Skip to content

Forward audio inputs to the Responses API - #33932

Merged
copyberry[bot] merged 1 commit into
mainfrom
copyberry/codex-internal-to-codex-oss/f72cd6b6e43ab12757eeb47621b1d670594ac7d9
Jul 18, 2026
Merged

Forward audio inputs to the Responses API#33932
copyberry[bot] merged 1 commit into
mainfrom
copyberry/codex-internal-to-codex-oss/f72cd6b6e43ab12757eeb47621b1d670594ac7d9

Conversation

@copyberry

@copyberry copyberry Bot commented Jul 18, 2026

Copy link
Copy Markdown

Forward audio inputs to the Responses API

Why

Audio variants were available in the user-input protocol but were replaced with unsupported-input placeholders instead of being sent to the model.

What changed

  • Serialize audio data URLs as input_audio content and convert local wav, mp3, m4a, webm, and ogg files to labeled data URLs.
  • Validate and canonicalize base64 audio before requests, enforce the 50 MiB input limit, and replace invalid, unsupported, or oversized audio with explanatory text.
  • Preserve audio attachments when mapping response items back to user-message events and document the app-server input variants.

Testing

  • Add unit coverage for local-file conversion, data URL validation, size and format errors, event mapping, and attachment extraction.
  • Add client tests that verify data URL and local audio payloads sent to the Responses API.

## Why

Audio variants were available in the user-input protocol but were replaced with unsupported-input placeholders instead of being sent to the model.

## What changed

- Serialize audio data URLs as `input_audio` content and convert local `wav`, `mp3`, `m4a`, `webm`, and `ogg` files to labeled data URLs.
- Validate and canonicalize base64 audio before requests, enforce the 50 MiB input limit, and replace invalid, unsupported, or oversized audio with explanatory text.
- Preserve audio attachments when mapping response items back to user-message events and document the app-server input variants.

## Testing

- Add unit coverage for local-file conversion, data URL validation, size and format errors, event mapping, and attachment extraction.
- Add client tests that verify data URL and local audio payloads sent to the Responses API.

GitOrigin-RevId: f72cd6b6e43ab12757eeb47621b1d670594ac7d9
@copyberry
copyberry Bot force-pushed the copyberry/codex-internal-to-codex-oss/f72cd6b6e43ab12757eeb47621b1d670594ac7d9 branch from e8fb3c9 to 23899f7 Compare July 18, 2026 00:27
@copyberry
copyberry Bot merged commit 23899f7 into main Jul 18, 2026
32 checks passed
@copyberry
copyberry Bot deleted the copyberry/codex-internal-to-codex-oss/f72cd6b6e43ab12757eeb47621b1d670594ac7d9 branch July 18, 2026 00:28
@github-actions github-actions Bot locked and limited conversation to collaborators Jul 18, 2026
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants