feat: Add Anthropic SDK message-per-token guide #3073
+364
−0
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
Important Review skippedAuto reviews are disabled on this repository. Please check the settings in the CodeRabbit UI or the You can disable this status message by setting the Comment |
aebe2c1 to
ea0ac8d
Compare
56c9bdb to
6b1fccd
Compare
6b1fccd to
15db8e7
Compare
mschristensen
approved these changes
Jan 13, 2026
Contributor
mschristensen
left a comment
There was a problem hiding this comment.
Nice, thanks, couple of small comments to address but approving ahead of that :)
|
|
||
| Using Ably to distribute tokens from the Anthropic SDK enables you to broadcast AI responses to thousands of concurrent subscribers with reliable message delivery and ordering guarantees, ensuring that each client receives the complete response stream with all tokens delivered in order. This approach decouples your AI inference from client connections, enabling you to scale agents independently and handle reconnections gracefully. | ||
|
|
||
| <Aside data-type="note"> |
Contributor
There was a problem hiding this comment.
Suggested change
| <Aside data-type="note"> | |
| <Aside data-type="further-reading"> |
|
|
||
| - [`message_start`](https://platform.claude.com/docs/en/build-with-claude/streaming#event-types): Signals the start of a response. Contains a `message` object with an `id` to correlate subsequent events. | ||
|
|
||
| - [`content_block_start`](https://platform.claude.com/docs/en/build-with-claude/streaming#event-types): Indicates the start of a new content block. For text responses, the `content_block` will have `type: "text"`. |
Contributor
There was a problem hiding this comment.
Suggested change
| - [`content_block_start`](https://platform.claude.com/docs/en/build-with-claude/streaming#event-types): Indicates the start of a new content block. For text responses, the `content_block` will have `type: "text"`. | |
| - [`content_block_start`](https://platform.claude.com/docs/en/build-with-claude/streaming#event-types): Indicates the start of a new content block. For text responses, the `content_block` will have `type: "text"`; other types may be specified, such as `"thinking"` for internal reasoning tokens. The `index` indicates the position of this item in the message's `content` array. |
|
|
||
| - [`content_block_start`](https://platform.claude.com/docs/en/build-with-claude/streaming#event-types): Indicates the start of a new content block. For text responses, the `content_block` will have `type: "text"`. | ||
|
|
||
| - [`content_block_delta`](https://platform.claude.com/docs/en/build-with-claude/streaming#content-block-delta-types): Contains a text delta in the `delta.text` field. Use the `index` to correlate deltas relating to a specific content block. |
Contributor
There was a problem hiding this comment.
Suggested change
| - [`content_block_delta`](https://platform.claude.com/docs/en/build-with-claude/streaming#content-block-delta-types): Contains a text delta in the `delta.text` field. Use the `index` to correlate deltas relating to a specific content block. | |
| - [`content_block_delta`](https://platform.claude.com/docs/en/build-with-claude/streaming#content-block-delta-types): Contains a single text delta in the `delta.text` field. If `delta.type === "text_delta"` the delta contains model response text; other types may be specified, such as `"thinking_delta"` for internal reasoning tokens. Use the `index` to correlate deltas relating to a specific content block. |
|
|
||
| - [`content_block_delta`](https://platform.claude.com/docs/en/build-with-claude/streaming#content-block-delta-types): Contains a text delta in the `delta.text` field. Use the `index` to correlate deltas relating to a specific content block. | ||
|
|
||
| - [`content_block_stop`](https://platform.claude.com/docs/en/build-with-claude/streaming#event-types): Signals completion of a content block. |
Contributor
There was a problem hiding this comment.
Suggested change
| - [`content_block_stop`](https://platform.claude.com/docs/en/build-with-claude/streaming#event-types): Signals completion of a content block. | |
| - [`content_block_stop`](https://platform.claude.com/docs/en/build-with-claude/streaming#event-types): Signals completion of a content block. Contains the `index` that identifies content block. |
|
|
||
| - [`content_block_stop`](https://platform.claude.com/docs/en/build-with-claude/streaming#event-types): Signals completion of a content block. | ||
|
|
||
| - [`message_delta`](https://platform.claude.com/docs/en/build-with-claude/streaming#event-types): Contains additional message-level metadata that may be streamed incrementally. |
Contributor
There was a problem hiding this comment.
Suggested change
| - [`message_delta`](https://platform.claude.com/docs/en/build-with-claude/streaming#event-types): Contains additional message-level metadata that may be streamed incrementally. | |
| - [`message_delta`](https://platform.claude.com/docs/en/build-with-claude/streaming#event-types): Contains additional message-level metadata that may be streamed incrementally. Includes a [`delta.stop_reason`](https://platform.claude.com/docs/en/build-with-claude/handling-stop-reasons) which indicates why the model successfully completed its response generation. |
| import Anthropic from '@anthropic-ai/sdk'; | ||
|
|
||
| // Initialize Anthropic client | ||
| const anthropic = new Anthropic(); |
Contributor
There was a problem hiding this comment.
We should remove the references to the anthropic client in this code block, as it is not relevant to what is being documented (this has been fixed in the openai guides already)
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
AIT-204
Similar to #3024, add a guide for message-per-token streaming using Ably and the Anthropic SDK.
The guide includes working code examples, proper setup instructions, and demonstrates the complete workflow from API key setup through running multiple concurrent streaming responses.
Review App
Checklist