Skip to content

Conversation

@rumpl
Copy link
Member

@rumpl rumpl commented Dec 9, 2025

The runtime will save intermediate messages it gets during a loop

@rumpl rumpl requested a review from a team as a code owner December 9, 2025 08:35
@rumpl rumpl force-pushed the runtime-session-store branch 3 times, most recently from e190585 to 3eabf4c Compare December 9, 2025 09:16
// Start a recording AI proxy to record and replay traffic.
svr, _ := startRecordingAIProxy(t)
args = append(args, "--models-gateway", svr.URL)
args = append(args, "--models-gateway", svr.URL, "--session-db", "/tmp/session.db")
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What happens when tests run concurrently?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The store should be able to handle concurrent requests so this is fine.

}

type InMemorySessionStore struct {
sessions map[string]*Session
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can this store be shared between multiple sessions? Should it be synchronised?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated

@rumpl rumpl force-pushed the runtime-session-store branch from 3eabf4c to d76f278 Compare December 9, 2025 09:27
The runtime will save intermediate messages it gets during a loop

Signed-off-by: Djordje Lukic <[email protected]>
@rumpl rumpl force-pushed the runtime-session-store branch from d76f278 to 02daf90 Compare December 9, 2025 09:29
@dgageot dgageot merged commit 51a4255 into docker:main Dec 9, 2025
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants