investigate cost optimizations #11
Description
andrewsu
Issue body actions
- Batch processing -- can be used for mass profile creation
- Prompt caching -- for multi-turn conversations
- after 2-party conversations are initiated, perhaps we can allow them to do quick iteration/execution on that conversation specifically to best leverage caching?
Reactions are currently unavailable