Add support for OpenAI Conversations

[franciscojavierarceo]

🚀 Describe the new functionality needed

The full documentation is here: https://platform.openai.com/docs/api-reference/conversations

Requires

1. Create
2. Retrieve
3. Update
4. Delete
5. List items
6. Create items
7. Retrieve item
8. Delete item

💡 Why is this needed? What if we don't build it?

Required to deprecate Agents

Other thoughts

Based on discussion here

[ashwinb]

I'd love to hear what @bbrowning / @mattf think about this as well. Given our aggressive adoption of OpenAI APIs this seems like the way to move forwards and remove Agents.

[bbrowning]

So, the Conversations API is new enough that I haven't fully digested its additions. However, I think https://platform.openai.com/docs/assistants/migration may be helpful when thinking about our Agents API and how we'd migrate users to some more widely supported equivalent.

In the OpenAI APIs, Conversations are a server-side collection of messages, tool calls, tool outputs, etc. These are essentially conversation state, along with an API to manage that state for each Conversation.

Our Agents API also associated a model and a list of tools with each Agent. This is more akin to the old OpenAI Assistants API - Assistants were persistent API objects that bundled model choice, instructions, and tool declarations—created and managed entirely through the API. And in the OpenAI space, model choice, instructions, and tool declarations are now Prompts. However, the only API exposed for prompts is to reference one (along with an associated variables) when creating a Responses API request. There's no formal API to manage Prompts.

Can we fully migrate users off Agents without Prompts, and just using Responses and Conversations? We may be able to, but that might need some investigation to prove out. I think the Responses + Conversations API surface covers all the important bits, but we should consider mapping out a few example apps with pseudo-code or something else to show before/after of Agents API vs Responses + Conversations APIs.

[franciscojavierarceo]

However, the only API exposed for prompts is to reference one (along with an associated variables) when creating a Responses API request. There's no formal API to manage Prompts.

It seems relatively simple: https://platform.openai.com/docs/guides/prompting#create-a-prompt

@mattf was preferential towards this in the community call today. So I'm happy to implement this.

[bbrowning]

Also note that it's not just the new Conversations API but also the conversations parameters to Create Responses requests.