Talks Streams Overview ๐Ÿ“™

โš ๏ธ Legacy Overview - Please Use Agents SDK / Agents Streams

The Talks/Clips Streams (Live Streaming API) endpoints are a legacy feature.

While they remain supported for existing integrations, we highly encourage developers to use the newer Agents SDK or the Agents Streams going forward.


Why migrate?

  • Better performance & lower latency
  • Easier integration with the Agents SDK - no need to manage WebRTC and API calls manually
  • Same core functionality (real-time video streaming) plus more:
    • Real-time video responses from the LLM, enhanced with Knowledge and RAG.
    • Advanced features like Fluent streaming + Interrupt (for Premium+ avatars) and upcoming capabilities
  • Future-proof: all new features will be released only for Agents SDK / Agents Streams
  • Same pricing as Talks/Clips Streams

๐Ÿ‘‰ If youโ€™re just getting started: skip this page and head to Agents SDK / Agents Streams

๐Ÿ‘‰ If you need to maintain an existing Talks/Clips Streams integration, see the Legacy mapping below to migrate smoothly.


โœด๏ธ Legacy mapping

If youโ€™re migrating from the old Talks/Streams or Clips/Streams see the following mapping to transition smoothly:

Legacy endpoint

Agents SDK equivalent

Agents Streams equivalent

Create a new Stream

POST /talks/streams

POST /clips/streams

agentManager.connect()

POST /agents/{agentId}/streams

Start a WebRTC connection

POST /talks/streams/{streamId}/sdp

POST /clips/streams/{streamId}/sdp

Handled by agentManager.connect()

POST /agents/{agentId}/streams/{streamId}/sdp

Submit network information

POST /talks/streams/{streamId}/ice

POST /clips/streams/{streamId}/ice

Handled by agentManager.connect()

POST /agents/{agentId}/streams/{streamId}/ice

Text/Audio input โ†’ Avatar reply

Create a talk stream

POST /talks/streams/{streamId}

Create a clip stream

POST /clips/streams/{streamId}

agentManager.speak()

Create a video stream

POST /agents/{agentId}/streams/{streamId}

LLM response โ†’ Avatar reply

N/A

agentManager.chat()

Create a chat

POST /agents/{agentId}/chat

Send a message to a Chat

POST /agents/{agentId}/chat/{chatId}

Close stream

DELETE /talks/streams/{streamId}

DELETE /clips/streams/{streamId}

agentManager.disconnect()

DELETE /agents/{agentId}/streams/{streamId}

Note: Most WebRTC client code (SDP/ICE handlers, RTCPeerConnection wiring) is reusable from the previous demo repository. You can still use that repository as a starting point - just update the API calls to the new Agents Streams endpoints. Keep in mind that creating an Agent is a prerequisite before starting a stream.

When using the SDK, all of this is handled for you through simple functions, making integration much easier.


โœด๏ธ Support


Have any questions? We're here to help! Just click the Contact Support button below, and we'll be happy to answer shortly.

Contact Support