Discussions

Ask a Question
Back to All

Latency for Input and Output responses

Hi Sir,

I need to know the input and output latency, as we are connecting to an LLM. For example, if a user is attending a mock interview through an avatar, we need to understand the response latency for the avatar's replies.