Discussions
Streaming but with my own self-hosted LLM
about 2 months ago by ri.kwmachinelearning
Right now for the streaming API I see that the LLM used is OpenAI.
Is there a way for me to use my own source that will return a text string for the avatar to read out?
Thank you.