How to make the live stream work with custom data

Hi,

I have to build an avatar that answer questions given by speech to the avatar. The avatar should accept specific data to talk to. I've thought in training my own LLM using Langchain and GPT.

How can I do it to make it work by talking and answering from the custom LLm created with Langchain? Is it possible? or it just works with ChatGPT?

Appreciate your time