I feel like this should be a very common pattern, but I am trying to use Langroid to build an AI agent that connects to an LLM agent I am hosting myself on azure. I cannot find anywhere in the Langroid docs that states how to point the chat agent to my cloud LLM. There is a lot of documentation around using it with a locally hosted LLM, but nothing cloud based. Is this something that Langroid allows? For context, I am hosting ollama using mixtral LLM. Continue reading...
