How this works

AI in a Box is a product that gives you access to a self-hosted large language model server (llm) and a vector database (vectordb).

It’s designed in a way that only the midsever included with it can access the llm and vectordb. This is to ensure that the data is secure and that the llm and vectordb are not used for any other purpose than the intended use case.