Configure LLM - Large Language Model

In this app, LLM is used for several purposes:

1. Extracting knowledge from docs;
2. Generating responses to user queries.

Configure the LLM

After login with admin account, you can configure the LLM in the admin panel.

1. Go to the admin panel;
2. Click on the LLMs tab;
3. Click on the + New button to add a new LLM;

4. Input your LLM information and click Create LLM button;

Supported LLMs

Currently we support the following LLMs:

• OpenAI (opens in a new tab)
• Gemini (opens in a new tab)
• OpenAI Like
  • OpenRouter (opens in a new tab)
    • Default config: {"api_base": "https://openrouter.ai/api/v1/"}
  • BigModel (opens in a new tab)
    • Default config:

    {
        "api_base": "https://open.bigmodel.cn/api/paas/v4/",
        "is_chat_model": true
    }
• Bedrock (opens in a new tab)
• Anthropic Vertex AI (opens in a new tab)
• Ollama (opens in a new tab)
  • Default config: {"base_url": "http://localhost:11434"}