Docs
LLM - Large Language Model

Configure LLM - Large Language Model

In this app, LLM is used for several purposes:

  1. Extracting knowledge from docs;
  2. Generating responses to user queries.

Configure the LLM

After login with admin account, you can configure the LLM in the admin panel.

  1. Go to the admin panel;
  2. Click on the LLMs tab;
  3. Click on the + New button to add a new LLM;

llm-config

  1. Input your LLM information and click Create LLM button;
  2. Done!
💡

If you want to use the new LLM while answering user queries, you need switch to Chat Engines tab and set the new LLM as LLM.

Supported LLMs

Currently we support the following LLMs:

Deploy with DockerChat Engine