LLM Provider Settings

Configure the AI provider used by all users

Admin Only
Endpoint for Ollama or OpenAI-compatible providers.
Stored encrypted in the database.
An API key is already saved.
0 = deterministic, 2 = creative
Embedding Compute Device

Controls which hardware runs the embedding model. Requires app restart to take effect.

Run this in your terminal after saving, then restart the app.
Model Suggestions

OpenAI

  • gpt-4o
  • gpt-4-turbo
  • gpt-3.5-turbo

Anthropic

  • claude-3-5-sonnet-20241022
  • claude-3-opus-20240229
  • claude-3-haiku-20240307

Ollama

  • mistral-small3.1
  • llama3.1
  • gemma2

Groq (Generic)

  • Base URL: https://api.groq.com/openai/v1/chat/completions
  • llama-3.1-70b-versatile
Security
API keys are encrypted with Fernet symmetric encryption before being stored in the database. Set ENCRYPTION_KEY in your .env to a stable 44-character Fernet key. Generate one with: 
python -c "from cryptography.fernet import Fernet; print(Fernet.generate_key().decode())"