Skip to main content
AnythingLLM can connect to APIAny.AI through OpenAI-compatible settings. After setup, you can use chat, reasoning, translation, and multimodal models from the same client.

Prerequisites

  • AnythingLLM is installed.
  • You have created an API key in the APIAny.AI dashboard.
  • You have selected a model ID, such as gpt-5.4-mini or gpt-4o-mini.

Configuration values

Setup

  1. Open workspace settings and go to LLM configuration.
  2. Select Generic OpenAI.
  3. Enter the Base URL, API key, model name, and context window.
  4. Save and run a test chat in the workspace.

Walkthrough screenshots

The screenshots below show the key configuration screens in AnythingLLM. API names and endpoints have been adjusted for APIAny.AI.

Step 1

AnythingLLM setup screenshot 1

Step 2

AnythingLLM setup screenshot 2

Step 3

AnythingLLM setup screenshot 3

Troubleshooting

401 or authentication errors

Make sure the API key is copied completely, has no extra spaces, and is enabled in the APIAny.AI dashboard.

The model does not appear in the app

Enter the model ID manually and confirm it is available in the model catalog. Some tools do not fetch model lists automatically.

Which Base URL should I use?

OpenAI-compatible settings usually use https://apiany.ai/v1; Claude-compatible settings usually use https://apiany.ai; tools that ask for a full endpoint use https://apiany.ai/v1/chat/completions.