Skip to content

Models and Providers

Glue ships with a curated catalog. Selected models are always written as provider/model — for example anthropic/claude-sonnet-4-6. Credentials never live in project config; they come from env vars, ~/.glue/credentials.json, or an OS keychain layer later.

Canonical source: docs/reference/models.yaml.

shipping
Anthropic, OpenAI, Gemini, Mistral, Groq, and other hosted providers.
ModelProviderCapabilitiesNotes

Local models

Ollama runs on localhost; capability depends on hardware.
ModelProviderCapabilitiesNotes

OpenAI-compatible endpoints

Any endpoint that speaks the OpenAI wire format can be added with adapter: openai. That includes Groq, Ollama, vLLM, LM Studio, and OpenRouter — each listed separately in the catalog because their base URLs and auth differ, not because the wire format does.

~/.glue/models.yaml — OpenAI-compatible provider
yaml
providers:
  local-vllm:
    adapter: openai
    base_url: http://localhost:8000/v1
    auth:
      api_key: none

Minimal config

~/.glue/config.yaml — quickest path to a running agent
yaml
active_model: anthropic/claude-sonnet-4-6

Credentials come from the environment in this example (ANTHROPIC_API_KEY). To override any catalog entry or add a provider of your own, drop a models.yaml into ~/.glue/ — it merges on top of the bundled catalog.

Configuration reference →

Released under the MIT License.