> ## Documentation Index
> Fetch the complete documentation index at: https://docs.raily.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# LLM Providers

> The models Raily uses for its agentic layer, answers, and embeddings

Raily works with the major model providers. They are used in three places:

* **Agentic layer**: analyzes a query and rewrites it for better retrieval. See [Agentic Layer](https://docs.raily.ai/concepts/agentic-layer.md).
* **Answers**: generates the response from the retrieved passages in chat.
* **Embeddings**: turns your content and queries into vectors. You choose the embedding provider per collection when you connect a [vector store](https://docs.raily.ai/integrations/vector-store/overview.md).

By default, Raily runs these model calls on its own account. To bill query analysis, chat answers, source setup, quality evaluators, and LLM reranking to your own Google account instead, add your Google AI key. See [Use your own Google AI key](https://docs.raily.ai/integrations/model-keys.md). Embeddings and document processing still run on Raily.

> [card] OpenAI
>
> GPT for answers and OpenAI embeddings

> [card] Anthropic
>
> Claude for answers

> [card] Google
>
> Gemini for the agentic layer, answers, and embeddings

> [card] Vertex AI
>
> Google Vertex embeddings

> [card] AWS Bedrock
>
> Bedrock embeddings

> [card] Sentence Transformers
>
> Self-hosted open-source embeddings


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.