> For the complete documentation index, see [llms.txt](https://docs.instruqt.com/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.instruqt.com/ai-capabilities/connect-ai-models.md).

# Connect AI Models

Use AI models in your content via your cloud accounts

You can connect your own AI models to the platform and use them directly inside your labs and training content. This means you can build AI-focused content and hands-on exercises using the same models your organisation already runs in production.

To connect a model, you bring it in through a supported cloud account. Currently supported providers are Google Vertex AI and Amazon Bedrock.

***

#### How to Connect a Model to Your Content

The AI service must be enabled in your cloud provider settings before you can connect it to the platform. Only account owners can do this.

Once that is done:

1. Add a cloud account to your track.
2. Enable the relevant AI service within that account.

***

#### Supported Models

Only text-based models are supported. Image and video generation models cannot be connected at this time.

The tables below list all currently supported models. If a model you need is not listed, you can request it and we will review it.

#### Google Vertex AI

{% hint style="info" %}
**Anthropic models are not available on Vertex AI.** Enabling Anthropic models in GCP requires completing a form in the Model Garden for each model. This process cannot be automated, so Anthropic models are not currently supported through Vertex AI. We recommend using AWS Bedrock for Anthropic models instead.
{% endhint %}

| Provider | Model                         |
| -------- | ----------------------------- |
| DeepSeek | deepseek-v3.1-maas            |
| DeepSeek | deepseek-v3.2-maas            |
| Google   | gemini-2.0-flash-001          |
| Google   | gemini-2.0-flash-lite-001     |
| Google   | gemini-2.5-flash-lite         |
| Google   | gemini-2.5-flash              |
| Google   | gemini-2.5-pro                |
| Google   | gemini-3-flash-preview        |
| Google   | gemini-3-pro-preview          |
| Google   | gemini-3.1-flash-lite-preview |
| Google   | gemini-3.1-flash-lite         |
| Google   | gemini-3.1-pro-preview        |
| Google   | gemini-3.5-flash-lite         |
| Google   | gemini-3.5-flash              |
| Google   | gemini-3.6-flash              |
| Google   | gemini-3.7-flash              |
| Google   | gemma-4-26b-a4b-it-maas       |
| Meta     | llama-3.1-405b-instruct-maas  |
| Meta     | llama-3.3-70b-instruct-maas   |
| Mistral  | codestral-2                   |
| Mistral  | mistral-medium-3              |
| Mistral  | mistral-small-2503            |
| OpenAI   | gpt-oss-120b-maas             |

#### Amazon Bedrock

{% hint style="info" %}
**Anthropic models require all regions within a geography to be enabled.** Anthropic models on Bedrock use cross-region inference, which routes requests across all regions in a geography. You must enable model access in every region within the geography you want to use. For example, to use the US geography you need to enable all US regions: us-east-1, us-east-2, us-west-1, and us-west-2.

The first time an Anthropic model is used in a new sandbox, AWS finishes enabling it in the background and this can take a few minutes, as per [AWS documentation](https://docs.aws.amazon.com/bedrock/latest/userguide/model-access.html). Calls made during that time can fail with an access denied error mentioning AWS Marketplace. Retry after a few minutes.
{% endhint %}

| Provider  | Model                           |
| --------- | ------------------------------- |
| Amazon    | nova-micro-v1:0                 |
| Amazon    | nova-lite-v1:0                  |
| Amazon    | nova-pro-v1:0                   |
| Amazon    | nova-2-lite-v1:0                |
| Amazon    | titan-embed-text-v2:0           |
| Anthropic | claude-haiku-4-5-20251001-v1:0  |
| Anthropic | claude-opus-4-5-20251101-v1:0   |
| Anthropic | claude-opus-4-6-v1              |
| Anthropic | claude-sonnet-4-5-20250929-v1:0 |
| Anthropic | claude-sonnet-4-6               |
| DeepSeek  | v3-v1:0                         |
| DeepSeek  | v3.2                            |
| Google    | gemma-3-4b-it                   |
| Google    | gemma-3-12b-it                  |
| Google    | gemma-3-27b-it                  |
| Meta      | llama3-1-405b-instruct-v1:0     |
| Meta      | llama3-3-70b-instruct-v1:0      |
| Mistral   | devstral-2-123b                 |
| Mistral   | ministral-3-8b-instruct         |
| OpenAI    | gpt-oss-120b-1:0                |

***

#### Requesting Additional Models

If you need a model that is not listed above, contact support to submit a request. Requests are reviewed on a case-by-case basis.

***

### FAQ

<details>

<summary>Which cloud providers are supported?</summary>

Google Vertex AI and Amazon Bedrock are currently supported. Additional providers may be added over time.

</details>

<details>

<summary>Can I use any model available in Vertex AI or Bedrock?</summary>

No. Only the models listed on this page are supported.

All other models are unavailable by default. If you need a model that is not listed, contact support to request it.

</details>

<details>

<summary>Who can connect a cloud account?</summary>

The AI service must be enabled in your cloud provider settings by an account owner or administrator before anyone can connect it on the platform.

</details>

<details>

<summary>Are there limits on how much I can use a model?</summary>

Yes. Token limits apply to model usage on the platform.

For details on current limits, contact your customer success team.

</details>

<details>

<summary>Can I set custom limits for my organisation?</summary>

Custom usage limits are not available yet but are planned for a future release.

</details>

<details>

<summary>Can I use image or video generation models?</summary>

No. Only text-based models are supported at this time. Image and video generation models cannot be connected.

</details>

<details>

<summary>What if the model I need is not on the supported list?</summary>

You can request additional models through support. Requests are reviewed on a case-by-case basis and we will let you know the outcome.

</details>
