Managing providers in AI Runtime Control

AI Runtime Control (ARC) routes your traffic to LLM services called providers (for example, Anthropic). Before ARC can route requests to a provider, you add it with its credentials and the models you want to allow. Once you've added your providers, ARC gives you a single place to see and manage every LLM service your traffic routes to.

This guide describes how to add, edit, and remove providers.

Before you begin

Keep in mind the following:

• To manage ARC providers, you must be assigned the superuser role.
• Adding a provider requires a base URL and an API key. Refer to your LLM provider's documentation for exact instructions on how to find these details.

Add a provider

To add a new provider to AI Runtime Control, follow these steps.

1. Log in to the Fastly control panel.
2. Go to Tools > AI Runtime Control.
3. Click the Providers tab.
4. Click Add, then select a provider. The provider form appears.
5. (Optional) If the provider offers a choice of Authentication type, select the type you want to use. The credential fields on the form change to match your selection.
6. Enter the authentication credentials for your provider. For most providers, this is the API key field.
7. In the Model permissions, do one of the following:
   • To make every LLM model available for this provider, select Allow all models.
   • To limit access to specific LLM models for this provider, select Limit model access and then select which models to allow. The selected models appear in the Allowed models list.
8. Click Save. The new provider appears on the Providers tab.

Edit a provider

To edit an existing provider in AI Runtime Control, follow these steps.

1. Log in to the Fastly control panel.
2. Go to Tools > AI Runtime Control.
3. Click the Providers tab.
4. Find the appropriate provider card and click Edit.
5. Update the provider's authentication credentials or Model permissions fields as needed.
6. Click Save. The displayed provider's details are updated.

Remove a provider

To remove an existing provider from AI Runtime Control, follow these steps.

1. Log in to the Fastly control panel.
2. Go to Tools > AI Runtime Control.
3. Click the Providers tab.
4. Find the appropriate provider card and click Details.
5. Click Remove.
6. Confirm your choice by clicking Remove provider. The provider is removed from your list of AI Runtime Control Providers.

Viewing provider details

To view details about a provider, follow these steps.

1. Log in to the Fastly control panel.
2. Go to Tools > AI Runtime Control.
3. Click the Providers tab.
4. Find the appropriate provider card and click Details. The provider details appear.