Model Access
Connect a model provider, browse the marketplace (featured models, search, install all), install models for an org or a project, edit grants and auth modes, and what withdrawn models mean.
Preview. Model access 1.0 is built and merged but not deployed yet. Names, screens and defaults on this page can change before release.
Model access is the part that decides which models your org may use and how. The path is the same for every model:
- Connect a provider once.
- Install the models you want from the marketplace, for the org or for one project.
- Adjust the grant if you want to narrow the auth modes, efforts or projects.
- Point stages and cards at them. See Choosing Models.
You never need a profile for each model and effort combination. A profile is an optional constraint on top.
Terms
| Term | Meaning |
|---|---|
| Provider connection | Your org's connected provider: a credential you supplied, or the platform's metered pool. |
| Catalog model | A model the platform lists, with its efforts and default effort. Operators maintain the catalog. |
| Library entry | A catalog model installed for your org. |
| Grant | What your org permits on an entry: auth modes, efforts and projects. A project can narrow it. It never widens it. |
Connect a provider
Open Settings, then Integrations. There is one tile per provider kind, including gateway providers such as Vercel AI Gateway. Enter the provider's key and save.
Connecting a provider does two things:
- It links the provider to models you have already installed, so an entry that was waiting for a provider becomes ready.
- It makes that provider's catalog models available to install.
Right after an LLM provider connects, the page offers Install featured provider models (n), which installs the provider's featured models in one step, and Choose…, which opens the marketplace filtered to that provider.
Which models are available to you
A model is available to your org when at least one provider serving of it can run under at least one auth mode:
| Auth mode | Available when |
|---|---|
byok | You connected a key for a provider that serves the model. |
metered | Your org is entitled to metered, and the platform holds a key for that provider. You do not connect anything. |
local | You have a credential for a provider that serves the model locally. |
host-session | The model lists host-session and a host-session route exists. |
If the metered entitlement cannot be read, metered is treated as unavailable. It never defaults to allowed. The marketplace shows each model's Available via modes.
The marketplace
Open the Marketplace and choose Models. Org admins can install; other members and every project view are read-only.
- Featured first. Models an operator has featured sit in a Featured band at the top.
- Search. Type in the search box. The server searches display name, model id, canonical name and provider. You can also filter by provider, by capability tag such as
tools, and by whether your org can run the model now. - Load more. Results load 50 at a time (at most 100 per request), with Load more for the rest. The price limit and the sort order apply only to the models loaded so far, and the page says so.
- Status. Each card shows whether an installed model is ready, needs a provider, or needs attention.
One card represents one model, even when several providers serve it.
Install for the org
Select Install for org on a card. Org admins only. If more than one of your providers can serve the model, a chooser lets you pick which provider is primary and which are fallbacks.
If no provider can serve the model for your org, the install is refused with model_not_available, and nothing is created. Connect a provider first. A model an operator has withdrawn cannot be installed.
Install all
Install all installs a provider's featured models, or a list you choose, in one request. It is bounded: there is no "install everything from this gateway".
POST /api/marketplace/models/install-batch{ "provider": "vercel-gateway", "selection": { "kind": "featured" } }or, for chosen models:
{
"provider": "vercel-gateway",
"selection": { "kind": "ids", "catalogIds": ["<catalog-id>", "<catalog-id>"] }
}- At most 50 ids per request. If a provider has more than 50 featured models, the request is refused with
too_many_featuredand nothing is installed; use Choose… instead. - Each model installs on its own, and the response reports one result per model:
installed,already_installed,unavailableorfailed. One failure does not undo the others. - Every installed model gets the full set of efforts and the auth modes your org can actually run it with.
- Each created entry writes one audit event. The events from one request share a bulk operation id so they can be read back together.
- It needs an org admin signed in as a person. An API key cannot install models.
Install for a project
An install can be scoped to one project by passing projectId:
POST /api/marketplace/models/{id}/install{ "projectId": "<project-id>" }- If the model is not installed yet, a new entry is created that includes only that project.
- If it is already installed, the entry gains that project, and nothing else about the grant changes. A project install can never widen what the org admin set for other projects.
projectIdcannot be combined withgrant.includedProjectIds.- It still requires an org admin. The
install-batchrequest acceptsprojectIdthe same way.
The Marketplace opened from inside a project lists models for reading but has no install button, so project installs go through the API for now.
Auth modes and grants
An entry carries the org's grant: which auth modes it may run under, which efforts, and which projects. A new entry starts open: every auth mode a serving offers, all efforts (including future ones), and all projects.
To start narrower, pass a grant when you install:
{ "grant": { "authModes": ["byok"], "efforts": ["low", "medium", "high"] } }Every mode and effort must be offered by a live serving of the model, and metered also needs your org's entitlement.
Edit a grant
Open Settings, then Models. Each installed model shows what it permits, and org admins can change it:
| Control | What it sets |
|---|---|
| Auth modes | Which of byok, metered, local and host-session the org permits. Only modes a live serving offers can be ticked, and Metered is disabled unless your org is entitled. |
| Efforts | All efforts, including future ones, or a chosen list. |
| Projects | All projects, including future ones, or only the ones you tick. |
| BYOK credential per serving | Which of your credentials a serving uses, or the org default credential. |
Select Save grant. Switching from all projects to selected projects requires you to name the included projects in the same save. Grant changes are audited, and saving an unchanged grant writes nothing.
A project can narrow what the org permits, for that model only: which auth modes, which efforts, whether the project is included, or whether it is disabled entirely.
PUT /api/org/{orgId}/model-library/entries/{entryId}/projects/{projectId}{ "included": true, "disabled": false, "authModes": ["byok"], "efforts": null }null for authModes or efforts means no narrowing. included matters only when the entry's project scope is selected, and disabled denies the project under either scope. Both routes are for org admins.
Warnings on an installed model
| Warning | Meaning |
|---|---|
| No provider serves this model yet | Connect a provider to use it. |
| Grant permits an auth mode no serving offers | Saving the grant drops it. |
| Grant permits an effort no serving offers | Saving the grant drops it. |
| Metered is permitted but the org is not entitled | Metered cannot run until the org is entitled. |
| No project is included | No project can use the model. |
| Stored grant is malformed | The model cannot dispatch until the grant is saved again. |
| A provider serving was withdrawn from the catalog | It still runs, but cannot be installed again. |
Who can do what
| Action | Minimum role |
|---|---|
| Browse the marketplace and read installed models | Org member |
| Install, edit grants, narrow projects | Org admin (a person, not an API key, for installs) |
Withdrawn models
An operator can withdraw a model so that no org can see or install it, and can restore it later. Withdrawing is not deprecating, and it never breaks a working setup:
- The model disappears from the marketplace and cannot be installed again.
- Existing installs keep running. Settings shows the entry with "withdrawn from the catalog (still runs)" and the entry warning above. Runs on it carry a warning on the receipt.
- A
followselection skips withdrawn models. Apinnedselection on one keeps working.
If a model you depend on is withdrawn, pin or follow a replacement, or ask your platform operator whether it will be restored.
Operators
Platform operators curate the catalog: they can import many models from a gateway at once, feature a subset so it shows first in every org's marketplace, and withdraw or restore models. See the operator Model Catalog reference.
Related pages
Choosing Models
How a run gets its model: the resolution order from node pin to system, the model selection values (pinned, follow, profile, router, inherit with effort), default effort, and profiles as optional constraints.
Auth Modes
How the platform resolves a single auth mode from a profile's auth_modes set; preference order, scope narrowing, and per-mode behavior.