Lowp tae content
Leid: SCO-ULSTER
Menu

LLM gateway

Prism

Available

Ae model name wi several vendors ahint it.

Read the API reference Contack us

An OpenAI-compatible gateway fer large language models. Clients uise the yin model name wi several vendors ahin it. Whan a vendor rins oot o budget, pit on a rate limit or gaes doon, Prism fails ower tae the neist yin mid-request withoot interruptin the client. The API reference, testit agane the live gateway wi the client binaries thersels, documents oniehing that disnae wark.

Wha it is for. Teams that caa LLMs frae their ain tools an want the yin key an yin endpoint fer aal their vendors.

Status
Available
Pairt o
Core platform
Product site
prism.rodmena.co.uk/llms.txt
Tags
OpenAI-compatibleFailoverBearer auth

Whit it daes

  • Ae model name

    Clients name a model an Prism decides whilk vendor serves it.

  • Failover mid-request

    If a vendor is oot o budget, rate-limited or doon, the next yin taks ower athoot the client kennin.

  • OpenAI-compatible

    Existing clients and SDKs wirk onchanged apairt frae the base URL and key.

  • Tested API reference

    We testit the statements in the reference agane the live gateway an documentit the gaps we ken aboot.

Documentation an access details is on the product site, prism.rodmena.co.uk/llms.txt. For a pilot, an integration or procurement questions, contact us.