Lowp tae content
Leid: SCO-ULSTER
Menu

LLM gateway

Prism

Available

Ae model name wi several vendors ahint it.

Read the API reference Contack us

A OpenAI-compatible gateway for muckle language models. Clients uise ae model name wi several vendors ahint it. Whan a vendor rins oot o budget, applies a rate limit or gaes doon, Prism fails ower tae the nixt ane mid-request athoot interruptin the client. The API reference wis testit agin the live gateway wi the client binaries thairsels, an it documents onythin that disnae wirk.

Wha it is for. Teams that cry LLMs fae their ain tools an want ae key an ae endpoint for ilka vendor.

Status
Available
Pairt o
Core platform
Product site
prism.rodmena.co.uk/llms.txt
Tags
OpenAI-compatibleFailoverBearer auth

Whit it daes

  • Ae model name

    Clients name a model an Prism decides whilk vendor serves it.

  • Failover mid-request

    If a vendor is oot o budget, rate-limited or doon, the next yin taks ower athoot the client kennin.

  • OpenAI-compatible

    Existing clients and SDKs wirk onchanged apairt frae the base URL and key.

  • Tested API reference

    Ilka statement in the reference wis tested agin the live gateway, an kent gaps is documented.

Documentation an access details is on the product site, prism.rodmena.co.uk/llms.txt. For a pilot, an integration or procurement questions, contact us.