Lowp tae content
Leid: SCO
Menu

LLM gateway

Prism

Available

Ae model name wi several vendors ahint it.

Read the API reference Contact us

A gateway for muckle language models that is compatible wi OpenAI. Clients uise ae model name wi several vendors ahint it. Whan a vendor rins oot o budget, applies a rate limit or gaes doon, Prism fails ower tae the nixt ane mid-request athoot interruptin the client. The API reference wis testit against the live gateway wi the client binaries thairsels, an it documents onything that disna work.

Wha it is for. Teams that cry LLMs frae their ain tools and want ae key and ae endpoint for ilka vendor.

Status
Available
Pairt o
Core platform
Product site
prism.rodmena.co.uk/llms.txt
Tags
OpenAI-compatibleFailoverBearer auth

Whit it dis

  • Ae model name

    Clients name a model and Prism decides which vendor serves it.

  • Failover mid-request

    Gin a vendor is oot o budget, rate-limited or doun, the nixt ane taks ower athoot the client noticin.

  • OpenAI-compatible

    Existing clients and SDKs wirk onchanced apairt frae the base URL and key.

  • Testit API reference

    Ilka statement in the reference wis testit against the live gateway, and kent gaps are documentit.

Documentation and access details are on the product site, prism.rodmena.co.uk/llms.txt. For a pilot, an integration or procurement questions, contact us.