Lowp tae content
Leid: SCO
Menu

LLM gateway

Prism

Available

Ae model name wi several vendors ahint it.

Read the API reference Contact us

An OpenAI-compatible gateway for large language models. Clients uise ae model name wi sindry vendors ahint it. Whan a vendor rins oot o budget, applies a rate limit or gangs doun, Prism fails ower tae the neist ane mid-request withoot interruptin the client. The API reference, testit agin the live gateway wi the client binaries thairsels, documents onything that disna wirk.

Wha it is for. Teams that cry on LLMs frae their ain tuils an want ae key an ae endpoint for aw their vendors.

Status
Available
Pairt o
Core platform
Product site
prism.rodmena.co.uk/llms.txt
Tags
OpenAI-compatibleFailoverBearer auth

Whit it dis

  • Ae model name

    Clients name a model and Prism decides which vendor serves it.

  • Failover mid-request

    Gin a vendor is oot o budget, rate-limited or doun, the nixt ane taks ower athoot the client noticin.

  • OpenAI-compatible

    Existing clients and SDKs wirk onchanced apairt frae the base URL and key.

  • Testit API reference

    We testit the statements in the reference agin the live gateway an documentit the gaps we ken o.

Documentation and access details are on the product site, prism.rodmena.co.uk/llms.txt. For a pilot, an integration or procurement questions, contact us.