GitHub

Community

The API version to use for this operation. This follows the YYYY-MM-DD format (e.g 2023-05-15)

The name of your Azure OpenAI Resource (e.g https://glide-test.openai.azure.com/)

This is your deployment name. You're required to first deploy a model before you can make calls (e.g. glide-gpt-35)

How often gateway should probe models with not the lowest response latency

The number of latency probes required to init moving average

Model instance ID (unique in scope of the router)

the list of models that could handle requests

retry when no healthy model is available to router

strategy on picking the next model to serve the request

Retrieve list of configured language routers and their configurations

Welcome to the Glide's documentation - The Cloud Native LLM Gateway

How to install and run Glide on your developer machine or bare metal setups

How to install Glide into a Kubernetes Cluster