Right now there is no explicit routing strategy. I think currently we can simply add multiple variants and have it be load balanced uniformly.

But with so many providers having lots of options such as priority service tier, PTUs etc. a more flexible way to control routing is desirably.

LiteLLM does have multiple options but it seems kind of disjointed.

Are there any plans to implement a more complex routing strategy that can be configured?