[FR]: Support for setting up multiple custom providers

[zrquan]

Proposal summary

Support for setting up multiple custom providers

Motivation

I tried using the models on two different servers and wanted to compare them in the playground, but it looks like there's no way to do that right now. Because I can't create two custom providers with different URLs at the same time.

[juanferrub]

Hi. @zrquan - Thanks for raising this feature request! 🙏

We definitely see the value in being able to configure multiple custom providers (e.g. different servers/URLs) so that you can compare models side by side in the playground. Right now you are right: the system only supports one custom provider per workspace, and both our backend and frontend assume this constraint.

Supporting multiple providers would require:
• Backend changes: our database schema currently enforces a single unique provider per workspace. Extracting provider logic from the model prefix would need an update.
• Frontend changes: the UI and flows are designed to assume one provider, so we’d need to rethink how providers are displayed, selected, and managed.

There are some potential workarounds (like limiting multiple prefixed custom providers), but those wouldn’t scale well or solve the problem properly. A proper solution would involve a deeper change to both FE and BE.

We’ve saved this request for consideration in our roadmap. In the meantime, if you could share a bit more about your use case (e.g. how often you’d need to switch between providers, or whether comparisons are mostly for development/testing vs. ongoing usage), that would help us prioritize and shape the right solution.

Thanks!

[zrquan]

Hi @juanferrub ! Thanks a bunch for your open-source work!

I get that you need some time to find the best solution.

if you could share a bit more about your use case

Right now my use case is: I'm comparing the response of different models when I'm developing prompts.