Introducing any-llm Gateway 🚀
In release 1.2.0 we're excited to release the any-llm gateway: allowing you to manage users, budgets, and LLM providers in your infrastructure.
Check out the docs: https://mozilla-ai.github.io/any-llm/gateway/overview/
Enjoy!
New Providers
We add support for minimax and zai providers, as well as the gateway client so that you can easily communicate with the any-llm gateway from the any-llm client 🙏
What's Changed
- feat(gateway): add gateway provider by @njbrake in #587
- feat(zai): Add ZaiProvider for z.ai API integration by @njbrake in #583
- feat(minimax): Add Minimax provider support by @njbrake in #585
- chore(databricks): disable integration tests until we get more signal… by @njbrake in #590
- fix(tests): fix integration test filter with dynamic job determination by @njbrake in #589
- chore: loosen tool test by @njbrake in #592
- fix: hf wakeup script catch both exception types by @njbrake in #593
- Update guide by @angpt in #591
- chore: more reliable models for testing by @njbrake in #594
- pre-commit autoupdate by @github-actions[bot] in #595
- pre-commit autoupdate by @github-actions[bot] in #597
- Update readme by @angpt in #596
- feat: any-llm-gateway by @njbrake in #598
- chore: gateway image name by @njbrake in #601
- chore: Nebius through portkey dropped qwen3-14b by @njbrake in #603
New Contributors
Full Changelog: 1.1.0...1.2.0
Contributors
angpt and njbrake