any-llm is a library that offers a unified interface for multiple LLM providers, making it easy to adapt to changing needs, markets, or costs. Built with official SDKs, it lets you switch models and providers on demand whether you’re building agents or any LLM-powered app.

This looks SUUUUPER useful - build against an abstract API that then translates that to various LLMs and providers so you can easily switch from AWS to OpenAI to AI Foundry etc.

Distribute and run LLMs with a single file. Contribute to mozilla-ai/llamafile development by creating an account on GitHub.

And it seems to work well, too. Download an LLM and application all in one file. Slick.