LiteLLM AI integration now available
Change effective on 23 October 2025
You can now use Heroku AI with LiteLLM.
LiteLLM is an open-source Python library that acts as a unified interface to call large language models (LLMs). You can use LiteLLM to simplify model access, spend tracking, and fallback management across various LLMs. This integration enables you to use AI models deployed on Heroku’s infrastructure with LiteLLM.
To learn more, see our LiteLLM AI Integration documentation.