Search overlay panel for performing site-wide searches

Build Your Next Big Thing on Heroku. Sign Up Now!

Managed Inference and Agents

Building Data-Aware AI Applications with Heroku AI and LlamaIndex

Building AI applications that can interact with private data is a common goal for many organizations. The challenge often lies in connecting large language models (LLMs) with proprietary datasets. A combination of Heroku Managed Inference and Agents and LlamaIndex provides an elegant stack for this purpose.

This post explores how to use these tools to build retrieval-augmented generation (RAG) applications. We’ll cover the technical components, Use Cases and the development process, and how to get started.

Building Agents With Heroku AI and Pydantic AI

Building production-grade AI applications can be complex, but with Heroku and Pydantic AI, developers gain a powerful and reliable solution for integrating advanced AI capabilities. Heroku makes it easy to integrate AI into your applications with Heroku Managed Inference and Agents. With a single click, you can attach powerful Large Language Models like Anthropic’s Claude 4 Sonnet to your apps. Heroku AI also provides built-in tools like secure code execution and an OpenAI-compatible API that you can drop directly into popular frameworks and SDKs.

Introducing the Heroku AI Platform as a Service (AI PaaS)

Today, we are pleased to announce the evolution of Heroku to an AI Platform as a Service (AI PaaS). GenAI has changed how we build software (vibe coding), the kind of technology we use (Cursor, LLMs), the type of software we make (agents), and redefined what it means to be a developer in this new world.

In a recent Salesforce study, 84% of developers with AI say it helps their teams complete their projects …

Heroku AI: Claude 4 Sonnet is now available

Anthropic’s Claude 4 Sonnet, part of the next generation of Claude models, is now available on Heroku Managed Inference and Agents. This gives developers immediate access to a model designed for coding, advanced reasoning, and the support of capable AI agents. Heroku Managed Inference and Agents expands your AI choices, offering the freedom to build transformative applications with the developer and operational ease Heroku is known for. Claude 4 Sonnet extends what’s possible with …

Heroku AI: Managed Inference and Agents is now Generally Available

Many of the most exciting experiences we’re beginning to rely on every day are powered by AI; whether it’s conversational assistants, personalized recommendations or code generation, these experiences are powered by inference systems and intelligent agents. Behind the scenes, developers offload complex decisions, automate tasks, and compose intelligent applications using large language models and tool execution flows. Together, these AI-powered primitives are becoming a key complement to traditional application development, enabling a new wave of …

Heroku AI | Managed Inference and Agents

Over the last couple of years, we’ve repeatedly heard the question “who will build the Heroku of AI?”. The answer to that question is that Heroku will, of course.

We are excited to bring AI to the Heroku platform with the pilot of Managed Inference and Agents, delivered with the graceful developer and operational experience and composability that are the heart of Heroku.

Heroku’s Managed Inference and Agents provide access to leading AI models from …

Subscribe to the full-text RSS feed for Managed Inference and Agents.