Red Hat AI Inference

Build, deploy, and monitor AI models and apps.
Get consistency across operating environments.
Simplify the way you build, deploy, and manage apps.
Scale automation and unite tech, teams, and environments.
Modernize operations for virtualized and containerized workloads.
Control and protect critical infrastructure.
Code, build, deploy, and monitor security-focused software.
Deploy workloads closer to the source with edge technology.
Learn how to use our cloud products and solutions at your own pace in the Red Hat® Hybrid Cloud Console.
Develop and deploy AI solutions across the hybrid cloud.
Support hybrid cloud innovation on a flexible operating system.
Build, modernize, and deploy apps at scale.
Implement enterprise-wide automation.
Discover resources and tools to help you build, deliver, and manage cloud-native applications and services.
Find solutions from our collaborative community of experts and technologies in the Red Hat® Ecosystem Catalog.
We'll recommend resources you may like as you browse. Try these suggestions for now.
A subscription may be required for some services.
Account number: [[account_number]]
A platform of products and services for the development and deployment of AI across the hybrid cloud.
Red Hat AI Enterprise
Build, develop, and deploy AI-powered applications across the hybrid cloud.
Red Hat AI Inference
Optimize model performance with an integrated stack for fast, consistent, and cost-effective inference at scale.
Red Hat OpenShift AI
Build and deploy AI-enabled applications and models at scale across hybrid environments.
Current Red Hat AI customers
Hardware & infrastructure
Red Hat® AI Inference is an integrated stack that provides fast, consistent, and cost-effective inference at scale.
Deep dives, demos and an unveiling of Red Hat AI 3.6
View this video by opting in to "Advertising cookies."
Is AI inference costing you too much? Video duration: 2:16
Red Hat AI Inference provides the operational control to run any model on any accelerator across the hybrid cloud.
Powered by vLLM and llm-d, the end-to-end inference stack optimizes token economics and hardware capacity for faster response times. Acting as the engine for agentic AI and Model-as-a-Service patterns, the open source technology increases efficiency without sacrificing performance.
vLLM is a high-efficiency inference engine that solves GPU utilization issues with lower cost-per-token and stable latency at scale.
With its portable, open source approach and a growing community, vLLM is emerging as the Linux® of gen AI inference.
As a leading commercial contributor, Red Hat offers the unique vLLM expertise to help you reach your AI goals.
500K+ GPUs deployed 24/71
200+ Different accelerator types2
500+ Supported model architectures2
24x higher throughput compared to competitors3