AI teams need flexibility whether running workloads on-prem or in the cloud. That’s why dstack, a member of the Intel® Liftoff program for AI startups, is now adding support for Intel® Gaudi® AI Accelerators and integration with Intel® Tiber® AI Cloud.
With this latest release, dstack supports the orchestration of containers across on-prem machines equipped with Intel® Gaudi® accelerators making it easier to manage and scale AI workloads across different environments.
How dstack Enhances AI Deployment with Intel® Gaudi®
With its integration of Intel® Gaudi®, dstack simplifies AI infrastructure management across cloud and on-prem environments. Developers can fine-tune, deploy, and manage AI models seamlessly while leveraging Intel® Gaudi®’s high-performance architecture.
dstack provides a unified AI workflow that integrates with Gaudi-powered hardware. By leveraging Gaudi’s efficient processing, enterprises can significantly reduce training and inference costs, making AI workloads more accessible. Additionally, dstack supports flexible deployment across both cloud and on-premises environments, ensuring AI models are efficiently orchestrated regardless of infrastructure.
Advancing Scalable AI
dstack’s integrated approach lets you train models faster, cut infrastructure overhead, and pick the best computing resources for each project - no proprietary lock-ins required.
Key Advantages:
- Performance Meets Accessibility: High throughput and low latency shorten training cycles, so AI and data science teams can test new ideas quickly and stay ahead in fast-moving markets.
- Cost-Efficient Scaling: By automatically optimizing your hardware usage, you can expand AI initiatives without inflating your budget or dedicating an entire ops team to hardware optimization.
- Hardware Flexibility: Free yourself from single-vendor constraints. dstack’s lightweight orchestration seamlessly works with Intel® Gaudi® and other accelerators you may already use.
We’re excited to see how this integration works for organizations!
Related resources
Intel® Gaudi® 2 AI accelerator - High-performance AI training processor designed for deep learning workloads
Intel® Liftoff Startups in the 2024 German AI Startup Landscape: Innovation, Growth, & Collaboration
As a Software Tools Ecosystem Specialist at Intel, I’ve had the privilege of working on the dynamic GenAI initiative. My focus is on driving engagement with the software developer audience. I'm a proud team member of the Intel® Liftoff for Startups and the Developer Engagement, Relations, and Studio team.