Artificial Intelligence Platform Provider Clarifai Unveils Compute Orchestration Capability
Optimize AI Workloads, Cut Costs, and Avoid Vendor Lock-in with Clarifai’s New Compute Orchestration Platform
Clarifai, a leading artificial intelligence platform provider, has announced a new compute orchestration capability that enables enterprises to optimize their AI workloads, reduce costs, and avoid vendor lock-in. The public preview release allows organizations to orchestrate AI workloads through a unified control plane, regardless of whether they are running on cloud, on-premises, or in air-gapped infrastructure.
Reducing Compute Usage and Costs
Clarifai’s compute orchestration platform claims to reduce compute usage by 3.7x through model packing optimisations, while supporting over 1.6 million inference requests per second with 99.9997% reliability. This can potentially cut costs by 60-90%, depending on configuration.
Key Features of the Compute Orchestration Platform
- Cost Optimization: Automated resource management, including model packing, dependency simplification, and customisable auto-scaling options that can scale to zero for model replicas and compute nodes.
- Deployment Flexibility: Deployment on any hardware vendor, including cloud, on-premise, air-gapped, and Clarifai SaaS infrastructure.
- Integration with Clarifai’s AI Platform: Integration with Clarifai’s AI platform for data labeling, training, evaluation, workflows, and feedback.
- Security Features: Deployment into customer VPCs or on-premise Kubernetes clusters without requiring open inbound ports, VPC peering, or custom IAM roles.
A Solution Born from Customer Feedback
The compute orchestration platform emerged from Clarifai customers’ issues with AI performance and cost. A customer noted, "If we had a way to think about it holistically and look at our on-prem costs compared to our cloud costs, and then be able to orchestrate across environments with a cost basis, that would be incredibly valuable."
Putting the Capabilities to Use
The compute orchestration capability builds on Clarifai’s existing AI platform, which has processed over 2 billion operations in computer vision, language, and audio AI. The company reports maintaining 99.99%+ uptime and 24/7 availability for critical applications.
Availability and Getting Started
The compute orchestration capability is currently available in public preview. Organizations interested in testing the platform should contact Clarifai for access.
Frequently Asked Questions
Q: What is Clarifai’s compute orchestration platform?
A: Clarifai’s compute orchestration platform is a new capability that enables enterprises to optimize their AI workloads, reduce costs, and avoid vendor lock-in.
Q: What are the key features of the compute orchestration platform?
A: The key features include cost optimization, deployment flexibility, integration with Clarifai’s AI platform, and security features.
Q: How does the compute orchestration platform reduce compute usage and costs?
A: The platform reduces compute usage by 3.7x through model packing optimisations, while supporting over 1.6 million inference requests per second with 99.9997% reliability. This can potentially cut costs by 60-90%, depending on configuration.
