Red Hat Completes Acquisition of Neural Magic, Enhancing AI Capabilities
Red Hat, the IBM-owned open-source software giant, has completed its acquisition of Neural Magic, a pioneering artificial intelligence (AI) optimization startup. Initially announced in November 2024, the deal closed on January 13, 2025, marking a significant step in Red Hat’s strategy to enhance its AI capabilities across hybrid cloud environments.
Background on Neural Magic
Neural Magic, an MIT spinoff founded in 2018, has developed innovative software and algorithms that accelerate generative AI inference workloads. The company’s technology allows complex AI models to run efficiently on commodity hardware, including standard CPUs and GPUs, potentially reducing the need for expensive, specialized AI accelerators.
Key Technologies Acquired by Red Hat
-
vLLM Expertise
Neural Magic is a leading contributor to vLLM, an open-source project for efficient large language model (LLM) serving. In particular, vLLM is already Red Hat Enterprise Linux (RHEL) AI and Red Hat OpenShift AI’s inference engine.
-
DeepSparse
An inference runtime that delivers GPU-class performance on commodity CPUs through algorithms that reduce computation and memory needs for neural network execution. Specifically, besides LLMs, DeepSparse is also useful for computer vision (CV) and natural language processing (NLP).
-
SparseZoo
A repository of pre-optimized CV, NLP, and LLM models.
-
Model Compression Techniques
Neural Magic has developed advanced methods for model quantization and sparsification, which can significantly reduce model size and computational requirements without substantial loss in accuracy.
-
Cross-platform Optimization
Neural Magic’s technology enables AI model optimization for deployment across cloud, data center, and edge environments.
Red Hat’s Vision for AI
Red Hat’s CEO, Matt Hicks, stated that the company believes the future of AI is open. The acquisition of Neural Magic is a strategic enhancement to its AI capabilities, facilitating AI deployment across hybrid clouds by leveraging Neural Magic’s expertise in model optimization and inference acceleration.
Conclusion
The acquisition of Neural Magic by Red Hat is a significant step in the company’s strategy to enhance its AI capabilities across hybrid cloud environments. The technologies acquired by Red Hat, including vLLM, DeepSparse, SparseZoo, model compression techniques, and cross-platform optimization, will enable the company to offer more cost-effective, scalable AI solutions that reduce dependency on specialized hardware.
FAQs
Q: What is Neural Magic?
A: Neural Magic is a pioneering artificial intelligence (AI) optimization startup that has developed innovative software and algorithms that accelerate generative AI inference workloads.
Q: What did Red Hat acquire from Neural Magic?
A: Red Hat acquired Neural Magic’s vLLM expertise, DeepSparse, SparseZoo, model compression techniques, and cross-platform optimization technologies.
Q: What does this acquisition mean for Red Hat’s AI capabilities?
A: The acquisition of Neural Magic enhances Red Hat’s AI capabilities across hybrid cloud environments, enabling the company to offer more cost-effective, scalable AI solutions that reduce dependency on specialized hardware.
Q: What is Red Hat’s vision for AI?
A: Red Hat believes the future of AI is open and is committed to making AI workloads more accessible, efficient, and deployable across hybrid cloud environments.
