Enterprise Investment in Artificial Intelligence (AI) Nears $14 Billion
This year, there’s been a huge enterprise investment in artificial intelligence (AI), nearing $14 billion. However, a significant proportion of companies are unsure what they’re doing with the technology, according to a survey of businesses by venture capital firm Menlo Ventures.
Uncertainty Around Generative AI
More than a third of our survey respondents do not have a clear vision for how generative AI will be implemented across their organizations, write the authors of the report, Menlo Ventures partners Tim Tully and Joff Redfern, and investor Derek Xiao, who used the help of Anthropic’s Claude Sonnet 3.5 large language model (LLM) to compile the report.
AI Spending Reaches New Heights
The report is the latest output from Tully, Redfern, and Xiao, who also offered a perspective on AI agents in September. The authors suggest the uncertainty around generative AI (Gen AI) indicates that "we’re still in the early stages of a large-scale transformation".
Foundation Models Dominate Spending
Indeed, the lack of clarity on AI strategy is just one element of an otherwise very positive piece. Leaving aside spending on AI chips from Nvidia and others, spending on "foundation models, model training + deployment, AI-specific data infrastructure, and new generative AI applications" totaled $13.8 billion in 2024, the authors relate, more than six times as much as 2023’s total ($2.3bn).
Application Layer Heats Up
The biggest single category of AI spending is foundation models. The application category is "heating up", the researchers write. "While foundation model investments still dominate enterprise generative AI spend, the application layer is now growing faster," they write, "benefiting from coalescing design patterns at the infrastructure level. Companies are creating substantial value by using these tools to optimize workflows across sectors, paving the way for broader innovation."
Use Cases and Dominant Categories
The dominant use cases, by prominence, include code generation via code copilots, including Microsoft’s GitHub Copilot, currently on course to reach $300 million in annual revenue. Next are support chatbots, followed by enterprise search and retrieval, and automatically generated meeting summaries.
Anthropic Gains Ground
Menlo has a direct financial interest in AI spending, as the firm backs many startups in the area, including Anthropic and vector database maker Pinecone. In fact, Anthropic is gaining ground against OpenAI, the authors relate, winning converts from GPT to Claude.
Modern AI Stack
The most forward-looking part of the report covers what Tully, Redfern, and Xiao refer to as the "Modern AI Stack", layers of infrastructure technology used to build applications. The researchers report that "enterprises [are] coalescing around the core building blocks that comprise the runtime architectures of most production AI systems".
Predictions for the Year Ahead
The report offers three predictions for the year ahead. First, AI agents are poised to "disrupt" the $400bn enterprise software market, led by platforms such as Clay and Forge, "tackling complex, multi-step tasks that go beyond the capabilities of current systems focused on content generation and knowledge retrieval".
Conclusion
The report offers a comprehensive overview of the current state of generative AI in the enterprise and provides insights into the trends and predictions for the future. While there may be uncertainty around AI strategy, the report suggests that companies are creating substantial value by using these tools to optimize workflows across sectors, paving the way for broader innovation.
FAQs
Q: What is the current state of generative AI in the enterprise?
A: According to Menlo Ventures, more than a third of companies do not have a clear vision for how generative AI will be implemented across their organizations.
Q: What is the biggest single category of AI spending?
A: The biggest single category of AI spending is foundation models.
Q: What are the dominant use cases for AI?
A: The dominant use cases, by prominence, include code generation via code copilots, support chatbots, enterprise search and retrieval, and automatically generated meeting summaries.
Q: What are the predictions for the year ahead?
A: The report offers three predictions for the year ahead, including the disruption of the $400bn enterprise software market, the emergence of AI-native challengers, and a massive talent drought.
