The Rise of AI-Powered Apps in 2025
In 2025, entrepreneurs will unleash a flood of AI-powered apps. Finally, generative AI will deliver on the hype with a new crop of affordable consumer and business apps.
A Lopsided Ecosystem
For example, Elon Musk raised $6 billion to launch the newcomer xAI and bought 100,000 Nvidia H100 GPUs, the costly chips used to process AI, costing north of $3 billion to train its model, Grok. At those prices, only techno-tycoons can afford to build these giant LLMs.
The incredible spending by companies such as OpenAI, Google, and xAI has created a lopsided ecosystem that’s bottom heavy and top light. The LLMs trained by these huge GPU farms are usually also very expensive for inference, the process of entering a prompt and generating a response from large language models that is embedded in every app using AI.
The Cost of Inference
As a result, excellent LLMs with high inference costs have made it unaffordable to proliferate killer apps. This lopsided ecosystem of ultra-rich tech moguls battling each other has enriched Nvidia while forcing application developers into a catch-22 of either using a low-cost and low-performance model bound to disappoint users, or face paying exorbitant inference costs and risk going bankrupt.
A New Approach Emerges
In 2025, a new approach will emerge that can change all that. This will return to what we’ve learned from previous technology revolutions, such as the PC era of Intel and Windows or the mobile era of Qualcomm and Android, where Moore’s law improved PCs and apps, and lower bandwidth cost improved mobile phones and apps year after year.
A New Law for AI Inference
But what about the high inference cost? A new law for AI inference is just around the corner. The cost of inference has fallen by a factor of 10 per year, pushed down by new AI algorithms, inference technologies, and better chips at lower prices.
A Reference Point
As a reference point, if a third-party developer used OpenAI’s top-of-the-line models to build AI search, in May 2023 the cost would be about $10 per query, while Google’s non-Gen-AI search costs $0.01, a 1,000x difference. But by May 2024, the price of OpenAI’s top model came down to about $1 per query. At this unprecedented 10x-per-year price drop, application developers will be able to use ever higher-quality and lower-cost models, leading to a proliferation of AI apps in the next two years.
Conclusion
In 2025, the floodgates of AI-powered apps will open, and entrepreneurs will unleash a new wave of innovative and affordable apps that will revolutionize industries and change the way we live and work. The era of affordable and high-quality AI is finally here.
FAQs
Q: What is the current state of the AI ecosystem?
A: The current state of the AI ecosystem is lopsided, with a few ultra-rich tech moguls competing with each other to train the most powerful large language models, while application developers are forced to choose between low-cost and low-performance models or exorbitant inference costs.
Q: What is the cost of inference in the current ecosystem?
A: The cost of inference in the current ecosystem is very high, with some models costing up to $10 per query. However, a new law for AI inference is emerging, which will reduce the cost of inference by a factor of 10 per year.
Q: What is the impact of the new law for AI inference?
A: The new law for AI inference will make it possible for application developers to use ever higher-quality and lower-cost models, leading to a proliferation of AI apps in the next two years.
Q: What are the implications of the rise of AI-powered apps?
A: The rise of AI-powered apps will revolutionize industries and change the way we live and work, enabling entrepreneurs to create innovative and affordable apps that will have a profound impact on society.
