Generative AI in Video Games: Sony’s Experiment with AI-Generated Characters
Sony’s Experiment with AI-Generated Characters
Video game companies are increasingly interested in incorporating generative AI into their games. Recently, Sony has been experimenting with fully-fledged AI-generated characters, with a prototype of Aloy from the Horizon series as its test subject.
The Leaked Video
A leaked video showcases Sony software engineering director Sharwin Raghoebardajal’s experiment with an AI-driven version of Aloy. The video has been circulating online, and it’s clear that Sony is still working on refining the technology. The AI-generated Aloy responds to questions about her life and the game’s world, using synthesized voice and facial movements.
The Technology Behind the Demo
The demo utilized a combination of technologies, including OpenAI’s Whisper for speech-to-text, GPT-4 and Llama 3 for decision-making, Sony’s Emotional Voice Synthesis (EVS) for speech generation, and Mockingbird for facial animation. The test was conducted on a PC, but Sony has reportedly also experimented with running parts of this system on PS5 hardware.
Fan Reaction
Fans are already expressing their dismay at the results, with many calling the AI Aloy "creepy," "ghastly," and "rancid." One user even pleaded with Sony to "please work on literally anything else." While the technology is promising, the current results are far from convincing.
The Future of AI in Video Games
Nvidia has also been working on AI-generated NPCs that players can interact with, as seen in its demo at Gamescom 2024. Microsoft has also been exploring AI characters, with its Muse AI model for gameplay generation. While fully AI-generated characters could revolutionize the gaming industry, there are concerns about the potential impact on voice actors and the threat of replacing human creators.
Conclusion
While Sony’s experiment with AI-generated characters is an exciting development, there is still much work to be done to achieve convincing results. The technology has the potential to transform the gaming industry, but it’s essential to balance progress with the need for high-quality, engaging gameplay.
FAQs
Q: What is AI-generated characters in video games?
A: AI-generated characters are computer-generated characters that use artificial intelligence to simulate human-like behavior and interactions.
Q: What technologies are being used to create AI-generated characters?
A: Companies like Sony, Nvidia, and Microsoft are using a combination of technologies, including natural language processing, machine learning, and computer vision to create AI-generated characters.
Q: What is the potential impact of AI-generated characters on the gaming industry?
A: AI-generated characters have the potential to revolutionize the gaming industry, offering new possibilities for storytelling, character development, and player interaction. However, there are also concerns about the potential impact on voice actors and the threat of replacing human creators.
