'Creepy,' 'ghastly,' 'rancid': Viewers react to leaked video of Sony's AI-powered Aloy

Aloy
(Image credit: PlayStation)

The Verge has shared a leaked Sony PlayStation video demonstrating an AI-powered version of Aloy from Horizon Forbidden West taking part in a conversation with Sharwin Raghoebardajal, a director of software engineering at SIE.

The video, which has since been taken down under a copyright claim, featured Aloy responding to questions from Raghoebardajal and showing off a segment of gameplay, after which the character described everything that happened in the clip. OpenAI's Whisper is used for the voice-to-text, OpenAI and Llama handle the conversation and decision-making, and the facial animations come from Sony's own internal Mockingbird system.

The system seen in the video is running on PC, but Raghoebardajal says they've been able to get Whisper and Mockingbird running on consoles (presumably PS5) "with relatively little overhead."

"Nothing is scripted," Raghoebardajal says in the video. "You can ask her anything, and she'll answer [as] Aloy."

It's not great, to be blunt. The interaction is stilted and awkward, and it's all very uncanny valley: It's very clearly a machine spouting off text-to-voice search results, and there's nothing organic or "natural" about it. Which is probably to be expected: Raghoebardajal says the initial demo was "just a quick, fun prototyping project," while the version seen in this video was bolstered by a few weeks of extra work for closed-door demonstrations at the Sony Technology Exchange Fair. The presentation is "just a glimpse of what is possible," Raghoebardajal says, and nowhere near a final product, or even meant for public consumption.

Despite those caveats, the reactions to the video on YouTube are not hugely positive. "Creepy," "ghastly," "rancid," and "cursed" are amongst the adjectives used to describe the video; one user begged Sony to "please work on literally anything else," while a couple others want to know—you can probably see this coming—why Sony is horsing around with this instead of making the Bloodborne remaster.

(Image credit: various (YouTube))

Not all of the complaints are entirely serious, of course, although the person noting the grim irony of doing an AI demo in a game in which AI was responsible for the annihilation of humanity makes a fair point. But there are also concerns expressed about the long-term impact of this sort of work on game development, particularly with regard to the role that voice actors will play in future productions.

Sony is far from unique in working on this sort of thing. Ubisoft and Inworld AI showed off their own AI-powered NPC creations at GDC in 2024, for instance, and Nvidia is working on "Co-Playable Character" technology in partnership with other developers including Krafton—not exactly the same thing, but broadly similar in the sense that it's AI stuff being shoehorned into videogames.

None of it has added up to much at this point, and as anyone who futzed with config files to improve the godawful NPC pathfinding in the original Baldur's Gate can tell you, there's definitely a place for better AI in videogames. But the rise of AI in game development has a potentially dark underbelly and there's a growing feeling of inevitability to it: I don't think AI will ever replicate the genuine human performances we've enjoyed in games like Baldur's Gate 3 or Hellblade: Senua's Sacrifice, but it's also presumably a whole lot cheaper (you don't have to pay a machine and they never need time off) and sooner or later that's going to start figuring into the conversation.

I've reached out to Sony for comment on the video and will update if I receive a reply.

Baldur's Gate 3 romanceBaldur's Gate 3 multiplayerBaldur's Gate 3 endingsBaldur's Gate 3 multiclass buildsBest RPGs

Baldur's Gate 3 romance: Who to pursue
Baldur's Gate 3 multiplayer: How co-op works
Baldur's Gate 3 endings: For better or worse
Baldur's Gate 3 multiclass builds: Coolest combos
Best RPGs: The greatest you can play now

TOPICS
Andy Chalk
US News Lead

Andy has been gaming on PCs from the very beginning, starting as a youngster with text adventures and primitive action games on a cassette-based TRS80. From there he graduated to the glory days of Sierra Online adventures and Microprose sims, ran a local BBS, learned how to build PCs, and developed a longstanding love of RPGs, immersive sims, and shooters. He began writing videogame news in 2007 for The Escapist and somehow managed to avoid getting fired until 2014, when he joined the storied ranks of PC Gamer. He covers all aspects of the industry, from new game announcements and patch notes to legal disputes, Twitch beefs, esports, and Henry Cavill. Lots of Henry Cavill.

You must confirm your public display name before commenting

Please logout and then login again, you will then be prompted to enter your display name.

Read more
Aloy - Horizon
'I feel worried about this art form:' Unsurprisingly, the real Aloy from Horizon isn't a fan of AI Aloy
An Ai face looks down on a human.
Xbox announces 'a generative AI model for gameplay ideation' called Muse, but don't get too excited: Machines aren't about to make games for you just yet
BURBANK, CALIFORNIA - AUGUST 15: Protestors attend the SAG-AFTRA Video Game Strike Picket on August 15, 2024 in Burbank, California. (Photo by Lila Seeley/Getty Images)
8 months into their strike, videogame voice actors say the industry's latest proposal is 'filled with alarming loopholes that will leave our members vulnerable to AI abuse'
A robot girl from Judas looks skeptical, her synthetic skin peeling off to reveal metal below.
Bioshock's Big Daddy Ken Levine says that while he doesn't want to 'underestimate' AI, he's 'not overly impressed' by it, either
Microsoft Muse-generated gaming in action
'A massive, massive moment of wow.' Microsoft CEO predicts AI-generated games are a 'CGI moment' for the industry
Apex Legends Final Fantasy 7
Over 30 Apex Legends voice actors refuse to sign an agreement that would see them 'give up our expertise to train the generative AI that will replace us tomorrow'
Latest in AI
Closeup of the new Copilot key coming to Windows 11 PC keyboards
Microsoft co-authored paper suggests the regular use of gen-AI can leave users with a 'diminished skill for independent problem-solving' and at least one AI model seems to agree
Still image of Bastion holding a bird, taken from Microsoft's Copilot for Gaming reveal trailer
Microsoft unveils Copilot for Gaming, an AI-powered 'ultimate gaming sidekick' that will let you talk to your console so you don't have to talk to your friends
BURBANK, CALIFORNIA - AUGUST 15: Protestors attend the SAG-AFTRA Video Game Strike Picket on August 15, 2024 in Burbank, California. (Photo by Lila Seeley/Getty Images)
8 months into their strike, videogame voice actors say the industry's latest proposal is 'filled with alarming loopholes that will leave our members vulnerable to AI abuse'
live action Jimbo the Jester from Balatro holding a playing card and addressing the camera
LocalThunk forbids AI-generated art on the Balatro subreddit: 'I think it does real harm to artists of all kinds'
Aloy
'Creepy,' 'ghastly,' 'rancid': Viewers react to leaked video of Sony's AI-powered Aloy
Seattle, USA - Jul 24, 2022: The South Lake Union Google Headquarter entrance at sunset.
Google is rolling out an even more AI-heavy search engine mode because 'power users want AI responses for even more of their searches'
Latest in News
Aloy - Horizon
'I feel worried about this art form:' Unsurprisingly, the real Aloy from Horizon isn't a fan of AI Aloy
Crying laughing emoji with disturbing realistic elements for REPO
REPO's first update will add a new map and a 'duck bucket' so we can finally give that pesky quacker a time out
Man facing camera
The Day Before studio reportedly sues Russian website for calling infamous disaster-game a 'scam'
Will Poulter holding a CD ROM
'What are most games about? Killing': Black Mirror Season 7 includes a follow-up to 2018 interactive film Bandersnatch
Casper Van Dien in Starship Troopers
Sony, which is making a Helldivers 2 movie, is also making a new Starship Troopers movie, but it's not based on the Starship Troopers movie we already have
Assassin's Creed meets PUBG
Ubisoft is reportedly talking to Tencent about creating a new business entity to manage Assassin's Creed and other big games