A new AI can make 2D images 3D, like these high-def faces and yes, even cats

3D generated images
(Image credit: Eric R. Chan*, Connor Z. Lin*, Matthew A. Chan*, Koki Nagano*, Boxiao Pan, Shalini De Mello, Orazio Gallo, Leonidas Guibas, Jonathan Tremblay, Sameh Khamis, Tero Karras, and Gordon Wetzstein)

Realistic images generated by AI neural networks are all the rage at the moment. Images like these AI-generated Duke Nukems have gone viral for their disturbing yet weirdly accurate takes. While AIs like DALLE-2 can do Photoshop magic better than the real thing, all this is about to get much wilder as it moves to 3D.

GAN is a popular machine-learning model that pits two neural networks against each other to make for more accurate predictions. It's already proven effective for 2D image recreation, and according to MarketTechPost, researchers at Stanford have put it to work creating powerful 3D images.

The researchers call this AI model EG3D. It takes high-resolution 2D GAN images and moves them into the third dimension. It does this in a way that's far less computer-intensive and more accurate than previous attempts, and even boasts of being able to manage it on laptops. Github does recommend 1-8 high-end Nvidia GPUs, so maybe make that a fairly good laptop to get the job done.

It seems to be achieved by the AI's neural networks being trained on the resulting topography from 2D images until a consistent result is achieved. This has led to the team producing some creepily real pictures of people's faces from multiple angles. It has also created some very cute pictures of cats, which feels much less threatening. 

Your next machine

(Image credit: Future)

Best gaming PC: The top pre-built machines from the pros
Best gaming laptop: Perfect notebooks for mobile gaming

The biggest downside to these creations is they can be difficult to edit and refine. Thanks to being produced by AI, they aren't exactly modelled in Blender ready to be manipulated to the user's whims. A different machine-learning model developed by the University of Wisconsin called GiraffeHD, which allows different variables in these images to be determined and selected will likely be a great help in the next step of these technologies.

That being said, because of the way these 3D images are generated, it may be a little while before we see them come to games. Being able to generate 3D images from already generated 2D images could be a huge boon for the industry, but it's a little while off yet. However, once people manage to get these models to run in programs people can actually work with, the likelihood of seeing these AI-generated pictures in media is much more likely.

Hope Corrigan
Hardware Writer

Hope’s been writing about games for about a decade, starting out way back when on the Australian Nintendo fan site Vooks.net. Since then, she’s talked far too much about games and tech for publications such as Techlife, Byteside, IGN, and GameSpot. Of course there’s also here at PC Gamer, where she gets to indulge her inner hardware nerd with news and reviews. You can usually find Hope fawning over some art, tech, or likely a wonderful combination of them both and where relevant she’ll share them with you here. When she’s not writing about the amazing creations of others, she’s working on what she hopes will one day be her own. You can find her fictional chill out ambient far future sci-fi radio show/album/listening experience podcast right here. No, she’s not kidding. 

Read more
A screenshot taken from the 2025 Nvidia tech demo Zorah
Nvidia RTX 50-series and dev kit show that rasterization is old news and we're now firmly in the era of AI rendering
Nvidia RTX 5090 Founders Edition graphics card on different backgrounds
AI will be crammed in more of the graphics pipeline as Nvidia and Microsoft are bringing AI shading to a DirectX preview next month
Microsoft Muse-generated gaming in action
'A massive, massive moment of wow.' Microsoft CEO predicts AI-generated games are a 'CGI moment' for the industry
A photo of Nvidia's Zorah graphics demo running a large gaming monitor
Nvidia's expanded Zorah demo tells us how AI is the future of graphics: 'There's no rasterization going on at all. This is all ray traced and the amazing part is that it's actually faster than rasterizing'
Collage of images to represent Nvidia's RTX AI PCs
I'll say it: The best thing I saw from Nvidia at CES wasn't its sweet new GPUs, but some tasty AI every RTX gamer can enjoy
An Ai face looks down on a human.
Xbox announces 'a generative AI model for gameplay ideation' called Muse, but don't get too excited: Machines aren't about to make games for you just yet
Latest in AI
CHINA - 2025/02/11: In this photo illustration, a Roblox logo is seen displayed on the screen of a smartphone. (Photo Illustration by Sheldon Cooper/SOPA Images/LightRocket via Getty Images)
'Humans still surpass machines': Roblox has been using a machine learning voice chat moderation system for a year, but in some cases you just can't beat real people
OpenAI logo displayed on a phone screen and ChatGPT website displayed on a laptop screen are seen in this illustration photo taken in Krakow, Poland on December 5, 2022.
ChatGPT faces legal complaint after a user inputted their own name and found it accused them of made-up crimes
Public Eye trailer still - dead-eyed police officer sitting for an interview
I'm creeped out by this trailer for a generative AI game about people using an AI-powered app to solve violent crimes in the year 2028 that somehow isn't a cautionary tale
Closeup of the new Copilot key coming to Windows 11 PC keyboards
Microsoft co-authored paper suggests the regular use of gen-AI can leave users with a 'diminished skill for independent problem-solving' and at least one AI model seems to agree
Still image of Bastion holding a bird, taken from Microsoft's Copilot for Gaming reveal trailer
Microsoft unveils Copilot for Gaming, an AI-powered 'ultimate gaming sidekick' that will let you talk to your console so you don't have to talk to your friends
BURBANK, CALIFORNIA - AUGUST 15: Protestors attend the SAG-AFTRA Video Game Strike Picket on August 15, 2024 in Burbank, California. (Photo by Lila Seeley/Getty Images)
8 months into their strike, videogame voice actors say the industry's latest proposal is 'filled with alarming loopholes that will leave our members vulnerable to AI abuse'
Latest in News
Team Fortress Spy being shocked
An FPS studio pulled its game from Steam after it got caught linking to malware disguised as a demo, but the dev insists it was actually the victim of a labyrinthine conspiracy
Neighbors Suburban Warfare screenshot a child aims a slingshot at a man from across a cul-de-sac.
A beta of backyard FPS Neighbors: Suburban Warfare is out now, and the balance discussion is hysterical: nerf trash can lids and children
Grand Theft Auto 6 trailer still - woman in the front seat of a car, looking out the back window while holding a wad of cash
The specter of a GTA 6 delay haunts the games industry: 'Some companies are going to tank' if they guess wrong, says analyst
Screenshot from Wreckfest 2
Wreckfest 2 has hit early access for your car-obliterating combat racing enjoyment
Alma, the handler from Monster Hunter Wilds, closes her eyes and looks a little disappointed.
Monster Hunter director joined an online hunt, carted first: 'I feel bad about that'
Image for
Warhammer 40,000: Darktide’s getting a new roguelite wave defense mode that sounds a whole lot like a souped-up take on Killing Floor