NVIDIA's NeRF AI Can Turn 2D Images Into a 3D Scene in "Tens of Milliseconds"

Hoping to use the technology to improve robots and autonomous driving.

Tech & Gadgets
3,711 1 Comments

NVIDIA‘s new Instant NeRF artificial intelligence technology can now turn 2D images into 3D scenes.

In a new blog post detailing its latest research, the tech company explained that its NeRF AI is capable of taking numerous 2D images and generating a 3D scene with them in a significantly short time. The system uses neural networks that are capable of observing various images and then filling in the blanks in order to reconstruct a full scene, predicting both the light’s color and direction of radiation. It’ll even work around objects in the way, such as pillars. The original NeRF took much longer to train, taking hours before rendering a scene over a few minutes, but now Instant NeRF has revolutionized its speed.

“Instant NeRF, however, cuts rendering time by several orders of magnitude,” the company wrote. “It relies on a technique developed by NVIDIA called multi-resolution hash grid encoding, which is optimized to run efficiently on NVIDIA GPUs. Using a new input encoding method, researchers can achieve high-quality results using a tiny neural network that runs rapidly.”

With this new advancement, NVIDIA says NeRF is able to process the images in a few minutes and generate a full 3D scene in “tens of milliseconds.” It added that the technology can be used in the near future to both train robots and enhance vehicles with autonomous driving, allowing them to understand the size and shape of real-0world objects quicker and more easily. Eventually, it can also be used in both the architecture and entertainment fields.

Elsewhere in tech, Elon Musk is considering starting a new social media platform.

Read Full Article

What to Read Next

Aries and New Balance Reunite for Running-Inspired Collection
Footwear

Aries and New Balance Reunite for Running-Inspired Collection

Focusing on the Fresh Foam 1080v11 silhouette.

New Balance 550 Is Arriving in a "Panda" Colorway
Footwear

New Balance 550 Is Arriving in a "Panda" Colorway

The signature pair is slated to drop later this year.

Donald Glover Enlists Malia Obama as a Writer for His New Amazon Series
Entertainment

Donald Glover Enlists Malia Obama as a Writer for His New Amazon Series

Noting that the former first daughter’s writing style is “great.”

Apple Rumored to Release iPad Pro With M2 Chip This Fall
Tech & Gadgets

Apple Rumored to Release iPad Pro With M2 Chip This Fall

Potentially supporting MagSafe charging.

Take a Look Inside Balenciaga's New London Flagship Store
Fashion 

Take a Look Inside Balenciaga's New London Flagship Store

Practicing Demna’s “Raw Architecture” concept.


Craig Robinson Takes on Snake Hunting in 'Killing It'
Entertainment

Craig Robinson Takes on Snake Hunting in 'Killing It'

‘The Office’ and ‘Brooklyn Nine-Nine’ star takes center stage in his latest comedy series.

Crunchyroll Shuts Down Its Free Ad-Supported Simulcast Subscription Tier
Entertainment

Crunchyroll Shuts Down Its Free Ad-Supported Simulcast Subscription Tier

Replacing it with a “seasonal sampler” instead.

Tom Holland, Zendaya and Jacob Batalon React to Their 'Spider-Man' Auditions
Entertainment

Tom Holland, Zendaya and Jacob Batalon React to Their 'Spider-Man' Auditions

The three friends reflect on their earlier days.

'Ghost in the Shell: SAC_2045' Announces Season 2 Release Date With New Trailer
Entertainment

'Ghost in the Shell: SAC_2045' Announces Season 2 Release Date With New Trailer

Releasing on Netflix globally.

Louis Vuitton Loses Copyright Infringement Lawsuit, Ordered To Pay Nearly $1 Million USD in Compensation
Fashion

Louis Vuitton Loses Copyright Infringement Lawsuit, Ordered To Pay Nearly $1 Million USD in Compensation

The seven-year copyright infringement dispute has officially been solved.

More ▾
 
We got you covered. Don’t miss out on the latest news by signing up for our newsletters.

By subscribing, you agree to our Terms of Use and Privacy Policy.