Nvidiahas made another attempt to add depth to shallow graphics.
After converting 2D images into 3Dscenes,models, andvideos, the company has turned its focus to editing.
Dubbed 3D MoMa, the technique could givegame studiosa simple way to alter images and scenes.
This typically relies on time-consuming photogrammetry, which takes measurements from photos.
3D MoMa speeds up the task through inverse rendering.
This process uses AI to estimate a scenes physical attributes from geometry to lighting by analyzing still images.
The pictures are then reconstructed in a realistic 3D form.
3D MoMa generates objects as triangle meshes a format thats straightforward to edit with widely-used tools.
The models are created within an hour on a single NVIDIA Tensor Core GPU.
Materials can then be overlaid on the meshes like skins.
The lighting of the scene is also predicted, which allows creators to modify its effects on the objects.
3D MoMa was showcased at this weeksComputer Vision and Pattern Recognition Conference(CVPR) in New Orleans.
In homage to the birthplace of jazz, Nvidia researchers used the technique to visually render the musical genre.
The team first collected hundreds of pictures of trumpet, trombones, saxophones, drums, and clarinets.
Next, 3D MoMa reconstructed the images into 3D representations.
The instruments were then edited and given new materials.
The trumpet, for instance, was transformed from cheap plastic to lavish gold.
The newly-edited instruments were then ready to be placed into any virtual scene.
Nvidia dropped them into a Cornell box, which is used to test rendering quality.
Finally, the 3D objects were rendered in an animated scene.
That could also ease our metamorphosis into metaverse forms.
you’ve got the option to read the study paper behind 3D MoMahere.
Story byThomas Macaulay
Thomas is the managing editor of TNW.
He leads our coverage of European tech and oversees our talented team of writers.
Away from work, he e(show all)Thomas is the managing editor of TNW.
He leads our coverage of European tech and oversees our talented team of writers.
Away from work, he enjoys playing chess (badly) and the guitar (even worse).
