Varjo’s Fusion Algorithm Combines Volumetric Capture with Video

Unlocking New Possibilities with the Fusion Algorithm

2
varjo fusion algorithm
Virtual RealityLatest News

Published: January 5, 2021

Rebekah Carter

Rebekah Carter

Varjo, an innovator in the world of disruptive, VR technology, recently announced the arrival of a new fusion algorithm that combines video with volumetric capture, and the Nvidia deep-learning algorithm (optical flow). This allows technology to capture the world in real-time and open the door to “holoportation”.

The new technology goes beyond what lidar can accomplish alone. The process ensures that stable depth capture is available at 90 FPS, for experiences such as real-time holoportation that takes you too other places in VR and XR. 3D semantic segmentation takes the possibilities to the next level.

Through the full field of view lidar on the Varjo XR-3 headset, Varjo can deliver unique experiences with the help of video, and Nvidia’s deep neural network algorithm, creating a depth map for the video feed. Then there are three layers of filtering that analyse the data based on the time of flight, depth image, and detailed depth contours. The solution can capture unique details like hair, and allow for more significant gradients, camera reprojections and 3D reconstruction.

The Best Experience for Mixed Reality?

Varjo’s new combination of cutting-edge technology allows for really amazing holoportation of the items and information in front of the headset in real-time. Though Varjo has produced some fantastic headsets in the past, this represents the highest possible quality of virtual reality or mixed reality headset available for most people.

The XR-3 is the leading mixed reality headset for professionals and big companies too. Organisations like Kia Motors started using this tech during the pandemic for remote design through Autodesk. Additionally, Varjo is the latest headset creator that integrates the hand-tracking technology from Ultraleap into the experience.

A purchase from Varjo also includes licenses for the latest algorithm (generation 5) in Ultraleap.

A Leap in Technology

The arrival of the Varjo VR-3 and XR-3 appears to be a significant leap forward in technical advancement. One of the newest features users can unlock is high-resolution pictures everywhere they look thanks to a higher-resolution peripheral screen with rendering technology included.

Professionals can have the confidence that what they see in the color space is the same across all of the headsets from Vargo, thanks to professional grade color space technology. What’s more, the Varjo has a broader screen than any of the current VR headsets in the mainstream environment today, including the latest Valve Index.

Notable updates to the VR-3 and XR-3 now available from Varjo include a 40% wider field of view compared to previous generation options, and a movement of the centre focus based on feedback from customers. However, there is also no significant difference in where you are looking depending on whether you’re using the peripheral or center display thanks to foveated rendering.

 

Immersive ExperienceVisualizationVR Headsets
Featured

Share This Post