Another piece of CES news this week: among all the big announcements and innovations, XR streaming solutions provider Innoactive announced a new product partnership with Apple and NVIDIA to introduce a streaming service between Omniverse and Apple Vision Pro.
The move enables NVIDIA Omniverse developers to stream their Universal Scene Description (OpenUSD) workflows to an Apple Vision Pro headset.
Innoactive announced NVIDIA spatial streaming for Omniverse at CES this week, aiming to continue immersive industry-wide advancements in streaming technology, which allows headsets to display high-quality 3D models and experiences.
This is a massive leap for the industry. If wireless streaming continues its uptick, the ability to stream more complex services onto increasingly small-end devices could prove paradigm-shifting for the AR/VR/MR hardware market.
The streaming platform notably features support for streaming digital twin-related workflows to Apple Vision Pro devices, in a move which seems to parallel NVIDIA’s usage of Apple products in its simulation and robotics fields.
Furthermore, Innoactive notes that the CES announcement marks the debut of hybrid rendering, a platform feature that combines local and remote rendering. Therefore, the new hybrid-rendering feature allows NVIDIA developers to render fully interactive experiences in an Apple SwiftUI or Reality Kit application.
The new streaming platform’s features also include streamlined access to immersive 3D environments, browser streaming, standard VR headset streaming, on-demand cloud tools, enterprise-grade security considerations, and support for NVIDIA accelerated computing technology.
Innovative is working to deploy its Vision Pro-ready solutions in professional settings today, such as working with Automotive firm Volkswagen Group and Healthcare leaders Syntegon.
Dr Axel Heinrich, Head of Innovation and Systems Architecture at Volkswagen AG, noted that the company uses Innoactive’s XR Streaming platform to power its Digital Reality Hub tool.
Heinrich added:
Now with their support of NVIDIA Omniverse, OpenUSD and Apple Vision Pro, we can do exact surface validation as well as early product decisions in ergonomics and user interaction – without needing any physical prototype, at lightning speed. This includes high precision and realistic visualization of the surface, incorporating real-time lighting and shadowing. Additionally, it enhances the user car experience and provides insights into the experience of valency.
Apple Vision Pro Helps to Train NVIDIA Robots
NVIDIA recently took centre stage to showcase its latest innovations in emerging technology, focusing on its robotics and artificial intelligence investments. The company’s research into robotics and self-driving cars is closely intertwined with developing an AI framework to support the next generation of these technologies.
In addition, NVIDIA’s announcements at CES highlighted the significant role of spatial computing and the Omniverse platform in training its robotics, environmental AI, and self-driving car systems. These systems require the ability to analyze and understand real-world environments to function effectively.
Importantly, in its official press releases about recent updates in robotics, NVIDIA featured Apple’s Vision Pro mixed reality headset in several promotional images, illustrating its crucial role in this initiative. During last year’s NVIDIA GTC, the company emphasized how the Vision Pro would become increasingly significant in its research into emerging workplace tools, reinforcing the connection between the device and the Omniverse platform.
The support from NVIDIA and Innoactive for the Apple Vision Pro indicates a strong commitment and investment in the mixed reality device, countering the notion that it underperformed in its first year.