What is Ultraleap Gemini? Functionalities, Features, and Benefits

With Gemini, VR users will never again have to wonder "Where are my hands?"

4
What is Ultraleap Gemini? Functionalities, Features, and Benefits
Virtual RealityNews Analysis

Published: May 11, 2022

XR Today Team

Ultraleap Gemini is a fifth-generation hand-tracking platform that supports virtual and augmented reality (VR/AR) solutions, and has been designed to provide immersive, realistic, and interactive computing experiences.

It is one of the most reliable and versatile hand-tracking systems available today and has already enabled incredibly immersive experiences for firms such as Varjo and Qualcomm.

Ultraleap Gemini connects with Qualcomm’s Snapdragon XR2 platform, bringing touchless technology to self-service solutions, and supports a variety of applications like gaming, education, training, design, and manufacturing. It is also compatible with multiple peripherals, such as keyboards, mice, and joysticks, and its fast initialization processes can track two hands simultaneously as well as in challenging conditions.

Gemini creates virtual indicators with fingers, knuckles, and palms using computer vision, allowing developers to detect everything from pinches to taps, twists, and other gestures. Using the Ultraleap Gemini app, the user can easily view wireframe skeletons as realistic hands, even as the system analyzes and converts hand motion data.

Top Features of Ultraleap Gemini

Currently, Ultraleap Gemini offers the following features:

Fast initialization

Gemini’s initialization process is lightning fast, and thanks to the broad field-of-view of its Stereo IR 170 camera, users’ hands are monitored before entering the picture. Users can leverage their hands, which are central to making immersive learning effective, as their primary means to interact with the outside world.

With Gemini, users no longer wonders where their hands are, but can begin interacting with the surrounding environment using them with little or no instruction, reducing cognitive strain, streamlining onboarding training, and deepening immersion and user confidence.

Tracks diverse hand sizes

Gemini’s computer vision system uses a combination of deep learning and traditional computer vision algorithms to track hands with a high degree of accuracy, which is critical in enterprise applications where people have various body types and hand sizes. It also allows training, design, and manufacturing companies to develop solutions that everyone can use on the factory floor or in the field, regardless of body structure.

Interact with both hands together

With the Ultraleap Gemini platform, users can interact with both hands at the same time. In VR, Gemini makes it easier than ever to use two hands. Without hand-tracking tracking systems triggering unexpected pauses, a user’s hands could be either held as close or as far apart from each other.

For example, people can use one hand to point at something while the other hand is used for tasks such as turning a virtual knob or opening a door, or perform two separate tasks simultaneously such as writing with one hand while gesturing with the other.

This level of engagement is not possible with a traditional keyboard and mouse and provides a more realistic and immersive experience to assimilate data better and retain information.

Works in a challenging environment

With this technology, firms can deliver VR trainers in various settings, including backroom warehouses, workplaces, and even trainee homes. Hand-tracking is robust in a wide range of lighting conditions, thanks to Gemini’s powerful algorithms and infrared cameras, and can also detect hands even while in busy environments.

Flexible integration options

Gemini is not limited to a single headset range, unlike other hand-tracking solutions. Several devices such as integrated hand-tracking headsets from Varjo or Lynx, Leap Motion Controllers, or even the company’s VR Developer Mount can used the device as an added peripheral.

Why Should Users Opt for the Device?

There are many reasons users may consider Ultraleap Gemini over other hand-tracking devices. It is the next step in bringing intuitive and seamless XR experiences to life by allowing natural human interactions in VR.

Ultraleap has updated its hand-tracking technology to offer one of the most advanced and flexible hand-tracking experiences possible today. The company also collaborates with software and hardware partners to develop turnkey solutions for a broader audience.

Considerations to Remember

For users looking for an easy to use enterprise hand-tracking solution that integrates seamlessly with their existing hardware and software, Ultraleap Gemini is a good choice. It is accurate, reliable, and flexible with many integration options.

When choosing a hand-tracking device, users must consider the needs of their specific industry and application. For example, if clients are looking for a device to use in manufacturing, they may want to check if it can track small objects accurately in diverse lighting conditions. Conversely, if buyers need a durable device to use in various environments, Ultraleap Gemini is a great option due to its relatively ruggedized exterior.

Getting started with Ultraleap Gemini

If you are new to Ultraleap Gemini, the device comes with a ‘getting started’ guide to simplify its learning curve. At its solution’s core, Gemini is a versatile input device that can be used for various tasks in VR ranging from simple navigation to complex 3D modelling. With its unique optical tracking and haptic feedback capabilities, Ultraleap Gemini provides a natural and intuitive way to interact with your computer.

Using the included USB cable, users can tether their Ultraleap Gemini to a computer and once connected, begin using the device by following the instructions in the guide.

After learning the basics, they can start exploring the more advanced features of the solution. To learn more about what the device can do, kindly check the documentation on the Ultraleap website.

HapticsImmersive ExperienceVR HeadsetsWearables

Brands mentioned in this article.

Featured

Share This Post