Palms-on Quest 2 fingers monitoring v2 (and comparability with Ultraleap)

I saved enjoying with them, and I noticed that I may simply put one hand in entrance of the opposite, I may make the 2 fingers cross their fingers, and see the monitoring nonetheless working! The steadiness of two-hands interplay has actually modified from night time to day! Now lastly the fingers monitoring system is usable for 2 fingers interactions, and this pose properly for the way forward for pure interactions on Quest (and Cambria).

Quest Palms Monitoring v2 evaluation

After this constructive first impression, I wished to dig deeper and consider fastidiously the efficiency of hand monitoring, so I made a number of checks in varied apps, specifically the Oculus Residence menu, Hand Physics Lab, and VR Exercise.

Speaking about the monitoring of a single hand, the performances are superb, and the digital hand is now in a position to observe very properly my actual hand. It’s particularly spectacular how the fingers monitoring could be very correct. The digital hand and all its fingers have more often than not the precise pose of my actual one. There are some poses that problem laborious the monitoring algorithms, and generally the pose of the pinky or ring finger is barely inaccurate: as an illustration, once I make the ring finger contact the thumb, generally I don’t see the fingertips of the digital hand really touching, however nonetheless fairly distant. I’ve verified the monitoring utilizing passthrough, so having some floor fact, and I can let you know that aside from these small points, which anyway are usually not a giant deal, the monitoring went normally very properly. I used to be fairly impressed.

I learn a declare saying that now the monitoring algorithm can also be very reactive, so appropriate for use additionally in health functions. I attempted instantly to punch stuff, to find that really, the monitoring fails miserably whenever you begin giving actual punches. I attempted a degree of VR Exercise, and so long as I used to be offering gradual punches, every little thing labored, however once I actually began punching stuff, the fingers had been disappearing. When the hand is simply too quick, the monitoring nonetheless fails. I can see that the monitoring is best than earlier than on this state of affairs, however for my part, it’s nonetheless not sufficient for boxing video games.

As for the sector of view of monitoring, I may see my fingers nonetheless tracked on the fringe of the visible FOV of the headset, so so long as you see your fingers, they’re certainly tracked. I even tried to click on on a button that it was exterior of my peripheral view and the interplay nonetheless labored, so the monitoring FOV is greater than the imaginative and prescient FOV.

Speaking about two-hand interactions, the system is now far more steady than earlier than, and as I stated within the earlier paragraph, I may even interwave the fingers of the 2 fingers and the monitoring nonetheless labored! That is actually an important consequence achieved by Meta engineers. Anyway, once I moved one hand in entrance of the opposite, it nonetheless occurred many instances that the occluded hand misplaced the monitoring or that it began glitching. Additionally some poses with the 2 fingers closely touching nonetheless made the monitoring go loopy. So, two fingers interactions are significantly better than earlier than, however the monitoring remains to be not 100% dependable when the 2 fingers are occluding one another.

Comparability with Ultraleap monitoring

Let me evaluate the monitoring of the fingers on Meta Quest 2 with the monitoring provided by the Ultraleap Stereo IR 170 Sensor and Gemini monitoring on the earlier 4 factors:

• Single hand monitoring accuracy: I’d say that now Meta is on par. The monitoring of the fingers labored very properly, with just a few minor glitches, precisely because it occurs with Ultraleap units;
• Robustness to quick actions: I’d say that Ultraleap is barely higher on this. They’re nearly on par, however I may transfer my fingers a bit sooner earlier than making the monitoring on the hand get misplaced when utilizing the most recent Ultraleap sensor;