Any resources for getting started in touch interactivity with the depth cameras? (d435 or d455)

[nataliesettles]

Do you know of any materials that could help me to start getting my head around using the SDK to develop something similar to the Touchless Control Software? (Though I'm aiming for a larger scale and using a hand rather than a finger - see sketch below.) I have both a d435 and d455 to experiment with. Any basic working sandbox of touch interactivity or its subcomponents would really help me start to get a toehold to understand the relevant tools in the SDK. I'm an experienced game dev, however, this realm of developing for sensors is new to me.

So far I've forked this repo from another developer for a start, but I wondered if there are other related resources or info you might point to?
https://github.com/sugi-cho/RealSense-Touch

Thanks!

[MartyG-RealSense]

Hi @nataliesettles A touchless interactive RealSense compatible system called LUMOplay may fit your requirements.

https://www.intelrealsense.com/interactive-displays-for-retail/

https://youtube.com/watch?v=J8W1gLi3Idk

Another RealSense-powered system you could explore that supports interactive learning without having to touch a screen is Prowise MOVE.

https://www.intelrealsense.com/interactive-learning/

[nataliesettles]

Hi @MartyG-RealSense - thanks for your reply. Since I wrote, I discovered the community on the Intel RealSense site where you've answered some similar questions, and I was able to determine a few things:

I learned that LUMOplay and Prowise appear to not work for custom content and I already have an interactive Unity project developed.

It looks as though my best bet initially is to explore Nuitrack SDK gesture tracking.

Cheers!

[MartyG-RealSense]

You are very welcome, @nataliesettles - thanks very much for the update!

[nataliesettles]

Update: My project is Unity based, and so far I've rounded on working with the OpenCV for Unity asset and using the blob tracking approach. I'm reasonably happy with it.

[MartyG-RealSense]

Thanks very much for the personal recommendation of OpenCV for Unity, which I have suggested myself in the past. :)