MediaPipe Gesture Detector

vvvv gamma question
1

Hi everyone,
I’m working with MediaPipe’s gesture detector and I’m looking for advice on finding different gesture models.
Here are the gestures I’m trying to detect:

0 - Unrecognized gesture, label: Unknown
1 - Closed fist, label: Closed_Fist
2 - Open palm, label: Open_Palm
3 - Pointing up, label: Pointing_Up
4 - Thumbs down, label: Thumb_Down
5 - Thumbs up, label: Thumb_Up
6 - Victory, label: Victory
7 - Love, label: ILoveYou

Does anyone know how I can find these models using the Gesture detector?

Thanks!

1 Like
2

Sounds like a job for Wekinator @visionnocturne . With Wekinator you basically make your own model. So you could, for example, take the angles between the finger joints and use those as ‘features’ for the ‘labels’ you’ve described above-

1 Like
3

Hi @visionnocturne here’s a WIP attached, you can detect all the pretrained mediapipe gestures that way:
HowTo Use Gesture Detection MediaPipe_WIP_bnj.vl (32.6 KB)

The gestures are also described here:

2 Likes
4

i’ve just published 0.6.1-alpha of VL.MediaPipe and included this helppatch by @benju. thanks for that one!

3 Likes