Hey everyone.
I’m working on a task involving the detection of articulatory tongue movements using a smartphone’s front-facing camera. Specifically, I need to reliably classify vertical tongue motion (up / down / neutral position) in real time. The environment is everyday — standard indoor lighting, no additional equipment. The target audience is children, which adds variability in terms of anatomy and behavior in front of the camera.
I’ve experimented with MediaPipe, but its tongue tracking is pretty lacking. I’d love to hear whether there are approaches that actually work in practice, or whether this is fundamentally a hard-constrained problem under these shooting conditions. Could something be borrowed from adjacent fields — say, deformable object tracking or industrial detection, where similar problems have already been solved reasonably well?
Has anyone actually worked on detection or tracking of intraoral objects (tongue, teeth) on mobile hardware that could realistically achieve high detection accuracy?
Thanks in advance.