OpenMG: An Open-Source Middleware Interface for Gesture Recognition (1090-004374) (Technical Proceedings Manuscript Oral Presentations: Simulation Design and Innovation)
Start time: Thursday, January 21, 2021, 11:00 AM End time: Thursday, January 21, 2021, 12:00 PM Session Type: Technical Proceedings
Content Category:
Innovator
Structured Abstract:
The interface between the user and a healthcare simulation is a critical component, often driving engagement, immersion, and usage. However, the majority of interface designs leverage the mouse and keyboard, despite the availability of newer hardware platforms. With a goal of enabling a more natural user interface, the OpenMG effort designed an open-source gesture database for healthcare simulations. The system utilizes a hardware-agnostic approach to capture gestures onto a universal hand model, supplying a readily available database mapping gestures to intended actions. This manuscript reports on the development of the OpenMG software package, initial functionality testing, and conclusions including future research avenues for improving human-computer interaction in healthcare simulation.