IMSH Delivers Sessions - Scroll down to "ADD to your Briefcase"
Assessing eXtended Reality (XR) for the Medical Community Using a Three-Dimensional User-Centered Approach (1090-005436)
Start time: Tuesday, March 30, 2021, 11:00 AM End time: Tuesday, March 30, 2021, 12:00 PM CE Hours: 1.00 Session Type: Prerecorded Educational Courses Cost: $0.00
Learning Objective 1:
Appreciate the importance of user-centered validation of immersive XR technologies, including virtual, augmented, and mixed reality headsets and associated applications, which can improve the software development process and ultimately increase the value of your eXtended Reality (XR) medical applications by ensuring they are able to achieve targeted learning and operational performance.
Learning Objective 2:
Recognize potential physiological maladaptation associated with HWD and the impact on post XR exposure human functioning (e.g., visual functioning, hand-eye coordination, ataxia).
Learning Objective 3:
Understand HWD design parameters and usage protocols that can guide effective and safe use of XR technology for medical training applications.
Content Category: Educator
Course Content:
The goal of this course is to introduce to the medical community, a three-dimensional user-centered evaluation protocol for immersive eXtended Reality (virtual, augmented, and mixed reality, XR) technologies that accounts for 1) human visual capabilities, 2) operational tasks, and 3) operational environments.
Medical practitioners and educators will learn how to use key cues important to the medical use case to predict and measure how well XR technologies, particularly head-worn displays (HWDs), can support learning and operational performance. The first dimension of the approach assesses human perception in a headset through validated tests that can assess how well the learner is able to perform tasks such as identify and recognize medical injuries or perform a surgical skill. The tests in the human perception test battery include visual acuity, contrast sensitivity, depth perception/stereoacuity, and color matching, resulting in a rating of how well the HWD matches aspects of the medical environment and the clinical tasks performed. Specifically, the evaluation can be used to determine if HWD design factors will impact visual perception, thereby potentially degrading target detection, recognition, and localization, etc., all of which can compromise operational performance.
Because of the differences between the real world and what is experienced in the HWD, the type of medical task performed can affect the cognitive ability of the learner. This dimension predicts and measures how well human cognitive functioning in an HWD compares to real-world functioning. This component of the protocol uses eye tracking technology in the real-world and in the HWD to characterize and quantify the direct influence of the HWD on cognitive constructs of human information processing, such as situation awareness, memory, and decision making. The results indicate whether or not degradation of operational performance and negative training transfer can be expected due to human information processing limitations in the HWD (e.g., small field-of-view and associated degraded/altered sensation & perception, attentional tunneling, artificial cue reliance, etc.) that limit perceptual validity. This compare-and-contrast between, say a surgeon’s decision-making during laparoscopic surgery with and without the support of virtual augmented overlays, can determine if XR in fact enhances the highly complex series of processes and actions associated with medical decision making and overall performance.
Tasks that medical personnel perform from training to administering care can be of short or long duration and change in complexity. Thus, to assess the operational environment, the protocol predicts how physiologically resilient humans are to varied duration XR exposures, particularly with regard to potential for impacting post exposure function in an operational environment (e.g., alter the dexterity of a surgeon). This component of the protocol uses EGG, HRV, EDA, postural stability, hand-eye coordination, and visual measures to determine if XR has important negative effects on physiological state and if this negatively impacts human performance, training, or post exposure safety. The results can be used to characterize the adverse physiological symptom profile (e.g., nausea, eye strain, visual fatigue, etc.) and physiological recovery time associated with HWD exposure, evaluate the effect of varied exposure protocols on physiological impact, and quantify suitability for training and operational support via a psychophysical adverse aftereffects (e.g., post XR exposure ataxia, degraded hand-eye coordination, shifts in visual functioning) testing battery. This component of the validation protocol provides insight into whether or not a “grounding” period will be necessary post HWD exposure, where medical personnel must decompress to allow for physiological recalibration prior to diving back into the operating room or other operational environments.
Course Overview:
The goal of this course is to introduce to the medical community, a three-dimensional user-centered evaluation protocol for immersive eXtended Reality (virtual, augmented, and mixed reality, XR) technologies that accounts for 1) human visual capabilities, 2) operational tasks, and 3) operational environments.
Co-Presenter: Darrin Frye, Frye Medicine
Disclosure: No financial relationships with ineligible companies.