You are currently viewing CHI ‘24 Feature: Innovating Medical Education with VR Childbirth Delivery Training

IMWUT 2024: PilotAR, an Open-Source Tool to Conduct Pilot Studies with Smart Glasses

Congratulations to the authors of “PilotAR: Streamlining Pilot Studies with OHMDs from Concept to Insight”. This paper has been accepted (with minor revisions) to IMWUT’24. An accompanying demo paper has also been accepted to UbiComp/ISWC 2024. For more details about the paper and the open-source tool, please refer to PilotAR.

-

Authors

Nuwan Janaka, Runze Cai, Ashwin Ram, Lin Zhu, Shengdong Zhao, Kai Qi Yong

Abstract

Pilot studies in HCI research serve as a cost-effective approach to validate potential ideas and identify impactful findings before extensive studies. Yet, the additional requirements of AR/MR, such as multi-view observations and increased multitasking, make it challenging to conduct pilot studies effectively, hindering innovations in this field. Based on interviews with 12 AR/MR researchers, we identified the key challenges associated with conducting AR/MR pilot studies with Optical See-Through Head-Mounted Displays (OST-HMDs, OHMDs), including the inability to observe and record in-context user interactions, increased task load, and difficulties with in-context data analysis and discussion. To tackle these challenges, we introduce PilotAR, a desktop-based tool designed iteratively to enhance OHMD-based AR/MR pilot studies. PilotAR facilitates data collection via live first-person and third-person views, multi-modal annotations, and flexible wizarding interfaces. It also accommodates multi-experimenter settings, streamlines the study process with configurable workflows and shortcuts, records annotated data, and eases results sharing. Formative testing, conducted using three case studies, has highlighted the significant benefits of PilotAR, as well as its potential for further development and refinement.

Video