OUR PUBLICATIONS
Peer-reviewed publications
MobileHCI LBW 2024
What's this? Understanding User Interaction Behaviour with Multimodal Input Information Retrieval System
Silang Wang, Hyeongcheol Kim, Nuwan Janaka, Kun Yue, Hoang-Long Nguyen, Shengdong Zhao, Haiming Liu, Khanh-Duy Le
Keywords:
Information Retrieval, Multimodal Interaction, User Search Behaviour, Heads-up Computing
CHI 2024
Navigating Real-World Challenges: A Quadruped Robot Guiding System for Visually Impaired People in Diverse Environments
Shaojun Cai, Ashwin Ram, Zhengtai Gou, Mohd Alqama Wasim Shaikh, Yu-An Chen, Yingjia Wan, Kotaro Hara, Shengdong Zhao, David Hsu
Keywords:
visual impairment, orientation and mobility, assistive technology, navigation, robot guide dog
CHI 2024
Heads-Up Multitasker: Simulating Attention Switching On Optical Head-Mounted Displays
Yunpeng Bai, Aleksi Ikkala, Antti Oulasvirta, Shengdong Zhao, Lucia J. Wang, Pengzhi Yang, Peisen Xu
Keywords:
multitasking, heads-up computing, computational rationality, deep reinforcement learning, bounded optimal control
CHI 2024
AudioXtend: Assisted Reality Visual Accompaniments for Audiobook Storytelling During Everyday Routine Tasks
Felicia Fang-Yi Tan, Peisen Xu, Ashwin Ram, Wei Zhen Suen, Shengdong Zhao, Yun Huang, Christophe Hurter
Keywords:
CHI EA 2024
Demonstrating PANDALens: Enhancing Daily Activity Documentation with AI-assisted In-Context Writing on OHMD
Nuwan Janaka, Runze Cai, Shengdong Zhao, David Hsu
Keywords:
CHI 2024
Facilitating Virtual Reality Integration in Medical Education: A Case Study of Acceptability and Learning Impact in Childbirth Delivery Training
Chang Liu, Felicia Fang-Yi Tan, Shengdong Zhao, Abhiram Kanneganti, Gosavi Arundhati Tushar, Eng Tat Khoo
Keywords:
Medical Education, Virtual Reality, User Experience Design, Obstetrics & Gynaecology
CHI 2024
PANDALens: Towards AI-Assisted In-Context Writing on OHMD During Travels
Runze Cai, Nuwan Janaka, Yang Chen, Lucia J. Wang, Shengdong Zhao, Can Liu
Keywords:
HMD, smart glasses, AI, large language model, multimodal information, Human-AI collaborative writing, in-context writing, travel blog
CoRR 2024
GPTVoiceTasker: LLM-Powered Virtual Assistant for Smartphone
Minh Duc Vu, Han Wang, Zhuang Li, Jieshan Chen, Shengdong Zhao, Zhenchang Xing, Chunyang Chen
Keywords:
Communications of the ACM 2023
Heads-Up Computing: Moving Beyond the Device-Centered Paradigm
Shengdong Zhao, Felicia Tan, Katherine Fennedy
Keywords:
heads-up, human-centered, paradigm
IMWUT 2023
GlassMessaging: Towards Ubiquitous Messaging Using OHMDs
Nuwan Janaka, Jie Gao, Lin Zhu, Shengdong Zhao, Lan Lyu, Peisen Xu, Maximilian Nabokow, Silang Wang, Yanch Ong
Keywords:
texting, messaging, heads-up computing, smart glasses, OST-HMD
VidAdapter: Adapting Blackboard-Style Videos for Ubiquitous Viewing
Ashwin Ram, Han Xiao, Shengdong Zhao, Chi-Wing Fu
Keywords:
content adaptation; ubiquitous learning; video lectures; smart glasses
INTERACT 2023
AdaptReview: Towards Effective Video Review Using Text Summaries and Concept Maps
Shan Zhang, Yang Chen, Nuwan Janaka, Chloe Haigh, Shengdong Zhao, and Wei Tsang Ooi
Keywords:
video review, concept map, text summary
DIS 2023
Mindful Moments: Exploring On-the-go Mindfulness Practice On Smart-glasses
Felicia Tan, Ashwin Ram, Chloe Haigh, Shengdong Zhao
Keywords:
Smart glasses, Mindfulness, OHMD, On-the-go, Breath-based guidance
ISMAR Adjunct 2023
Minimizing Attention Costs of Visual OHMD Notifications
Nuwan Janaka
Keywords:
notification, attention, OHMD, OST HMD, interruption, smart glasses,
CHI EA 2023
NotiFade: Minimizing OHMD Notification Distractions Using Fading
Nuwan Janaka, Shengdong Zhao, Samantha W.T. Chan
Keywords:
notifcation, smart glasses, OHMD, OST HMD, fading, interruption, distraction, animation, fade, scroll
CHI 2023
Can Icons Outperform Text? Understanding the Role of Pictograms in OHMD Notifications
Nuwan Janaka, Shengdong Zhao, Shardul Sapkota
Keywords:
notification, OHMD, OST HMD, smart glasses, pictogram, icon, interruption, distraction
ParaGlassMenu: Towards Social-Friendly Subtle Interactions in Conversations
Runze Cai, Nuwan Janaka, Shengdong Zhao, Minghui Sun
Keywords:
IoT manipulation, circular menu, ring interaction, social interaction, conversation, HMD, smart glasses, Internet-of-Things
Not All Spacings are Created Equal: The Effect of Text Spacings in On-the-go Reading Using Optical See-Through Head-Mounted Displays
Chen Zhou, Katherine Fennedy, Felicia Fang-Yi Tan, Shengdong Zhao, Yurui Shao
Keywords:
Text Spacing, Inter-line Spacing, Inter-word Spacing, Reading on-the-go, Mobile Reading, Heads-up Computing, OHMD, SmartGlasses
IJHCS 2023
BackTracer: Improving ray-casting 3D target acquisition by backtracking the interaction history
Kaiqi Chen, Huagen Wan, Shengdong Zhao, Xutao Liu
Keywords:
Target acquisition, 3D selection, Ray-casting, Backtracking time interval, Interaction history
IMWUT 2022
SSpoon: A Shape-changing Spoon That Optimizes Bite Size for Eating Rate Regulation
Yang Chen, Katherine Fennedy, Anna Fogel, Shengdong Zhao, Chao Zhang, Lijuan Liu and Chingchiuan Yen
Keywords:
Shape-changing interfaces; Eating rate; Human food interaction; Empirical study
CHI 2022
Does Dynamically Drawn Text Improve Learning? Investigating the Effect of Text Presentation Styles in Video Learning
Ashwin Ram and Shengdong Zhao
Keywords:
Dynamic drawing, Text presentation styles, Video learning, Heads-up computing, Mobile HCI, Smart-glasses, OHMD
Paracentral and near-peripheral visualizations: Towards attention-maintaining secondary information presentation on OHMDs during in-person social interactions
Nuwan Janaka, Chloe Haigh, Hyeongcheol Kim, Shan Zhang, and Shengdong Zhao
Keywords:
paracentral, near-peripheral, social interaction, conversation, circular progress, reminder notification, interruption, HMD, smart glasses
CoRR 2022
Visual Behaviors and Mobile Information Acquisition
Nuwan Janaka, Xinke Wu, Shan Zhang, Shengdong Zhao, and Petr Slovak
Keywords:
Visual behaviors, Attention fragmentation, Mobile information acquisition, Microlearning on the move, Shadowing, HMD, Smart glasses, Mobile phones
IMWUT 2021
LSVP: Towards Effective On-the-go Video Learning Using Optical Head-Mounted Displays
Ashwin Ram and Shengdong Zhao
Keywords:
Smart glasses, dynamic information
SENSORS 2021
Affective Colormap Design for Accurate Visual Comprehension in Industrial Tomography
Yuchong Zhang, Morten Fjeld, Marco Fratarcangeli, Alan Said, and Shengdong Zhao
Keywords:
affective colormap design; human perception; visualization; crowdsourced study; microwave tomography
Moment-to-Moment Continuous Attention Fluctuation Monitoring through Consumer-Grade EEG Device
Shan Zhang, Zihan Yan, Shardul Sapkota, Shengdong Zhao, and Wei Tsang Ooi
Keywords:
EEG; moment-to-moment; attention detection; wearable; machine learning
ISMAR 2021
Exploring Head-based Mode-Switching in Virtual Reality
Rongkai Shi, Nan Zhu, Hai-Ning Liang, Shengdong Zhao
Keywords:
Human-centered computing—Human computer interaction (HCI)—Interaction paradigms—Virtual reality; Human-centered computing—Human computer interaction (HCI)— Empirical studies in HCI;
MobileHCI 2021
Ubiquitous Interactions for Heads-Up Computing: Understanding Users' Preferences for Subtle Interaction Techniques in Everyday Settings
Shardul Sapkota, Ashwin Ram, Shengdong Zhao
Keywords:
Subtle Interactions; Wearable Computing; Smart Glasses; Heads-up Computing; Thumb-index-fnger Interaction
CoRR 2021
Exploring Head-based Mode-Switching in Virtual Reality
Rongkai Shi, Nan Zhu, Hai-Ning Liang, Shengdong Zhao
Keywords:
Human-centered computing—Human computer interaction (HCI)—Interaction paradigms—Virtual reality; Human-centered computing—Human computer interaction (HCI)— Empirical studies in HCI;
CHI 2020
EYEditor: Towards On-the-Go Heads-Up Text Editing Using Voice and Manual Input
Debjyoti Ghosh, Pin Sym Foong, Shengdong Zhao, Can Liu, Nuwan Janaka, and Vinitha Erusu
Keywords:
manual-input, text editing, wearable interaction, re-speaking, heads-up interaction, smart glass, mobile interaction, voice interaction, eyeditor
Learn with Haptics: Improving Vocabulary Recall with Free-form Digital Annotation on Touchscreen Mobiles
Smitha Sheshadri, Shengdong Zhao, Yang Chen, and Morten Fjeld
Keywords:
multimodal learning, intersensory reinforced learning, motoric engagement, haptics for learning, mobile vocabulary learning
Virtually-Extended Proprioception: Providing Spatial Reference in VR through an Appended Virtual Limb
Yang Tian, Yuming Bai, Shengdong Zhao, Chi-Wing Fu, Tianpei Yang, and Pheng Ann Heng
Keywords:
proprioception, virtual reality, target selection, appended limb, spatial reference
ToCHI 2020
Commanding and Re-Dictation: Developing Eyes-Free Voice-Based Interaction for Editing Dictated Text
Debjyoti Ghosh, Can Liu, Shengdong Zhao, and Kotaro Hara
Keywords:
commanding, eyes-free, voice-based text editing, Text editing, voice interaction, re-dictation, voice user interfaces
CSCW 2020
From Lost to Found: Discover Missing UI Design Semantics through Recovering Missing Tags
Chunyang Chen, Sidong Feng, Zhengyang Liu, Zhenchang Xing, and Shengdong Zhao
Keywords:
graphical user interface, deep learning, semantics, designers, tags
CoRR 2020
From Lost to Found: Discover Missing UI Design Semantics through Recovering Missing Tags
Chunyang Chen, Sidong Feng, Zhengyang Liu, Zhenchang Xing, and Shengdong Zhao
Keywords:
graphical user interface, deep learning, semantics, designers, tags
MobileHCI 2020
LiveSnippets: Voice-based Live Authoring of Multimedia Articles about Experiences
Hyeongcheol Kim, Shengdong Zhao, Can Liu, Kotaro Hara
Keywords:
in-situ voice-based multimedia authoring, voice-based multimedia documentation, multimedia authoring in situ
ICIS 2020
Practical Empathy: The Duality of Social and Transactional Roles of Conversational Agents in Giving Health Advice
Debjyoti Ghosh and Isam Faik
Keywords:
practical Empathy, conversational agents, healthcare, user expectation, duality, social and transactional expectations, health advice, agent response
CHI EA 2020
Considering Wake Gestures for Smart Assistant Use
Patryk Pomykalski, Mikołaj P. Woźniak, Paweł W. Woźniak, Krzysztof Grudzień, Shengdong Zhao, and Andrzej Romanowski
Keywords:
smart speaker, gestural input, smart assistant, gesture, gesture elicitation
ACM 2020
CHI '20: CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA, April 25-30, 2020
Regina Bernhaupt, Florian ‘Floyd’ Mueller, David Verweij, Josh Andres, Joanna McGrenere, Andy Cockburn, Ignacio Avellino, Alix Goguey, Pernille Bjøn, Shengdong Zhao, Briane Paul Samson, Rafal Kocielnik
Keywords:
Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, CHI 2020, Honolulu, HI, USA, April 25-30, 2020
Regina Bernhaupt, Florian ‘Floyd’ Mueller, David Verweij, Josh Andres, Joanna McGrenere, Andy Cockburn, Ignacio Avellino, Alix Goguey, Pernille Bjøn, Shengdong Zhao, Briane Paul Samson, Rafal Kocielnik
Keywords:
J Med Internet Res 2020
A Clinical Teaching Blended Learning Program to Enhance Registered Nurse Preceptors’ Teaching Competencies: Pretest and Posttest Study
Xi Vivien Wu, Yuchen Chi1, Umadevi Panneer Selvam, M Kamala Devi1, Wenru Wang, Yah Shih Chan, Fong Chi Wee, Shengdong Zhao, Vibhor Sehgal, and Neo Kim Emily Ang
Keywords:
blended learning, case-based learning, clinical pedagogy, clinical teaching competency, web-based program, nurse preceptor
Nurse Education Today 2020
A web-based clinical pedagogy program to enhance registered nurse preceptors' teaching competencies – An innovative process of development and pilot program evaluation
Xi Vivien Wu, Yuchen Chi, Yah Shih Chan, Wenru Wang, Emily Neo Kim Ang, Shengdong Zhao, Vibhor Sehgal, Fong Chi Wee, Umadevi Panneer Selvam, and M. Kamala Devi
Keywords:
clinical pedagogy, teaching competency, web-based program, nurse preceptor
IMWUT 2019
Enhancing Augmented VR Interaction via Egocentric Scene Analysis
Yang Tian, Chi-Wing Fu, Shengdong Zhao, Ruihui Li, Xiao Tang, Xiaowei Hu, and Pheng-Ann Heng
Keywords:
virtual reality, visual tool, deep learning, scene analysis, depth sensing, egocentric view, visual guidance, augmented VR interaction
CSCW 2019
Gallery D.C.: Design Search and Knowledge Discovery through Auto-created GUI Component Gallery
Chunyang Chen, Sidong Feng, Zhenchang Xing, Linda Liu, Shengdong Zhao, and Jinshui Wang
Keywords:
object detection, multi-faceted design search, design demographics, gui design, mobile application, design comparison
Interact 2019
ScaffoMapping: Assisting Concept Mapping for Video Learners
Shan Zhang, Xiaojun Meng, Can Liu, Shengdong Zhao, Vibhor Sehgal, and Morten Fjeld
Keywords:
concept map, scaffolding, video learning
Investigating Feedback for Two-Handed Exploration of Digital Maps Without Vision
Sandra Bardot, Marcos Serrano, Simon Perrault, Shengdong Zhao, and Christophe Jouffrais
Keywords:
users with visual impairment, accessibility Wearable devices, smartwatches, multimodal feedback, map exploration
CHI 2018
EDITalk: Towards Designing Eyes-free Interactions for Mobile Word Processing
Debjyoti Ghosh, Pin Sym Foong, Shengdong Zhao, Di Chen, and Morten Fjeld
Keywords:
eyes-free interfaces, voice-based word processing, barge-in, conversational ui, eyes-free interaction design
Harvesting Caregiving Knowledge: Design Considerations for Integrating Volunteer Input in Dementia Care
Pin Sym Foong, Shengdong Zhao, Felicia Tan, and Joseph Jay Williams
Keywords:
health, dementia care, caregiving, volunteers
AVI 2018
Movespace: on-body athletic interaction for running and cycling
Velko Vechev, Alexandru Dancu, Simon T. Perrault, Quentin Roy, Morten Fjeld, and Shengdong Zhao
Keywords:
on-body interaction, cycling, running, interaction in motion, sports training
IUI 2018
AVEID: Automatic Video System for Measuring Engagement In Dementia
Viral Parekh, Pin Sym Foong, Shengdong Zhao, and Ramanathan Subramanian
Keywords:
video-based analytics, dementia, engagement
ChineseCHI 2018
Assessing the Utility of the System Usability Scale for Evaluating Voice-based User Interfaces
Debjyoti Ghosh, Pin Sym Foong, Shan Zhang, and Shengdong Zhao
Keywords:
voice-based user interface, evaluation, conversational user interface, voice user interface
Teach Me Fast: How to Optimize Online Lecture Video Speeding for Learning in Less Time?
Devangini Patel, Debjyoti Ghosh, and Shengdong Zhao
Keywords:
speaker’s speech rate, video speed prediction, video speed modelling, online video learning, video player interface, video speed
IJHC 2017
Editorial of the Special Issue on Mobile Human-Computer Interaction
Fiona Fui-Hoon Nah, Dongsong Zhang, John Krogstie, Shengdong Zhao
Keywords:
CHI 2017
Follow-My-Lead: Intuitive Indoor Path Creation and Navigation Using Interactive Videos
Quentin Roy, Simon T. Perrault, Shengdong Zhao, Richard C. Davis, Anuroop Pattena Vaniyar, Velko Vechev, Youngki Lee, and Archan Misra
Keywords:
smartglasses, indoor navigation, wearable computing, mobile computing, egocentric visual navigation., video, leader-follower
VITA: Towards Supporting Volunteer Interactions with Long-Term Care Residents with Dementia
Pin Sym Foong, Shengdong Zhao, Kelsey Carlson, and Zhe Liu
Keywords:
tablets, engagement activity, dementia, nursing homes, dementia care., volunteers
ReTool: Interactive Microtask and Workflow Design through Demonstration
Chen Chen, Xiaojun Meng, Shengdong Zhao, and Morten Fjeld
Keywords:
freeform interactive microtasks, programming by demonstration, workflow, retool, crowdsourcing
JSTSP 2017
Introduction to the Issue on Signal Processing and Machine Learning
Mihaela van der Schaar, Richard G. Baraniuk, Mung Chiang, Jonathan Huang, Shengdong Zhao
Keywords:
IMWUT 2017
BlindType: Eyes-Free Text Entry on Handheld Touchpad by Leveraging Thumb's Muscle Memory
Yiqin Lu, Chun Yu, Xin Yi, Yuanchun Shi, and Shengdong Zhao
Keywords:
eyes-free input, smart TV interaction, text entry, HMDs
CSCW 2017
Korero: Facilitating Complex Referencing of Visual Materials in Asynchronous Discussion Interface
Soon Hau Chua, Toni-Jan Keith Palma Monserrat, Dongwook Yoon, Juho Kim, and Shengdong Zhao
Keywords:
referencing, asynchronous discussion interface
Interact 2017
NexP: A Beginner Friendly Toolkit for Designing and Conducting Controlled Experiments
Xiaojun Meng, Pin Sym Foong, Simon Perrault, and Shengdong Zhao
Keywords:
NexP, controlled experiment, toolkit, design platform
RSS 2017
XPose: Reinventing User Interaction with Flying Cameras.
Ziquan Lan, Mohit Shridhar†, David Hsu, and Shengdong Zhao
Keywords:
ChineseCHI 2017
Trade-off between Automation and Accuracy in Mobile Photo Recognition Food Logging
Brian Y. Lim, Xinni Chng, and Shengdong Zhao
Keywords:
user experience, field study, food logging, food journals, mobile applications, image recognition
CHI EA 2017
FusePrint: A DIY 2.5D Printing Technique for Good-fit Fabrication with Daily Objects
Kening Zhu, Alexandru Dancu, and Shengdong Zhao
Keywords:
3D printing, DIY, SLA, daily objects, 2.5D printing
CoRR 2017
AVEID: Automatic Video System for Measuring Engagement In Dementia
Viral Parekh, Pin Sym Foong, Shengdong Zhao, Ramanathan Subramanian
Keywords:
Engagement; Video-based analytics; Dementia
CHI 2016
HaptiColor: Interpolating Color Information as Haptic Feedback to Assist the Colorblind
Marta G. Carcedo, Soon Hau Chua, Simon Perrault, Paweł Wozniak, Raj Joshi, Mohammad Obaid, Morten Fjeld, and Shengdong Zhao
Keywords:
wristband, vibration, wearable computing, color blindness, spatiotemporal vibrotactile pattern
ToCHI 2016
Investigating Expressive Tactile Interaction Design in Artistic Graphical Representations
Maryam Azh, Shengdong Zhao, and Sriram Subramanian
Keywords:
Interaction design, tactile interfaces, design tools, affordances, research through design, expressive tactile interaction design, creativity support tools, visuotactile interaction
DIS 2016
FusePrint: A DIY 2.5D Printing Technique Embracing Everyday Artifacts
Kening Zhu, Alexandru Dancu and Shengdong Zhao
Keywords:
FusePrint; Fabrication; DIY; 3D Printing; 2.5D Printing; Stereolithography; Everyday Artifacts.
AVI 2016
5-Step Approach to Designing Controlled Experiments
Xiaojun Meng, Pin Sym Foong, Simon Perrault, and Shengdong Zhao
Keywords:
NexP, experimental design tool, design controlled experiment
HyNote: Integrated Concept Mapping and Notetaking
Xiaojun Meng, Shengdong Zhao, and Darren Edge
Keywords:
notetaking, mobile interaction, concept mapping
OzCHI 2016
Supporting the comparison of alternative stories
Atima Tharatipyakul, Hyowon Lee, Shengdong Zhao, and Richard C. Davis
Keywords:
storyboard, story comparison, interaction design
NordiCHI 2016
Towards Leaning Aware Interaction with Multitouch Tabletops
Khanh-Duy Le, Mahsa Paknezhad, Paweł W. Woźniak, Maryam Azh, Gabrielė Kasparavičiūtė, Morten Fjeld, Shengdong Zhao, and Michael S. Brown
Keywords:
tabletop interaction, active shape models, interactive surface, Leaning, lean recognition
Ubitile: A Finger-Worn I/O Device for Tabletop Vibrotactile Pattern Authoring
Khanh-Duy Le, Kening Zhu, Tomasz Kosinski, Morten Fjeld, Maryam Azh, and Shengdong Zhao
Keywords:
surface computing, ring-like device, Vibrotactile pattern authoring
ITAP 2016
Design Considerations for Volunteer Support in Dementia Care
Pin Sym Foong and Shengdong Zhao
Keywords:
devices, non-primary, volunteering, primary, Dementia, caregivers, volunteers, burden of care
TIST 2016
Using Crowdsourcing for Scientific Analysis of Industrial Tomographic Images
Chen Chen, Paweł W. Woźniak, Andrzej Romanowski, Mohammad Obaid, Tomasz Jaworski, Jacek Kucharski, Krzysztof Grudzień, Shengdong Zhao, and Morten Fjeld
Keywords:
Silo, particle tracking, crowdsourcing, tomography
ChineseCHI 2016
Positioning Glass: Investigating Display Positions of Monocular Optical See-Through Head-Mounted Display
Soon Hau Chua, Simon T. Perrault, Denys J. C. Matthies, and Shengdong Zhao
Keywords:
user interface, design guidelines, monocular optical see-through head-mounted display, display position
CHI EA 2016
Ringteraction: Coordinated Thumb-index Interaction Using a Ring
Sarthak Ghosh, Hyeong Cheol Kim, Yang Cao, Arne Wessels, Simon T. Perrault, and Shengdong Zhao
Keywords:
bi-digit interaction, mobile computing, wearable computing, smartphone, joint interaction, ring
A Dummy's Guide to your Next EXPeriment: Experimental Design and Analysis Made Easy
Shengdong Zhao, Xiaojun Meng, Pin Sym Foong, and Simon Perrault
Keywords:
conduct experiment, toolkit, controlled experimental design, statistical analysis
ACM 2016
Proceedings of the International Symposium on Interactive Technology and Ageing Populations, ITAP 2016, Kochi, Japan, October 20-22, 2016
Xiangshi Ren, Antti Oulasvirta, Cosmin Munteanu and Shengdong Zhao
Keywords:
Proceedings of the Fourth International Conference on Human Agent Interaction, HAI 2016, Biopolis, Singapore, October 4-7, 2016
Wei-Yun Yau, Takashi Omori, Giorgio Metta, Hirotaka Osawa, Shengdong Zhao
Keywords:
CHI 2015
CoFaçade: A Customizable Assistive Approach for Elders and Their Helpers
Jason Chen Zhao, Richard C. Davis, Pin Sym Foong, and Shengdong Zhao
Keywords:
accessibility design, cofa-ade, silver computing
Physical Loci: Leveraging Spatial, Object and Semantic Memory for Command Selection
Simon T. Perrault, Eric Lecolinet, Yoann Pascal Bourse, Shengdong Zhao, and Yves Guiard
Keywords:
spatial memory, input, association, memorization, method of loci, command selection, mnemonic device
OmniVib: Towards Cross-body Spatiotemporal Vibrotactile Notifications for Mobile Phones
Jessalyn Alvina, Shengdong Zhao, Simon T. Perrault, Maryam Azh, Thijs Roumen, and Morten Fjeld
Keywords:
arm, waist, mobile device, spatiotemporal vibrotactile pattern, notification, tactile feedback, palm, thigh
NotiRing: A Comparative Study of Notification Channels for Wearable Interactive Rings
Thijs Roumen, Simon T. Perrault, and Shengdong Zhao
Keywords:
wearable computing, poke, activity, vibration, sound, heat, notification, ring, light
ToCHI 2015
ColorBless: Augmenting Visual Information for Colorblind People with Binocular Luster Effect
Soon Hau Chua, Haimo Zhang, Muhammad Hammad, Shengdong Zhao, Sahil Goyal, and Karan Singh
Keywords:
augmented visualization, color blindness, Binocular luster, stereoscopic 3D
CSCW 2015
To Risk or Not to Risk?: Improving Financial Risk Taking of Older Adults by Online Social Information
Jason Chen Zhao, Wai-Tat Fu, Hanzhe Zhang, Shengdong Zhao, and Henry Duh
Keywords:
decision-making, social information, older adults, experience-based task, risk-taking
MobileHCI 2015
Botential: Localizing On-Body Gestures by Measuring Electrical Signatures on the Human Skin
Denys J. C. Matthies, Simon T. Perrault, Bodo Urban, and Shengdong Zhao
Keywords:
capacitive sensing, user interface, embodied interaction, on-body interaction, eyes-free, EMG, hands-free
L@S 2015
Understanding Learners' General Perception Towards Learning with MOOC Classmates: An Exploratory Study
Soon Hau Chua, Juho Kim, Toni-Jan Keith Monserrat, and Shengdong Zhao
Keywords:
online learning, learning behavior, moocs, collaborative learning, massive open online courses
CHI 2014
WADE: simplified GUI add-on development for third-party software
Xiaojun Meng, Shengdong Zhao, Yongfeng Huang, Zhongyuan Zhang, James Eagan, and Ramanathan Subramanian
Keywords:
wysiwyg, WADE, add-on integration, GUI, IDE
Food messaging: using edible medium for social messaging
Jun Wei, Xiaojuan Ma, and Shengdong Zhao
Keywords:
field study, food messaging, food hci, food printer, affective communication, edible social messaging
L.IVE: an integrated interactive video-based learning environment
Toni-Jan Keith Palma Monserrat, Yawen Li, Shengdong Zhao, and Xiang Cao
Keywords:
interactive video, l.ive, video-based online learning
Draco: bringing life to illustrations with kinetic textures
Rubaiat Habib Kazi, Fanny Chevalier, Tovi Grossman, Shengdong Zhao, and George Fitzmaurice
Keywords:
sketching, direct manipulation, kinetic textures, animation
AVI 2014
BezelCopy: an efficient cross-application copy-paste technique for touchscreen smartphones
Chen Chen, Simon T. Perrault, Shengdong Zhao, and Wei Tsang Ooi
Keywords:
handheld device, copy-paste, mobile computing, smartphone, input, bezel interaction
IJHCI 2014
Using Social Media Platforms for Human-Robot Interaction in Domestic Environment
Xiaoning Ma, Xin Yang,Shengdong Zhao,Chi-Wing Fu, Ziquan Lan, and Yiming Pu
Keywords:
CHI EA 2014
Peripheral Microinteraction For Wearable Computing
Denys Matthies, Simon T. Perrault, Eric Lecolinet, and Shengdong Zhao
Keywords:
peripheral interaction, microinteraction, eyes-free interaction, wearable computing, input interfaces
Draco: bringing life to illustrations
Rubaiat Habib Kazi, Fanny Chevalier, Tovi Grossman, Shengdong Zhao, and George Fitzmaurice
Keywords:
sketch, textures, direct manipulation, animation
Draco: living illustrations
Rubaiat Habib Kazi, Fanny Chevalier, Tovi Grossman, Shengdong Zhao, and George Fitzmaurice
Keywords:
L.IVE: an integrated interactive video-based learning environment
Toni-Jan Keith Palma Monserrat, Shengdong Zhao, Yawen Li and Xiang Cao
Keywords:
NordiCHI 2014
Thaddeus: a dual device interaction space for exploring information visualisation
Paweł Woźniak, Lars Lischke, Benjamin Schmidt, Shengdong Zhao, and Morten Fjeld
Keywords:
multi surface environment, mobile interaction, interactive visualization, dual device
SIGGRAPH Studio 2014
DRACO: sketching animated drawings with kinetic textures
Rubaiat Habib Kazi, Fanny Chevalier, Tovi Grossman, Shengdong Zhao, George Fitzmaurice
Keywords:
SIGGRAPH Posters 2014
DRACO: sketching animated drawings with kinetic textures
Rubaiat Habib Kazi, Fanny Chevalier, Tovi Grossman, Shengdong Zhao, George Fitzmaurice
Keywords:
ChineseCHI 2014
Limiting trial and error: introducing a systematic approach to designing clutching
Pawel Woźniak, Morten Fjeld, and Shengdong Zhao
Keywords:
design procedure, clutching, input channels
Eyes-free gesture passwords: a comparison of various eyes-free input methods
Chen Chen, Soon Hau Chua, David Chung, Simon T. Perrault, Shengdong Zhao, and Wing Kei
Keywords:
passwords, security, eyes-free, gesture
CHI 2013
AutoGami: a low-cost rapid prototyping toolkit for automated movable paper craft
Kening Zhu and Shengdong Zhao
Keywords:
automated paper craft, toolkit, paper computing, selective inductive power transmission
NoteVideo: facilitating navigation of blackboard-style lecture videos
Toni-Jan Keith Palma Monserrat, Shengdong Zhao, Kevin McGee, and Anshul Vikram Pandey
Keywords:
blackboard-style videos, notevideo, video, video navigation, notevideo+, online streaming, video summary
CSCW 2013
Designing an effective vibration-based notification interface for mobile phones
Bahador Saket, Chrisnawan Prasojo, Yongfeng Huang, and Shengdong Zhao
Keywords:
vibration patterns, perceived urgency, mobile phone, notifications, alerts
APCHI 2013
Holy smartphones and tablets, Batman!: mobile interaction's dynamic duo
Tommaso Piazza, Morten Fjeld, Gonzalo Ramos, AsimEvren Yantac, and Shengdong Zhao
Keywords:
human factors, tablet, PDA, screen, context-aware computing, device, content, smartphone, design, mobile
IwC 2013
Shared Input Multimodal Mobile Interfaces: Interaction Modality Effects on Menu Selection in Single-Task and Dual-Task Environments
Shengdong Zhao, Duncan P. Brumby, Mark Chignell, Dario Salvucci, and Sahil Goyal
Keywords:
earPod, eyes-free, shared-input multimodal interfaces
IJACS 2013
Food Media: Interactive Entertainment Over Telepresent Dinner
Jun Wei, Adrian David Cheok, and Shengdong Zhao
Keywords:
food media, family dining, entertainment, multisensory, home media
CHI EA 2013
Dynamic duo: phone-tablet interaction on tabletops
Tommaso Piazza, Shengdong Zhao, Gonzalo Ramos, Asim Evren Yantaç, and Morten Fjeld
Keywords:
context-aware, input devices and strategies, tablet, mobile user interfaces, content, user interfaces, phone, combination
NoteVideo: facilitating navigation of blackboard-style lecture videos
Toni-Jan Keith Palma Monserrat, Shengdong Zhao, Kevin McGee, and Anshul Vikram Pandey
Keywords:
blackboard-style videos, notevideo, video, video navigation, notevideo+, online streaming, video summary
CHI 2012
Beyond stereo: an exploration of unconventional binocular presentation for novel visual experience
Haimo Zhang, Xiang Cao, and Shengdong Zhao
Keywords:
binocular visualization, special effect, stereo
Exploring user motivations for eyes-free interaction on mobile devices
Bo Yi, Xiang Cao, Morten Fjeld, and Shengdong Zhao
Keywords:
mobile devices, user motivation, eyes-free
Vignette: interactive texture design and manipulation with freeform gestures for pen-and-ink illustration
Rubaiat Habib Kazi, Takeo Igarashi, Shengdong Zhao, and Richard Davis
Keywords:
texture design and manipulation, sketch based interaction, pen-and-ink illustration
AVI 2012
AutoComPaste: auto-completing text as an alternative to copy-paste
Shengdong Zhao, Fanny Chevalier, Wei Tsang Ooi, Chee Yuan Lee, and Arpit Agarwal
Keywords:
copy-paste, windows management, autocompletion
CHI Extended Abstracts 2012
Anyone can sketch vignettes!
Rubaiat Habib Kazi, Takeo Igarashi, Shengdong Zhao, Richard Davis and Toni-Jan Keith Monserrat
Keywords:
Pen and ink illustration, sketch, texture, creativity
ISMAR-AMH 2012
When AR meets food: A structural overview of the research space on multi-facets of food
Jun Wei, Shengdong Zhao, Ryohei Nakatsu, and Henry B.L. Duh
Keywords:
food, augmented reality, smell, taste, entertainment
EuroVis 2012
Tracing Tuples Across Dimensions: A Comparison of Scatterplots and Parallel Coordinate Plots
X. Kuang, H. Zhang, S. Zhao, and M.J. McGuffin
Keywords:
AUTODESK RESEARCH 2012
A Classification of Opening Posts in Commercial Software Help Forums
Xiaole Kuang, Bo Yi, Shengdong Zhao, Jianann Chow, Tovi Grossman, and George Fitzmaurice
Keywords:
opening posts, commercial software, online help forum
APCHI 2012
Older Adults and Computer Usage: Common Activities and Essential Applications
Melissa Wong, Kristal Chan, Niti Madhugiri, and Shengdong Zhao
Keywords:
older adults, Human-computer Interaction
Robots in my contact list: using social media platforms for human-robot interaction in domestic environment
Xiaoning Ma, Xin Yang, Shengdong Zhao, Chi-Wing Fu, Ziquan Lan, and Yiming Pu
Keywords:
domestic robots, social media platforms, intuitive interaction, human-robot interaction
ICMI 2012
LUI: lip in multimodal mobile GUI interaction
Maryam Azh and Shengdong Zhao
Keywords:
multimodal mobile interaction, gesture input, lui
ICMI'12 grand challenge: haptic voice recognition
Khe Chai Sim, Shengdong Zhao, Kai Yu, and Hank Liao
Keywords:
multimodal interface, mobile text input, haptic voice recognition
IHCI 2012
Keynote speech I: Beyond multi-touch: Interactive surfaces that support haptic feedback and multiple independent views
Sriram Subramanian; Xiang Cao; Shengdong Zhao; Sudhir Dixit; Anil K. Gupta; Atanendu Sekhar Mandai; Manas Modi; Ramalatha Marimuthu, Amit. A. Nanavati, Nitendra Rajput and Pradeep Yammiyavar
Keywords:
multitouch devices, interactive surfaces, tactile feedback, physical buttons, Bristol Interaction and Graphics group, touch interfaces, dynamic views allocation, UltraHaptics, multipoint haptic feedback system, PiVOT, tabletop system
MSR-TR 2012
Understanding Mid-Air Hand Gestures: A Study of Human Preferences in Usage of Gesture Types for HCI
Roland Aigner, Daniel Wigdor, Hrvoje Benko, Michael Haller, David Lindbauer, Alexandra Ion, Shengdong Zhao, and Jeffrey Tzu Kwan Valino Koh
Keywords:
SIGGRAPH Posters 2012
Vignette: a style preserving sketching tool for pen-and-ink illustration with texture synthesis
Rubaiat Habib Kazi, Takeo Igarashi, Shengdong Zhao, Richard Davis and Kenshi Takayama
Keywords:
CHI 2011
MOGCLASS: evaluation of a collaborative system of mobile devices for classroom music education of young children
Yinsheng Zhou, Graham Percival, Xinxi Wang, Ye Wang, and Shengdong Zhao
Keywords:
children, music, user-centered design, mobile devices, musical instruments, education
Farmer's tale: a facebook game to promote volunteerism
Don Sim Jianqiang, Xiaojuan Ma, Shengdong Zhao, Jing Ting Khoo, Swee Ling Bay, and Zhenhui Jiang
Keywords:
persuasive games, volunteerism, social networking
Measuring web page revisitation in tabbed browsing
Haimo Zhang and Shengdong Zhao
Keywords:
tabbed browsing, effective revisitation, web revisitation
SandCanvas: a multi-touch art medium inspired by sand animation
Rubaiat Habib Kazi, Kien Chuan Chua, Shengdong Zhao, Richard Davis, and Kok-Lim Low
Keywords:
creativity, table-top computing, multi-touch art, sand animation
SIGGRAPH Dailies 2011
SandCanvas: New Possibilities in Sand Animation
Rubaiat Habib Kazi, Kien Chuan Chua, Shengdong Zhao, Richard Davis, and Kok-Lim Low
Keywords:
Sand animation, multi-touch, tabletop computing, creativity
ICINFA 2011
Assessing age-related performance decrements in user interface tasks
Xiaolei Zhou, Shengdong Zhao, Mark Chignell, and Xiangshi Ren
Keywords:
human performance, speed-accuracy tradeoff, user group, steering task, aging effects
ACM MULTIMEDIA 2010
MOGCLASS: a collaborative system of mobile devices for classroom music education
Yinsheng Zhou, Graham Percival, Xinxi Wang, Ye Wang, and Shengdong Zhao
Keywords:
education, user-centered design, children, musical instruments, mobile devices, music
VCIP 2010
MusicFlow: an interactive music composition system
Sharon Yee Ping Tan, Zhijia Hu, Alan Yih Lun Koh, Felicia, and Shengdong Zhao
Keywords:
NOSSDAV 2010
Towards understanding user tolerance to network latency and data rate in remote viewing of progressive meshes
Ransi Nilaksha De Silva, Wei Cheng, Wei Tsang Ooi, and Shengdong Zhao
Keywords:
progressive meshes, quality of experience, streaming
CHI 2009
Magic cards: a paper tag interface for implicit robot control
Shengdong Zhao, Koichi Nakamura, Kentaro Ishii, and Takeo Igarashi
Keywords:
paper-tag-based interface, implicit human robot interaction, domestic service, magic cards
ACM MULTIMEDIA 2009
Towards characterizing user interaction with progressively transmitted 3D meshes
Ransi Nilaksha De Silva, Wei Cheng, Dan Liu, Wei Tsang Ooi, and Shengdong Zhao
Keywords:
user behavior, interaction, progressive meshes
INTERACT 2009
Designing Laser Gesture Interface for Robot Control
Kentaro Ishii, Shengdong Zhao, Masahiko Inami, Takeo Igarashi, and Michita Imai
Keywords:
laser pointe, stroke gestur, human-robot interactio, user interface
JSMEWES 2009
An Empirical Investigation of Age-related Performance in Computer Interface Tasks
Xiaolei Zhou, Shengdong Zhao, Mark Chignell, and Xiangshi Ren
Keywords:
TSpace 2009
earPod: Efficient Hierarchical Eyes-free Menu Selection
Shengdong Zhao
Keywords:
earPod; Human Computer Interaction; Computer Science; Interactive Techniques
HCI 2008
Improving Target Acquisitions through Utilizing Pen Pressure
Xiangshi Ren, Jibin Yin, Shengdong Zhao, and Yang Li
Keywords:
CHI 2007
InkSeine: In Situ search for active note taking
Ken Hinckley, Shengdong Zhao, Raman Sarin, Patrick Baudisch, Edward Cutrell, Michael Shilman, and Desney Tan
Keywords:
gestures, search, tablet, pen, input, ink, handwriting
Earpod: eyes-free menu selection using touch input and reactive audio feedback
Shengdong Zhao, Pierre Dragicevic, Mark Chignell, Ravin Balakrishnan, and Patrick Baudisch
Keywords:
auditory menu, gestural interaction
INTERACT 2007
The Adaptive Hybrid Cursor: A Pressure-Based Target Selection Technique for Pen-Based User Interfaces
Xiangshi Ren, Jibin Yin, Shengdong Zhao, and Yang Li
Keywords:
pen-based interfaces, pressure, small target acquisition, target density
IFAC HMS 2007
Using Glyphs To Facilitate Transition From Hierarchical Selection To Gesturing
Shengdong Zhao and Mark Chignell
Keywords:
human-machine interface, human-centered design, motor control
CHI 2006
Zone and polygon menus: using relative position to increase the breadth of multi-stroke marking menus
Shengdong Zhao, Maneesh Agrawala, and Ken Hinckley
Keywords:
open-based interfaces, position-based menus, pie menus, marking menus
UIST 2006
Phosphor: explaining transitions in the user interface using afterglow effects
Patrick Baudisch, Desney Tan, Maxime Collomb, Dan Robbins, Ken Hinckley, Maneesh Agrawala, Shengdong Zhao, and Gonzalo Ramos
Keywords:
cartoon animation, user interfaces, phosphor, diagrams, comic animation, information visualization
INFOVIS 2005
Elastic hierarchies: combining treemaps and node-link diagrams
Shengdong Zhao, M.J. McGuffin, and M.H. Chignell
Keywords:
data visualisation, computer animation, tree data structures
UIST 2004
Simple vs. compound mark hierarchical marking menus
Shengdong Zhao and Ravin Balakrishnan
Keywords:
pie menus, marking menus
INTERACT 2003
Listen to the Music: Audio Preview Cues for Exploration of Online Music
Monica M. C. Schraefel , Maria Karam and Shengdong Zhao
Keywords:
Multimodal interfaces, information access, data exploration, audio interfaces
WWW 2002
Hunter gatherer: interaction support for the creation and management of within-web-page collections
Monica M. C. Schraefel , Yuxiang Zhu, David Modjeska, Daniel Wigdor and Shengdong Zhao
Keywords:
Web-based interaction design, information gathering and management, attention, collections, transclusions