Haptic Artificial Muscle Skin for Extended Reality

Yuxuan Guo, Yang Luo, Roshan Plamthottam, Siyou Pei, Chen Wei, Ziqing Han, Jiacheng Fan, Mason Possinger, Kede Liu, Yingke Zhu, Zhangqing Fei, Isabelle Winardi, Hyeonji Hong, Yang Zhang, Lihua Jin, and Qibing Pei (Science Advances, 10(43), eadr1765, 2024)

We present a wearable haptic artificial muscle skin based on multilayer dielectric elastomer actuators (DEAs) in Extended Reality (XR) systems to enhance immersion.

UI Mobility Control in XR: Switching UI Positionings between Static, Dynamic, and Self Entities

Siyou Pei, David Kim, Alex Olwal, Yang Zhang, and Ruofei Du (CHI '2024)

We facilitated UI mobility between static, dynamic, and self entities with Finger Switches based on users' in-situ needs.

WheelPose: Data Synthesis Techniques to Improve Pose Estimation Performance on Wheelchair Users

William Huang, Sam Ghahremani, Siyou Pei, and Yang Zhang (CHI '2024)

A data synthesis pipeline to address the underrepresentation of wheelchair users in data collection for pose estimation models.

Embodied Exploration: Facilitating Remote Accessibility Assessment for Wheelchair Users with Virtual Reality

Siyou Pei, Alexander Chen, Chen Chen, Franklin Mingzhe Li, Megan Fozzard, Hao-yun Chi, Nadir Weibel, Patrick Carrington, Yang Zhang (ASSETS '2023)

VR technique for wheelchair users to evalute accessibility remotely.

ForceSight: Non-Contact Force Sensing with Laser Speckle Imaging

Siyou Pei, Pradyumna Chari, Xue Wang, Xiaoying Yang, Achuta Kadambi, Yang Zhang (UIST '2022)

Best Demo Honorable Mention

Object surfaces deform in the presence of force. This deformation, though very minute, manifests as observable and discernible laser speckle shifts, which we leverage to sense the applied force.

Hand Interfaces: Using Hands to Imitate Objects in AR/VR for Expressive Interactions

Siyou Pei, Alexander Chen, Jaewook Lee, Yang Zhang (CHI '2022)

Best Paper Honorable Mention

A new interaction technique that lets users' hands become virtual objects by imitating the objects themselves. For example, a thumbs-up hand pose is used to mimic a joystick.

AURITUS: An Open-Source Optimization Toolkit for Training and Development of Human Movement Models and Filters Using Earables

Swapnil Sayan Saha, Mr. Sandeep Singh Sandha, Siyou Pei, Vivek Jain, Mr. Ziqi Wang, Yuchen Li, Ankur Sarker, Prof. Mani Srivastava (IMWUT '2021)

AURITUS is an extendable and open-source optimization toolkit designed to enhance and replicate earable applications, e.g., activity detection and head-pose tracking.