About Me

Hi 😆 This is Xiaoyu. I’m now working as a research intern at the HCI Initiative of The Hong Kong University of Science and Technology, under the supervision of Prof. Xiaojuan Ma. Previously I was a research intern at Institute of Computing Technology, Chinese Academy of Sciences, supervised by Prof. Tengxiang Zhang.

I received my MSc degree in Big Data Technology from HKUST and my BSc degree in Data Science at Yuanpei College, Peking University.

My research focuses on Human-Computer Interaction, encompassing both technique-driven approaches (e.g., designing novel input/output techniques) and problem-driven approaches (e.g. understanding users’ choices of non-verbal cues to express their intents). While they may have different paradigms, they are deeply complementary. Thus, I would like to define my research interest as iteratively designing novel interactive systems and understanding users through a careful examination of their interaction with the system, where insights from one inform and inspire the other.
If you are interested in my work, feel free to chat with me 🥹.

📝 Selected Publications

• Signaling Human Intentions to Service Robots: Understanding the Use of Social Cues during In-Person Conversations (CHI '25, Honorable Mention)
  Hanfang Lyu, Xiaoyu Wang, Nandi Zhang, Shuai Ma, Qian Zhu, Yuhan Luo, Fugee Tsung, Xiaojuan Ma

• GestureGPT: Toward Zero-Shot Free-Form Hand Gesture Understanding with Large Language Model Agents (ISS '24, Best Paper)
  Xin Zeng*, Xiaoyu Wang*, Tengxiang Zhang, Chun Yu, Shengdong Zhao, Yiqiang Chen

• WebJump: AR-facilitated Distributed Display of Web Pages (CHI EA '23)
  Xin Zeng, Xiaoyu Wang, Zhengtai Gou, Yiqiang Chen, Tengxiang Zhang

🎖️ Selected Awards

• 2025 Best Paper Honorable Mention Award @ CHI '25
• 2024 Best Paper Award @ ISS '24
• 2024 Excellent Student Scholarship for MSc BDT Program @ HKUST
• 2023 Outstanding Graduate in Yuanpei College @ PKU
• 2022 Award for Scientific Research @ PKU
• 2022 3rd-class Scholarship @ PKU

👻 Miscellaneous

• During my undergraduate years at Yuanpei College, I was a member of Yuanpei Profile (Website|Github|WeChat), a student-run organization dedicated to building an intelligent campus for our college. We developed systems to support student affairs like room booking, interest group organization, and information sharing. We even created some fun projects like “Your Annual Usage Report of Function Rooms” (a latest version developed by current members is here). 🫶🏻