Exploring the Use of Gesture in Collaborative Tasks
Isaac Wang, Pradyumna Narayana, Dhruva Patil, Gururaj Mulay, Rahul Bangar, Bruce Draper, Ross Beveridge, and Jaime Ruiz. 2017. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '17). ACM, New York, NY, USA, 2990-2997. DOI: https://doi.org/10.1145/3027063.3053239
I’m a Graduate Research Assistant at the University of Florida, currently pursuing a Ph.D. in Human-Centered Computing under Dr. Jaime Ruiz. I graduated in 2015 with a B.S. in Computer Science from Seattle Pacific University.
Currently, my research focuses on communicating with computers through gesture interaction and the use of expressive virtual agents. I am also developing an intelligent video annotation tool, called EASEL, that uses gesture segmentation and recognition to automate and improve the process of analyzing non-verbal gestures and intents in video.
Isaac defended his thesis and graduated with his PhD in Summer 2022.
Related Projects
EGGNOG: A Continuous, Multi-modal Data Set of Naturally Occurring Gestures with Ground Truth Labels
Isaac Wang, Mohtadi Ben Fraj, Pradyumna Narayana, Dhruva Patil, Gururaj Mulay, Rahul Bangar, J. Ross Beveridge, Bruce A. Draper, and Jaime Ruiz. 2017. In 2017 12th IEEE International Conference on Automatic Face Gesture Recognition (FG 2017), 414–421. DOI: https://doi.org/10.1109/FG.2017.145
Communicating and Acting: Understanding Gesture in Simulation Semantics
Nikhil Krishnaswamy, Pradyumna Narayana, Isaac Wang, Kyeongmin Rim, Rahul Bangar, Dhruva Patil, Gururaj Mulay, Ross Beveridge, Jaime Ruiz, Bruce Draper, and James Pustejovsky. 2017. In 12th International Conference on Computational Semantics (IWCS 2017)--Short papers.
EASEL: Easy Automatic Segmentation Event Labeler
Isaac Wang, Pradyumna Narayana, Jesse Smith, Bruce Draper, Ross Beveridge, and Jaime Ruiz. 2018.In Proceedings of the 23rd International Conference on Intelligent User Interfaces (IUI '18). ACM, New York, NY, USA. DOI: https://doi.org/10.1145/3172944.3173003
Staying Alive with Virtual Humans
Sarah Morrison-Smith, Heng Yao, Isaac Wang, Benjamin Lok, and Jaime Ruiz. 2018. In CHI '18 Extended Abstracts on Human Factors in Computing Systems (CHI EA '18). ACM, New York, NY, USA
Cooperating with Avatars Through Gesture, Language and Action
Pradyumna Narayana, Nikhil Krishnaswamy, Isaac Wang, Rahul Bangar, Dhruva Patil, Gururaj Mulay, Kyeongmin Rim, Ross Beveridge, Jaime Ruiz, James Pustejovsky, and Bruce Draper. 2018. In Intelligent Systems and Applications (Advances in Intelligent Systems and Computing), 272–293.
Exploring Virtual Agents for Augmented Reality
Isaac Wang, Jesse Smith, and Jaime Ruiz. 2019. In 2019 CHI Conference on Human Factors in Computing Systems Proceedings (CHI 2019), May 4–9, 2019, Glasgow, Scotland, UK. ACM, New York, NY, USA. Paper 281, 10 pages. https://doi.org/10.1145/3290605.3300511
Experimental Analysis of Single Mode Switching Techniques in Augmented Reality
Jesse Smith, Isaac Wang, Julia Woodward, and Jaime Ruiz. 2019. In Proceedings of the 45th Graphics Interface Conference on Proceedings of Graphics Interface 2019 (GI ‘19). Canadian Human-Computer Communications Society, Waterloo, CAN, Article 20, 1–8. https://doi.org/10.20380/GI2019.20
User-Aware Shared Perception for Embodied Agents
David White, Ross Beveridge, Bruce Draper, Francisco Ortega, Rahul Bangar, Dhruva Patil, James Pustejovsky, Nikhil Krishnaswamy, Kyeongmin Rim, Jaime Ruiz, and Isaac Wang. 2019. User-Aware Shared Perception for Embodied Agents. In 2019 IEEE International Conference on Humanized Computing and Communication (HCC), Laguna Hills, CA, USA, 2019, pp. 46-51.
Examining Fitts’ and FFitts’ Law Models for Children’s Pointing Tasks on Touchscreens
Julia Woodward, Jahelle Cato, Jesse Smith, Isaac Wang, Brett Benda, Lisa Anthony, and Jaime Ruiz. 2020. In Proceedings of the International Conference on Advanced Visual Interfaces (AVI '20). September 28– October 2, 2020, Ischia, Italy. ACM, New York, NY, USA, 5 pages. https://doi.org/10.1145/3399715.3399844
Evaluating the Scalability of Non-Preferred Hand Mode Switching in Augmented Reality
Jesse Smith, Isaac Wang, Winston Wei, Julia Woodward, and Jaime Ruiz. 2020. In Proceedings of the International Conference on Advanced Visual Interfaces (AVI '20). September 28– October 2, 2020, Ischia, Italy. ACM, New York, NY, USA, 9 pages. https://doi.org/10.1145/3399715.3399850
Examining the Presentation of Information in Augmented Reality Headsets for Situational Awareness
Julia Woodward, Jesse Smith, Isaac Wang, Sofia Cuenca, and Jaime Ruiz. 2020. In Proceedings of the International Conference on Advanced Visual Interfaces (AVI '20). September 28– October 2, 2020, Ischia, Italy. ACM, New York, NY, USA, 5 pages. https://doi.org/10.1145/3399715.3399846
“Wow, You Are Terrible at This!” - An Intercultural Study on Virtual Agents Giving Mixed Feedback
2020. “Wow, You Are Terrible at This!” - An Intercultural Study on Virtual Agents Giving Mixed Feedback. In IVA ’20: Proceedings of the 20th ACM International Conference on Intelligent Virtual Agents (IVA ’20), October 19–23, 2020, Virtual Event, Scotland, UK. ACM, New York, NY, USA, 8 pages. https://doi.org/10.1145/3383652.3423887
MMGatorAuth: A Novel Multimodal Dataset for Authentication Interactions in Gesture and Voice
Sarah Morrison-Smith, Aishat Aloba, Hangwei Lu, Brett Benda, Shaghayegh Esmaeili, Gianne Flores, Jesse Smith, Nikita Soni, Isaac Wang, Rejin Joy, Damon L. Woodard, Jaime Ruiz, and Lisa Anthony. 2020. In Proceedings of the 2020 International Conference on Multimodal Interaction (ICMI '20). Association for Computing Machinery, New York, NY, USA, 370–377. DOI:https://doi.org/10.1145/3382507.3418881
Examining the Use of Nonverbal Communication in Virtual Agents
Isaac Wang and Jaime Ruiz. 2021. International Journal of Human–Computer Interaction (Mar. 2021), 1–26. DOI: https://doi.org/10.1080/10447318.2021.1898851
It’s a Joint Effort: Understanding Speech and Gesture in Collaborative Tasks
Isaac Wang, Pradyumna Narayana, Dhruva Patil, Rahul Bangar, Bruce Draper, Ross Beveridge, and Jaime Ruiz. 2021. In Human-Computer Interaction. Interaction Techniques and Novel Applications (Lecture Notes in Computer Science), 159–178. https://doi.org/10.1007/978-3-030-78465-2_13