The question
There are four high-level primary questions. (1) How can neuromorphic computing aid user interaction and decision making? (2) How is decision making affected as a user goes from a frontier LLM to a smaller model, and everywhere within that spectrum? (3) Agentic AI is set to become pervasive in many jobs. How does its use affect our cognitive load, and how can we improve the interfaces? And (4) how can neuromorphic computing and other AI paradigms help the user have a personalized interaction? This last one is especially important for accessibility.
How we work
We have started most recently in this area. For example, Beyond the Wizard of Oz (opens in new tab) , an IEEE VR publication (under the journal IEEE TVCG), shows what happens when real-time machine learning is accurate enough (80% or higher) yet makes mistakes. We validated the work conducted for years by the human-factors community, now using real-time machine learning. Yet it was not only validated — the automation bias was worse than we believed.
Currently, we have students working on the questions above to solve different critical human-centered AI challenges.
What this work enables
We hope that our work will enable the improvement of the use of AI, in particular under low-powered and constrained environments.
Papers in this area 11
Journal Articles 3
- Beyond the Wizard of Oz: Negative Effects of Imperfect Machine Learning to Examine the Impact of Reliability of Augmented Reality Cues on Visual Search Performance (opens in new tab) 2024
- Fast, Accurate, but Sometimes Too-Compelling Support: The Impact of Imperfectly Automated Cues in an Augmented Reality Head-Mounted Display on Visual Search Performance 2023
- Building an Emotionally Responsive Avatar with Dynamic Facial Expressions in Human—Computer Interactions (opens in new tab) 2021
Conference Papers 3
- User-Aware Shared Perception for Embodied Agents (opens in new tab) 2019
- A System for Non-Intrusive Affective Assessment in the Circumplex Model from Pupil Diameter and Facial Expression Monitoring (opens in new tab) 2018
- Bio-sensing for Emotional Characterization without Word Labels (opens in new tab) 2009
Workshop Articles 2
- Addressing Human Factors Related to Artificial Intelligence Integrated Visual Cueing (opens in new tab) 2024
- Interpreting and Generating Gestures with Embodied Human Computer Interactions 2020