CAREER: Next Generation Multimodal Interfaces

Principal Investigator: Jaime Ruiz

Sponsor: National Science Foundation

Start Date: August 15, 2018

End Date: July 31, 2023

Amount: $193,768


Ever smaller computational devices coupled with advances in input affordances are revolutionizing the way users interact with technology. New, more natural user interfaces exploit touch, speech, gestures, handwriting, and vision in an effort to reduce the barriers imposed by interfaces, so that computing technology acts more like a dynamic partner and less like a tool. Nevertheless, human-computer interaction continues for the most part to mimic the traditional point-and-click paradigm associated with desktop computers. This research will take human-computer communication to the next level by leveraging human-human nonverbal communication such as gaze, body posture, and facial expressions. Project outcomes will have strong societal impact by moving us closer to truly smart environments and lowering the bar for those individuals who find using current technology difficult. The educational activities encompassed by this work will expose students to new ways of interacting with technology, in order to encourage them to pursue careers in computer science.

More Information: