Toward Perceptual Computing: Vision-based Human Computer Interaction

With the ubiquity of powerful, mobile computers andrapid advances in sensing and robot technologies,there exists a great potential for creating advanced,perceptual computing environments. In this work, weinvestigate techniques for integrating passive,vision-based sensing into such environments, whichinclude both conventional interfaces and large-scaleenvironments. We discuss a methodology forvision-based human-computer interaction called theVisual Interaction Cues (VICs) paradigm. In theVICs paradigm, users interact with the computersystem through natural hand gestures. We capture alanguage of interaction" in which individualgestures are the words and sequences of gestures arethe sentences. We give examples of both individualgestures and the gesture language and present themon our next-generation interaction platform the 4DTouchpad. Ultimately our work takes a concrete steptoward perceptual user interfaces."

Corso is an assistant professor of Computer Science andEngineering at the University at Buffalo, The State University ofNew York. He received his Ph.D. at The Johns Hopkins Universityin 2005 in Computer Science. He then spent two years as apost-doctoral fellow at the University of California, Los Angelesin Medical Imaging.