Joint Audio Visual Processing

Full Paper at IEEE Xplore

Přednášející: Thrasyvoulos Pappas, Autoři: Pubudu Madhawa Silva, Thrasyvoulos N. Pappas, Northwestern University, United States; Joshua Atkins, James E. West, The Johns Hopkins University, United States

With the ever increasing availability of the Internet and electronic media rich in graphical and pictorial information -- for communication, commerce, entertainment, art, education -- it has been hard for the visually impaired community to keep up. We propose a non-invasive system that can be used to convey graphical and pictorial information via touch and hearing. The main idea is that the user actively explores a two-dimensional layout consisting of one or more objects on a touch screen with the finger while listening to auditory feedback. We have demonstrated the efficacy of the proposed approach in a range of tasks, from basic shape identification to perceiving a scene with several objects. The proposed approach is also expected to contribute to research in virtual reality, immersive environments, and medicine.

  Přepis řeči



Please sign in to post your comment!

  Informace o přednášce

Nahráno: 2011-05-24 17:15 - 17:35, Club H
Přidáno: 9. 6. 2011 12:19
Počet zhlédnutí: 45
Rozlišení videa: 1024x576 px, 512x288 px
Délka videa: 0:17:21
Audio stopa: MP3 [5.93 MB], 0:17:21