SuperLectures.com

PERCEIVING GRAPHICAL AND PICTORIAL INFORMATION VIA TOUCH AND HEARING

Joint Audio Visual Processing

Full Paper at IEEE Xplore

Presented by: Thrasyvoulos Pappas, Author(s): Pubudu Madhawa Silva, Thrasyvoulos N. Pappas, Northwestern University, United States; Joshua Atkins, James E. West, The Johns Hopkins University, United States

With the ever increasing availability of the Internet and electronic media rich in graphical and pictorial information -- for communication, commerce, entertainment, art, education -- it has been hard for the visually impaired community to keep up. We propose a non-invasive system that can be used to convey graphical and pictorial information via touch and hearing. The main idea is that the user actively explores a two-dimensional layout consisting of one or more objects on a touch screen with the finger while listening to auditory feedback. We have demonstrated the efficacy of the proposed approach in a range of tasks, from basic shape identification to perceiving a scene with several objects. The proposed approach is also expected to contribute to research in virtual reality, immersive environments, and medicine.


  Speech Transcript

|

  Comments

Please sign in to post your comment!

  Lecture Information

Recorded: 2011-05-24 17:15 - 17:35, Club H
Added: 9. 6. 2011 12:19
Number of views: 45
Video resolution: 1024x576 px, 512x288 px
Video length: 0:17:21
Audio track: MP3 [5.93 MB], 0:17:21