Haptic Soundscapes
Purpose
Haptic Soundscapes Research attempts to find ways of integrating
haptics and sounds into digital media, specifically online maps so that blind
and disabled persons can use these products.
Research
The following examples are in order from newest to oldest.
Some examples require Immersion Desktop, Haptic Mice, Flash Player, SVG Plug-in,
Java support and other additions. You need to use Internet Explorer 5.5 or higher.
Many examples will not work with Netscape.
- Location Finding Algorithm
- Sound & Haptics Interaction Experiment in SVG.
- Will be posted after experiment has been run.
- California Cenus 2000 Map - nearly ready for deployment!
- California Counties by several Census 2000 variables,
using haptic and auditory output. SVG plugin required. Jsyn plugin required.
- Create Vector
Shapes & Explore Haptically <new
- Create several customizable vector shapes using auditory/haptic output
and explore results haptically. SVG plugin required.
- Nevada
County Map v1.0
- Auditory Searchable County Map of Nevada using SVG.
Users can search for any county in Nevada, and they will be vocally told
where to move the mouse. SVG plugin required.
- UCSB
Campus Map v2.0b
- This release uses a totally new algorithm for zooming, new panning capabilities
using a slider bar, zooming slider bar, new colors, visual texture on
buttons and a preloader. The new zooming algorithm is mathmatically much
simpler and more accurate. The new sliders are haptically enabled with
the same texture found on the traditional zoom and pan buttons. Sound
need to be added to new buttons. Flash plugin required. * Many
thanks to Dennis Whelan (UCSB Campus Planning and Design) for the excellent
base map.
- UCSB
Campus Map w/Zoom Slider v1.8b
- Test implementations of Scaling Bar. This is beta version, and has some
issues, namely, using the scaling bar to zoom does not zoom in/out necessarily
on the correct location. * Many
thanks to Dennis Whelan (UCSB Campus Planning and Design) for the excellent
base map
- Force
feedback experiment.
- Never run do to disappointing performance of feedback mouse. Requires
Flash Plugin and fixed Wingman Force Feedback Mouse for Win 98. No force
feedback on other operating systems due to mouse only working on Windows
98 (no drivers for other OS's). offsite: links to Andreas website.
- California
Cenus Map A
- This will be an interactive map of California using Census 2000 data
with both Haptic and Sound effects when finished. Click on the southern
California counties for their population counts as of Year 2000. A few
of the northern Counties are not finished.
- California
Census Map B
- California Map with tones attached to each county. The tones vary in
pitch and volume depending on the population. The pitch only lasts one
second, and it starts as soon as you put the mouse over the county. A
warning for Los Angeles county- if your speakers are up too high, it might
be a bit loud.
- UCSB
Campus Map v1.75
- Main and secondary doors have been added to the most used buildings
on campus. When you run the mouse over the door, it will announce either
as "primary entrance" or "secondary entrance" and
have a haptic effect slightly different than the rest of the structure
has. Detail now changes as one zooms in and out. At first one would only
see the major objects but as one zooms in, more objects such as sidewalks,
text and other smaller details become visible. This version works best
with the Logitech IFeel Mouseman. * Many
thanks to Dennis Whelan (UCSB Campus Planning and Design) for the excellent
base map.
- UCSB
Campus Map v1.6
- Finished updating all the older sounds, all buildings now have have
same voice and sound level. Changed roads, buildings, and some other sounds,
so that they would only work when over the object, if you move out of
the object, then the sound will quit. This avoids having many sounds play
at once, which was very annoying. This version works best with the Logitech
IFeel Mouseman. * Many
thanks to Dennis Whelan (UCSB Campus Planning and Design) for the excellent
base map.
- UCSB
Campus Map v1.5
- Fixed zooming to center issue. This took a lot of work and the solution
is quite complicated. The solution is here for zooming in, zooming out
is nearly the same. It is a Flash ActiveScript (.as), which works much
like that of JavaScript. The factor .47 is found by trial and error. Added
maximum/minimum zooming factors, maximum pan-right, pan-left, etc. Added
secondary roads, trees and water vocally/haptically enabled. This version
works best with the Logitech IFeel Mouseman. * Many
thanks to Dennis Whelan (UCSB Campus Planning and Design) for the excellent
base map.
- UCSB
Campus Map v1.2
- Most buildings haptically & vocally enabled. Most roads and parking
lots haptically & vocally enabled. Click lots and roads for vocal. * Many
thanks to Dennis Whelan (UCSB Campus Planning and Design) for the excellent
base map.
- UCSB
Campus Map v1.0
- This is the first attempt at the campus map in Flash. * Many
thanks to Dennis Whelan (UCSB Campus Planning and Design) for the excellent
base map.
- ASP
UCSB Map
- This was a project to build a haptic map in ASP, but we changed to flash.
Test it and you will understand why. The zooming and panning don't work
very well in comparison. * Many
thanks to Dennis Whelan (UCSB Campus Planning and Design) for the excellent
base map.
- Test
Haptic Flash Boxes
- This was a test project to verify using Haptic effects in Flash.
Researchers
Plugins or software required by examples
- Macromedia
Flash Plugin
- Vector plugin for IE & NN.
- SVG
Plugin
- Vector plugin to support SVG XML
data type as defined by W3C.
- Java Support
- some pages require java support, which maybe deactivated on your browser.
- Jsyn Plugin
- A java based sound synthesis applet.
- Immersion
Plugin
- Haptic Plugins to make your haptic mouse work. You have to have a
haptic mouse.
Last updated by David Jones on 7/4/2009