SensoramaLab
Overview    |    Activities    |    Facilities    |    Technical details    |    Sponsors    |    Contacts 

RESEARCH Rehabilitation of handicaped little girl by Tony Brooks Rehabilitation of handicapped little girl by Tony Brooks Tony's workshop in Porto (2008)Tony showing PS2 Eye toy game for rehab Our stand at Scandinavian Rehabilitation Messe 2008, CPH. Immersion for therapy of acrophobia Statistics on publications about VRET Skip RIzzo PTSD application Virtual Environment for PTSD EXPERIMENTATIONS Tux Racer customized Tux Racer original Magic carpet The ToyRoom Using Wii controller Space RaceFlying Cities Visual perception of music by TB TEACHING ESS: Student game like eye toy Whodunit : Students game for sensorama
Rehabilitation  For kids with important disabilities, the experience of multimedia interaction with dedicated gesture interfaces is a great moment of creativity and play... the positive impact on their wellness and motricity proves to be important for both the child and his/her family.
"Soundscapes virtual interactive space" was presented in April 2008 as an ArtAbilitation workwhop.
See the description at the soundscape web site.
Training and therapy Exercises for physiotherapy are often repetitive and boring to execute. Games involving body movements (like the Sony EyeToy) can be used to motivate the trainee to perform exercises. Therapists find the idea appealing, but they would like to have more control on the design and execution of the exercises.

We dispose of a variety of gaming interfaces (camera or sensors) involving physical movement and design or adapt existing games to fit to specific therapeutic needs.
Virtual Reality Exposure Therapy VR simulation is a powerful tool for Cognitive and Behavioural Therapists. Over the past 10 years (follow link on picture), several experiments have shown that it can be applied to various anxiety disorders.

Our research interests stand in the development of innovative technical solutions involving more play and creative interaction in the VRET.
PTSD Therapy


Iraq scenario
We collaborate with Pr. A.Rizzo (US institute for creative technologies) on the development of a VR application for the therapy of Post Traumatic Stress Disorder by successive exposure of warriors in virtually simulated scenes of Iraq war.
 
New gaming interfaces





PAPER:
Herbelin B., Ciger J. and Brooks A.L. (2008). Customization of gaming technology and prototyping of rehabilitation applications. Proc. 7th International Conference on Disability, Virtual Reality and Associated Technologies and Art Abilitation, Maia, PO, 8-11 Sept 2008, pp. 211-218

Get PDF here

Tux Racer / PPR is a famous open source game. First we made it stereoscopic. Second, we changed the control to be full body with camera tracking like for eye-toy games. Another way to control the game is by using a Soundbeam sensor.



Download Description PDF


Tux Racer
Ever dream of driving a flying carpet? Our simulator uses a 6 DOFs head tracker to control the camera point of view and a dance mat to control the carpet. In addition, voice recognition allows to order the carpet to "fly", "stop", go "slower" or "faster".

The simulator is quite immersive and requires a good sense of balance.

Magic Carpet
Magic Carpet 2 (Thanks to Margot for her kind participation)
Magic Carpet: Tony great master :)

Download Description PDF
The ToyRoom is a virtual environment that you explore by flying a toy airplane. You control its orientation by simple manipulation of a little box (containing a 3-axis accelerometer, like in Mintendo Wii). Physics simulation allows to hit and knock objects over. The game consist in catching as many energy balls as possible; you locate them visualy and from the music they make (spatialized sound).

The emphasise is made on the "naturalness" of the interface and the simplicity of gaming rules; very young kids (3+) instantly feel at ease with it !

Download Description PDF
The Nindendo Wii console proposes new and natural ways to play computer games by sensing hand movements of the players. However, the difficulty of  games like Wii Sports is too high for being used for rehabilitation (physiotherapy training, handicapped children, etc.).

Therefore, we are working with the CWiid interface library to use Wii controllers with any game we can develop or adapt. For example, the GPL game Neverball is great to play by orienting a Wii controller instead of using the mouse.
The "Space Race" is a simple racing game between two spaceships. The player starts behind the ennemy and shall go through the acceleration rings few times in order to overtake the opponent. Hitting obstacles is not fatal but slows down the vehicle. Auditory cues help locating the oponent and the gate.

To control the spaceship, the user holds a bar in two hands and moves it on the side to steer and front and back to control the speed. The tracking of the handle bar is made by stereo-vision of two reflective markers.


Download Description PDF
Artistic experiments Although we are not pure artists, we do not forget that creativity goes hand in hand with art.
Developing interactive performance such as Babilu volati (left image) or creating real time visualizations of music (right) are other ways of experimenting with original cross modal interactions that have great potential for rehabilitation and social inclusion of handicaped.
Students' projects Students in Medialogy at AAUE develop computer games and virtual environments. The examples above give an idea of the kind of projects we supervise. Valid HTML 4.01 Transitional
Document made with Nvu