fun.tast.tisch. - Novel evolution to operate the Microsoft Pixelsense in neuro-rehabilitation

Start date: 01-10-2012

End date: 30-09-2014


  • Collaboration
  • Human-Computer Interaction
  • Interaction Methods
  • Accessibility

In the project fun.tast.tisch. which was led by our cooperation partner LIFEtool, an innovative software system with recognition of vulnerable objects was developed for the use of Microsoft Pixelsense in the training area. This system should correspond to the therapeutic requirements or provide for the integration of existing therapeutic approaches. Above all these should use the advantages of Microsoft Pixelsense to create an added value for the patient and the therapist.


Worldwide, 15 million people suffer a stroke every year - in addition to strokes, severe craniocerebral trauma (SHT) as a result of e.g. traffic accidents is the leading cause of severe physical and neurological disabilities. With computer programs, brain-damaged patients in rehabilitation can regain lost abilities through targeted training. However, the standard PC has its limits in therapy.

The fun.tast.tisch consortium has the necessary complementary competencies, such as medical-technical and therapeutic knowledge, software development know-how, e.g. in the field of Natural User Interfaces (NUI), methodical competencies and many years of project management and evaluation experience at its disposal. 

Target group

Our main target group are neurological patients with limitations of basal cognitive abilities due to acquired and/or congenital neurological damage of the central nervous system.


In particular, the functional deficits of patients with regard to the novel application of Microsoft Pixelsense - through value-added criteria such as direct interaction, multi-touch, multi-user, tabletop design and object recognition - were analyzed and determined.

Thereby the therapy application possibilities and above all the requirements of the therapists, patients to this software system were considered.

Training software modules were developed which address the concrete functional deficits.

A further goal was to evaluate the training modules continuously with the target group in user studies.


  • Functional software prototype on Microsoft PixelSense with numerous training modules (e.g. with focus on motor skills, memory, or spatial cognition and construction)
  • Results of several user studies, partly in the clinical environment

Project website

Further information can be found at


M. Augstein, T. Neumayr, R. Ruckser-Scherb and S. Dielacher,"Collaboration Around an Interactive Tabletop in Rehabilitation Settings",in Collaboration Meets Interactive Spaces,C. Anslow, P. Campos & J. Jorgeth ed.Springer,2017,425-442.

M. Augstein, T. Neumayr, I. Karlhuber, S. Dielacher, J. Altmann and S. Öhlinger,"Tabletop-Supported Rehabilitation with fun.tast.tisch. - Lessons Learned",in Proceedings of the 10th ACM International Conference on Interactive Tabletops and Surfaces (ITS15),Funchal, Madeira, Portugal,2015,pp. 283-288.

M. Augstein, T. Neumayr, I. Karlhuber, S. Dielacher, S. Öhlinger and J. Altmann,"Training of Cognitive Performance in Complex Tasks with a Tabletop-Based Rehabilitation System",in Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces,Funchal, Madeira, Portugal,2015,pp. 15-24.

T. Neumayr, M. Augstein, J. Altmann, S. Dielacher and I. Karlhuber,"fun.tast.tisch. – A User-Centered Interdisciplinary Design Process for a Novel Approach to Neuro-Rehabilitation",in Tagungsband des 8. Forschungsforum der österreichischen Fachhochschulen,Kufstein, Austria,2014.

M. Augstein and T. Neumayr,"Touch and Tangibles - Interacting with fun.tast.tisch. Results of a Study with Non-Target-Group Users",in Proceedings of the 2014 Workshop on Tactile/Haptic User Interfaces for Tabletops and Tablets (TacTT),Dresden, Germany,2014.

M. Augstein and T. Neumayr,"Challenges and Opportunities of fun.tast.tisch. in Interactive Rehabilitation Settings",in Proceedings of the 2nd International Workshop Collaboration meets Interactive Surfaces. Walls, Tables, Tablets, Phones, co-located with ITS2014,Dresden, Germany,2014.

M. Augstein, T. Neumayr, R. Ruckser-Scherb, I. Karlhuber and J. Altmann,"The fun.tast.tisch. Project - Interactive Tabletops in Neuro-Rehabilitation",in Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces 2013,St. Andrews, Scotland, UK,2013,pp. 81-90.

M. Augstein, T. Neumayr, R. Ruckser-Scherb, I. Karlhuber and J. Altmann,"The fun.tast.tisch. Project – A Novel Approach to Neuro-Rehabilitation Using an Interactive Multiuser Multitouch Tabletop",in Proceedings of the 2013 ACM International Conference on Interactive Tabletops and Surfaces,St. Andrews, Scotland, UK,2013,pp. 81-90.

M. Augstein, T. Neumayr, I. Schacherl-Hofer and S. Öhlinger,"fun.tast.tisch. - User-Centered Design for Interactive Tabletop Interfaces in Neuro-Rehabilitation",in Mensch & Computer 2013, Tagungsband,Bremen, Germany,2013,pp. 309-312.

M. Augstein, T. Neumayr and I. Schacherl-Hofer,"The Usability of a Tabletop Application for Neuro-Rehabilitation from Therapists' Point of View",in Proceedings of the 9th ACM International Conference on Interactive Tabletops and Surfaces,Dresden, Germany,2014,pp. 239-248.

Project lead

Placeholder Picture for Mirjam Augstein

Mirjam Augstein


Picture of Thomas Neumayr

Thomas Neumayr

Picture of Josef Altmann

Josef Altmann

Funding Partners

Company Partners

Scientific Partners