A Dual-Mode Human Computer Interface Combining Speech and Tongue Motion for People with Severe Disabilities

IEEE Trans Neural Syst Rehabil Eng, 2013 · DOI: 10.1109/TNSRE.2013.2248748 · Published: November 1, 2013

Simple Explanation

This research introduces a new assistive technology that combines tongue movement and speech recognition to help people with severe disabilities use computers more easily. The system, called the dual-mode Tongue Drive System (dTDS), uses a headset to track tongue movements and capture voice commands. The dTDS aims to provide a faster, more flexible, and more reliable way for users to interact with computers, overcoming the limitations of using either tongue movement or speech alone. Initial tests with both able-bodied individuals and those with spinal cord injuries showed that the dTDS improved performance in tasks requiring both pointing and typing, suggesting it could be a valuable tool for computer access.

Study Duration

Not specified

Participants

14 able-bodied subjects and three individuals with high level spinal cord injuries at level C3–C5

Evidence Level

Level Not specified, Experimental

Key Findings

1
The dual-mode Tongue Drive System (dTDS) significantly improves the speed of completing complex computer access tasks compared to using tongue motion or speech recognition alone.
2
Combining tongue motion and speech recognition in the dTDS does not negatively impact the user's performance with either modality.
3
Individuals with prior experience using the Tongue Drive System (TDS) demonstrate better control over the mouse cursor and complete tasks more efficiently when using the dTDS.

Research Summary

This paper introduces the dual-mode Tongue Drive System (dTDS), a novel human-computer interface designed to assist individuals with severe disabilities in accessing computers more efficiently. The dTDS combines tongue motion tracking with speech recognition, leveraging the strengths of each modality to enhance speed, flexibility, and reliability in computer interaction. Experimental results demonstrate that the dTDS outperforms unimodal approaches in complex computer access tasks, offering a promising alternative for individuals with limited motor abilities.

Practical Implications

Enhanced Computer Access

The dTDS can provide individuals with severe disabilities with a more efficient and versatile means of accessing computers, enabling greater independence and participation in vocational and recreational activities.

Improved Assistive Technology Design

The study highlights the benefits of multimodal interfaces in assistive technology, suggesting that combining different input modalities can overcome the limitations of single-input systems and improve user performance.

Personalized Assistive Solutions

The dTDS allows users to select their preferred modality (tongue motion or speech) based on their individual needs and environmental conditions, offering a more personalized and adaptable assistive solution.

Study Limitations

1
The study involved a limited number of participants with spinal cord injuries, which may limit the generalizability of the findings to a broader population of individuals with severe disabilities.
2
The performance of the speech recognition component of the dTDS was affected by the user's accent, which may limit its effectiveness for non-native English speakers.
3
The typing task used in the study may not fully represent real-world typing scenarios, which could affect the ecological validity of the results.

Your Feedback

Was this summary helpful?

Back to Assistive Technology