Audio-Haptic Drawing Training for Spatial Cognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional methods for presenting spatial information are inaccessible to blind and low vision individuals, limiting their ability to develop spatial cognition and spatiomotor skills essential for daily and professional activities, with existing rehabilitation approaches being piecemeal and ineffective.

Innovation Solution

A Cognitive-Kinesthetic Drawing Training Method using non-visual freehand drawing with audio-haptic feedback on standard touch screen devices, allowing for the enhancement of spatial cognition and spatiomotor coordination through error analysis and feedback, enabling blind and low vision individuals to develop mental representations for precise motor control.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional visual display methods are used to present spatial information, then spatial cognition training is effective for sighted individuals, but the method becomes inaccessible to blind and low vision individuals

Engineering Contradiction:
ImproveAccessibility to blind and low vision individualsVSAvoidLoss of spatial information accessibility
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The patent replaces visual display mechanisms with audio-haptic feedback mechanisms. Audio signals provide spatial structure information through sound characteristics that vary with finger position, while haptic feedback provides tactile confirmation of correct positions. This substitution makes spatial information accessible to blind and low vision individuals without losing the essential spatial cognition training objectives.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces audio-haptic feedback as an intermediary between the user and spatial information. Instead of direct visual perception, blind users interact with spatial structures through audio cues that guide finger movement along correct paths and haptic feedback that confirms accurate positioning, thereby mediating the transmission of spatial information in an accessible manner.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If traditional rehabilitation approaches are used for spatial cognition training, then some specific skills can be improved, but the approach becomes piecemeal and ineffective for comprehensive rehabilitation

Engineering Contradiction:
ImproveComprehensive rehabilitation efficiencyVSAvoidComplexity of training system integration
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent merges multiple rehabilitation functions into a single integrated drawing task. The audio-haptic feedback system simultaneously trains spatial cognition, memory, and motor coordination by guiding users to reproduce visual images through tactile exploration and audio-guided drawing, thereby achieving comprehensive rehabilitation through one unified paradigm rather than separate training modules.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent creates a universal training system that serves multiple rehabilitation purposes through a single interface. The same audio-haptic feedback mechanism supports exploration of spatial structures, memory retention, motor skill development, and error correction, making the system multi-functional and highly efficient for comprehensive spatial cognition rehabilitation.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Adaptability or versatility

If specialized expensive tangible displays are used for non-visual spatial information presentation, then accessibility is improved, but cost and device complexity increase significantly

Engineering Contradiction:
ImproveNon-visual spatial information accessibilityVSAvoidComplexity and cost of display device
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent uses audio-haptic feedback to create functional copies of visual spatial information in an accessible format. Instead of requiring expensive specialized tangible displays, the system reproduces the essential spatial structure information through audio cues and haptic feedback on standard touch screen devices, providing an affordable copy that maintains the training effectiveness.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent changes the physical parameters of information presentation from visual to audio-haptic modalities. By varying audio characteristics (frequency, amplitude, timing) based on finger position and providing corresponding haptic feedback, the system translates spatial information into parameters that are perceivable by blind users using standard devices, eliminating the need for expensive specialized hardware.

Inventive Principle:
Principle #35Parameter changes

4Manufacturing precision

If visual drawing training is used to enhance spatiomotor coordination, then motor precision is improved, but the training becomes inaccessible to those without vision

Engineering Contradiction:
ImproveMotor control precisionVSAvoidVisual dependency blocking access
Core Design Contradiction:
Manufacturing precisionVSObject-affected harmful factors

Solution Approach 1:

The patent inverts the traditional visual drawing approach by making the reproduction phase tactile and audio-guided. Instead of visually observing and copying images, blind users explore spatial structures through tactile feedback and audio cues, then reproduce them through memory-guided motor actions with audio-haptic verification, thereby achieving motor precision training without visual dependency.

Inventive Principle:
Principle #13The other way round (Inversion)

Data Source

PatentUS10722150B2System for training spatial cognition, memory and spatiomotor coordination through drawing
Publication Date: 2020.07.28 LIKOVA LORA T
  • US10722150B2 patent drawing
  • US10722150B2 patent drawing
  • US10722150B2 patent drawing

AI summary

A method for improving subject's spatial cognition and spatial memory includes presenting spatial information to the person through non-visual means, parcellating the image to enhance understanding of the nature and relationships of the image components to augment image memory, drawing the image, detecting and encoding the errors in the drawing, and providing interactive feedback based on the individual's drawing performance. The methodology includes audio-haptic feedback to present the spatial image information non-visually using an audible signal that varies as a function of the distance of the finger/stylus from the regions of a display that express the image features.