Tactile Display Mapping Document Formatting for Visually Impaired Users

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Visually impaired users face difficulties in reading and authoring documents due to the lack of assistive technologies that allow them to detect formatting, content, and consistency without reading or remembering each word/cell/node individually, and current screen readers do not effectively utilize other senses to convey document structure and formatting.

Innovation Solution

The implementation of tactile effects on computing devices, such as deformable screens, vibrations, and static charges, to map formatting properties and document structure, enabling visually impaired users to comprehend document structure and formatting through touch, thereby enhancing their ability to create professional and consistently formatted documents.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If screen readers read aloud document content and properties, then visually impaired users can access document information, but users must read and remember each word/cell/node individually to build a mental picture of the document

Engineering Contradiction:
Improvedocument structure and formatting informationVSAvoidtime to read and remember each element
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent replaces the auditory-based screen reader system with a tactile feedback system that uses touch sensations to convey document structure and formatting information. The tactile output device provides physical feedback (such as vibration patterns, pressure variations, or haptic responses) that directly represent document properties like headings, paragraphs, and formatting, eliminating the need for users to mentally construct document structure from sequential audio input.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If visually impaired users tab through document content using keyboard or touch, then they can access document elements, but they cannot detect formatting, content, and consistency without reading each element individually

Engineering Contradiction:
Improvedocument navigationVSAvoidformatting and structure detection
Core Design Contradiction:
Ease of operationVSDifficulty of detecting and measuring

Solution Approach 1:

The patent adapts the concept of visual color coding to tactile feedback by assigning different touch sensations to different document formatting properties. Just as color changes visually indicate different document elements (headings, paragraphs, bold text), the system uses distinct haptic patterns, vibration frequencies, or pressure levels to tactically represent various formatting attributes, making them immediately detectable without sequential reading.

Inventive Principle:
Principle #32Color changes

Solution Approach 2:

The patent introduces a tactile feedback intermediary between the document content and the user's perception. This intermediary layer translates document structure and formatting into touch-based sensations, allowing users to directly perceive formatting properties through tactile feedback rather than having to cognitively process and remember each element's attributes.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If current assistive technologies provide audio feedback, then users can access document content, but they cannot utilize other senses to detect formatting and structure

Engineering Contradiction:
Improvesensory utilizationVSAvoidformatting detection accuracy
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent makes the assistive technology multi-functional by incorporating multiple sensory channels beyond audio. The system provides both auditory output and tactile feedback, allowing users to access document information through multiple senses simultaneously. This multi-sensory approach enhances reliability by providing redundant and complementary information channels for detecting formatting and structure.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution allows visually impaired users to more easily understand and create well-formatted documents by translating formatting properties and structure into tactile sensations, improving their confidence and efficiency in document authoring.

Implementation Method 1

By utilizing a display with one or more tactile capabilities (e.g., deformable screens, vibrations, static charges, heat, etc.)

Methodology Applied
Scientific EffectVibration: Vibration

Implementation Method 2

By utilizing a display with one or more tactile capabilities (e.g., deformable screens, vibrations, static charges, heat, etc.)

Methodology Applied
Scientific EffectStatic charge: Electrostatics

Implementation Method 3

By utilizing a display with one or more tactile capabilities (e.g., deformable screens, vibrations, static charges, heat, etc.)

Methodology Applied
Scientific EffectHeat: Heating

Data Source

PatentUS11023655B2Accessibility detection of content properties through tactile interactions
Publication Date: 2021.06.01 MICROSOFT TECHNOLOGY LICENSING LLC
  • US11023655B2 patent drawing
  • US11023655B2 patent drawing
  • US11023655B2 patent drawing

AI summary

One or more tactile effects may be mapped to application user interface elements, formatting properties, and document structure and applied to a display comprising tactile capabilities (e.g., deformable screens, vibrations, static charges, heat, etc.). Formatting, structure, and user interface elements may be mapped to different screen variations that may be felt by a visually impaired user. A visually impaired user may be able to utilize his/her sense of touch to more easily comprehend formatting and structure of a document, as well as to have greater confidence to author professional and consistently formatted and structured documents. A tactile effect may be applied to a location of a displayed user interface element, formatting property, or document structure, or may be applied to a designated area of the display.