Symbolic Expression Accessibility via Segmented Aural Navigation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current text-to-speech systems are cumbersome and difficult to use for presenting symbolic expressions like mathematical, scientific, or chemical formulas, creating a significant cognitive burden for users with impaired vision.

Innovation Solution

A computing device method that displays and aurally presents symbolic expressions by selecting and transitioning between portions of the expression based on user input, using touch-sensitive surfaces and gestures to navigate and map areas for accessible interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If text-to-speech systems present symbolic expressions using conventional linear reading methods, then the system can provide audio output, but the cognitive burden on users with impaired vision increases significantly

Engineering Contradiction:
Improveease of useVSAvoidcognitive burden
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The symbolic expression is divided into multiple selectable regions, each corresponding to a specific portion of the expression. Users can navigate between these segmented regions using touch gestures, allowing them to access different parts of the expression systematically rather than attempting to process the entire expression at once.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system adds a spatial dimension to navigation by mapping touch gestures on the display surface to specific regions of the symbolic expression. This transforms the one-dimensional linear reading approach into a two-dimensional spatial navigation approach, where users can directly interact with different parts of the expression through touch movements.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of information

If text-to-speech systems attempt to present entire symbolic expressions at once, then complete information is provided, but precision of navigation and presentation deteriorates

Engineering Contradiction:
Improveinformation completenessVSAvoidnavigation precision
Core Design Contradiction:
Loss of informationVSMeasurement precision

Solution Approach 1:

The symbolic expression is divided into multiple selectable regions, each corresponding to a specific portion of the expression. Users can navigate between these segmented regions using touch gestures, allowing them to access different parts of the expression systematically rather than attempting to process the entire expression at once.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Each region of the symbolic expression is assigned specific properties and can be independently selected and presented. This allows the system to provide detailed, precise information about specific portions of the expression when needed, rather than providing a generic overview of the entire expression.

Inventive Principle:
Principle #3Local quality

3Productivity

If conventional text-to-speech reading methods are used for symbolic expressions, then the system can operate with simple controls, but the efficiency of information access decreases

Engineering Contradiction:
Improveinformation access efficiencyVSAvoidinterface complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The touch-sensitive display surface serves multiple functions: it acts as both the visual display and the navigation control interface. Users interact with the expression by touching and gesturing on the same surface that displays the content, eliminating the need for separate controls and improving access efficiency.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system allows users to directly interact with the symbolic expression through touch gestures on the display surface. The display itself becomes the control mechanism, where touch movements and gestures directly navigate and select regions of the expression without requiring additional buttons or controls.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10540792B2Accessibility techniques for presentation of symbolic expressions
Publication Date: 2020.01.21 APPLE INC
  • US10540792B2 patent drawing
  • US10540792B2 patent drawing
  • US10540792B2 patent drawing

AI summary

Methods for presenting symbolic expressions such as mathematical, scientific, or chemical expressions, formulas, or equations are performed by a computing device. One method includes: displaying a first portion of a symbolic expression within a first area of a display screen; while in a first state in which the first area is selected for aural presentation, aurally presenting first information related to the first portion of the symbolic expression; while in the first state, detecting particular user input; in response to detecting the particular user input, performing the steps of: transitioning from the first state to a second state in which a second area, of the display, is selected for aural presentation; determining second information associated with a second portion, of the symbolic expression, that is displayed within the second area; in response to determining the second information, aurally presenting the second information.