Node-Link Diagram Audio Interface for Visually Impaired Users

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Graphical user interfaces (GUIs) that utilize visualizations, such as node-link diagrams, are inaccessible to visually impaired users, as they rely on visual elements that cannot be interpreted by individuals who are blind or have impaired vision.

Innovation Solution

A user interface that generates a node-link diagram and includes a virtual reference point and a virtual control element, allowing users to rotate the control element to contact nodes, with audio feedback providing information about the contacted elements, enabling visually impaired users to explore the diagram through sound characteristics.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If graphical visualizations are used to help users understand information quickly, then information comprehension speed is improved, but accessibility for visually impaired users deteriorates

Engineering Contradiction:
Improveinformation comprehension speedVSAvoidaccessibility for visually impaired users
Core Design Contradiction:
Loss of timeVSAdaptability or versatility

Solution Approach 1:

The patent replaces the visual graphical user interface with an audio-based interface. Instead of using visual elements like graphs and charts that are inaccessible to visually impaired users, the system converts data into audio outputs with varying characteristics (pitch, volume, tempo) that convey the same information, enabling blind users to interpret data through hearing rather than sight

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent changes the sensory modality parameter from visual to acoustic. By transforming the interface from a visual display to an audio-based system with adjustable acoustic parameters (pitch for category differentiation, volume for emphasis, tempo for data density), the system maintains rapid information comprehension while achieving accessibility for visually impaired users

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If audio feedback is added to provide accessibility, then accessibility for visually impaired users is improved, but device complexity increases

Engineering Contradiction:
Improveaccessibility for visually impaired usersVSAvoidinterface complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent creates a unified audio interface that serves multiple functions simultaneously: it provides data presentation, navigation guidance, and accessibility support through a single coherent audio output system. The voice synthesis engine and audio parameter control system handle multiple tasks (conveying data values, indicating categories, guiding exploration) without requiring separate visual and audio subsystems, thus managing complexity while achieving versatility

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces a voice synthesis engine as an intermediary that converts structured data into natural-sounding audio outputs. This mediator layer translates data values and metadata into spoken language with adjustable acoustic characteristics, simplifying the interface by providing a single conversion pathway from data to accessible output rather than requiring multiple specialized output channels

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11460973B1User interfaces for converting node-link data into audio outputs
Publication Date: 2022.10.04 SAS INSTITUTE INC
  • US11460973B1 patent drawing
  • US11460973B1 patent drawing
  • US11460973B1 patent drawing

AI summary

Node-link data can be converted into audio outputs. For example, a system can generate a graphical user interface (GUI) depicting a node-link diagram having nodes and links. The GUI can include a virtual reference point in the node-link diagram and a virtual control element that is rotatable around the virtual reference point by a user to contact one or more of the nodes in the node-link diagram. The system can receive user input for rotating the virtual control element around the virtual reference point, which can generate a contact between the virtual control element and a particular node of the node-link diagram. In response to detecting the contact, the system can determine a sound characteristic configured to indicate an attribute associated with the particular node. The system can then generate a sound having the sound characteristic, for example to assist the user in exploring the node-link diagram.