Sonifying Graphical Data Visualizations for Accessibility
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Graphical visualizations, such as graphs and charts, are difficult or impossible for visually impaired individuals to interpret due to their visual nature, limiting their ability to understand the underlying data and trends.
Innovation Solution
A system that detects metadata describing data points in graphical visualizations and generates an interactive interface, including a matrix of cells, where each cell corresponds to a data point, allowing users to interact and receive a sonified representation of the data points through audio signals, with sound characteristics representing different aspects of the data points, enabling visually impaired users to perceive the information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If graphical visualizations are used to present data, then information presentation effectiveness is improved, but accessibility for visually impaired users deteriorates
Solution Approach 1:
The patent introduces an intermediary system that converts graphical visualizations into audio-based representations. This mediator translates visual data points into sonified output with multiple sound characteristics, allowing visually impaired users to access information through their sense of hearing rather than sight, thus resolving the accessibility contradiction while preserving information effectiveness
Solution Approach 2:
The patent replaces the visual mechanical system (graphical displays requiring sight) with an acoustic system (audio output requiring hearing). By substituting the sensory modality from visual to auditory, the system maintains effective data presentation while making it accessible to visually impaired users who cannot process visual information
2Measurement precision
If sonified representation with multiple sound characteristics is used, then data interpretation accuracy is improved, but system complexity increases
Solution Approach 1:
The patent changes multiple parameters of the audio output simultaneously - using different sound characteristics such as pitch, volume, and tone to represent different data point attributes. This multi-parameter approach enables accurate differentiation and interpretation of multiple data points through audio alone, achieving data interpretation accuracy comparable to or exceeding visual methods while managing system complexity through software-based audio synthesis
Data Source
AI summary
Graphical data-visualizations can be converted into sonified output. For example, a computing device can detect metadata that describes data points for a graphical visualization. The computing device can generate an interactive interface that is different from the graphical visualization based on the metadata. The interactive interface may include a matrix of cells corresponding to the data points in the metadata. The computing device can detect an interaction with a cell in the matrix. The interaction can indicate that a sonified representation of a data point corresponding to the cell is to be output. The computing device can responsively determine at least two sound characteristics for the sonified representation of the data point using a portion of the metadata describing the data point. The at least two sound characteristics can each audibly represent different aspects of the data point. The computing device can then cause the sonified representation to be output.