Sound Visualization Plugin for Gaming Accessibility

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video games lack accessible sound visualization features, particularly for deaf or hard-of-hearing users, and integrating sound visualization into existing games is a tedious and time-consuming process that requires access to game code, limiting its universal application across different games and platforms.

Innovation Solution

A sound visualization application/service that dynamically generates and renders graphical sound indications independently of the game code, allowing universal application across various games and platforms without requiring access to the game's code, enabling real-time sound visualization for users.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If sound visualization is integrated directly into video game code, then the visualization is specific to that game, but the integration process is tedious and time-consuming and cannot be applied universally across different games

Engineering Contradiction:
Improveuniversal application across gamesVSAvoidintegration complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system separates sound visualization functionality from game code by creating an independent audio processing component. The audio driver intercepts audio data streams separately from the game execution, allowing visualization to be added without modifying game code. This segmentation enables universal application across different games while reducing integration complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

An independent audio processing application serves as an intermediary between the game's audio output and the visualization display. This mediator captures audio data streams, processes them through spectral analysis, and generates visual representations without requiring direct integration with game code, thereby enabling universal compatibility across different games and platforms.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of manufacture

If sound visualization is integrated directly into video game code, then the visualization is specific to that game, but this requires access to and understanding of the video game code

Engineering Contradiction:
Improveease of integrationVSAvoidapplicability to existing games
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The sound visualization functionality is extracted from the game code and implemented as a separate independent application. The system captures audio data streams externally through the audio driver without requiring access to or modification of the game's source code. This extraction enables easy integration into existing games while maintaining universal applicability across different titles and platforms.

Inventive Principle:
Principle #2Taking out (Extraction)

3Reliability

If traditional sound visualization integration methods are used, then the visualization is part of the video game, but this does not enable universal application across different video games and applications

Engineering Contradiction:
Improvevisualization stabilityVSAvoidcross-platform compatibility
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The independent audio processing application provides universal sound visualization functionality that can be applied across different games and platforms without modification. By operating as a separate entity that intercepts and processes audio data streams generically, the system achieves both reliable visualization performance and broad cross-platform compatibility, eliminating the need for game-specific integration.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11291911B2Visualization of sound data extending functionality of applications/services including gaming applications/services
Publication Date: 2022.04.05 MICROSOFT TECHNOLOGY LICENSING LLC
  • US11291911B2 patent drawing
  • US11291911B2 patent drawing
  • US11291911B2 patent drawing

AI summary

The present disclosure relates to processing operations configured to execute a sound visualization application/service that dynamically generates graphical sound indication providing a visualization of sound for content being presented. A visualization of sound data may be generated and rendered from analysis of sound data, occurring in a manner that is independent from the application/service that is being used to present the content. The sound visualization application/service may be implemented as an independent application/service or plugin that works universally to provide graphical sound visualization regardless of whether content was developed to support graphical sound visualization. For example, a sound visualization application/service is implemented that generates and renders sound indication graphically without requiring access to code of displayed content. Rendered sound visualization may be presented concurrently with displayed content. This differentiates from traditional technical examples that may code accessibility features directly into the content itself, thereby overcoming limitations in previous implementation examples.