Dynamic Audio Visualization for Hearing-Impaired Gaming

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Players with hearing impairments face challenges in fully engaging with video games due to the reliance on auditory cues, as they may not adequately comprehend the sounds and actions within the game environment.

Innovation Solution

Implementing a dynamic in-game audio visualization theme that adjusts the gameplay video to include visual elements in designated border regions, indicating audio content such as sound effects, location, and volume, allowing players to understand game events through visual cues even without audible sound.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If audio cues are used for game events, then player engagement and immersion are improved, but accessibility for hearing-impaired players deteriorates

Engineering Contradiction:
ImproveaccessibilityVSAvoidaudio content comprehension
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The patent introduces visual elements as an intermediary representation of audio content. These visual elements appear in border regions and convey information about sound effects, their locations, volumes, and types, allowing hearing-impaired players to comprehend audio cues that would otherwise be inaccessible to them.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent transforms audio information from the auditory dimension to the visual dimension. By rendering visual representations in border regions that correspond to audio events, the system enables hearing-impaired players to perceive and understand game audio content through sight rather than sound.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If visual elements are added to indicate audio content, then accessibility for hearing-impaired players is improved, but device complexity increases

Engineering Contradiction:
ImproveaccessibilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent divides the display area into border regions that are separate from the main gameplay area. Visual elements representing audio content are confined to these border regions, allowing the core gameplay to remain unchanged while adding accessibility features in a segmented, non-intrusive manner.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The visual elements in border regions serve multiple functions: they indicate sound effect types, locations, volumes, and timing. This multi-functionality allows a single visual representation system to convey comprehensive audio information without requiring separate mechanisms for each audio attribute.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11986731B2Dynamic adjustment of in-game theme presentation based on context of game activity
Publication Date: 2024.05.21 SONY INTERACTIVE ENTERTAINMENT LLC
  • US11986731B2 patent drawing
  • US11986731B2 patent drawing
  • US11986731B2 patent drawing

AI summary

A method for enabling visualization of audio content of a video game is provided, including the following operations: executing a session of a video game; activating an audio visualization theme for the session of the video game; responsive to activating the audio visualization theme, then dynamically adjusting gameplay video of the session to include visual elements indicative of audio content of the session; wherein said visual elements are rendered in a designated border region of the gameplay video based on the audio content of the session.