Mobile Terminal UI Adaptation via Audio Feature Extraction

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current mobile communication terminals with integrated music players lack a seamless integration of music player functionality with other device features, leading to a need for enhanced user interface customization based on audio data to improve user satisfaction.

Innovation Solution

A method and module that receive audio data, extract features, and modify user interface components accordingly, utilizing 3-D rendered graphical objects and audio visualization effects, with a module comprising an audio feature extractor, user interface modifier, and audio detector to optimize power usage and user configurability.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the user interface is made more alive with audio-based modifications, then user satisfaction increases, but computational power requirements increase

Engineering Contradiction:

Improveuser interface adaptabilityVSAvoidcomputational power

Core Design Contradiction:

Adaptability or versatilityVSPower

Solution Approach 1:

The system pre-extracts audio features from audio data before modifying user interface components. By performing feature extraction in advance and storing relevant audio characteristics, the system reduces real-time computational requirements while maintaining the ability to dynamically adapt the UI based on audio content.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system modifies only specific user interface components based on extracted audio features rather than transforming the entire interface. This selective modification approach applies changes locally to relevant UI elements, reducing overall computational burden while maintaining user satisfaction through targeted adaptations.

Inventive Principle:

Principle #3Local quality

2Adaptability or versatility

If audio visualization effects are superposed on user interface components, then user satisfaction increases, but device complexity increases

Engineering Contradiction:

Improveuser interface customizationVSAvoidsystem complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system combines audio visualization effects with existing user interface components by superimposing visual representations of audio features directly onto UI elements. This merging approach integrates multiple functions (audio visualization and UI presentation) into a unified system, reducing overall complexity compared to implementing separate visualization and UI systems.

Inventive Principle:

Principle #5Merging (Combining)

3Adaptability or versatility

If the user interface is dynamically modified based on audio data, then the music player and other functions are perceived as one unified apparatus, but power consumption increases

Engineering Contradiction:

Improveapparatus integration perceptionVSAvoidpower consumption

Core Design Contradiction:

Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The system updates user interface modifications periodically based on changes in audio features rather than continuously. By monitoring audio data at intervals and updating UI components only when significant changes occur, the system maintains the perception of a unified apparatus while reducing continuous power consumption associated with constant UI updates.

Inventive Principle:

Principle #19Periodic action

Data Source

PatentUS8930002B2Mobile communication terminal and method therefor

Publication Date: 2015.01.06 HFI INNOVATION INC

AI summary

A method for providing a user interface modified in accordance to audio data, a module including an audio feature extractor and a UI modifier, an apparatus and a computer readable medium. First, audio data is received. Thereafter, an audio feature is extracted from the received audio data. In accordance to the extracted audio feature, the appearance of one of a number of user interface components is modified, e.g. by superposing music visualization effects.