Speaker Characteristic Based User Interface Customization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Client devices do not automatically customize user interfaces based on the characteristics of the user, leading to mismatched preferences when shared among multiple users, and even for single users, the interface may not be tailored to individual preferences.

Innovation Solution

The client device estimates user characteristics such as age, gender, and emotion through speech processing and machine learning, using techniques like neural networks, to customize the user interface, including font size, color scheme, and application access.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If the user interface is customized based on speaker characteristics, then the user experience is improved and individual preferences are matched, but the device complexity increases due to speech processing and machine learning components

Engineering Contradiction:
Improveuser experienceVSAvoiddevice complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system automatically detects speaker characteristics and customizes the user interface without requiring manual user input or configuration. The machine learning model autonomously analyzes audio signals and applies appropriate UI customizations based on detected characteristics such as age, gender, or emotional state, enabling the system to serve itself rather than requiring user intervention for customization.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system changes UI parameters such as font size, color scheme, and layout based on detected speaker characteristics. By dynamically adjusting these parameters according to the speaker's characteristics, the system adapts the user interface to match individual preferences and needs, improving ease of operation for different user demographics.

Inventive Principle:
Principle #35Parameter changes

2Extent of automation

If automatic customization is implemented, then individual preferences are automatically matched, but the measurement precision of speaker characteristics may be insufficient leading to inaccurate customization

Engineering Contradiction:
Improveautomatic customizationVSAvoidspeaker characteristic detection accuracy
Core Design Contradiction:
Extent of automationVSMeasurement precision

Solution Approach 1:

The system uses feedback loops where the machine learning model continuously analyzes audio signals and refines its detection of speaker characteristics. By comparing detected characteristics with actual user behavior patterns, the system can improve the accuracy of its measurements and adjust its customization strategies accordingly, enhancing both automation and measurement precision.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs preliminary analysis of speaker characteristics before implementing customization. By pre-processing audio signals and pre-determining characteristic parameters, the system prepares accurate measurement data in advance, which then guides the automatic customization process, ensuring that the customization is based on precise and reliable speaker characteristic detection.

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If speaker characteristics are processed and used for customization, then the user interface adapts to individual needs, but the loss of information occurs when characteristics are not accurately captured or when data privacy is compromised

Engineering Contradiction:
Improveinterface adaptabilityVSAvoidinformation loss
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The system extracts only the necessary speaker characteristics needed for UI customization while discarding unnecessary or sensitive information. By selectively extracting relevant features such as age group, gender, or emotional state without capturing identifiable personal information, the system achieves interface adaptability while minimizing information loss and protecting user privacy.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The machine learning model acts as an intermediary between the audio signal and the UI customization. It processes the audio data, extracts meaningful characteristics, and translates them into appropriate UI adjustments without directly storing or exposing the raw audio data or intermediate processing information, thereby reducing information loss and enhancing data security.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11620104B2User interface customization based on speaker characteristics
Publication Date: 2023.04.04 GOOGLE LLC
  • US11620104B2 patent drawing
  • US11620104B2 patent drawing
  • US11620104B2 patent drawing

AI summary

Characteristics of a speaker are estimated using speech processing and machine learning. The characteristics of the speaker are used to automatically customize a user interface of a client device for the speaker.