Dynamic User Interface Adaptation Using Biometric and Manipulation Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing electronic devices fail to accurately adapt user interfaces based on user feelings and manipulation information, leading to suboptimal user experiences as they do not effectively integrate emotional and physical state data to modify application functionality and content arrangement.

Innovation Solution

An electronic device and method that utilize image sensors to identify user expressions, biometric sensors to detect emotional states, and analyze manipulation information to dynamically modify user interfaces, prioritizing functions and content based on user preferences and emotional data, and even consider external user feedback for personalized adaptations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If user interface is dynamically modified based on manipulation information and feeling information, then user experience is improved, but device complexity increases

Engineering Contradiction:
Improveuser experienceVSAvoiddevice complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system segments the complex task of user interface adaptation into distinct functional modules: a feeling information obtaining unit that collects emotional data, a manipulation information obtaining unit that tracks user interactions, and a user interface modifying unit that applies adaptations. This segmentation allows each module to handle specific aspects of the complexity independently, improving user experience without overwhelming the system architecture.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The controller acts as an intermediary that receives and processes both manipulation information and feeling information, then translates these inputs into appropriate user interface modifications. This intermediary layer manages the complexity by centralizing the decision-making logic, coordinating between multiple data sources and the user interface adaptation process.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If multiple sensors and data sources are integrated to detect user emotions, then measurement precision of user state is improved, but device complexity increases

Engineering Contradiction:
Improveemotional state detection accuracyVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system merges multiple data sources including biometric sensors, image sensors for facial expression analysis, and manipulation information from user interactions. By combining these diverse inputs through the controller, the system achieves comprehensive and precise emotional state detection while managing complexity through integrated processing rather than separate systems.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The controller serves multiple functions: it processes biometric sensor data, analyzes facial expressions from image sensors, tracks manipulation information, and coordinates user interface modifications. This multi-functionality reduces overall system complexity by having a single component handle diverse tasks rather than requiring separate specialized systems for each function.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Adaptability or versatility

If user interface is customized based on real-time emotional data, then adaptability of the system is improved, but processing time increases

Engineering Contradiction:
Improveinterface adaptabilityVSAvoidprocessing time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system performs preliminary actions by continuously obtaining and preprocessing both feeling information and manipulation information in the background before user interface modifications are needed. This allows the controller to have processed data ready for rapid decision-making, enabling real-time adaptability without significant processing delays when interface changes are required.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements self-service by automatically monitoring user emotional states and manipulation patterns, then autonomously adapting the user interface without requiring user input or manual configuration. This self-service capability enables continuous real-time adaptation while minimizing processing overhead by eliminating the need for user-initiated adjustments or complex configuration processes.

Inventive Principle:
Principle #25Self-service

Data Source

PatentEP3321787B1Method for providing application, and electronic device therefor
Publication Date: 2020.07.22 SAMSUNG ELECTRONICS CO LTD
  • EP3321787B1 patent drawingFigure 1
  • EP3321787B1 patent drawingFigure 2
  • EP3321787B1 patent drawingFigure 3

AI summary

Provided is an application providing method of an electronic device, the application providing method including: obtaining manipulation information of a user with respect to an application provided by the electronic device; obtaining feeling information of the user; modifying a user interface of the application based on the manipulation information and the feeling information of the user; and providing the application including the modified user interface.