Vital-Data Avatar Rendering for Accurate User State Estimation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing avatar systems fail to realistically reflect the complex mental and physical states of users, limiting their versatility and accuracy in diverse applications.

Innovation Solution

An information processing system that acquires vital data, including heart rate and heart rate variability, to estimate user states in real-time, creating avatars that dynamically reflect mental and physical states through facial expressions, posture, aura, and color changes, and can display internal avatar information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If simple mental state or facial expression data is used to configure avatars, then the system is easy to implement and operate, but the avatar cannot realistically reflect the complex state of the user

Engineering Contradiction:
Improveease of avatar configurationVSAvoidaccuracy of user state reflection
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent transforms the avatar configuration from using simple mental state or facial expression parameters to using multiple physiological parameters (heart rate, respiration rate, skin conductance, temperature) and behavioral parameters (facial expressions, head movements, body posture). This parameter expansion enables realistic reflection of complex user states including mental state, physical state, and emotional state simultaneously.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent combines multiple types of data (physiological data from sensors, facial expression data from cameras, head movement data from accelerometers) to create a composite avatar representation. This composite approach integrates diverse data sources to achieve a comprehensive and realistic depiction of user state that surpasses any single data type.

Inventive Principle:
Principle #40Composite materials

2Measurement precision

If multiple types of vital data are collected and processed in real-time, then the avatar can realistically reflect user state, but the system complexity increases

Engineering Contradiction:
Improveaccuracy of user state estimationVSAvoidcomplexity of data processing system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent divides the complex data processing system into distinct functional modules: a data acquisition module that collects physiological and behavioral data, a data processing module that analyzes the collected data, and an avatar generation module that creates the visual representation. This segmentation allows each module to handle specific tasks independently, managing overall system complexity while maintaining high estimation accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary processing layer between raw data collection and avatar generation. This intermediary module integrates multiple data sources, correlates physiological data with behavioral observations, and transforms complex multi-dimensional data into meaningful user state estimates that drive avatar animation and expression.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Duration of action of moving object

If real-time processing of vital data is implemented, then the avatar dynamically reflects user state, but the computational resources and time required increase

Engineering Contradiction:
Improvereal-time responsivenessVSAvoidprocessing time
Core Design Contradiction:
Duration of action of moving objectVSLoss of time

Solution Approach 1:

The patent implements periodic sampling of physiological data at optimized intervals rather than continuous monitoring. The system collects vital data at regular time intervals, processes these periodic samples to estimate user state, and updates the avatar accordingly. This periodic approach maintains real-time responsiveness while significantly reducing computational burden compared to continuous processing.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The patent applies partial processing by focusing computational resources on the most informative data subsets. Rather than processing all available data with equal depth, the system identifies and prioritizes key physiological and behavioral indicators that most strongly correlate with user state, processing these selectively to achieve accurate real-time estimation with reduced time requirements.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentEP3636156B1Information processing system for user state estimation using vital data correlation and avatar display
Publication Date: 2026.03.11 SMART BEAT PROFITS LTD
  • EP3636156B1 patent drawingFigure 1
  • EP3636156B1 patent drawingFigure 2
  • EP3636156B1 patent drawingFigure 3

AI summary

Provided is an information processing system capable of configuring an avatar that more realistically reflects a state of a user. The information processing system includes: vital data acquiring means for acquiring vital data including a heart rate of a user; a terminal apparatus that transmits, in real-time via a communication network, the vital data acquired by the vital data acquiring means; and an information processing server that processes the vital data transmitted from the terminal apparatus, wherein the information processing server includes: a storage unit that stores the vital data; a user state estimating unit that estimates a state of the user based on at least the heart rate and a heart rate variability calculated, based on the heart rate; an avatar data creating unit that creates display data for displaying an avatar reflecting at least an estimation result by the user state estimating unit; and a communication interface that, when a transmission request for the display data is received via the communication network, transmits the display data to a source of the transmission request.