Head-Mounted Display Brainwave Measurement for User Interest Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for assessing image quality and user interest in moving image content are limited by subjective biases, high costs, and complexity, particularly when using brainwave analysis, as they require specialized equipment and struggle with maintaining consistent luminance and are not easily integrable into general viewing devices like head-mounted displays.

Innovation Solution

An information processing device integrated into a head-mounted display that includes an image presentation unit and a brainwave measurement unit, capable of measuring brainwaves and generating assessment information to analyze user interest, concentration, and fatigue, using a brainwave signal in conjunction with reproduction control information to provide accurate and cost-effective analysis.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If brainwave measurement is used to assess image quality and user interest, then measurement precision is improved, but device complexity and cost increase due to specialized equipment requirements

Engineering Contradiction:
Improveuser interest analysis precisionVSAvoidequipment complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces complex mechanical/optical measurement systems with electrical signal measurement. Instead of using near-infrared spectrometry or other complex physiological monitoring devices, the system uses simple electroencephalogram (EEG) electrodes to detect brainwave electrical signals, significantly simplifying the measurement system while maintaining precision in user interest analysis

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent uses electrical signal copies of brain activity (brainwaves) as proxies for direct physiological measurement. By measuring the electrical signals generated by brain activity during image viewing, the system infers user interest without requiring direct observation of physiological responses, simplifying the measurement approach

Inventive Principle:
Principle #26Copying

2Ease of operation

If brainwave measurement equipment is integrated into head-mounted displays, then ease of operation is improved, but device complexity increases

Engineering Contradiction:
Improveintegration easeVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent merges the brainwave measurement function with the head-mounted display device. By integrating EEG electrodes into the head-mounted display, the system combines image presentation and brainwave measurement in a single device, making the system easier to operate while managing complexity through functional integration

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The head-mounted display is designed to perform multiple functions: presenting images and measuring brainwaves simultaneously. This multi-functionality allows the same device to serve both as a display and a measurement tool, improving ease of operation by eliminating the need for separate equipment

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If near-infrared spectrometry is used for brainwave measurement, then measurement precision is improved, but cost increases significantly

Engineering Contradiction:
Improvebrainwave detection precisionVSAvoidmanufacturing cost
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

The patent replaces expensive near-infrared spectrometry equipment with inexpensive EEG electrodes. The EEG measurement system uses simple electrical sensors that are much cheaper to manufacture and integrate, while still providing sufficient precision for brainwave detection and user interest analysis

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

Solution Approach 2:

The patent substitutes complex optical measurement systems (near-infrared spectrometry) with simple electrical signal measurement (EEG). This substitution dramatically reduces manufacturing costs while maintaining measurement precision for brainwave detection

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the generation of image assessment information and analysis of user interest and engagement based on brainwave signals, facilitating cost-effective and precise analysis of image content, suitable for integration into general viewing devices, reducing the need for expensive equipment like near-infrared spectrometry.

Implementation Method 1

a brainwave measurement unit configured to measure a brainwave of the user (viewer), in which a brainwave measurement electrode is set in a region of a head of the user (viewer) on which the head-mounted display is worn

Methodology Applied
Scientific EffectElectroencephalogram (EEG):

Data Source

PatentUS10817057B2Information processing device, information processing method, and program
Publication Date: 2020.10.27 SONY GROUP CORP
  • US10817057B2 patent drawing
  • US10817057B2 patent drawing
  • US10817057B2 patent drawing

AI summary

Image assessment information is generated, and analysis information such as the degree of interest in an image presented to the user or a region of interest is acquired on the basis of a brainwave signal of a user observing an image. A content delivery unit that delivers image content, a data transceiver unit that receives delivery content, a head-mounted display that presents content, and a content analysis unit that analyzes content assessment information are included. The data transceiver unit generates assessment information set to be able to identify whether a brainwave signal is output when a certain image is presented in association with the brainwave signal and image reproduction control information acquired from the user and outputs the assessment information to a content analysis device. The content analysis device analyzes the degree of interest in the image presented to the user, a region of interest, or the like using the brainwave signal.