Pupil Size Measurement for VR User Engagement Quantification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current virtual reality (VR) technologies lack effective methods to quantify and provide feedback on user engagement levels, which are crucial for content creators to tailor and enhance VR experiences.

Innovation Solution

The method involves measuring and analyzing changes in pupil size using head-mounted displays (HMDs) to determine user engagement by comparing measured pupil sizes during VR scenes to expected sizes based on luminance, using a reference image and pupillary response test sequences to establish baseline expectations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If pupil size measurements are used to quantify user engagement, then user engagement feedback is obtained, but device complexity increases

Engineering Contradiction:
Improveuser engagement feedbackVSAvoiddevice complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The HMD's existing display and image capture components are made to serve dual purposes: the display presents VR content while the image capture device records pupil size. This multi-functionality approach allows engagement measurement without adding dedicated specialized hardware, thereby reducing the impact on device complexity while still obtaining valuable user engagement feedback.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If reference images and pupillary response test sequences are used to establish baseline expectations, then measurement precision is improved, but loss of time increases

Engineering Contradiction:
Improvepupil size measurement precisionVSAvoidtime for baseline testing
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

Baseline pupil size expectations are determined in advance through reference images and pupillary response test sequences with known luminance values. By performing this calibration beforehand, the system establishes accurate measurement benchmarks that improve precision while minimizing the time required during actual VR content viewing, as the baseline comparison data is already available.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach allows for real-time quantification and categorization of user engagement, enabling content creators to adapt VR content and improve user experience by identifying engaging and disengaging content segments, thereby enhancing user interaction and satisfaction.

Implementation Method 1

measuring and tracking changes in pupil size of an HMD user's eyes

Methodology Applied
Scientific EffectPupillary light reflex:

Data Source

PatentUS10614586B2Quantifying user engagement using pupil size measurements
Publication Date: 2020.04.07 SONY INTERACTIVE ENTERTAINMENT LLC
  • US10614586B2 patent drawing
  • US10614586B2 patent drawing
  • US10614586B2 patent drawing

AI summary

Methods and systems are provided for enabling quantification and categorization of levels of user engagement of a user while wearing a head mounted display (HMD) and being presented virtual reality (VR) content. A computer-implemented method includes presenting a VR scene to an HMD user via display of the HMD and capturing one or more images of an eye of the HMD user while the HMD user is wearing the HMD and being presented with the VR scene. The method also includes operations for analyzing the one or more images for obtaining a pupil size measurement of the eye of the HMD user and for obtaining pupil size indicators usable to correlate pupil size measurements with user engagement. The method may also determine a level of user engagement based on the pupil size measurement and the pupil size indicators.