Pupil Dilation Patterns for Hands-Free Cognitive Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Electronic devices face limitations in device interaction and control capabilities due to size constraints, operational constraints, and user interaction challenges such as limited physical buttons, cumbersome touchscreen use, and difficulty in interacting with devices when hands are occupied or unavailable.

Innovation Solution

Devices utilize physiological data, particularly pupil dilation patterns, to detect user interests and intentions, enabling interaction through involuntary responses, and combine this data with voluntary inputs to enhance user experience and interface navigation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional input mechanisms (physical buttons, touchscreens) are used, then device interaction functionality is provided, but device complexity increases and ease of operation deteriorates when hands are occupied

Engineering Contradiction:
Improveease of operationVSAvoiddevice complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent replaces mechanical input mechanisms (physical buttons, touchscreens requiring hand contact) with an optical/biological detection system that monitors pupil dilation patterns. This substitution eliminates the need for hands-on interaction while reducing physical device components dedicated to input mechanisms.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system utilizes the user's own physiological responses (involuntary pupil dilation patterns) as the input mechanism. The user's body automatically provides the control signals through natural physiological reactions to content, eliminating the need for external input devices or manual interaction.

Inventive Principle:
Principle #25Self-service

2Adaptability or versatility

If more input mechanisms are added to improve interaction capability, then functionality increases, but device size and complexity increase

Engineering Contradiction:
Improveinteraction capabilityVSAvoiddevice complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The pupil detection system serves multiple functions: it detects user interest, determines navigation commands, controls media playback, and provides accessibility features. A single physiological sensor replaces what would traditionally require multiple specialized input devices, achieving multi-functionality through a unified mechanism.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent replaces multiple mechanical and electronic input mechanisms with a single physiological detection system that captures comprehensive interaction data through pupil pattern analysis, reducing overall device complexity while maintaining or enhancing interaction versatility.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Ease of operation

If pupil dilation detection is used to control device functions, then hands-free operation is enabled, but measurement precision requirements increase

Engineering Contradiction:
Improvehands-free operationVSAvoidpupil pattern detection precision
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The system continuously monitors pupil dilation patterns and provides real-time feedback by executing commands when specific patterns are detected. This continuous feedback loop allows for dynamic adjustment and confirmation of user intent, compensating for the challenges of physiological measurement through iterative verification.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs preliminary analysis of pupil patterns to identify potential user intentions before executing commands. By detecting and analyzing patterns in advance and confirming them through contextual understanding, the system reduces the immediate precision burden during critical decision moments.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP3857340B1Pupil modulation as a cognitive control signal
Publication Date: 2025.09.10 APPLE INC
  • EP3857340B1 patent drawingFigure 1~2
  • EP3857340B1 patent drawingFigure 3A~3B
  • EP3857340B1 patent drawingFigure 4

AI summary

One exemplary implementation provides an improved user experience on a device by using physiological data to initiate a user interaction for the user experience based on an identified interest or intention of a user. For example, a sensor may obtain physiological data (e.g., pupil diameter) of a user during a user experience in which content is displayed on a display. The physiological data varies over time during the user experience and a pattern is detected. The detected pattern is used to identify an interest of the user in the content or an intention of the user regarding the content. The user interaction is then initiated based on the identified interest or the identified intention.