Gaze-Driven Display Region Segmentation for HMD Power Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Head-Mounted Display (HMD) devices for virtual and augmented reality face challenges in achieving high drawing processing capacity while minimizing power consumption and size, due to the need for high-resolution displays and efficient heat dissipation mechanisms.

Innovation Solution

The electronic device incorporates a housing with a display apparatus, an arithmetic portion, a gaze detection portion, and a motion detection portion, featuring a layered structure with a driver circuit and functional circuit controlling pixel emission, and using transistors with silicon and metal oxide semiconductor layers to optimize power usage and reduce size.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If an arithmetic circuit with high drawing processing capacity is provided to respond to user motion and gaze, then drawing processing capacity is improved, but power consumption increases

Engineering Contradiction:
Improvedrawing processing capacityVSAvoidpower consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The display area is divided into multiple regions based on the user's gaze point, with different refresh rates assigned to each region. The region containing the gaze point is refreshed at a higher rate while other regions use lower refresh rates, reducing overall power consumption while maintaining drawing processing capacity for the important gaze region

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The refresh rate is dynamically adjusted based on the user's gaze position and motion detection. When the user moves their gaze to a new region, the system adapts by changing which regions receive high-priority rendering, optimizing power consumption in real-time while maintaining necessary drawing processing capacity

Inventive Principle:
Principle #15Dynamics

2Manufacturing precision

If the display apparatus has increased resolution and reduced size, then display quality is improved, but the arithmetic circuit requires more power and generates more heat

Engineering Contradiction:
Improvedisplay resolutionVSAvoidpower consumption
Core Design Contradiction:
Manufacturing precisionVSUse of energy by moving object

Solution Approach 1:

Instead of uniformly high refresh rates across the entire high-resolution display, the system applies different quality levels to different regions. The gaze-point region maintains high resolution and high refresh rate, while peripheral regions use lower refresh rates, reducing overall power consumption while preserving display quality where the user actually looks

Inventive Principle:
Principle #3Local quality

3Productivity

If an arithmetic circuit with high drawing processing capacity is provided, then drawing processing capacity is improved, but heat dissipation mechanism is required increasing device size

Engineering Contradiction:
Improvedrawing processing capacityVSAvoiddevice size
Core Design Contradiction:
ProductivityVSVolume of moving object

Solution Approach 1:

By segmenting the display into regions with different refresh rates, the system reduces the total computational load on the arithmetic circuit. This lowers heat generation, allowing the use of more compact heat dissipation mechanisms and reducing overall device volume while maintaining high drawing processing capacity for the gaze region

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS20240402489A1Electronic device
Publication Date: 2024.12.05 SEMICON ENERGY LAB CO LTD
  • US20240402489A1 patent drawing
  • US20240402489A1 patent drawing
  • US20240402489A1 patent drawing

AI summary

A novel electronic device is provided. The electronic device includes a housing, a display apparatus, an arithmetic portion, a gaze detection portion, and a motion detection portion. The display apparatus includes a display element, a pixel circuit, a driver circuit, and a functional circuit. The motion detection portion has a function of detecting the motion of the housing. The gaze detection portion has a function of detecting a gaze point corresponding to a gaze on the display apparatus. The arithmetic portion has a function of performing drawing processing in accordance with the motion of the housing and a function of dividing a display portion of the display apparatus into a plurality of regions in accordance with the gaze point. The pixel circuit has a function of controlling light emission of the display element. The driver circuit has a function of controlling the pixel circuit. The functional circuit has a function of performing control of the driver circuit, the control differing between the plurality of regions. The display apparatus includes a first layer, a second layer, and a third layer. The first layer, the second layer, and the third layer are provided in different layers. The first layer includes the driver circuit and the functional circuit. The second layer includes the pixel circuit. The third layer includes the display element.