Dynamic Display Detail Adjustment for AR Frame Rate Stability

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The limited battery capacity and processing power of information processing devices, such as augmented reality head-mounted displays, lead to a decrease in display frame rate when the processing demand for virtual objects increases, causing discomfort and disrupting real-time interaction.

Innovation Solution

The device dynamically adjusts the display detail level of virtual objects based on sensed processing capacity, including changing resolution and effect processing, to maintain a stable frame rate by reducing processing load when capacity is exceeded.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If the processing amount of display of the virtual object is increased to improve display quality, then the display detail level is improved, but the display frame rate decreases due to limited processor capacity

Engineering Contradiction:
Improvedisplay detail levelVSAvoiddisplay frame rate
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The patent applies dynamics by making the display detail level adjustable and changeable in real-time based on processing capacity conditions. The control unit dynamically modifies display parameters (such as resolution, polygon count, texture quality) of the virtual object according to the current frame rate and processing load, allowing the system to adapt between quality and performance requirements.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent implements parameter changes by modifying display-related parameters of the virtual object (resolution, geometric complexity, texture details, shading quality) based on the detected processing capacity. When the frame rate drops below a threshold, the control unit changes these parameters to reduce processing load, thereby restoring the frame rate while maintaining acceptable display quality.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If the processing capacity is increased to maintain display frame rate, then the display frame rate is maintained, but the power consumption increases reducing battery life

Engineering Contradiction:
Improvedisplay frame rateVSAvoidpower consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent applies partial action by selectively reducing the display detail level only when and where necessary (when frame rate drops below threshold), rather than maintaining full processing capacity continuously. This allows the system to consume less power during periods when high performance is not needed, while still maintaining acceptable frame rates.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The patent implements feedback by continuously monitoring the display frame rate and using this information to adjust the processing load. The control unit detects the frame rate, compares it with a predetermined threshold, and adjusts the display parameters accordingly, creating a closed-loop control system that optimizes power consumption based on actual performance needs.

Inventive Principle:
Principle #23Feedback

3Productivity

If the display detail level is reduced to maintain frame rate, then the display frame rate is maintained, but the display quality deteriorates

Engineering Contradiction:
Improvedisplay frame rateVSAvoiddisplay quality
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The system dynamically adjusts display parameters based on real-time processing capacity assessment, allowing the display quality to be optimized for current conditions rather than being fixed. This enables the system to maintain high quality when processing capacity allows and reduce quality only when necessary to maintain frame rate.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes display parameters (resolution, geometry complexity, texture quality, shading details) based on processing capacity conditions. These parameter changes are designed to reduce processing load while minimizing the impact on perceived display quality, maintaining an optimal balance between frame rate and visual fidelity.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentEP3667622B1Information processing device, information processing method, and program
Publication Date: 2023.08.23 SONY GROUP CORP
  • EP3667622B1 patent drawingFigure 1
  • EP3667622B1 patent drawingFigure 2
  • EP3667622B1 patent drawingFigure 3

AI summary

[Problem] To provide an information processing device, an information processing method, and a computer program that are capable of avoiding decrease of the display frame rate of a virtual object. [Solution] An information processing device including a control unit configured to sense a state that causes decrease of a display frame rate of a virtual object presented to a user and dynamically change a display detail level of the virtual object in accordance with a result of the sensing is provided.