Environmental Camera Refresh Rate Matching for XR Image Latency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In extended reality devices, the delay in presenting real environment images occurs due to a mismatch between the refresh rate of the environmental camera and the screen refresh rate, leading to repeated display of old frame data.
Innovation Solution
A configuration method for an environmental camera that determines an optimal refresh rate value for the target application, ensuring the target refresh rate of the environmental camera is within a threshold of the optimal refresh rate of the application, thereby synchronizing the update pace of environmental images with virtual content.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the environmental camera uses a fixed refresh rate, then the device operation is simple, but the real environment image presentation is delayed due to mismatch with screen refresh rate
Solution Approach 1:
The patent implements dynamic refresh rate adjustment for the environmental camera based on the currently running application's requirements. The system determines the optimal refresh rate for the target application and configures the environmental camera accordingly, allowing the refresh rate to change dynamically rather than remaining fixed. This resolves the contradiction by making the system adaptable to different application needs while maintaining simple operation through automated adjustment.
Solution Approach 2:
The patent changes the refresh rate parameter of the environmental camera to match the optimal refresh rate of the target application. By adjusting this key parameter dynamically, the system eliminates the mismatch between camera and screen refresh rates, thereby preventing image presentation delays while keeping the operation simple through automated parameter configuration.
2Loss of time
If the environmental camera refresh rate is increased to match screen refresh rate, then image presentation delay is reduced, but power consumption increases
Solution Approach 1:
The patent dynamically adjusts the environmental camera's refresh rate parameter based on the target application's requirements. Instead of using a fixed high refresh rate that would consume excessive power, the system sets the refresh rate to match the optimal value needed for each application, thereby reducing unnecessary power consumption while eliminating image presentation delays.
Solution Approach 2:
The patent applies partial action by adjusting the refresh rate to the minimum necessary value that satisfies the application's requirements. Rather than continuously using the maximum refresh rate, the system uses just enough refresh rate to prevent image delays, thereby optimizing power consumption while maintaining acceptable performance.
3Loss of time
If the environmental camera refresh rate is dynamically adjusted for each application, then image presentation delay is eliminated, but device complexity increases
Solution Approach 1:
The patent implements a self-service mechanism where the system automatically determines the optimal refresh rate for the target application and configures the environmental camera accordingly. This automated self-adjustment eliminates the need for manual configuration or complex user intervention, thereby reducing the perceived complexity for users while still achieving dynamic refresh rate adaptation to eliminate image delays.
Solution Approach 2:
The patent employs feedback mechanisms where the system monitors the currently running application and adjusts the environmental camera's refresh rate based on the application's requirements. This closed-loop feedback system automatically adapts to different scenarios, eliminating image presentation delays while managing complexity through automated control rather than manual configuration.
Data Source
AI summary
A configuration method for an environmental camera, an electronic device, and a storage medium are provided. The method includes: determining an optimal refresh rate value for a target application currently in operation; determining a target refresh rate value of the environmental camera based on the optimal refresh rate value of the target application currently in operation, wherein a difference between the target refresh rate value of the environmental camera and the optimal refresh rate value of the target application currently in operation is less than or equal to a first set threshold value; and configuring a refresh rate configuration item of the environmental camera using the target refresh rate value.