Power-Efficient 3D Reconstruction via Adaptive Depth Sensor Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional 3D reconstruction methods are computationally expensive and power-hungry, limiting their practicality in mobile devices due to high power consumption, which restricts their use in real-time applications.
Innovation Solution
A method for power-efficient real-time 3D reconstruction on mobile devices that involves capturing images with cameras, determining the need for depth sensor usage based on camera pose information, and disabling the depth sensor when not required, enabling it only when updating or extending the 3D model, using techniques like volumetric reconstruction and surface reconstruction to conserve power.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If depth sensor is continuously used for 3D reconstruction, then reconstruction quality is improved, but power consumption increases
Solution Approach 1:
The depth sensor is activated periodically rather than continuously, only when the system determines that the current 3D model requires extension or update. The processor evaluates whether newly captured images contain significant environmental changes, and only triggers depth sensor usage when necessary, creating a periodic activation pattern that reduces power consumption while maintaining reconstruction quality.
Solution Approach 2:
The system dynamically adjusts depth sensor activation based on real-time assessment of environmental changes. The processor continuously monitors captured images and dynamically determines whether depth sensing is needed, transitioning the system between active and inactive states based on the actual requirements of the 3D reconstruction task.
2Measurement precision
If depth sensor is frequently activated to update 3D model, then model accuracy is improved, but battery life decreases
Solution Approach 1:
The system employs feedback mechanisms where the processor analyzes captured images to determine whether the current 3D model accurately represents the environment. Based on this feedback assessment, the system intelligently activates the depth sensor only when the model requires updating, creating a closed-loop control system that optimizes battery usage while maintaining model accuracy.
Solution Approach 2:
Instead of continuously activating the depth sensor, the system applies partial action by activating it only for the specific duration and frequency needed to maintain adequate 3D model accuracy. The processor determines the minimum necessary depth sensing events required to keep the model current, avoiding excessive sensor activation that would unnecessarily drain the battery.
3Productivity
If real-time 3D reconstruction is performed, then application responsiveness is improved, but power consumption increases
Solution Approach 1:
The system performs real-time 3D reconstruction updates periodically rather than continuously. The processor evaluates captured images at regular intervals and triggers depth sensing and model updates only when environmental changes are detected, maintaining real-time responsiveness while reducing overall power consumption through periodic operation.
Solution Approach 2:
The system uses the captured color images themselves to determine when depth sensing is needed, making the reconstruction process self-regulating. The processor analyzes the captured images to assess whether the 3D model needs updating, using the available visual information to self-determine the appropriate timing for power-intensive depth sensing operations.
Data Source
Figure 1
Figure 2A
Figure 2B
AI summary
Embodiments disclosed facilitate resource utilization efficiencies in Mobile Stations (MS) during 3D reconstruction. In some embodiments, camera pose information for a first color image captured by a camera on an MS may be obtained and a determination may be made whether to extend or update a first 3-Dimensional (3D) model of an environment being modeled by the MS based, in part, on the first color image and associated camera pose information. The depth sensor, which provides depth information for images captured by the camera, may be disabled, when the first 3D model is not extended or updated.