Remote AR Measurement via Video Stream and Point Cloud
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality (AR) systems, while capable of capturing and processing video streams and motion data, face limitations in accurately measuring objects that are partially or fully outside the camera's field of view, particularly when using handheld devices, as they require manual movement and alignment by the user, which can be cumbersome and imprecise.
Innovation Solution
A system that enables remote device processing of video streams and AR data, allowing users to select points on objects and calculate measurements through point cloud data and camera pose information, with remote guidance for capturing additional data to measure objects not fully visible, using a combination of local and remote device capabilities and network communication.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If manual movement and alignment by the user is used to capture objects outside the field of view, then measurement coverage is improved, but ease of operation deteriorates
Solution Approach 1:
The patent introduces a remote device as an intermediary that assists the local device user in capturing objects outside the field of view. The remote device provides real-time video feedback and guidance, enabling the local device to capture necessary data points without requiring complex manual alignment operations by the user.
Solution Approach 2:
The system implements real-time feedback by transmitting video stream data from the local device to the remote device, which then provides guidance back to the user. This feedback loop enables the user to capture objects outside the field of view more easily by showing exactly what needs to be captured and how to position the device.
2Measurement precision
If remote guidance is used to capture additional data points, then measurement precision is improved, but device complexity increases
Solution Approach 1:
The patent divides the measurement system into two separate devices: a local device that captures video and AR data, and a remote device that provides guidance and processing. This segmentation allows each device to have specialized, simpler functionality while achieving high measurement precision through their coordinated interaction.
Solution Approach 2:
The system uses existing multi-functional devices (smartphones or tablets) that can serve as either local or remote devices. These devices already possess camera, processor, and display capabilities, so the system leverages their existing functionality rather than requiring specialized hardware, thereby minimizing the increase in device complexity.
3Measurement precision
If point cloud data and camera pose information are processed remotely, then measurement accuracy is improved, but loss of time increases
Solution Approach 1:
The system performs preliminary processing by capturing and transmitting video stream and AR data in real-time during the measurement process. The remote device receives and processes this data concurrently with the data capture, preparing guidance information before it is needed, thereby reducing the time delay between data capture and measurement results.
Solution Approach 2:
The patent maintains continuous data transmission and processing between the local and remote devices throughout the measurement process. The video stream and AR data are transmitted continuously, and the remote device continuously processes this data and provides real-time feedback, ensuring that the useful action of measurement proceeds without interruption or delay.
Data Source
AI summary
Embodiments include systems and methods for remotely measuring distances in an environment captured by a device. A device captures a video stream of a device along with AR data that may include camera pose information and/or depth information, and transmits the video stream and AR data to a remote device. The remote device receives a selection of a first point and a second point within the video stream and, using the AR data, calculates a distance between the first and second points. The first and second points may be at different locations not simultaneously in view of the device. Other embodiments may capture additional points to compute areas and/or volumes.