Real-time 3D Point Cloud Display for UAV Surveying

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In surveying and mapping, users face inefficiencies due to the inability to view three-dimensional point clouds in real time, leading to prolonged reconstruction times, poor reconstruction quality, and unnecessary re-shooting efforts, which waste time and resources.

Innovation Solution

A real-time display method and system for three-dimensional point clouds using an unmanned aerial vehicle (UAV) that synchronously displays the UAV's current position and point cloud on a flight route, allowing users to inspect the reconstruction effect in real time by processing images captured by the UAV's image capturing device.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the entire scene is reconstructed before allowing the user to view the point cloud, then the reconstruction is complete and accurate, but the user must wait a long time (tens of minutes to several days) to inspect the results

Engineering Contradiction:
Improvereconstruction accuracyVSAvoidwaiting time for reconstruction
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent divides the complete scene reconstruction into multiple sub-scenes or regions. Each sub-scene is reconstructed independently and can be viewed separately, allowing users to inspect specific areas without waiting for the entire scene to be processed. This segmentation enables partial results to be displayed while the full reconstruction continues in the background.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary reconstruction on selected sub-scenes or regions before the complete scene reconstruction is finished. By prioritizing certain areas for early processing, users can view preliminary results of specific regions while the overall reconstruction project continues, significantly reducing the perceived waiting time.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If the user waits for complete scene reconstruction before inspection, then all areas are available for review, but the operational efficiency is reduced due to inability to identify poor reconstruction areas in time

Engineering Contradiction:
Improvecompleteness of reconstruction reviewVSAvoidoperational efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The reconstruction project is divided into multiple sub-scenes that can be processed and reviewed independently. Users can select specific sub-scenes for priority reconstruction and review, enabling them to identify quality issues in specific areas without waiting for the entire project to complete, thus improving operational efficiency while maintaining overall review capability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system provides real-time feedback on reconstruction quality by displaying completed sub-scenes as they are processed. Users can immediately see which areas have been successfully reconstructed and which need re-shooting, allowing for timely corrective actions rather than discovering issues after the entire project is complete.

Inventive Principle:
Principle #23Feedback

3Manufacturing precision

If poor shooting areas are not identified in time, then the complete reconstruction is finished, but re-shooting is required which wastes manpower and time cost

Engineering Contradiction:
Improvereconstruction qualityVSAvoidtime cost of re-shooting
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system implements real-time quality feedback by displaying reconstructed sub-scenes during the processing workflow. Users can immediately identify areas with poor reconstruction quality or insufficient image coverage, allowing them to mark these regions for re-shooting before leaving the site, thereby avoiding the need to return later and reducing both time and manpower costs.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system enables preliminary quality assessment of reconstruction results as they become available. By identifying poor shooting areas during the reconstruction process rather than after completion, users can take preliminary corrective actions (re-shooting) while still at the location, preventing the need for costly return trips.

Inventive Principle:
Principle #10Preliminary action

4Quantity of substance

If the entire scene reconstruction is completed before display, then the full point cloud is available for viewing, but the user experience is poor due to long waiting time

Engineering Contradiction:
Improveamount of point cloud dataVSAvoiduser experience
Core Design Contradiction:
Quantity of substanceVSEase of operation

Solution Approach 1:

The complete point cloud dataset is divided into multiple sub-scenes that can be displayed independently. Users can view completed sub-scenes immediately after their processing is finished, providing a satisfying user experience with visible progress, while the remaining portions continue to be processed in the background without interrupting the user's ability to work with available data.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS12092463B2Real-time display method, device, system and storage medium of three-dimensional point cloud
Publication Date: 2024.09.17 SZ DJI TECH CO LTD
  • US12092463B2 patent drawing
  • US12092463B2 patent drawing
  • US12092463B2 patent drawing

AI summary

A real-time display method, device, system, and storage medium for a three-dimensional point cloud can include: displaying a flight route corresponding to a target shooting area of an unmanned aerial vehicle; acquiring a current position of the unmanned aerial vehicle and an image captured by an image capturing device of the unmanned aerial vehicle; based upon the image, determining a three-dimensional point cloud corresponding to at least a portion of the target shooting area; and displaying synchronously the current position of the unmanned aerial vehicle and the three-dimensional point cloud while the unmanned aerial vehicle moves according to the flight route, where a display icon corresponding to the current position is located on the flight route.