Unmanned aerial vehicle video augmented reality implementation method

A technology of augmented reality and implementation method, applied in image data processing, 3D modeling, instruments, etc., can solve the problem that the positioning relationship between video and geographic coordinate system is not established, the POS data of UAV is not fully utilized, and the information layer cannot be directly Multiplexing and other issues to achieve the effect of improving processing efficiency, reducing data processing workload, and improving information fusion capabilities

Pending Publication Date: 2019-06-11
CHINA RAILWAY DESIGN GRP CO LTD
View PDF8 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] At present, the video-based augmented reality method mainly uses video processing software, uses computer vision to reconstruct the relative relationship, and then adds information, does not make full use of the POS data of the d

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Unmanned aerial vehicle video augmented reality implementation method
  • Unmanned aerial vehicle video augmented reality implementation method
  • Unmanned aerial vehicle video augmented reality implementation method

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0044] Example one:

[0045] A realization method of UAV video augmented reality based on photogrammetry technology and 3DGIS technology, including the following steps:

[0046] S1) Using consumer-grade multi-rotor drones that support 2K and above resolution camera functions, the camera's pitch angle (relative to the downward swing angle) is 30°-60°, along with figure 1 The route shown is flying at a constant speed. Such as figure 2 As shown, the photogrammetry method is used to process the aerial photography data of the calibration site to obtain accurate camera field of view, focal length, lens distortion and other camera internal azimuth parameters. The obtained parameter file is as follows image 3 Shown. Then, the unmanned aerial vehicle uses the camera to collect a strip of video, and extracts frames of the collected video to obtain key frame images at a ratio of 1 / 10-1 / 30. In this embodiment, the key frame images are acquired at a ratio of 1 / 10, such as Figure 4 Shown.

[...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an unmanned aerial vehicle video augmented reality implementation method based on a photogrammetry technology and a 3D GIS technology. The method mainly comprises the steps ofvideo frame extraction, camera calibration, aerial triangulation reconstruction, 3D GIS virtual scene establishment, sequence frame image rendering, video synthesis and the like. According to the invention, the POS data of the unmanned aerial vehicle are utilized; the accurate camera track and attitude are recovered by using a space three-adjustment method; A three-dimensional geographic scene isestablished in a 3D GIS system; The method comprises the steps of acquiring a video image, superposing various types of vector data, importing a three-dimensional model, adding a custom character label and a graphic label, realizing a blanking effect by importing a digital surface model, then acquiring a rendered image with the same visual angle as the original video frame by frame, superposing the rendered image with the original video frame by frame, and acquiring a video result containing rich information. According to the method, the processing efficiency and effect are improved, the automation degree can be greatly improved in repeated line inspection application of linear engineering, and an efficient and real technical means is provided for scheme display and on-site inspection.

Description

technical field [0001] The invention belongs to the fields of unmanned aerial vehicle application, computer vision and augmented reality, and in particular relates to a method for realizing augmented reality of unmanned aerial vehicle video based on photogrammetry technology and 3DGIS technology. Background technique [0002] Multi-rotor UAV video aerial photography technology is widely used in the field of construction engineering, mainly used in the information collection of the site during the planning and design phase, and the site inspection during the construction process. Aerial video data without further processing can only be viewed and cannot be integrated with the information system. The video-based augmented reality technology can superimpose text and graphic annotations in the video, and can display design schemes, mark engineering element information, and record problems in aerial videos, which can greatly improve the informatization attributes of aerial video ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T19/00G06T17/05
Inventor 赵文韩祖杰刘小龙范登科王华宁新稳黄漪张恒宗伟丽王娇
Owner CHINA RAILWAY DESIGN GRP CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap