Unlock instant, AI-driven research and patent intelligence for your innovation.

Two-dimensional photoelectric video and three-dimensional scene fusion method

A 3D scene, photoelectric video technology, applied in image data processing, 3D modeling, instruments, etc., can solve problems such as image distortion, and achieve the effect of rapid target geolocation ability

Active Publication Date: 2020-03-27
西安应用光学研究所
View PDF4 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] In the present invention, in order to solve the fusion problem of two-dimensional photoelectric video and three-dimensional digital map, this process is divided into four processes to solve the geographical positioning problem respectively, and solve the problem of photoelectric video Image distortion correction problem, solve the registration problem of photoelectric video and corresponding position in 3D digital map, solve the texture mapping problem of 2D photoelectric video and 3D terrain

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Two-dimensional photoelectric video and three-dimensional scene fusion method
  • Two-dimensional photoelectric video and three-dimensional scene fusion method
  • Two-dimensional photoelectric video and three-dimensional scene fusion method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] Such as figure 1 As shown, the fusion method of 2D photoelectric video and 3D scene in the present invention is divided into four modules, including geolocation, distortion correction, image registration and dynamic texture mapping. Combining the aircraft attitude angle, aircraft position and line of sight information provided by the inertial navigation, as well as the visualized three-dimensional scene, the geographic positioning is realized. The distortion parameters determined by the sensor image combined with the calibration process are corrected. According to the results of geolocation, the image of the location area is image-registered with the real-time photodetection video frame. Finally, according to the offset-compensated area, the corrected image is used as the texture for mapping. The specific calculation process is described in detail below:

[0035] (1) Geographic positioning:

[0036] The geolocation process is as follows: according to the position an...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a two-dimensional photoelectric video and three-dimensional scene fusion method. The method mainly comprises four parts of geographic positioning, image distortion correction,image registration and dynamic texture mapping. According to the method, the two-dimensional photoelectric video can be fused on the surface of the three-dimensional terrain; a scene which is in continuous butt joint in three-dimensional space dimensions and is registered in geographic position is presented to an observer, the scene can show a dynamic activity center area and can also show topographic and geomorphic characteristics of areas around the sensor, and the observer can see two kinds of information including dynamic and static combination in one picture. In this way, the advantages of the photoelectric video data and the terrain data, namely the real-time performance of the photoelectric video data and the wide area of the terrain data, can be combined, a better scheme for perceiving the surrounding situation is provided for pilots, and the method has certain application potential in the aspects of flight safety improvement, target reconnaissance, target tracking, route analysis and situation awareness.

Description

technical field [0001] The invention belongs to the fields of photoelectric reconnaissance and situation awareness, and mainly relates to a method for fusing two-dimensional photoelectric video and three-dimensional scenes. Background technique [0002] Compared with three-dimensional digital map data, the photoelectric sensor detection data on the airborne platform has the advantages of real-time dynamics in the form of two-dimensional video, such as dynamic ground target tracking or enemy dynamic activity reconnaissance, but they are all limited by the detection visual field. Field, distance and area, it can only present images within the limited field of view area with a fixed viewing angle, and the terrain features outside the detection area cannot be perceived. The 3D digital map can present 3D topographic features at any point of view and angle of view. Its advantage is that it can display terrain scenes at any distance and range. However, the data for constructing a 3...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T17/05G06T7/33G06T7/80G06T3/00
CPCG06T17/05G06T7/33G06T7/80G06T2207/10012G06T2207/30181G06T3/04
Inventor 高强纪明陶忠何樱杨光李良福安学智谢欢张鹏骞坤
Owner 西安应用光学研究所