Mine multi-camera video fusion method based on GPU and CPU cooperative computing

A multi-camera and video fusion technology, applied in computer components, computing, image enhancement, etc., can solve problems such as panoramic deformation and limited viewing angle of a single camera

Inactive Publication Date: 2015-10-07
CHINA UNIV OF MINING & TECH
View PDF7 Cites 22 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to provide a mine multi-camera video fusion method based on the cooperative calculation of GPU and CPU to solve the problem of limited viewing angle and panoramic deformation of the single camera in the fully mechanized excavation face of the mine

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Mine multi-camera video fusion method based on GPU and CPU cooperative computing
  • Mine multi-camera video fusion method based on GPU and CPU cooperative computing
  • Mine multi-camera video fusion method based on GPU and CPU cooperative computing

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0089] Embodiment 1: The multi-camera video fusion method of the mine: Aiming at the special working environment requirements of the fully mechanized mining face of the mine, a GPU and CPU collaborative computing model is constructed; the image information obtained by the camera is used to automatically identify the correct image sequence; the camera parameters are adjusted by bundling Solve the unified fusion plane, decompose the video frame image of a single camera, and fuse the video in multiple bands, and finally realize the panoramic video of the fully mechanized mining face with high resolution and high frame rate;

[0090] The dispatching center obtains video signals of multiple downhole cameras; processes the video signals obtained by each camera, and re-merges multiple groups of video image sequences with overlapping areas according to different viewing angles and differences in sensors to form a set of registered resolutions High seamless video image sequence, generat...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a mine multi-camera video fusion method based on GPU and CPU cooperative computing and belongs to the mine multi-camera video fusion method. The method is characterized in that a GPU and CPU cooperative computing model is established, and thus current situation of poor real-time performance of an existing video fusion method is relieved; automatic matching is carried out by utilizing features of overlapped regions between adjacent video sources to determine relative position relation of the video sources, so that positions of cameras do not need to be assigned in advance, and automatic integration is realized; camera parameter bundle adjustment estimation and automatic alignment are carried out, so that the problem of deformation of panorama images after fusion is solved; and an exposure compensation and multiband fusion method is adopted, and finally, an ultrahigh-resolution large-visual angle mine mining (extraction) working face large-scale scene real-time integral video is generated, so that the method plays an important role for improving coal mining work efficiency and guaranteeing coal mine safety production. The advantages are that the multi-camera video fusion method utilizes the existing cameras of a coal mine fully to generate the mine mining (extraction) working face panorama video, thereby reducing equipment investment and improving safety of coal mine production.

Description

technical field [0001] The invention relates to a mine multi-camera video fusion method, in particular to a mine multi-camera video fusion method based on GPU and CPU cooperative calculation. Background technique [0002] The mine automatic multi-camera video fusion technology based on the cooperative calculation of the graphics processing unit (GPU) and the central processing unit (CPU) is to fuse the real-time video information captured by cameras at different points scattered in the scene into a panoramic real-time video. For the monitoring of mine mechanized excavation working face, the current video image acquisition equipment has some shortcomings, such as panoramic camera, although it can contain a wide range of scene information, but the cost of the camera is relatively high, and the existing cameras in the coal mine cannot be fully utilized. The resolution of the camera is limited, and it is impossible to clearly display the details of the mine mining (excavation) f...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06T7/00G06T3/00G06K9/62H04N7/18
CPCH04N7/18G06T3/0068G06T2207/10016G06V20/48G06F18/251
Inventor 姚睿夏士雄牛强周勇陈朋朋王重秋
Owner CHINA UNIV OF MINING & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products