Video imaging method, system, device and storage medium based on hybrid camera

A technology of hybrid camera and imaging method, applied in the field of image recognition, which can solve the problems of low resolution and capture of video images

Active Publication Date: 2021-05-11
SHENZHEN GRADUATE SCHOOL TSINGHUA UNIV
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, whether it is a ring-shaped ultra-high-resolution imaging system with a larger viewing angle or a portable version of a dual-camera high-resolution imaging system, the information dimensions of the images formed are RGB (red, green, blue, , Green, Blue, the three primary colors that can be captured by the human eye, the same below) three-dimensional information, the higher-dimensional information of the captured light at the spectral level cannot be captured by the current system
[0004] In recent years, although super-resolution algorithms, hyperspectral cameras, and artificial intelligence technologies based on hyperspectral images have gradually matured, on the basis of existing high-resolution video acquisition systems, there is still no solution at the pixel level. The technical problem of increasing the amount of information in a higher dimension and the low resolution of video images

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video imaging method, system, device and storage medium based on hybrid camera
  • Video imaging method, system, device and storage medium based on hybrid camera
  • Video imaging method, system, device and storage medium based on hybrid camera

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0030] figure 1 It is a schematic flowchart of a video imaging method based on a hybrid camera provided by Embodiment 1 of the present invention. The method can be executed by a video imaging system based on a hybrid camera array, and the system can be implemented in the form of software and / or hardware.

[0031] Such as figure 1 Described, the method of the present embodiment comprises:

[0032] S110. Acquire at least three low-resolution images captured by a wide-field camera, and acquire a high-resolution image captured by a narrow-field camera.

[0033] Among them, the wide-field camera can be understood as a camera with a short-focus lens. The camera has a larger lens aperture and better image quality. That is to say, the wide-field camera can capture close-range images, and the resolution of the captured images is relatively low but the captured images have a wide field of view. A narrow field of view camera can be understood as a camera with a telephoto lens. The len...

Embodiment 2

[0065] As a preferred embodiment of the above embodiment, image 3 A video imaging method based on a hybrid camera provided in Embodiment 2 of the present invention, the method includes:

[0066] S301. Acquire at least three low-resolution preview images based on at least three wide-field cameras.

[0067] The at least three wide-field cameras may be three or more, optionally, five wide-field cameras, and the lens of each camera has a shooting degree of 90 degrees. Before processing the low-resolution images captured by the wide-field cameras, a low-resolution preview image can be captured by five wide-field cameras. It should be noted that before taking low-resolution images based on the wide-field camera and processing them, the parameters of the wide-field camera can be adjusted and set. Optionally, adjusting the parameters of the wide-field camera can be Adjust the performance parameters of the wide-field camera, and adjust the placement position so that each wide-field ...

Embodiment 3

[0086] Figure 4 A schematic structural diagram of a video imaging system based on a hybrid camera array provided by Embodiment 3 of the present invention, the system includes: an image acquisition module 410 , an image stitching processing module 420 , an image fusion processing module 430 and a video image processing module 440 .

[0087] Wherein, the image acquisition module 410 is used to acquire at least three low-resolution images taken by a wide-field camera, and obtains a high-resolution image taken by a narrow-field camera; the image stitching processing module 420 is used to process each The low-resolution images are spliced ​​to obtain a low-resolution ring image; the image fusion processing module 430 is configured to fuse the low-resolution ring image with the high-resolution image to determine a high-resolution ring image ; The video image processing module 440 is used to obtain a high-resolution video image by encoding and integrating each of the high-resolution...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the present invention discloses a hybrid camera-based video imaging method, system, device, and storage medium. The method includes: acquiring at least three low-resolution images captured by a wide-field camera, and acquiring images captured by a narrow-field camera. A high-resolution image taken; by splicing each of the low-resolution images to obtain a low-resolution ring image; fusing the low-resolution ring image with the high-resolution image to determine a high-resolution image A ring image: by encoding and integrating each of the high-resolution ring images, a high-resolution video image is obtained. The technical solution of the embodiment of the present invention realizes that by combining the high-resolution images and low-resolution images captured by the narrow field of view camera and the wide field of view camera respectively, and using a series of algorithms to process them to obtain one billion pixels Super-resolution video images, improving the resolution of video images and the technical effect of spectral dimension.

Description

technical field [0001] Embodiments of the present invention relate to the technical field of image recognition, and in particular to a hybrid camera-based video imaging solution, system, device, and storage medium. Background technique [0002] With the development of existing computational photography, camera industry and artificial intelligence industry technology, the field of computer vision has achieved breakthroughs in performance and data scale in video acquisition, video target tracking, and real-time video recognition. The recognition accuracy of video recognition technology can exceed that of human eyes. In order to further realize better modern artificial intelligence algorithms and help research in related fields, and at the same time achieve better video recognition effects in high-definition surveillance, remote sensing recognition and even military applications, how to effectively improve the dimension of current video in information space, It has become a ke...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04N5/232
CPCH04N23/951H04N23/698
Inventor 方璐戴琼海朱天奕
Owner SHENZHEN GRADUATE SCHOOL TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products