Hybrid camera array based light field video imaging system and video processing method

A hybrid camera and light field image technology, applied in image data processing, TV system components, TV, etc., can solve the problem of low spatial resolution of light field cameras

Active Publication Date: 2018-04-24
BEIJING ZOHETEC CO LTD
View PDF8 Cites 28 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in the current era of pursuing high resolution, the shortcoming of low spatial resolution of light field cameras is constantly being magnified, and even becomes an obstacle to the further development of light field cameras.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Hybrid camera array based light field video imaging system and video processing method
  • Hybrid camera array based light field video imaging system and video processing method
  • Hybrid camera array based light field video imaging system and video processing method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0021] The present invention will be further described below in conjunction with the accompanying drawings and specific embodiments.

[0022] The specific embodiment of the present invention provides a light field video imaging system that can generate a billion-pixel light field video. The system is realized based on a hybrid camera array and a special video image fusion algorithm, specifically including controlling the pan / tilt, image processing unit, a storage unit, and the hybrid camera array installed on the control pan / tilt. The hybrid camera array includes at least one global camera, at least one global light field camera, and a plurality of local cameras; the global camera, the global light field camera, and the plurality of local cameras acquire a global image of a predetermined scene synchronously, respectively. A low-resolution reference video, a global low-resolution light field video, and a plurality of different local high-resolution videos are stored in the stor...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a hybrid camera array based light field video imaging system and video processing method. The system includes a control cloud deck, an image processing unit, a storage unit anda hybrid camera array. The hybrid camera array includes a global camera, a global light field camera and a plurality of local cameras used for collecting a global low resolution reference video, a global light field video and a plurality of local high definition videos of one scene synchronously. The image processing unit performs following treatment on a reference image, a global light field image and a plurality of high definition images of each group taken at the same moment: performing block matching on the local images with the reference image, converting the local images to corresponding blocks of the reference image based on matching results and obtaining a global high definition image; based on the global high definition image, performing super-resolution on the global light fieldimage so as to obtain a global high resolution light field image; combining all frames of global high resolution light field images into a global high resolution light field video.

Description

technical field [0001] The invention relates to the fields of computer vision and video processing, in particular to a light field video imaging system based on a hybrid camera array and a related video processing method. Background technique [0002] Since the hand-held model of the light field camera was proposed by Ren.NG et al. in 2005, the light field camera has been greatly developed and has gradually stepped out of the laboratory and become a civilian product. However, in this era of pursuing high resolution, the shortcoming of low spatial resolution of light field cameras is constantly being magnified, and even becomes an obstacle to the further development of light field cameras. However, the characteristics of light field video that can be zoomed arbitrarily and can be displayed in multi-viewpoints are very pursued by people. Therefore, how to obtain high-resolution light field video is a problem that many people are constantly exploring. [0003] The disclosure o...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04N5/265H04N5/268H04N5/262H04N5/247G06T3/40
CPCH04N5/262H04N5/265H04N5/268G06T3/4053H04N23/90
Inventor 方璐刘烨斌王好谦袁肖赟徐志伟
Owner BEIJING ZOHETEC CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products