Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Image interpolation method and device based on RGB-D image and multi-camera system

An interpolation method, multi-camera technology, applied in image enhancement, image analysis, image data processing and other directions, can solve problems such as look and feel stuck

Pending Publication Date: 2021-03-12
PLEX VR DIGITAL TECH CO LTD
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In order to solve the problem that multi-view video is easy to get stuck when switching viewing angles due to the small number of acquisition cameras, the present invention proposes an image interpolation method and device based on RGB-D images and a multi-camera system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image interpolation method and device based on RGB-D image and multi-camera system
  • Image interpolation method and device based on RGB-D image and multi-camera system
  • Image interpolation method and device based on RGB-D image and multi-camera system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0089] The technical solutions of the present invention will be further described below in conjunction with the accompanying drawings and through specific implementation methods.

[0090] Wherein, the accompanying drawings are only for illustrative purposes, showing only schematic diagrams, rather than physical drawings, and should not be construed as limitations on this patent; in order to better illustrate the embodiments of the present invention, some parts of the accompanying drawings will be omitted, Enlargement or reduction does not represent the size of the actual product; for those skilled in the art, it is understandable that certain known structures and their descriptions in the drawings may be omitted.

[0091] In the drawings of the embodiments of the present invention, the same or similar symbols correspond to the same or similar components; , "inner", "outer" and other indicated orientations or positional relationships are based on the orientations or positional ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an image interpolation method and device based on RGBD images and a multi-camera system. The method comprises the steps that camera calibration is conducted on each camera in the multi-camera system; determining an interpolation position of a new camera according to the position information of each camera in the multi-camera system, and calculating a camera pose of the newcamera according to camera calibration data; according to the projection relationship of the cameras and the pose information of each camera, calculating a plurality of initial interpolation images having a one-to-one correspondence relationship with specified images acquired by each camera in the multi-camera system; performing image fusion on each initial interpolation image to obtain a fused interpolation image; and performing pixel completion on the fused interpolation image to finally obtain an interpolation image associated with the new camera. According to the invention, the problem that a multi-view-angle video is easy to have an unsmooth impression during switching of viewing view angles due to the fact that the number of the acquisition cameras is too small is solved.

Description

technical field [0001] The invention relates to an image interpolation method, in particular to an image interpolation method and device based on RGB-D and a multi-camera system. Background technique [0002] Today, multi-camera systems are widely used in 3D reconstruction, motion capture, and multi-viewpoint video capture. The multi-camera system tracks and shoots one or more targets at the same time through multiple different cameras, light sources, storage devices, etc., and the obtained multi-view video can better show the characteristics of the target, which can greatly improve the visual experience of the audience. However, multi-view videos can usually only be viewed at the original viewing angle of the capture camera. When the number of capture cameras is sparse, the switching of viewing angles will cause large content changes, making the user feel stuck. Contents of the invention [0003] In order to solve the problem that multi-view video is easy to get stuck wh...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T3/40G06T5/50G06T7/70G06T7/80
CPCG06T3/4007G06T5/50G06T7/70G06T7/80G06T2207/20221G06T2207/10024G06T2207/10028G06T2207/30244H04N13/246H04N13/271H04N13/282H04N17/002H04N13/239H04N13/111
Inventor 章焱舜陈欣张迎梁
Owner PLEX VR DIGITAL TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products