Image adaptive synthesis method and device and computer readable storage medium

A synthesis method and self-adaptive technology, applied in the field of image processing, can solve the problems that the synthesis effect cannot be guaranteed, and the field of high real-time performance cannot be applied, so as to achieve the effect of improving the effect

Active Publication Date: 2020-02-14
双智博(沈阳)机电设备制造有限公司
View PDF13 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The advantage of this method is that you can get a satisfactory synthesis effect without investing a lot of time and money. The disadvantage is that it cannot guarantee a real-time synthesis effect and cannot be applied to fields that require high real-time performance, such as live broadcast.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image adaptive synthesis method and device and computer readable storage medium
  • Image adaptive synthesis method and device and computer readable storage medium
  • Image adaptive synthesis method and device and computer readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0039] This embodiment provides a method for adaptive image synthesis, comprising the following steps:

[0040] (1) Obtain two shooting scenes to be synthesized, as the foreground and the background respectively.

[0041] (2) Determine the camera parameters of the foreground and background by Zhang Zhengyou calibration method, the parameters of the camera include f x , f y , u 0 and v 0 .

[0042] (3) Obtain any matching point corresponding to the synthetic trajectory in the foreground and background respectively, and determine the coordinates (X, Y, Z) of the two matching points in the camera coordinate system and the coordinates in the pixel coordinate system (u, v); Wherein, the coordinates of the matching point in the camera coordinate system can be obtained by sensor or manual measurement.

[0043] (4) Judging the depth of the two matching points in the camera coordinate system (that is, the Z value of the two), and obtaining the judgment result;

[0044](5) Accordi...

Embodiment 2

[0055] This embodiment provides a specific implementation of the above image adaptive synthesis method in video synthesis, and its operating environment is Windows 10+OpenCV 3.4.3+Kinect for Windows SDK 2.0+VS2017, specifically, it includes the following steps :

[0056] (1) Use the iphone 6s plus camera to record video as the background, and mark the coordinates of the background matching point in the camera coordinate system; use the kinect 2.0 camera to capture the video in real time, as the foreground, and mark the coordinates of the foreground matching point in the camera coordinate system .

[0057] (2) Use GML Camera Calibration to calibrate the camera parameters of the iphone 6s plus camera and the kinec t 2.0 camera.

[0058] (3) Load the image data streams of the foreground and the background, and adjust the progress of the foreground and the background to the time point when you want to start compositing.

[0059] (4) Obtain a pair of frame data synchronously from...

Embodiment 3

[0063] Refer to attached figure 1 , this embodiment provides an image adaptive synthesis device, which includes: an acquisition module, used to acquire two shooting scenes, respectively as the foreground and the background; a parameter determination module, used to determine the camera of the foreground and the background through the Zhang Zhengyou calibration method Parameter; the coordinate determination module is used to obtain any matching point corresponding to the synthetic trajectory in the foreground and the background respectively, and determines the coordinates of the two matching points in the camera coordinate system and the coordinates in the pixel coordinate system; the judgment module uses It is used to judge the depth of two matching points in the camera coordinate system to obtain the judgment result; the adaptive affine transformation module is used to perform affine transformation on the foreground or background according to the judgment result, the camera pa...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an image adaptive synthesis method and device and a computer readable storage medium, and belongs to the technical field of image processing. The image adaptive synthesis method comprises the following steps: firstly, determining camera parameters of a foreground and a background; then, respectively obtaining any matching point corresponding to the synthetic track in the foreground and the background, and determining coordinates of the two matching points in a camera coordinate system and coordinates of the two matching points in a pixel coordinate system; and then, judging the depths of the two matching points in a camera coordinate system, carrying out affine transformation processing on the foreground or the background, and carrying out image synthesis through OpenCV to obtain a synthesized image. According to the invention, affine transformation processing is firstly carried out on the foreground or the background, and then image synthesis is carried out through OpenCV, so that the purposes that control parameters do not need to be manually adjusted in the shooting process and the synthesized image can be output in real time can be achieved under the condition that the positions and parameters of the corresponding foreground camera and background camera are different.

Description

technical field [0001] The present invention relates to the technical field of image processing, in particular to an image adaptive synthesis method, device and computer-readable storage medium. Background technique [0002] Virtual studio is a unique multimedia production technology developed in recent years, which is widely used in the production of TV programs, filming of film and television dramas, teaching, live broadcasting and other fields. The so-called virtual studio technology is to use the chroma keying technology to replace the video background, and then replace the blue box or green box background deducted by the chroma key with the two or three-dimensional scenes shot in advance or made by the computer. Video synthesis technology, according to the parameters such as the position and focal length of the foreground camera, the perspective relationship of the background is consistent with that of the foreground. Through chroma key synthesis, the characters and pro...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04N5/272
CPCH04N5/272
Inventor 王斌杨晓春刘一
Owner 双智博(沈阳)机电设备制造有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap