Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and apparatus for synthetizing animations in videos in real time

A technology in video and animation, used in animation production, image data processing, instruments, etc., can solve the problems of lack of ability to synthesize animation, inability to predict video screen changes, and short duration.

Inactive Publication Date: 2016-02-17
BEIJING SEVEN DIMENSION VISION TECH CO
View PDF9 Cites 21 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In the live video data of the live broadcast, since the shooting angle and camera position of the camera that collects the video data cannot be predicted, if you want to synthesize animation in the live video during the live broadcast, because the change of the video picture cannot be predicted, in order to ensure the synthesis effect Not obtrusive, at best, some short-duration, 2D animations or pictures can be synthesized in the video
[0004] It can be seen that the current animation synthesis effect in video, especially the ability to synthesize animation in real-time in live video, basically does not have the ability to effectively meet the needs of existing visual communication.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and apparatus for synthetizing animations in videos in real time
  • Method and apparatus for synthetizing animations in videos in real time
  • Method and apparatus for synthetizing animations in videos in real time

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0048] figure 1 It is a method flowchart of a method for synthesizing animation in video in real time provided by an embodiment of the present invention. The method is applied to video collected in real time, and relevant parameters need to be obtained before implementing the method.

[0049] The fixed area where the video is collected includes at least one camera, and the video is collected by the main camera in the at least one camera; the server establishes a 3D coordinate system in the fixed area, and the server collects the at least one video in real time. The position information of a camera in the 3D coordinate system and the video acquisition parameters of the main camera; the server uses a rendering engine to establish a virtual area according to the fixed area and the 3D coordinate system, and the fixed area is in the The position information in the 3D coordinate system has a proportional relationship with the position information of the virtual area in the 3D coord...

Embodiment 2

[0086] In practical applications, the motion capture device may collect the motion data of the second target according to a preset collection frequency. For example, the preset collection frequency is 50 times per second, that is, the motion capture device collects motion data 50 times within one second. Of course, this numerical value is only for illustration, and the present invention is not limited thereto. In addition, the server may preset a refresh rate, which is referred to as a preset refresh rate for ease of description. The server generates video images of each frame of the target video at a preset refresh rate. For example, the refresh rate of the server may be 40 times per second, then the server generates 40 frames of video images within one second. Of course, this numerical value is only for illustration, and the present invention is not limited thereto.

[0087] There is a situation that the refresh rate of the server is different from the collection frequenc...

Embodiment 3

[0113] Figure 4 A device structure diagram of a device for synthesizing animation in video in real time provided for an embodiment of the present invention, which is applied to a video collected in real time. The fixed area where the video is collected includes at least one camera, and the video is captured by the at least Collected by the main camera in one camera; the server establishes the 3D coordinate system of the fixed area, and the server collects the position information of the at least one camera in the 3D coordinate system and the video collection of the main camera in real time parameter; the server uses a rendering engine to establish a virtual area according to the fixed area and the 3D coordinate system, the position information of the fixed area in the 3D coordinate system is the same as the position information of the virtual area in the 3D coordinate system The location information has a proportional relationship; the server uses the rendering engine to set ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention discloses a method and apparatus for synthetizing animations in videos in real time. The method and apparatus are applied to videos which are acquired in real time. The method includes the following steps that: action data and action coordinates which are acquired in real time by action capture equipment as well as face data and face coordinates which are acquired in real time by face capture equipment are obtained, and a skeleton model and a face model are generated in a target region in a virtual area; a virtual camera keeps synchronous with a main camera, so that skeleton animations which are generated by the skeleton model in the virtual area according to the action data and face animations generated according to the face data are obtained; the skeleton animations and the face animations of the face model are extracted from a rendering engine, and synthetic video data can be obtained through the animation data of the skeleton animations and the face animations which are synthetized in real time by a 3D coordinate system in video data, and the synthetic video data are outputted in real time. With the method and apparatus of the invention adopted, the animations can be synthetized in the videos in real time, and existing video visual communication requirements can be satisfied.

Description

technical field [0001] The invention relates to the field of real-time video synthesis, in particular to a method and device for synthesizing animation in video in real time. Background technique [0002] Video is a common media format. For example, real-time live video data can be obtained from a live TV program collected by a camera. In the process of live broadcast, in order to improve the live broadcast effect or increase artistic expression, the animation effect can be synthesized in the live video through data synthesis in the live video data, which is a new form of visual communication, such as strengthening the performance of characters Emoticon animations, voiceover text art, and some background animation effects, etc. [0003] However, the animation synthesis currently applied in TV or network video playback mainly relies on the completion of video post-processing, that is, in the case of non-live broadcasting, after animation synthesis is performed in the recorde...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04N21/234H04N21/218G06T13/40
CPCH04N21/234G06T13/40H04N21/21805H04N21/23412
Inventor 殷元江
Owner BEIJING SEVEN DIMENSION VISION TECH CO
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com