Unlock instant, AI-driven research and patent intelligence for your innovation.

Real-time compositing of live recording-based and computer graphics-based media streams

A technology of computer graphics and media streaming, which is applied in computing, image communication, stereoscopic system, etc., and can solve the problems of interruption of live scenes, inability to provide visual preview tools, and visual preview of a large amount of time

Inactive Publication Date: 2013-08-21
CRYTEK
View PDF5 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, previsualization tools are not able to provide results that resemble the final version and look nothing like the final product
As such, these tools still require a significant amount of time to generate the previs, and often require the production team to interrupt the recording of the live scene and wait for the previs

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Real-time compositing of live recording-based and computer graphics-based media streams
  • Real-time compositing of live recording-based and computer graphics-based media streams
  • Real-time compositing of live recording-based and computer graphics-based media streams

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0057] figure 1A flowchart showing a method for providing a composite media stream according to an embodiment of the present disclosure. Method 100 may be performed on a compositing workstation, which may be incorporated into a recording device such as a real camera. In step 102, a real camera may be used to capture the real scene. The recording of the real scene and any further associated data, such as sensor and motion tracking data, can be transferred directly to the compositing workstation. The received recordings and any further data are processed in step 104 to generate a 3D representation of the real scene. In step 106 further data, such as motion tracking data and parameters of the real camera, as well as the records may be further used in step 106 to synchronize the virtual camera within the virtual scene with the real camera. As indicated by the dotted line between steps 104 and 106, further information may also be used for the synchronization 106 of the virtual c...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention relates to providing composite media streams based on a live recording of a real scene and a synchronous virtual scene. A method for providing composite media streams comprises recording a real scene using a real camera; creating a three-dimensional representation of the real scene based on the recording; synchronizing a virtual camera inside a virtual scene with the real camera; generating a representation of the virtual scene using the virtual camera; compositing at least the three-dimensional representation of the real scene with the representation of the virtual scene to generate a media stream; and providing the media stream at the real camera. A camera device, a processing pipeline for compositing media streams, and a system are defined.

Description

technical field [0001] The present invention relates to real-time compositing of media streams, and generally relates to providing in real-time on each recording camera a composite media stream comprising computer graphics based on a recording of a live scene. In particular, the present invention relates to a camera device capable of recording a live scene and simultaneously displaying a media stream including a computer graphics-based component synchronized with the actual live scene. Background technique [0002] Embedding computer-generated graphic objects in movies is a well-known technique. Computer graphics are used to enhance the film and enable, for example, fantasy-like characters and environments that would normally be difficult to generate using classical, non-digital methods. Typically, during the production of a film, different sources and individual materials, such as real scenes and computer-generated objects, are combined into a final picture. Typically, th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T13/40
CPCG06T13/20G06T19/006H04N13/207
Inventor 杰瓦特·耶尔利
Owner CRYTEK