Unlock instant, AI-driven research and patent intelligence for your innovation.

Video real-time recording method and recording device based on augmented reality

A technology of equipment and target objects, applied in image communication, electrical components, three-dimensional systems, etc., can solve the problems of unclear presentation form of virtual content, appearance of time and action rhythm, superposition of virtual content, etc., to achieve the effect of real-time interaction

Active Publication Date: 2018-01-19
SHICHEN INFORMATION TECH SHANGHAI CO LTD
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In the prior art, to superimpose the virtual content on the recorded video is generally to record a video first, then superimpose the virtual content to be superimposed on the recorded video, and superimpose the virtual content on the recorded video through post-production. In the video, and then presented to the user, but it is impossible to superimpose the virtual content in real time during the recording process
[0005] Therefore, in the current video AR processing technology, the video recorder does not know the presentation form, appearance time, and action rhythm of the virtual content, so it is difficult to organically combine the recorded video with the virtual content and achieve interaction

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video real-time recording method and recording device based on augmented reality
  • Video real-time recording method and recording device based on augmented reality
  • Video real-time recording method and recording device based on augmented reality

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0062] An embodiment of the present invention provides a recording device, which can realize a real-time video recording method based on AR (Augmented Reality, augmented reality), such as figure 1 As shown, the recording device includes a camera 11, an AR engine 12, a 3D engine 13, a video encoding unit 14, an audio synthesis unit 15, an audio encoding unit 16, a media file processing unit 17 and a display unit 18, wherein:

[0063] The camera 11 transmits the captured image information to the AR engine 12. After receiving the image information, the AR engine 12 recognizes the target object in it, extracts the attribute information of the target object, and sends the attribute information and environment content of the target object to the 3D engine 13. , wherein the environment content is the actual scene captured by the camera, that is, the environment itself where the target object is located, which may contain image information or audio information in the environment; the 3...

Embodiment 2

[0086] like figure 2 As shown, the embodiment of the present invention provides a real-time video recording method based on augmented reality, using the recording device as shown in Embodiment 1, specifically including:

[0087] S1. The camera collects the image information in the real scene, and sends the collected image information to the AR engine;

[0088] Specifically, turn on the camera in the recording device, and take pictures of the parts that need to be interacted with in the real scene.

[0089] S2. The AR engine analyzes the received image information, determines the target object in the image information and acquires the attribute information of the target object, and sends the attribute information and environment content of the target object to the 3D engine;

[0090] In step S2, the AR engine receives the image information sent by the camera, and determines the target object in the image through image retrieval and other methods. When there are two or more targ...

Embodiment 3

[0117] The embodiment of the present invention also provides a real-time video recording method based on augmented reality, using the recording device described in Embodiment 1, the method includes:

[0118] 301. The smart phone collects images in real scenes, such as turning on the camera of the smart phone, starting the video shooting mode, and recording the real scene, for example, the recording includes at least one of images such as people, buildings, flowers, trees, and indoor spaces;

[0119] In this embodiment, the recording device is a smart phone, and all processing and storage are done on the smart phone as an example for description.

[0120] 302. The smartphone sends the collected image information to the AR engine for processing;

[0121] 303. After the AR engine receives the image information, it first analyzes the image, and uses the method of image retrieval to identify the target object existing in the image, that is, to retrieve the content of the received i...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides an augmented-reality-based real-time video recording method and recording equipment. The recording equipment is composed of an AR engine and a 3D engine. The AR engine is used for receiving image information, identifying a target object in the image information, and extracting attribute information of the target object, and sending the attribute information of the target object and a content of an environment where the target object is located to the 3D engine, wherein the engine content includes the information of the environment where the target object is located. The 3D engine is used for receiving the attribute information and the environment content, which are sent by the AR engine, of the target object, a virtual content corresponding to the target object is determined based on the attribute information of the target object, and carrying out superposition on the virtual content and the environment content to form an interaction content, so that the interaction content can be synthesized into an image and / or the interaction content is displayed by a display unit.

Description

technical field [0001] The invention relates to the field of augmented reality technology, in particular to a real-time video recording method and recording device based on augmented reality. Background technique [0002] AR (Augmented Reality, Augmented Reality) technology is a brand-new human-computer interaction technology. It applies virtual content to the real world through smart terminal equipment and visualization technology, so that the virtual content and the real world can be superimposed on the same screen or space at the same time and presented to the audience. user. With the popularity of smart terminals, the application of AR technology is becoming more and more extensive, and AR applications can be installed on smart terminals to experience. Specifically, the workflow of the AR application is as follows: the smart terminal captures image frames through the camera, recognizes the image frames, and determines the AR target object; tracks the AR target object in...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04N13/204H04N13/189H04N13/161H04N13/275
CPCH04N13/161H04N13/189H04N13/204H04N13/275
Inventor 张小军王凤伟王伟楠
Owner SHICHEN INFORMATION TECH SHANGHAI CO LTD