Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Virtual live broadcast method and system based on smart phone AR augmented reality

An augmented reality, smartphone technology, applied in the AR field, can solve problems such as difficult to achieve augmented reality, and achieve the effect of strong independence and high flexibility

Active Publication Date: 2020-02-18
CHENGDU SOBEY DIGITAL TECH CO LTD
View PDF9 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In the video processing layer, in order to achieve some image effects, such as seemingly cool animations and 3D effects, the essence is based on superimposing dynamic pictures, superimposing some 3D engine models, superimposing some H5 special effects, and it is difficult to achieve augmented reality. This more realistic effect

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Virtual live broadcast method and system based on smart phone AR augmented reality
  • Virtual live broadcast method and system based on smart phone AR augmented reality

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] The present invention will be further described below in conjunction with the accompanying drawings.

[0032] The AR that appears in this invention, the full name is Augmented Reality, is a cutting-edge technology. It is called augmented reality technology in Chinese. It is a technology that calculates the position and angle of camera images in real time and adds corresponding images, videos, and 3D models. , the goal of this technology is to put the virtual world on the screen and interact with the real world. ARKit is Apple's latest development framework for AR function realization, which can help us realize AR technology functions in the simplest and fastest way. SceneKit is a framework launched by Apple for building 3D scenes, which can seamlessly interact with other frameworks for building 3D and 2D models, and is used for the presentation of scenes, models and other functions. The combination of SceneKit framework and ARKit framework realizes real AR special effec...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to the technical field of AR, and discloses a virtual live broadcast method and system based on smart phone AR augmented reality. According to the scheme, the image data is acquired through the combination of the SceneKit framework and the ARKit framework, wherein the SceneKit framework is used for acquiring real world image data and displaying a virtual 3D model; the ARKit framework is used for being responsible for capture and action interaction of camera events, the collected image data are presented with SCNView as a carrier and transmitted to the data processing layer, and AI beautifying, filter filtering and static image layer superposition processing is carried out; meanwhile, audio data is collected and transmitted to the data processing layer for noise reduction processing; and then AR images are collected, coded and packaged, and then plug flow and transmission are carried out. According to the scheme, AR augmented reality is carried out based on the SceneKit framework and the ARKit framework, the AR effect in the live broadcast result is derived from the stream pushing framework, and live broadcast stream pushing with the AR special effect is realized.

Description

technical field [0001] The invention relates to the field of AR technology, in particular to a virtual live broadcast method and system based on smart phone AR augmented reality. Background technique [0002] The basic process of the existing live broadcast streaming is audio and video collection-audio and video processing-encoding and packaging-push streaming and transmission. Among them, the most important impact on video and audio effects lies in the collection and processing link. Acquisition is the first link in the entire video streaming process. It obtains the original video data from the acquisition device of the system and outputs it to the next link, which includes two aspects of data acquisition: audio acquisition and image acquisition. Image acquisition is achieved through camera acquisition, screen recording, and video file data reading. [0003] The video processing stage processes the collected images and audio data, adds beautification effects, watermarks, c...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): H04N21/2187H04N21/234H04N21/2343H04N21/6437H04N13/275
CPCH04N13/275H04N21/2187H04N21/234H04N21/2343H04N21/6437
Inventor 谢超平王威周游孙永宝骆东袁龙
Owner CHENGDU SOBEY DIGITAL TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com