Dynamic image fusion method and system for VR panoramic live broadcast

A technology of dynamic images and fusion methods, applied in stereoscopic systems, image communication, image data processing, etc., can solve problems such as large blind spots, poor interactivity, and small field of vision, achieve natural and smooth image splicing, reduce live broadcast delays, and change The effect of viewing angle

Pending Publication Date: 2021-03-19
NANJING UNIV OF POSTS & TELECOMM
View PDF5 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The traditional immersive experience requires the purchase and wearing of professional VR glasses, which are not only expensive and have a high threshold, but are also very detrimental to the promotion and dissemination of live broadcasts, which runs coun

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Dynamic image fusion method and system for VR panoramic live broadcast
  • Dynamic image fusion method and system for VR panoramic live broadcast
  • Dynamic image fusion method and system for VR panoramic live broadcast

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] The present invention will be described in further detail below in conjunction with the accompanying drawings.

[0034] Such as figure 1 As shown, a kind of dynamic image fusion method that the present invention proposes is used for VR panorama live broadcast, specifically comprises the following steps:

[0035] Step 1: Set up cameras in different directions to collect multi-view live streams, compress and encode them, and push them to the streaming media server in real time.

[0036] The compression coding adopted is H264 compression coding. The streaming media server is an SRS open source streaming media server, and the uplink adopts the RTMP transmission protocol to push the live stream to the SRS streaming media server in real time.

[0037] Step 2: Use the dynamic image fusion algorithm to seamlessly splice live images from different perspectives to generate a VR panoramic live stream.

[0038] The dynamic image fusion algorithm used, the dynamic image fusion al...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a dynamic image fusion method and system for VR panoramic live broadcast, and the method comprises the steps: collecting a multi-view live broadcast stream, carrying out compression coding, and pushing the multi-view live broadcast stream to a streaming media server in real time; using a dynamic image fusion algorithm to seamlessly splice the live broadcast images of different visual angles to generate VR panoramic live broadcast streams; creating a virtual scene and a 3D sphere object, and establishing a grid model in the virtual scene by taking the VR panorama as a material; creating a virtual perspective camera, and specifying an initial position, a direction and a visual field range of the camera; creating a 3D renderer, rendering all the two-dimensional live broadcast pictures in the visual field range of the virtual camera in the scene into a three-dimensional image, and displaying the three-dimensional image; and changing the position and direction of thevirtual camera according to the change of the viewing angle of the user so as to generate and display live broadcast pictures of different viewing angles. According to the invention, the visual anglechange of the user is supported, the visual field range of the user in live broadcast can be expanded, the live broadcast blind area is eliminated, immersive visual perception is brought to the user,and the live broadcast effect is improved.

Description

technical field [0001] The invention belongs to the field of 5G online live broadcast, and in particular relates to a dynamic image fusion method and system for VR panoramic live broadcast. Background technique [0002] The advent of the 5G era has brought vigorous vitality to the webcast industry and made it more widely used. With the development of science and technology, people have been pursuing higher comfort and experience, so the experience requirements for watching live broadcasts are getting higher and higher. The live broadcast itself is bound to develop a new form of existence, and its functions will become more and more powerful. . With the application of 5G network, immersive experience will become an important form of learning, life, entertainment and aesthetics, so the combination of immersive experience and webcast has become the focus of current research. [0003] The traditional immersive experience requires the purchase and wearing of professional VR gla...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04N21/218H04N21/2187H04N21/44G06T3/40G06T15/00H04N13/282
CPCH04N21/2187H04N21/21805H04N21/44016H04N13/282G06T3/4038G06T15/00
Inventor 张晖李吉媛赵海涛孙雁飞朱洪波
Owner NANJING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap