Viewpoint switching method and system for multi-viewpoint video

A multi-view video and switching system technology, applied in the field of video playback, can solve problems such as time point delay, and achieve the effect of improving user experience and improving playback fluency.

Active Publication Date: 2021-07-27
FENGHUO COMM SCI & TECH CO LTD
View PDF10 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

During the sending process, the CDN server generally has a buffer area for temporarily storing video data, and the terminal also has a buffer area for temporarily storing video data. The total length of video content in the CDN server and terminal buffer may reach the second level or even ten seconds. There will be a large delay between the content played by the terminal and the content currently processed by the CDN server

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Viewpoint switching method and system for multi-viewpoint video
  • Viewpoint switching method and system for multi-viewpoint video
  • Viewpoint switching method and system for multi-viewpoint video

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0049] figure 2 It is a business scene architecture diagram of multi-viewpoint video playback in the embodiment of the present invention. The present invention adopts a multi-viewpoint video end-to-end system, which is divided into two parts: live broadcast and on-demand broadcast. , compressed and encoded by the encoding server, and then streamed and packaged by the CDN server, and sent to the terminal; while the on-demand content is directly injected into the CDN server as a file, processed by the CDN server, and then sent to the terminal after being streamed and packaged.

[0050] During the live broadcast, the camera array collects raw video data collected by a total of x cameras. When the encoding server compresses and encodes, such as image 3 As shown, an IDR frame is generated for each channel of video code stream at a period of n seconds, that is, each channel of video has an IDR frame at each time node of n seconds, that is, the length of the GOP (Group of Pictures)...

Embodiment 2

[0058] like Figure 4 As shown, it is a viewpoint switching method of a multi-viewpoint video in an embodiment of the present invention, including:

[0059] S1. After receiving the user's view switching request, the terminal checks whether there is an IDR frame within the preset duration of the terminal's local cache content of the current view;

[0060] S2. If there is an IDR frame in the preset duration of the terminal local cache content of the current viewpoint, add the time point of the IDR frame to the viewpoint switching request, and report to the server;

[0061] S3. If there is no IDR frame within the preset duration of the terminal local cache content of the current viewpoint, and the cache content is longer than the preset duration, add a time point after the preset duration to the viewpoint switching request, and report to the server;

[0062] S4. If there is no IDR frame within the preset duration of the terminal local cache content of the current viewpoint, and ...

Embodiment 3

[0067] When the terminal receives a command from the user to switch viewpoints, it checks the time stamp information of the extension field of each frame for the content locally cached by the terminal. If there is an IDR frame within the preset duration (for example, m milliseconds) of the terminal locally cached content of the current viewpoint, the The time point of the IDR frame is added to the view switching request and reported to the CDN server; if there is no IDR frame within m milliseconds of the terminal local cache content of the current view, and the cache content is greater than m milliseconds, the time point after m milliseconds is added to the view switching request , report to the CDN server; if there is no IDR frame within the preset duration of the terminal local cache content of the current viewpoint, and the cache content is less than m milliseconds, add the time point at the end of the terminal local cache to the view switching request and report to the CDN s...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a viewpoint switching method of a multi-viewpoint video, comprising: after receiving a viewpoint switching request, a terminal checks whether there is an IDR frame within a preset duration of the terminal local cache content of the current viewpoint; if there is an IDR frame within the preset duration, Then add the time point of the IDR frame to the viewpoint switching request and report to the server; if there is no IDR frame within the preset duration and the cache content is greater than the preset duration, then add the time point after the preset duration to the viewpoint switching request and report to the server ; If there is no IDR frame within the preset duration, and the cache content is less than the preset duration, then add the time point at the end of the cache to the view switching request and report to the server; clear the local cache of the terminal after the time point in the viewing point switching request reported to the server. The invention realizes the alignment of time stamps of different viewpoints in multi-viewpoint video switching, so that the connection of front and rear viewpoints is synchronized in time. The invention also discloses a corresponding viewpoint switching system of multi-viewpoint video.

Description

technical field [0001] The invention belongs to the technical field of video playback, and more particularly relates to a method and system for switching viewpoints of multi-viewpoint videos. Background technique [0002] Multi-view video is obtained by shooting the same scene or object from different positions and angles by a camera array composed of multiple cameras, such as figure 1 As shown, compared with single-view video, multi-view video can provide information from multiple angles of the same scene or object, enabling people to obtain a richer visual experience. The multi-viewpoint video data collected by the camera array is transmitted to the CDN (Content Delivery Network, Content Distribution Network) server after being encoded by the encoding server, and the video is streamed by the CDN server and sent to the user terminal (such as a TV set-top box, PC, mobile phone Wait). When watching through the terminal, the user can freely switch the viewpoints in the multi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04N21/81H04N21/433H04N21/231H04N21/6587H04N21/8547H04N21/218
CPCH04N21/21805H04N21/23106H04N21/4331H04N21/6587H04N21/816H04N21/8547
Inventor 田路夏洪升
Owner FENGHUO COMM SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap