Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Viewpoint switching method and system for multi-viewpoint video

A multi-view video and switching system technology, applied in the field of video playback, can solve problems such as time point delay, and achieve the effect of improving user experience and improving playback fluency.

Active Publication Date: 2020-07-03
FENGHUO COMM SCI & TECH CO LTD
View PDF13 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

During the sending process, the CDN server generally has a buffer area for temporarily storing video data, and the terminal also has a buffer area for temporarily storing video data. The total length of video content in the CDN server and terminal buffer may reach the second level or even ten seconds. There will be a large delay between the content played by the terminal and the content currently processed by the CDN server

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Viewpoint switching method and system for multi-viewpoint video
  • Viewpoint switching method and system for multi-viewpoint video
  • Viewpoint switching method and system for multi-viewpoint video

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0049] figure 2 It is a business scene architecture diagram of multi-viewpoint video playback in the embodiment of the present invention. The present invention adopts a multi-viewpoint video end-to-end system, which is divided into two parts: live broadcast and on-demand broadcast. , compressed and encoded by the encoding server, and then streamed and packaged by the CDN server, and sent to the terminal; while the on-demand content is directly injected into the CDN server as a file, processed by the CDN server, and then sent to the terminal after being streamed and packaged.

[0050] During the live broadcast, the camera array collects raw video data collected by a total of x cameras. When the encoding server compresses and encodes, such as image 3 As shown, an IDR frame is generated for each channel of video code stream at a period of n seconds, that is, each channel of video has an IDR frame at each time node of n seconds, that is, the length of the GOP (Group of Pictures)...

Embodiment 2

[0058] Such as Figure 4 As shown, it is a viewpoint switching method of a multi-viewpoint video in an embodiment of the present invention, including:

[0059] S1. After receiving the user's view switching request, the terminal checks whether there is an IDR frame within the preset duration of the terminal's local cache content of the current view;

[0060] S2. If there is an IDR frame in the preset duration of the terminal local cache content of the current viewpoint, add the time point of the IDR frame to the viewpoint switching request, and report to the server;

[0061] S3. If there is no IDR frame within the preset duration of the terminal local cache content of the current viewpoint, and the cache content is longer than the preset duration, add a time point after the preset duration to the viewpoint switching request, and report to the server;

[0062] S4. If there is no IDR frame within the preset duration of the terminal local cache content of the current viewpoint, a...

Embodiment 3

[0067] When the terminal receives a command from the user to switch viewpoints, it checks the time stamp information of the extension field of each frame for the content locally cached by the terminal. If there is an IDR frame within the preset duration (for example, m milliseconds) of the terminal locally cached content of the current viewpoint, the The time point of the IDR frame is added to the view switching request and reported to the CDN server; if there is no IDR frame within m milliseconds of the terminal local cache content of the current view, and the cache content is greater than m milliseconds, the time point after m milliseconds is added to the view switching request , report to the CDN server; if there is no IDR frame within the preset duration of the terminal local cache content of the current viewpoint, and the cache content is less than m milliseconds, add the time point at the end of the terminal local cache to the view switching request and report to the CDN s...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a viewpoint switching method of a multi-viewpoint video, which comprises the following steps: after a terminal receives a viewpoint switching request, checking whether an IDR frame exists in the local cache content of the terminal of the current viewpoint within a preset duration; if the IDR frame exists in the preset duration, adding the time point of the IDR frame into the viewpoint switching request, and reporting the viewpoint switching request to a server; if the IDR frame does not exist in the preset duration and the cache content is greater than the preset duration, adding a time point after the preset duration into the viewpoint switching request, and reporting the viewpoint switching request to a server; if the IDR frame does not exist in the preset duration and the cache content is less than the preset duration, adding the time point of the cache tail end into the viewpoint switching request, and reporting the viewpoint switching request to a server; and emptying the terminal local cache after the time point in the viewpoint switching request of the reporting server. According to the invention, alignment of timestamps of different viewpoints in multi-viewpoint video switching is realized, so that connection of front and rear viewpoints is synchronized in time. The invention further discloses a corresponding viewpoint switching system for the multi-viewpoint video.

Description

technical field [0001] The invention belongs to the technical field of video playback, and more particularly relates to a method and system for switching viewpoints of multi-viewpoint videos. Background technique [0002] Multi-view video is obtained by shooting the same scene or object from different positions and angles by a camera array composed of multiple cameras, such as figure 1 As shown, compared with single-view video, multi-view video can provide information from multiple angles of the same scene or object, enabling people to obtain a richer visual experience. The multi-viewpoint video data collected by the camera array is transmitted to the CDN (Content Delivery Network, Content Distribution Network) server after being encoded by the encoding server, and the video is streamed by the CDN server and sent to the user terminal (such as a TV set-top box, PC, mobile phone Wait). When watching through the terminal, the user can freely switch the viewpoints in the multi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04N21/81H04N21/433H04N21/231H04N21/6587H04N21/8547H04N21/218
CPCH04N21/21805H04N21/23106H04N21/4331H04N21/6587H04N21/816H04N21/8547
Inventor 田路夏洪升
Owner FENGHUO COMM SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com