Viewpoint switching method and system for multi-viewpoint video

A multi-view video and switching system technology, applied in the field of video playback, can solve problems such as time point delay, and achieve the effect of improving user experience and improving playback fluency.

Active Publication Date: 2020-07-03
FENGHUO COMM SCI & TECH CO LTD
View PDF13 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

During the sending process, the CDN server generally has a buffer area for temporarily storing video data, and the terminal also has a buffer area for temporarily storing video data. The total length of video conte

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Viewpoint switching method and system for multi-viewpoint video
  • Viewpoint switching method and system for multi-viewpoint video
  • Viewpoint switching method and system for multi-viewpoint video

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0048] Example 1

[0049] figure 2 This is a business scenario architecture diagram of multi-view video playback in an embodiment of the present invention. The present invention adopts a multi-view video end-to-end system, which is divided into two parts: live broadcast and on-demand. The live broadcast uses the camera array to collect the multi-view video content of the object in real time. , The encoding server performs compression encoding, and then the CDN server performs streaming and packaging, and sends it to the terminal; while the on-demand content is directly injected into the CDN server as a file, processed by the CDN server, and then streamed and packaged before being sent to the terminal.

[0050] During the live broadcast process, the camera array collects raw video data collected by a total of x cameras. When the encoding server performs compression encoding, such as image 3 As shown, IDR frames are generated for each video stream with a period of n seconds, that is...

Example Embodiment

[0057] Example 2

[0058] Such as Figure 4 Shown here is a method for switching viewpoints of a multi-view video in an embodiment of the present invention, including:

[0059] S1. After receiving the user viewpoint switching request, the terminal checks whether there are IDR frames within the preset time period of the content cached locally by the terminal of the current viewpoint;

[0060] S2. If there is an IDR frame in the local cache content of the terminal of the current viewpoint for a preset period of time, the time point of the IDR frame is added to the viewpoint switching request and reported to the server;

[0061] S3. If there is no IDR frame within the preset time period of the local cache content of the terminal of the current viewpoint, and the cache content is greater than the preset time period, the time point after the preset time period is added to the viewpoint switching request and reported to the server;

[0062] S4. If there is no IDR frame within the preset time ...

Example Embodiment

[0066] Example 3

[0067] When the terminal receives the user's command to switch viewpoints, it checks the extended field timestamp information of each frame for the content cached locally by the terminal. If there are IDR frames in the local cache content of the current viewpoint for the preset duration (for example, m milliseconds), it will The time point of the IDR frame is added to the viewpoint switching request and reported to the CDN server; if there is no IDR frame within m milliseconds of the local cache content of the terminal of the current viewpoint, and the cache content is greater than m milliseconds, the time point after m milliseconds is added to the viewpoint switching request , Report to the CDN server; if there is no IDR frame within the preset time period of the local cache content of the terminal of the current viewpoint, and the cache content is less than m milliseconds, the time point at the end of the terminal’s local cache is added to the viewpoint switch...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a viewpoint switching method of a multi-viewpoint video, which comprises the following steps: after a terminal receives a viewpoint switching request, checking whether an IDR frame exists in the local cache content of the terminal of the current viewpoint within a preset duration; if the IDR frame exists in the preset duration, adding the time point of the IDR frame into the viewpoint switching request, and reporting the viewpoint switching request to a server; if the IDR frame does not exist in the preset duration and the cache content is greater than the preset duration, adding a time point after the preset duration into the viewpoint switching request, and reporting the viewpoint switching request to a server; if the IDR frame does not exist in the preset duration and the cache content is less than the preset duration, adding the time point of the cache tail end into the viewpoint switching request, and reporting the viewpoint switching request to a server; and emptying the terminal local cache after the time point in the viewpoint switching request of the reporting server. According to the invention, alignment of timestamps of different viewpoints in multi-viewpoint video switching is realized, so that connection of front and rear viewpoints is synchronized in time. The invention further discloses a corresponding viewpoint switching system for the multi-viewpoint video.

Description

technical field [0001] The invention belongs to the technical field of video playback, and more particularly relates to a method and system for switching viewpoints of multi-viewpoint videos. Background technique [0002] Multi-view video is obtained by shooting the same scene or object from different positions and angles by a camera array composed of multiple cameras, such as figure 1 As shown, compared with single-view video, multi-view video can provide information from multiple angles of the same scene or object, enabling people to obtain a richer visual experience. The multi-viewpoint video data collected by the camera array is transmitted to the CDN (Content Delivery Network, Content Distribution Network) server after being encoded by the encoding server, and the video is streamed by the CDN server and sent to the user terminal (such as a TV set-top box, PC, mobile phone Wait). When watching through the terminal, the user can freely switch the viewpoints in the multi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04N21/81H04N21/433H04N21/231H04N21/6587H04N21/8547H04N21/218
CPCH04N21/21805H04N21/23106H04N21/4331H04N21/6587H04N21/816H04N21/8547
Inventor 田路夏洪升
Owner FENGHUO COMM SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products