Panoramic video rendering method and system

A panoramic video and video source technology, applied in the field of image rendering, can solve the problems of large consumption of rendering performance in different interactive modes, regardless of the adaptability of panoramic video, and achieve the effect of avoiding playback freeze and optimizing rendering efficiency

Active Publication Date: 2021-03-09
SHANGHAI BILIBILI TECH CO LTD
View PDF15 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004]However, WebGL only provides a basic 3D graphics drawing tool, and does not consider the adaptability of panoramic video in d

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Panoramic video rendering method and system
  • Panoramic video rendering method and system
  • Panoramic video rendering method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0060] Such as figure 2 As shown, it is a flow chart of a panoramic video rendering method proposed in the first embodiment of the present application. It can be understood that the flowchart in this method embodiment is not used to limit the sequence of execution steps. Some steps in the flow chart can also be added or deleted as needed.

[0061] The method includes the following steps:

[0062] S200, acquire the current frame image from the video source, and generate texture map data, wherein, according to the viewing angle of the perspective camera, the gaze point area is determined, and the picture pixels outside the gaze point area are compared with the picture pixels in the gaze point area Render at a lower resolution.

[0063] When it is necessary to play a panoramic video on the client side, it is first necessary to obtain each frame of image from the video source, and draw and generate texture map data according to each frame of image. Each frame image update of ...

Embodiment 2

[0104] Such as Figure 7 As shown, it is a flow chart of a panoramic video rendering method proposed in the second embodiment of the present application. In the second embodiment, the panoramic video rendering method further includes step S302 on the basis of the above-mentioned first embodiment. It can be understood that the flowchart in this method embodiment is not used to limit the sequence of execution steps. Some steps in the flow chart can also be added or deleted as needed.

[0105] The method includes the following steps:

[0106] S300. Acquire the current frame image from the video source.

[0107] When it is necessary to play a panoramic video on the client side, it is first necessary to obtain each frame of image from the video source, and draw and generate texture map data according to each frame of image.

[0108] S302. Determine whether the current frame image needs to be rendered according to preset performance detection parameters. When rendering is not r...

Embodiment 3

[0124] Such as Figure 8 As shown, it is a schematic diagram of a hardware architecture of an electronic device 20 proposed in the third embodiment of the present application. In this embodiment, the electronic device 20 may include, but is not limited to, a memory 21 , a processor 22 , and a network interface 23 that may be communicatively connected to each other through a system bus. It should be pointed out that, Figure 8 Only electronic device 20 is shown with components 21-23, but it should be understood that implementing all of the illustrated components is not a requirement and that more or fewer components may instead be implemented. In this embodiment, the electronic device 20 may be the client device 2 or the panoramic video rendering device 3 .

[0125] The memory 21 includes at least one type of readable storage medium, and the readable storage medium includes a flash memory, a hard disk, a multimedia card, a card-type memory (for example, SD or DX memory, etc.)...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a panoramic video rendering method, and the method comprises the steps: obtaining a current frame image from a video source, generating texture mapping data, determining a gazepoint region according to the visual angle of a perspective camera, and generating texture mapping data; rendering the picture pixels outside the fixation point area by adopting a resolution lower than that of the picture pixels in the fixation point area; constructing a spherical rendering model, and mapping the current frame image into a three-dimensional picture according to the texture mapping data; and projecting the three-dimensional picture into a two-dimensional screen. The invention further discloses a panoramic video rendering system, an electronic device and a computer readable storage medium. Therefore, the rendering efficiency can be optimized and the playing lag can be avoided by weakening the rendering mode of the picture pixels outside the user fixation point area.

Description

technical field [0001] The present application relates to the technical field of image rendering, and in particular to a panoramic video rendering method, system, electronic device, and computer-readable storage medium. Background technique [0002] With the popularization and development of computer technology, users often need to perform panoramic video rendering on electronic devices. Input methods have become an important tool for users to interact with electronic devices. Sexual demands are getting higher and higher. [0003] Panoramic video is a video shot with a 3D camera in a full 360-degree scene. When watching a panoramic video, users can freely adjust the direction of the video up, down, left, and right, which can bring viewers a fully immersive experience. The essence of panoramic video is a spherical video. The current mainstream encoding technology does not support the processing of three-dimensional spherical video formats. Therefore, before storage and encod...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T15/00
CPCG06T15/005
Inventor 许欢谭兆歆刘浩
Owner SHANGHAI BILIBILI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap