System and method for implementing playback of panoramic video on mobile device

Abstract

The invention relates to a method and system for implementing playback of a panoramic video on a mobile device. The method comprises the steps of after sensing that a user acquires a selected video image by a trigger operation on a video application, creating a three-dimensional sphere in a virtual environment by using an OpenGL ES (Open Graphics Library for Embedded System); placing a camera in the three-dimensional world inside the sphere; executing a video acquiring and converting step, i.e. reading the video image at a preset speed, acquiring each frame of video image and converting the video image into texture information; executing a texture information mapping step, i.e. mapping the texture information obtained by conversion into the sphere; executing a view angle calculating step, i.e. according to a rotating angle and a camera view angle of the three-dimensional sphere, carrying out quaternion matrix calculation to obtain an actually displayed image matrix; and repeating the video acquiring and converting step, the texture information mapping step and the view angle calculating step, and acquiring a panoramic video image. Therefore, 360-degree panoramic video playback on the mobile device is implemented, and a video viewing effect is improved.

Description

technical field [0001] The invention relates to the technical field of digital media, in particular to a system and method for playing panoramic video on a mobile device. Background technique [0002] With the rapid increase in the number of mobile video users, the competition in the mobile video application market has become increasingly fierce, and users have higher and higher requirements for mobile video applications. In existing mobile video applications, a regular rectangular video image is obtained by playing the m3u8 or mp4 address and played into the application interface, but this requires that the content of the above video image must be a normal tiled rectangle screen. [0003] As we all know, panoramic video is developed and extended on the basis of 360 panoramic technology, which converts static panoramic pictures into dynamic video images, so that video viewers have a truly immersive feeling, and they are not affected by it. Time, space and geographical cons...

AI Technical Summary

Problems solved by technology

However, in existing video playback, in order to perform panoramic video playback, if a panoramic video that is not tiled to a spherical surface is placed in an ordinary player for playback, what the user sees will be a distorted Unprocessed images make it difficult to achieve a satisfactory audio-visual experience for users

Images