Panoramic video browsing interaction method
A panoramic video and interactive method technology, applied in the field of panoramic video feature extraction and navigation, can solve problems such as user misses, achieve the effects of improving pleasure and understanding, simplifying operation difficulty, and enhancing positioning capabilities
Pending Publication Date: 2022-05-24
BEIHANG UNIV
View PDF0 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
In summary, these methods can only generate a single virtual camera path so that users miss important content outside the screen, or need to manually specify a fixed candidate window instead of automatically generating a virtual camera path
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0016] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided for a thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes, and are not intended to limit the protection scope of the present disclosure.
[0017] In addition, it should be noted that, for the convenience of description, only the parts related to the related invention are shown in the drawings. The embodiments of this disclosure and features of the embodiments may be combined with each other without conflict.
[0018] It should be noted that the modif...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The embodiment of the invention discloses a panoramic video browsing interaction method. The specific embodiment of the method comprises the following steps: down-sampling an input panoramic video; a saliency estimation method and an object detection method are used for the panoramic video after down-sampling, and a saliency score is generated; using an optical flow estimation method for the panoramic video after down-sampling to generate an optical flow; according to the main virtual camera, the preset number of sub virtual cameras, the significance score and the optical flow, virtual camera motion path information is generated in combination with a dynamic programming algorithm so as to perform smooth switching; and providing the panoramic video and the motion path information of the virtual camera to an interactive interface. According to the implementation mode, a user can perceive important information displayed by the sub-window while watching the content displayed by the main window on the two-dimensional screen, and the content of the sub-window is smoothly switched to the main window at any time, so that the perception degree of watching panoramic video content on the two-dimensional screen by the user is remarkably improved; and the difficulty of interaction between the user and the panoramic video is greatly reduced.
Description
technical field [0001] Embodiments of the present disclosure relate to the technical field of image processing, and in particular, to panoramic video feature extraction and navigation technologies. Background technique [0002] Today, with the help of commercial mobile 360° cameras such as Insta360 ONE X and RICOH Theta, 360° video shooting has become very easy and popular. Users can freely rotate their heads to explore interesting content in the video while watching 360° videos through head-mounted display devices (eg, HTC Vive and Oculus Rift). However, head-mounted displays are not widespread. In contrast, another more common way to experience 360° video is to watch by manipulating an NFoV (Normal Field of View) window on a two-dimensional screen. In this way, the user needs to manually change the current viewing angle through the mouse or touch screen to adjust the viewing content, and this interactive way will reduce the viewing pleasure and increase the operation burd...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/269G06V10/46G06F9/451
CPCG06T7/269G06F9/451G06T2207/10016
Inventor 汪淼李奕君张文煊
Owner BEIHANG UNIV