Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Prediction method of user fixation point in 360-DEG panoramic VR video

Inactive Publication Date: 2018-08-28
PLEX VR DIGITAL TECH CO LTD
View PDF5 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] In order to solve the existing problems, the present invention aims to provide a method for predicting the user's gaze point in a 360-degree panoramic VR video

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Prediction method of user fixation point in 360-DEG panoramic VR video
  • Prediction method of user fixation point in 360-DEG panoramic VR video
  • Prediction method of user fixation point in 360-DEG panoramic VR video

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] The present invention will be further described now in conjunction with accompanying drawing.

[0026] see figure 2 , figure 2 Shown is an effect comparison diagram of an embodiment of the present invention, assuming a series of video frames of a given 360-degree VR video ( figure 2 2 groups are given with 4 frames each), V 1:t ={v 1 ,v 2 ,...,v t}, and the gaze point position of the pth user watching this video where l t =(x t ,y t ), x t and y t They are the latitude and longitude coordinates respectively, and the value range is x t ∈[0,360],y t ∈[-90,90], t∈[1,4] and is a positive integer. In this embodiment, firstly, the above video frames and gaze point positions are collected as a sample set. see figure 1 , and then build an artificial neural network. The artificial neural network is a convolutional neural network and a recursive neural network, including a trajectory encoding module, a significance encoding module and a difference prediction m...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a prediction method of a user fixation point in a 360-DEG panoramic VR video. The method comprises the following steps: acquiring a sample set about a video frame and a fixation point location when a past user watches a specific video; establishing an artificial neural network which comprises a track coding module, a significance coding module and a difference prediction module; inputting the sample set into the artificial neural network to train, thereby obtaining a fixation point prediction location with the minimum Euclidean distance with the actual fixation point location of the user. Through the prediction method disclosed by the invention, the 360-DEG space environment is actively explored, the possible fixation point of the future user can be predicted by using the past fixation point, the error value is small, and a video maker can utilize the fixation point more sufficiently.

Description

technical field [0001] The invention relates to the technical field of virtual reality (VR), in particular to a method for predicting a user's gaze point in a 360-degree panoramic VR video. Background technique [0002] At present, 360-degree panoramic VR videos have attracted widespread attention and interest, and YouTube and Facebook have provided many high-quality 360-degree videos. [0003] For 360-degree panoramic VR videos, we propose the task of gaze point prediction. This task is to predict the position of the next user's gaze point based on the gaze point information watched by users in the past. The task of gaze point prediction has a wide range of applications. For example, if you know where the user will pay attention to next, you can place an advertisement or some other information there; in addition, the level difficulty design of the game can be more flexible. If you want to reduce the difficulty, we can place it on the player's next gaze point. Some rewards...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04N13/383H04N21/442G06N3/04
CPCH04N21/44218G06N3/045
Inventor 高盛华虞晶怡
Owner PLEX VR DIGITAL TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com