Gaze-Based Viewpoint Generation for Spherical Video
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Manually setting viewpoints for visual content with a greater field of view than can be viewed within a single viewpoint is difficult and time-consuming, especially when the direction of interest changes during playback due to movement in spherical images or videos.
Innovation Solution
A system and method that generates viewpoints for visual content based on gaze directions of human subjects within the content, using processors to determine and adjust viewing directions and extents of view based on gaze analysis, allowing for automatic alignment of the visual content with the subjects' lines of sight.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If manual viewpoint setting is used for spherical visual content, then viewpoint precision can be controlled, but the process becomes extremely time-consuming and inefficient
Solution Approach 1:
The system performs automatic viewpoint determination by analyzing gaze directions of human subjects within the visual content itself. The computer automatically identifies multiple viewpoints by detecting where human subjects are looking, eliminating the need for manual viewpoint setting while maintaining precision through algorithmic analysis of subject attention patterns.
2Device complexity
If fixed viewpoints are used for spherical visual content, then device complexity is reduced, but the system cannot follow moving events or changing directions of interest
Solution Approach 1:
The system determines multiple viewpoints dynamically based on the progress length of the video and changing gaze directions of human subjects. As the video progresses and subjects look at different locations, the system automatically updates the set of determined viewpoints to follow moving events and changing directions of interest, making the viewpoint control adaptive rather than static.
Solution Approach 2:
The system uses gaze direction analysis of human subjects as feedback to automatically adjust and determine appropriate viewpoints. By continuously monitoring where subjects look within the spherical visual content, the system receives real-time feedback about which regions are of interest and automatically determines viewpoints that follow these attention patterns.
3Reliability
If multiple viewpoints are manually configured to cover all events, then completeness of coverage is improved, but the complexity and time required for configuration increases significantly
Solution Approach 1:
The system automatically determines multiple viewpoints by analyzing gaze directions of human subjects within the visual content. Rather than requiring manual configuration of numerous viewpoints to cover all events, the system self-service determines the appropriate set of viewpoints by identifying where human subjects are looking, ensuring complete event coverage while eliminating configuration complexity.
Data Source
AI summary
Visual information defining visual content may be accessed. The visual content may include one or more views of one or more scenes. The scene(s) may include one or more human subjects. Gaze directions of the human subject(s) may be determined. The gaze directions may indicate one or more viewing directions in which the human subject(s) are looking. One or more directions of view for the visual content may be determined based on the gaze directions of the human subject(s). The direction(s) of view may include one or more of the viewing directions looked at by the human subject(s). The visual content may be presented on a display based on the direction(s) of view for the visual content.