AR Video Playback Control Using Gaze and User Position
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies fail to appropriately control the stop and resume of stereoscopic video virtual object viewing based on user line of sight and distance, leading to inconsistent viewing experiences.
Innovation Solution
An information processing apparatus equipped with a processor, positioning sensor, and gaze sensor records user position and line of sight information to control playback of stereoscopic video virtual objects, allowing seamless pause and resume based on predefined ranges and angles, with optional notifications and adjustments for alignment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If stop and playback control is based on planar video virtual object viewing conditions (deviation and distance), then simple viewing control is achieved, but stereoscopic video virtual object viewing cannot be appropriately controlled
Solution Approach 1:
The patent extends the static planar viewing control to dynamic three-dimensional space control by introducing gaze direction and spatial position as time-varying parameters. The system continuously tracks user gaze and position to dynamically determine when to stop/resume playback, adapting to the user's movement in three-dimensional space rather than relying on fixed planar coordinates.
Solution Approach 2:
The patent transitions from two-dimensional planar video control to three-dimensional spatial control by incorporating gaze direction vectors and spatial position coordinates. This dimensional expansion enables the system to handle stereoscopic video viewing by considering the user's position and orientation in three-dimensional space, not just their location relative to a fixed screen.
2Adaptability or versatility
If playback control is based on camera position and posture information, then video creation functionality is achieved, but user line of sight and distance-based control is not possible
Solution Approach 1:
The patent makes the system multi-functional by integrating both video creation capabilities (using camera position and posture data) and user viewing control (using gaze direction and distance measurements). The same processing apparatus handles both recording camerawork data for video creation and detecting user gaze/position for playback control, eliminating the need for separate systems.
Solution Approach 2:
The patent introduces gaze direction and user position as intermediary parameters that bridge the gap between camera-based video creation data and user-based viewing control. These intermediary measurements translate camera coordinates into user-centric spatial information, enabling the system to control playback based on where the user is looking and their distance from the virtual object.
3Device complexity
If no gaze direction and distance detection is implemented, then device complexity is reduced, but appropriate stop and resume timing cannot be determined
Solution Approach 1:
The patent implements self-service by having the system automatically detect user gaze direction and position, then autonomously determine when to stop and resume playback without requiring additional sensors or complex processing. The existing camera and processing units are utilized to perform both video creation and viewing control functions, eliminating the need for separate specialized sensors.
Data Source
AI summary
In an information processing apparatus that is worn by a user and is used and an information processing method, a stereoscopic video virtual object is played back, the played video virtual object is disposed and displayed to be superimposed on a real object, and user information including at least one of a disposition position where the video virtual object is disposed, a position of the user, and a direction of a line of sight of the user is recorded. When it is detected that the user has moved out of a range that is a predetermined distance away from the disposition position, the playback of the video virtual object is stopped. When the user enters the range after the playback of the video virtual object is stopped, the playback of the video virtual object is resumed on the basis of the recorded user information.