Gaze-Tracking Robot Projects Secondary Video Feed
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current gaming systems limit the user's visual experience to a display device, restricting the ability to interact with a virtual space beyond the display's visual area, as previous solutions fail to provide a seamless and spatially aware second screen projection.
Innovation Solution
A system comprising a computing device and a companion robot that captures the user's gaze direction and projects a secondary video feed onto a surface in the local environment, allowing the user to view the virtual space from different angles by changing the projection based on the user's gaze direction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If a display device is used to view the virtual space, then the user can see the video game content, but the visual area is limited to the display device's screen
Solution Approach 1:
The patent extends the viewing experience from a two-dimensional display screen to three-dimensional space by projecting the video feed onto surfaces in the local environment. The projector casts images onto walls, ceilings, or other surfaces around the user, transforming the confined 2D visual experience into an immersive 3D spatial experience that utilizes the entire room as the display area.
Solution Approach 2:
The system uses a mobile robot that can perform multiple functions: navigating to different locations, capturing user gaze direction with cameras, processing images to determine gaze direction, and projecting video feeds onto various surfaces. This multi-functional robot replaces what would otherwise require separate devices for each function, reducing overall system complexity while expanding visual area.
2Adaptability or versatility
If the projection is fixed on one surface, then the setup is simple, but the user cannot interact with the virtual space from different angles
Solution Approach 1:
The system dynamically adapts the projection location and orientation based on the user's real-time gaze direction. The mobile robot continuously tracks where the user is looking and adjusts the projection accordingly, allowing the user to interact with the virtual space from different angles. This dynamic behavior provides versatility without requiring complex manual configuration.
Solution Approach 2:
The system implements a feedback loop where the camera captures the user's gaze direction, the controller processes this information to determine where the user is looking, and the projector adjusts its output accordingly. This closed-loop feedback system enables the projection to automatically adapt to user preferences and viewing angles, providing versatility through intelligent response rather than complex setup.
3Extent of automation
If the second screen projection is not spatially aware, then the system is simpler, but the projection does not respond to user gaze direction
Solution Approach 1:
The system performs self-service by automatically tracking the user's gaze direction and adjusting the projection without requiring manual input or configuration. The camera and controller work together to autonomously determine where the user is looking and dynamically reposition the projection to match the user's viewing direction, creating an automated, responsive experience.
Solution Approach 2:
The patent replaces manual mechanical adjustment of projection surfaces with an automated optical and computational system. Instead of physically moving the projector or adjusting angles manually, the system uses image capture devices to detect gaze direction and computationally determines the appropriate projection orientation, substituting mechanical complexity with sensor-based automation.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A system is provided, including the following: a computing device that executes a video game and renders a primary video feed of the video game to a display device, the primary video feed providing a first view into a virtual space; a robot, including, a camera that captures images of a user, a projector, and, a controller that processes the images of the user to identify a gaze direction of the user; wherein when the gaze direction of the user changes from a first gaze direction that is directed towards the display device, to a second gaze direction that is directed away from the display device, the computing device generates a secondary video feed providing a second view into the virtual space; wherein the controller of the robot activates the projector to project the secondary video feed onto the projection surface in the local environment.