Virtual Indicium Gaze Guidance for AR Cinematography
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional augmented reality (AR) systems and green screen configurations fail to effectively direct the gaze of actors in a cinematographic context, resulting in a lack of realism due to the inability to see virtual objects, leading to cumbersome coordination systems and limited two-dimensional cues.
Innovation Solution
A computer program product that determines a virtual indicium position in a physical environment by calculating the intersection of a vector originating from the user's head position and intended gaze on a virtual object, allowing a projector to display a three-dimensional virtual indicium outside the camera's field of view, enabling accurate gaze adjustment and realistic interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a display device is positioned in front of the actor to show the virtual object location, then the actor can see where to look, but the display device appears in the camera's field of view and interferes with video capture
Solution Approach 1:
The system uses an intermediary computational approach to solve the contradiction. Instead of physically placing a display device that would block the camera, the system calculates a virtual indicium position in 3D space that aligns with the actor's intended gaze direction. The projector then projects an indicium at this calculated position, which is visible to the actor but positioned such that it does not obstruct the camera's field of view. This intermediary calculation layer mediates between the actor's need for guidance and the camera's need for an unobstructed view.
Solution Approach 2:
The system transitions from a 2D display approach to a 3D spatial approach. Rather than placing a 2D display device in front of the actor (which blocks the camera), the system calculates positions in three-dimensional space and projects indicia accordingly. The vector-based calculation determines the intersection point of the gaze vector with the virtual object position, creating a 3D spatial solution that resolves the 2D field of view conflict.
2Measurement precision
If the actor looks at the display device to find the correct gaze position, then the actor can locate the virtual object, but the actor must translate between camera coordinate system and personal coordinate system, causing hunting behavior
Solution Approach 1:
The system enables self-service by directly providing gaze guidance in the actor's natural viewing direction. The vector calculation determines where the actor should be looking based on their head position and intended gaze direction, and projects the indicium exactly at that location. The actor does not need to look at a separate display device or perform coordinate transformations; the indicium appears exactly where they need to look, making the system self-adjusting and eliminating hunting behavior.
3Measurement precision
If conventional AR systems are used to register virtual objects with the physical environment, then virtual objects can be positioned accurately, but actors cannot see the virtual objects and thus cannot direct their gaze accurately
Solution Approach 1:
The system introduces an intermediary visual indicator (the projected indicium) that bridges the gap between the invisible virtual object and the actor's visual system. While the virtual object itself remains invisible to the actor (maintaining its positioned accuracy in the registered environment), the projected indicium serves as a visible mediator that indicates where the actor should direct their gaze. The indicium is positioned at the intersection of the gaze vector and the virtual object location, providing visual guidance without revealing the virtual object itself.
Data Source
AI summary
A process determines, with a processor, a virtual indicium position in a physical environment at which a virtual indicium is to be projected. The processor determines the virtual indicium position based on a point of intersection of a vector and an object within the physical environment. The vector originates at a head position of a user and is directed through a point of intended gaze on a virtual object toward the virtual indicium. Further, the processor sends, with the processor to an actuator, an instruction to adjust a position of a projector in operable communication with the actuator so that the projector projects the virtual indicium toward the virtual indicium position.