Display Control Apparatus for Virtual Viewpoint Occlusion Handling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems for generating virtual viewpoint images from multiple physical cameras struggle with accurately designating and displaying the virtual camera position and point of gaze, particularly in complex environments where occlusions occur, making it difficult for users to intuitively understand the virtual camera's position and gaze direction.
Innovation Solution
A display control apparatus and method that includes a system for acquiring and processing user input to generate virtual viewpoint information, allowing for the display of virtual viewpoint objects, point of gaze objects, and projected point of gaze objects, with the ability to correct the virtual viewpoint position to avoid occlusions and display these objects semi-transparently to enhance visibility.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the virtual viewpoint position is designated in complex environments with occlusions, then the virtual viewpoint image can be generated, but the user cannot intuitively understand the virtual camera position and gaze direction due to occlusions
Solution Approach 1:
The patent introduces intermediary visual elements (viewpoint indicator showing virtual camera position, gaze indicator showing point of gaze, and reference line connecting them) that mediate between the complex occluded environment and the user's understanding. These indicators act as visual mediators that clarify the virtual camera's position and orientation even when the actual scene is occluded.
Solution Approach 2:
The patent employs color changes and visual property modifications of the indicators (such as making them semi-transparent or adjusting their appearance) to enhance visibility and distinguishability in complex environments. This helps users perceive the indicators clearly without them being obscured by the surrounding occluded scene elements.
2Loss of information
If indicators are displayed in occluded areas, then position information is provided, but the indicators become difficult to see due to occlusions
Solution Approach 1:
The indicators are designed with specific visual properties including semi-transparency and color characteristics that allow them to remain visible when positioned in or near occluded areas. The visual properties are adjusted to ensure detectability against various background conditions.
Solution Approach 2:
The indicators serve as intermediary visual elements that bridge the gap between occluded position information and user perception. Even when placed in occluded areas, they maintain visibility through their design as distinct visual mediators that draw user attention.
3Loss of information
If multiple indicators are displayed simultaneously, then comprehensive position and gaze information is provided, but the display becomes complex and harder to interpret
Solution Approach 1:
The patent segments the information display into distinct, functionally separate indicators: a viewpoint indicator for camera position, a gaze indicator for point of gaze, and a reference line showing the relationship between them. This segmentation organizes complex information into manageable, individually understandable components.
Solution Approach 2:
The patent adds a spatial dimension to the display by showing the reference line that connects the viewpoint and gaze indicators, creating a visual representation of the camera's orientation in 3D space. This dimensional approach helps users understand the spatial relationship without requiring complex textual or numerical data.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A display control apparatus (130) acquires information indicating virtual viewpoint information including a position of a point of gaze, which is a position gazed at from a virtual viewpoint, wherein the virtual viewpoint corresponds to a virtual viewpoint image that is generated based on a plurality of images captured by a plurality of imaging apparatuses (110), and displays an image (600) including a point of gaze object (602) indication the position of the point of gaze and a projected point of gaze object (603) indicating a position of the point of gaze on a projection plane.