Virtual Viewpoint Marker Positioning via Plane of Interest
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In virtual viewpoint images, additional information such as markers can be displayed at unintended positions when the viewpoint is changed, and it is challenging to accurately input and render such information in three-dimensional space.
Innovation Solution
An image processing system that converts two-dimensional marker inputs to three-dimensional marker objects using a plane of interest, ensuring the marker remains appropriately positioned relative to the virtual viewpoint and photographic subject, even when the viewpoint changes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a marker is added to a virtual viewpoint image at a specific position, then the marker is displayed correctly at the current viewpoint, but the marker is displayed at an unintended position when the viewpoint is switched
Solution Approach 1:
The patent introduces a plane of interest in three-dimensional space to anchor the marker position. Instead of defining the marker position solely in two-dimensional image space, the plane of interest provides a three-dimensional reference framework that maintains marker accuracy across viewpoint changes. The plane is defined by a position and normal vector in 3D space, creating a stable reference that transcends viewpoint variations.
Solution Approach 2:
The plane of interest acts as an intermediary between the marker input and the three-dimensional virtual space. By projecting the marker onto this intermediate plane, the system establishes a reliable mapping relationship that preserves marker position accuracy regardless of viewpoint changes. The plane serves as a mediator that translates 2D marker inputs into consistent 3D positions.
2Ease of operation
If additional information is input to a two-dimensional virtual viewpoint image, then the information is displayed at the input position, but it is difficult to input information to the appropriate three-dimensional position
Solution Approach 1:
The plane of interest serves as an intermediary that bridges simple 2D marker input and precise 3D position placement. Users can input markers on the 2D image, and the system automatically maps these to accurate 3D positions on the plane, combining operational simplicity with positioning precision.
Solution Approach 2:
The patent introduces the plane of interest as a three-dimensional construct with position and orientation information. This 3D plane acts as a reference surface that guides the conversion of 2D marker inputs into accurate 3D positions, adding dimensional context without complicating the input process.
Data Source
Figure 1A~1B
Figure 2A~2B
Figure 3A~3D
AI summary
An image processing apparatus obtains an input of additional information to a two-dimensional virtual viewpoint image that is based on a three-dimensional virtual space and a virtual viewpoint in the virtual space, sets a plane of interest on which the additional information is to be located in the virtual space, in a range according to the virtual viewpoint in the virtual space, converts the additional information to an object to be located at a three-dimensional position in the virtual space by projecting the input additional information to the plane of interest, and causes a display to display the virtual viewpoint image that is based on the virtual space in which the object is located at the three-dimensional position.