3D Cursor Positioning via Depth Map Lookup
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing display control technologies require complex calculations to accurately position objects in a virtual space based on user input, increasing processing burdens and complicating the display of objects at designated positions.
Innovation Solution
A display control program that uses image generating, acquisition, calculation, and object arranging means to calculate and display objects in a three-dimensional virtual space without complex calculations by utilizing depth values from images taken by a virtual camera, allowing for easy positioning and orientation of objects based on user input.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If geometric calculation methods are used to determine virtual space position based on touch position, then positioning accuracy is improved, but calculation complexity increases
Solution Approach 1:
The patent uses depth map images as a copy of the virtual space scene to directly obtain depth information without complex geometric calculations. The depth map serves as a pre-calculated representation of spatial relationships, allowing the system to query position information by simple image coordinate mapping rather than performing real-time ray casting or intersection calculations with 3D models.
Solution Approach 2:
The depth map is generated in advance as part of the normal rendering pipeline, preparing spatial information before it is needed for object placement. This preliminary calculation of depth values for all pixels eliminates the need for complex on-demand geometric computations when the user designates a position, as the spatial data is already available in the pre-rendered depth map.
2Measurement precision
If complex geometric calculations are performed to calculate straight lines and intersection points, then positioning precision is improved, but processing time increases
Solution Approach 1:
The depth map provides a pre-computed copy of spatial depth information that can be directly queried using simple 2D coordinate mapping. Instead of performing time-consuming 3D geometric calculations to find intersection points, the system simply reads the depth value at the corresponding 2D screen coordinate from the depth map, dramatically reducing processing time while maintaining positioning precision.
Solution Approach 2:
The patent replaces complex mechanical-style geometric calculations (ray casting, intersection computation) with a simpler data lookup operation. The depth map transforms the problem from a computational geometry task into a straightforward image processing task, where position information is obtained by sampling pixel values rather than solving mathematical equations.
3Productivity
If depth values from images are used to calculate virtual space positions, then processing burden is reduced, but calculation accuracy may be compromised
Solution Approach 1:
The depth map is generated using the same virtual camera parameters and projection matrix as the main scene rendering, ensuring that the depth values accurately represent the true 3D spatial relationships. This copying approach preserves measurement precision because the depth map is not an approximation but a direct rendering of the scene's geometric data in a different format.
Solution Approach 2:
The patent substitutes complex forward geometric calculations with inverse projection using pre-rendered depth values. The depth map contains accurate depth information encoded in the image data, and by using the relationship between image coordinates and 3D space through the known camera parameters, the system achieves accurate position calculation through simpler mathematical operations.
Data Source
Figure 1
Figure 2A~2D
Figure 3
AI summary
A game apparatus acquires a designated position Q, on an image, which corresponds to a touch position T detected by a touch panel, and a depth value of the designated position Q. A game apparatus calculates a designated three-dimensional position P in a three-dimensional virtual space, based on the designated position Q on the image and the depth value. The game apparatus next determines an orientation of a cursor object to arrange the cursor object at the calculated designated three-dimensional position P. The game apparatus next uses a virtual camera to take an image of the virtual space including the cursor object, and displays the image on an upper LCD.