Augmented Reality Texture Mapping for Immersive Virtual Object Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality game systems fail to provide a realistic experience as virtual objects appear to exist and move within a real space, lacking a sense of immersion due to their two-dimensional representation.
Innovation Solution
A computer-readable storage medium with an information processing program that captures real-world images, positions and moves virtual objects based on real-world topography, maps real-world textures onto virtual objects, and displays these in a way that simulates the virtual objects' presence in the real world, allowing users to interact with a dynamically deformed environment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If virtual objects are displayed on a two-dimensional plane, then the system complexity is reduced, but the user cannot feel a sense of reality as if virtual objects exist and move in real space
Solution Approach 1:
The patent transitions from two-dimensional display to three-dimensional virtual space representation. Virtual objects are positioned and moved in a three-dimensional virtual space that corresponds to the real-world environment, allowing users to perceive depth and spatial relationships. This dimensional change enables the virtual objects to appear as if they truly exist and move within the real space, resolving the contradiction between simplicity and realism.
Solution Approach 2:
The patent creates a virtual copy of the real-world environment by capturing images with an imaging device and generating a virtual space that replicates the real-world topography and characteristics. This virtual copy allows virtual objects to interact with the environment in a realistic manner while maintaining system manageability, as the virtual space is a representation rather than a direct simulation of all physical constraints.
2Reliability
If virtual objects are moved in a three-dimensional virtual space, then the user experience and sense of reality are improved, but the computational resources and processing complexity increase
Solution Approach 1:
The patent performs preliminary actions by capturing real-world images and pre-processing them to create the virtual space representation before virtual objects begin to move. The virtual space is prepared in advance with the correct topology and characteristics, so that when virtual objects are positioned and moved, the computational burden is reduced compared to real-time generation of the entire environment. This preliminary preparation enables immersive 3D movement while managing computational energy consumption.
Data Source
AI summary
A moving object and a topography object having a portion with different heights are positioned in a virtual space, and the moving object is controlled so as to move on the topography object. A real world image is obtained from an imaging device, and a position and an orientation of a marker in the real world image are detected. On the basis of a result of the detection, a virtual camera is positioned in the virtual space, and a moving object and a topography object are rendered on the basis of the virtual camera. Here, the real world image obtained from the imaging device is used as a texture for the topography object. The rendered moving object and the topography object are synthesized on the real world image and a synthesized image is displayed on a display device.