Virtual Camera Spatial Rendering for Hand-Drawn Augmented Reality
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image print creating apparatuses cannot effectively superimpose user-created images onto real spaces, resulting in a lack of natural augmented reality, as they only handle still images and do not allow users to feel that the image exists in the real world.
Innovation Solution
An information processing technique that uses a computer connected to an imaging device, input device, and display device to capture and detect images, calculate relative positions, set a virtual camera, and generate object images for display on a screen, allowing users to input and display hand-drawn images as if they exist in real space, with features like dynamic display changes based on user input and marker detection.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a still image is superimposed on a planar image obtained by photographing the user, then the makeup image can be displayed on the screen, but the user cannot feel as if the makeup image exists in the real space
Solution Approach 1:
The patent transitions from 2D planar image superimposition to 3D spatial rendering by introducing depth information and three-dimensional coordinate systems. The image processing apparatus calculates three-dimensional positions of users and renders images with depth perception, allowing users to feel as if objects exist in real space rather than merely on a flat screen.
Solution Approach 2:
The patent introduces a camera as an intermediary device to capture real-world spatial information and user positions. This camera data serves as a mediator between the virtual makeup images and the user's real-space perception, enabling accurate spatial registration and depth-aware rendering that creates natural augmented reality.
2Ease of operation
If the image is merely superimposed on the planar still image, then the processing is simple, but the user feels that two objects in different spaces are superimposed
Solution Approach 1:
The patent introduces dynamic elements to the image superimposition process by continuously tracking user positions, head movements, and camera angles in real-time. The rendering adapts dynamically to user actions and environmental changes, maintaining spatial realism while keeping the interface intuitive and easy to operate through automatic tracking and adjustment.
3Reliability
If hand-drawn images are displayed with dynamic changes based on marker detection, then the sense of reality is enhanced, but the detection and measurement complexity increases
Solution Approach 1:
The patent uses marker detection to create accurate copies of real-world spatial relationships and translates them into the virtual rendering environment. By detecting markers in the real world and copying their positional and orientational data into the three-dimensional coordinate system, the system achieves high spatial realism without requiring complex direct measurement of all environmental parameters.
Data Source
AI summary
An information processing section of a game apparatus executes a program including: a step of obtaining an image captured by an outer camera; a step of calculating, when detection of a marker is completed, a position and an orientation of a virtual camera based on a result of the marker detection; a step of obtaining hand-drawn data; a step of capturing, with the virtual camera, a fundamental polygon to which a texture is applied to generate a hand-drawn image, and displaying, on an upper LCD, an image in which the hand-drawn image is superimposed on the camera image; and a step of displaying a hand-drawn input image on a lower LCD.