AR Simulation System for Marker-Free Character Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing MR and AR systems fail to achieve effective interaction between virtual characters and users in real space, and they rely on dedicated markers for character placement, which is problematic. Additionally, these systems do not effectively utilize real space information for character appearance.
Innovation Solution
A simulation system that acquires real space information through image capturing, generates a virtual space corresponding to the real space, sets a reference point based on user and real space information, and disposes a character object in the virtual space. The system also sets a hit volume based on the user's position and performs processes with respect to the character based on the positional relationship between the hit volume and the character when the user inputs a command.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If dedicated markers are disposed in real space to enable character appearance, then character placement is enabled, but system complexity and user burden increase
Solution Approach 1:
The patent extracts the marker requirement from the system by enabling character placement through direct recognition of real space features (walls, floors, ceilings) without requiring dedicated markers. The AR device uses its imaging section to capture and process real space information, eliminating the need for separate marker disposal infrastructure.
Solution Approach 2:
The system performs self-service by using the AR device's own imaging capabilities to capture real space information and automatically generate three-dimensional map data. The device serves itself by processing its captured images to identify placement positions, eliminating the need for external marker disposal systems.
2Ease of operation
If real space information is not effectively utilized, then system simplicity is maintained, but character interaction suitability deteriorates
Solution Approach 1:
The patent applies preliminary action by performing real space recognition and generating three-dimensional map information before character placement. The AR device captures images, processes them to create spatial maps, and identifies suitable placement positions in advance, enabling appropriate character interaction without losing real space information.
Solution Approach 2:
The system implements feedback by continuously utilizing real space information captured through the imaging section to adjust and optimize character placement positions. The processed three-dimensional map data provides feedback on the real space structure, enabling the system to select placement positions that ensure suitable character interaction.
3Measurement precision
If three-dimensional map information is generated from captured images, then real space recognition accuracy is improved, but processing time and computational load increase
Solution Approach 1:
The patent applies partial action by processing only the necessary portions of captured images to generate three-dimensional map information sufficient for character placement. The image processing section selectively extracts relevant spatial features and generates map data at appropriate resolution levels, avoiding excessive processing while maintaining recognition accuracy.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A simulation system includes an information acquisition section that acquires real space information obtainable by performing a recognition process of a real space around a user and user information including position information of the user; a virtual space generation section that generates a virtual space corresponding to the real space based on the real space information; an object processing section that sets a reference point in the virtual space based on the user information and the real space information, and disposes an object of a character in the virtual space based on the reference point; and a display processing section that performs a process of displaying an image including an image of the character in a display section. The object processing section sets a hit volume based on a position of a user moving body in the virtual space corresponding to the user, and performs a process with respect to the character in accordance with a positional relationship between the hit volume and the character when the user performs a given input.