AR Marker Detection for Shared Virtual Space Without Line of Sight
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality technologies require other client devices to be within the camera's field of view to share a common virtual space, limiting the ability to share virtual information among users when images of those devices are not included in the captured image.
Innovation Solution
An information processing apparatus with an image recognition unit to detect a marker image, a spatial recognition unit to construct a real-world coordinate system, and a virtual object display unit to place virtual objects in the shared coordinate system, allowing virtual objects to be displayed and shared regardless of the device's position or orientation relative to the camera.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If position information of other client devices is acquired based on shape information and positions included in captured images, then the system can determine device locations, but other client devices must be inside the camera's field of view to share virtual space
Solution Approach 1:
The patent introduces a server as an intermediary that collects and manages position information from multiple client devices. Instead of requiring direct visual detection between devices, the server acts as a central hub that receives position data from each device and distributes it to others, enabling virtual space sharing without camera field of view constraints
Solution Approach 2:
The patent replaces the optical/mechanical system of camera-based visual detection with an electronic communication system. Position information is transmitted via communication interfaces and processed through coordinate system transformations, eliminating the need for physical line-of-sight between devices
2Measurement precision
If a real-world coordinate system is constructed from marker image position and orientation, then accurate virtual object placement is achieved, but the system requires direct camera viewing of the marker
Solution Approach 1:
The patent transforms the problem from 2D image plane coordinates to 3D real-world coordinate system. By constructing a real-world coordinate system from marker detection and transforming positions between these coordinate systems, the system achieves accurate virtual object placement while allowing devices to be positioned at various angles and distances from the marker
3Adaptability or versatility
If virtual objects are placed in a shared real-world coordinate system, then multiple users can share the same virtual space, but complex coordinate system construction and transformation is required
Solution Approach 1:
The patent creates a universal real-world coordinate system that serves multiple functions: it enables position tracking, orientation determination, virtual object placement, and inter-device communication. This single coordinate system framework handles all spatial relationships among multiple users and devices, reducing the need for separate processing systems
Data Source
AI summary
An information processing apparatus comprising an image recognition unit that detects whether an image preset as a marker image exists in a captured image; a spatial recognition unit that, when the marker image is detected by the image recognition unit, constructs a real-world coordinate system computed from a position and orientation of the marker image, and computes information corresponding to a position and orientation of the information processing apparatus in the constructed real-world coordinate system; and a virtual object display unit that acquires at least one of the data stored in the storage unit, data existing on a network, and data transmitted from the one or more other information processing apparatuses and received by the communication interface, places the acquired data in the constructed real-world coordinate system, and controls the display unit to display the acquired data as one or more virtual objects.