Marker Image Search in Virtual Space for Immersive AR
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional image processing systems that use marker images to combine virtual objects with captured images lack engagement and interest, as they only display virtual objects at the position of the marker in the captured image without providing an immersive experience.
Innovation Solution
An image processing system that includes a first information processing apparatus for displaying a virtual space and a second apparatus for displaying real-space images, allowing users to change viewpoints and interactively search for marker images within the virtual space, enabling the combination of virtual objects with captured images based on marker detection.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a virtual object is displayed at the position of the marker image in the captured image, then the virtual object can be combined with the captured image, but the display lacks engagement and interest
Solution Approach 1:
The patent introduces a virtual space dimension beyond the flat captured image. Users can move viewpoints in three-dimensional space to search for marker images, transforming the experience from simple 2D overlay to immersive 3D exploration. This dimensional expansion creates engagement while maintaining manageable system complexity through virtual camera positioning.
Solution Approach 2:
The system implements dynamic viewpoint movement within the virtual space, allowing users to change observation positions and search for markers interactively. This dynamic exploration transforms the static marker display into an engaging search experience, where users actively navigate through virtual space rather than passively viewing fixed overlays.
2Adaptability or versatility
If users can change viewpoints in virtual space to search for marker images, then user engagement is enhanced, but the system complexity increases
Solution Approach 1:
The first information processing apparatus serves multiple functions: it generates the virtual space, positions marker images within it, and handles viewpoint control for searching. This multi-functionality consolidates complexity into a single system rather than distributing it across multiple devices, making the enhanced interactivity achievable without proportionally increasing overall system complexity.
Solution Approach 2:
The patent introduces a virtual space as an intermediary between the captured image and the user. This virtual environment acts as a mediator that enables interactive viewpoint changes and marker searching without requiring direct manipulation of the captured image itself, thus providing adaptability while managing system complexity through abstraction.
3Ease of operation
If a panoramic image with wide viewing angle is used for virtual space, then immersive experience is improved, but the area of the image to be processed increases
Solution Approach 1:
The panoramic virtual space is segmented into different viewpoint positions and observation directions. Rather than processing the entire 360-degree panorama simultaneously, the system divides the virtual space into manageable sectors corresponding to different camera positions, allowing immersive experience while reducing the processing area at any given moment.
Solution Approach 2:
The system uses partial action by displaying only the relevant portion of the panoramic virtual space needed for the current viewpoint and marker search. Instead of rendering and processing the entire panoramic image at full resolution, it focuses computational resources on the current field of view, maintaining immersion while reducing processing area.
Data Source
AI summary
A marker image that, if included in a captured image captured by an image capturing apparatus, performs image processing on the captured image and is thereby allowed to cause a predetermined virtual object to appear is placed in a virtual space. Then, a viewpoint for displaying a part of the virtual space on a display apparatus is changed in accordance with a user input, and the virtual space viewed from the viewpoint is displayed on the display apparatus.