AR Space Image Projecting System for Multi-User Sharing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality technologies do not enable multiple users to share an image projected onto real objects in the actual world from a user terminal, lacking a method for virtual image projection and display on real-world objects.

Innovation Solution

An AR space image projecting system comprising a server and user terminals with depth map acquisition, three-dimensional object specification, projected image designation, and superimposition, allowing users to project and share images on real-world objects through augmented reality, with the server registering and managing projected image information associated with three-dimensional object data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If augmented reality technology is used to display virtual objects in real space, then the immersive experience is improved, but the ability for multiple users to share projected images on real objects is not achieved

Engineering Contradiction:
Improvemulti-user sharing capabilityVSAvoidimage projection accuracy on real objects
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent introduces a server as an intermediary between user terminals and real objects. The server stores three-dimensional object information, receives projection instructions from user terminals, and manages the coordination of projected images across multiple users. This intermediary enables multi-user sharing while maintaining projection accuracy by centralizing the management of object data and projection parameters.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs preliminary actions by pre-storing three-dimensional object information on the server before actual projection occurs. Depth maps and object geometric data are prepared in advance, allowing the system to quickly and accurately project images onto real objects when multiple users are involved, without compromising precision during the actual projection phase.

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If virtual images are projected onto real objects in the actual world, then the augmented reality experience is enhanced, but the technical method for enabling multiple users to share these projections is not provided

Engineering Contradiction:
Improvecollaborative AR experienceVSAvoidsystem architecture complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments the AR system into distinct functional modules: user terminals for capturing and displaying, a server for storing and coordinating, and the real objects as projection targets. This segmentation allows multiple users to collaboratively share AR experiences while managing system complexity through clear separation of concerns, with each component having a specific, well-defined role.

Inventive Principle:
Principle #1Segmentation

3Manufacturing precision

If projected images are superimposed onto three-dimensional objects photographed by user terminals, then the realism of AR display is improved, but the method for registering and managing projection information across multiple users is not established

Engineering Contradiction:
Improveprojection positioning accuracyVSAvoidprojection data management
Core Design Contradiction:
Manufacturing precisionVSLoss of information

Solution Approach 1:

The patent creates and stores digital copies of real objects as three-dimensional data on the server. These digital models serve as templates for accurate image projection. By copying the geometric and spatial characteristics of real objects into digital form, the system achieves precise projection positioning while the server manages all projection data, preventing information loss across multiple user sessions.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS11238658B2AR space image projecting system, AR space image projecting method, and user terminal
Publication Date: 2022.02.01 SQUARE ENIX HLDG CO LTD
  • US11238658B2 patent drawing
  • US11238658B2 patent drawing
  • US11238658B2 patent drawing

AI summary

An AR space image projecting system is configured to: acquire a depth map of an area photographed by a photographing unit; specify at least one three-dimensional object existing in the area; receive designation of a projected image; receive a projection execution input in a state where the projected image is superimposed onto the three-dimensional object and the superimposed projected image is displayed; specify, when the projection execution input is received, onto what position of the three-dimensional object the projected image is projected, and register information on the projected image and information on a projected position so as to be associated with the three-dimensional object information; and superimpose the projected image on the three-dimensional object reflected on a display unit and display the three-dimensional object thus superimposed in a case where the three-dimensional object onto which the projected image is projected is photographed by the photographing unit.