Mixed Reality Space Sharing via Regional 3D Data Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current mixed reality space sharing systems require users to pre-sense every corner of a large real space for MR terminals to recognize 3D information, leading to lengthy processing times and inefficient information sharing.

Innovation Solution

A system comprising multiple MR terminals and a shared information management server, where one terminal senses and uploads 3D information and anchor data, allowing other terminals to download and create a synchronized mixed reality space without pre-sensing, and periodic updates of only changed data are transmitted to maintain accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If users pre-sense every corner of a large real space for MR terminals to recognize 3D information, then the accuracy of the mixed reality space is improved, but the processing time becomes excessively long

Engineering Contradiction:
Improve3D information accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary sensing of the real space by one or more MR terminals before actual use. The sensed 3D information is stored in advance on the server, so when users need to access the mixed reality space, the 3D information is already prepared and can be quickly downloaded without requiring real-time sensing of every corner.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system divides the real space into multiple regions or zones. Instead of sensing the entire large space at once, MR terminals can sense and process smaller regions separately. The server stores and manages 3D information for each region, allowing users to download only the specific regions they need rather than the entire space, thereby reducing processing time while maintaining accuracy for the required areas.

Inventive Principle:
Principle #1Segmentation

2Productivity

If 3D information is shared across multiple MR terminals, then collaborative work efficiency is improved, but network bandwidth consumption increases

Engineering Contradiction:
Improvecollaborative work efficiencyVSAvoidnetwork bandwidth
Core Design Contradiction:
ProductivityVSLoss of energy

Solution Approach 1:

The server stores 3D information in a distributed manner, organizing it by spatial regions. Each MR terminal downloads only the 3D information for the specific regions it needs to access, rather than downloading the entire space data. This allows collaborative work across multiple terminals while each terminal consumes network bandwidth only for its local viewing requirements.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The server creates and stores copies of 3D information for different regions. When multiple MR terminals need to access the same mixed reality space, they can download copies of the relevant regional data from the server rather than transmitting the entire dataset between terminals, reducing overall network bandwidth consumption while enabling efficient collaboration.

Inventive Principle:
Principle #26Copying

3Area of stationary object

If the entire real space is sensed in advance, then complete coverage of the mixed reality space is achieved, but the data storage requirement becomes excessively large

Engineering Contradiction:
Improvecoverage areaVSAvoiddata storage
Core Design Contradiction:
Area of stationary objectVSQuantity of substance

Solution Approach 1:

The system segments the large real space into multiple smaller regional zones. Each zone's 3D information is stored separately on the server. This allows the system to provide complete coverage of the entire space by combining multiple regional datasets, while each individual terminal only needs to store and download the specific regional data it requires, reducing the storage burden on individual devices.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Instead of requiring every MR terminal to sense and store the entire real space, the system allows terminals to download only the partial 3D information for the specific regions they need to access. This partial action approach achieves complete coverage capability across the network while keeping individual terminal storage requirements manageable.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS12182946B2Mixed reality space sharing system, sharing information management server, mixed reality terminal, mixed reality space sharing method, and sharing information management program
Publication Date: 2024.12.31 NIPPON TELEGRAPH & TELEPHONE CORP
  • US12182946B2 patent drawing
  • US12182946B2 patent drawing
  • US12182946B2 patent drawing

AI summary

A mixed reality space sharing system is provided with which 3D information regarding a target real space can be shared between a plurality of MR terminals while keeping the information updated, without spending a long processing time. A shared information management server includes an information management unit for creating a room by associating, with each other, 3D information and anchor information that are transmitted from a first terminal, which is at least one of a plurality of mixed reality terminals, and managing the 3D information, and a sharing unit for transmitting the 3D information and the anchor information to a second terminal different from the first terminal. The second terminal downloads the 3D information and the anchor information transmitted from the shared information management server and creates a mixed reality space using the downloaded information.