MR Play Area Mapping for Cross-Room 3D Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In remote communication using mixed reality (MR), a 3D model of one user may appear to be partly sticking into a wall in the room of another user due to differing room sizes, as existing technologies set play areas based on the walls of the first user's room without considering the second user's environment.
Innovation Solution
An image processing apparatus determines individual play areas for both users based on the three-dimensional shapes of their respective environments, comparing wall-to-wall distances to establish a range that avoids the 3D model from appearing to stick into walls, using techniques like Visual SLAM and object detection algorithms to identify room dimensions and set boundaries.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If the play area is set based on the first user's room walls only, then the setup process is simple, but the 3D model may appear to stick into the second user's walls due to room size differences
Solution Approach 1:
The system performs preliminary actions by obtaining environment information from both users before setting the play area. The image processing apparatus collects room dimension data from both the first and second users' environments in advance, then uses this information to pre-calculate appropriate play area parameters that will work for both users, preventing the sticking issue before it occurs
Solution Approach 2:
The system implements feedback by using the second user's environment information to adjust and optimize the play area settings for the first user. The apparatus compares room size data from both users and uses this feedback to determine play area parameters that ensure the 3D model will not appear to stick into the second user's walls
2Manufacturing precision
If the play area is set to accommodate both users' room sizes, then the 3D model positioning is accurate, but the system complexity increases
Solution Approach 1:
The system extracts only the essential information needed for play area determination from the users' environments. Instead of processing complete environment maps or detailed room models, the apparatus extracts key parameters such as room dimensions and wall positions from both users' environments, using only this extracted data to set the play area parameters
Solution Approach 2:
The image processing apparatus performs multiple functions using a unified approach: it obtains environment information, determines room sizes, calculates play area parameters, and adjusts 3D model positioning all through a single integrated process that handles both users' environments simultaneously, reducing overall system complexity
Data Source
AI summary
An image processing apparatus of the present disclosure is an image processing apparatus for performing remote communication between a first user and a second user present in an environment different from an environment of the first user, including: an obtaining unit configured to obtain first environment information being information for determining three-dimensional shapes of surroundings around the first user, and second environment information being information for determining three-dimensional shapes of surroundings around the second user; and a determination unit configured to determine a play area for at least one of the first user and the second user for the remote communication based on the first environment information and the second environment information obtained by the obtaining unit.