Mixed Reality Controller for 3D Model Creation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for creating mixed reality experiences face challenges due to the cost, accuracy, and availability of CAD models, as well as the labor-intensive process of reverse engineering, especially when no 3D model exists for preexisting equipment, and existing technologies like Placenote require stable physical object locations.
Innovation Solution
A method and system using a mixed reality controller to define a coordinate system frame of reference, additional points, and interface elements of a target object, generating a 3D model and metadata for creating mixed reality experiences, allowing for the creation of viable digital objects that can be spatially and contextually overlaid in the real world, independent of the object's location.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If CAD models are used to replicate physical objects in mixed reality, then the initial accuracy is good, but the models become obsolete when equipment is upgraded or modified
Solution Approach 1:
The system performs preliminary actions by capturing the current state of physical equipment through point clouds and 3D scanning before modifications occur. This creates a baseline digital representation that can be subsequently updated, allowing the system to adapt to equipment upgrades or modifications while maintaining accurate representations.
Solution Approach 2:
The system changes parameters by transitioning from static CAD models to dynamic point cloud representations that can be updated. The point cloud data structure allows for parameter changes in the digital representation to match physical equipment modifications, resolving the obsolescence issue while maintaining measurement precision.
2Adaptability or versatility
If reverse engineering is used to create 3D models of physical objects, then models can be created without CAD data, but the process is costly and labor-intensive
Solution Approach 1:
The system substitutes manual reverse engineering processes with automated 3D scanning technology. Portable scanners and mobile mapping systems replace labor-intensive measurement methods, dramatically reducing the time required to create accurate 3D models of preexisting equipment while maintaining versatility in modeling various object types.
Solution Approach 2:
The system creates accurate digital copies of physical objects through point cloud capture and photogrammetry. These digital replicas can be generated rapidly from physical scans, enabling the creation of 3D models for preexisting equipment without requiring time-consuming reverse engineering processes.
3Adaptability or versatility
If 3D scanning equipment is used to create point clouds, then models can be created without CAD data, but the process is laborious and requires further contextual manipulation
Solution Approach 1:
The system merges multiple data capture methods (laser scanning, structured light scanning, photogrammetry) into a unified point cloud representation. This integration allows different scanning technologies to work together, reducing the complexity of the overall workflow while maintaining the ability to create accurate models of diverse physical objects.
Solution Approach 2:
The system achieves universality by creating a standardized point cloud data structure that can represent various types of physical objects regardless of the scanning method used. This multi-functional approach allows the same processing pipeline to handle data from different scanning technologies, reducing workflow complexity while maintaining versatility.
4Ease of operation
If Placenote technology is used for 3D annotations, then annotations can be placed in physical space, but the system requires physical objects to remain in fixed locations
Solution Approach 1:
The system performs preliminary actions by capturing the spatial relationships and contextual information of physical objects before they move. The point cloud data records the original positions and orientations, enabling the system to track and update annotations even when objects are relocated, thus maintaining ease of operation while increasing adaptability to object movement.
Data Source
AI summary
The invention relates to creating actual object data for mixed reality applications. In some embodiments, the invention includes using a mixed reality controller to (1) define a coordinate system frame of reference for a target object, the coordinate system frame of reference including an initial point of the target object and at least one directional axis that are specified by a user of the mixed reality controller, (2) define additional points of the target object, and (3) define interface elements of the target object. A 3D model of the target object is generated based on the coordinate system frame of reference, the additional points, and the interface elements. After receiving input metadata for defining interface characteristics for the interface elements displayed on the 3D model, the input metadata is sued to generate a workflow for operating the target object in a mixed reality environment.