Head-Mounted Device Real-World Content Capture for Early Design Defect Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current virtual reality technologies in industrial design require extensive time to create 3D models, leading to design defects often being discovered only in late stages, as they do not efficiently capture real-world information for early-stage evaluation.
Innovation Solution
A method using a head-mounted device with a display, optical camera, and control circuit to capture real-world content, track feature points, and generate adjustable virtual objects within a virtual environment, allowing for early identification of design defects by projecting the moving track of feature points onto real-world content to define planes and capture image information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional VR technologies are used to create 3D models, then design evaluation can be performed in virtual environment, but the process takes large amount of time and design defects cannot be found in early stages
Solution Approach 1:
The system performs preliminary scanning and capture of real-world objects to create initial 3D models automatically, eliminating the time-consuming manual modeling process. The optical camera captures images from multiple angles and automatically generates 3D models before detailed design work begins, enabling early-stage evaluation.
Solution Approach 2:
The system creates accurate digital copies of real-world objects by scanning their physical forms. These copies preserve the original geometry and can be directly used for virtual evaluation, eliminating the need for manual 3D modeling while maintaining measurement precision.
2Manufacturing precision
If manual 3D model establishment is performed, then accurate virtual models can be created, but the process requires large amount of time and cannot support early-stage design iteration
Solution Approach 1:
The system replaces manual mechanical modeling processes with automated optical scanning and computer vision algorithms. The optical camera and processing circuit automatically capture geometric information and generate 3D models, substituting time-consuming manual operations with rapid automated systems that maintain high precision.
Solution Approach 2:
The system changes the parameters of model creation by using photogrammetry and structured light scanning techniques instead of manual modeling. This allows the capture of high-precision geometric data in seconds rather than hours, dramatically increasing design productivity while maintaining accuracy.
3Ease of operation
If real-world tools and materials are used for design modification, then intuitive design improvements can be made, but the results cannot be evaluated in true size until prototype completion
Solution Approach 1:
The system transitions the design evaluation from physical space to virtual space by projecting captured real-world content into a virtual environment. Designers can manipulate virtual models in 3D space while maintaining accurate size relationships, preserving size perception information that would be lost in traditional 2D sketching or small-scale models.
Solution Approach 2:
The system introduces a virtual reality environment as an intermediary between physical design tools and final prototype evaluation. This intermediary allows designers to use intuitive digital manipulation tools while maintaining accurate size and proportion representation, bridging the gap between early-stage design and final prototype evaluation.
4Loss of time
If scaled-down models are used for design review, then early evaluation is possible, but design defects cannot be detected due to size differences
Solution Approach 1:
The system creates full-scale virtual copies of design objects instead of scaled-down physical models. These digital twins maintain the true dimensions and geometric details of the actual objects, enabling detection of design defects that would be invisible in scaled models while providing immediate virtual evaluation.
Data Source
AI summary
A method for capturing real-world information into a virtual environment is provided. The method is suitable for a head-mounted device (HMD) located in a physical environment, and includes the following operations: providing the virtual environment, wherein a real-world content within the virtual environment is captured from a part of the physical environment corresponding to a perspective of the HMD; tracking a feature point which located within the physical environment and moved by a user, so as to define a selected plane of the real-world content by projecting a moving track of the feature point onto the real-world content; capturing image information corresponding to the selected plane; and generating a virtual object having an appearance rendered according to the image information, in which the virtual object is adjustable in size.