Voice-Activated XR BIM Mapping for Marker-Free Construction Targeting
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality systems in construction sites rely on markers for position recognition, which are difficult to attach and maintain due to the dynamic nature of construction sites, leading to challenges in accurately displaying XR content.
Innovation Solution
A wearable electronic device with sensors and a processor that maps BIM data to a user's field of view, using voice-based inputs to identify targets and display XR content without markers, adjusting for user motion and orientation, and anticipating future targets based on BIM data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If markers are used for position recognition in construction sites, then augmented reality content can be displayed, but the markers are difficult to attach and maintain due to the dynamic nature of construction sites
Solution Approach 1:
The patent removes the marker component entirely from the system, extracting the position recognition function from the marker-dependent approach and implementing it through direct environmental feature recognition and BIM data mapping, thereby eliminating the operational burden of marker attachment and maintenance
Solution Approach 2:
The patent replaces the mechanical marker attachment system with a digital recognition system that uses sensors, cameras, and BIM data mapping to achieve position recognition, substituting physical marker-based mechanics with computational and optical methods
2Adaptability or versatility
If markers are installed on objects in construction sites, then all types of objects can be recognized, but the markers need to be directly recognized and re-attached after various processes are completed
Solution Approach 1:
The patent performs preliminary action by pre-mapping BIM data to the construction site environment and pre-identifying objects and their positions before actual use, storing this information for rapid retrieval and display without requiring real-time marker attachment
Solution Approach 2:
The patent creates a universal position recognition system that can identify any object in the construction site through BIM data mapping and environmental feature recognition, rather than requiring specific markers on each object, making the system adaptable to all objects without re-attachment
3Ease of operation
If voice-based input is used to call targets, then user interaction is simplified, but the system must accurately convert speech to text and identify the correct target
Solution Approach 1:
The patent implements feedback by providing visual confirmation of the identified target through augmented reality display, allowing the user to verify whether the spoken command was correctly interpreted and the correct target selected, enabling correction if needed
Data Source
AI summary
The present disclosure relates to an electronic device of wearable form worn on a user's head and outputting XR content in front of the user including a sensing unit including at least one sensor a display unit, and a processor configured to map BIM data of a construction site in which the user is located to a space within a user's field of view based on sensing information sensed and obtained from the sensing unit, control such that the XR content corresponding to a target is displayed on the display unit, based on a call signal of the target in relation to the construction site being included in a voice-based input signal received from the sensing unit.