Gaze-Based BIM Retrieval in Mixed Reality for On-Site Building Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional BIM technology faces challenges in portability, requires high professional skills, and struggles to intuitively integrate digital models with actual construction sites, leading to inefficient and complex information retrieval.
Innovation Solution
Integrating eye tracking and mixed reality (MR) technologies to enable users to retrieve building information by gazing at specific components, displaying relevant details in real-time through a MR device.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If conventional BIM technology is used on construction sites, then building information can be accessed, but the portability is limited and the process is time-consuming
Solution Approach 1:
The patent replaces manual mechanical searching through paper drawings and digital files with an automated eye-tracking system. The eye tracker automatically detects which building component the user is looking at and retrieves corresponding information, eliminating the need for manual navigation through BIM software interfaces and significantly reducing information retrieval time.
Solution Approach 2:
The system enables self-service information retrieval where the BIM model and information panel automatically respond to user gaze without requiring manual queries. When the eye tracker detects the user is looking at a specific building component, the system automatically displays relevant information, making the information retrieval process autonomous and efficient.
2Ease of operation
If BIM technology is used to visualize building information, then understanding of drawing information is enhanced, but the integration with physical environment is challenging
Solution Approach 1:
The patent merges the digital BIM model with the physical construction environment by overlaying virtual building components onto their corresponding physical locations. The eye tracker captures the user's line of sight, identifies the physical building component being viewed, and displays associated BIM information, creating an integrated augmented reality experience that combines digital and physical domains.
Solution Approach 2:
The eye-tracking system serves as an intermediary that bridges the physical construction site and the digital BIM model. By detecting the user's gaze direction and mapping it to corresponding building components, the eye tracker enables natural interaction between the physical environment and digital information without requiring complex manual operations.
3Productivity
If conventional BIM software interface is used, then building information can be retrieved, but high professional skills are required and operation is complex
Solution Approach 1:
The patent replaces complex manual operations required by conventional BIM software interfaces with automated eye-tracking technology. Instead of requiring users to navigate through software menus, search functions, and layer configurations, the system automatically detects the user's visual focus and retrieves corresponding building information, eliminating the need for professional software operation skills.
Data Source
AI summary
A method for retrieving in-situ building information based on visual gaze is disclosed, including: extracting and optimizing a building information model; obtaining gaze data; aligning the BIM model with a physical structure of the building through a spatial anchors technology; and wearing MR device for on-site building information retrieval. Based on MR technology, the present invention provides a visual gaze retrieval method for building information with real building components as the carrier. The MR technology is used to link and bind the digital information of building components with the physical entities of building components; the eye tracking technology is used to perform the visual information retrieval of building components. Users can rapidly obtain relevant building information, such as material properties and design parameters, by gazing at real building components, which improves the efficiency of on-site work and brings significant improvement and convenience to the construction industry.