Gesture BIM modeling method based on AR

Abstract

The invention discloses a gesture BIM modeling method based on AR, and relates to the technical field of intelligent construction of constructional engineering. Comprising the following steps: step 1, hardware preparation: AR glasses, an AR glasses host or a desktop computer host, a power supply case and a Bluetooth keyboard; the system further comprises an AR modeling software APP interaction system. 2, the modeling process comprises the steps of A, data acquisition and preprocessing; b, identifying and explaining gestures; c, building and rendering a BIM model; d, model interaction and editing; according to the method, the user can perform BIM modeling in the AR environment through natural gestures, so that the modeling efficiency and intuition are improved, and the technical problem that components such as a peripheral handle are inconvenient to operate intelligently is solved.

Description

Technical Field

[0001] The present invention relates to the technical field of intelligent construction of construction projects, and particularly to a gesture BIM modeling method based on AR. Background Art

[0002] As a brand-new computer application technology, BIM technology has been widely promoted and applied worldwide. Compared with traditional building design application software, users can directly use three-dimensional models for design, which has brought qualitative changes to the design progress, design cost, and design scope of construction projects. The advantages of BIM technology are mainly manifested in: significantly improving design efficiency, design data can be reused multiple times, the coordination of the system is enhanced, the design cost is greatly reduced, the design quality of the project is improved, the time cost is reduced, and the error rate of design and documents is reduced, etc. It can be foreseen that BIM will be more widely used in the fields of building design, construction, etc. due to its characteristics such as coordination, optimization, systematicness, simulation, visualization, and the ability to generate graphics.

[0003] The key to BIM technology is modeling. Currently, the mainstream engineering modeling software includes revit + dynamo, civil3D, Navisworks, domestic Glodon BIMmake, etc. However, modeling is a meticulous task and takes a long time.

[0004] With the continuous development of the construction industry, BIM technology is increasingly widely used in the stages of building design, construction, and management. Traditional BIM modeling is usually operated through a computer mouse and keyboard, which has problems such as complex operation, low efficiency, and lack of intuitiveness.

[0005] Currently, XR technology has emerged, mainly including VR, AR, and MR. VR is virtual reality, AR is augmented reality, and MR is mixed reality. These three XR technologies can all be used for three-dimensional visualization modeling. Regarding VR modeling, there has been some research, mainly due to its strong sense of immersion.

[0006] As a technology that combines virtual information with the real scene, AR technology provides new ideas and methods for BIM modeling. By integrating the BIM model with the real scene, users can perform modeling operations more intuitively. However, most of the existing AR-based BIM modeling methods require the use of external devices such as handles for operation, and there are still certain limitations.

[0007] Therefore, we provide a gesture BIM modeling method based on AR. Summary of the Invention

[0008] The object of the present invention is to provide an AR-based gesture BIM modeling method, enabling users to perform BIM modeling in an AR environment through natural gesture actions, thereby improving the efficiency and intuitiveness of modeling.

[0009] To solve the above technical problems, the present invention provides the following technical solutions:

[0010] An AR-based gesture BIM modeling method, comprising the following steps:

[0011] Step 1, hardware preparation: AR glasses, an AR glasses host or a desktop computer host, a power supply chassis, and a Bluetooth keyboard; it also includes an AR modeling software APP interaction system;

[0012] Step 2, the modeling process includes:

[0013] A. Data collection and preprocessing; first, start the depth camera and the IMU. The depth camera is used to collect image data of the user's gesture actions, and the IMU is used to collect the user's spatial position and attitude information; then, preprocess the collected image data and position and attitude information, including image denoising, background removal, and feature extraction, and store the preprocessed data in the data buffer for subsequent gesture recognition and parsing;

[0014] B. Gesture recognition and interpretation; the gesture recognition technology is based on the convolutional neural network architecture of deep learning; the network is trained by setting gesture sample data so that it can learn the features and patterns of different gestures; in actual applications, the collected gesture action data is input into the trained CNN model, and the model outputs the category and related parameters of the gesture;

[0015] Map the recognized gesture actions to the corresponding BIM modeling operations;

[0016] C. BIM model construction and rendering; according to the user's gesture operations, a BIM model is constructed in real time in the AR environment; use a graphics rendering engine to render the constructed BIM model to integrate it with the real scene;

[0017] D. Model interaction and editing; the user interacts with and edits the constructed BIM model through gesture actions; during the editing process, the data of the BIM model is updated in real time and saved to the database.

[0018] In a further technical solution, the AR glasses include a glasses body, spectacle lenses, an IMU inertial positioning unit, a depth camera, a lidar emission port, and a lidar camera receiving port;

[0019] The spectacle lenses are placed inside the glasses body and are arranged in two groups symmetrically distributed along the center of the glasses body; six groups of depth cameras are circumferentially distributed in a rectangular pattern on the two groups of spectacle lenses;

[0020] Two sets of IMU inertial positioning units are installed between two sets of spectacle lenses. The two sets of IMU inertial positioning units are arranged vertically, and a lidar emission port is installed between them. A lidar camera receiving port is installed at the bottom of the bottom IMU inertial positioning unit.

[0021] In a further technical solution, the AR modeling software APP interaction system includes a menu group, a user operation model, an absolute reset button, and a relative reset button; the menu group includes a main menu, a left toolbar, and a right toolbar;

[0022] The left toolbar and the right toolbar are respectively arranged on both sides of the user operation model; the main menu is set at the top; and the absolute reset button and the relative reset button are arranged at both ends of the AR modeling software APP interaction system.

[0023] In a further technical solution, in the recognition and interpretation of gestures in step 2, the gesture operation: the AR glasses open the spatial modeling APP, display the left toolbar on the user's left and the right toolbar on the right, use the hand to click the main menu on the upper side, and the buttons on the left and right change, and set the main menu and the tool buttons on the side to follow eye movement.

[0024] In a further technical solution, in the recognition and interpretation of gestures in step 2, for the setting of the coordinate system, after the user looks straight ahead and presses the absolute reset button on one side of the AR glasses, an X-axis with the midpoint of the center line connecting the left and right AR glasses as the origin of the spatial coordinates is established, with the positive direction from left to right, the front and back of the origin as the Y-axis, the front is positive and the back is negative, and the up and down as the Z-axis, with the upward direction as the positive direction of the absolute coordinate system.

[0025] In a further technical solution, a relative coordinate system is adopted. The user presses the relative reset button on the other side to establish a relative coordinate system with the axis of the AR glasses. Similarly, the origin of the coordinates is the midpoint of the center line connecting the two spectacle lenses, and the coordinate system axes are the same as those of the absolute coordinates. When the AR glasses move and rotate, the relative coordinates also follow the AR glasses, and the displayed menu group, model and the relative position of the AR glasses remain unchanged.

[0026] In a further technical solution, the position of the main menu is pinched by the index finger and thumb of the hand and placed in the front or side and then moved. Then, the menu item can be clicked with the finger to display a drop-down menu, and then the menu command is clicked. When selecting a position in the modeling area, the BIM software designs a modeling coordinate system. As the index finger fingertip moves, the three-dimensional coordinates of the fingertip are displayed in different colors in front of the AR glasses, and the modeling coordinate axes are also displayed at the same time;

[0027] When the fingertip is under the modeling coordinates, a light-colored coordinate frame is displayed in front of the AR glasses. Relative to an appropriate position in front of the AR glasses, the other index finger and thumb pinch the coordinate frame and move the position;

[0028] The position where the instruction is determined to be put down is determined by the pinch of the index finger and the thumb of the finger in the coordinate system.

[0029] In a further technical solution, the AR glasses host includes a photosensitive array of a lidar camera. The photosensitive array includes laser receiving units arranged in a matrix. The laser receiving unit includes an avalanche diode and a counter. When the lidar emission port emits, the counter counts the number of quartz oscillations and stops counting in this unit when receiving laser light. The distance of each part in the gesture is calculated using the relationship between frequency and wavelength, and the phase difference between the lidar emission port and the lidar camera receiving port is added to calculate the distance of each point in the gesture model, thereby generating an accurate gesture position model.

[0030] In a further technical solution, the laser beam pulse diverges into a conical surface irradiation area through the lidar emission port, and the emission time is timed by a high-frequency quartz crystal oscillator. The lidar camera receiving port forms an image on the photosensitive array. The focusing distance of the lidar camera is adjusted by calculating the distance from the midpoint of the line connecting the left and right fingers and the midline of the spectacle lens using the model generated by the camera, and an accurate gesture position model is generated.

[0031] Compared with the prior art, the following beneficial effects are achieved:

[0032] 1. Intuitive and natural operation: The user performs BIM modeling through gesture actions without using a mouse, keyboard, or other external devices. The operation is more intuitive and natural, reducing the learning cost and operation difficulty.

[0033] 2. Improve modeling efficiency: Gesture operations are fast and flexible, which can greatly improve the efficiency of BIM modeling and shorten the modeling cycle.

[0034] 3. Enhance immersion: The BIM model is integrated with the real scene through AR technology, enabling the user to perform modeling operations as if on the spot, enhancing the user's immersion and experience.

[0035] 4. Facilitate on-site application: The AR-based gesture BIM modeling method can be applied in actual scenarios such as construction sites, facilitating construction workers to view, edit, and adjust building models, improving construction accuracy and efficiency. Description of the Drawings

[0036] Figure 1 It is a schematic flow chart of the BIM modeling method based on AR gestures;

[0037] Figure 2 It is a schematic diagram of the dedicated AR glasses used in the BIM modeling method based on AR gestures;

[0038] Figure 3 It is a display schematic diagram of gesture recognition and parsing in the present invention;

[0039] Figure 4 It is a schematic flow diagram of BIM model construction and rendering in the invention;

[0040] Figure 5 It is a schematic flow diagram of model interaction and editing in the invention;

[0041] Figure 6 It is a schematic diagram of the photosensitive array of the lidar camera.

[0042] In the figure: 1. spectacle lens; 2. IMU inertial positioning unit; 3. depth camera; 4. lidar emission port; 5. lidar camera receiving port; 6. main menu; 7. left toolbar; 8. right toolbar; 9. user operation; 10. absolute reset button; 11. relative reset button. Specific embodiments

[0043] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0044] Please refer to Figure 1-6 , the present invention provides a technical solution, an AR-based gesture BIM modeling method, including the following: Step 1, hardware preparation: AR glasses, AR glasses host or desktop computer host, power supply chassis, Bluetooth keyboard; it also includes an AR modeling software APP interaction system;

[0045] Step 2, the modeling process includes:

[0046] A. Data acquisition and preprocessing

[0047] As Figure 2 shown, first start the depth camera and IMU. The depth camera is used to collect image data of the user's gesture actions, and the IMU is used to collect the user's spatial position and attitude information. Then, preprocess the collected image data and position and attitude information, including operations such as image denoising, background removal, and feature extraction, and store the preprocessed data in the data buffer for subsequent gesture recognition and parsing.

[0048] B. Gesture recognition and parsing

[0049] As Figure 3As shown, the pre - processed gesture action data is read from the data buffer and input into a pre - trained deep - learning gesture recognition model. The gesture recognition model analyzes and recognizes the input gesture action data, and outputs the type and parameters of the gesture action. Then, the recognized gesture action type and parameters are matched with a pre - defined BIM modeling operation mapping table to determine the corresponding BIM modeling operation.

[0050] C. BIM Model Construction and Rendering

[0051] As Figure 4 shown, according to the determined BIM modeling operation, a BIM model is constructed in real - time in the AR environment. First, according to the requirements of the modeling operation, the corresponding component models are selected from the BIM component library and loaded into the memory. Then, according to the parameters of the gesture action, the component models are adjusted and transformed in terms of position, attitude, size, etc. to construct a complete BIM model. Finally, the constructed BIM model is rendered using a graphics rendering engine to integrate it with the real - world scene, presenting a realistic visual effect.

[0052] D. Model Interaction and Editing

[0053] As Figure 5 shown, users can interact with and edit the constructed BIM model through gesture actions. For example, users can select the component model to be edited through a grasping gesture, and then adjust the component model through gesture actions such as stretching, rotating, and scaling. During the editing process, the data of the BIM model is updated in real - time and saved to the database. Users can also delete the unnecessary component models through a deletion gesture, or add new component models from the component library to the BIM model through an addition gesture.

[0054] The BIM software also needs to be redesigned, including the front menu, left and right toolbars. The software also needs to support gesture, voice, and virtual keyboard input methods.

[0055] The processing accuracy requirements of the lidar camera array of this device are high. The internal quartz crystal needs to adopt a constant - temperature device to reduce the influence of temperature changes on the quartz crystal frequency. Since the AR glasses are the main display device, the calculation of spatial position requires fast response, which has high requirements for the CPU. A split - body design can be adopted. The host and the glasses are connected by a data cable. The user wears the host on the body. The host is built - in with a large - capacity lithium battery. The graphics card needs to support a three - dimensional special type. It can also be wirelessly connected to a desktop computer host, and the glasses need an external power supply.

[0056] Appendix Figure 1 is a schematic flow chart of the BIM modeling method based on AR gestures: including four processing processes: data acquisition and pre - processing, gesture recognition and interpretation, BIM model construction and rendering, and model interaction and editing.

[0057] Appendix Figure 2 Schematic diagram of the dedicated AR glasses used in the BIM modeling method based on AR gestures, including spectacle lenses 1, two groups of IMU inertial positioning units 2, six groups of depth cameras 3, lidar emission ports 4, lidar camera receiving ports 5, absolute reset buttons 10, and relative reset buttons 11. This AR glasses device is the device for data acquisition and preprocessing in the present invention, which collects and preprocesses data for gesture operations and has a built-in micro data processor.

[0058] Appendix Figure 3 Schematic diagram of gesture recognition and parsing in the present invention, including a main menu 6, a left toolbar 7, a right toolbar 8, and user operations 9. It is necessary to design a spatial BIM modeling software APP. Currently, based on AR gestures, SLAM simultaneous localization and mapping technology is adopted, mainly solving the positioning of the camera in space and the creation of a map of the environment.

[0059] Limited by the office space, the area of the desk is small. When actually using AR modeling, move the office computer away as much as possible and leave enough space on the desk.

[0060] When using gesture operations, the AR glasses open the spatial modeling APP and display the menus floating in front, behind, left, and right of the user. For convenient operation, only the tool buttons on the left and right sides of the user and the upper menu can be displayed. By clicking on the upper menu with the hand, the buttons on the left and right sides change. The menu and the side tool buttons are set to follow eye movement, that is, when the user turns the AR to the left or right, the upper menu appears in front of the eyes, and the buttons on the left and right sides are the same. The same is true when turning to the back, which is convenient for the user to operate. The space in front of the user's eyes is the modeling space, where the user can use fingers to zoom in or out the model size ratio, and can also use gestures to control the translation, rotation, etc. of the model. It can be set that the model rotates with the user's head for follow-up operation. The specific operation method is as follows:

[0061] Setting of the coordinate system: When the user is at a desk or other occasions, after looking straight ahead, press the absolute reset button on one side of the glasses to establish an absolute coordinate system with the midpoint of the connection line between the centers of the left and right glasses as the origin of the spatial coordinate system. The X-axis is from left to right with the positive direction, the Y-axis is in front and behind the origin, with the front being positive and the back being negative, and the Z-axis is up and down, with the upward direction being the positive direction. After the position is fixed, if it moves or rotates, the attitude is measured by the IMU inertial positioning component of the glasses to calculate the relative position of the glasses in the absolute coordinates. If a relative coordinate system is used, the user presses the relative reset button on the other side to establish a relative coordinate system with the axis of the glasses. Similarly, the origin of the coordinate system is the midpoint of the connection line between the centers of the two spectacle lenses, and the coordinate system axes are the same as the absolute coordinates. Only when the glasses move and rotate, the relative coordinates also follow the glasses, and the displayed menu, model, and the relative position of the glasses remain unchanged.

[0062] The main menu is in the front. The position of the main menu can be adjusted by pinching it with the index finger and thumb of the hand and placing it in a suitable position in the front or side. Then, the user can click on the menu item with a finger to display the drop-down menu. After that, click on the menu command. In a suitable position in the modeling area, the BIM software has designed a modeling coordinate system. As the fingertip of the index finger moves, the three-dimensional coordinates of the fingertip are displayed in a certain color in front of the glasses, and the modeling coordinate axes are also displayed. Of course, the modeling coordinate system adds translation and scaling parameters in the absolute and relative coordinate systems of the glasses. When the fingertip is under the modeling coordinates, a light-colored coordinate frame is displayed in front of the glasses. Relative to a suitable position in front of the glasses, the coordinate frame can also be moved to other positions by pinching it with the index finger and thumb of the other hand. When the finger pinches the index finger and thumb under the coordinate system, the position where the command is placed is determined, such as the center of the sphere when drawing a sphere. After the center position of the sphere is determined, an input sphere radius box is displayed. Another index finger clicks on the radius box, and a virtual key digital box is displayed below the radius box. After the index finger clicks on the number and then clicks the OK button, the radius is input. This AR system also supports voice input. The user can also perform modeling operations by simply speaking the commands and numbers. At the same time, it also supports Bluetooth keyboard operations. The input of text can be done using a virtual keyboard, voice input, or a virtual handwriting board. Gestures replace the mouse. Pinching the index finger and thumb can move the menu and toolbar. When the index finger moves in space, clicking on the toolbar or the model is equivalent to clicking the left mouse button, and clicking the middle finger is equivalent to clicking the right mouse button. Clicking the ring finger on the menu bar, toolbar, or model can perform movement. Bringing the two palms together once reduces the model by one scale, and separating them enlarges the model by one scale. Of course, the scale can be set using the menu. In actual use, the functions of other fingers can be redefined, and the left and right hands can cooperate to operate the modeling.

[0063] Appendix Figure 4 It is a schematic diagram of the process for constructing and rendering a BIM model in the invention, including creating a three-dimensional view of the building model, specifying the rendered appearance of the material and applying the material to the model elements, adding the required content such as plants, people, cars, and other environments, decals to the building model, defining the rendering settings, including defining lighting for the building model, rendering the image, and after completing the rendering, comparing whether it meets the requirements of the building model. If it is not suitable, modify the model and then perform the rendering comparison again. Repeat this process until it directly meets the usage requirements of the model.

[0064] Appendix Figure 5This is a schematic diagram of the process of model interaction and editing in the present invention. It mainly relies on six cameras in front of the AR glasses plus a lidar with a ranging distance of no less than 6m and an accuracy of 1mm to generate gesture and environmental entity models within a 6m range. The model generated by the cameras mainly calculates the spatial position of the object based on the distance between the centers of the two lenses and the position of the object, mainly the gesture position, and the corresponding parallax of the two images. Combined with the accurate position measured by the lidar, a spatial entity model is generated. Since the lidar uses a ranging camera to collect image distance positions, the data acquisition speed is higher than that of the line-scanning lidar. For the lidar camera, see my CN202210648899.2 "A Method for Using a Fast 3D Scanner". The real-time position model of the gesture action is generated by superimposing the color model generated by the camera and the black-and-white-gray model generated by the lidar camera, and the gesture action is accurately recognized for model building operations. The three-dimensional visualization of BIM modeling greatly improves the realism of modeling.

[0065] After the model is built, it is saved and directly compared with the spatial rendering. The rendered model is then translated and rotated to be observed from different angles, and then the model is modified and rendered again for comparison. This process continues until the model is optimal.

[0066] Appendix Figure 6 This is the photosensitive array of the lidar camera, which includes laser receiving units 12 arranged in a matrix. Avalanche diodes with fast response speeds are used for the receiving units. Each diode unit is equipped with a counter at the back. As long as the laser is emitted, each receiving unit counts the number of quartz oscillation times and stops counting when the laser is received. The distance of each part of the gesture is calculated using the relationship between frequency and wavelength. Combined with the phase difference between the laser radar emission port 4 and the lidar camera receiving port 5, the distance of each point of the gesture model is calculated to generate an accurate gesture position model. The laser beam pulse emitted by the lidar is diverged into a conical surface by the lens of the lidar emission port 4 to irradiate a large area in the front. The emission time is measured using a high-frequency quartz crystal oscillator. The image is formed on the photosensitive array by the lens of the lidar camera receiving port 5. The focusing distance of the lidar camera is adjusted by calculating the distance from the midpoint of the line connecting the left and right fingers to the midline of the lens using the model generated by the camera, with the aim of generating an accurate gesture position model.

[0067] For those skilled in the art, it is obvious that the present invention is not limited to the details of the above exemplary embodiments, and without departing from the spirit or basic characteristics of the present invention, the present invention can be implemented in other specific forms. Therefore, from any point of view, the embodiments should be regarded as exemplary and non-limiting. The scope of the present invention is defined by the appended claims rather than the above description. Therefore, all changes falling within the meaning and scope of the equivalent elements of the claims are intended to be encompassed within the present invention.

[0068] In addition, it should be understood that although this specification is described in terms of embodiments, not every embodiment contains only one independent technical solution. This narrative style of the specification is only for clarity. Those skilled in the art should regard the specification as a whole, and the technical solutions in each embodiment can also be appropriately combined to form other embodiments that can be understood by those skilled in the art.

Claims

1. A gesture BIM modeling method based on AR, characterized in that: The following steps are involved: Step 1, hardware preparation: AR glasses, AR glasses host or desktop computer host, power case, Bluetooth keyboard; also includes AR modeling software APP interactive system; Step 2: The modeling process includes: A. Data collection and preprocessing: First, start the depth camera and IMU. The depth camera is used to collect image data of the user's gestures, and the IMU is used to collect the user's spatial position and posture information. Then, the collected image data and position and posture information are preprocessed, including image denoising, background removal, and feature extraction. The preprocessed data is stored in the data buffer, waiting for subsequent gesture recognition and analysis. B. Recognition and interpretation of gestures; Gesture recognition technology is based on the convolutional neural network architecture of deep learning; the network is trained by setting gesture sample data so that it can learn the characteristics and patterns of different gestures; in actual applications, the collected gesture action data is input into the trained CNN model, and the model outputs the category and related parameters of the gesture; Mapping the recognized gestures to the corresponding BIM modeling operations; C. BIM model construction and rendering: Based on the user's gesture operation, the BIM model is constructed in real time in the AR environment; the constructed BIM model is rendered using a graphics rendering engine to integrate it with the real scene; D. Model interaction and editing: Users interact and edit the constructed BIM model through gestures; during the editing process, the data of the BIM model is updated in real time and saved in the database.

2. The AR-based gesture BIM modeling method according to claim 1, characterized in that: The AR glasses include a glasses body, glasses lenses (1), an IMU inertial positioning unit (2), a depth of field camera (3), a laser radar transmitting port (4), and a laser radar camera receiving port (5); The spectacle lenses (1) are placed in a spectacle body, and two groups are arranged symmetrically along the center of the spectacle body; six groups of depth-of-field cameras (3) are distributed in a rectangular pattern around the two groups of spectacle lenses (1); Two groups of IMU inertial positioning units (2) are installed between the two groups of eyeglass lenses (1); the two groups of IMU inertial positioning units (2) are arranged vertically, and a laser radar transmitting port (4) and a laser radar camera receiving port (5) are installed between them.

3. The AR-based gesture BIM modeling method according to claim 1, characterized in that: The AR modeling software APP interactive system comprises a menu group, a user operation model (9), an absolute reset button (10) and a relative reset button (11); the menu group comprises a main menu (6), a left toolbar (7) and a right toolbar (8); The user operation model (9) is provided with a left toolbar (7) and a right toolbar (8) on both sides; a main menu (6) is provided on the top; and an absolute reset button (10) and a relative reset button (11) are provided at both ends of the AR modeling software APP interactive system.

4. The AR-based gesture BIM modeling method according to claim 3, characterized in that: In the recognition and interpretation of gestures in step 2, gesture operation: the AR glasses open the spatial modeling APP, display the left toolbar (7) on the left side of the user and the right toolbar (8) on the right side, use the hand to click the main menu (6) on the upper side, and the buttons on the left and right sides change again, and set the main menu (6) and the tool buttons on the side to follow the eye movement.

5. The AR-based gesture BIM modeling method according to claim 4, characterized in that: In the recognition and interpretation of the gesture in step 2, the coordinate system is set. After the user looks straight ahead, he presses the absolute reset button (10) on one side of the AR glasses to establish an absolute coordinate system with the midpoint of the line connecting the centers of the left and right AR glasses as the origin of the spatial coordinate X-axis, from left to right as the positive direction, the front and back of the origin as the Y-axis, the front as positive, the back as negative, the up and down as the Z-axis, and the upward direction as the positive direction.

6. The AR-based gesture BIM modeling method according to claim 5, characterized in that: Using the relative coordinate system, the user presses the relative reset button (11) on the other side to establish a relative coordinate system based on the axis of the AR glasses. Similarly, the origin of the coordinate system is the midpoint of the line connecting the centers of the two lenses. The axis of the coordinate system is the same as the absolute coordinate. When the AR glasses move and rotate, the relative coordinates also follow the AR glasses, and the displayed menu group, model and AR glasses remain in the same relative position.

7. The AR-based gesture BIM modeling method according to claim 5, characterized in that: The position of the main menu (6) is held by the index finger and thumb and placed in the front or side position. Then the menu item can be clicked with the finger, a drop-down menu appears, and then the menu command is clicked to select a position in the modeling area. The BIM software designs a modeling coordinate system. The movement of the index finger tip will display the three-dimensional coordinates of the finger tip in different colors in front of the AR glasses, and the modeling coordinate axis will be displayed at the same time. When the fingertips are in the modeling coordinates, a light-colored coordinate frame is displayed in front of the AR glasses. Relative to the appropriate position in front of the AR glasses, the index and thumb of the other hand clamp the coordinate frame and move the position; The index finger and thumb are pinched together in the coordinate system to determine the position where the command is placed.

8. The AR-based gesture BIM modeling method according to claim 7, characterized in that: The AR glasses host comprises a photosensitive array of a laser radar camera, the photosensitive array comprises laser receiving units (12) arranged in a matrix shape, and the laser receiving units (12) comprise an avalanche diode and a counter; when the laser radar emits a port (4), the counter counts the number of quartz oscillations, and stops counting when receiving the laser, and calculates the distance of each part of the gesture using the relationship between frequency and wavelength, and calculates the distance of each point in the gesture model by adding the phase difference between the laser radar emitter port (4) and the laser radar camera receiving port (5), thereby generating an accurate gesture position model.

9. The AR-based gesture BIM modeling method according to claim 8, characterized in that: The laser beam pulse is emitted through the laser radar emission port (4) to form a conical surface irradiation area, the emission time is timed by a high-frequency quartz crystal oscillator, and the laser radar camera receiving port (5) forms an image on the photosensitive array; The laser radar camera focus distance uses the model generated by the camera to calculate the distance between the midpoint of the line connecting the left and right fingers and the midline of the eye lens to focus and generate a precise position model of the gesture.

Images