Construction method based on augmented reality

Abstract

The content of the present disclosure relates to a construction method based on augmented reality (AR). The construction method comprises: establishing a communication connection between an AR device and a ranging apparatus; acquiring a construction drawing of a target object; by means of the AR device, projecting a construction trajectory map associated with the construction drawing onto a scene where the target object is located; the ranging apparatus measuring the target object along a projection route, so as to acquire measurement data of the target object; and on the basis of the measurement data and design data of the target object, calibrating the projection of the target object in the scene. By means of the construction method in the content of the present disclosure, a communication connection can be established between an AR device and a ranging apparatus, and the projection of an target object in a scene can then be calibrated, and thus the ability to optimize a composite AR image can be further enhanced under the AR technique and using the ranging apparatus, and construction can be made more accurate.

Description

An Augmented Reality-Based Construction Method Technical Field

[0001] This disclosure relates to the field of augmented reality technology, and more specifically to an augmented reality-based construction method. Background Technology

[0002] In existing technologies, Augmented Reality (AR) technology integrates a computer-generated virtual environment with the user's surrounding real environment using optoelectronic display technology, interactive technology, multiple sensor technologies, and computer graphics and multimedia technologies. This allows the user to perceive and believe that the virtual environment is a component of their real environment. Augmented Reality features new characteristics such as virtual-real integration, real-time interaction, and 3D registration.

[0003] Augmented reality (AR) technology can be used for navigation during construction, i.e., pre-obtaining blueprints and guiding construction through AR. However, AR guidance lacks precision and can cause errors (for example, AR may instruct you to move 5 meters from point A to point B, but the actual distance between points A and B may be more or less than 5 meters, e.g., you may have actually moved 5.05 meters). This can lead to insufficient construction accuracy and distortion of the composite scene generated by AR technology.

[0004] Utility Model Content

[0005] To address the technical problems existing in the prior art, namely the lack of accuracy in traditional augmented reality (AR)-based navigation or display technologies, the inventors of this disclosure innovatively conceived of connecting and optimizing AR devices and ranging devices based on augmented reality (AR) technology. This allows for the calibration of the projection of the target object in the real-world scene based on measurement data and the corresponding design data of the target object, thereby optimizing the composite AR image and making construction more precise.

[0006] To achieve the aforementioned technical effects, this disclosure proposes an augmented reality-based construction method, which includes:

[0007] Establish a communication connection between augmented reality devices and ranging devices;

[0008] Obtain the construction drawings of the target object;

[0009] The construction trajectory map associated with the construction drawings is projected onto the scene where the target object is located via the augmented reality device;

[0010] The target object is measured along the projection path using a ranging device to obtain measurement data of the target object; and

[0011] The projection of the target object in the scene is calibrated based on the measurement data and the design data of the target object.

[0012] In this way, the augmented reality-based construction method disclosed herein can establish a communication connection between the augmented reality device and the ranging device, and then calibrate the projection of the target object in the scene based on the measurement data and the design data of the target object. This enables the ranging device to further enhance the ability to optimize composite AR images under augmented reality (AR) technology, and makes the construction more precise.

[0013] In the technical solution according to this disclosure, the construction method further includes: acquiring dimensional data associated with a predetermined construction trajectory map; and marking the construction trajectory map based on the dimensional data using a ranging device. This method enables the marking of dimensional data associated with the construction trajectory map, thereby enhancing the ability to optimize composite AR images using a ranging device and making construction more precise.

[0014] In the technical solution according to this disclosure, the construction method further includes: drawing an actual trajectory map associated with the real-world scene based on the measurement data of the ranging device. In other words, the technical solution according to this disclosure can generate an actual trajectory map of the ranging device based on the measurement data of the ranging device, and provides data assurance for optimizing the AR display accuracy of augmented reality devices using this actual trajectory map.

[0015] In the technical solution according to this disclosure, the construction trajectory map includes predetermined marker points, and the construction method further includes: issuing a warning signal when the ranging device approaches or reaches the marker point. In this way, the construction method proposed according to this disclosure can more effectively issue a warning signal when the ranging device approaches or reaches the marker point, so as to make construction personnel notice the corresponding marker point and increase construction accuracy.

[0016] In the technical solution according to this disclosure, the construction method further includes marking the location of the marker point when the ranging device approaches or reaches it. In this way, the construction method proposed according to this disclosure can more advantageously not only issue a warning signal when the ranging device approaches or reaches the marker point but also mark the corresponding marker point location, so that construction personnel can notice the corresponding marker point, thereby increasing construction accuracy.

[0017] In the technical solution according to this disclosure, the alert signal includes a visual or auditory alert signal. In this way, the construction method proposed according to this disclosure can more effectively issue an alert signal when the ranging device approaches or reaches the location of the marker point, so that construction personnel notice the corresponding marker point, thereby increasing construction accuracy.

[0018] In the technical solution according to this disclosure, the construction trajectory map includes predetermined marker points, and the measurement method further includes: presenting the marker points in a real-world scene using the augmented reality device. In this way, the augmented reality-based construction method disclosed in this disclosure can present the marker points in a real-world scene, allowing construction workers to intuitively observe the positions of the marker points, thereby improving construction accuracy.

[0019] In the technical solution according to this disclosure, the construction method further includes: obtaining an update to the construction trajectory map; and modifying the construction trajectory map based on the update. In this way, during construction, the construction method disclosed in this disclosure can update the construction trajectory map in real time, thereby dynamically modifying the construction trajectory map based on the latest information to obtain the latest and most accurate construction information, thus ensuring the construction accuracy of the construction method according to this disclosure.

[0020] In the technical solution according to this disclosure, the construction trajectory diagram is a two-dimensional or three-dimensional diagram of a computer-aided design drawing. In this way, the construction method according to this disclosure can be used for construction planning based on two-dimensional or three-dimensional diagrams generated by computer-aided design such as CAD, thereby expanding the application scenarios of the construction method according to this disclosure and improving the construction accuracy.

[0021] In the technical solution according to this disclosure, the construction method further includes: training an autonomous learning model based on the measurement data and the design data; and optimizing the projection of the target object in the scene based on the trained autonomous learning model. In this way, the construction method according to this disclosure can introduce an autonomous learning model, thereby enabling training of the autonomous learning model based on the measurement data and the design data, and optimizing the projection of the target object in the scene based on the trained autonomous learning model. This allows for training of the autonomous learning model based on multiple data sets, and optimization of images based on augmented reality (AR) technology, including both real-world and virtual scenes, based on the trained autonomous learning model, thereby improving display effects and accuracy.

[0022] In summary, the construction method based on augmented reality disclosed herein can establish a communication connection between the augmented reality device and the ranging device, and then calibrate the projection of the target object in the scene based on the measurement data and the design data of the target object. This enables the ranging device to further enhance the ability to optimize composite AR images under augmented reality (AR) technology, and makes the construction more precise. Attached Figure Description

[0023] Features, advantages, and other aspects of the various embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description, in which several embodiments of this disclosure are illustrated by way of example and not limitation, in the drawings:

[0024] Figure 1 shows a connection diagram of an augmented reality-based construction method 100 according to an embodiment of the present disclosure; and

[0025] Figure 2 shows a system block diagram of a hardware device for an augmented reality-based construction method according to one embodiment of the present disclosure. Detailed Implementation

[0026] Various exemplary embodiments of this disclosure are described in detail below with reference to the accompanying drawings. While the exemplary methods and apparatuses described below include software and / or firmware executed on hardware among other components, it should be noted that these examples are merely illustrative and should not be considered limiting. For example, it is conceivable that any or all hardware, software, and firmware components may be implemented exclusively in hardware, exclusively in software, or in any combination of hardware and software. Therefore, although exemplary methods and apparatuses have been described below, those skilled in the art will readily understand that the examples provided are not intended to limit the ways in which these methods and apparatuses may be implemented.

[0027] Furthermore, the flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of methods and systems according to various embodiments of this disclosure. It should be noted that the functions marked in the blocks may occur in a different order than that shown in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, or they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, may be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0028] As mentioned above, existing technologies suffer from the following technical problems: traditional augmented reality (AR)-based navigation or display technologies lack sufficient precision. To address these issues, the inventors of this disclosure innovatively conceive of connecting and optimizing an AR device and a ranging device, thereby calibrating the projection of the target object in a real-world scene based on measurement data and the corresponding design data of the target object. This optimizes the composite AR image and enhances construction accuracy. In summary, the inventors of this disclosure innovatively propose an augmented reality-based construction method, comprising: establishing a communication connection between the augmented reality device and the ranging device; acquiring construction drawings of the target object; projecting the construction trajectory map associated with the construction drawings onto the scene containing the target object via the augmented reality device; measuring the target object along the projection path using the ranging device to obtain measurement data; and calibrating the projection of the target object in the scene based on the measurement data and the target object's design data. In this manner, the augmented reality-based construction method disclosed herein establishes a communication connection between the augmented reality device and the ranging device. Then, based on the measurement data and the design data of the target object, the projection of the target object in the scene is calibrated. This enables the use of the ranging device to further enhance the optimization capabilities of composite AR images under augmented reality (AR) technology, resulting in more precise construction. In other words, simply put, the augmented reality-based construction method of this disclosure first obtains drawings, which can be either pre-existing or measured on-site as needed. Then, the augmented reality-based construction method of this disclosure uses an augmented reality (AR) device for projection navigation and trajectory guidance. The user of the AR device, for example, can walk along the navigation trajectory by using or carrying the ranging device, thereby obtaining accurate measurement data and trajectory information, acquiring deviation data between the data measured by the ranging device and the AR device, and calibrating the projection of the target object in the scene based on the deviation data. Furthermore, preferably, the augmented reality-based construction method according to this disclosure can introduce an autonomous learning model, which can learn deviation data and train the model, and use the deviation data output by the model to compensate for the map in AR, so that the map in AR has as little error as possible or even no error.

[0029] The augmented reality-based construction method disclosed in this disclosure will be described below with reference to Figures 1 and 2. Figure 1 shows a connection diagram of an augmented reality-based construction method 100 according to an embodiment of this disclosure, while Figure 2 shows a system block diagram of hardware devices for an augmented reality-based construction method according to an embodiment of this disclosure.

[0030] As shown in Figure 1, the augmented reality-based construction method 100 according to this disclosure includes at least the following five steps: First, in step 110, a communication connection 230 is established between the augmented reality device 210 and the ranging device 220. Here, the augmented reality device can be a head-mounted glasses device, a wearable device with a display, a smartwatch, or even a smart projector; the ranging device 220 can be a ranging wheel, or other laser-based ranging devices such as a level or line projector; and the communication connection 230 can be a network connection based on the WiFi protocol, or a network connection based on other bus protocols such as RJ45, ZigBee, Bluetooth, or ProfiBus, as long as a communication connection between the augmented reality device 210 and the ranging device 220 can be established. Then, the augmented reality-based construction method 100 according to this disclosure includes method step 120, in which the construction drawings of the target object are obtained, i.e., what kind of construction process needs to be carried out. For example, if parking space marking is to be carried out, then a parking space planning drawing of a parking lot needs to be obtained. This planning drawing includes, for example, the area data of the parking lot, the planned number of parking spaces, and the specific coordinate location information of each parking space. Next, the augmented reality-based construction method 100 according to this disclosure includes method step 130, in which the construction trajectory map associated with the construction drawings is projected onto the scene where the target object is located via the augmented reality device 210. That is, for example, when the display of the augmented reality device 210, such as a smart wearable device, the user can see the real scene superimposed with the object to be constructed, such as displaying the unmarked parking space lines in an empty parking lot. Next, the augmented reality-based construction method 100 according to this disclosure includes method step 140. In method step 140, a ranging device 220 measures the target object (e.g., the planned parking space) along the projection route to obtain measurement data of the target object (e.g., the planned parking space); and in method step 150, the projection of the target object in the scene is calibrated based on the measurement data and the design data of the target object (e.g., the planned parking space). For example, a standard parking space is usually 5.3 meters long and 2.5 meters wide, but the parking space projection based on AR technology may not be exactly 5.3 meters * 2.5 meters. In this case, a ranging device, such as a ranging wheel, can be used to measure the projected parking space line. If the actual measured size is 5.83 meters * 2.75 meters, it needs to be scaled to obtain a more accurate size. In actual construction, construction needs to be carried out according to the calibrated projection to improve construction accuracy.In this way, the augmented reality-based construction method 100 disclosed herein can establish a communication connection 230 between the augmented reality device 210 and the ranging device 220, and then calibrate the projection of the target object in the scene based on the measurement data and the design data of the target object (e.g., a parking space). This enables the ranging device 220 to further enhance the ability to optimize composite AR images under augmented reality (AR) technology, and makes the construction more precise.

[0031] After several such calibration processes, subsequent construction processes within the same construction scenario can achieve more accurate projections. For example, after calibrating the size of the AR projection using augmented reality (AR) technology, subsequent measurements of parking spaces or the provision of data for parking space construction based on the calibrated projection can yield parking spaces that are essentially identical to or completely identical to the design dimensions. For instance, if 10 parking spaces are planned, the AR projection can be calibrated based on the first few spaces (e.g., three spaces). Using the calibrated AR projection for navigation will result in more accurate lateral positioning data for subsequent measurements.

[0032] Preferably, in the technical solution according to this disclosure, the construction method 100 further includes (not shown in Figure 1): acquiring dimensional data associated with a predetermined construction trajectory map; and marking the construction trajectory map based on the dimensional data using a ranging device. For example, if there is a speed bump one meter in front of the first parking space, the position of the speed bump can be marked one meter in front of the first parking space using a ranging device, and the length can also be marked according to the design length of the speed bump, for example, three meters long and 30 centimeters wide. In this way, dimensional data associated with the construction trajectory map can be marked, thereby realizing the ability to further enhance the optimization of composite AR images under augmented reality (AR) technology using a ranging device, and making the construction more precise.

[0033] Furthermore, in the technical solution according to this disclosure, the construction method 100 further includes (not shown in Figure 1): drawing an actual trajectory map associated with the real scene based on the measurement data of the ranging device 220. That is, in the technical solution proposed according to this disclosure, an actual trajectory map of the ranging device 220 can be generated based on the measurement data of the ranging device 220, providing data assurance for optimizing the AR display accuracy of the augmented reality device using this actual trajectory map. For example, the size of a parking space projected purely using augmented reality technology might be 5.83 meters * 2.75 meters, so the shape of the displayed parking space would definitely deviate from the actual shape. However, during construction, by controlling the actual size with the help of the ranging device 220, a parking space with the same actual size as the design size is drawn. At this time, the shape of the parking space drawn based on the trajectory of the ranging device 220 is more accurately displayed in the augmented reality device 210.

[0034] In the technical solution according to this disclosure, the construction trajectory map includes predetermined marker points, and the construction method further includes: issuing a warning signal when the ranging device approaches or reaches the marker point. In this way, the construction method proposed according to this disclosure can more effectively issue a warning signal when the ranging device approaches or reaches the marker point, so that construction personnel notice the corresponding marker point, thereby increasing construction accuracy. For example, the construction trajectory map may include a wall 0.5 meters away from the end of the first parking space. In this case, when the ranging device 220 or augmented reality device 210 approaches this location, i.e., approaches the wall, a warning signal can be issued to ensure the safety of construction personnel. Alternatively, a parking area marker needs to be marked on the left pillar of the first parking space, or the index number of the parking space, such as parking space number 0001, needs to be marked at the front middle position of the first parking space. In this case, a warning signal can be issued when the ranging device 220 or augmented reality device 210 reaches or approaches the marker point, so that construction personnel can carry out construction accurately.

[0035] Preferably, in the technical solution according to this disclosure, the construction method further includes marking the location of the marker point when the ranging device approaches or reaches it. In this way, the construction method proposed according to this disclosure can more advantageously not only issue a warning signal when the ranging device approaches or reaches the marker point but also mark the corresponding marker point location, so that construction personnel can notice the corresponding marker point, thereby increasing construction accuracy. As mentioned above, a parking area marker needs to be marked on the left pillar of the first parking space, or the index number of the parking space, such as parking space number 0001, needs to be marked at the front center of the first parking space. In this case, a warning signal can be issued when the ranging device 220 or the augmented reality device 210 reaches or approaches the marker point, so that construction personnel can carry out construction accurately. Specifically, for example, when marking the front parking line of the first parking space, if the parking line is 2.5 meters long, then the middle 0.5 meters can be reserved for use as a parking space index number mark. After marking 1-meter parking lines on both sides, it reminds the construction workers that the parking index number needs to be marked, and the mark can be made when reaching the 1-meter position.

[0036] Preferably, in the technical solution according to this disclosure, the reminder signal includes a visual or auditory reminder signal. In this way, the construction method 100 proposed according to this disclosure can more advantageously issue a reminder signal when the ranging device approaches or reaches the location of the marker point, so that construction personnel notice the corresponding marker point, thereby increasing construction accuracy. That is, such a reminder signal can be a flashing reminder light, a beeping sound from a beeper, or a voice reminder with corresponding content, or it can be, for example, a text reminder displayed on a screen, or even a vibration reminder function of the ranging device 220.

[0037] In the technical solution according to this disclosure, the construction trajectory map includes predetermined marker points, and the measurement method 100 further includes (not shown in Figure 1): presenting the marker points in the real scene using the augmented reality device 210. In this way, the augmented reality-based construction method 100 disclosed in this disclosure can present the marker points in the real scene, allowing construction workers to intuitively observe the location of the marker points, thereby improving construction accuracy. As mentioned above, a parking area marker needs to be marked on the left pillar of the first parking space, or the index number of the parking space, such as parking space number 0001, needs to be marked at the front center of the first parking space. In this case, the marker point can be presented in the real scene before the ranging device 220 or the augmented reality device 210 reaches or approaches the marker point using augmented reality technology, so that construction workers have an intuitive understanding and avoid misoperation. A reminder signal is issued when the marker point is approached, so that construction workers can carry out construction accurately. Specifically, for example, when marking the front parking line of the first parking space, if the parking line is 2.5 meters long, then the middle 0.5 meters can be reserved as a parking space index number marker. In this case, before marking the parking lines on both sides by 1 meter, the marker point is marked with the help of augmented reality technology, which reminds the construction workers that the parking index number needs to be marked. At this time, the parking space index number can be marked when the workers reach the 1-meter position.

[0038] Preferably, in the technical solution according to this disclosure, the construction method 100 further includes (not shown in Figure 1): obtaining an update to the construction trajectory map; and modifying the construction trajectory map based on the update. In this way, during construction, the construction method disclosed in this disclosure can update the construction trajectory map in real time, thereby dynamically modifying the construction trajectory map based on the latest information to obtain the latest and most accurate construction information, thus ensuring the construction accuracy of the construction method according to this disclosure. For example, during construction, designers may discover design flaws in the original design, such as a pillar in a parking lot where designing parking spaces at that location clearly cannot meet parking needs. Designers can then update the construction trajectory map in a timely manner. The augmented reality-based construction method according to this disclosure can also update the construction trajectory map in a timely manner to ensure construction accuracy by using the latest construction trajectory map.

[0039] Preferably, in the technical solution according to this disclosure, the construction trajectory diagram is a two-dimensional or three-dimensional diagram of a computer-aided design drawing. In this way, the construction method according to this disclosure can perform construction planning based on two-dimensional or three-dimensional diagrams generated by computer-aided design such as CAD, thereby expanding the application scenarios of the construction method according to this disclosure and improving the construction accuracy of the construction method according to this disclosure.

[0040] In the technical solution according to this disclosure, the construction method further includes: training the autonomous learning model 211 based on the measurement data and the design data; and optimizing the projection of the target object in the scene based on the trained autonomous learning model 211. The autonomous learning model here can be a mature, large-scale model, or it can be configured by the construction personnel according to their own needs. In actual use, the autonomous learning model 211 can be retrained based on the actual construction information, making the trained autonomous learning model 211 more closely resemble the actual application scenario. In this way, the construction method according to this disclosure can introduce the autonomous learning model 211, thereby enabling training of the autonomous learning model 211 based on the measurement data and the design data, and optimizing the projection of the target object in the scene based on the trained autonomous learning model 211. This allows for training of the autonomous learning model 211 based on multiple data sets, and optimization of images based on augmented reality (AR) technology, including both real-world and virtual scenes, based on the trained autonomous learning model 211, thereby improving display effects and accuracy.

[0041] In summary, the construction method based on augmented reality disclosed herein can establish a communication connection between the augmented reality device and the ranging device, and then calibrate the projection of the target object in the scene based on the measurement data and the design data of the target object. This enables the ranging device to further enhance the ability to optimize composite AR images under augmented reality (AR) technology, and makes the construction more precise.

[0042] The above descriptions are merely optional embodiments of the present disclosure and are not intended to limit the embodiments of the present disclosure. For those skilled in the art, the embodiments of the present disclosure can have various modifications and variations. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the embodiments of the present disclosure should be included within the protection scope of the embodiments of the present disclosure.

[0043] While embodiments of this disclosure have been described with reference to several specific examples, it should be understood that the embodiments of this disclosure are not limited to the specific embodiments disclosed. The embodiments of this disclosure are intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims. The scope of the claims is to be interpreted in the broadest sense, thereby encompassing all such modifications and equivalent structures and functions.

Claims

1. A construction method based on augmented reality, characterized in that, The construction method includes: Establish a communication connection between augmented reality devices and ranging devices; Obtain the construction drawings of the target object; The construction trajectory map associated with the construction drawings is projected onto the scene where the target object is located via the augmented reality device; The target object is measured along the projection path using a ranging device to obtain measurement data of the target object; and The projection of the target object in the scene is calibrated based on the measurement data and the design data of the target object.

2. The construction method according to claim 1, characterized in that, The construction method also includes: Obtain dimensional data associated with the predetermined construction trajectory diagram; The construction trajectory map is marked based on the dimensional data using a ranging device.

3. The construction method according to claim 1, characterized in that, The construction method also includes: Based on the measurement data from the ranging device, an actual trajectory map associated with the real-world scene is drawn.

4. The construction method according to claim 1, wherein the construction trajectory map includes predetermined marker points, characterized in that, The construction method also includes: A warning signal is issued when the ranging device approaches or reaches the location of the marker point.

5. The construction method according to claim 4, characterized in that, The construction method also includes: The marker is marked when the ranging device approaches or reaches the location of the marker point.

6. The construction method according to claim 4, characterized in that, The alert signal includes visual or auditory alert signals.

7. The construction method according to claim 1, wherein the construction trajectory map includes predetermined marker points, characterized in that, The measurement method further includes: The marker points are presented in a real-world scene using the augmented reality device.

8. The construction method according to claim 1, characterized in that, The construction method also includes: Obtain updates to the construction trajectory map; and The construction trajectory diagram is modified based on the update.

9. The construction method according to claim 1, characterized in that, The construction trajectory diagram is a two-dimensional or three-dimensional diagram of a computer-aided design drawing.

10. The construction method according to claim 1, characterized in that, The construction method also includes: The autonomous learning model is trained based on the measurement data and the design data; and The projection of the target object in the scene is optimized based on the trained self-learning model.

Images