Project supervision methods, devices, equipment and media based on AR technology

Abstract

The present application relates to the field of construction project management, and in particular to a method, device, equipment and medium for project supervision based on AR technology, the method comprising: when a request for viewing the project progress is received, the actual construction image is acquired in real time, and a standard construction image is determined based on the actual construction image; the standard construction image is superimposed on the actual construction image to obtain a superimposed AR image, the AR device is controlled to display the superimposed AR image, and whether there is a construction progress deviation is determined based on the superimposed AR image; if so, the construction progress deviation value is determined based on the actual construction image; if not, a normal construction progress reminder signal is generated for reminder. The present application has the effect of improving the efficiency of determining the construction progress deviation value.

Description

Technical Field

[0001] The present application relates to the technical field of construction project management, and in particular to an AR-based engineering project supervision method, device, equipment and medium. Background Art

[0002] Augmented Reality (AR) technology can process the acquired spatial data through the mutual collaboration of cameras and sensors, and then generate a virtual environment based on the acquired spatial data, and can achieve a perfect fusion of the virtual environment and the real environment. At the same time, it is the convenience of AR technology that makes AR technology more and more widely used in the construction industry.

[0003] In the related art, construction data measured and uploaded by construction technicians are obtained, and the construction data obtained above are analyzed and integrated, and then whether there is a construction progress deviation is determined based on the integrated construction progress data; however, each time the determination of whether there is a construction progress deviation is performed, the construction technicians are required to spend a certain amount of time measuring to determine whether there is a construction progress deviation. It can be seen that the related art is less efficient in determining whether there is a construction progress deviation. Summary of the invention

[0004] In order to improve the efficiency of determining construction progress deviations, the present application provides an engineering project supervision method, device, equipment and medium based on AR technology.

[0005] In a first aspect, the present application provides an engineering project supervision method based on AR technology, which adopts the following technical solution: an engineering project supervision method based on AR technology, comprising:

[0006] When a project progress viewing request is received, an actual construction image is acquired in real time, and a standard construction image is determined based on the actual construction image;

[0007] superimposing the standard construction image onto the actual construction image to obtain a superimposed AR image, controlling an AR device to display the superimposed AR image, and determining whether there is a construction progress deviation based on the superimposed AR image;

[0008] If yes, the construction progress deviation value is determined according to the actual construction image; if no, a normal construction progress reminder signal is generated to provide a reminder.

[0009] In a preferred example, the present application may be further configured as follows: determining the construction progress deviation value according to the actual construction image includes:

[0010] Identify the actual construction image and determine construction process item information, wherein the construction process item information includes: a category to which the construction process item belongs and actual construction data, wherein the category to which the construction process item belongs includes at least: an overall construction process item;

[0011] If the category to which the construction process item belongs is the overall construction process item, then determining a plurality of operation construction process items in the overall construction process item;

[0012] Obtaining weight values ​​corresponding to each of the plurality of operation construction process items;

[0013] The construction progress deviation value is determined based on the weight values ​​corresponding to each of the multiple operation construction process items and the actual construction data.

[0014] In a preferred example, the present application may be further configured as follows: the operation construction process item includes a plurality of sub-operation construction process items, and the construction progress deviation value is determined based on the weight values ​​corresponding to the plurality of operation construction process items and the actual construction data, including:

[0015] For each operation construction process item, obtain the number of sub-operation construction process items;

[0016] Determine the construction progress value of the operation construction process item based on the actual construction data and the quantity corresponding to each of the sub-operation construction process items;

[0017] Determine the actual construction progress value of the overall construction process item based on the weight values ​​corresponding to each of the multiple operation construction process items and the construction progress values ​​corresponding to each of the multiple operation construction process items;

[0018] The standard construction progress value of the overall construction process item is obtained, and the construction progress deviation value is determined based on the standard construction progress value and the actual construction progress value.

[0019] In a preferred example, the present application may be further configured as follows: after determining the construction progress deviation value according to the actual construction data, the following further includes:

[0020] The superimposed AR image is displayed differentially to distinguish between a repeated construction image and a differential construction image, wherein the differential construction image is an AR image having a difference between the standard construction image and the actual construction image, and the repeated construction image is an image that is a duplicate of the actual construction image and the standard construction image;

[0021] Acquire an initial position of the difference construction image on the actual construction image;

[0022] Based on the correspondence between the preset position and the text display position and the initial position, determining a target text display position corresponding to the initial position;

[0023] The difference construction image and the construction progress deviation value are spliced ​​to obtain a spliced ​​difference construction image, and the AR device is controlled to display the construction progress deviation value at the target text display position.

[0024] In a preferred example, the present application may be further configured as follows: determining the standard construction image based on the actual construction image includes:

[0025] Based on a preset construction marker image and the actual construction image, determining whether a target construction marker image exists in the actual construction image;

[0026] If yes, extract the image of the target construction marker, and determine the standard construction image based on the correspondence between the preset construction marker and the standard construction image and the target construction marker;

[0027] If not, a target construction area is determined based on the actual construction image, and the corresponding standard construction image is determined based on the target construction area.

[0028] In a preferred example, the present application may be further configured as follows: after determining the construction progress deviation value according to the actual construction image, the following further includes:

[0029] Based on the preset correspondence between the construction progress deviation value and the extension level and the construction progress deviation value, determine the target extension level corresponding to the construction progress deviation value;

[0030] Determining whether the target extension level is within a preset acceptable extension level range;

[0031] If yes, generating the target extension level reminder signal to provide an extension reminder;

[0032] Otherwise, a normal construction delivery strategy is generated based on the construction progress deviation value, and the normal construction delivery strategy is recommended to the user end.

[0033] In a preferred example, the present application may be further configured as follows: generating a normal construction delivery strategy based on the construction progress deviation value includes:

[0034] Get the current date;

[0035] Determine the remaining construction date based on the preset standard delivery date of the project and the current date;

[0036] Based on the construction progress deviation value, the estimated installation worker efficiency and the remaining construction date, the number of additional construction workers is determined, and the number of additional construction workers is used as the normal construction delivery strategy.

[0037] In a second aspect, the present application provides an engineering project supervision device based on AR technology, which adopts the following technical solution: an engineering project supervision device based on AR technology, comprising:

[0038] An acquisition module, configured to acquire an actual construction image in real time when a request for viewing the project progress is received, and determine a standard construction image based on the actual construction image, wherein the actual construction image is acquired by an AR device;

[0039] A construction progress deviation determination module, used to control the AR device to display a superimposed image of the standard construction image superimposed on the actual construction image, and determine whether there is a construction progress deviation based on the superimposed image; if so, trigger the construction progress deviation value determination module; if not, trigger the reminder module;

[0040] A construction progress deviation value determination module, used for identifying the actual construction image to determine the construction progress deviation value;

[0041] The reminder module is used to generate a good reminder signal of the construction progress for reminder.

[0042] In a third aspect, the present application provides an electronic device, which adopts the following technical solution:

[0043] at least one processor;

[0044] Memory;

[0045] At least one application, wherein the at least one application is stored in a memory and configured to be executed by at least one processor, and the at least one application is configured to: execute the engineering project supervision method based on AR technology as described in any one of the first aspects.

[0046] In a fourth aspect, the present application provides a computer-readable storage medium, which adopts the following technical solution:

[0047] A computer-readable storage medium stores a computer program, which, when executed in a computer, causes the computer to execute the engineering project supervision method based on AR technology as described in any one of the first aspects.

[0048] In summary, this application includes the following beneficial technical effects:

[0049] When a request to view the project progress is received, the actual construction image is obtained, and the standard construction image is determined based on the actual construction image for comparison with the actual construction image; then the AR device is controlled to display the superimposed image of the standard construction image and the actual construction image, so as to more intuitively show the difference between the actual construction and the standard construction through superposition, so that according to the superimposed image, it is possible to more accurately judge whether there is a construction progress deviation; if so, the actual construction image is identified, and the construction progress deviation value is determined to quantify the image difference between the actual construction image and the standard construction image, which helps the user to understand the current construction progress deviation in more detail; if not, a normal construction progress reminder signal is generated; compared with the related art in which construction personnel are arranged to spend time measuring data to determine whether there is a construction progress deviation, the present application only needs to use VR equipment to compare whether the actual construction image and the standard construction image are the same to directly determine whether there is a construction progress deviation, which solves the technical problem in the related art that it takes a long time to determine whether there is a construction progress deviation, thereby effectively improving the efficiency of determining the construction progress deviation value. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] Figure 1 A schematic diagram of an interactive scenario of an engineering project supervision method based on AR technology provided in an embodiment of the present application.

[0051] Figure 2 A flowchart of an engineering project supervision method based on AR technology provided in an embodiment of the present application.

[0052] Figure 3 A schematic diagram of the structure of an engineering project supervision device based on AR technology provided in an embodiment of the present application.

[0053] Figure 4 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0054] The following is combined with Figure 1 To Attachment Figure 4 This application is described in further detail.

[0055] This specific embodiment is merely an explanation of the present application and is not a limitation of the present application. After reading this specification, a person skilled in the art may make non-creative modifications to the present embodiment as needed, but such modifications are protected by the patent law as long as they are within the scope of the present application.

[0056] In order to make the purpose, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application are clearly and completely described. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0057] In addition, the term "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article, unless otherwise specified, generally means that the associated objects before and after are in an "or" relationship.

[0058] like Figure 1 As shown, it is a schematic diagram of an interactive scenario of an engineering project supervision method based on AR technology provided in an embodiment of the present application. The AR device collects actual construction images and transmits them to the electronic device. The electronic device determines the corresponding standard construction image and controls the AR device to perform superposition and comparison to determine whether there is a construction progress deviation. If so, the electronic device determines the construction progress deviation value, otherwise, it generates a normal construction progress reminder signal.

[0059] The embodiments of the present application are further described in detail below in conjunction with the drawings in the specification.

[0060] The embodiment of the present application provides an engineering project supervision method based on AR technology, which is executed by an electronic device, which can be a server or a terminal device, wherein the server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides cloud computing services. The terminal device can be a smart phone, a tablet computer, a laptop computer, a desktop computer, etc., but is not limited to this. The terminal device and the server can be directly or indirectly connected via wired or wireless communication, and the embodiment of the present application does not limit this. Figure 2 As shown, the method includes step S101, step S102, step S103 and step S104, wherein:

[0061] Step S101: when a project progress viewing request is received, an actual construction image is acquired in real time, and a standard construction image is determined based on the actual construction image.

[0062] Specifically, in the embodiment of the present application, a monitoring program is pre-integrated in the electronic device, and the monitoring program is used to monitor the triggering behavior of the project progress viewing request. Once the viewing request is monitored to be triggered, the actual construction image is obtained. Specifically, when the user determines to view the project progress, a project progress viewing request is automatically generated, wherein the method of confirming the viewing may include the user confirming the viewing by clicking a viewing button on the application, and the user confirming the viewing by voice. When the electronic device detects that the user triggers the construction progress viewing request, the electronic device obtains the actual construction image.

[0063] It can be understood that in the embodiment of the present application, the AR device can be a handheld mobile terminal device. The user holds the AR device and collects the construction site image through the AR device. After the AR device completes the collection, it will display the above-collected construction site image in the form of a three-dimensional model on the display screen, that is, the actual construction image. It can be understood that in order to accurately determine the actual construction image collected, a calibration frame is displayed on the display screen of the AR device, and the actual construction image in the calibration frame is used as the standard. When the user holds the AR device for a period of time greater than the preset period, the actual construction image in the calibration frame is determined to be the image corresponding to the project progress that needs to be viewed. The electronic device obtains the construction image on the display screen of the AR device and uses it as the actual construction image. Further, the standard construction image is determined. It can be understood that by determining the standard construction image to achieve a more accurate comparison with the actual construction image, the standard construction image is a three-dimensional construction image corresponding to the normal construction progress.

[0064] Step S102: superimpose the standard construction image on the actual construction image to obtain a superimposed AR image, control the AR device to display the superimposed AR image, and determine whether there is a construction progress deviation based on the superimposed AR image.

[0065] Specifically, the actual construction image can be placed at the bottom layer of the display layer, and the standard construction image can be placed at the upper layer of the actual construction image to achieve the superposition of the standard construction image and the actual construction image. Further, if yes, step S103 is executed, and the construction progress deviation value is determined according to the actual construction image, so that the relevant management personnel can obtain the construction progress information in real time through the AR device, and the construction progress management efficiency can also be improved; if no, step S104 is executed, indicating that the construction progress is normal, and a normal construction progress reminder signal can be generated to remind the relevant management personnel.

[0066] Step S103: If yes, determine the construction progress deviation value according to the actual construction image.

[0067] Specifically, when it is determined that there is a construction progress deviation, analysis and integration are performed based on the actual construction image to determine the actual construction progress value, and the construction progress deviation value is determined based on the preset standard construction progress value and the actual construction progress value; it can be understood that, in general, based on the actual situation, when it is determined that there is a construction progress deviation, it indicates that the actual construction progress is slower than the standard construction progress, that is, the actual construction progress value < the standard construction progress value, and the construction progress deviation value > 0.

[0068] Step S104: If not, a normal construction progress reminder signal is generated to provide a reminder.

[0069] Specifically, the electronic device can send a good construction progress reminder signal through wireless transmission or wired transmission, wherein the electronic device can generate a reminder signal in text format and display it on the AR device to achieve the purpose of reminder, or the electronic device sends a voice reminder instruction, the AR device receives the voice reminder instruction, and plays the voice corresponding to the good construction progress reminder signal for reminder. The embodiment of the present application does not limit the specific content of the above-mentioned voice, and the user can set it by himself.

[0070] In an embodiment of the present application, when a request to view the project progress is received, an actual construction image is obtained, and a standard construction image is determined based on the actual construction image for comparison with the actual construction image; then the AR device is controlled to display an overlay image of the standard construction image and the actual construction image, so as to more intuitively show the difference between the actual construction and the standard construction through overlay, so that it is possible to more accurately judge whether there is a construction progress deviation based on the overlay image; if so, the actual construction image is identified, and the construction progress deviation value is determined to quantify the image difference between the actual construction image and the standard construction image, which helps the user to understand the current construction progress deviation in more detail; if not, a normal construction progress reminder signal is generated; compared with the related art in which construction personnel are arranged to spend time measuring data to determine whether there is a construction progress deviation, the present application only needs to use a VR device to compare whether the actual construction image and the standard construction image are the same to directly determine whether there is a construction progress deviation, which solves the technical problem in the related art that it takes a long time to determine whether there is a construction progress deviation, thereby effectively improving the efficiency of determining the construction progress deviation value.

[0071] In a possible implementation of the embodiment of the present application, step S103 identifies the actual construction image to determine the construction progress deviation value, specifically including:

[0072] Identify the actual construction image and determine the construction process item information, the construction process item information includes: the category to which the construction process item belongs and the actual construction data, the category to which the construction process item belongs includes at least: the overall construction process item;

[0073] If the category to which the construction process item belongs is an overall construction process item, then multiple operation construction process items in the overall construction process item are determined; and weight values ​​corresponding to each of the multiple operation construction process items are obtained;

[0074] The construction progress deviation value is determined based on the weight values ​​corresponding to each of the multiple operation construction process items and the actual construction data.

[0075] Specifically, the categories to which construction process items belong include: overall construction process items and single construction process items, wherein a single construction process item can be any complete operational construction process item, such as an electrical construction process item or a pipeline construction process item; an overall construction process item is all construction process items in a complete construction building, that is, it includes multiple operational construction process items, such as electrical construction process items, pipeline construction process items, approval processes, and acceptance processes. The specific implementation method for determining the construction process item information includes: pre-storing a complete AR image of the building construction project in an electronic device, comparing the actual construction image with the above complete AR image, and determining whether they are the same. If they are the same, it can be determined that the category of the construction process item corresponding to the actual construction image is an overall construction process item, otherwise, it is determined to be a single construction process item. Among them, when the category to which the construction process item belongs is the overall construction process item, the corresponding actual construction data is the construction data after the construction is completed; when it is a single construction process item, the achievable method of determining the corresponding actual construction data specifically includes: obtaining the distance between the AR device and the construction object in the actual construction image and the image shooting ratio of the AR device, and determining the construction data based on the image shooting ratio and the above distance, wherein the above distance can be monitored by a distance sensor set on the AR device.

[0076] It can be understood that, when it is a single construction process item, the construction progress deviation value can be determined according to the completed workload and the remaining time of the construction period corresponding to each sub-operation construction process item, wherein the first score corresponding to the above-mentioned completed workload is determined according to the preset correspondence between the completed workload and the first score and the above-mentioned completed workload, and the second score corresponding to the above-mentioned remaining time of the construction period is determined according to the preset correspondence between the remaining time of the construction period and the second score and the above-mentioned remaining time of the construction period, and the average score of the sum of the scores of the first score and the second score is calculated, and then the construction progress value corresponding to the above-mentioned average score is determined according to the preset correspondence between the average score and the construction progress value. Among them, the preset correspondence between the completed workload and the first score, the preset correspondence between the remaining time of the construction period and the second score, and the preset correspondence between the average score and the construction progress value are all determined by relevant technical personnel based on work experience, and the embodiments of this application are no longer limited. It is understandable that different construction projects correspond to different operation and construction process items. The construction project identification corresponding to the overall construction process item can be obtained, and the corresponding operation and construction process item can be determined according to the correspondence between the preset construction project identification and the operation and construction process item; different construction projects have different construction focuses, so there are some construction project approval process items with larger weight values ​​to speed up the construction progress; some construction project acceptance process items have larger weight values ​​to speed up the use of construction projects. The weight value corresponding to each operation and construction process item is pre-input into the electronic device by relevant technical personnel based on actual conditions, and the embodiments of this application are no longer limited. For example, when the operation and construction process item is pipeline construction, the completed workload is the ratio of the current pipeline length to the total pipeline length; the remaining time of the construction period is determined based on the current time and the construction period delivery time.

[0077] Furthermore, the operation construction process item includes a plurality of sub-operation construction process items. According to the weight values ​​and actual construction data corresponding to the plurality of operation construction process items, the construction progress deviation value is determined, specifically including:

[0078] For each operation construction process item, obtain the number of sub-operation construction process items;

[0079] Determine the construction progress value of the operation construction process item based on the actual construction data and quantity corresponding to each of all sub-operation construction process items;

[0080] Determine the actual construction progress value of the overall construction process item based on the weight values ​​corresponding to each of the multiple operation construction process items and the construction progress values ​​corresponding to each of the multiple operation construction process items;

[0081] Obtain the standard construction progress value of the overall construction process item, and determine the construction progress deviation value based on the standard construction progress value and the actual construction progress value.

[0082] Specifically, when the operation construction process item is a pipeline construction process item, the corresponding sub-operation construction process item may be the laying of drinking water pipes and the laying of floor heating pipes, etc., and the number of pre-stored sub-operation construction process items can be obtained from the operation construction process item database.

[0083] The construction progress value of the construction process item can be operated according to the calculation formula. The calculation formula is: Among them, M1 represents the construction progress value of the sub-operation construction process item numbered 1, M2 represents the construction progress value of the sub-operation construction process item numbered 2, and M n It represents the construction progress value of the sub-operation construction process item numbered n, where n is the number of sub-operation construction process items. The numbers corresponding to each sub-operation construction process item are pre-entered into the electronic device by relevant technical personnel, and the construction progress value of the operation construction process item can be obtained.

[0084] The actual construction progress value can be calculated according to the calculation formula: actual construction progress value = N1*K1+N2*K2+…+N m *K m , where N1 is the construction progress value corresponding to the operation construction process item numbered 1, N2 is the construction progress value corresponding to the operation construction process item numbered 2, and N m is the construction progress value corresponding to the operation construction process item numbered m, K1 is the weight value corresponding to the operation construction process item numbered 1, K2 is the weight value corresponding to the operation construction process item numbered 2, and K m is the weight value corresponding to the operation construction process item numbered m. The standard construction progress value is pre-entered into the electronic device by the relevant technical personnel; in actual construction, the relevant technical personnel will pre-plan the standard construction progress value corresponding to each operation construction process item and the overall construction process item, and store it in the electronic device for better management. Furthermore, the construction progress deviation value can be determined according to the calculation formula, and the calculation formula is: construction progress deviation value = standard construction progress deviation value - actual construction progress deviation value.

[0085] In an embodiment of the present application, for each operation construction process item, the number of sub-operation construction process items is obtained, and the construction progress value is determined according to the corresponding actual construction data and quantity; then, the actual construction progress value of the overall construction process item is determined according to the accurate weight value and quantity of the operation construction process items, thereby further improving the accuracy of determining the actual construction progress value of the overall construction process item; then, the standard construction progress value is obtained, and the construction progress deviation value is determined according to the standard construction progress value and the actual construction progress value, thereby obtaining a more accurate construction progress deviation value.

[0086] In an embodiment of the present application, actual construction images are identified to determine the category to which the construction process items belong and the actual construction data. The process of determining the construction progress deviation values ​​corresponding to construction process items of different categories is different. Therefore, determining the category to which the construction process items belong can effectively improve the accuracy of determining the construction progress deviation values; and corresponding construction progress deviation values ​​are determined for different categories to which construction process items belong. When it is an overall construction process item, multiple operation construction process items are determined, and the corresponding weight values ​​are obtained for each of them. The construction progress deviation values ​​are determined based on the weight values ​​and the actual construction data, so as to effectively improve the accuracy of determining the construction progress deviation values.

[0087] A possible implementation of the embodiment of the present application, after determining the construction progress deviation value according to the actual construction data, further includes:

[0088] The superimposed AR image is displayed differentially to distinguish between a repeated construction image and a differential construction image, wherein the differential construction image is an AR image that is different from the standard construction image and the actual construction image, and the repeated construction image is an image that is a duplicate of the actual construction image and the standard construction image;

[0089] Obtaining the initial position of the difference construction image on the actual construction image;

[0090] Based on the correspondence between the preset position and the text display position and the initial position, determining a target text display position corresponding to the initial position;

[0091] The difference construction image and the construction progress deviation value are spliced ​​to obtain a spliced ​​difference construction image, and the AR device is controlled to display the construction progress deviation value at the target text display position.

[0092] Specifically, the electronic device compares the actual construction image with the standard construction image, determines the difference between the actual construction image and the standard construction image, and displays the difference differently. The parts with differences can be marked with a preset target color. It is understandable that the preset target color is different from the color corresponding to the parts with differences. The embodiment of the present application does not limit the preset target color, and the user can set it by himself. Among them, the difference part is the difference construction image, and the repeated construction image is the construction image corresponding to the part where the actual construction image is exactly the same as the standard construction image. Differentiated display of the superimposed image can help relevant supervisors to more clearly understand the construction differences.

[0093] A coordinate system can be established with any point in the actual construction image as the origin, and then the initial position of the difference construction image can be determined according to the difference construction image. It can be understood that the above initial position can be a set of several two-dimensional coordinates. In the embodiment of the present application, the actual construction image covers the calibration frame in the entire AR device display screen, so the initial position corresponding to the actual construction image is the first position of the calibration frame on the display screen of the AR device.

[0094] The correspondence between the preset position and the text display position is pre-input into the electronic device by relevant technicians. The correspondence between the above position and the text display position can be pre-set by the technicians based on their work experience. Further, the target text display position is determined and then spliced ​​by marking lines. The electronic device generates instructions on whether to display other information and sends the above display instructions to the AR device. The user can click the "Confirm Display" or "Refuse Display" button to confirm whether to display other information. When the user clicks the "Confirm Display" button, the AR device sends the collected instructions to the electronic device, and the electronic device controls the AR device to display the construction process items.

[0095] In an embodiment of the present application, the superimposed AR image is displayed in a differentiated manner. The differentiated display helps the relevant supervisors to more intuitively understand the difference between the actual construction progress and the standard construction progress. The first position of the differential construction image is then obtained, and the target text display position corresponding to the first position is determined based on the corresponding relationship and the first position. The superimposed AR image and the construction progress deviation value are then spliced. The construction progress deviation value is displayed while calibrating the differential AR image, so as to better help the relevant supervisors understand the construction progress deviation value.

[0096] In a possible implementation of the embodiment of the present application, step S101 determines a standard construction image based on an actual construction image, specifically including:

[0097] Based on the preset construction marker image and the actual construction image, determining whether a target construction marker image exists in the actual construction image;

[0098] If yes, extract the image of the target construction marker, and determine the standard construction image based on the correspondence between the preset construction marker and the standard construction image and the target construction marker;

[0099] If not, a target construction area is determined based on the actual construction image, and the corresponding standard construction image is determined based on the target construction area.

[0100] Specifically, the preset construction marker image is pre-input into the electronic device by the relevant technical personnel, and the construction marker can be a construction marker pre-set by the relevant technical personnel in the construction area corresponding to different construction process items. It can be understood that when the same construction process item is located in different construction areas, the corresponding construction markers are set with different numbers. The embodiment of the present application does not limit the setting position of the construction marker, and the user can set it by himself. The correspondence between the above-mentioned construction markers and the standard construction image is pre-input into the electronic device. It can be understood that the actual construction image can correspond to any spatial range, and the construction marker will not cover all construction areas. When the actual construction image corresponds to a smaller spatial range, there may be a situation where the construction marker does not exist in the actual construction image. At this time, the standard construction image cannot be determined according to the above-mentioned correspondence. Therefore, it is necessary to determine the target construction area according to the actual construction image, and determine the standard construction image according to the target construction area.

[0101] In an embodiment of the present application, whether there are construction markers is determined based on the construction markers and the actual construction image, so as to determine the standard construction image based on the construction markers; when there are construction markers, the standard construction image is directly determined based on the construction markers, so as to effectively improve the determination process of the standard construction image; however, the actual construction image can correspond to a construction area of ​​any spatial range, so there may be no construction markers in the actual construction image. When there are no construction markers in the actual construction image, the target construction area is determined, and the standard construction image is determined based on the target construction area, so as to effectively improve the efficiency of determining the standard construction image.

[0102] A possible implementation of the embodiment of the present application, after determining the construction progress deviation value according to the actual construction image, further includes:

[0103] Based on the preset correspondence between the construction progress deviation value and the extension level and the construction progress deviation value, determine the target extension level corresponding to the construction progress deviation value;

[0104] Determine whether the target extension level is within the preset acceptable extension level range;

[0105] If so, a target extension level reminder signal is generated to provide an extension reminder;

[0106] Otherwise, a normal construction delivery strategy is generated based on the construction progress deviation value, and the normal construction delivery strategy is recommended to the user end.

[0107] Specifically, the correspondence between the preset construction progress deviation value and the extension level is pre-input into the electronic device by relevant technical personnel based on work experience. In the embodiment of the present application, the extension level includes: the first extension level, the second extension level and the third extension level. From the first extension level to the third extension level, the construction progress deviation gradually increases. It can be understood that the first extension level represents a slight construction progress deviation, that is, the actual delivery date of the construction project is slightly different from the standard delivery date, such as a delivery date difference of one or two days; the second extension level represents a moderate construction progress deviation, such as a delivery date difference of 3-5 days between the actual delivery date of the construction project and the standard delivery date; the third extension level represents a severe construction progress deviation, and the actual delivery date of the construction project is more than 5 days different from the standard delivery date.

[0108] The preset acceptable extension level range is pre-input by relevant technical personnel. In the embodiment of the present application, based on the actual situation, the preset acceptable extension level range includes: the first extension level and the second extension level, so as to avoid the extension level being too high, which will increase the construction cost of the construction project. Further, if yes, a reminder signal can be generated to inform the relevant management personnel of the extension level of the construction process item corresponding to the actual construction image. If no, a normal construction delivery strategy can be generated and recommended to the user; by generating a normal construction delivery strategy, the deviation of the construction progress can be reduced as much as possible to ensure the normal delivery of the construction project.

[0109] In an embodiment of the present application, a target extension level corresponding to the construction progress deviation value is determined based on the correspondence between the construction progress deviation value and the extension level, so that the construction progress deviation value can be more intuitively displayed through the extension level; then, it is determined whether the target extension level is within a preset acceptable extension level range. If so, a target extension level reminder signal is generated to remind the user; otherwise, a normal construction delivery strategy is generated based on the construction progress deviation value and recommended to the user end to reduce the construction progress deviation as much as possible and ensure the normal delivery of the construction project.

[0110] A possible implementation of the embodiment of the present application generates a normal construction delivery strategy based on the construction progress deviation value, specifically including:

[0111] Get the current date;

[0112] Determine the remaining construction date based on the preset standard project delivery date and the current date;

[0113] Based on the construction progress deviation value, expected facility worker efficiency and remaining construction date, the number of additional construction workers is determined, and the number of additional construction workers is used as the normal construction delivery strategy.

[0114] Specifically, the current date can be obtained through the electronic clock. The standard delivery date of the project and the construction efficiency are both input into the electronic device in advance by relevant technical personnel. It can be understood that in the construction of a building project, the standard delivery date of the project and the construction efficiency corresponding to different construction process items are different.

[0115] Standard remaining construction progress value = 1-standard construction progress value, the standard construction progress value corresponds to the current date, the total remaining construction progress value = standard remaining construction progress value + construction progress deviation value, further, The current number of construction workers is pre-entered into the electronic device by relevant technical personnel. It is understandable that in the actual construction process, the newly added construction workers can be newly recruited construction workers or dispatched from other construction areas. This embodiment of the present application does not limit this. In addition, by increasing the number of construction workers and using it as a normal construction delivery strategy, the construction progress is effectively guaranteed.

[0116] In an embodiment of the present application, the current date is obtained, and then the remaining construction date is determined based on the preset standard project delivery date and the current date, so that the construction of the project can be completed within the remaining construction date. Then, based on the construction progress deviation value, the preset construction labor efficiency and the remaining construction date, the number of additional construction personnel is determined, and the number of additional construction personnel is used as the normal construction delivery strategy to assist the user's decision-making, thereby better ensuring the normal delivery of the construction project.

[0117] The above embodiment introduces an engineering project supervision method based on AR technology from the perspective of method flow. The following embodiment introduces an engineering project supervision device based on AR technology from the perspective of virtual module or virtual unit. For details, please refer to the following embodiment.

[0118] The present application embodiment provides an engineering project supervision device based on AR technology, such as Figure 3 As shown, the engineering project supervision device based on AR technology may specifically include:

[0119] The acquisition module 201 is used to acquire the actual construction image in real time when receiving a request to view the project progress, and determine the standard construction image based on the actual construction image, where the actual construction image is collected by the AR device;

[0120] The construction progress deviation determination module 202 is used to control the AR device to display a superimposed image of the standard construction image superimposed on the actual construction image, and determine whether there is a construction progress deviation based on the superimposed image; if so, trigger the construction progress deviation value determination module 203; if not, trigger the reminder module 204;

[0121] A construction progress deviation value determination module 203 is used to identify the actual construction image to determine the construction progress deviation value;

[0122] The reminder module 204 is used to generate a good construction progress reminder signal for reminder.

[0123] In a possible implementation of the embodiment of the present application, the construction progress deviation value determination module 203 is specifically used to:

[0124] Identify the actual construction image and determine the construction process item information, the construction process item information includes: the category to which the construction process item belongs and the actual construction data, the category to which the construction process item belongs includes at least: the overall construction process item;

[0125] If the category to which the construction process item belongs is an overall construction process item, then multiple operation construction process items in the overall construction process item are determined; and weight values ​​corresponding to each of the multiple operation construction process items are obtained;

[0126] The construction progress deviation value is determined based on the weight values ​​corresponding to each of the multiple operation construction process items and the actual construction data.

[0127] In a possible implementation of the embodiment of the present application, the operation construction process item includes a plurality of sub-operation construction process items, and the construction progress deviation value determination module 203 is specifically used to:

[0128] For each operation construction process item, obtain the number of sub-operation construction process items;

[0129] Determine the construction progress value of the operation construction process item based on the actual construction data and quantity corresponding to each of all sub-operation construction process items;

[0130] Determine the actual construction progress value of the overall construction process item based on the weight values ​​corresponding to each of the multiple operation construction process items and the construction progress values ​​corresponding to each of the multiple operation construction process items;

[0131] Obtain the standard construction progress value of the overall construction process item, and determine the construction progress deviation value based on the standard construction progress value and the actual construction progress value.

[0132] In a possible implementation of the embodiment of the present application, the engineering project supervision device based on AR technology further includes: a display module for:

[0133] The superimposed AR image is displayed differentially to distinguish between a repeated construction image and a differential construction image, wherein the differential construction image is an AR image that is different from the standard construction image and the actual construction image, and the repeated construction image is an image that is a duplicate of the actual construction image and the standard construction image;

[0134] Obtaining the initial position of the difference construction image on the actual construction image;

[0135] Based on the correspondence between the preset position and the text display position and the initial position, determining a target text display position corresponding to the initial position;

[0136] The difference construction image and the construction progress deviation value are spliced ​​to obtain a spliced ​​difference construction image, and the AR device is controlled to display the construction progress deviation value at the target text display position.

[0137] In a possible implementation of the embodiment of the present application, when the acquisition module 201 determines the standard construction image based on the actual construction image, it is specifically used to:

[0138] Based on the preset construction marker image and the actual construction image, determining whether a target construction marker image exists in the actual construction image;

[0139] If yes, extract the image of the target construction marker, and determine the standard construction image based on the correspondence between the preset construction marker and the standard construction image and the target construction marker;

[0140] If not, a target construction area is determined based on the actual construction image, and a corresponding standard construction image is determined based on the target construction area.

[0141] In a possible implementation of the embodiment of the present application, the engineering project supervision device based on AR technology further includes: a target extension level determination module, which is used to:

[0142] Based on the preset correspondence between the construction progress deviation value and the extension level and the construction progress deviation value, determine the target extension level corresponding to the construction progress deviation value;

[0143] Determine whether the target extension level is within the preset acceptable extension level range;

[0144] If so, a target extension level reminder signal is generated to provide an extension reminder;

[0145] Otherwise, a normal construction delivery strategy is generated based on the construction progress deviation value, and the normal construction delivery strategy is recommended to the user end.

[0146] In a possible implementation manner of the embodiment of the present application, when the target extension level determination module generates a normal construction delivery strategy based on the construction progress deviation value, it is specifically used to:

[0147] Get the current date;

[0148] Determine the remaining construction date based on the preset standard project delivery date and the current date;

[0149] Based on the construction progress deviation value, expected facility worker efficiency and remaining construction date, the number of additional construction workers is determined, and the number of additional construction workers is used as the normal construction delivery strategy.

[0150] Technicians in the relevant field can clearly understand that, for the convenience and brevity of description, the specific working process of the engineering project supervision device based on AR technology described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0151] An electronic device is provided in an embodiment of the present application, such as Figure 4 As shown, Figure 4 The electronic device shown includes: a processor 301 and a memory 303. The processor 301 and the memory 303 are connected, such as through a bus 302. Optionally, the electronic device may further include a transceiver 304. It should be noted that in actual applications, the transceiver 304 is not limited to one, and the structure of the electronic device does not constitute a limitation on the embodiments of the present application.

[0152] Processor 301 may be a CPU (Central Processing Unit), a general purpose processor, a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. It may implement or execute various exemplary logic blocks, modules and circuits described in conjunction with the disclosure of this application. Processor 301 may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, etc.

[0153] The bus 302 may include a path to transmit information between the above components. The bus 302 may be a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus. The bus 302 may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 4 Only one thick line is used in the diagram, but it does not mean that there is only one bus or only one type of bus.

[0154] The memory 303 can be a ROM (Read Only Memory) or other types of static storage devices that can store static information and instructions, a RAM (Random Access Memory) or other types of dynamic storage devices that can store information and instructions, or an EEPROM (Electrically Erasable Programmable Read Only Memory), a CD-ROM (Compact Disc Read Only Memory) or other optical disk storage, optical disk storage (including compressed optical disk, laser disk, optical disk, digital versatile disk, Blu-ray disk, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited to these.

[0155] The memory 303 is used to store the application code for executing the solution of the present application, and the execution is controlled by the processor 301. The processor 301 is used to execute the application code stored in the memory 303 to implement the contents shown in the above method embodiment.

[0156] The electronic devices include, but are not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), and fixed terminals such as digital TVs, desktop computers, etc. It can also be a server, etc. Figure 4 The electronic device shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0157] An embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored. When the computer-readable storage medium is run on a computer, the computer can execute the corresponding content in the aforementioned method embodiment.

[0158] It should be understood that, although the steps in the flowchart of the accompanying drawings are displayed in sequence as indicated by the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least a part of the steps in the flowchart of the accompanying drawings may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily executed at the same time, but can be executed at different times, and their execution order is not necessarily sequential, but can be executed in turn or alternately with other steps or at least a part of the sub-steps or stages of other steps.

[0159] The above description is only a partial implementation method of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.

Claims

1. A project supervision method based on AR technology, characterized in that: include: When a request to view the project progress is received, the actual construction image is acquired in real time, and the standard construction image is determined based on the actual construction image; a calibration frame is displayed on the display screen of the AR device, and the actual construction image in the calibration frame is used as the standard. When the user holds the AR device for a period longer than a preset period, the actual construction image in the calibration frame is determined to be the image corresponding to the project progress to be viewed; superimposing the standard construction image onto the actual construction image to obtain a superimposed AR image, controlling an AR device to display the superimposed AR image, and determining whether there is a construction progress deviation based on the superimposed AR image; If yes, determining the construction progress deviation value according to the actual construction image; If not, a normal construction progress reminder signal is generated to provide a reminder; Determining the construction progress deviation value according to the actual construction image includes: Identify the actual construction image and determine construction process item information, wherein the construction process item information includes: a category to which the construction process item belongs and actual construction data, wherein the category to which the construction process item belongs includes at least: an overall construction process item; If the category to which the construction process item belongs is the overall construction process item, then determining a plurality of operation construction process items in the overall construction process item; Obtaining weight values ​​corresponding to each of the plurality of operation construction process items; Determining the construction progress deviation value based on the weight values ​​corresponding to the multiple operation construction process items and the actual construction data; The operation construction process item includes a plurality of sub-operation construction process items, and the construction progress deviation value is determined based on the weight values ​​corresponding to the plurality of operation construction process items and the actual construction data, including: For each operation construction process item, obtain the number of sub-operation construction process items; Determine the construction progress value of the operation construction process item based on the actual construction data and the quantity corresponding to each of the sub-operation construction process items; Determine the actual construction progress value of the overall construction process item based on the weight values ​​corresponding to each of the multiple operation construction process items and the construction progress values ​​corresponding to each of the multiple operation construction process items; Obtaining a standard construction progress value of the overall construction process item, and determining the construction progress deviation value based on the standard construction progress value and the actual construction progress value; After determining the construction progress deviation value based on actual construction data, it also includes: The superimposed AR image is displayed differentially to distinguish between a repeated construction image and a differential construction image, wherein the differential construction image is an AR image having a difference between the standard construction image and the actual construction image, and the repeated construction image is an image that is a duplicate of the actual construction image and the standard construction image; Acquire an initial position of the difference construction image on the actual construction image; Based on the correspondence between the preset position and the text display position and the initial position, determining a target text display position corresponding to the initial position; splicing the difference construction image with the construction progress deviation value to obtain a spliced ​​difference construction image, and controlling the AR device to display the construction progress deviation value at the target text display position; The determining of the standard construction image based on the actual construction image comprises: Based on a preset construction marker image and the actual construction image, determining whether a target construction marker image exists in the actual construction image; If yes, extract the image of the target construction marker, and determine the standard construction image based on the correspondence between the preset construction marker and the standard construction image and the target construction marker; If not, a target construction area is determined based on the actual construction image, and the corresponding standard construction image is determined based on the target construction area.

2. The engineering project supervision method based on AR technology according to claim 1 is characterized in that: After determining the construction progress deviation value according to the actual construction image, the method further includes: Based on the preset correspondence between the construction progress deviation value and the extension level and the construction progress deviation value, determine the target extension level corresponding to the construction progress deviation value; Determining whether the target extension level is within a preset acceptable extension level range; If yes, generating the target extension level reminder signal to provide an extension reminder; Otherwise, a normal construction delivery strategy is generated based on the construction progress deviation value, and the normal construction delivery strategy is recommended to the user end.

3. The engineering project supervision method based on AR technology according to claim 2 is characterized in that: The generating a normal construction delivery strategy based on the construction progress deviation value includes: Get the current date; Determine the remaining construction date based on the preset standard delivery date of the project and the current date; Based on the construction progress deviation value, the estimated installation worker efficiency and the remaining construction date, the number of additional construction workers is determined, and the number of additional construction workers is used as the normal construction delivery strategy.

4. An engineering project supervision device based on AR technology, characterized in that: include: The acquisition module, when receiving a request to view the project progress, acquires the actual construction image in real time, and determines the standard construction image based on the actual construction image; a calibration frame is displayed on the display screen of the AR device, and the actual construction image in the calibration frame is used as the standard. When the user holds the AR device for a period longer than a preset period, the actual construction image in the calibration frame is determined to be the image corresponding to the project progress to be viewed; A construction progress deviation determination module, used to superimpose the standard construction image onto the actual construction image to obtain a superimposed AR image, control the AR device to display the superimposed AR image, and determine whether there is a construction progress deviation based on the superimposed AR image; if so, trigger the construction progress deviation value determination module; if not, trigger the reminder module; A construction progress deviation value determination module, used to determine the construction progress deviation value according to the actual construction image; A reminder module is used to generate a normal construction progress reminder signal for reminder; Determining the construction progress deviation value according to the actual construction image includes: Identify the actual construction image and determine construction process item information, wherein the construction process item information includes: a category to which the construction process item belongs and actual construction data, wherein the category to which the construction process item belongs includes at least: an overall construction process item; If the category to which the construction process item belongs is the overall construction process item, then determining a plurality of operation construction process items in the overall construction process item; Obtaining weight values ​​corresponding to each of the plurality of operation construction process items; Determining the construction progress deviation value based on the weight values ​​corresponding to the multiple operation construction process items and the actual construction data; The operation construction process item includes a plurality of sub-operation construction process items, and the construction progress deviation value is determined based on the weight values ​​corresponding to the plurality of operation construction process items and the actual construction data, including: For each operation construction process item, obtain the number of sub-operation construction process items; Determine the construction progress value of the operation construction process item based on the actual construction data and the quantity corresponding to each of the sub-operation construction process items; Determine the actual construction progress value of the overall construction process item based on the weight values ​​corresponding to each of the multiple operation construction process items and the construction progress values ​​corresponding to each of the multiple operation construction process items; Obtaining a standard construction progress value of the overall construction process item, and determining the construction progress deviation value based on the standard construction progress value and the actual construction progress value; After determining the construction progress deviation value according to the actual construction data, the method further includes: The superimposed AR image is displayed differentially to distinguish between a repeated construction image and a differential construction image, wherein the differential construction image is an AR image having a difference between the standard construction image and the actual construction image, and the repeated construction image is an image that is a duplicate of the actual construction image and the standard construction image; Acquire an initial position of the difference construction image on the actual construction image; Based on the correspondence between the preset position and the text display position and the initial position, determining a target text display position corresponding to the initial position; splicing the difference construction image with the construction progress deviation value to obtain a spliced ​​difference construction image, and controlling the AR device to display the construction progress deviation value at the target text display position; The determining of the standard construction image based on the actual construction image comprises: Based on a preset construction marker image and the actual construction image, determining whether a target construction marker image exists in the actual construction image; If yes, extract the image of the target construction marker, and determine the standard construction image based on the correspondence between the preset construction marker and the standard construction image and the target construction marker; If not, a target construction area is determined based on the actual construction image, and a corresponding standard construction image is determined based on the target construction area.

5. An electronic device, characterized in that: include: at least one processor; Memory; At least one application, wherein the at least one application is stored in a memory and configured to be executed by at least one processor, and the at least one application is configured to: execute the engineering project supervision method based on AR technology as described in any one of claims 1 to 3.

6. A computer-readable storage medium, characterized in that: A computer program is stored thereon, and when the computer program is executed in a computer, the computer is caused to execute the engineering project supervision method based on AR technology as described in any one of claims 1 to 3.

Images