Electromechanical equipment installation and monitoring method applied to building area and computer equipment

Abstract

The embodiment of the invention relates to the field of electromechanical equipment installation and monitoring, in particular to an electromechanical equipment installation and monitoring method applied to a building area and computer equipment. A specific embodiment of the method comprises the following steps: performing image splicing on each optimized building wide-angle image in an optimized building wide-angle image set; generating a model according to the building area spliced image and pre-trained building information, and generating an original building area model corresponding to the building area; acquiring electromechanical equipment model information corresponding to each electromechanical equipment code identifier in the electromechanical equipment code identifier group; filling the original building area model according to the electromechanical equipment model information group and the electromechanical equipment code identification group to obtain a target building area model; and according to the target building area model, associated installation equipment is controlled to carry out installation processing on all the to-be-installed electromechanical equipment. According to the embodiment, the electromechanical devices can be installed according to the target building area model, and the installation error of the electromechanical devices is avoided.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of electromechanical equipment installation and monitoring, and specifically to electromechanical equipment installation and monitoring methods and computer equipment applied to building areas. Background Art

[0002] Electromechanical equipment generally refers to machinery, electrical appliances and electrical automation equipment. In construction, it mostly refers to the general term for machinery and pipeline equipment other than geotechnical, carpentry, steel bars and mud and water. It is different from hardware and mostly refers to finished products that can achieve certain functions. At present, in the construction industry, the installation of electromechanical equipment in the construction area requires operators to install and place each electromechanical equipment according to the installation drawings. However, the installation and placement of each electromechanical equipment by operators according to the installation drawings is inefficient and easily causes equipment installation errors. After the equipment is installed incorrectly, it is difficult for operators to discover it in time. Summary of the invention

[0003] The content of this application is used to introduce concepts in a brief form, which will be described in detail in the detailed implementation section below. The content of this application is not intended to identify the key features or essential features of the technical solution claimed for protection, nor is it intended to limit the scope of the technical solution claimed for protection.

[0004] Some embodiments of the present application propose electromechanical equipment installation and monitoring methods, computer equipment, and computer-readable storage media applied to building areas to solve one or more of the technical problems mentioned in the above background technology section.

[0005] In a first aspect, some embodiments of the present application provide a method for installing and monitoring electromechanical equipment applied to a building area, the method comprising: collecting building data in a building area where electromechanical equipment is to be installed by means of an electromechanical equipment installation monitoring device, wherein the building data comprises: a set of wide-angle building images corresponding to the building area; encoding each electromechanical equipment to be installed in the building area to generate a coding identification of electromechanical equipment, and obtaining a coding identification group of electromechanical equipment; generating an optimized building wide-angle image set through the building wide-angle image set, wherein the optimized building wide-angle image is an image obtained by local fusion optimization of multiple building wide-angle images; stitching each optimized building wide-angle image in the optimized building wide-angle image set to obtain a stitched image of the building area; generating a stitched image of the building area according to the stitched image of the building area and a pre-trained building information generation model. The invention relates to a method for forming an original building area model corresponding to the above-mentioned building area; obtaining the electromechanical equipment model information corresponding to each electromechanical equipment coding identification in the above-mentioned electromechanical equipment coding identification group, and obtaining the electromechanical equipment model information group, wherein the electromechanical equipment model information includes: electromechanical equipment model, installation location information, and equipment size information; filling the above-mentioned original building area model according to the above-mentioned electromechanical equipment model information group and the above-mentioned electromechanical equipment coding identification group, and obtaining the target building area model; according to the above-mentioned target building area model, controlling the associated installation equipment to perform installation processing on each electromechanical equipment to be installed; in response to determining that the installation of each electromechanical equipment is completed, controlling the above-mentioned electromechanical equipment installation monitoring device to collect the building data of the building area after the installation is completed as the target building data, and performing position verification on each installed electromechanical equipment according to the above-mentioned target building data.

[0006] In a second aspect, the present application also provides a computer device, comprising a processor, a memory, and a computer program stored in the memory and executable by the processor, wherein when the computer program is executed by the processor, the method described in any implementation of the first aspect is implemented.

[0007] In a third aspect, the present application further provides a computer-readable storage medium, on which a computer program is stored, wherein when the computer program is executed by a processor, the method described in any implementation of the first aspect is implemented.

[0008] The above-mentioned embodiments of the present application have the following beneficial effects: through the electromechanical equipment installation and monitoring method applied to the building area of ​​some embodiments of the present application, a three-dimensional model of the building area can be established, and through the three-dimensional model and the electromechanical equipment model, the target building area model after the electromechanical equipment is installed can be simulated. Therefore, each electromechanical equipment can be installed according to the target building area model. Then, the installation error of the electromechanical equipment is avoided. First, the building data in the building area where the electromechanical equipment is to be installed is collected through the electromechanical equipment installation monitoring device, wherein the above-mentioned building data includes: a building wide-angle image set corresponding to the building area. Each electromechanical equipment to be installed in the above-mentioned building area is coded to generate an electromechanical equipment coding identification to obtain an electromechanical equipment coding identification group. Thus, it is convenient to construct a building area model. Second, through the above-mentioned building wide-angle image set, an optimized building wide-angle image set is generated, wherein the optimized building wide-angle image is an image after local fusion optimization of multiple building wide-angle images. Each optimized building wide-angle image in the above-mentioned optimized building wide-angle image set is image stitched to obtain a building area stitched image. Thus, the model accuracy of the subsequently generated building area model is improved by image optimization. Third, the original building area model corresponding to the above-mentioned building area is generated according to the above-mentioned building area splicing image and the pre-trained building information generation model. Thus, a three-dimensional model of the building area can be established. Fourth, the electromechanical equipment model information corresponding to each electromechanical equipment coding identification in the above-mentioned electromechanical equipment coding identification group is obtained to obtain the electromechanical equipment model information group, wherein the electromechanical equipment model information includes: electromechanical equipment model, installation location information, and equipment size information. Fifth, according to the above-mentioned electromechanical equipment model information group and the above-mentioned electromechanical equipment coding identification group, the above-mentioned original building area model is filled to obtain the target building area model. Thus, through the three-dimensional model and the electromechanical equipment model, the target building area model after the electromechanical equipment is installed can be simulated. Sixth, according to the above-mentioned target building area model, the associated installation equipment is controlled to install each electromechanical equipment to be installed. In response to determining that each electromechanical equipment is installed, the above-mentioned electromechanical equipment installation monitoring device is controlled to collect the building data of the building area after the installation is completed as the target building data, and according to the above-mentioned target building data, the position of each installed electromechanical equipment is verified. Therefore, each electromechanical device can be installed according to the target building area model. Thus, installation errors of the electromechanical devices can be avoided. In addition, data can be collected again on the building area where the electromechanical devices have been installed to verify whether there are errors in the installation of each electromechanical device, so as to facilitate timely correction. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] The above and other features, advantages and aspects of the embodiments of the present application will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and that components and elements are not necessarily drawn to scale.

[0010] Figure 1 is a flow chart of some embodiments of the method for installing and monitoring electromechanical equipment applied to a building area according to the present application;

[0011] Figure 2 It is a schematic diagram of the structure of a computer device suitable for implementing some embodiments of the present application. DETAILED DESCRIPTION

[0012] Embodiments of the present application will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present application are shown in the accompanying drawings, it should be understood that the present application can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present application. It should be understood that the drawings and embodiments of the present application are only for exemplary purposes and are not intended to limit the scope of protection of the present application.

[0013] It should also be noted that, for ease of description, only the parts related to the invention are shown in the drawings. In the absence of conflict, the embodiments and features in the embodiments of the present application can be combined with each other.

[0014] It should be noted that the concepts such as "first" and "second" mentioned in this application are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0015] It should be noted that the modifications of "one" and "plurality" mentioned in the present application are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0016] The names of the messages or information exchanged between multiple devices in the embodiments of the present application are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0017] The present application will be described in detail below with reference to the accompanying drawings and in combination with embodiments.

[0018] Figure 1 The process 100 of some embodiments of the electromechanical equipment installation and monitoring method applied to the building area according to the present application is shown. The electromechanical equipment installation and monitoring method applied to the building area includes the following steps:

[0019] Step 101, collecting building data in a building area where the electromechanical equipment is to be installed by means of an electromechanical equipment installation monitoring device.

[0020] In some embodiments, the execution subject (for example, a computer device) of the electromechanical equipment installation and monitoring method applied to the building area can collect building data in the building area where the electromechanical equipment is to be installed through the electromechanical equipment installation monitoring device. Among them, the above-mentioned building data includes: a set of wide-angle images of buildings in the building area. The electromechanical equipment installation monitoring device may refer to a monitoring device with a wide-angle lens set in the building area, which may include a wide-angle lens camera and various sensors. Among them, the building wide-angle image set is a wide-angle image in the building area. The building wide-angle image set is a set of images collected by a camera with a wide-angle lens and containing a panoramic view of the building area. The building area may be an area where various electromechanical equipment is to be installed. For example, the building area may be a laboratory, an exhibition hall, and other areas. For example, various electromechanical equipment may include but is not limited to: household appliances, automotive electronics products, fitness and sports machinery, computers, printers, copiers, communication equipment and other office automation equipment, etc.

[0021] In an actual scenario, the execution entity can collect building data in the building area where the electromechanical equipment is to be installed through the following steps:

[0022] The first step is to collect a set of wide-angle images of buildings in the building area where the electromechanical equipment is to be installed. For example, the associated wide-angle lens camera can be controlled to collect wide-angle images of each building in the building area where the electromechanical equipment is to be installed.

[0023] In the second step, each building wide-angle image in the building wide-angle image set with a time sequence is converted to obtain a converted building wide-angle image information sequence. For example, for each building wide-angle image in the above-mentioned building wide-angle image set, first, the image size of the above-mentioned building wide-angle image can be converted; then, the building wide-angle image can be standardized; and then, the building wide-angle image can be converted into a building wide-angle image tensor. The converted building wide-angle image tensor is used as the converted building wide-angle image information. The image size conversion can be a conversion to a preset image size. The building wide-angle image tensor can be a PyTorch tensor.

[0024] In the third step, for each converted building wide-angle image information in the converted building wide-angle image information sequence, the following steps are performed:

[0025] 1. Input the above-mentioned converted building wide-angle image information into the encoding network included in the pre-trained deep image construction model to obtain the converted building wide-angle image feature map. Among them, the above-mentioned deep image construction model includes: an encoding network, an image memory network and a decoding network, and the above-mentioned image memory network includes: an attention layer. Among them, the above-mentioned deep image construction model can be a neural network model with the converted building wide-angle image as input and the corresponding building wide-angle depth image as output. The encoding network can be used to extract image features. For example, the encoding network can be an encoder of Vision Transformer. The image memory network can be used to save the image features and depth information of the historical frames, and can also fuse the historical information with the feature map of the current image to enhance the feature map of the current frame image. The decoding network can be used to decode the enhanced attention operation feature map to obtain the building wide-angle depth image. For example, the decoding network can be a decoder of DPT (Dense Prediction Transformer) Head. The attention layer can be used to perform attention operation. The above-mentioned encoding network can include each feature extraction layer with order.

[0026] 2. Input the above-mentioned converted building wide-angle image feature map into the above-mentioned attention layer to perform an attention operation on the above-mentioned converted building wide-angle image feature map and the memory features stored in the above-mentioned image memory network to obtain an attention operation feature map. For example, the above-mentioned execution subject may perform an attention mechanism on the above-mentioned converted building wide-angle image feature map and the above-mentioned memory features to obtain a weighted feature representation as an attention operation feature map. The memory features are initially empty. The above-mentioned attention layer may include various attention network layers. In each attention network layer, the current feature map is first processed by a self-attention mechanism, and then processed together with the memory features by a cross-attention mechanism to capture the dependency between the current feature map and the memory features. Each attention network layer may also include a feedforward network for further processing of data.

[0027] 3. Input the attention operation feature map into the decoding network to obtain a wide-angle depth image of the building. The decoding network may include feature decoding layers corresponding to the feature extraction layers. The number of feature decoding layers may be the same as the number of feature extraction layers. Each feature decoding layer corresponds to one feature extraction layer. The feature decoding layers correspond to the feature extraction layers in reverse order.

[0028] 4. The building wide-angle image corresponding to the converted building wide-angle image information and the building wide-angle depth image are combined into building image data.

[0029] The fourth step is to merge the various building image data into building data.

[0030] Thereby, the accuracy of each depth image generated for the time-sequential image sequence is improved, thereby facilitating the subsequent position verification of the installed electromechanical equipment.

[0031] Step 102: perform coding processing on each electromechanical device to be installed in the building area to generate a coding identification of the electromechanical device and obtain a coding identification group of the electromechanical device.

[0032] In some embodiments, the execution subject may perform coding processing on each electromechanical device to be installed in the building area to generate a coding identification of the electromechanical device and obtain a coding identification group of the electromechanical device. For example, each electromechanical device to be installed may be coded according to a pre-set coding rule to generate a coding identification of the electromechanical device. For example, the coding rule may be a serial number code, a device name code, or a device placement position code. The electromechanical device coding identification may uniquely identify an electromechanical device.

[0033] Step 103: Generate an optimized building wide-angle image set through the above building wide-angle image set.

[0034] In some embodiments, the above-mentioned execution subject can generate an optimized building wide-angle image set through the above-mentioned building wide-angle image set. Among them, the optimized building wide-angle image is an image after local fusion optimization of multiple building wide-angle images. For example, the building wide-angle image set may include: a first building wide-angle image, a second building wide-angle image, and a third building wide-angle image. Among them, there is an overlapping area 1 between the first building wide-angle image and the second building wide-angle image. There is an overlapping area 2 between the second building wide-angle image and the third building wide-angle image. Therefore, for the first building wide-angle image and the second building wide-angle image, the first building wide-angle image and the second building wide-angle image can be spliced, and the pixel values ​​of the pixels of the first building wide-angle image and the second building wide-angle image in the overlapping area 1 are averaged to obtain the first optimized building wide-angle image. The above-mentioned execution subject can splice the second building wide-angle image and the third building wide-angle image, and average the pixel values ​​of the pixels of the second building wide-angle image and the third building wide-angle image in the overlapping area 2 to obtain the second optimized building wide-angle image.

[0035] In a practical scenario, the execution subject can generate an optimized building wide-angle image set through the following steps:

[0036] In the first step, for each building wide-angle image in the above building wide-angle image set, the following processing steps are performed:

[0037] 1. Perform distortion calibration on the wide-angle image of the building to obtain a distortion-calibrated wide-angle image of the building. For example, the distortion calibration can be performed on the wide-angle image of the building to obtain a distortion-calibrated wide-angle image of the building by means of geometric correction.

[0038] 2. Perform target detection processing on the above-mentioned distortion-calibrated building wide-angle image to obtain a target description information group. The target description information includes: a target feature point group. For example, the detected target can be an air conditioner / television / computer, and the accuracy of target modeling affects the availability of the updated building area model generated subsequently. The target-based image alignment method has a faster alignment speed than the full pixel comparison method. The NanoDet model can be used to perform target detection processing on the above-mentioned distortion-calibrated building wide-angle image to obtain a target description information group.

[0039] In the second step, according to the target description information set corresponding to the building wide-angle image, image similarity matching is performed on the building wide-angle images in the building wide-angle image set to generate a building wide-angle image group set. The matching building wide-angle images can be used as the building wide-angle image group by determining the feature point matching degree of the target feature point group included in the target description information corresponding to the building wide-angle image through feature point matching.

[0040] In the third step, for each building wide-angle image group in the above building wide-angle image group set, perform the following optimization steps:

[0041] 1. Randomly select a building wide-angle image from the above building wide-angle image group as the basic building wide-angle image.

[0042] 2. According to each building wide-angle image in the building wide-angle image group except the above-mentioned basic building wide-angle image, the above-mentioned basic building wide-angle image is partially optimized to generate an optimized building wide-angle image. Only the local area where the target feature point is located, which is included in each building wide-angle image in the building wide-angle image group except the above-mentioned basic building wide-angle image, can be superimposed on the basic building wide-angle image, and the pixel values ​​are averaged to obtain the optimized building wide-angle image.

[0043] Step 104 , stitching the optimized building wide-angle images in the optimized building wide-angle image set to obtain a building area stitching image.

[0044] In some embodiments, the execution subject may stitch the optimized building wide-angle images in the optimized building wide-angle image set to obtain a building area stitched image. For example, the optimized building wide-angle images may be stitched in sequence according to the time sequence of the image frames to obtain a building area stitched image.

[0045] In an actual scenario, the execution subject may perform image stitching on each optimized building wide-angle image in the above-mentioned optimized building wide-angle image set through the following steps:

[0046] In the first step, for each optimized building wide-angle image in the optimized building wide-angle image set, feature points are extracted from the lateral edge region in the optimized building wide-angle image to generate edge region features. The lateral edge region is a rectangular region on both sides of the image in the optimized building wide-angle image. For example, a SIFT (Scale-Invariant Feature Transform) algorithm can be used to extract feature points from the lateral edge region in the optimized building wide-angle image to generate edge region features.

[0047] In the second step, based on the edge area features corresponding to the optimized building wide-angle images, the optimized building wide-angle images in the above-mentioned optimized building wide-angle image set are image matched, and an image stitching order index sequence is generated. The image stitching order index sequence represents the image stitching order of each optimized building wide-angle image in the above-mentioned optimized building wide-angle image set. For example, the above-mentioned execution subject can perform image matching on the optimized building wide-angle images in the above-mentioned optimized building wide-angle image set by matching feature points.

[0048] The third step is to stitch the optimized building wide-angle images in the optimized building wide-angle image set together through the image stitching order index sequence to obtain a building area stitching image. For example, the optimized building wide-angle image corresponding to index 1 can be stitched to the left of the optimized building wide-angle image corresponding to index 3, the optimized building wide-angle image corresponding to index 3 can be stitched to the left of the optimized building wide-angle image corresponding to index 4, and the optimized building wide-angle image corresponding to index 4 can be stitched to the left of the optimized building wide-angle image corresponding to index 1.

[0049] Step 105 , generating an original building area model corresponding to the building area according to the building area spliced ​​image and the pre-trained building information generation model.

[0050] In some embodiments, the execution entity may generate an original building area model corresponding to the building area based on the building area stitched image and a pre-trained building information generation model.

[0051] In an actual scenario, the execution entity can generate the original building area model corresponding to the above building area through the following steps:

[0052] The first step is to generate an initial building area model and building area model information according to the above-mentioned building area splicing image and the above-mentioned building information generation model. Wherein, the above-mentioned building area model information includes: a building area model element information set, and the building area model element information includes: a regional element type, a regional element feature vector and a regional element position information, and the regional element position information represents the position of the building area model element corresponding to the building area model element information in the initial building area model. The building information generation model may include: an encoder, a decoder, a feature extraction model and a threshold adjustment network. Wherein, the encoder includes: a first 2D convolution layer, a first residual convolution layer, a second residual convolution layer, a third residual convolution layer, a fourth residual convolution layer, a second 2D convolution layer, a third 2D convolution layer and a fourth 2D convolution layer. Wherein, a maximum pooling layer is arranged between the first 2D convolution layer and the first residual convolution block. A maximum pooling layer is arranged between the second 2D convolution layer and the third 2D convolution layer. A maximum pooling layer is arranged between the third 2D convolution layer and the fourth 2D convolution layer. Among them, the number of channels of the first residual convolution layer is (64, 64, 256). The number of channels of the second residual convolution layer is (128, 128, 256). The number of channels of the third residual convolution layer is (128, 128, 256). The number of channels of the fourth residual convolution layer is (128, 128, 256). The decoder includes: four three-dimensional deconvolution layers connected in series. For example, the decoder may include: a first three-dimensional deconvolution layer, a second three-dimensional deconvolution layer, a third three-dimensional deconvolution layer, and a fourth three-dimensional deconvolution layer. The feature extraction model includes: a first three-dimensional convolution layer, a first fully connected layer of the second three-dimensional convolution layer, a first attention layer, and a second attention layer. The first attention layer and the second attention layer each include an attention mechanism layer and a three-dimensional deconvolution layer. The threshold adjustment network can use YOLO as the backbone network. For example, the threshold adjustment network extracts image features from the spliced ​​image of the building area and converts them into feature images of different feature dimensions for superposition. The regional element position information represents the position of the regional model element corresponding to the building regional model element information in the original building regional model. The regional element type represents the element category of the regional model element. The regional element feature vector may be a one-dimensional feature vector for the regional model element. The regional element feature vector may be a one-dimensional feature vector corresponding to the target framed by the predicted anchor frame. The regional element position information may represent the position of the target after three-dimensional reconstruction in the original building regional model. The regional element type may be the category of the target framed by the predicted anchor frame by the threshold adjustment network. For example, the regional element position information may be determined by projection.

[0053] The first step may include:

[0054] 1. Based on the encoder included in the building information generation model, generate the spliced ​​image coding features corresponding to the spliced ​​image of the building area.

[0055] 2. Generate image decoding features corresponding to the above-mentioned spliced ​​image encoding features through the decoder included in the above-mentioned building information generation model.

[0056] 3. Generate image extraction features corresponding to the above-mentioned image decoding features through the feature extraction model included in the above-mentioned building information generation model.

[0057] 4. Generate adjustment parameters corresponding to the building area splicing image through the threshold adjustment network included in the above-mentioned building information generation model.

[0058] 5. Generate an initial building area model and building area model information through the above adjustment parameters and the above image extraction features.

[0059] In the second step, for each building area model element information in the building area model element information set, the following processing steps are performed:

[0060] 1. According to the regional element type and regional element feature vector included in the above-mentioned building area model element information, determine whether there is a building area model element matching the above-mentioned building area model element information in a pre-set building area model element library. Wherein, determining whether there is a building area model element matching the above-mentioned building area model element information in the pre-set building area model element library includes: first, encoding the regional element type included in the above-mentioned building area model element information to generate a regional element type encoding vector. Secondly, vector splicing the above-mentioned regional element type encoding vector and the regional element feature vector included in the above-mentioned building area model element information to obtain a splicing vector. Then, hashing the above-mentioned splicing vector to obtain a hash vector. Finally, matching the above-mentioned hash vector with the vector identifier corresponding to the building area model element in the above-mentioned building area model element library to determine whether there is a building area model element matching the above-mentioned building area model element information in the building area model element library. Wherein, the building area model element library can be a database storing pre-built and updated building area model elements. The building area model element can be a three-dimensional model for electromechanical equipment. For example, the execution subject may determine whether there is a building area model element matching the building area model element information in a preset building area model element library by means of data query. The vector identifier may represent a vector of a building area model element.

[0061] 2. In response to the existence of a matching building area model element in the building area model element library, determining a building area model element matching the above building area model element information as a candidate building area model element.

[0062] In the third step, the initial building area model is updated according to each candidate building area model element to generate an updated initial building area model as the original building area model. For example, for each candidate building area model element, the element in the initial building area model corresponding to the candidate building area model element is replaced with the candidate building area model element to generate an updated initial building area model as the original building area model.

[0063] Therefore, a feature extraction model is added to the encoder-decoder structure to better extract the shape, texture and spatial relationship of the 3D model. At the same time, the quality and details of model reconstruction are improved by introducing an attention mechanism in the feature extraction model. Then, by introducing a threshold adjustment network, the 3D reconstruction of the building area model can be selectively performed by controlling the threshold during reconstruction. In this way, the model accuracy of the building area model obtained by modeling is greatly improved.

[0064] Step 106: Obtain the electromechanical device model information corresponding to each electromechanical device code identification in the electromechanical device code identification group to obtain the electromechanical device model information group.

[0065] In some embodiments, the execution subject may obtain the electromechanical equipment model information corresponding to each electromechanical equipment coding identification in the electromechanical equipment coding identification group to obtain the electromechanical equipment model information group. The electromechanical equipment model information includes: electromechanical equipment model, installation location information, and equipment size information. The electromechanical equipment model may represent a three-dimensional model of the electromechanical equipment. The installation location information may represent the installation location of the electromechanical equipment in the building area. The equipment size information may represent the size (length, width, and height) of the electromechanical equipment.

[0066] Step 107, filling the original building area model according to the electromechanical equipment model information group and the electromechanical equipment code identification group to obtain a target building area model.

[0067] In some embodiments, the execution subject may fill the original building area model according to the electromechanical equipment model information group and the electromechanical equipment code identification group to obtain the target building area model. For example, each electromechanical equipment model may be added to the original building area model, and each electromechanical equipment model may be placed at a corresponding installation position.

[0068] In an actual scenario, the execution subject can fill the original building area model through the following steps to obtain the target building area model:

[0069] In the first step, for each electromechanical device model information in the electromechanical device model information group, the following filling steps are performed:

[0070] 1. Fill the electromechanical equipment model included in the electromechanical equipment model information into the installation position of the corresponding installation position information in the original building area model.

[0071] 2. Determine the electromechanical equipment coding identification corresponding to the electromechanical equipment model information as the target electromechanical equipment coding identification.

[0072] 3. Mark the target electromechanical equipment code identification on the electromechanical equipment model of the corresponding electromechanical equipment model information in the original building area model.

[0073] In the second step, the filled original building area model is determined as the target building area model.

[0074] Step 108: According to the target building area model, control the associated installation equipment to perform installation processing on each electromechanical device to be installed.

[0075] In some embodiments, the execution subject may control the associated installation equipment to install each electromechanical device to be installed according to the target building area model. For example, according to the posture and position of the electromechanical device model displayed in the target building area model, the associated installation equipment may be controlled to install / place the electromechanical device to be installed at the corresponding position in the building area. The installation equipment may include a robotic arm, a forklift, a handling device, etc.

[0076] Step 109, in response to determining that the installation of each electromechanical equipment is completed, controlling the electromechanical equipment installation monitoring device to collect building data of the building area after the installation is completed as target building data, and performing position verification on each installed electromechanical equipment based on the target building data.

[0077] In some embodiments, the execution subject may control the electromechanical equipment installation monitoring device to collect the building data of the building area after the installation is completed as the target building data in response to determining that each electromechanical equipment has been installed, and perform position verification on each electromechanical equipment after installation according to the target building data. The target building data here may refer to the building data of the building area that is re-collected after the installation of each electromechanical equipment is completed, and may include a wide-angle image of the building and a wide-angle depth image of the building. The depth image, also known as a distance image or a range image, records the distance from the image acquisition device to each point in the scene, and directly reflects the geometric shape of the visible surface of the scene. This feature makes the depth image have important applications in the fields of three-dimensional reconstruction and posture estimation, because it provides the three-dimensional coordinate information of the object. Therefore, the features of the depth image can be used to determine the actual installation position information of each electromechanical equipment. Afterwards, it is determined whether there is a deviation between the actual installation position information of each electromechanical equipment and the corresponding installation position information. If there is a deviation, the position of the installed electromechanical equipment is corrected.

[0078] The present application also provides a computer device 200. Figure 2 As shown, the computer device 200 includes: a bus 201, a processor 202, a memory 203 and a communication interface 204. The processor 202, the memory 203 and the communication interface 204 communicate with each other through the bus 201. The computer device 200 can be a server or a terminal device. It should be understood that the present application does not limit the number of processors and memories in the computer device 200.

[0079] The bus 201 may be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 2 The bus 201 is represented by only one line, but it does not mean that there is only one bus or one type of bus. The bus 201 may include a path for transmitting information between various components of the computer device 200 (for example, the memory 203, the processor 202, and the communication interface 204).

[0080] The processor 202 may include any one or more of a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor (MP), or a digital signal processor (DSP).

[0081] The memory 203 may include a volatile memory, such as a random access memory (RAM). The memory 203 may also include a non-volatile memory, such as a read-only memory (ROM), a flash memory, a hard disk drive (HDD), or a solid state drive (SSD).

[0082] The memory 203 stores executable program codes, and the processor 202 executes the executable program codes to respectively implement the functions of the acquisition module, the sampling module, the determination module, and the mixing module, thereby implementing the electromechanical equipment installation and monitoring method applied to the building area. That is, the memory 203 stores instructions for executing the electromechanical equipment installation and monitoring method applied to the building area.

[0083] The communication interface 204 uses a transceiver module such as, but not limited to, a network interface card or a transceiver to implement communication between the computer device 200 and other devices or a communication network.

[0084] An embodiment of the present application also provides a chip, which includes a processor and a data interface. The processor reads instructions stored in a memory through the data interface to execute the above-mentioned electromechanical equipment installation and monitoring method applied to a building area.

[0085] The embodiment of the present application also provides a computer-readable storage medium. The above-mentioned computer-readable storage medium can be any available medium that can be stored by a computing device or a data storage device such as a data center that contains one or more available media. The above-mentioned available medium can be a magnetic medium (for example, a floppy disk, a hard disk, a tape), an optical medium (for example, a DVD), or a semiconductor medium (for example, a solid-state hard disk), etc. The computer-readable storage medium includes instructions, and the above-mentioned instructions instruct the computing device to execute the above-mentioned electromechanical equipment installation and monitoring method applied to the building area.

[0086] The technical features of the above embodiments can be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0087] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the protection scope of the technical solutions of the embodiments of the present application.

Claims

1. A method for installing and monitoring electromechanical equipment in a building area, comprising: Collecting building data in the building area where the electromechanical equipment is to be installed by means of an electromechanical equipment installation monitoring device, wherein the building data includes: a set of wide-angle images of buildings corresponding to the building area; Performing coding processing on each electromechanical device to be installed in the building area to generate an electromechanical device coding identification to obtain an electromechanical device coding identification group; Generate an optimized building wide-angle image set through the building wide-angle image set, wherein the optimized building wide-angle image is an image obtained by locally fusion optimization of multiple building wide-angle images; Performing image stitching on each optimized building wide-angle image in the optimized building wide-angle image set to obtain a building area stitching image; Generate an original building area model corresponding to the building area according to the building area spliced ​​image and a pre-trained building information generation model; Acquire the electromechanical equipment model information corresponding to each electromechanical equipment code identification in the electromechanical equipment code identification group to obtain the electromechanical equipment model information group, wherein the electromechanical equipment model information includes: electromechanical equipment model, installation location information, and equipment size information; Filling the original building area model according to the electromechanical equipment model information group and the electromechanical equipment code identification group to obtain a target building area model; According to the target building area model, controlling the associated installation equipment to perform installation processing on each electromechanical equipment to be installed; In response to determining that each electromechanical equipment has been installed, the electromechanical equipment installation monitoring device is controlled to collect building data of the building area after installation as target building data, and to perform position verification on each installed electromechanical equipment based on the target building data.

2. The electromechanical equipment installation and monitoring method applied to the building area according to claim 1 is characterized in that: The step of generating an original building area model corresponding to the building area according to the building area stitched image and a pre-trained building information generation model comprises: Generate an initial building area model and building area model information according to the building area spliced ​​image and the building information generation model, wherein the building area model information includes: a building area model element information set, the building area model element information includes: an area element type, an area element feature vector and an area element position information, and the area element position information represents the position of the building area model element corresponding to the building area model element information in the initial building area model; For each building area model element information in the building area model element information set, the following processing steps are performed: According to the area element type and the area element feature vector included in the building area model element information, determining whether there is a building area model element matching the building area model element information in a preset building area model element library; In response to the existence of a matching building area model element in the building area model element library, determining the building area model element matching the building area model element information as a candidate building area model element; The initial building area model is updated according to each candidate building area model element to generate an updated initial building area model as the original building area model.

3. The electromechanical equipment installation and monitoring method for use in a building area according to claim 2, characterized in that: The step of generating a model according to the building area stitching image and the building information to generate an initial building area model and building area model information includes: Based on the encoder included in the building information generation model, generate a mosaic image coding feature corresponding to the building area mosaic image; Generate image decoding features corresponding to the spliced ​​image encoding features through a decoder included in the building information generation model; Generate an image extraction feature corresponding to the image decoding feature through a feature extraction model included in the building information generation model; Generate adjustment parameters corresponding to the building area spliced ​​image through the threshold adjustment network included in the building information generation model; An initial building area model and building area model information are generated by using the adjustment parameters and the image extraction features.

4. The electromechanical equipment installation and monitoring method for use in a building area according to claim 2, characterized in that: The method of filling the original building area model according to the electromechanical equipment model information group and the electromechanical equipment code identification group to obtain the target building area model includes: For each mechatronic device model information in the mechatronic device model information group, the following filling steps are performed: Filling the electromechanical equipment model included in the electromechanical equipment model information into the installation position of the corresponding installation position information in the original building area model; Determine the electromechanical equipment coding identifier corresponding to the electromechanical equipment model information as the target electromechanical equipment coding identifier; Marking a target electromechanical equipment code identification on the electromechanical equipment model of the electromechanical equipment model information corresponding to the original building area model; The filled original building area model is determined as the target building area model.

5. A computer device, wherein: The computer device comprises a processor, a memory, and a computer program stored in the memory and executable by the processor, wherein when the computer program is executed by the processor, the steps of the method according to any one of claims 1 to 4 are implemented.

6. A computer-readable storage medium, wherein: The computer-readable storage medium stores a computer program, wherein when the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 4 are implemented.

Images