Comparison method and device of indoor distribution route and electronic equipment
By constructing a three-dimensional standard model of the room system and integrating real images, and automatically comparing differences, the problem of bias in manual comparison is solved, and the accuracy and efficiency of comparison are improved.
Patent Information
- Application Number
- CN202411884970.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-19
- Publication Date
- 2025-04-22
AI Technical Summary
In the prior art, the comparison of room branch routing mainly relies on manual comparison design drawings, which are prone to deviations and errors, which affect the accuracy and efficiency of the comparison.
Augmented reality images are obtained by building a three-dimensional standard model of the room segment system based on computer-aided design (CAD) drawings and fusing the real image with the three-dimensional standard model. Then, the augmented reality image and the real image are compared to the differential pixels, and the comparison results of the room division system are obtained based on the differential pixels.
Automatic comparison of the difference between the three-dimensional standard model and the real image is achieved, reducing the deviation caused by human subjective factors and improving the accuracy and efficiency of the comparison.
Smart Images
Figure CN119862616A_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present application relate to the field of mobile communication technology, and in particular to a method, device and electronic device for comparing indoor routing. Background Art
[0002] With the continuous advancement of technology and the growing needs of users, the complexity of indoor distributed systems (especially the routing pipeline layout) is constantly increasing, becoming a major challenge to ensure network performance and maintenance management.
[0003] In the related technology, the comparison of indoor routing is usually done manually by maintenance personnel according to the design drawings. During the comparison process, the maintenance personnel need to compare with the computer-aided design (CAD) drawings while observing with their eyes, which may lead to deviations. Summary of the invention
[0004] The embodiments of the present application provide a method, device and electronic device for comparing indoor distributed routing, which can at least solve the problem that there may be deviations in manual comparison of indoor distributed systems.
[0005] In order to solve the above technical problems, this application is implemented as follows: In a first aspect, an embodiment of the present application provides a method for comparing indoor routing, the method comprising: constructing a three-dimensional standard model of the indoor system based on a computer-aided design (CAD) drawing of the indoor system, wherein the CAD drawing is used to indicate the routing pipeline layout of the indoor system; fusing a real image corresponding to the indoor system with an image of the three-dimensional standard model to obtain an augmented reality image; comparing the augmented reality image with the real image to obtain difference pixels between the augmented reality image and the real image; obtaining a comparison result corresponding to the indoor system based on the difference pixels, wherein the comparison result is used to indicate the difference between the CAD drawing corresponding to the indoor system and the real scene.
[0006] In a second aspect, a device for comparing indoor routing is provided, the device comprising: a construction module, for constructing a three-dimensional standard model of the indoor system based on a computer-aided design (CAD) drawing of the indoor system, wherein the CAD drawing is used to indicate the routing pipeline layout of the indoor system; a first acquisition module, for fusing a real image corresponding to the indoor system with an image of the three-dimensional standard model to obtain an augmented reality image; a second acquisition module, for comparing the augmented reality image with the real image to obtain difference pixels between the augmented reality image and the real image; a third acquisition module, for obtaining a comparison result corresponding to the indoor system based on the difference pixels, wherein the comparison result is the difference between the CAD drawing corresponding to the indoor system and the real scene.
[0007] In a third aspect, an embodiment of the present application provides an electronic device, comprising a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the method described in the first aspect above are implemented.
[0008] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the method described in the first aspect above are implemented.
[0009] In a fifth aspect, an embodiment of the present application provides a computer program product, which includes a computer program stored on a non-transitory computer-readable storage medium, and the computer program includes program instructions. When the program instructions are executed by a computer, the computer executes the steps of the method described in the first aspect above.
[0010] The technical solution provided by this application may have the following beneficial effects: In an embodiment of the present application, a three-dimensional standard model of the room-divided system can be constructed based on the computer-aided design CAD drawings of the room-divided system, and then the real image corresponding to the room-divided system is fused with the image of the three-dimensional standard model to obtain an augmented reality image; the augmented reality image is compared with the real image to obtain the difference pixels between the augmented reality image and the real image; and the comparison result corresponding to the room-divided system is obtained based on the difference pixels. In the above manner, the comparison result of the room-divided system can be obtained by automatically comparing the difference between the augmented reality image and the real image of the three-dimensional standard model, which can reduce the deviation caused by human subjective factors.
[0011] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS
[0012] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.
[0013] Figure 1 A schematic diagram of a flow chart of a method for comparing room-divided routing provided in an embodiment of the present application is shown; Figure 2 A schematic diagram showing another method for comparing room-divided routing provided in an embodiment of the present application is shown; Figure 3 A schematic diagram of the structure of a comparison device for room-divided routing provided in an embodiment of the present application is shown; Figure 4 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application is shown; Figure 5 A schematic structural diagram of another electronic device provided in an embodiment of the present application is shown. DETAILED DESCRIPTION
[0014] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.
[0015] With the rapid development of information technology, wireless communication networks have become one of the indispensable infrastructures in modern society. They support the operation of key areas such as people's daily communications, data transmission, Internet of Things applications, and smart cities. As an important part of the wireless communication network, the indoor distribution system plays a vital role in improving the quality of wireless signal coverage inside buildings and enhancing user experience. However, with the continuous advancement of technology and the growing needs of users, the complexity of indoor distribution systems is also increasing, especially the layout of routing pipelines, which has become an important challenge to ensure network performance and maintenance management.
[0016] The indoor distribution system (abbreviated as indoor distribution system) is a successful solution for indoor user groups to improve the mobile communication environment in buildings. It can use relevant technical means to evenly distribute the signals of mobile communication base stations in every corner of the room, thereby ensuring that the indoor area has ideal signal coverage.
[0017] Figure 1 A schematic diagram of a method for comparing room-divided routing provided by an exemplary embodiment of the present application is shown. The method can be executed by an electronic device, which can be a terminal such as a mobile phone or a computer. Figure 1As shown, the method mainly includes the following steps: S101: constructing a three-dimensional standard model of the room-divided system based on the computer-aided design (CAD) drawings of the room-divided system.
[0018] Wherein, the CAD drawing is used to indicate the routing pipeline layout of the indoor distribution system.
[0019] In the embodiment of the present application, the computer-aided design CAD drawings of the room-divided system can be obtained, and then a three-dimensional standard model of the room-divided system can be constructed according to the drawings. This can avoid manual recognition of CAD drawings, improve the accuracy of room-divided routing comparison, and reduce errors.
[0020] In practical applications, the process of constructing a three-dimensional standard model of a room distribution system can be performed by manual three-dimensional modeling or automatic modeling, which is not specifically limited in the embodiments of the present application.
[0021] In an optional implementation, constructing a three-dimensional standard model of the room-divided system based on a computer-aided design (CAD) drawing of the room-divided system may include the following steps: Step 1, obtain the primitive information of at least one component in the CAD drawing; in the embodiment of the present application, the primitive information of the component layer in the CAD drawing can be extracted to obtain the primitive information of at least one component. In practical applications, components include 12 feeders, two power dividers, couplers, etc., which are important components of the room distribution system. In practical applications, the primitive information of a component may include basic information of the component, such as name, type, number, etc., which can be used to distinguish different components; geometric features such as shape, size, position, etc. of the component may also be included. In practical applications, the primitive information of a component may also include the material type, color, texture, unit price, total price, etc. of the component. The embodiment of the present application does not specifically limit the specific content of the primitive information.
[0022] Step 2: Generate the three-dimensional modeling parameters of the component according to the graphic element information of the component. In the embodiment of the present application, the three-dimensional modeling parameters of the component can be generated according to the characteristics of different components. For example, the three-dimensional modeling parameters of the 12-feeder are the feeder starting point coordinates and the end point coordinates, the three-dimensional modeling parameters of the two-power divider are the model insertion point coordinates, the model angle and the three-axis ratio of the model, and the three-dimensional modeling parameters of the coupler are the model insertion point coordinates, the model angle and the three-axis ratio of the model, etc.
[0023] Step 3, according to the three-dimensional modeling parameters of the components, obtain a three-dimensional standard model of the room distribution system, wherein different components are colored with different colors; in the embodiment of the present application, different components are colored with different colors for subsequent comparison.
[0024] Step 4, lightweight processing is performed on the three-dimensional standard model to obtain the lightweight three-dimensional standard model. In the embodiment of the present application, the three-dimensional standard model is lightweight processed to facilitate rendering and display on the mobile terminal. In practical applications, the Draco mesh compression algorithm can be used to lightweight the obtained three-dimensional standard model, thereby saving space.
[0025] S102: Fusing the real image corresponding to the room distribution system with the image of the three-dimensional standard model to obtain an augmented reality image.
[0026] In the embodiment of the present application, the real image corresponding to the room partition system can be fused with the image of the three-dimensional standard model to obtain an augmented reality image. In this way, the room partition system on the drawing can be displayed in the form of an image, which is convenient for subsequent comparison.
[0027] In an optional implementation, before fusing the real image corresponding to the room separation system with the image of the three-dimensional standard model to obtain an augmented reality image, the method may further include the following steps: Step 1, obtain the first real image corresponding to the room distribution system, wherein the first real image carries a target mark, the first real image is obtained by a first camera, and the target mark is used to indicate the position of the mark point of the three-dimensional standard model in the real scene; in actual application, when constructing a three-dimensional standard model, the origin of the coordinate system of the three-dimensional standard model, a mark point on the Z axis, and a mark point on the X axis can be recorded. Then, in the real scene, find the points corresponding to the origin, the Z-axis mark point, and the X-axis mark point of the three-dimensional standard model, and make special marks, for example, the origin corresponds to the point in the real scene marked as a solid square, the Z-axis mark point corresponds to the point in the real scene marked as a solid equilateral triangle, and the X-axis mark point corresponds to the point in the real scene marked as a solid circle.
[0028] In an embodiment of the present application, a first real image carrying a target mark corresponding to the room distribution system taken by a first camera can be obtained. In practical applications, the first real image taken by the first camera at two different angles can be obtained. Step 2, determine the first pose of the first camera in the world coordinate system; in this embodiment of the present application, the first pose of the first camera in the world coordinate system can be determined. For the determination of the first pose of the first camera, in practical applications, the first pose can be directly obtained based on the built-in gyroscope in the first camera, or it can be based on a deep learning network, such as poseNet's pose estimation, which is not specifically limited in this embodiment of the present application.
[0029] Step 3, obtain the coordinates of the target mark in the world coordinate system according to the first posture, the intrinsic parameters and extrinsic parameters of the first camera, and the position of the target mark in the first real image; in this embodiment of the present application, the three-dimensional coordinates of the target mark in the world coordinate system can be obtained according to the first posture, the intrinsic and extrinsic parameters of the camera, and the position of the target mark in the first real image.
[0030] Step 4: Determine the origin offset and rotation angle between the three-dimensional standard model coordinate system and the world coordinate system of the three-dimensional standard model according to the coordinates of the target mark in the world coordinate system.
[0031] In an embodiment of the present application, the origin offset and rotation angle between the three-dimensional standard model coordinate system and the world coordinate system of the three-dimensional standard model can be determined according to the coordinates of the target mark in the world coordinate system (the origin offset and rotation angle are two important parameters that describe the position change of a graphic or object in a two-dimensional space).
[0032] In the above manner, the origin offset and rotation angle of the three-dimensional standard model coordinate system and the world coordinate system can be obtained according to the first real image carrying the target mark, the first camera shooting the first real image, and the internal and external parameters of the first camera, that is, the conversion relationship between the two coordinate systems can be obtained. This can prepare for the subsequent fusion of the real image and the image of the three-dimensional standard model.
[0033] In an optional implementation, the step of fusing the real image corresponding to the room separation system with the image of the three-dimensional standard model to obtain an augmented reality image may include the following steps: Step 1, obtaining a second posture of a second camera in the world coordinate system and a real image of the second camera in the second posture; In the embodiment of the present application, the second posture of the second camera in the world coordinate system and the real image of the second camera in the second posture can be obtained. In practical applications, the second posture is the posture of the second camera in the world coordinate system, which refers to the position and orientation information of the second camera relative to the world coordinate system. This usually includes the following information: (1) The position of the second camera: that is, the translation vector of the second camera in the world coordinate system. (2) The rotation of the second camera: that is, the rotation matrix or Euler angle of the second camera in the world coordinate system, indicating the orientation of the second camera. In practical applications, the focal length of the second camera, that is, the magnification of the second camera, can also be included, which can affect the perspective effect of the image. In practical applications, the built-in gyroscope in the second camera can be used to directly obtain the second posture, or the method based on the deep learning network can be used to determine the second posture, which is not specifically limited in the embodiment of the present application. Obtaining the second posture of the second camera in the world coordinate system and the real image of the second camera in the second posture can prepare for obtaining an augmented reality image. In practical applications, the real image can include the above-mentioned first real image, and the embodiment of the present application does not specifically limit the number of real images. The second camera may also include the first camera mentioned above, which is not specifically limited in the embodiment of the present application.
[0034] Step 2, obtaining a third pose of the second camera in the three-dimensional standard model coordinate system according to the origin offset and rotation angle between the three-dimensional standard model coordinate system and the world coordinate system and the second pose; In the embodiment of the present application, the third pose of the second camera in the three-dimensional standard model coordinate system can be obtained according to the origin offset and rotation angle of the three-dimensional standard model coordinate system and the world coordinate system and the second pose. The second camera can be transferred from the world coordinate system to the three-dimensional standard model coordinate system. In this way, it is easy to obtain the image of the three-dimensional standard model corresponding to the real image, which is convenient for image superposition and fusion to obtain an augmented reality image.
[0035] Step 3: superimpose and fuse the real image with the image of the three-dimensional standard model in the third posture to obtain an augmented reality image, wherein the transparency of the real image and the image of the three-dimensional standard model in the third posture is set to a preset value.
[0036] In an embodiment of the present application, the real image and the image of the three-dimensional standard model in the third posture can be superimposed and fused to obtain an augmented reality image. In practical applications, the real image and the two-dimensional image of the three-dimensional standard model in the third posture can be superimposed and fused according to the third posture of the second camera in the coordinate system of the three-dimensional standard model to generate an augmented reality image in the current camera posture. The third posture of the second camera in the three-dimensional standard model includes the three-axis pitch angle and three-dimensional coordinates of the second camera. Unity can be used to obtain the two-dimensional image of the three-dimensional standard model in the third posture, and the two-dimensional image is superimposed and fused with the real image taken by the second camera. During the fusion process, the transparency of the real image and the two-dimensional image of the model are set to a preset value, and the preset value is 1, that is, opaque.
[0037] Through the above method, each real image captured by the second camera can find the corresponding two-dimensional image of the three-dimensional standard model (the real image and the two-dimensional image show the scene in the same posture), and then through the superposition and fusion of the two images, the corresponding augmented reality image can be obtained, which can avoid the waste of real images, make full use of existing resources, and facilitate a more comprehensive comparison of augmented reality images with real images. Moreover, compared with matching the real image corresponding to the image of the three-dimensional standard model, the above method is more feasible and less difficult to implement, and can improve the efficiency of obtaining augmented reality images.
[0038] S103: Compare the augmented reality image with the real image to obtain difference pixels between the augmented reality image and the real image.
[0039] In the embodiment of the present application, the augmented reality image can be compared with the real image to obtain the difference pixels between the augmented reality image and the real image, which can improve the accuracy of the comparison and reduce the labor cost.
[0040] In an optional implementation, the comparing the augmented reality image with the real image to obtain the difference pixels between the augmented reality image and the real image may include the following steps: Step 1, using a trained image semantic segmentation model to perform semantic segmentation on the components in the real image to obtain first masks of different components in the real image; In the embodiment of the present application, the trained image semantic segmentation model can be used to perform semantic segmentation on various components in the real image to obtain masks of different components in the real image. For the semantic segmentation model of the image, in practical applications, the Mask R-CNN neural network model can be selected.
[0041] Step 2, obtaining second masks of different components in the augmented reality image according to the coloring of different components in the three-dimensional standard model; In an embodiment of the present application, the second mask of different components in the augmented reality image can be obtained according to the coloring of different components in the three-dimensional standard model. In practical applications, different components may be colored differently. For example, the omnidirectional antenna model is colored with (255, 0, 0), the two-power divider is colored with (0, 255, 0), the 5dB coupler is colored with (0, 0, 255), the 12-feeder is colored with (255, 255, 0), and the 78-feeder is colored with (0, 255, 255). Therefore, according to the coloring of different components, the second mask of different components in the augmented reality image can be obtained accordingly.
[0042] Step 3: Determine the overlap between the first mask and the second mask of the same type of components.
[0043] In the embodiment of the present application, the overlap between the first mask and the second mask of the same component can be determined. In practical applications, the general mask matrix uses bool variables as matrix units. Therefore, for the calculation of the overlap of two masks, the XOR logic operation of the two masks can be used to obtain the overlap matrix, in which the overlap pixels are False and the non-overlap pixels are True.
[0044] Step 4: When the first mask and the second mask do not completely overlap, obtain the difference pixels between the augmented reality image and the real image.
[0045] In the embodiment of the present application, the difference pixel between the augmented reality image and the real image can be obtained when the first mask and the second mask do not completely overlap. In practical applications, all True pixels in the overlap matrix can be extracted, and if the pixel is True in the augmented reality mask, the pixel can be determined as a difference pixel.
[0046] Through the above implementation method, the components in the augmented reality image and the real image can be compared in a targeted manner to obtain the difference pixels between the augmented reality image and the real image, which can improve the efficiency of comparing the design scene and the actual scene of the room distribution system. Moreover, by calculating the overlap between the first mask and the second mask to determine the difference pixels, the accuracy of the comparison can be improved.
[0047] S104: Obtaining a comparison result corresponding to the room separation system according to the difference pixels.
[0048] The comparison result is used to indicate the difference between the CAD drawing corresponding to the room distribution system and the actual scene.
[0049] In the embodiment of the present application, the comparison result between the CAD drawing corresponding to the room distribution system and the real scene can be obtained according to the difference pixels, so as to improve the accuracy of the comparison.
[0050] In an optional implementation, obtaining the comparison result corresponding to the room separation system according to the difference pixel may include: Highlighting corresponding pixels of the difference pixels in the augmented reality image to obtain a target augmented reality image; Determine that the target augmented reality image is a comparison result corresponding to the room separation system.
[0051] In the embodiment of the present application, the corresponding pixels in the augmented reality image can be highlighted according to the difference pixels, and the highlighted augmented reality image can be saved as the comparison result. By highlighting the difference pixels, the difference between the design scene and the real scene of the room division system can be more clearly displayed, which is convenient for subsequent operations.
[0052] In an embodiment of the present application, a three-dimensional standard model of the room-divided system can be constructed based on the computer-aided design CAD drawings of the room-divided system, and then the real image corresponding to the room-divided system is fused with the image of the three-dimensional standard model to obtain an augmented reality image; the augmented reality image is compared with the real image to obtain the difference pixels between the augmented reality image and the real image; and the comparison result corresponding to the room-divided system is obtained based on the difference pixels. Through the above method, it is not necessary for maintenance personnel to have professional ability to read engineering drawings, which can reduce training costs and time, and it is also possible to reduce errors caused by human subjective factors by automatically comparing the difference between the three-dimensional standard model and the real image.
[0053] Figure 2 A flow chart of another method for comparing room-divided routing provided by an exemplary embodiment of the present application is shown, and the method comprises the following steps: S201: construct a three-dimensional standard model; S202: fusing the real image with the three-dimensional standard model based on augmented reality technology to obtain an augmented reality image; S203: Identifying the difference pixels between the augmented reality image and the real image; S204: Highlight corresponding pixels in the augmented reality image according to the difference pixels, and save the highlighted augmented reality image as a comparison result.
[0054] The comparison method of room-divided routing provided in the embodiment of the present application may be performed by a subject Figure 3 The comparison device for room-divided routing shown in the figure. In the embodiment of the present application, the comparison device for room-divided routing executing the comparison method for room-divided routing is taken as an example to illustrate the comparison device for room-divided routing provided in the embodiment of the present application.
[0055] Figure 3 A schematic structural diagram of a comparison device for room-divided routing provided by an exemplary embodiment of the present application is shown. The comparison device for room-divided routing can implement all or part of the contents of the above-mentioned comparison embodiment of room-divided routing. The comparison device for room-divided routing includes: a construction module 301, a first acquisition module 302, a second acquisition module 303 and a third acquisition module 304.
[0056] In an embodiment of the present application, a construction module 301 is used to construct a three-dimensional standard model of the indoor distributed system based on a computer-aided design CAD drawing of the indoor distributed system, wherein the CAD drawing is used to indicate the routing pipeline layout of the indoor distributed system; a first acquisition module 302 is used to fuse a real image corresponding to the indoor distributed system with an image of the three-dimensional standard model to obtain an augmented reality image; a second acquisition module 303 is used to compare the augmented reality image with the real image to obtain difference pixels between the augmented reality image and the real image; a third acquisition module 304 is used to obtain a comparison result corresponding to the indoor distributed system based on the difference pixels, wherein the comparison result is the difference between the CAD drawing corresponding to the indoor distributed system and the real scene.
[0057] In an optional implementation, the construction module 301 is used to construct the three-dimensional standard model of the room-divided system based on the computer-aided design CAD drawing of the room-divided system, specifically for: Obtaining the graphic element information of at least one component in the CAD drawing; Generate three-dimensional modeling parameters of the component according to the graphic element information of the component, According to the three-dimensional modeling parameters of the components, a three-dimensional standard model of the room distribution system is obtained, wherein different components are colored with different colors; The three-dimensional standard model is lightweighted to obtain the lightweighted three-dimensional standard model.
[0058] In an optional implementation, the first acquisition module 302 is further configured to: Acquire a first real image corresponding to the room separation system, wherein the first real image carries a target mark, the first real image is acquired by a first camera, and the target mark is used to indicate the position of the mark point of the three-dimensional standard model in the real scene; Determine the first pose of the first camera in the world coordinate system; Obtaining coordinates of the target mark in the world coordinate system according to the first posture, the intrinsic parameters and the extrinsic parameters of the first camera, and the position of the target mark in the first real image; According to the coordinates of the target mark in the world coordinate system, the origin offset and the rotation angle between the three-dimensional standard model coordinate system and the world coordinate system of the three-dimensional standard model are determined.
[0059] In an optional implementation, the first acquisition module 302, when used to fuse the real image corresponding to the room separation system with the image of the three-dimensional standard model to obtain the augmented reality image, is specifically used to: Acquire a second posture of a second camera in the world coordinate system and a real image of the second camera in the second posture; Obtaining a third pose of the second camera in the three-dimensional standard model coordinate system according to the origin offset and the rotation angle between the three-dimensional standard model coordinate system and the world coordinate system and the second pose; The real image and the image of the three-dimensional standard model in the third posture are superimposed and fused to obtain an augmented reality image, wherein the transparency of the real image and the image of the three-dimensional standard model in the third posture is set to a preset value.
[0060] In an optional implementation, the second acquisition module 303, when used to compare the augmented reality image with the real image to obtain the difference pixels between the augmented reality image and the real image, is specifically used to: Perform semantic segmentation on the components in the real image using a trained image semantic segmentation model to obtain first masks of different components in the real image; Obtaining second masks of the different components in the augmented reality image according to the coloring of the different components in the three-dimensional standard model; Determining the overlap between the first mask and the second mask of the same type of components; When the first mask and the second mask do not completely overlap, difference pixels between the augmented reality image and the real image are obtained.
[0061] In an optional implementation, when the third acquisition module 304 is used to obtain the comparison result corresponding to the room separation system according to the difference pixel, it is specifically used to: Highlighting corresponding pixels of the difference pixels in the augmented reality image to obtain a target augmented reality image; Determine that the target augmented reality image is a comparison result corresponding to the room separation system.
[0062] The comparison device for indoor routing in the embodiment of the present application can be an electronic device or a component in an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc. It can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.
[0063] The comparison device for room-divided routing in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.
[0064] The comparison device for room-divided routing provided in the embodiment of the present application can achieve Figure 1 To avoid repetition, the various processes implemented by the method embodiment are not described here.
[0065] Alternatively, if Figure 4 As shown, the embodiment of the present application also provides an electronic device 400, including a processor 401 and a memory 402, the memory 402 stores a program or instruction that can be run on the processor 401, and the program or instruction is executed by the processor 401 to achieve the above Figure 1 The various steps of the indoor routing comparison method shown can achieve the same technical effect. To avoid repetition, they will not be repeated here.
[0066] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.
[0067] Figure 5FIG. 1 is a block diagram of another electronic device 500 according to an exemplary embodiment of the present application. The electronic device 500 may be implemented as a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart watch, a TV, etc. The electronic device 500 may also be referred to as a user device, a portable terminal, a laptop terminal, a desktop terminal, etc.
[0068] Typically, the electronic device 500 includes a processor 501 and a memory 502 .
[0069] The processor 501 may include one or more processing cores, such as a 4-core processor, a 5-core processor, etc. The processor 501 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). The processor 501 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 501 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 501 may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.
[0070] The memory 502 may include one or more computer-readable storage media, which may be non-transitory. The memory 502 may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 502 is used to store at least one instruction, which is used to be executed by the processor 501 to implement all or part of the steps in the comparison method of the room-divided routing shown in the method embodiment of the present application.
[0071] In some embodiments, the electronic device 500 may further optionally include: a peripheral device interface 503 and at least one peripheral device. The processor 501, the memory 502 and the peripheral device interface 503 may be connected via a bus or a signal line. Each peripheral device may be connected to the peripheral device interface 503 via a bus, a signal line or a circuit board. Specifically, the peripheral device includes: at least one of a radio frequency circuit 504, a display screen 505, a camera assembly 506, an audio circuit 507 and a power supply 508.
[0072] In some embodiments, the electronic device 500 further includes one or more sensors 509 , including but not limited to: an acceleration sensor 510 , a gyroscope sensor 511 , a pressure sensor 512 , an optical sensor 513 , and a proximity sensor 514 .
[0073] Those skilled in the art will understand that Figure 5 The structure shown in the figure does not constitute a limitation on the electronic device 500, and may include more or less components than those shown in the figure, or combine some components, or adopt a different component arrangement.
[0074] The embodiment of the present application also provides a computer-readable storage medium on which a program or instruction is stored, and when the program or instruction is executed by a processor, the above Figure 1 The various processes of the indoor routing comparison method shown can achieve the same technical effect. To avoid repetition, they will not be repeated here.
[0075] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.
[0076] The present application also provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the above Figure 1 The various processes of the indoor routing comparison method shown can achieve the same technical effect. To avoid repetition, they will not be repeated here.
[0077] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.
[0078] The present application also provides a computer program product, wherein the computer program product includes a computer program stored on a non-transitory computer-readable storage medium, wherein the computer program includes program instructions, and when the program instructions are executed by a computer, the above Figure 1The steps of the indoor routing comparison method shown in the figure can achieve the same technical effect. To avoid repetition, they will not be repeated here.
[0079] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the invention disclosed herein. The present application is intended to cover any modification, use or adaptation of the present application, which follows the general principles of the present application and includes common knowledge or customary techniques in the art that are not disclosed in the present application. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present application are indicated by the claims.
[0080] It should be understood that the present application is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.
Claims
1. A method for comparing indoor routing, characterized in that: include: Based on the computer-aided design (CAD) drawings of the room-divided system, a three-dimensional standard model of the room-divided system is constructed, wherein the CAD drawings are used to indicate the routing pipeline layout of the room-divided system; Fusing the real image corresponding to the room distribution system with the image of the three-dimensional standard model to obtain an augmented reality image; Comparing the augmented reality image with the real image to obtain difference pixels between the augmented reality image and the real image; Based on the difference pixels, a comparison result corresponding to the room-divided system is obtained, wherein the comparison result is used to indicate the difference between the CAD drawing corresponding to the room-divided system and the actual scene.
2. The method according to claim 1, characterized in that The three-dimensional standard model of the room-divided system is constructed based on the computer-aided design CAD drawing of the room-divided system, including: Obtaining the graphic element information of at least one component in the CAD drawing; Generate three-dimensional modeling parameters of the component according to the graphic element information of the component, According to the three-dimensional modeling parameters of the components, a three-dimensional standard model of the room distribution system is obtained, wherein different components are colored with different colors; The three-dimensional standard model is lightweighted to obtain the lightweighted three-dimensional standard model.
3. The method according to claim 2, characterized in that Before fusing the real image corresponding to the room separation system with the image of the three-dimensional standard model to obtain an augmented reality image, the method further includes: Acquire a first real image corresponding to the room separation system, wherein the first real image carries a target mark, the first real image is acquired by a first camera, and the target mark is used to indicate the position of the mark point of the three-dimensional standard model in the real scene; Determine the first pose of the first camera in the world coordinate system; Obtaining coordinates of the target mark in the world coordinate system according to the first posture, the intrinsic parameters and the extrinsic parameters of the first camera, and the position of the target mark in the first real image; According to the coordinates of the target mark in the world coordinate system, the origin offset and the rotation angle between the three-dimensional standard model coordinate system and the world coordinate system of the three-dimensional standard model are determined.
4. The method according to claim 3, characterized in that The step of fusing the real image corresponding to the room separation system with the image of the three-dimensional standard model to obtain an augmented reality image includes: Acquire a second posture of a second camera in the world coordinate system and a real image of the second camera in the second posture; Obtaining a third pose of the second camera in the three-dimensional standard model coordinate system according to the origin offset and the rotation angle between the three-dimensional standard model coordinate system and the world coordinate system and the second pose; The real image and the image of the three-dimensional standard model in the third posture are superimposed and fused to obtain an augmented reality image, wherein the transparency of the real image and the image of the three-dimensional standard model in the third posture is set to a preset value.
5. The method according to claim 2, characterized in that: The comparing the augmented reality image with the real image to obtain difference pixels between the augmented reality image and the real image includes: Perform semantic segmentation on the components in the real image using a trained image semantic segmentation model to obtain first masks of different components in the real image; Obtaining second masks of the different components in the augmented reality image according to the coloring of the different components in the three-dimensional standard model; Determining the overlap between the first mask and the second mask of the same type of components; When the first mask and the second mask do not completely overlap, difference pixels between the augmented reality image and the real image are obtained.
6. The method according to claim 1, characterized in that Obtaining a comparison result corresponding to the room separation system according to the difference pixels, including: Highlighting corresponding pixels of the difference pixels in the augmented reality image to obtain a target augmented reality image; Determine that the target augmented reality image is a comparison result corresponding to the room separation system.
7. A comparison device for room-based routing, characterized in that: include: A construction module, used to construct a three-dimensional standard model of the room-divided system based on a computer-aided design (CAD) drawing of the room-divided system, wherein the CAD drawing is used to indicate the routing pipeline layout of the room-divided system; A first acquisition module is used to fuse the real image corresponding to the room distribution system with the image of the three-dimensional standard model to obtain an augmented reality image; A second acquisition module is used to compare the augmented reality image with the real image to obtain difference pixels between the augmented reality image and the real image; The third acquisition module is used to obtain a comparison result corresponding to the room-divided system according to the difference pixels, wherein the comparison result is the difference between the CAD drawing corresponding to the room-divided system and the actual scene.
8. An electronic device, characterized in that: The electronic device comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the method according to any one of claims 1 to 6 are implemented.
9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a program or instruction, and when the program or instruction is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.
10. A computer program product, characterized in that The computer program product comprises a computer program stored on a non-transitory computer-readable storage medium, wherein the computer program comprises program instructions, and when the program instructions are executed by a computer, the computer is caused to perform the steps of the method according to any one of claims 1 to 6.