Abnormality detection method and device of equipment, storage medium and computer equipment

Abstract

The application discloses an abnormality detection method and device of equipment, a storage medium and computer equipment, and relates to the electrical equipment field, and mainly aims at improving the abnormality detection efficiency of equipment. The method comprises the following steps: obtaining three-dimensional parameter information and operation parameter information corresponding to each moment in the running process of the equipment to be detected; based on the three-dimensional parameter information and the operation parameter information, a preset three-dimensional model in the running process corresponding to the equipment to be detected is drawn; a real video image corresponding to a real scene where the equipment to be detected is located is determined, and the real video image is projected into a preset virtual reality display model; the preset three-dimensional model is projected into a target position corresponding to the real video image in the preset virtual reality display model; and based on the preset three-dimensional model at the target position, it is judged whether the equipment to be detected is abnormal. The application is suitable for detecting the abnormality of equipment.

Description

Technical Field

[0001] This invention relates to the field of electrical equipment, and in particular to a method, apparatus, storage medium, and computer device for detecting equipment malfunctions. Background Technology

[0002] Power supply equipment is the core of maintaining daily human life and is involved in many fields such as logistics, healthcare, emergency response services, and enterprise networks. The normal operation of power supply equipment is the foundation for the normal operation of human life. Therefore, the detection of abnormalities in power supply equipment is very important.

[0003] Currently, equipment anomaly detection is typically performed by having inspectors physically visit the equipment. However, this method is inefficient if inspectors are not present at the equipment location; they need to spend time reaching the equipment when an anomaly occurs. Summary of the Invention

[0004] This invention provides a method, apparatus, storage medium, and computer device for detecting device anomalies, which mainly improves the efficiency of device anomaly detection.

[0005] According to a first aspect of the present invention, a method for detecting anomalies in a device is provided, comprising:

[0006] Acquire the three-dimensional parameter information and operating parameter information of the device under test at various moments during operation;

[0007] Based on the three-dimensional parameter information and the operating parameter information, a preset three-dimensional model of the device under test during its operation is drawn.

[0008] Determine the real-world video image corresponding to the real-world scene where the device under test is located, and project the real-world video image onto a preset virtual reality display model;

[0009] The preset 3D model is projected onto the target position corresponding to the real video image in the preset virtual reality display model;

[0010] Based on a preset 3D model at the target location, it is determined whether the device to be detected is abnormal.

[0011] According to a second aspect of the present invention, an anomaly detection device for a device is provided, comprising:

[0012] The acquisition unit is used to acquire the three-dimensional parameter information and operating parameter information of the device under test at various moments during operation.

[0013] A drawing unit is used to draw a preset three-dimensional model of the device under test during its operation based on the three-dimensional parameter information and the operating parameter information.

[0014] The first projection unit is used to determine the real video image corresponding to the real scene where the device under test is located, and to project the real video image onto a preset virtual reality display model;

[0015] The second projection unit is used to project the preset three-dimensional model onto the target position corresponding to the real video image in the preset virtual reality display model;

[0016] The judgment unit is used to determine whether the device to be detected is abnormal based on a preset three-dimensional model at the target location.

[0017] According to a third aspect of the present invention, a computer-readable storage medium is provided having a computer program stored thereon, which, when executed by a processor, performs the following steps:

[0018] Acquire the three-dimensional parameter information and operating parameter information of the device under test at various moments during operation;

[0019] Based on the three-dimensional parameter information and the operating parameter information, a preset three-dimensional model of the device under test during its operation is drawn.

[0020] Determine the real-world video image corresponding to the real-world scene where the device under test is located, and project the real-world video image onto a preset virtual reality display model;

[0021] The preset 3D model is projected onto the target position corresponding to the real video image in the preset virtual reality display model;

[0022] Based on a preset 3D model at the target location, it is determined whether the device to be detected is abnormal.

[0023] According to a fourth aspect of the present invention, a computer device is provided, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to perform the following steps:

[0024] Acquire the three-dimensional parameter information and operating parameter information of the device under test at various moments during operation;

[0025] Based on the three-dimensional parameter information and the operating parameter information, a preset three-dimensional model of the device under test during its operation is drawn.

[0026] Determine the real-world video image corresponding to the real-world scene where the device under test is located, and project the real-world video image onto a preset virtual reality display model;

[0027] The preset 3D model is projected onto the target position corresponding to the real video image in the preset virtual reality display model;

[0028] Based on a preset 3D model at the target location, it is determined whether the device to be detected is abnormal.

[0029] According to the present invention, a method, apparatus, storage medium, and computer device for detecting equipment anomalies, compared with the current method of inspectors personally visiting the equipment site to detect equipment anomalies, the present invention obtains three-dimensional parameter information and operating parameter information corresponding to each moment of the equipment under test during operation; and based on the three-dimensional parameter information and the operating parameter information, draws a preset three-dimensional model of the equipment under test during operation; simultaneously, it determines the real-world video image corresponding to the real-world scene in which the equipment under test is located, and projects the real-world video image onto a preset virtual reality display model; then, it projects the preset three-dimensional model onto the target position corresponding to the real-world video image in the preset virtual reality display model; finally, based on the preset three-dimensional model at the target position, it determines whether the equipment under test has an anomaly. Therefore, by drawing the preset three-dimensional model corresponding to the equipment under test, projecting the preset three-dimensional model and the real-world video image in which the equipment under test is located onto the preset virtual reality display model, and finally determining whether the equipment under test has an anomaly based on the preset three-dimensional model in the preset virtual reality display model, the present invention avoids the time wasted by inspectors personally visiting the equipment site to detect equipment, thereby improving the efficiency of equipment anomaly detection. Attached Figure Description

[0030] The accompanying drawings, which are included to provide a further understanding of the invention and form part of this application, illustrate exemplary embodiments of the invention and, together with their description, serve to explain the invention and do not constitute an undue limitation thereof. In the drawings:

[0031] Figure 1 A flowchart of an anomaly detection method for a device provided by an embodiment of the present invention is shown;

[0032] Figure 2 A flowchart of another device anomaly detection method provided by an embodiment of the present invention is shown;

[0033] Figure 3 This diagram illustrates the structure of an anomaly detection device for an equipment according to an embodiment of the present invention.

[0034] Figure 4 This invention provides a schematic diagram of the structure of an anomaly detection device for another device.

[0035] Figure 5 A schematic diagram of the physical structure of a computer device provided in an embodiment of the present invention is shown. Detailed Implementation

[0036] The present invention will be described in detail below with reference to the accompanying drawings and embodiments. It should be noted that, unless otherwise specified, the embodiments and features described in the present application can be combined with each other.

[0037] Currently, the method of having inspectors personally go to the equipment site to inspect the equipment has a low efficiency in detecting equipment abnormalities because it takes time for the inspectors to arrive at the equipment site.

[0038] To address the above problems, embodiments of the present invention provide a method for detecting device anomalies, such as... Figure 1 As shown, the method includes:

[0039] 101. Obtain the three-dimensional parameter information and operating parameter information of the device under test at various times during operation.

[0040] The three-dimensional parameter information includes the external dimensions and internal structural dimensions of the equipment, while the operating parameter information includes the operating speed, operating power, and operating temperature of the equipment.

[0041] In this embodiment of the invention, to overcome the problem of low efficiency in anomaly detection of existing equipment, the invention draws a preset 3D model corresponding to the equipment to be tested, and projects the preset 3D model and the real-world video image of the equipment to be tested onto a preset virtual reality display model. Finally, based on the preset 3D model in the preset virtual reality display model, it determines whether the equipment to be tested has any anomalies. This avoids the time wasted by inspectors visiting the equipment site in person, thereby improving the efficiency of anomaly detection. This embodiment of the invention is mainly applied to scenarios involving the detection of equipment anomalies. The executing entity of this embodiment is a device or equipment capable of detecting equipment anomalies, which can be specifically located on the client or server side.

[0042] Specifically, when inspectors perform anomaly detection on equipment, they cannot observe the internal structural information of the equipment, i.e., they cannot observe the internal components, nor can they observe the dimensional parameters of the equipment. This results in low accuracy in detecting equipment anomalies. To improve the accuracy of anomaly detection, it is necessary to create a pre-defined 3D model of the equipment under test. Therefore, sensors must first be installed on the equipment under test to measure its external dimensions, internal structural dimensions, and the dimensions of each component, as well as the installation dimensions between components, in real time. Simultaneously, the sensors detect information such as the power, operating speed, and rotational speed of the equipment under test during operation. Then, based on the dimensional information and operating parameters of the equipment under test, a pre-defined 3D model of the equipment is created. Finally, based on the operating parameter information of the equipment at various times, a pre-defined 3D model that operates synchronously with the equipment under test is determined. Simultaneously, the preset 3D model during operation and the real-world scene image corresponding to the device under test are projected onto a preset virtual reality display model. Based on the preset 3D model displayed in the preset virtual reality display model, the testing personnel can detect whether the device under test has any abnormalities. It should be noted that through the preset 3D model in the preset virtual reality display model, the size information and real-time operating parameter information corresponding to the preset 3D model can be observed. Based on the structural information and surrounding environment information corresponding to the preset 3D model, the testing personnel can determine whether the device under test in the real-world scene has any abnormalities, avoiding the need for testing personnel to go to the site to test the device, thus improving the efficiency of detecting device abnormalities. At the same time, based on the preset 3D model, the testing personnel can observe the internal structural information of the device under test, thus improving the accuracy of detecting abnormalities in the device under test.

[0043] 102. Based on the three-dimensional parameter information and the operating parameter information, draw a preset three-dimensional model of the device under test during its operation.

[0044] In this embodiment of the invention, after obtaining the three-dimensional parameter information and the operating parameter information corresponding to the device under test, in order to accurately and quickly detect the abnormality of the device under test, it is first necessary to draw a preset three-dimensional model corresponding to the device under test. Specifically, the method for drawing the preset three-dimensional model corresponding to the device under test is to input the three-dimensional parameter information and the operating parameter information corresponding to the device under test into a preset three-dimensional image drawing model for image drawing to obtain the preset three-dimensional model corresponding to the device under test. Then, the preset three-dimensional model and the real scene image corresponding to the device under test are projected onto a preset virtual reality display model. The preset three-dimensional model and the display scene are integrated in the preset virtual reality display model. That is, in the preset virtual reality display model, a virtual-real combined space that seamlessly integrates virtual objects (preset three-dimensional models) into a real scene can be observed. Finally, based on the operation status of the preset three-dimensional model displayed in the virtual-real combined space, it is determined whether there is an abnormality in the device under test in the real scene. This avoids the need for multiple testing personnel to go to the device site for testing when there are multiple devices that need to be tested, thus saving manpower.

[0045] 103. Determine the real-world video image corresponding to the real-world scene where the device to be tested is located, and project the real-world video image onto a preset virtual reality display model.

[0046] The real-world video image is an image of the surrounding environment of the device under test in the real world. The preset virtual reality display model can be a HoloLens display device, which can be a head-mounted glasses type or a computer screen-like type.

[0047] In this embodiment of the invention, to obtain real-world video images corresponding to the real-world scene where the device under test is located, a camera can be installed on the device under test. The camera captures real-time video images of the device under test's surroundings in the real world and transmits these captured images to a preset virtual reality display device. Simultaneously, a preset 3D model corresponding to the device under test is also transmitted to the preset virtual reality display device, achieving fusion between the preset 3D model and the displayed video images. The position of the preset 3D model in the real-world video images is the same as the position of the device under test in the real-world video images. Finally, the person being tested can determine whether the device under test has any abnormalities by observing the preset preset 3D model in the preset virtual reality display model, thus improving the detection efficiency of abnormal situations of the device under test.

[0048] 104. Project the preset 3D model onto the target position corresponding to the real video image in the preset virtual reality display model.

[0049] In this embodiment of the invention, after obtaining the preset three-dimensional model corresponding to the device under test, in order to enable the testing personnel to observe the operating status and structural parameter information of the device under test in the office, it is necessary to project the preset three-dimensional model onto the preset virtual reality display model. Specifically, based on the first position information of the device under test in the real scene, the second position information of the preset three-dimensional model in the real video image on the preset virtual reality display model is determined. Finally, based on the second position information, the preset three-dimensional model is projected onto the preset virtual reality display model, so that the testing personnel can sit in the office and judge whether the device under test has any abnormalities by observing the operating information and structural information corresponding to the preset three-dimensional model in the preset virtual reality display model.

[0050] 105. Based on the preset three-dimensional model at the target location, determine whether the device to be detected is abnormal.

[0051] In this embodiment of the invention, after projecting both the real-world video image and the preset 3D model onto the preset virtual reality display model, the testing personnel can determine whether the device under test is abnormal by observing the operating status and component structure information of the preset unit model in the preset virtual reality display model. For example, if the preset 3D model on the preset virtual reality display device generates abnormal gas during operation, it is determined that the device under test is abnormal. If internal components of the preset 3D model suddenly fall off during operation, it is determined that the device under test is abnormal, and maintenance personnel need to be notified for repair. Thus, by drawing the preset 3D model corresponding to the device under test and projecting the preset 3D model and the real-world video image of the device under test onto the preset virtual reality display model, the testing personnel can ultimately determine whether the device under test is abnormal based on the preset 3D model in the preset virtual reality display model. This avoids the time wasted by the testing personnel going to the equipment site for testing, thereby improving the efficiency of equipment anomaly detection.

[0052] According to the present invention, a method for detecting equipment anomalies, compared with the current method of having inspectors personally visit the equipment site to detect anomalies, the present invention obtains three-dimensional parameter information and operating parameter information corresponding to each moment of the equipment under test during operation; and based on the three-dimensional parameter information and the operating parameter information, draws a preset three-dimensional model of the equipment under test during operation; simultaneously, it determines the real-world video image corresponding to the real-world scene in which the equipment under test is located, and projects the real-world video image onto a preset virtual reality display model; then, it projects the preset three-dimensional model onto the target position corresponding to the real-world video image in the preset virtual reality display model; finally, based on the preset three-dimensional model at the target position, it determines whether the equipment under test has an anomaly. Therefore, by drawing the preset three-dimensional model corresponding to the equipment under test, projecting the preset three-dimensional model and the real-world video image in which the equipment under test is located onto the preset virtual reality display model, and finally determining whether the equipment under test has an anomaly based on the preset three-dimensional model in the preset virtual reality display model, the present invention avoids the time wasted by inspectors personally visiting the equipment site for equipment inspection, thereby improving the efficiency of equipment anomaly detection.

[0053] Furthermore, to better illustrate the above-described process of detecting device anomalies, as a refinement and extension of the above embodiments, this invention provides another method for detecting device anomalies, such as... Figure 2 As shown, the method includes:

[0054] 201. Obtain the three-dimensional parameter information and operating parameter information of the device under test at various times during operation.

[0055] Specifically, the sensor can measure the three-dimensional parameter information and operating status information of the device under test at various times. The sensor is connected to the preset three-dimensional image rendering model. The three-dimensional parameter information and operating status information of the device under test at each time are transmitted to the preset three-dimensional image rendering model in real time. The three-dimensional image rendering model renders the preset three-dimensional model corresponding to the device under test based on the acquired three-dimensional parameter information and operating status information.

[0056] 202. Based on the three-dimensional parameter information and the operating parameter information, draw a preset three-dimensional model of the device under test during its operation.

[0057] In this embodiment of the invention, after acquiring three-dimensional parameter information such as the external dimensions and component dimensions of the device under test, as well as operating parameter information such as the speed and power of the device under test, using sensors, it is necessary to draw a preset three-dimensional model of the device under test in operation based on the acquired three-dimensional parameter information and the operating parameter information. Therefore, step 202 specifically includes: drawing a preset three-dimensional model of the device under test in operation using a preset three-dimensional image drawing model based on the three-dimensional parameter information and the operating parameter information.

[0058] The preset 3D image rendering model can be a SolidWorks model. Specifically, the 3D parameter information and operating parameter information acquired by the sensor are transmitted to the SolidWorks model in real time. Based on the 3D parameter information and operating parameter information, the SolidWorks model renders the preset 3D model corresponding to the device under test. Because the sensor acquires the 3D parameter information and operating parameter information corresponding to the device under test in real time, the operating state of the rendered preset 3D model is synchronized with the operating state of the device under test. After the preset 3D model is rendered, in order to reduce the differences in color and other aspects between the preset 3D model and the device under test, that is, to achieve the realism of the preset 3D model, it is necessary to render the preset 3D model. The specific rendering method is as follows: based on the entity effect corresponding to the device under test, the rendering parameters corresponding to the preset 3D model are determined; based on the rendering parameters, the preset 3D model is rendered to obtain the rendered preset 3D model.

[0059] Specifically, the physical appearance of the device under test is first determined. For example, if the external color and the colors of the internal components of the device under test are determined to be gray, and the color of the connectors is determined to be black, then based on the above coloring, the rendering color parameters corresponding to the preset 3D model can be determined. At the same time, based on the material of the device under test, the rendering material parameters corresponding to the preset 3D model can be determined. Finally, based on the various rendering parameters corresponding to the preset 3D model, the preset 3D model is rendered to obtain the rendered preset 3D model. Finally, the rendered preset 3D model is projected onto the preset virtual reality display model. Based on the rendered preset 3D model displayed in the preset virtual reality display model, the testing personnel determine whether the device under test has any abnormalities.

[0060] 203. Determine the real-world video image corresponding to the real-world scene in which the device under test is located.

[0061] Specifically, by installing a camera on the device under test, real-time video images corresponding to the real-world scene in which the device under test is located can be acquired. The camera is connected to the preset virtual reality display device, and the camera transmits the captured real-world video images at various times to the preset virtual reality display device in real time.

[0062] 204. Determine the first preset coordinate system corresponding to the real video image in the real scene, and determine the first coordinate information of the real video image in the first preset coordinate system.

[0063] In this embodiment of the invention, in order to project the real video image onto the preset virtual reality display model, it is first necessary to determine the first coordinate system of the real video image in the real scene. If the real scene where the device to be detected is located is a factory, then the first preset coordinate system in the factory is determined, and the first coordinate information of each point in the real video image in the first preset coordinate system is determined using a camera device. At the same time, the second preset coordinate system in the preset virtual reality display model is determined, as well as the coordinate transformation matrix for transforming the coordinates from the first preset coordinate system to the second preset coordinate system is determined. Finally, based on the coordinate transformation matrix and the first coordinate information, the real video image is projected onto the preset virtual reality display model.

[0064] 205. Determine the second preset coordinate system in the preset virtual reality display device, and determine the coordinate transformation matrix for the coordinate transformation from the first preset coordinate system to the second preset coordinate system.

[0065] In this embodiment of the invention, in order to project the real-world video image corresponding to the real-world scene where the device under test is located into the preset virtual reality display model, it is first necessary to determine the second preset coordinate system corresponding to the preset virtual reality display model, and determine the coordinate transformation matrix for the coordinate transformation from the first preset coordinate system in the real-world scene to the second preset coordinate system. Based on this, step 205 specifically includes: determining a common reference point in the first preset coordinate system and the second preset coordinate system; determining the third coordinate information of the common reference point in the first preset coordinate system, and determining the fourth coordinate information of the common reference point in the second preset coordinate system; and determining the coordinate transformation matrix for the coordinate transformation from the first preset coordinate system to the second preset coordinate system based on the third coordinate information and the fourth coordinate information.

[0066] The common reference point can be a marker, such as a QR code. It should be noted that the marker can also be a graphic marker or a character marker. This embodiment of the invention does not make any specific limitation. The marker is affixed to the device to be tested, and the marker can be displayed in the camera device in the preset virtual reality display model.

[0067] Specifically, the common reference point is marked in the device to be tested, so the third coordinate information of the common reference point in the first preset coordinate system can also be read. At the same time, the common reference point is within the field of view that the camera device can observe. The camera device is connected to the preset virtual reality display model. The second preset coordinate system in the preset virtual reality display model is the coordinate system in the camera device. Therefore, the fourth coordinate information corresponding to the common reference point can be read in the second preset coordinate system of the preset virtual reality display model. Through the third coordinate information of the common reference point in the first preset coordinate system and the fourth coordinate information in the second preset coordinate system, the coordinate transformation matrix for converting the real video image in the real scene to the preset virtual reality display model can be determined. Finally, based on the coordinate transformation matrix and the first coordinate information of the real video image in the real scene, the second coordinate information of the real video image in the second preset coordinate system can be determined. Finally, based on the second coordinate information, the real video image is projected onto the preset virtual reality display model. It should be noted that when the common reference point moves relative to the position of the camera device in the preset virtual reality display model, the position of the identified common reference point in the second preset coordinate system corresponding to the preset virtual reality display model changes. At this time, it is necessary to recalculate the coordinate transformation matrix from the first preset coordinate system to the second preset coordinate system to update the second preset coordinate system corresponding to the preset virtual reality display model. When the common reference point is outside the field of view of the camera device, the second preset coordinate system in the preset virtual reality display model is updated based on SLAM positioning. The SLAM algorithm can construct the real scene where the device to be detected is located and determine the position coordinates of the camera device in the real scene. When relative movement occurs, the position coordinates are updated to realize the update of the second preset coordinate system in the preset virtual reality display model.

[0068] 206. Based on the coordinate transformation matrix and the first coordinate information, determine the second coordinate information of the real video image in the second preset coordinate system.

[0069] Specifically, based on the coordinate transformation matrix and the first coordinate information, each point in the real video image is transformed into a preset virtual reality display model, that is, the real scene where the device to be detected is located is projected into the preset virtual reality display model. For example, the third coordinate information corresponding to the common reference point is [x h ,y h ,z h The fourth coordinate information corresponding to the common reference point is [x] v ,y v ,z v Then, using the third coordinate information and the fourth coordinate information, the coordinate transformation matrix for the coordinate transformation from the first preset coordinate system to the second preset coordinate system can be determined as b, where [x v ,y v ,z v ] T =b[x h ,y h ,z h ] T If the coordinates of a point in the real video image in the first preset coordinate system are [2,5,9], then the second coordinate information of that point in the second preset coordinate system is b[2,5,9]. T Similarly, the second coordinate information corresponding to each point of the real video image in the second preset coordinate system can be determined, thereby projecting the real video image from the real scene onto the preset virtual reality display model.

[0070] 207. Based on the second coordinate information, project the real video image onto the preset virtual reality display model.

[0071] Specifically, after determining the second coordinate information of the real video image in the second preset coordinates based on the coordinate transformation matrix and the first coordinate information, the real video image can be projected onto the preset virtual reality display model. At the same time, the preset three-dimensional model is projected onto the target position corresponding to the real video image in the preset virtual reality display model. By observing the operating status and structural parameters corresponding to the preset three-dimensional model in the preset virtual reality display model, the testing personnel can know whether the device under test has any abnormalities.

[0072] 208. Project the preset 3D model onto the target position corresponding to the real video image in the preset virtual reality display model.

[0073] In this embodiment of the invention, in order to efficiently and accurately determine whether the device under test is abnormal, it is also necessary to project the preset 3D model onto the target position corresponding to the real video image in the preset virtual reality display model. Based on this, step 208 specifically includes: determining the fifth coordinate information of the device under test in the first preset coordinate system; determining the sixth coordinate information of the preset 3D model corresponding to the device under test in the second preset coordinate system based on the coordinate transformation matrix and the fifth coordinate information; and projecting the preset 3D model onto the target position corresponding to the real video image in the preset virtual reality display model based on the sixth coordinate information.

[0074] Specifically, in order to achieve a complete integration of virtual and reality, the preset 3D model needs to be projected onto the real scene. In order to improve the detection accuracy of abnormal conditions of the device under test, the position of the preset 3D model in the real scene should be the same as the position of the device under test in the real scene. Therefore, it is first necessary to determine the fifth coordinate information of the device under test in the first preset coordinate system, and based on the coordinate transformation matrix of the first preset coordinate system to the second preset coordinate system and the fifth coordinate system, determine the sixth coordinate information of the device under test in the preset virtual reality display model. The sixth coordinate information is determined as the coordinate information corresponding to the preset 3D model, which is the target position. Finally, based on the sixth coordinate information, the preset 3D model is projected onto the preset virtual reality display model.

[0075] 209. Based on the preset three-dimensional model at the target location, determine whether the device to be detected is abnormal.

[0076] In this embodiment of the invention, after projecting the real scene where the device to be tested is located and the preset three-dimensional model onto the preset virtual reality display model, the testing personnel need to determine whether the device to be tested is abnormal based on the preset three-dimensional model displayed in the preset virtual reality display model. Based on this, step 209 specifically includes: determining whether the device to be tested is abnormal based on the structural parameter information and environmental information corresponding to the preset three-dimensional model at the target location.

[0077] Specifically, the inspectors can simultaneously observe the real scene and the virtual 3D model in the preset virtual reality display model, thus achieving the fusion of the real world and virtual images. The preset virtual reality display model can display the structural parameter information, operating status information, and environmental information corresponding to the preset 3D model in real time. Based on the information displayed in the preset virtual reality display model, the inspectors can determine whether the device under test is abnormal. For example, when the device under test is operating normally, the positional distance between two important components is 50mm. If, during operation, the positional distance between these two components changes to 100mm as shown in the preset virtual reality display model, then it is determined that the device under test is abnormal. At the same time, if abnormal smoke is observed being emitted from the preset 3D model in the preset virtual reality display model during operation, it is determined that the device under test is abnormal, and relevant personnel need to go to the site to inspect the device under test.

[0078] According to another method for detecting equipment anomalies provided by the present invention, compared with the current method of having inspectors personally go to the equipment site to detect equipment anomalies, the present invention obtains the three-dimensional parameter information and operating parameter information corresponding to each moment of the equipment under test during operation; and based on the three-dimensional parameter information and the operating parameter information, draws a preset three-dimensional model of the equipment under test during operation; simultaneously, it determines the real video image corresponding to the real scene in which the equipment under test is located, and projects the real video image onto a preset virtual reality display model; then, it projects the preset three-dimensional model onto the target position corresponding to the real video image in the preset virtual reality display model; finally, based on the preset three-dimensional model at the target position, it determines whether the equipment under test has an anomaly. Therefore, by drawing the preset three-dimensional model corresponding to the equipment under test, projecting the preset three-dimensional model and the real video image in which the equipment under test is located onto the preset virtual reality display model, and finally determining whether the equipment under test has an anomaly based on the preset three-dimensional model in the preset virtual reality display model, the present invention avoids the time wasted by inspectors personally going to the equipment site for equipment inspection, thereby improving the efficiency of equipment anomaly detection.

[0079] Furthermore, as Figure 1 In specific implementation, embodiments of the present invention provide an anomaly detection device for a device, such as... Figure 3 As shown, the device includes: an acquisition unit 31, a drawing unit 32, a first projection unit 33, a second projection unit 34, and a judgment unit 35.

[0080] The acquisition unit 31 can be used to acquire the three-dimensional parameter information and operating parameter information of the device under test at various times during operation.

[0081] The drawing unit 32 can be used to draw a preset three-dimensional model of the device under test during its operation based on the three-dimensional parameter information and the operating parameter information.

[0082] The first projection unit 33 can be used to determine the real video image corresponding to the real scene where the device under test is located, and project the real video image onto a preset virtual reality display model.

[0083] The second projection unit 34 can be used to project the preset three-dimensional model onto the target position corresponding to the real video image in the preset virtual reality display model.

[0084] The judgment unit 35 can be used to determine whether the device to be detected is abnormal based on a preset three-dimensional model at the target location.

[0085] In specific application scenarios, in order to project the real-world video images onto a preset virtual reality display model, such as... Figure 4 As shown, the first projection unit 33 includes a first determining module 331 and a first projection module 332.

[0086] The first determining module 331 can be used to determine the first preset coordinate system corresponding to the real video image in the real scene, and to determine the first coordinate information of the real video image in the first preset coordinate system.

[0087] The first determining module 331 can also be used to determine the second preset coordinate system in the preset virtual reality display device, and to determine the coordinate transformation matrix for the coordinate transformation from the first preset coordinate system to the second preset coordinate system.

[0088] The first determining module 331 can be specifically used to determine the second coordinate information of the real video image in the second preset coordinate system based on the coordinate transformation matrix and the first coordinate information.

[0089] The first projection module 332 can be used to project the real video image onto the preset virtual reality display model based on the second coordinate information.

[0090] In a specific application scenario, in order to determine the coordinate transformation matrix for the coordinate transformation from the first preset coordinate system to the second preset coordinate system, the first determining module 331 can be specifically used to determine a common reference point in the first preset coordinate system and the second preset coordinate system; determine the third coordinate information of the common reference point in the first preset coordinate system, and determine the fourth coordinate information of the common reference point in the second preset coordinate system; and determine the coordinate transformation matrix for the coordinate transformation from the first preset coordinate system to the second preset coordinate system based on the third coordinate information and the fourth coordinate information.

[0091] In a specific application scenario, in order to project the preset 3D model onto the target position corresponding to the real video image in the preset virtual reality display model, the second projection unit 34 includes a second determining module 341 and a second projection module 342.

[0092] The second determining module 341 can be used to determine the fifth coordinate information of the device to be detected in the first preset coordinate system.

[0093] The second determining module 341 can be specifically used to determine the sixth coordinate information of the preset three-dimensional model corresponding to the device to be detected in the second preset coordinate system based on the coordinate transformation matrix and the fifth coordinate information.

[0094] The second projection module 342 can be used to project the preset three-dimensional model onto the target position corresponding to the real video image in the preset virtual reality display model based on the sixth coordinate information.

[0095] In a specific application scenario, in order to draw a preset three-dimensional model of the device under test during its operation, the drawing unit 32 can be used to draw a preset three-dimensional model of the device under test during its operation based on the three-dimensional parameter information and the operation parameter information, using a preset three-dimensional image drawing model.

[0096] In specific application scenarios, in order to determine whether the device under test is abnormal, the judgment unit 35 can be used to determine whether the device under test is abnormal based on the structural parameter information and environmental information corresponding to the preset three-dimensional model at the target location.

[0097] In specific application scenarios, in order to render the preset three-dimensional model, the device further includes a determining unit 36 ​​and a rendering unit 37.

[0098] The determining unit 36 ​​can be used to determine the rendering parameters corresponding to the preset 3D model based on the entity effect corresponding to the device to be detected.

[0099] The rendering unit 37 can be used to render the preset 3D model based on the rendering parameters to obtain the rendered preset 3D model.

[0100] It should be noted that other corresponding descriptions of the functional modules involved in the anomaly detection device provided in this embodiment of the invention can be found in [reference]. Figure 1 The corresponding description of the method shown will not be repeated here.

[0101] Based on the above, Figure 1 Accordingly, this embodiment of the invention also provides a computer-readable storage medium storing a computer program that, when executed by a processor, performs the following steps: acquiring three-dimensional parameter information and operating parameter information corresponding to various moments during the operation of the device under test; drawing a preset three-dimensional model of the device under test during its operation based on the three-dimensional parameter information and the operating parameter information; determining a real video image corresponding to the real scene where the device under test is located, and projecting the real video image onto a preset virtual reality display model; projecting the preset three-dimensional model onto a target position corresponding to the real video image in the preset virtual reality display model; and determining whether the device under test has any abnormalities based on the preset three-dimensional model at the target position.

[0102] Based on the above, Figure 1 The method shown and as Figure 3 The embodiment of the device shown in the invention also provides a physical structure diagram of a computer device, such as... Figure 5 As shown, the computer device includes: a processor 41, a memory 42, and a computer program stored in the memory 42 and executable on the processor. Both the memory 42 and the processor 41 are mounted on a bus 43. When the processor 41 executes the program, it performs the following steps: acquiring three-dimensional parameter information and operating parameter information corresponding to each moment of the device under test during operation; drawing a preset three-dimensional model of the device under test during its operation based on the three-dimensional parameter information and the operating parameter information; determining the real-world video image corresponding to the real-world scene where the device under test is located, and projecting the real-world video image onto a preset virtual reality display model; projecting the preset three-dimensional model onto a target position corresponding to the real-world video image in the preset virtual reality display model; and determining whether the device under test has any abnormalities based on the preset three-dimensional model at the target position.

[0103] Through the technical solution of this invention, the invention acquires three-dimensional parameter information and operating parameter information corresponding to each moment of the device under test during operation; and based on the three-dimensional parameter information and the operating parameter information, draws a preset three-dimensional model of the device under test during operation; simultaneously, it determines the real-world video image corresponding to the real-world scene in which the device under test is located, and projects the real-world video image onto a preset virtual reality display model; then, it projects the preset three-dimensional model onto the target position corresponding to the real-world video image in the preset virtual reality display model; finally, based on the preset three-dimensional model at the target position, it determines whether the device under test has any abnormalities. Therefore, by drawing a preset three-dimensional model corresponding to the device under test, projecting the preset three-dimensional model and the real-world video image in which the device under test is located onto a preset virtual reality display model, and finally determining whether the device under test has any abnormalities based on the preset three-dimensional model in the preset virtual reality display model, this invention avoids the time wasted by inspection personnel personally going to the equipment site for inspection, thereby improving the efficiency of equipment abnormality detection.

[0104] It is obvious to those skilled in the art that the modules or steps of the present invention described above can be implemented using general-purpose computing devices. They can be centralized on a single computing device or distributed across a network of multiple computing devices. Optionally, they can be implemented using computer-executable program code, thereby storing them in a storage device for execution by a computing device. In some cases, the steps shown or described can be performed in a different order than those presented herein, or they can be fabricated as separate integrated circuit modules, or multiple modules or steps can be fabricated as a single integrated circuit module. Thus, the present invention is not limited to any particular combination of hardware and software.

[0105] The above description is merely a preferred embodiment of the present invention and is not intended to limit the invention. Various modifications and variations can be made to the present invention by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the scope of protection of the present invention.

Claims

1. A method for detecting anomalies in equipment, characterized in that, include: The method acquires three-dimensional parameter information and operating parameter information of the device under test at various moments during operation; wherein, the device under test is a power supply device; the three-dimensional parameter information includes the external dimensions, internal structural dimensions, dimensions of each component, and installation dimensions between each component of the device under test; the operating parameter information includes the operating speed, operating power, operating temperature, and rotational speed of the device under test; the three-dimensional parameter information and operating parameter information are obtained in real time by sensors installed on the device under test. Based on the three-dimensional parameter information and the operating parameter information, a preset three-dimensional model of the device under test during its operation is drawn using a preset three-dimensional image drawing model; wherein, the physical state of the preset three-dimensional model is synchronized with the physical state of the device under test. Based on the entity effect corresponding to the device under test, the rendering parameters corresponding to the preset 3D model are determined; based on the rendering parameters, the preset 3D model is rendered to obtain the rendered preset 3D model; wherein, the entity effect corresponding to the device under test includes entity color and material, and the rendering parameters include rendering color parameters and rendering material parameters; Determine the real-world video image corresponding to the real-world scene where the device under test is located, and project the real-world video image onto a preset virtual reality display model; Wherein, the real-world video image is captured in real time by a camera device installed on the device to be tested; the projection of the real-world video image onto a preset virtual reality display model includes: determining a first preset coordinate system corresponding to the real-world video image in the real-world scene, and determining first coordinate information of the real-world video image in the first preset coordinate system; determining a second preset coordinate system in the preset virtual reality display device, and determining a coordinate transformation matrix for coordinate transformation from the first preset coordinate system to the second preset coordinate system; based on the coordinate transformation matrix and the first coordinate information, determining second coordinate information of the real-world video image in the second preset coordinate system; based on the first... The two coordinate information is used to project the real video image onto the preset virtual reality display model; the determination of the coordinate transformation matrix for the coordinate transformation from the first preset coordinate system to the second preset coordinate system includes: determining a common reference point in the first preset coordinate system and the second preset coordinate system; determining the third coordinate information of the common reference point in the first preset coordinate system, and determining the fourth coordinate information of the common reference point in the second preset coordinate system; based on the third coordinate information and the fourth coordinate information, determining the coordinate transformation matrix for the coordinate transformation from the first preset coordinate system to the second preset coordinate system; wherein, the common reference point is marked on the device to be detected; If the common reference point moves relative to the position of the camera device, the coordinate transformation matrix is ​​recalculated to update the second preset coordinate system; if the common reference point is not within the field of view of the camera device, the second preset coordinate system is updated based on the SLAM positioning algorithm. The rendered preset 3D model is projected onto the target position corresponding to the real video image in the preset virtual reality display model; Based on the rendered preset 3D model at the target location, determine whether the device under test is abnormal; the determination of whether the device under test is abnormal based on the rendered preset 3D model at the target location includes: determining whether the device under test is abnormal based on the physical structure parameter information and environmental information corresponding to the rendered preset 3D model at the target location.

2. The method according to claim 1, characterized in that, The step of projecting the preset 3D model onto the target position corresponding to the real video image in the preset virtual reality display model includes: Determine the fifth coordinate information of the device to be tested in the first preset coordinate system; Based on the coordinate transformation matrix and the fifth coordinate information, the sixth coordinate information of the preset three-dimensional model corresponding to the device to be detected in the second preset coordinate system is determined; Based on the sixth coordinate information, the preset 3D model is projected onto the target position corresponding to the real video image in the preset virtual reality display model.

3. An anomaly detection device for equipment, characterized in that, include: The acquisition unit is used to acquire three-dimensional parameter information and operating parameter information of the device under test at various moments during operation; wherein, the device under test is a power supply device; the three-dimensional parameter information includes the external dimensions, internal structural dimensions, dimensions of each component, and installation dimensions between each component of the device under test; the operating parameter information includes the operating speed, operating power, operating temperature, and rotational speed of the device under test; the three-dimensional parameter information and operating parameter information are obtained in real time by sensors installed on the device under test. A drawing unit is used to draw a preset three-dimensional model of the device under test during its operation, based on the three-dimensional parameter information and the operating parameter information, using a preset three-dimensional image drawing model; wherein the physical state of the preset three-dimensional model is synchronized with the physical state of the device under test. The determining unit is used to determine the rendering parameters corresponding to the preset 3D model based on the entity effect corresponding to the device to be detected. A rendering unit is used to render the preset 3D model based on the rendering parameters to obtain the rendered preset 3D model; wherein, the entity effect corresponding to the device to be detected includes entity color and material, and the rendering parameters include rendering color parameters and rendering material parameters; The first projection unit is used to determine the real video image corresponding to the real scene where the device under test is located, and to project the real video image onto a preset virtual reality display model; wherein, the real video image is captured in real time by a camera device installed on the device under test; The first projection unit includes: The first determining module is configured to determine a first preset coordinate system corresponding to the real video image in the real scene, and determine the first coordinate information of the real video image in the first preset coordinate system; determine a second preset coordinate system in a preset virtual reality display device, and determine a coordinate transformation matrix for coordinate transformation from the first preset coordinate system to the second preset coordinate system; and determine the second coordinate information of the real video image in the second preset coordinate system based on the coordinate transformation matrix and the first coordinate information. The first projection module is used to project the real video image onto the preset virtual reality display model based on the second coordinate information; The first determining module, when determining the coordinate transformation matrix for coordinate transformation from the first preset coordinate system to the second preset coordinate system, is used to determine a common reference point in the first and second preset coordinate systems; determine the third coordinate information of the common reference point in the first preset coordinate system, and determine the fourth coordinate information of the common reference point in the second preset coordinate system; and determine the coordinate transformation matrix for coordinate transformation from the first preset coordinate system to the second preset coordinate system based on the third and fourth coordinate information; wherein the common reference point is marked on the device to be detected; if the positional relationship between the common reference point and the camera device changes, the coordinate transformation matrix is ​​recalculated to update the second preset coordinate system; if the common reference point is not within the visible range of the camera device, the second preset coordinate system is updated based on the SLAM positioning algorithm. The second projection unit is used to project the rendered preset 3D model onto the target position corresponding to the real video image in the preset virtual reality display model; The judgment unit is used to determine whether the device to be detected is abnormal based on the physical structure parameter information and environmental information corresponding to the rendered preset 3D model at the target location.

4. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 2.

5. A computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 2.

Images