Equipment state monitoring method and device based on infrared image

Abstract

The invention provides an equipment state monitoring method and device based on an infrared image. The method comprises the following steps: acquiring a current detection task, and generating navigation information according to the current detection task; sending the navigation information to a handheld terminal, so that the handheld terminal displays the navigation information; for each piece of to-be-detected equipment, acquiring infrared images of different point positions of the to-be-detected equipment, and determining a state detection result of the corresponding to-be-detected equipment according to the infrared images of the different point positions of the to-be-detected equipment; the state detection result comprises environment data; and rendering the digital twin model of the transformer substation based on the digital twin navigation point position correspondence table and the state detection result of each infrared image to obtain the digital twin model of the three-dimensional thermal field of the transformer substation. According to the invention, full-automatic state detection of the power equipment can be realized, so that the equipment detection efficiency is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of equipment inspection, and in particular to an equipment status monitoring method and device based on infrared images. Background Art

[0002] Currently, live equipment testing can identify defects, provide early warnings, and enable timely correction, thus preventing a large number of critical power equipment failures. Infrared testing, a key component of condition monitoring, typically uses portable testing instruments for on-site testing of operating power grid equipment. It offers flexibility, accuracy, and timeliness. Infrared testing data, as a key parameter characterizing equipment status, is a crucial basis for evaluating power grid equipment status.

[0003] However, with the widespread adoption of live-line testing, the contradiction between the massive amount of equipment and limited manpower is growing. Furthermore, infrared live-line testing requires high levels of personnel and results in low testing efficiency. Therefore, a new testing method is urgently needed to meet the needs of practical industrial production and sustainable development. Summary of the Invention

[0004] The embodiments of the present invention provide a device status monitoring method and apparatus based on infrared images to solve the problem of low device detection efficiency.

[0005] In a first aspect, an embodiment of the present invention provides a device status monitoring method based on infrared images, comprising:

[0006] Obtain the current detection task and generate navigation information based on the current detection task; the navigation information includes the corresponding points and detection order of multiple devices to be detected; each device to be detected corresponds to at least one point;

[0007] Sending the navigation information to the handheld terminal so that the handheld terminal displays the navigation information, wherein the navigation information is used to instruct the staff to reach the corresponding device to be detected and take infrared images of different points of the device to be detected;

[0008] For each device to be detected, infrared images of different points of the device to be detected are obtained, and based on the infrared images of different points of the device to be detected, a status detection result of the corresponding device to be detected is determined; the status detection result includes environmental data;

[0009] Based on the digital twin navigation point correspondence table and the status detection results of each infrared image, the substation digital twin model is rendered to obtain a three-dimensional thermal field digital twin model of the substation; the substation digital twin model includes three-dimensional models of all equipment in the substation.

[0010] In a second aspect, an embodiment of the present invention provides an infrared image-based device status monitoring apparatus, comprising:

[0011] A navigation information determination module is used to obtain the current detection task and generate navigation information based on the current detection task; the navigation information includes the corresponding points and detection order of multiple devices to be detected; each device to be detected corresponds to at least one point;

[0012] A navigation information display module is used to send the navigation information to the handheld terminal so that the handheld terminal displays the navigation information, wherein the navigation information is used to instruct the staff to reach the corresponding device to be detected and take infrared images of different points of the device to be detected;

[0013] A status detection result acquisition module is used to obtain infrared images of different points on each device to be detected, and determine the status detection result of the corresponding device to be detected based on the infrared images of the different points on the device to be detected; the status detection result includes environmental data;

[0014] The three-dimensional model rendering module is used to render the substation digital twin model based on the digital twin navigation point correspondence table and the status detection results of each infrared image to obtain a three-dimensional thermal field digital twin model of the substation; the substation digital twin model includes the three-dimensional models of all equipment in the substation.

[0015] An embodiment of the present invention provides an equipment status monitoring method and device based on infrared images. The method first obtains the current detection task and generates navigation information according to the current detection task; sends the navigation information to a handheld terminal so that the handheld terminal displays the navigation information, and the navigation information is used to instruct the staff to reach the corresponding equipment to be detected and take infrared images of different points of the equipment to be detected; by automatically planning the navigation route, efficient and accurate shooting of the power equipment can be achieved. After the infrared image of the power equipment is taken, the infrared image can be automatically uploaded and analyzed. For each equipment to be detected, the status detection result of the corresponding equipment to be detected is determined according to the infrared images of different points of the equipment to be detected; finally, based on the digital twin navigation point correspondence table and the status detection results of each infrared image, the digital twin model of the substation is rendered to obtain a three-dimensional thermal field digital twin model of the substation; this process no longer requires manual verification by the staff, thereby realizing fully automatic status detection of the power equipment and improving the efficiency of equipment detection. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0017] Figure 1 This is a flowchart of an implementation method of an infrared image-based device status monitoring method provided by an embodiment of the present invention;

[0018] Figure 2 Schematic diagram of the structure of an infrared image-based equipment status monitoring device provided by an embodiment of the present invention;

[0019] Figure 3 is a schematic diagram of a terminal provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0020] In the following description, specific details such as particular system structures and techniques are provided for purposes of illustration, not limitation, to facilitate a thorough understanding of the embodiments of the present invention. However, it will be apparent to those skilled in the art that the present invention may be practiced in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present invention with unnecessary detail.

[0021] In the description of this application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0022] References to "one embodiment" or "some embodiments" in this specification mean that a particular feature, structure, or characteristic described in conjunction with that embodiment is included in one or more embodiments of the present application. Thus, phrases such as "in one embodiment," "in some embodiments," "in other embodiments," and "in other embodiments" appearing in various places in this specification do not necessarily refer to the same embodiment, but rather mean "one or more but not all embodiments," unless otherwise specifically emphasized. The terms "including," "comprising," "having," and variations thereof all mean "including but not limited to," unless otherwise specifically emphasized.

[0023] In addition, the “plurality” mentioned in the embodiments of the present application should be interpreted as two or more.

[0024] In order to make the purpose, technical solutions and advantages of the present invention more clear, specific embodiments will be described below with reference to the accompanying drawings.

[0025] See also Figure 1 , which shows a flow chart of an implementation method of an infrared image-based device status monitoring method provided by an embodiment of the present invention, and is described in detail as follows:

[0026] S101: Acquire a current detection task and generate navigation information according to the current detection task; the navigation information includes corresponding points and detection order of multiple devices to be detected; each device to be detected corresponds to at least one point.

[0027] The execution entity of this embodiment is a terminal device, which is used to obtain inventory information of power equipment in the substation. This inventory information includes the location information of each power equipment and the points on the power equipment used to capture infrared images. Before performing an inspection task, the staff can select at least one device to be inspected on the terminal device. The terminal device generates navigation information based on the location information and points of the selected device to be inspected. This navigation information includes the location information and points of each device to be inspected, as well as the inspection order for each device to be inspected. The points are locations on the devices to be inspected, which instruct the staff to capture infrared images of the points.

[0028] Specifically, the navigation information may also be automatically generated based on the inspection cycle of the device to be inspected and the task assignment details of the superior.

[0029] After the navigation information is generated, the navigation information is written into the handheld terminal, which can be a terminal with an integrated thermal imager function. Specifically, the handheld terminal includes a manual shooting mode and an intelligent shooting mode. In the intelligent shooting mode, when performing intelligent shooting on site, the staff can hold the handheld terminal and shoot the equipment to be inspected one by one based on the navigation information displayed on the handheld terminal. The infrared image device status monitoring method provided in this embodiment can simplify the complex by setting the navigation information, greatly reducing the workload of the front-line personnel, so that the traditional infrared temperature measurement work that requires two people can be completed by one person, and the shooting time is greatly shortened. At the same time, the technical level requirements for the inspection personnel are further reduced, which is conducive to large-scale operations.

[0030] S102: Sending the navigation information to a handheld terminal so that the handheld terminal displays the navigation information, wherein the navigation information is used to instruct a worker to reach a corresponding device to be detected and take infrared images of different points of the device to be detected.

[0031] In this embodiment, after generating navigation information, the terminal device sends the navigation information to the handheld terminal. After the staff starts the detection task on the handheld terminal, the handheld terminal is used to determine the navigation path from the staff to the current device to be detected based on the detection order in the navigation information, the staff's real-time position and the position information of the device to be detected currently in the detection order, and display the navigation path. After the staff arrives at the current device to be detected, the handheld terminal displays the device number and corresponding point corresponding to the current device to be detected.

[0032] In one possible implementation, the specific implementation process of S102 includes:

[0033] S201: Send the navigation information to the handheld terminal so that the handheld terminal displays the location information of each device to be detected in sequence according to the detection order, and displays the auxiliary shooting angle of the corresponding point when the staff arrives at the corresponding device to be detected; the location information is used to instruct the staff to arrive at each device to be detected.

[0034] In this embodiment, after the handheld terminal monitors that the real-time position of the staff coincides with the position of the current equipment to be detected, it can display the various points of the current equipment to be detected. After monitoring the trigger instruction of any point, the handheld terminal turns on the infrared camera function and compares the infrared image in the real-time image with the preset image. If the contour similarity between the captured infrared image and the preset infrared image is greater than the preset similarity threshold, it is determined that the infrared image corresponding to the shooting angle matches the preset image, indicating that the image of this point of the power equipment can be captured. The handheld terminal can issue a prompt message, which is used to indicate that the user can capture the infrared image according to the shooting angle.

[0035] S202: Acquire an infrared image captured by the handheld terminal, and save the acquired infrared image, points, and devices to be detected according to a corresponding relationship.

[0036] Specifically, after capturing each infrared image, the handheld terminal obtains the point corresponding to the infrared image and the device number of the device to be detected, and constructs a mapping relationship between the infrared image, the point corresponding to the infrared image and the device number of the device to be detected, and automatically saves the mapping relationship.

[0037] In one possible implementation, the specific implementation process of S201 includes:

[0038] The navigation information is sent to the handheld terminal so that the handheld terminal displays the location information of the current device to be detected based on the staff's real-time location and the navigation information, and after the staff's real-time location reaches the current device to be detected, the handheld terminal displays the various points of the current device to be detected and the auxiliary shooting angles corresponding to the points.

[0039] In this embodiment, the handheld terminal can also directly overlay the contour line diagram of the preset image on the real-time image. When the real-time image captured coincides with the contour line of the preset image, the staff can determine that the auxiliary shooting angle is the correct shooting angle, thereby capturing the infrared image at this time.

[0040] S103: For each device to be detected, infrared images of different points of the device to be detected are obtained, and status detection results of the corresponding device to be detected are determined based on the infrared images of different points of the device to be detected; the status detection results include environmental data.

[0041] Specifically, environmental data includes temperature, humidity, radiation value and other data.

[0042] S104: Based on the digital twin navigation point correspondence table and the status detection results of each infrared image, the substation digital twin model is rendered to obtain a three-dimensional thermal field digital twin model of the substation; the substation digital twin model includes a three-dimensional model of all equipment in the substation.

[0043] It can be seen from the above embodiments that the equipment status monitoring method based on infrared images provided by the embodiments of the present invention can achieve efficient and accurate shooting of power equipment by automatically planning navigation routes. At the same time, after the infrared image of the power equipment is shot, the infrared image can be automatically uploaded and analyzed, and the environmental data and detection results of the corresponding points can be rendered to the digital twin model of the substation. Manual verification by staff is no longer required, and fully automatic status detection of power equipment can be realized, thereby improving the efficiency of equipment detection.

[0044] In one possible implementation, the device to be detected includes at least one component; the status detection result further includes normal and warning; the specific implementation process of S103 includes:

[0045] S201: For each infrared image of a first device to be detected, determine the components to which multiple monitoring points in the infrared image belong, and determine corresponding alarm threshold conditions based on the components to which each monitoring point belongs; the first device to be detected is any device to be detected.

[0046] Specifically, in order to monitor the environmental data of each part of the device to be detected in detail and render it into a three-dimensional model, this embodiment selects multiple monitoring points on each component of the infrared image. The handheld terminal connects to the security access platform through the 4G network Internet of Things and then docks with the terminal device. After the infrared image is taken, the handheld terminal converts the infrared image into base64 character format, encapsulates the converted infrared image, the monitoring point corresponding to the infrared image, and the device number of the device to be detected into json data, and uses the MQTT protocol to upload the data to the southbound interface of the security access platform. The terminal device docks with the northbound interface of the security access platform to receive the above data and store it in the database.

[0047] Since the alarm threshold of the environmental data corresponding to each component is different, after receiving the above data, the terminal device first determines the components to which the multiple monitoring points on the infrared image belong, and then obtains the alarm threshold conditions corresponding to the components.

[0048] Specifically, the alarm status in the status detection result may include general defect alarm, serious defect alarm and critical defect alarm; each alarm status corresponds to a different alarm threshold condition.

[0049] S202: Using openCV technology, analyze the temperature corresponding to each monitoring point in each infrared image of the first device to be detected.

[0050] In this embodiment, the mapping relationship between the newly stored infrared image, point and device to be detected is obtained from the database, and the base64 character content corresponding to the infrared image and point is passed to the OpenCV tool to parse the environmental data corresponding to each point of the component in the infrared image. At the same time, OCR technology is used to identify the maximum and minimum temperatures of the corresponding part of the infrared image, determine the temperature change range, and update the environmental data of each point corresponding to the component and the temperature change range corresponding to the component into the database.

[0051] S203: For each component of the first device to be detected, determine whether the temperatures of the monitoring points corresponding to the component meet the corresponding alarm threshold conditions. If the temperatures of the monitoring points corresponding to the component meet the corresponding alarm threshold conditions, then the status detection result of the component is determined to be normal; otherwise, the status detection result of the component is determined to be an alarm.

[0052] In this embodiment, the terminal device obtains the components to which each monitoring point in the infrared image belongs, and determines the alarm threshold conditions of the components to which they belong. According to the alarm threshold conditions corresponding to each component, the status detection results of each monitoring point are determined. When the status detection result of a monitoring point in a component includes an alarm state, the status detection result of the component is determined to be an alarm.

[0053] Specifically, the terminal device can determine the specific status of each monitoring point based on the multiple alarm threshold conditions (general defect alarm, serious defect alarm and critical defect alarm) corresponding to each monitoring point. When the status detection result of the monitoring point corresponding to the component includes any alarm status, at least one alarm status corresponding to the component will be saved.

[0054] In one possible implementation, the status detection result further includes the maximum temperature and the minimum temperature of each component; after S202, the method provided in this embodiment further includes:

[0055] According to the temperature of the monitoring point corresponding to each component in the first device to be detected, the maximum temperature and the minimum temperature corresponding to each component are determined.

[0056] In one possible implementation, the specific implementation process of S104 includes:

[0057] S301: Based on the digital twin navigation point correspondence table, determine the position points of multiple monitoring points in each infrared image in the three-dimensional model of the corresponding device to be detected.

[0058] In this embodiment, before step S101, the operator can use a thermal imager to capture infrared images of different points on the equipment to be inspected, mark different monitoring points in the infrared images, and then mark the corresponding locations in the three-dimensional model of the equipment to be inspected in the substation digital twin model. The monitoring points in the infrared images are then associated with the corresponding locations in the three-dimensional model to obtain a digital navigation point correspondence table. If the infrared image shooting angle needs to be changed later, the image can be captured at the new shooting angle and the digital twin navigation point correspondence table can be updated accordingly.

[0059] In subsequent practical applications, after determining the environmental data of each monitoring point, the terminal device will write the environmental data into the corresponding location point of the three-dimensional model according to the digital twin navigation point correspondence table.

[0060] S302: For each device to be detected, set a subsurface material for the three-dimensional model corresponding to the device to be detected, and set a blueprint and SceneTexture semi-transparent material at the location of each component in the three-dimensional model corresponding to the device to be detected.

[0061] S303: Based on the environmental data of each monitoring point, edit the corresponding numerical value at the corresponding position point in the three-dimensional model of the corresponding equipment to be detected so that the corresponding component displays the corresponding color, thereby obtaining a three-dimensional thermal field digital twin model of the substation.

[0062] In this embodiment, according to the shapes of components in the power equipment, component blueprints of corresponding shapes are placed at corresponding positions of each component in the three-dimensional model, and information such as component names and serial numbers are set.

[0063] Assign a Subsurface Material to each component and set an appropriate color. Assign a SceneTexture Translucent Material to each monitoring point. Combine the SceneTexture Translucent Material with the Subsurface Material, and assign the component ID channel to the combined material. Reserve editable value nodes for the SceneTexture Translucent Material so that you can edit the values ​​using Blueprints to achieve color control and alarm effects.

[0064] Next, a blueprint is used to obtain status test results for each monitoring point, including environmental data, the temperature range of each component, and whether an alarm has been triggered. For each component area, a local color bar is created to display the corresponding temperature range. The total temperature range is determined based on the maximum and minimum temperatures of all electrical equipment in the substation, and a global color bar is created based on this total temperature range.

[0065] This embodiment creates a group list for each device, including a corresponding component group list. This component group list includes the status detection results for each monitoring point. When a user clicks an option in the group list, an infrared image of the component corresponding to that option is displayed, and a temperature-based 3D model of the corresponding component area is displayed in the 3D model.

[0066] In one possible implementation, after S303, the method provided in this embodiment further includes:

[0067] When the status detection result of the first component is an alarm, the alarm effect is displayed at the corresponding position point in the corresponding three-dimensional model.

[0068] When a component is in an alarm state, the corresponding area of ​​the component is displayed in the substation digital twin model by highlighting or flashing.

[0069] In one possible implementation, after S303, the method provided in this embodiment further includes:

[0070] When the cursor is detected to be hovering over the coordinate range corresponding to the first component in the three-dimensional thermal field digital twin model, the corresponding color is displayed in the corresponding area of ​​the first component based on the environmental data of each monitoring point corresponding to the first component; otherwise, the preset color is displayed in the corresponding area of ​​the first component; the first component is any component of the equipment to be detected.

[0071] Specifically, in the substation digital twin model's initial state, each power equipment component is displayed in a preset color, and components with alarms flash. A hover event is added to the blueprints of each component. When the cursor hovers over a component, the corresponding area is magnified. The color value of the component's blueprint is adjusted using the environmental data from the corresponding monitoring points, so that the area displays the color corresponding to the actual temperature.

[0072] At the same time, when the cursor is not hovering over any power equipment blueprint, the total color bar of the entire substation is displayed on either side of the substation digital twin model. When the cursor is hovering over any component blueprint, the total color bar is hidden and the blueprint of the component is displayed. Figure 1 Display the local color bar corresponding to the component on the side, get the group center position corresponding to the current component, and display the local color bar next to the group center position.

[0073] As can be seen from the above examples, the infrared imaging equipment status monitoring method provided in this embodiment can realize intelligent infrared capture, digital management, and "cloud" infrared visualization functions for power equipment. The terminal device can create navigation information based on the ledger information, greatly improving capture efficiency, automatically identifying temperature, humidity, emissivity, radiator temperature, and shooting distance, and improving accurate temperature measurement capabilities. The handheld terminal synchronizes with the terminal device, and all images are automatically uploaded and digitally analyzed and managed. Combined with the component-level detailed modeling of the digital twin, "cloud" infrared visualization of the entire station is realized, enabling real-time active warning, alarm, and defect identification analysis of equipment status.

[0074] Specifically, this embodiment enables intelligent navigation and photography for handheld terminals: By developing an intelligent navigation algorithm, the system automatically plans photography routes based on inventory information, enabling efficient and accurate photography of power equipment. A supporting software system must be developed and modified, including task flow software, local databases, and cloud databases used by terminal devices. The terminal device software must enable the upload and import of inspection tasks; after import, it must automatically identify and name inspection tasks; and automatically verify task completion.

[0075] Secondly, this embodiment can realize the digital management function: it can establish a complete database management system to realize the automatic uploading, storage and digital analysis of all infrared spectra.

[0076] Again, this embodiment can realize "cloud" infrared visualization: using digital twin component-level fine modeling, it can realize "cloud" infrared visualization of all station equipment and provide intuitive equipment status display.

[0077] Finally, this embodiment can realize intelligent diagnosis and alarm: combining the digital twin model, developing intelligent diagnosis algorithms for equipment, and realizing real-time active early warning, alarm and defect identification analysis of equipment status.

[0078] It should be understood that the order of execution of the steps in the above embodiments does not necessarily mean the order of execution. The order of execution of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.

[0079] The following are device embodiments of the present invention. For details not fully described therein, reference may be made to the corresponding method embodiments described above.

[0080] Figure 2 The following is a schematic diagram showing the structure of an infrared image-based device state monitoring apparatus according to an embodiment of the present invention. For ease of explanation, only the parts related to the embodiment of the present invention are shown, which are described in detail as follows:

[0081] like Figure 2 As shown, the device state monitoring apparatus 100 based on infrared images includes:

[0082] The navigation information determination module 110 is used to obtain the current detection task and generate navigation information based on the current detection task; the navigation information includes the corresponding points and detection order of multiple devices to be detected; each device to be detected corresponds to at least one point;

[0083] The navigation information display module 120 is used to send the navigation information to the handheld terminal so that the handheld terminal displays the navigation information, wherein the navigation information is used to instruct the staff to reach the corresponding device to be detected and take infrared images of different points of the device to be detected;

[0084] The status detection result acquisition module 130 is used to obtain infrared images of different points on each device to be detected, and determine the status detection result of the corresponding device to be detected based on the infrared images of the different points on the device to be detected; the status detection result includes environmental data;

[0085] The three-dimensional model rendering module 140 is used to render the substation digital twin model based on the digital twin navigation point correspondence table and the status detection results of each infrared image to obtain a three-dimensional thermal field digital twin model of the substation; the substation digital twin model includes three-dimensional models of all equipment in the substation.

[0086] In one possible implementation, the navigation information display module is used to:

[0087] A position information display unit is used to send the navigation information to the handheld terminal so that the handheld terminal displays the position information of each device to be detected in sequence according to the detection order, and displays the auxiliary shooting angle of the corresponding point when the staff arrives at the corresponding device to be detected; the position information is used to instruct the staff to arrive at each device to be detected;

[0088] The shooting angle determination unit is used to obtain the infrared image taken by the handheld terminal and save the obtained infrared image, point and device to be detected in a corresponding relationship.

[0089] In one possible implementation, the shooting angle determination unit is specifically configured to:

[0090] The navigation information is sent to the handheld terminal so that the handheld terminal displays the location information of the current device to be detected based on the staff's real-time location and the navigation information, and after the staff's real-time location reaches the current device to be detected, the handheld terminal displays the various points of the current device to be detected and the auxiliary shooting angles corresponding to the points.

[0091] In one possible implementation, the device to be detected includes at least one component; the status detection result further includes normal and warning; the status detection result acquisition module 130 includes:

[0092] For each infrared image of a first device to be detected, determining components to which multiple monitoring points in the infrared image belong, and determining corresponding alarm threshold conditions based on the components to which each monitoring point belongs; the first device to be detected is any device to be detected;

[0093] Using openCV technology, analyze the temperature corresponding to each monitoring point in each infrared image of the first device to be detected;

[0094] For each component of the first device to be detected, determine whether the temperatures of each monitoring point corresponding to the component meet the corresponding alarm threshold conditions. If the temperatures of each monitoring point corresponding to the component meet the corresponding alarm threshold conditions, then the status detection result of the component is determined to be normal; otherwise, the status detection result of the component is determined to be an alarm.

[0095] In a possible implementation, the state detection result further includes the maximum temperature and the minimum temperature of each component; the state detection result acquisition module 130 further includes:

[0096] The temperature range determining unit is used to determine the maximum temperature and the minimum temperature corresponding to each component in the first device to be detected according to the temperature of the monitoring point corresponding to each component.

[0097] In one possible implementation, the 3D model rendering module 140 includes:

[0098] Based on the digital twin navigation point correspondence table, determine the position points of multiple monitoring points in each infrared image in the corresponding three-dimensional model of the equipment to be detected;

[0099] For each device to be tested, set the subsurface material for the 3D model corresponding to the device to be tested, and set the blueprint and SceneTexture semi-transparent material at the location of each component in the 3D model corresponding to the device to be tested;

[0100] Based on the environmental data of each monitoring point, the corresponding numerical value is edited at the corresponding position point in the three-dimensional model of the corresponding equipment to be detected so that the corresponding component displays the corresponding color, thereby obtaining a three-dimensional thermal field digital twin model of the substation.

[0101] In one possible implementation, the 3D model rendering module 140 further includes:

[0102] The alarm display unit is used to display the alarm effect at a corresponding position point in the corresponding three-dimensional model when the status detection result of the first component is an alarm.

[0103] In one possible implementation, the 3D model rendering module 140 further includes:

[0104] The hover highlight unit is used to display the corresponding color in the corresponding area of ​​the first component based on the environmental data of each monitoring point corresponding to the first component when the cursor is detected hovering over the coordinate range corresponding to the first component in the three-dimensional thermal field digital twin model; otherwise, a preset color is displayed in the corresponding area of ​​the first component; the first component is any component of the equipment to be detected.

[0105] Figure 3 Schematic diagram of a terminal provided by an embodiment of the present invention. Figure 3 As shown, the terminal 3 of this embodiment includes: a processor 30 and a memory 31. The memory 31 is used to store a computer program 32, and the processor 30 is used to call and run the computer program 32 stored in the memory 31 to perform the steps in the above-mentioned embodiments of the device status monitoring method based on infrared images, such as Figure 1 Alternatively, the processor 30 is used to call and run the computer program 32 stored in the memory 31 to implement the functions of each module / unit in the above-mentioned device embodiments, such as Figure 2 The functions of the modules 110 to 140 are shown.

[0106] Exemplarily, the computer program 32 may be divided into one or more modules / units, which are stored in the memory 31 and executed by the processor 30 to implement the present invention. The one or more modules / units may be a series of computer program instruction segments capable of implementing specific functions, which are used to describe the execution process of the computer program 32 in the terminal 3. For example, the computer program 32 may be divided into Figure 2Modules 110 to 140 are shown.

[0107] The terminal 3 may be a computing device such as a desktop computer, a notebook, a PDA, or a cloud server. The terminal 3 may include, but is not limited to, a processor 30 and a memory 31. Those skilled in the art will understand that Figure 3 It is only an example of terminal 3 and does not constitute a limitation on terminal 3. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, the terminal may also include input and output devices, network access devices, buses, etc.

[0108] The processor 30 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor.

[0109] The memory 31 may be an internal storage unit of the terminal 3, such as a hard disk or memory of the terminal 3. The memory 31 may also be an external storage device of the terminal 3, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash memory card, etc. equipped on the terminal 3. Furthermore, the memory 31 may include both an internal storage unit of the terminal 3 and an external storage device. The memory 31 is used to store the computer program and other programs and data required by the terminal. The memory 31 may also be used to temporarily store data that has been output or is about to be output.

[0110] Those skilled in the art can clearly understand that, for the convenience and brevity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In actual applications, the above-mentioned functions can be distributed and completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0111] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant description of other embodiments.

[0112] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present invention.

[0113] In the embodiments provided by the present invention, it should be understood that the disclosed devices / terminals and methods can be implemented in other ways. For example, the device / terminal embodiments described above are merely illustrative. For example, the division of the modules or units is merely a logical functional division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed can be through some interface, indirect coupling or communication connection of devices or units, and can be electrical, mechanical, or other forms.

[0114] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0115] In addition, the functional units in the various embodiments of the present invention may be integrated into a single processing unit, each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0116] If the integrated module / unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present invention can implement all or part of the processes in the above-mentioned embodiment method by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium. When the computer program is executed by a processor, it can implement the steps of the above-mentioned various embodiments of the device status monitoring method based on infrared images. Among them, the computer program includes computer program code, which can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium can include: any entity or device that can carry the computer program code, recording medium, USB flash drive, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signal, telecommunication signal and software distribution medium. It should be noted that the content contained in the computer-readable medium can be appropriately increased or decreased according to the requirements of legislation and patent practices in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practices, computer-readable media does not include electrical carrier signals and telecommunication signals.

[0117] The embodiments described above are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present invention, and should all be included in the scope of protection of the present invention.

Claims

1. A device status monitoring method based on infrared images, characterized in that: include: Obtain the current detection task and generate navigation information based on the current detection task; The navigation information includes the corresponding points and detection order of multiple devices to be detected; each device to be detected corresponds to at least one point; the navigation information is sent to the handheld terminal so that the handheld terminal displays the navigation information, and the navigation information is used to instruct the staff to reach the corresponding device to be detected and take infrared images of different points of the device to be detected; For each device to be detected, infrared images of different points of the device to be detected are obtained, and the status detection results of the corresponding device to be detected are determined based on the infrared images of different points of the device to be detected; the status detection results include environmental data; based on the digital twin navigation point correspondence table and the status detection results of each infrared image, the substation digital twin model is rendered to obtain a three-dimensional thermal field digital twin model of the substation; the substation digital twin model includes three-dimensional models of all equipment in the substation.

2. The device status monitoring method based on infrared images according to claim 1 is characterized in that: The sending of the navigation information to the handheld terminal so that the handheld terminal displays the navigation information, wherein the navigation information is used to instruct the staff to reach the corresponding device to be detected and capture infrared images of different points of the device to be detected, includes: Sending the navigation information to the handheld terminal so that the handheld terminal displays the location information of each device to be detected in sequence according to the detection order, and displays the auxiliary shooting angle of the corresponding point when the staff arrives at the corresponding device to be detected; the location information is used to instruct the staff to arrive at each device to be detected; The infrared image captured by the handheld terminal is obtained, and the obtained infrared image, point and device to be detected are saved according to the corresponding relationship.

3. The device status monitoring method based on infrared images according to claim 2, characterized in that: The sending of the navigation information to the handheld terminal so that the handheld terminal sequentially displays the location information of each device to be detected according to the detection order, and displays the auxiliary shooting angle of the corresponding point when the staff arrives at the corresponding device to be detected, including: The navigation information is sent to the handheld terminal so that the handheld terminal displays the location information of the current device to be detected based on the staff's real-time location and the navigation information, and after the staff's real-time location reaches the current device to be detected, the handheld terminal displays the various points of the current device to be detected and the auxiliary shooting angles corresponding to the points.

4. The device status monitoring method based on infrared images according to claim 1, characterized in that: The environmental data includes temperature; the device to be detected includes at least one component; the status detection result also includes normal and warning; Determining the status detection result of the corresponding device to be detected based on the infrared images of different points of the device to be detected includes: For each infrared image of a first device to be detected, determining components to which multiple monitoring points in the infrared image belong, and determining corresponding alarm threshold conditions based on the components to which each monitoring point belongs; the first device to be detected is any device to be detected; Using openCV technology, analyze the temperature corresponding to each monitoring point in each infrared image of the first device to be detected; For each component of the first device to be detected, determine whether the temperatures of each monitoring point corresponding to the component meet the corresponding alarm threshold conditions. If the temperatures of each monitoring point corresponding to the component meet the corresponding alarm threshold conditions, then the status detection result of the component is determined to be normal; otherwise, the status detection result of the component is determined to be an alarm.

5. The device status monitoring method based on infrared images according to claim 4 is characterized in that: The state detection results also include the maximum temperature and the minimum temperature of each component; After analyzing the temperature corresponding to each monitoring point in each infrared image of the first device to be detected using the openCV technology, the method further includes: According to the temperature of the monitoring point corresponding to each component in the first device to be detected, the maximum temperature and the minimum temperature corresponding to each component are determined.

6. The device status monitoring method based on infrared images according to claim 1, characterized in that: The digital twin model of the substation is rendered based on the digital twin navigation point correspondence table and the status detection results of each infrared image to obtain a three-dimensional thermal field digital twin model of the substation, including: Based on the digital twin navigation point correspondence table, determine the position points of multiple monitoring points in each infrared image in the corresponding three-dimensional model of the equipment to be detected; For each device to be tested, set the subsurface material for the 3D model corresponding to the device to be tested, and set the blueprint and SceneTexture semi-transparent material at the location of each component in the 3D model corresponding to the device to be tested; Based on the environmental data of each monitoring point, the corresponding numerical value is edited at the corresponding position point in the three-dimensional model of the corresponding equipment to be detected so that the corresponding component displays the corresponding color, thereby obtaining a three-dimensional thermal field digital twin model of the substation.

7. The device status monitoring method based on infrared images according to claim 6, characterized in that: After editing corresponding values ​​at corresponding positions in the three-dimensional model of the equipment to be detected based on the environmental data of each monitoring point so that corresponding components display corresponding colors, the method further includes: When the status detection result of the first component is an alarm, the alarm effect is displayed at the corresponding position point in the corresponding three-dimensional model.

8. The device status monitoring method based on infrared images according to claim 6, characterized in that: After editing corresponding values ​​at corresponding locations in the three-dimensional model of the equipment to be detected based on the environmental data of each monitoring point so that corresponding components display corresponding colors to obtain the three-dimensional thermal field digital twin model of the substation, the method further includes: When the cursor is detected to be hovering over the coordinate range corresponding to the first component in the three-dimensional thermal field digital twin model, the corresponding color is displayed in the corresponding area of ​​the first component based on the environmental data of each monitoring point corresponding to the first component; otherwise, the preset color is displayed in the corresponding area of ​​the first component; the first component is any component of the equipment to be detected.

9. An equipment status monitoring device based on infrared images, characterized in that: include: A navigation information determination module is used to obtain the current detection task and generate navigation information according to the current detection task; The navigation information includes the corresponding points and detection order of multiple devices to be detected; each device to be detected corresponds to at least one point; A navigation information display module is used to send the navigation information to the handheld terminal so that the handheld terminal displays the navigation information, wherein the navigation information is used to instruct the staff to reach the corresponding device to be detected and take infrared images of different points of the device to be detected; A status detection result acquisition module is used to obtain infrared images of different points on each device to be detected, and determine the status detection result of the corresponding device to be detected based on the infrared images of the different points on the device to be detected; the status detection result includes environmental data; The three-dimensional model rendering module is used to render the substation digital twin model based on the digital twin navigation point correspondence table and the status detection results of each infrared image to obtain a three-dimensional thermal field digital twin model of the substation; the substation digital twin model includes the three-dimensional models of all equipment in the substation.

10. The device for monitoring equipment status based on infrared images according to claim 9, characterized in that: The navigation information display module is used for: Displaying the location information of each device to be detected in sequence according to the detection order, so that the staff can reach each device to be detected according to the location information; For each point of each device to be detected, determine the corresponding shooting angle of the point, and take an infrared image of the point at the shooting angle corresponding to the point; Each infrared image, point and device to be detected is saved according to the corresponding relationship.

Images