Multi-modal information fusion equipment for converter station scene

Abstract

The invention discloses a multi-modal information fusion device for a converter station scene, and relates to the technical field of information fusion. According to the spatial physical position of a demand terminal and the communication and computing power heterogeneous characteristics of a computing node network, a multi-modal fusion task is effectively segmented and processed in parallel, and parallel high-efficiency multi-modal information fusion of a heterogeneous sensor network for a specific spatial physical position demand terminal is realized. When complex multi-modal information fusion operation is carried out in a converter station intelligent sensing scene, a streaming calculation graph constructed by operation operators such as standardized representation, translation and alignment is established according to different multi-modal information fusion requirements, and spatial information of different multi-modal information fusion requirement sources is collected; and dividing and mapping a computational flow graph by comprehensively considering node computing power, I / O and energy supply factors, so that the computational intensity of multi-modal data fusion is reduced, and the distributed multi-modal information fusion efficiency of the intelligent sensing scene of the converter station is improved.

Description

Technical Field

[0001] This invention relates to the field of information fusion technology, specifically to a multimodal information fusion device for a converter station scenario. Background Technology

[0002] With the increasing scale and complexity of power systems, the real-time monitoring and prediction of the operating status of converter stations, as key nodes in power transmission systems, has become particularly important. Traditional monitoring methods mainly rely on single-mode data, such as current, voltage, and temperature. However, this single-mode data often fails to comprehensively reflect the overall operating status of the converter station, thus limiting the accuracy and reliability of the monitoring results.

[0003] In recent years, multimodal data fusion technology has been widely used in many fields. Multimodal data fusion refers to obtaining more comprehensive and accurate information by combining data sources from different modes (such as temperature, current, voltage, and monitoring images). In converter station monitoring, multimodal data fusion can effectively combine electrical parameters, environmental parameters, and equipment status information to improve monitoring accuracy and anomaly detection sensitivity.

[0004] To achieve this goal, distributed computing and machine learning technologies have become important components of the solution. Distributed computing can process large amounts of real-time data, while machine learning can extract features from the data and perform predictive analysis.

[0005] Currently, there are some technologies in power system monitoring that utilize multimodal data fusion and distributed computing, but these technologies have certain limitations when applied to intelligent sensing scenarios in converter stations.

[0006] Traditional converter station monitoring primarily relies on data from single modes (such as current, voltage, and temperature), using simple signal processing and statistical analysis methods for monitoring and anomaly detection. This approach struggles to comprehensively consider multiple influencing factors, resulting in low accuracy and reliability of the monitoring results. Summary of the Invention

[0007] This invention provides a multimodal information fusion device for converter station scenarios to solve the problems in the background art.

[0008] To achieve the above objectives, the present invention provides the following technical solution: a multimodal information fusion device for a converter station scenario, comprising data received by sensors and distributed processing of data slices, wherein the data received by the sensors includes an infrared temperature sensor, a current sensor, and a voltage sensor; below the data received by the sensors is a distributed processing mechanism for data slices, below the distributed processing mechanism is a data slice, below the data slice is a data processing mechanism, below the data processing mechanism is a multimodal fusion mechanism, below the multimodal fusion mechanism is a fusion of all data, on one side of the fusion of all data is a fused feature dataset, on one side of the fused feature dataset is an anomaly detection mechanism, below the anomaly detection mechanism are indicators of no anomaly label and indicators of containing anomaly labels; below the indicator of no anomaly label is an indicator indicating that the equipment and environment are normal, and below the indicator of containing anomaly labels is an indicator indicating that an immediate comprehensive evaluation is required;

[0009] The infrared temperature sensor is fixedly installed at the front end of the infrared temperature measuring camera. A mounting base is movably provided on the top of the infrared temperature measuring camera. A fixing rod is fixedly provided on the top of the mounting base. One end of the fixing rod passes through the bottom of the protective shell and extends into the interior of the protective shell. A nut seat is fixedly provided on one end of the fixing rod. A lead screw is movably provided on the inner wall of the nut seat. One end of the lead screw is fixedly connected to the output shaft of the second motor.

[0010] A mounting plate is fixedly installed on the top of the protective shell. Mounting holes are provided on both sides of the mounting plate, and bolts are movably installed on the inner walls of the mounting holes. A protective cover is movably installed at one end of the bolts. A dehumidification box is movably installed inside the protective cover. A mesh plate is movably installed on the top of the dehumidification box. Dehumidification particles are installed inside the dehumidification box. A connecting plate is fixedly installed at the bottom of the dehumidification box. A crossbar is fixedly installed on one side of the protective cover. One end of the crossbar passes through one side of the mounting shell and extends into the interior of the mounting shell.

[0011] Furthermore, a guide block is fixedly provided on the top of the nut seat, and a guide rod is movably provided on the inner wall of the guide block.

[0012] Furthermore, the mesh plate and the dehumidification box are movably connected by a first screw, and the top of the dehumidification box has a threaded hole that matches the first screw.

[0013] Furthermore, the connecting plate and the protective cover are movably connected by a second screw, and threaded holes that are compatible with the second screw are provided on both sides of the bottom of the protective cover.

[0014] Furthermore, a threaded sleeve is fixedly provided at one end of the crossbar, and a screw is movably provided on the inner wall of the threaded sleeve. The connection between the screw and the threaded sleeve is a threaded connection. A driven bevel gear is fixedly provided at one end of the screw, and a master bevel gear is movably provided on one side of the driven bevel gear. The connection between the master bevel gear and the driven bevel gear is a meshing connection. A knob is fixedly provided on one side of the master bevel gear.

[0015] Furthermore, the surface of the knob is provided with anti-slip texture.

[0016] Furthermore, the connection between the lead screw and the nut seat is a threaded connection.

[0017] Furthermore, a first motor is installed inside the mounting base, and the output shaft of the first motor is fixedly connected to the top of the infrared temperature measurement camera.

[0018] Furthermore, the mesh diameter of the screen is smaller than the diameter of the dehumidifying particles.

[0019] Furthermore, the infrared temperature measurement camera is hemispherical.

[0020] Compared with the prior art, the present invention provides a multimodal information fusion device for converter station scenarios, which has the following beneficial effects:

[0021] 1. The multimodal information fusion equipment in this converter station scenario effectively divides and parallelizes multimodal fusion tasks based on the spatial physical location of the demanding terminals and the heterogeneous communication and computing power characteristics of the computing node network. This achieves parallel and high-efficiency multimodal information fusion of heterogeneous sensor networks for demanding terminals in specific spatial physical locations. When performing complex multimodal information fusion operations in the converter station's intelligent sensing scenario, a streaming computation graph is built based on standardized representation, translation, and alignment operators according to different multimodal information fusion requirements. Spatial information from different sources of multimodal information fusion requirements is collected, and the computational flow graph is divided and mapped by comprehensively considering node computing power, I / O, and energy supply factors. This reduces the computational intensity of multimodal data fusion and improves the distributed multimodal information fusion efficiency in the converter station's intelligent sensing scenario.

[0022] 2. The multimodal information fusion equipment in this converter station scenario fuses multimodal data from the converter station, including real-time monitoring images, temperature, current, and voltage. It collects and monitors sensor data on the operating status of various equipment and environmental parameters within the converter station. This data requires real-time processing to ensure the safe and stable operation of the converter station. The fault detection and diagnosis service analyzes sensor data and equipment operating status to detect and diagnose potential faults, preventing equipment damage and downtime. The equipment status assessment service evaluates the operating status of critical equipment and predicts its future maintenance needs.

[0023] 3. The multimodal information fusion equipment for this converter station scenario allows infrared temperature measurement cameras to be installed on walls or ceilings by setting bolts and mounting plates.

[0024] 4. The multimodal information fusion equipment in this converter station scenario uses a protective cover to keep the bolt head in a closed space, preventing the bolt head from being constantly exposed to the external environment, reducing the corrosion of the bolt head by humid gases, and thus extending the service life of the bolt.

[0025] 5. The multimodal information fusion equipment in this converter station scenario, by setting up a dehumidification box and dehumidification particles, can dehumidify the space inside the protective cover by storing dehumidification particles in the dehumidification box, making the space inside the protective cover dry, thereby further reducing the corrosion of bolt heads by humid gas. Attached Figure Description

[0026] Figure 1 This is a schematic diagram of the structure of the present invention;

[0027] Figure 2 This is a schematic diagram of the infrared temperature measurement camera structure of the present invention;

[0028] Figure 3 This is a schematic diagram of the infrared temperature sensor structure of the present invention;

[0029] Figure 4 This is a schematic diagram of the protective cover structure of the present invention;

[0030] Figure 5 This is a schematic diagram of the mounting shell structure of the present invention.

[0031] In the diagram: 1. Data received by the sensor; 101. Infrared temperature sensor; 102. Current sensor; 103. Voltage sensor; 2. Distributed processing of data slices; 201. Data slice; 202. Data processing; 203. Multimodal fusion; 204. Fusion of all data; 205. Obtaining the fused feature dataset; 206. Anomaly detection of the data; 207. No anomaly label; 208. Contains anomaly label; 209. Equipment and environment are normal; 210. Requires immediate comprehensive evaluation; 3. Infrared temperature measurement camera; 01. Mounting base; 302. First motor; 4. Fixing rod; 401. Protective shell; 402. Nut seat; 403. Lead screw; 404. Second motor; 405. Guide block; 406. Guide rod; 5. Mounting plate; 501. Bolt; 6. Protective cover; 601. Dehumidifier box; 602. Mesh plate; 603. First screw; 604. Dehumidifier particles; 605. Connecting plate; 606. Second screw; 7. Crossbar; 701. Mounting shell; 702. Threaded sleeve; 703. Screw; 704. Secondary bevel gear; 705. Main bevel gear; 706. Knob. Detailed Implementation

[0032] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0033] Please see Figure 1-5This invention discloses a multimodal information fusion device for a converter station scenario, including data 1 received by sensors and distributed processing 2 for data slices. The data 1 received by sensors includes an infrared temperature sensor 101, a current sensor 102, and a voltage sensor 103. The distributed processing 2 is located below the data 1 received by sensors. Below the distributed processing 2, a data slice 201 is located. Below the data slice 201, a data processing 202 is located. Below the data processing 202, a multimodal fusion device is located. 203, below the multimodal fusion 203, there is a fusion of all data 204, on one side of the fusion of all data 204, there is a fused feature dataset 205, on one side of the fused feature dataset 205, there is an anomaly detection 206, below the anomaly detection 206, there are no anomaly labels 207 and have anomaly labels 208, below the no anomaly label 207, there is a normal device and environment condition 209, below the anomaly label 208, there is a need for immediate comprehensive evaluation 210.

[0034] The infrared temperature sensor 101 is fixedly installed at the front end of the infrared temperature measuring camera 3. The top of the infrared temperature measuring camera 3 is movably provided with a mounting base 301. The top of the mounting base 301 is fixedly provided with a fixing rod 4. One end of the fixing rod 4 passes through the bottom of the protective shell 401 and extends into the interior of the protective shell 401. One end of the fixing rod 4 is fixedly provided with a nut seat 402. The inner wall of the nut seat 402 is movably provided with a lead screw 403. One end of the lead screw 403 is fixedly connected to the output shaft of the second motor 404.

[0035] A mounting plate 5 is fixedly installed on the top of the protective shell 401. Mounting holes are provided on both sides of the mounting plate 5, and bolts 501 are movably installed on the inner wall of the mounting holes. A protective cover 6 is movably installed at one end of the bolts 501. A dehumidification box 601 is movably installed inside the protective cover 6. A mesh plate 602 is movably installed on the top of the dehumidification box 601. Dehumidification particles 604 are provided inside the dehumidification box 601. A connecting plate 605 is fixedly installed at the bottom of the dehumidification box 601. A crossbar 7 is fixedly installed on one side of the protective cover 6. One end of the crossbar 7 passes through one side of the mounting shell 701 and extends into the interior of the mounting shell 701.

[0036] Specifically, a guide block 405 is fixedly provided on the top of the nut seat 402, and a guide rod 406 is movably provided on the inner wall of the guide block 405.

[0037] In this embodiment, by setting the guide block 405 and the guide rod 406, the nut seat 402 can be guided, so that the nut seat 402 can move stably.

[0038] Specifically, the mesh plate 602 and the dehumidification box 601 are movably connected by a first screw 603, and the top of the dehumidification box 601 is provided with a threaded hole that matches the first screw 603.

[0039] In this embodiment, by setting a first screw 603, the first screw 603 is loosened so that one end of the first screw 603 moves out of the threaded hole on the dehumidification box 601, thereby releasing the restriction on the mesh plate 602. Then the mesh plate 602 can be removed to facilitate the removal of the old dehumidification particles 604 and the replacement with new dehumidification particles 604.

[0040] Specifically, the connecting plate 605 and the protective cover 6 are movably connected by the second screw 606, and the protective cover 6 has threaded holes on both sides of its bottom that are compatible with the second screw 606.

[0041] In this embodiment, by setting a second screw 606, one end of the second screw 606 is moved out of the threaded hole on the protective cover 6 by loosening the second screw 606, thereby releasing the restriction on the connecting plate 605, and then the dehumidification box 601 can be disassembled.

[0042] Specifically, a threaded sleeve 702 is fixedly provided at one end of the crossbar 7, and a screw 703 is movably provided on the inner wall of the threaded sleeve 702. The connection between the screw 703 and the threaded sleeve 702 is a threaded connection. A driven bevel gear 704 is fixedly provided at one end of the screw 703, and a master bevel gear 705 is movably provided on one side of the driven bevel gear 704. The connection between the master bevel gear 705 and the driven bevel gear 704 is a meshing connection. A knob 706 is fixedly provided on one side of the master bevel gear 705.

[0043] In this embodiment, a knob 706 is provided. By rotating the knob 706, the main bevel gear 705, the driven bevel gear 704, and the screw 703 are rotated. The rotating screw 703 drives the protective cover 6 to move vertically through the threaded sleeve 702, so that the protective cover 6 covers the head of the bolt 501.

[0044] Specifically, the surface of the knob 706 is provided with anti-slip texture.

[0045] In this embodiment, by setting anti-slip texture, the friction between the hand and the knob 706 can be enhanced, making it less likely for the hand to slip when rotating the knob 706.

[0046] Specifically, the connection between the lead screw 403 and the nut seat 402 is a threaded connection.

[0047] In this embodiment, by setting a lead screw 403 and a nut seat 402, the second motor 404 drives the lead screw 403 to rotate, and the rotating lead screw 403 drives the infrared temperature measuring camera 3 to move laterally through the nut seat 402, thereby adjusting the horizontal displacement of the infrared temperature measuring camera 3.

[0048] Specifically, the mounting base 301 is equipped with a first motor 302, and the output shaft of the first motor 302 is fixedly connected to the top of the infrared temperature measuring camera 3.

[0049] In this embodiment, by setting a first motor 302, the infrared temperature measuring camera 3 can be driven to rotate, thereby adjusting the horizontal angle of the infrared temperature measuring camera 3.

[0050] Specifically, the mesh diameter of the mesh plate 602 is smaller than the diameter of the dehumidifying particles 604.

[0051] In this embodiment, by setting the mesh plate 602, the humid gas inside the protective cover 6 can enter the dehumidification box 601 through the mesh holes on the mesh plate 602, and then come into contact with the dehumidification particles 604 in the dehumidification box 601, and be absorbed by the dehumidification particles 604.

[0052] Specifically, the infrared temperature measurement camera 3 is hemispherical.

[0053] In this implementation scheme, an infrared temperature measurement camera 3 is set up. The infrared temperature measurement camera 3 is a device that uses infrared radiation to measure temperature. It receives the infrared radiation emitted by an object, processes the signal and converts it into temperature information. The infrared temperature measurement function is integrated into the monitoring system, which can achieve the dual purpose of monitoring and temperature measurement at the same time.

[0054] When using it, 1. According to each sensor S = {S1, S2, S3...S...} N The received current and voltage data, environmental data, and monitoring images are used as inputs.

[0055] 2. Divide the received data into data slices (data slice 1, data slice 2, data slice 3, ..., data slice K). Each data slice contains m modes, and the data of each mode is represented as {D1, D2, D3, ..., D...} M For each data slice, feature extraction is performed, i.e., F(k) = Extractork(D). k ).

[0056] 3. Encode each mode, E k =Encoder k (Dk ), which is converted into a feature vector.

[0057] 4. Perform feature fusion, i.e., attention weights. w a It is a learnable weight vector, where M is the number of modes and Ej is the feature of the j-th mode. The fused feature vector is the weighted sum of the feature vectors of each mode:

[0058] 5. After merging all the data together, the final feature dataset is formed;

[0059] n is the number of data slices.

[0060] 6. Use the newly obtained fused feature dataset as input to perform anomaly detection.

[0061] 7. After anomaly detection, the data is labeled, assigning corresponding labels to abnormal data and normal data to normal labels. That is, Label = {L1, L2, L3...L...} n}

[0062] 8. If any abnormality is found in the equipment, a comprehensive assessment and risk investigation of the converter station shall be conducted immediately.

[0063] 9. When the infrared temperature measuring camera 3 is installed on the wall or ceiling using bolts 501 and mounting plate 5, to reduce the corrosion of the bolt head by external moisture, the main bevel gear 705, the secondary bevel gear 704 and the screw 703 are rotated by turning the knob 706. The rotating screw 703 drives the protective cover 6 to move vertically through the threaded sleeve 702, so that the protective cover 6 covers the head of the bolt 501. The protective cover 6 keeps the head of the bolt 501 in a closed space. The moisture inside the protective cover 6 can enter the dehumidification box 601 through the mesh on the mesh plate 602, and then come into contact with the dehumidification particles 604 in the dehumidification box 601, and be absorbed by the dehumidification particles 604, so that the space inside the protective cover 6 becomes dry.

[0064] The first motor 302 is started, which drives the infrared temperature measuring camera 3 to rotate, thereby adjusting the horizontal angle of the infrared temperature measuring camera 3. The second motor 404 is started, which drives the lead screw 403 to rotate. The rotating lead screw 403 drives the infrared temperature measuring camera 3 to move laterally through the nut seat 402, thereby adjusting the horizontal displacement of the infrared temperature measuring camera 3. The infrared temperature measuring camera 3 is a device that uses infrared radiation to measure temperature. It receives the infrared radiation emitted by an object and converts it into temperature information after signal processing.

[0065] In summary, the multimodal information fusion device in this converter station scenario effectively divides and parallelizes the multimodal fusion task based on the spatial physical location of the demanding terminals and the heterogeneous communication and computing power characteristics of the computing node network. This achieves parallel and high-efficiency multimodal information fusion of heterogeneous sensor networks for demanding terminals in specific spatial physical locations. When performing complex multimodal information fusion operations in the converter station's intelligent sensing scenario, a streaming computation graph is constructed based on standardized representation, translation, and alignment operators according to different multimodal information fusion requirements. Spatial information from different sources of multimodal information fusion needs is collected, and the computational flow graph is divided and mapped by comprehensively considering node computing power, I / O, and energy supply factors. This reduces the computational intensity of multimodal data fusion and improves the distributed multimodal information fusion efficiency of the converter station's intelligent sensing scenario. The device fuses multimodal data from the converter station, including real-time monitoring images, temperature, current, and voltage, and sensor data collecting and monitoring the operating status and environmental parameters of various equipment within the converter station. This data requires real-time processing to ensure the safe and stable operation of the converter station. The fault detection and diagnosis service analyzes sensor data and equipment operating status to detect and diagnose potential faults, preventing equipment damage and downtime. The equipment condition assessment service evaluates the operating status of critical equipment and predicts future maintenance needs. By installing bolt 501 and mounting plate 5, the infrared temperature camera 3 can be mounted on a wall or ceiling. The protective cover 6 keeps the head of bolt 501 enclosed, preventing it from being constantly exposed to the external environment and reducing corrosion from humid gases, thus extending its service life. The dehumidification box 601 and dehumidifying particles 604 dehumidify the space inside the protective cover 6, further reducing corrosion from humid gases.

[0066] Although embodiments of the invention have been shown and described, it will be understood by those skilled in the art that various changes, modifications, substitutions and alterations can be made to these embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the appended claims and their equivalents.

Claims

1. A multimodal information fusion device for a converter station scenario, comprising data received by sensors (1) and distributed processing of data slices (2), characterized in that: The data (1) received by the sensor internally includes an infrared temperature sensor (101), a current sensor (102), and a voltage sensor (103). Below the data (1) received by the sensor is a distributed processing (2) function for data slices. Below the distributed processing (2) function is a data slice (201). Below the data slice (201) is a data processing (202). Below the data processing (202) is a multimodal fusion (203). Below the multimodal fusion (203) function is a function for processing all data. The data is fused (204). On one side of the data fusion (204), a fused feature dataset (205) is provided. On one side of the fused feature dataset (205), an anomaly detection (206) is provided. Below the anomaly detection (206), there are labels with no anomaly (207) and labels with anomaly (208). Below the label with no anomaly (207), there is a label indicating that the equipment and environment are normal (209). Below the label with anomaly (208), there is a label indicating that a comprehensive evaluation is needed immediately (210). The infrared temperature sensor (101) is fixedly installed at the front end of the infrared temperature measuring camera (3). The top of the infrared temperature measuring camera (3) is movably provided with a mounting base (301). The top of the mounting base (301) is fixedly provided with a fixing rod (4). One end of the fixing rod (4) penetrates the bottom of the protective shell (401) and extends into the interior of the protective shell (401). One end of the fixing rod (4) is fixedly provided with a nut seat (402). The inner wall of the nut seat (402) is movably provided with a lead screw (403). One end of the lead screw (403) is fixedly connected to the output shaft of the second motor (404). A mounting plate (5) is fixedly installed on the top of the protective shell (401). Mounting holes are provided on both sides of the mounting plate (5), and bolts (501) are movably installed on the inner wall of the mounting holes. A protective cover (6) is movably installed at one end of the bolts (501). A dehumidifying box (601) is movably installed inside the protective cover (6). A mesh plate (602) is movably installed on the top of the dehumidifying box (601). Dehumidifying particles (604) are provided inside the dehumidifying box (601). A connecting plate (605) is fixedly installed at the bottom of the dehumidifying box (6). A crossbar (7) is fixedly installed on one side of the protective cover (6). One end of the crossbar (7) passes through one side of the mounting shell (701) and extends into the interior of the mounting shell (701).

2. The multimodal information fusion device for a converter station scenario according to claim 1, characterized in that: A guide block (405) is fixedly provided on the top of the nut seat (402), and a guide rod (406) is movably provided on the inner wall of the guide block (405).

3. The multimodal information fusion device for a converter station scenario according to claim 1, characterized in that: The mesh plate (602) and the dehumidification box (601) are movably connected by a first screw (603), and the top of the dehumidification box (601) is provided with a threaded hole that matches the first screw (603).

4. The multimodal information fusion device for a converter station scenario according to claim 1, characterized in that: The connecting plate (605) and the protective cover (6) are movably connected by the second screw (606). The protective cover (6) has threaded holes on both sides of its bottom that are compatible with the second screw (606).

5. A multimodal information fusion device for a converter station scenario according to claim 1, characterized in that: One end of the crossbar (7) is fixedly provided with a threaded sleeve (702), and a screw (703) is movably provided on the inner wall of the threaded sleeve (702). The connection between the screw (703) and the threaded sleeve (702) is a threaded connection. One end of the screw (703) is fixedly provided with a driven bevel gear (704), and a master bevel gear (705) is movably provided on one side of the driven bevel gear (704). The connection between the master bevel gear (705) and the driven bevel gear (704) is a meshing connection. A knob (706) is fixedly provided on one side of the master bevel gear (705).

6. The multimodal information fusion device for a converter station scenario according to claim 5, characterized in that: The surface of the knob (706) is provided with anti-slip texture.

7. A multimodal information fusion device for a converter station scenario according to claim 1, characterized in that: The connection between the lead screw (403) and the nut seat (402) is a threaded connection.

8. A multimodal information fusion device for a converter station scenario according to claim 1, characterized in that: The mounting base (301) is equipped with a first motor (302), and the output shaft of the first motor (302) is fixedly connected to the top of the infrared temperature measuring camera (3).

9. A multimodal information fusion device for a converter station scenario according to claim 1, characterized in that: The mesh diameter of the screen (602) is smaller than the diameter of the dehumidifying particles (604).

10. A multimodal information fusion device for a converter station scenario according to claim 1, characterized in that: The infrared temperature measurement camera (3) is hemispherical.

Images