Highway electromechanical knowledge fusion and diagnosis system based on large model

Abstract

The application provides a highway electromechanical knowledge fusion and diagnosis system based on a large model, relates to the field of information and communication technology, and comprises a knowledge fusion hub module, a device perception and data acquisition layer and an intelligent diagnosis decision engine, wherein a knowledge graph construction system and a large model engine are built in the knowledge fusion hub module, real-time analysis calculation nodes and a predictive maintenance model are arranged in the intelligent diagnosis decision engine, and the device perception and data acquisition layer comprises an Internet of Things edge device, a monitoring camera and a device perception device. The application deeply fuses fragmented electromechanical knowledge through a large model technology, constructs an intelligent diagnosis engine, can monitor the equipment state in real time, accurately locates the fault root cause, and predicts potential risks. The device perception device is regularly moved along the highway, the appearance information of electromechanical equipment at each preset point is scanned and identified, so that the diagnosis result is output as an analysis basis when a fault occurs.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of information and communication technology, in particular to a highway electromechanical knowledge fusion and diagnosis system based on a large model. BACKGROUND

[0002] The core purpose of diagnosing the highway electromechanical system (including monitoring, toll, communication, lighting, ventilation, etc. Subsystem) is to accurately identify the equipment running state, potential failure and performance degradation trend through systematic, professional detection, analysis and evaluation, so as to realize the active control of the health state of electromechanical facilities, and ultimately guarantee the safe, efficient and reliable operation of the highway, and optimize the life cycle management cost. It is embodied in: ensuring driving safety; maintaining traffic efficiency; reducing operation and maintenance cost; supporting scientific decision-making; improving travel experience, ensuring timely information release and service facility availability, and laying a foundation for moving towards a more intelligent intelligent highway.

[0003] In the prior art, in addition to collecting a large amount of equipment parameter information, the scheme for diagnosing the highway electromechanical equipment can also establish a diagnosis system based on a large model, integrate and understand all the scattered equipment knowledge, and use these knowledge to intelligently analyze various electronic equipment (toll, monitoring, communication, lighting, power supply, etc.) on the highway, quickly diagnose faults, early warning risks, and guide maintenance decisions. However, the conventional diagnosis system can only identify and judge by collecting digital signals, and it is difficult to collect and obtain deformation and damage information in various electromechanical equipment, resulting in a large deviation in the diagnosis result. SUMMARY

[0004] In view of the deficiencies in the prior art, the present application aims to provide a highway electromechanical knowledge fusion and diagnosis system based on a large model to solve the problems raised in the background art. The present application deeply integrates fragmented electromechanical knowledge (manuals, drawings, maintenance records, etc.) through large model technology, builds an intelligent diagnosis engine, can monitor equipment status in real time, accurately locate fault root cause, and predict potential risks. The vehicle-mounted equipment sensing device moves along the highway regularly, scans and identifies the appearance information of the electromechanical equipment at each preset point, so as to output the diagnosis result as an analysis basis when a fault occurs.

[0005] In order to achieve the above object, the application is realized by the following technical scheme: the highway electromechanical knowledge fusion and diagnosis system based on a large model, comprising a knowledge fusion hub module, a device perception and data acquisition layer, and an intelligent diagnosis decision engine, a knowledge graph construction system and a large model engine are built in the knowledge fusion hub module, real-time analysis calculation nodes and predictive maintenance models are arranged in the intelligent diagnosis decision engine, the device perception and data acquisition layer comprises an Internet of Things edge device, a monitoring camera and a device perception device, wherein the device perception device is mounted on a highway inspection vehicle, and the device perception device comprises a fixed seat, a driving mechanism, a scanning assembly and a lifting mechanism, the driving mechanism is screwed on the surface of the fixed seat, the top end of the driving mechanism is provided with the scanning assembly, one end of the surface of the fixed seat is screwed with a lifting sleeve, the top end of the lifting sleeve is inserted with the lifting mechanism, a three-dimensional scanning diagnosis unit is arranged in the scanning assembly, and the tail end of the scanning assembly is used for embedding into the inner side of the lifting mechanism.

[0006] Further, the knowledge graph construction system is used to take device parameters and fault logic, construct a device relationship network, establish a unified semantic model based on the ontology framework of the highway electromechanical field, automatically extract entities and relationships in the electromechanical knowledge, and mine the correlations in the historical fault data by using a graph neural network.

[0007] Further, the knowledge graph construction system further converts real-time sensor data streams into attribute nodes through a dynamic knowledge injection mechanism, and finally generates a dynamic graph containing millions of nodes / edges, so that fragmented electromechanical knowledge is upgraded to a decision network that provides traceability and reasoning.

[0008] Further, the large model engine is used to understand natural language and associate fragmented knowledge, and the large model engine integrates a multi-source database, the multi-source database comprises a SQL database, a NoSQL database and a real-time time series database, wherein the SQL database is used to store structured data, the NoSQL database is used to store unstructured data, and the real-time time series database is used to store device operation data streams.

[0009] Further, the scanning assembly comprises a telescopic arm, a three-dimensional laser scanner and a plug-in board, the tail end of the telescopic arm is integrally formed with the plug-in board, the tail end of the plug-in board is integrally formed with a front end clamping rod, a rear end clamping rod is inserted into the side edge of the plug-in board, and the surface of the telescopic arm is screwed with the three-dimensional laser scanner.

[0010] Further, the driving mechanism comprises a stand, a motor and a rotating shaft, a clamping groove is formed in the top of the stand, the rotating shaft is arranged in the clamping groove, the motor is screwed on one side of the top end of the stand, and the rotating shaft is inserted into the output end of the motor.

[0011] Further, the motor is started to control the rotation of the rotating shaft and drive the telescopic arm to rotate synchronously, the telescopic arm is in a three-section telescopic structure, and the front end clamping rod and the rear end clamping rod are parallel to each other.

[0012] Further, the side of the lifting sleeve is provided with a lug plate, a distance measuring module is screwed on the surface of the lug plate, and the side of the lifting sleeve is also provided with an air cylinder; the lifting mechanism comprises a lifting column, a supporting spring and a transmission mechanism, the bottom of the lifting column is welded with the supporting spring, the bottom end of the supporting spring is connected with a bottom plate, and the supporting spring and the bottom plate are embedded into the inside of the lifting sleeve; and a clamping layer is formed in the inside of the lifting column, and the insertion plate is embedded into the inside of the clamping layer.

[0013] Further, the two sides of the lifting column are welded with an extension plate and a guide sleeve respectively, the transmission mechanism comprises a pressure bearing plate, a first gear and a second gear, the two ends of the pressure bearing plate are integrally formed with protrusions, the bottom of the pressure bearing plate is welded with a first gear rack, the bottom of the clamping layer is inserted with a supporting shaft, the surface of the supporting shaft is keyed with the first gear and the second gear, and the first gear and the first gear rack are engaged.

[0014] Further, the inside of the guide sleeve is inserted with an extension column, the surface of the extension column is integrally formed with a second gear rack, the second gear rack is used for engaging with the second gear, the end of the extension column is connected with an electrode column, the other end of the extension column is embedded into the inside of the extension plate, the bottom end of the pressure bearing plate is also welded with a spring rod, and the bottom end of the spring rod is fixedly connected with the inner wall of the lifting column.

[0015] The beneficial effects of the present application are as follows:

[0016] The highway electromechanical knowledge fusion and diagnosis system based on a large model can realize real-time monitoring of equipment state, accurate positioning of fault root cause, and prediction of potential risks, and can change passive repair to active prevention, correlate with equipment life cycle data, and respond to complex queries in seconds, thereby improving operation and maintenance efficiency and significantly reducing highway interruption risks and economic losses.

[0017] In the highway electromechanical knowledge fusion and diagnosis system based on a large model, a vehicle-mounted device sensing device is regularly moved along the highway to scan and identify the appearance information of electromechanical equipment at each preset point, so that whether each electromechanical equipment has deformation or damage can be regularly obtained, and the collected three-dimensional modeling information can be updated, so as to output a diagnosis result as an analysis basis when a fault occurs.

[0018] The large model-based highway electromechanical knowledge fusion and diagnosis system drives the lifting and rotation of the scanning assembly through the driving mechanism to realize the scanning process of the appearance of the surrounding electromechanical equipment, and can also cooperate with the reverse operation of the cylinder and the driving mechanism to detect the leakage around the power equipment on the side, so as to obtain more accurate and reliable leakage information for verifying the diagnosis result and improving the accuracy of the diagnosis information. BRIEF DESCRIPTION OF DRAWINGS

[0019] Figure 1 It is a principle block diagram of the large model-based highway electromechanical knowledge fusion and diagnosis system of the application;

[0020] Figure 2 It is a device perception device structure diagram used in the large model-based highway electromechanical knowledge fusion and diagnosis system of the application;

[0021] Figure 3 It is a structure schematic diagram of the scanning assembly part of the application;

[0022] Figure 4 It is an installation structure diagram of the three-dimensional laser scanner part of the application;

[0023] Figure 5 It is a structure schematic diagram of the lifting mechanism part of the application;

[0024] Figure 6 It is a split diagram of the lifting mechanism of the application;

[0025] Figure 7 It is Figure 2 It is an enlarged view of area A;

[0026] Figure 8 It is a structure schematic diagram of the transmission mechanism part of the application;

[0027] In the figure: 1, fixed seat; 2, driving mechanism; 3, scanning assembly; 4, lifting mechanism; 5, stand; 6, clamping groove; 7, motor; 8, rotating shaft; 9, telescopic arm; 10, three-dimensional laser scanner; 11, plug-in board; 12, rear end clamping rod; 13, front end clamping rod; 14, lifting sleeve; 15, convex plate; 16, distance measuring module; 17, cylinder; 18, lifting column; 19, interlayer; 20, transmission mechanism; 21, supporting spring; 22, bottom plate; 23, extension plate; 24, guide sleeve; 25, pressure plate; 26, convex strip; 27, first rack; 28, support shaft; 29, first gear; 30, second gear; 31, second rack; 32, extension column; 33, electrode column; 34, spring rod. DETAILED DESCRIPTION

[0028] In order to make the technical means, creative features, purposes and effects of the present application easy to understand, the following will further describe the present application in combination with specific embodiments.

[0029] Please refer to Figures 1 to 8 The present application provides the following technical solutions: a highway electromechanical knowledge fusion and diagnosis system based on a large model, comprising a knowledge fusion hub module, a device perception and data acquisition layer, and an intelligent diagnosis and decision engine, a knowledge graph construction system and a large model engine are built in the knowledge fusion hub module, real-time analysis and calculation nodes and a predictive maintenance model are arranged in the intelligent diagnosis and decision engine, the device perception and data acquisition layer comprises Internet of Things edge devices, monitoring cameras, and device perception devices, wherein the device perception devices are mounted on a highway inspection vehicle, and the device perception devices comprise a fixed seat 1, a driving mechanism 2, a scanning assembly 3, and a lifting mechanism 4, the driving mechanism 2 is screwed on the surface of the fixed seat 1, the top end of the driving mechanism 2 is provided with the scanning assembly 3, one end of the surface of the fixed seat 1 is screwed with a lifting sleeve 14, the top end of the lifting sleeve 14 is inserted with the lifting mechanism 4, a three-dimensional scanning diagnosis unit is arranged in the scanning assembly 3, and the end of the scanning assembly 3 is used for embedding into the inner side of the lifting mechanism 4. The system realizes the fusion of highway electromechanical knowledge based on a large model, and realizes the scanning and acquisition of the state of electromechanical equipment in cooperation with the vehicle-mounted device perception device, so as to achieve the purpose of more accurate and reliable system diagnosis.

[0030] In this embodiment, the knowledge graph construction system is used to obtain device parameters and fault logic, construct a device relationship network, and establish a unified semantic model based on the ontology framework of the highway electromechanical field, automatically extract entities and relationships in the electromechanical knowledge, and mine the correlations in the historical fault data by using a graph neural network. The knowledge graph construction system further converts real-time sensor data streams into attribute nodes through a dynamic knowledge injection mechanism, and finally generates a dynamic graph containing millions of nodes / edges, so that fragmented electromechanical knowledge is upgraded to a decision network that provides traceability and reasoning. The large model engine is used to understand natural language and associate fragmented knowledge, and the large model engine integrates a multi-source database, which comprises an SQL database, a NoSQL database, and a real-time time series database, wherein the SQL database is used to store structured data, the NoSQL database is used to store unstructured data, and the real-time time series database is used to store device operation data streams. The highway electromechanical knowledge fusion and diagnosis system deeply fuses fragmented electromechanical knowledge (manuals, drawings, maintenance records, etc.) through a large model technology, constructs an intelligent diagnosis engine, can monitor the state of the equipment in real time, accurately locates the root cause of the fault, and predicts potential risks, changes passive repair to active prevention, associates the whole life cycle data of the equipment, and responds to complex queries in seconds; improves the operation and maintenance efficiency, and significantly reduces the risk of highway interruption and economic loss.

[0031] The scanning assembly 3 comprises a telescopic arm 9, a three-dimensional laser scanner 10 and a plug-in plate 11, the telescopic arm 9 is integrally formed with the plug-in plate 11 at the end, the plug-in plate 11 is integrally formed with the front end clamping rod 13 at the end, the plug-in plate 11 is inserted with the rear end clamping rod 12 at the side, and the three-dimensional laser scanner 10 is screwed on the surface of the telescopic arm 9. The driving mechanism 2 comprises a column 5, a motor 7 and a rotating shaft 8, the column 5 is provided with a clamping groove 6 at the top, the rotating shaft 8 is installed in the clamping groove 6, the motor 7 is screwed on one side of the top end of the column 5, and the rotating shaft 8 is inserted into the output end of the motor 7. The motor 7 is used to control the rotating movement of the rotating shaft 8 and drive the telescopic arm 9 to run synchronously after being started, the telescopic arm 9 is in a three-section telescopic structure as a whole, and the front end clamping rod 13 and the rear end clamping rod 12 are parallel to each other. The vehicle-mounted device sensing device moves along the highway regularly, scans and identifies the appearance information of the electromechanical equipment at each preset point, so that whether the electromechanical equipment at each point has deformation or damage can be obtained regularly, and the collected three-dimensional modeling information is updated, so that the diagnosis result is output as an analysis basis when a fault occurs.

[0032] Specifically, the device sensing device is installed on the inspection vehicle of the highway, and the whole device sensing device is moved along the to-be-measured highway range regularly by the inspection vehicle. During the movement, a marker is erected in the area where three-dimensional scanning is needed. After the ranging module 16 irradiates the marker, an electric signal is sent to control the driving mechanism 2 to operate. At this time, the motor 7 in the driving mechanism 2 is started, the rotating shaft 8 and the telescopic arm 9 are driven to rotate by the operation of the motor 7, the three-dimensional laser scanner 10 at the end is driven to work by the rotation of the telescopic arm 9, the plug-in plate 11 at the end is moved upward from the inside of the lifting mechanism 4, so as to control the three-dimensional laser scanner 10 to lift upward, realize the scanning process of the corresponding electromechanical equipment around the marker, and finally realize the exploration of the surface deformation or damage phenomenon of the electromechanical equipment in the range and upload to the database for later diagnosis. The three-dimensional laser scanner 10 and the ranging module 16 are both existing mature technologies and do not belong to the protection range of the present application, so their internal structures and specific specifications are not described here.

[0033] The side of the lifting sleeve 14 is provided with a lug plate 15, the surface of the lug plate 15 is screwed with a distance measuring module 16, the side of the lifting sleeve 14 is also provided with a pneumatic cylinder 17, the lifting mechanism 4 comprises a lifting column 18, a supporting spring 21 and a transmission mechanism 20, the bottom of the lifting column 18 is welded with the supporting spring 21, the bottom end of the supporting spring 21 is connected with a bottom plate 22, the supporting spring 21 and the bottom plate 22 are embedded into the inside of the lifting sleeve 14, the inside of the lifting column 18 is provided with a sandwich layer 19, the plug-in plate 11 is used for embedding into the inside of the sandwich layer 19. The two sides of the lifting column 18 are respectively welded with an extension plate 23 and a guide sleeve 24, the transmission mechanism 20 comprises a pressure bearing plate 25, a first gear 29 and a second gear 30, the two ends of the pressure bearing plate 25 are integrally formed with a convex strip 26, the bottom of the pressure bearing plate 25 is welded with a first gear rack 27, the bottom of the sandwich layer 19 is inserted with a supporting shaft 28, the surface of the supporting shaft 28 is keyed with the first gear 29 and the second gear 30, the first gear 29 and the first gear rack 27 are engaged. The inside of the guide sleeve 24 is inserted with an extension column 32, the surface of the extension column 32 is integrally formed with a second gear rack 31, the second gear rack 31 is used for engaging with the second gear 30, the end of the extension column 32 is connected with an electrode column 33, the other end of the extension column 32 is embedded into the inside of the extension plate 23. The lifting and rotation of the scanning assembly 3 are controlled by the driving mechanism 2, so as to realize the scanning process of the appearance of the surrounding electromechanical equipment, and also can cooperate with the reverse operation of the pneumatic cylinder 17 and the driving mechanism 2 to detect the leakage around the power equipment on the side, so as to obtain more accurate and reliable leakage information, which is used for verifying the diagnosis result and improving the accuracy of the diagnosis information.

[0034] Specifically, the telescopic arm 9 and the lifting column 18 are docked by embedding the plug-in plate 11 into the inside of the sandwich layer 19 and clamping the two sides of the lifting column 18 through the front end clamping rod 13 and the rear end clamping rod 12 respectively. When the motor 7 is started subsequently, the telescopic arm 9 is driven to rotate upward, which can directly drive the lifting column 18 to also rise upward synchronously, so as to ensure that the three-dimensional laser scanner 10 can maintain a more stable state during the entire lifting process, until the plug-in plate 11 is completely removed from the inside of the sandwich layer 19, at this time the telescopic arm 9 reaches the maximum extension state, so as to be able to rotate in a larger range and realize the scanning and exploration of the top equipment. When the telescopic arm 9 is reset, the lifting column 18 is directly pressed downward, so that the supporting spring 21 is contracted.

[0035] When the air cylinder 17 is started, the lifting column 18 is pressed and clamped by the extension of the air cylinder 17, so as to achieve the locking purpose of the lifting column 18. At this time, through the reverse operation of the motor 7, the plug-in plate 11 at the end can be pressed downward on the pressure plate 25, so as to drive the pressure plate 25 and the first rack 27 at the bottom to move downward, and through the first gear 29, the support shaft 28 is driven to rotate, the second gear 30 drives the second rack 31 at the bottom to move, and finally the electrode column 33 at the end is extended outward from the inside of the guide sleeve 24, clamped on the corresponding electromechanical equipment around the side, and whether there is current at the contact position is probed, so as to achieve the purpose of leakage detection and diagnosis.

[0036] The above shows and describes the basic principles and main features of the present application and the advantages of the present application. It is obvious for those skilled in the art that the present application is not limited to the details of the above exemplary embodiments, and the present application can be realized in other specific forms without departing from the spirit or essential characteristics of the present application.

[0037] In addition, it should be understood that although the present application is described in terms of embodiments, not every embodiment contains only one independent technical solution, and the description of the specification is only for the sake of clarity, and those skilled in the art should consider the specification as a whole, and the technical solutions in each embodiment can be combined appropriately to form other embodiments that those skilled in the art can understand.

Claims

1. A highway electromechanical knowledge fusion and diagnosis system based on a large model, characterized in that: The application relates to a knowledge fusion center module, a device perception and data acquisition layer and an intelligent diagnosis decision engine, wherein a knowledge graph construction system and a large model engine are arranged in the knowledge fusion center module, real-time analysis calculation nodes and a predictive maintenance model are arranged in the intelligent diagnosis decision engine, the device perception and data acquisition layer comprises Internet of Things edge devices, monitoring cameras and device perception devices, the device perception devices are mounted on highway inspection vehicles, and the device perception devices comprise a fixed seat (1), a driving mechanism (2), a scanning assembly (3) and a lifting mechanism (4), the driving mechanism (2) is screwed on the surface of the fixed seat (1), the top end of the driving mechanism (2) is provided with the scanning assembly (3), one end of the surface of the fixed seat (1) is screwed with a lifting sleeve (14), the top end of the lifting sleeve (14) is inserted with the lifting mechanism (4), a three-dimensional scanning diagnosis unit is arranged in the scanning assembly (3), and the tail end of the scanning assembly (3) is used for being embedded into the inner side of the lifting mechanism (4); the knowledge graph construction system is used for obtaining device parameters and fault logic, constructing a device relationship network, establishing a unified semantic model based on a highway electromechanical field ontology framework, automatically extracting entities and relationships in electromechanical knowledge, and utilizing a graph neural network to mine correlations in historical fault data; the knowledge graph construction system further converts real-time sensor data streams into attribute nodes through a dynamic knowledge injection mechanism, finally generates a dynamic graph containing million nodes / edges, and upgrades fragmented electromechanical knowledge into a decision network providing tracing and reasoning, the large model engine is used for understanding natural language and associating fragmented knowledge, and the large model engine integrates a multi-source database, the multi-source database comprises an SQL database, a NoSQL database and a real-time time series database, the SQL database is used for storing structured data, the NoSQL database is used for storing unstructured data, and the real-time time series database is used for storing device running data streams; the scanning assembly (3) comprises a telescopic arm (9), a three-dimensional laser scanner (10) and a plug-in plate (11), the tail end of the telescopic arm (9) is integrally formed with the plug-in plate (11), the tail end of the plug-in plate (11) is integrally formed with a front end clamping rod (13), a rear end clamping rod (12) is inserted on the side of the plug-in plate (11), and the surface of the telescopic arm (9) is screwed with the three-dimensional laser scanner (10); the driving mechanism (2) comprises a stand (5), a motor (7) and a rotating shaft (8), the top of the stand (5) is provided with a clamping groove (6), the rotating shaft (8) is arranged in the clamping groove (6), one side of the top end of the stand (5) is screwed with the motor (7), and the rotating shaft (8) is inserted into the output end of the motor (7).The side of the lifting sleeve (14) is provided with a lug plate (15), the surface of the lug plate (15) is screwed with a distance measuring module (16), the side of the lifting sleeve (14) is further provided with a pneumatic cylinder (17), the lifting mechanism (4) comprises a lifting column (18), a supporting spring (21) and a transmission mechanism (20), the bottom of the lifting column (18) is welded with the supporting spring (21), the bottom end of the supporting spring (21) is connected with a bottom plate (22), the supporting spring (21) and the bottom plate (22) are embedded into the inside of the lifting sleeve (14), the inside of the lifting column (18) is provided with a sandwich layer (19), and the plug-in plate (11) is used for embedding into the inside of the sandwich layer (19).

2. The large model-based highway electromechanical knowledge fusion and diagnosis system according to claim 1, characterized in that: The motor (7) is started to control the rotating shaft (8) rotating movement and drive the telescopic arm (9) synchronous operation, the telescopic arm (9) is three telescopic structure as a whole, the front end clamp rod (13) and rear end clamp rod (12) are parallel to each other.

3. The large model-based highway electromechanical knowledge fusion and diagnosis system according to claim 1, characterized in that: Both sides of the lifting column (18) are welded with extension plate (23) and guide sleeve (24) respectively, the transmission mechanism (20) includes pressure plate (25), first gear (29) and second gear (30), both ends of the pressure plate (25) are integrally formed with convex strip (26), the bottom of the pressure plate (25) is welded with first rack (27), the bottom of the interlayer (19) is inserted with support shaft (28), the surface of the support shaft (28) is keyed with first gear (29) and second gear (30), the first gear (29) and first rack (27) are engaged.

4. The large model-based highway electromechanical knowledge fusion and diagnosis system according to claim 3, characterized in that: The inner side of the guide sleeve (24) is inserted with extension column (32), the surface of the extension column (32) is integrally formed with second rack (31), the second rack (31) is used for engaging with the second gear (30), the end of the extension column (32) is connected with electrode column (33), the other end of the extension column (32) is embedded into the inner side of the extension plate (23), the bottom end of the pressure plate (25) is also welded with spring rod (34), the bottom end of the spring rod (34) is fixedly connected with the inner wall of the lifting column (18).

Images