Multi-sensor equipment AI early warning system applied to bulk grain system line

Abstract

The invention discloses a multi-sensor equipment AI early warning system applied to a bulk grain system line, and belongs to the field of grain conveying. According to the method, the problems that data of an existing early warning system is difficult to process in a centralized manner and the practicability of the existing early warning system is reduced are solved, and the neural network model is trained and tested by adopting historical operation data, so that the model capable of predicting the operation state of the bulk grain equipment is obtained; the neural network model is applied to an actual bulk grain system line, so that the operation state of bulk grain equipment is predicted in real time, and whether the bulk grain system line and the surrounding environment are abnormal or not is inspected in combination with an unmanned aerial vehicle; when an abnormal condition is found, an alarm can be sent to the man-machine interaction interface in time, so that a manager is reminded to take solutions in time; therefore, the early warning function of the bulk grain equipment is effectively realized, the fault expansion of the bulk grain equipment is avoided, the hidden dangers of fire and dust detonation in the surrounding environment are avoided, and the labor intensity of inspectors is reduced.

Description

Technical Field

[0001] The present invention relates to the technical field of grain transportation, and in particular to a multi-sensor equipment AI early warning system applied to a bulk grain system line. Background Art

[0002] The bulk grain system line equipment includes scraper conveyors, bucket elevators, belt conveyors and other major equipment models, which are responsible for transporting bulk grain to bulk grain silos. During the operation, personnel are required to inspect the operating equipment. Due to the uncertainty of manual inspections, abnormal conditions of equipment cannot be discovered in time, resulting in the expansion of equipment failures and affecting safe production.

[0003] For example, in the prior art: current sensors, vibration sensors, audio sensors, temperature sensors, thermal imaging, flow sensors and drone audio and video special inspection modules are installed on the scraper conveyor, bucket elevator and belt conveyor of the grain conveying equipment, and the signals are collected.

[0004] However, currently, the alarm systems such as current alarm system, vibration alarm system, optical fiber temperature measurement and thermal imaging are all operated independently, and the individual systems always make inaccurate judgments, which brings great trouble to the operators and affects the use effect. Therefore, the existing needs are not met, so we proposed an AI early warning system for multi-sensor equipment applied to bulk grain system lines. Summary of the invention

[0005] The purpose of the present invention is to provide a multi-sensor equipment AI early warning system applied to a bulk grain system line, which predicts the operating status of the bulk grain equipment by adopting a neural network model, and combines a drone to patrol the bulk grain system line and the surrounding environment to see if there are any abnormalities; when an abnormal situation is found, an alarm can be promptly issued to the human-computer interaction interface to remind the management personnel to take timely solutions; thereby effectively realizing the early warning function of the bulk grain equipment, preventing the expansion of bulk grain equipment failures, and avoiding the hidden dangers of fire and dust explosion in the surrounding environment, reducing the labor intensity of patrol personnel, reducing labor costs, and solving the problems raised in the above-mentioned background technology.

[0006] To achieve the above object, the present invention provides the following technical solutions: The multi-sensor AI early warning system for bulk grain systems includes: The data collection unit collects the working status of the bulk grain equipment in real time through the sensor equipment, obtains the historical operation data and real-time operation data of the bulk grain equipment, and feeds back various operation data to the centralized processing unit for pre-processing; The centralized processing unit receives and pre-processes the historical operation data and real-time operation data of the bulk grain equipment, and extracts characteristic information from the pre-processed historical operation data as an indicator reflecting the historical operation status of the bulk grain equipment; The model building unit builds a neural network model, takes the historical operation data and the extracted feature information as the input set, and takes the historical operation status of the bulk grain equipment as the label; uses the cross-validation technology to train the neural network model, and adjusts the parameters of the neural network model to make the neural network model as close to the actual operation status of the bulk grain equipment as possible; The intelligent analysis unit uses the trained neural network model to analyze and predict the historical operation data of the bulk grain equipment to obtain the estimated state value of the bulk grain equipment; based on the estimated state value, it determines whether the bulk grain equipment is in a normal working state and whether there is any abnormality; and compares the judgment result with the historical operation state of the bulk grain equipment to verify the accuracy of the prediction of the neural network model; The model deployment unit deploys the verified neural network model into the actual bulk grain production system to predict the real-time operating status of the bulk grain equipment; The environmental inspection unit uses drone equipment to regularly inspect the bulk grain system line and the surrounding environment, obtain image information of the bulk grain system line and the surrounding environment, and judge whether there are abnormal dangers in the bulk grain system line and the surrounding environment; The human-computer interaction interface visualizes the operating status of the bulk grain equipment and the image information of the bulk grain system line and the surrounding environment.

[0007] Furthermore, the data acquisition unit includes: Equipment layout module, install various sensor devices on the scraper, bucket elevator and belt conveyor of bulk grain equipment, including: weight sensor, vibration sensor, temperature sensor, humidity sensor, particle size sensor and dust sensor; The timing feedback module sets a timing feedback mechanism for each sensor device, so that after the sensor device enters the real-time collection state, it regularly feeds back the real-time operation data of the bulk grain equipment to the centralized processing unit.

[0008] Furthermore, the centralized processing unit includes: Data cleaning module, which removes missing values, duplicate values ​​and outliers from the operating data, removes noise and unnecessary redundant information from the operating data, and converts the format of the operating data; The feature extraction module analyzes the vibration spectrum, particle speed and size, particle density and flow rate, and temperature distribution of the bulk grain equipment to extract the characteristic information of the bulk grain equipment's operating status; The data storage module classifies and organizes the received operation data by category, and stores the organized operation data by time series and category to form a database.

[0009] Furthermore, the model building unit includes: The sample division module divides the historical operation data and the extracted feature information into training sets and test sets; The label matching module collects the historical operating status of bulk grain equipment in the same period as the historical operating data; sets labels for each type of historical operating status, and then matches the labels with each type of historical operating status and historical operating data; The model building module takes the training set as the input set, builds and trains the neural network model based on the input set, and establishes the feature layer and learning process of the neural network model.

[0010] Furthermore, the intelligent analysis unit includes: The model verification module inputs the test set into the trained neural network model for prediction and outputs the estimated state value of the bulk grain equipment; and compares the estimated state value with the actual result to verify whether the prediction ability of the neural network model is accurate; The result generation module determines whether the bulk grain equipment is in a normal working state and whether there is an abnormal situation based on the estimated state value of the bulk grain equipment, and generates corresponding prediction results.

[0011] Furthermore, the intelligent analysis unit further includes: The model optimization module regularly uses real-time operation data to update and iterate the neural network model to optimize the parameters and performance of the neural network model.

[0012] Furthermore, the model deployment unit includes: The model deployment module exports the verified neural network model into an executable format, and deploys the neural network model to the cloud platform loaded with the human-computer interaction interface according to the requirements of the neural network model and system characteristics; The timing prediction module predicts the operating status of bulk grain equipment regularly according to the feedback frequency of real-time operating data; The early warning prompt module sends a warning prompt to the human-computer interaction interface in time when the neural network model predicts that the bulk grain equipment and the drone detects abnormal conditions in the surrounding environment, reminding the management personnel to check and repair.

[0013] Furthermore, the model deployment unit further includes: The model operation module performs real-time analysis based on the neural network model to determine the first real-time operation status of the bulk grain equipment; The monitoring module deploys the monitoring mechanism and calculates the operation status of the bulk grain equipment in real time according to the monitoring mechanism to obtain the second real-time operation status; Wherein, obtaining the second real-time operating status includes: Collect the real-time measurement values ​​of each sensor in each sensor type, and calculate the comprehensive measurement value of each type of bulk grain equipment based on the real-time measurement values ​​of each sensor; ; in, Indicates Comprehensive measurement values ​​of bulk grain equipment of each sensor under different sensor types; Indicates the number of sensors; Indicates the total number of sensors; Indicates Sensor Type The initial weights corresponding to the sensors; Indicates Sensor Type Dynamic weight adjustment factor corresponding to each sensor; Indicates Sensor Type Real-time measurement values ​​of sensors; An ordinal value indicating the sensor type; Based on the comprehensive measurement values ​​of the bulk grain equipment, the risk assessment value of the bulk grain equipment is calculated.

[0014] ; in, Indicates the risk assessment value of bulk grain equipment; Indicates the total number of sensor types; Indicates taking the maximum value; Indicates Safety measurement thresholds corresponding to the sensor types; Indicates The risk weights corresponding to the sensor types; Determine the second real-time operating status based on the risk assessment value of the bulk grain equipment. hour, , it means that the current bulk grain equipment is within the safe range; when , it means that the current bulk grain equipment is in the abnormal range; The report generating module is used to generate an evaluation report based on the first real-time operating status and the second real-time operating status, and transmit the evaluation report to the user terminal.

[0015] Furthermore, the environmental patrol unit includes: The equipment configuration module configures the corresponding drone equipment and image acquisition equipment according to the patrol area and frequency; The planning module formulates the inspection plan according to the location and environmental characteristics of the bulk grain system line, including: the time, route and key inspection contents of the inspection; The image acquisition module uses drones to regularly patrol the bulk grain system line and its surrounding environment to obtain corresponding image information; The image analysis module analyzes the image information to determine whether there are any abnormalities in the bulk grain system line and the surrounding environment.

[0016] Furthermore, the human-computer interaction interface includes: A parameter acquisition module, which acquires the operating status of the bulk grain equipment and the image information of the bulk grain system line and the surrounding environment, sets the operating status of the bulk grain equipment and the image information of the bulk grain system line and the surrounding environment as visual display elements, and determines the display weight of the visual display element based on the visual display requirements; A display configuration module extracts element features of the visual display elements, and allocates a display interface area for each visual display element in the human-computer interaction interface based on the element features and the display weight of the visual display elements. At the same time, an element name is generated for each display interface area based on the element features, and the display interface area is marked based on the element name. Determine the positional association relationship between each bulk grain equipment and the surrounding environment and the bulk grain system line, and add visual association paths to each display interface area in the human-computer interaction interface based on the positional association relationship; Based on the visual association path, the image information of the operating status of the bulk grain equipment and the surrounding environment and the image information of the bulk grain system line are visualized at the same location and frequency; The human-computer interaction configuration module adds preset interactive actions to the human-computer interaction interface at the background configuration end, and determines the response state of the visual display screen under each preset interactive action; Based on the response status of the visualization display screen under each preset interactive action, a multi-touch interaction mechanism is added to the visualization display results of the same frequency at the same location, and based on the multi-touch interaction mechanism, independent visualization display configuration is performed in the background configuration section for the operating status of the bulk grain equipment, the image information of the surrounding environment, and the image information of the bulk grain system line; Based on the independent visualization display configuration, the operating status of the bulk grain equipment and the image information of the bulk grain system line and the surrounding environment are visualized.

[0017] Compared with the prior art, the present invention has the following beneficial effects: 1. The present invention predicts the operating status of bulk grain equipment by adopting a neural network model, and combines a drone to inspect the bulk grain system line and the surrounding environment to see if there are any abnormalities; when an abnormal situation is found, an alarm can be promptly issued to the human-computer interaction interface to remind the management personnel to take timely solutions; thereby effectively realizing the early warning function of the bulk grain equipment, preventing the expansion of bulk grain equipment failures, and avoiding the hidden dangers of fire and dust explosion in the surrounding environment, reducing the labor intensity of inspectors, reducing labor costs, and improving the intelligence of existing agricultural development.

[0018] 2. By determining the display weights of the operating status of the bulk grain equipment and the image information of the bulk grain system line and the surrounding environment, it is possible to allocate corresponding display interface areas to different display contents in the human-computer interaction interface according to the display weights, and generate corresponding element names and mark the areas according to the element characteristics of each display interface area, so as to facilitate the display of corresponding contents in different display interface areas. Secondly, the positional association relationship between each bulk grain equipment and the surrounding environment and the bulk grain system line is determined, and different display interface areas are associated according to the positional association relationship, so as to facilitate the same-position and same-frequency visualization of the operating status of the bulk grain equipment and the image information of the surrounding environment and the image information of the bulk grain system line during the interactive operation of the drone, so as to facilitate the effective understanding and viewing of different dimensional information at the same position through the human-computer interaction interface. Finally, a preset interactive action is added to the human-computer interaction interface on the background configuration end, so as to realize the retrieval and independent visualization of the display content to be viewed through the preset interactive action, thereby improving the effect of human-computer interaction and facilitating users to quickly view the corresponding display content as needed.

[0019] 3. By obtaining the first real-time operating status and the second real-time operating status respectively, the comprehensiveness and accuracy of the bulk grain equipment monitoring results can be effectively guaranteed, thereby improving the accuracy of the early warning, and then ensuring the objectivity, accuracy and reliability of the generation of the evaluation report. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 This is a module composition diagram of the multi-sensor equipment AI early warning system applied to the bulk grain system line of the present invention. DETAILED DESCRIPTION

[0021] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0022] In order to solve the technical problem that the current alarm system, vibration alarm system, optical fiber temperature measurement and thermal imaging alarm systems in the existing technology are all independently operated, and the individual systems always make inaccurate judgments, which brings great trouble to the operators and affects the use effect, please refer to Figure 1 , this embodiment provides the following technical solutions: The multi-sensor AI early warning system for bulk grain systems includes: The data acquisition unit collects the working status of the bulk grain equipment in real time through sensor equipment, obtains the historical and real-time operation data of the bulk grain equipment, such as pressure, vibration, temperature, humidity, particle size, and dust content in the air, and feeds back various operation data to the centralized processing unit for pre-processing; the data acquisition unit includes: Equipment layout module, installs a variety of sensor devices on the scraper, bucket elevator and belt conveyor of the bulk grain equipment, the sensor devices include: weight sensor, vibration sensor, temperature sensor, humidity sensor, particle size sensor and dust sensor; specifically, select the appropriate sensor type and quantity according to the parameters to be detected, and determine the installation location; in this embodiment, for example: the installation location of the weight sensor can be installed at the bucket elevator port, discharge port and other places of the bucket elevator, the installation location of the temperature sensor can be installed at the feed port, discharge port and other places, and the installation location of the particle size sensor can be installed at the feed port, discharge port and other places; then design the corresponding interface according to the sensor type and quantity to connect the sensor to the early warning system; after installing and configuring the sensor equipment, it is necessary to test and verify the system to ensure that the early warning system can accurately detect and predict the operating status of the bulk grain equipment; the test includes: testing under normal working conditions and abnormal conditions to ensure the stability and reliability of the early warning system in actual applications.

[0023] The timing feedback module sets a timing feedback mechanism for each sensor device, so that after the sensor device enters the real-time collection state, it regularly feeds back the real-time operation data of the bulk grain equipment to the centralized processing unit; specifically, by designing a timing feedback mechanism according to the data sampling frequency of the sensor, the sensor device automatically enters the real-time collection state after starting or running for a period of time, and regularly sends data feedback to the centralized processing unit; for example: according to actual needs, the feedback frequency of the sensor device is set to feedback once every 60 minutes; if subsequent analysis shows that the operation state of the bulk grain equipment is abnormal, the originally set feedback frequency can be adjusted to feedback once every 30 minutes, until the bulk grain equipment fault is eliminated, and then the data feedback frequency is adjusted to the originally set feedback once every 60 minutes.

[0024] The centralized processing unit receives and pre-processes the historical and real-time operation data of the bulk grain equipment. The pre-processing includes cleaning, denoising, de-falsification and formatting, so as to facilitate subsequent data analysis and modeling. The centralized processing unit extracts characteristic information from the pre-processed historical operation data, such as vibration spectrum, particle velocity, particle size, particle shape and temperature distribution, as indicators reflecting the historical operation status of the bulk grain equipment. The centralized processing unit includes: The data cleaning module removes missing values, duplicate values ​​and outliers in the operating data, as well as removes noise and unnecessary redundant information in the operating data. For example, a low-pass filter is used to remove the noise in the operating data, and the format of the operating data is converted, so as to effectively remove outliers and noise in the operating data and improve the accuracy and reliability of the operating data. At the same time, it is easy to extract effective and useful feature information to improve the quality of the operating data analysis results.

[0025] The feature extraction module analyzes the vibration spectrum, particle speed and size, particle density and flow rate, and temperature distribution of the bulk grain equipment to extract the characteristic information of the operating status of the bulk grain equipment. Among them, by analyzing the vibration signal generated when the bulk grain equipment is in operation, the vibration frequency, intensity, phase and other information of the equipment can be obtained, thereby reflecting the operating status and stability of the bulk grain equipment. By measuring and analyzing the particles generated when the bulk grain equipment is in operation, the speed, size and shape of the particles can be obtained, thereby reflecting the conveying capacity and particle characteristics of the bulk grain equipment. By analyzing the temperature signal generated when the bulk grain equipment is in operation, the temperature distribution and change trend of the bulk grain equipment can be obtained, thereby reflecting the operating status and thermal balance of the bulk grain equipment. By analyzing the particle density and flow rate signals generated when the bulk grain equipment is in operation, the material conveying rate and conveying efficiency of the bulk grain equipment can be obtained, thereby reflecting the operating status and production capacity of the bulk grain equipment.

[0026] The data storage module classifies and organizes the received operating data by category, and stores the organized operating data by time series and category to form a database; specifically, when collecting the operating data of the bulk grain equipment, the timestamp of the data is synchronously recorded; the pre-processed data is classified by category, such as temperature, humidity, and weight; the data after classification and time series analysis is stored in the database, and different tables are established to store different data, such as temperature table, humidity table, and weight table, etc., and each table includes the timestamp of the data and the corresponding category information; at the same time, in order to facilitate later analysis and query, functions such as indexes and views can also be added to the database to ensure the effectiveness of the database.

[0027] The model building unit builds a neural network model. According to the scale of the operating data, it selects the appropriate network architecture, activation function, defines the loss function and optimizer, etc. It uses the historical operating data and the extracted feature information as the input set, and uses the historical operating status of the bulk grain equipment as the label; it uses the cross-validation technology to train the neural network model, and adjusts the parameters of the neural network model to make the neural network model as close to the actual operating status of the bulk grain equipment as possible; the model building unit includes: The sample partitioning module divides the historical operation data and the extracted feature information into a training set and a test set. The data in the training set will be used to train the neural network model, while the data in the test set will be used to verify the neural network model, such as accuracy, precision, and recall. If the performance of the model does not meet the requirements, it is necessary to adjust the parameters of the training model or add new features.

[0028] The label matching module collects the historical operating status of the bulk grain equipment in the same period as the historical operating data; sets a label for each type of historical operating status, and then matches the label with each type of historical operating status and historical operating data respectively; specifically, according to the time information and operating status information in the historical operating data, set corresponding labels for different operating states, so that each operating state corresponds to a unique label, such as: "normal operation", "fault shutdown" or "maintenance", etc.; matches each label content and the location where it appears by traversing the historical operating data, and analyzes the correlation between the label and the location where it appears; for example: all bulk grain equipment operations or other events associated with specific labels are recorded to better understand the status and behavior patterns of the bulk grain equipment, thereby predicting future operating status.

[0029] The model building module uses the training set as the input set, builds and trains the neural network model based on the input set, and establishes the feature layer and learning process of the neural network model; specifically, the samples in the training set are input into the neural network for forward propagation to obtain the output result of the neural network; and the output result is used as the input of the loss function to calculate the loss value; after calculating the loss value, the back propagation algorithm is used to calculate the updated value of the neural network model parameters, so that the output result of the neural network model is closer to the real result.

[0030] The intelligent analysis unit uses the trained neural network model to analyze and predict the historical operation data of the bulk grain equipment to obtain the estimated state value of the bulk grain equipment; based on the estimated state value, it is judged whether the bulk grain equipment is in a normal working state and whether there is an abnormal situation; and the judgment result is compared with the historical operation state of the bulk grain equipment to verify the accuracy of the prediction of the neural network model; the intelligent analysis unit includes: The model verification module inputs the test set into the trained neural network model for prediction and outputs the state estimation value of the bulk grain equipment; and compares the state estimation value with the actual result to verify whether the prediction ability of the neural network model is accurate; specifically, the test set data is input into the trained neural network model for prediction, and then the prediction result output by the neural network model is compared with the actual result. If the prediction result is completely consistent with the actual result, it means that the prediction ability of the neural network model is relatively accurate; otherwise, it means that there is an error in the neural network model, and the source of the error needs to be further analyzed, and the neural network model needs to be corrected or improved; after multiple iterations and improvements, the error between the prediction result of the neural network model and the actual result reaches an acceptable level.

[0031] The result generation module determines whether the bulk grain equipment is in a normal working state and whether there is an abnormal situation according to the state estimation value of the bulk grain equipment, and generates a corresponding prediction result; specifically, the working state of the bulk grain equipment is judged according to the predicted state estimation value of the bulk grain equipment, combined with the predefined normal working state rules and abnormal situation judgment criteria; if the state estimation value of the bulk grain equipment meets the normal working state rules and no abnormal situation is detected, it can be considered that the bulk grain equipment is in a normal working state and the corresponding prediction result is output; otherwise, the opposite is true.

[0032] The model optimization module regularly uses real-time operation data to update and iterate the neural network model to optimize the parameters and performance of the neural network model.

[0033] The model deployment unit deploys the verified neural network model to the actual bulk grain production system to predict the real-time operating status of the bulk grain equipment. The model deployment unit includes: The model deployment module exports the verified neural network model into an executable format, such as model files in ONNX, TensorFlow or Caffe, and deploys the neural network model to the cloud platform loaded with the human-computer interaction interface according to the requirements of the neural network model and system characteristics; The timing prediction module predicts the operating status of the bulk grain equipment according to the feedback frequency of the real-time operating data. Specifically, following the above embodiment, for example, the feedback frequency of the sensor equipment is set to be fed back once every 60 minutes, and the prediction frequency of the neural network model is also set to be predicted once every 60 minutes. Another example is that if it is found through analysis that the operating status of the bulk grain equipment is abnormal, the previously set feedback frequency can be adjusted to be fed back once every 30 minutes, and the prediction frequency of the neural network model is synchronously adjusted to be predicted once every 30 minutes. After the failure of the bulk grain equipment is rectified, the data feedback frequency and the prediction frequency of the neural network model are adjusted to their original positions.

[0034] The early warning prompt module, when the neural network model predicts that the bulk grain equipment and the drone detect abnormal conditions in the surrounding environment, promptly sends an early warning prompt to the human-computer interaction interface to remind management personnel to check and repair; specifically, if the estimated state of the bulk grain equipment does not meet the normal working state rules, or any abnormal conditions are detected, such as: machine failure, environmental pollution, etc., it is necessary to intervene in the state of the bulk grain equipment and output the corresponding early warning results; the early warning results can be output in different ways according to different situations, such as: sending an alarm to the human-computer interaction interface, recording a log, or sending an alarm message, etc.

[0035] In one embodiment, the multi-sensor equipment AI early warning system applied to the bulk grain system line, the model deployment unit, also includes: The model operation module performs real-time analysis based on the neural network model to determine the first real-time operation status of the bulk grain equipment; The monitoring module deploys the monitoring mechanism and calculates the operation status of the bulk grain equipment in real time according to the monitoring mechanism to obtain the second real-time operation status; Wherein, obtaining the second real-time operating status includes: Collect the real-time measurement values ​​of each sensor in each sensor type, and calculate the comprehensive measurement value of each type of bulk grain equipment based on the real-time measurement values ​​of each sensor; ; in, Indicates Comprehensive measurement values ​​of bulk grain equipment of each sensor under different sensor types; Indicates the number of sensors; Indicates the total number of sensors; Indicates Sensor Type The initial weights corresponding to the sensors; Indicates Sensor Type Dynamic weight adjustment factor corresponding to each sensor; Indicates Sensor Type Real-time measurement values ​​of sensors; An ordinal value indicating the sensor type; Based on the comprehensive measurement values ​​of the bulk grain equipment, the risk assessment value of the bulk grain equipment is calculated.

[0036] ; in, Indicates the risk assessment value of bulk grain equipment; Indicates the total number of sensor types; Indicates taking the maximum value; Indicates Safety measurement thresholds corresponding to the sensor types; Indicates The risk weights corresponding to the sensor types; Determine the second real-time operating status based on the risk assessment value of the bulk grain equipment. hour, , it means that the current bulk grain equipment is within the safe range; when , it means that the current bulk grain equipment is in the abnormal range; The report generating module is used to generate an evaluation report based on the first real-time operating status and the second real-time operating status, and transmit the evaluation report to the user terminal.

[0037] In this embodiment, the dynamic weight adjustment factor can be dynamically adjusted according to factors such as the historical accuracy and real-time stability of the sensor. For example, for a sensor with a small historical measurement error and stable recent data fluctuations, It can take a positive value to increase the weight of the sensor data in the fusion; otherwise, it takes a negative value.

[0038] In this embodiment, the first real-time operating state is the operating state of the bulk grain equipment obtained after real-time analysis based on the neural network model; the second real-time operating state is the operating state of the bulk grain equipment obtained after calculation based on the sensor data collected in real time.

[0039] In this embodiment, the user terminal includes but is not limited to a mobile phone, a computer, etc.

[0040] The working principle and beneficial effect of the above technical solution are: by respectively obtaining the first real-time operating status and the second real-time operating status, the comprehensiveness and accuracy of the monitoring results of the bulk grain equipment can be effectively guaranteed, thereby improving the accuracy of the early warning, and then ensuring the objectivity, accuracy and reliability of the generation of the evaluation report.

[0041] The environmental inspection unit uses drone equipment to regularly inspect the bulk grain system line and the surrounding environment, obtain image information of the bulk grain system line and the surrounding environment, and determine whether there are abnormal dangers in the bulk grain system line and the surrounding environment; the environmental inspection unit includes: The equipment configuration module configures the corresponding drone equipment and image acquisition equipment, such as high-definition cameras, infrared detectors, and laser scanners, according to the patrol area and frequency, to ensure that the acquired image information is accurate.

[0042] The plan-making module formulates a detailed inspection plan based on the location and environmental characteristics of the bulk grain system line, including: the time, route and key inspection content of the inspection; secondly, the scope and frequency of the inspection are determined based on factors such as the location, length and environmental characteristics of the bulk grain system line that needs to be inspected; for example: if the bulk grain system line is too long, it can be divided into several sections for inspection; if the environment around the bulk grain system line is complex and changeable, the frequency of inspection can be increased; and during the actual inspection process, the inspection results are recorded.

[0043] The image acquisition module uses drones to conduct regular inspections of the bulk grain system line and its surrounding environment to obtain corresponding image information, which includes: the appearance status of the equipment in the bulk grain system line and the meteorological information of the surrounding environment.

[0044] The image analysis module analyzes the image information to determine whether there are any abnormal conditions in the bulk grain system line and the surrounding environment. For example, based on the image information, the damage degree of the equipment in the bulk grain system line, the risk of leakage, and environmental pollution can be determined. If an abnormality is detected, relevant personnel should be notified in a timely manner to take measures to ensure production safety and environmental protection. Based on this, the image information of the bulk grain system line can be effectively obtained, so as to promptly discover and respond to abnormal conditions and ensure production safety and environmental protection.

[0045] The human-computer interaction interface visualizes the operating status of the bulk grain equipment and the image information of the bulk grain system line and the surrounding environment, so that managers can intervene and manage in a timely manner.

[0046] The beneficial effects achieved by the above content: Through the above operations, the early warning function of the bulk grain system line is effectively realized, the expansion of bulk grain equipment failures is prevented, and the hidden dangers of fire and dust explosion in the surrounding environment are avoided, the labor intensity of patrol personnel is reduced, labor costs are reduced, and the intelligence of existing agricultural development is improved.

[0047] Working principle: By using historical operating data to train and test the neural network model, a model that can predict the operating status of bulk grain equipment is obtained; the neural network model is applied to the actual bulk grain system line to make real-time predictions on the operating status of the bulk grain equipment, and combined with drones to patrol the bulk grain system line and the surrounding environment to see if there are any abnormalities; when an abnormal situation is found, an alarm can be promptly sent to the human-computer interaction interface to remind management personnel to take timely solutions.

[0048] In one embodiment, a multi-sensor device AI early warning system and a human-computer interaction interface applied to a bulk grain system line include: A parameter acquisition module, used to acquire the operating status of the bulk grain equipment and the image information of the bulk grain system line and the surrounding environment, and set the operating status of the bulk grain equipment and the image information of the bulk grain system line and the surrounding environment as a visualization display element, and determine the display weight of the visualization display element based on the visualization display requirement; Displays the configuration module for: Extracting element features of the visual display elements, and assigning a display interface area to each visual display element in the human-computer interaction interface based on the element features and the display weight of the visual display elements, and generating an element name for each display interface area based on the element features, and marking the display interface area based on the element name; Determine the positional association relationship between each bulk grain equipment and the surrounding environment and the bulk grain system line, and add visual association paths to each display interface area in the human-computer interaction interface based on the positional association relationship; Based on the visual association path, the image information of the operating status of the bulk grain equipment and the surrounding environment and the image information of the bulk grain system line are visualized at the same location and frequency; Human-computer interaction configuration module, used for: Add preset interactive actions to the human-computer interaction interface on the background configuration end, and determine the response state of the visual display screen under each preset interactive action; Based on the response status of the visualization display screen under each preset interactive action, a multi-touch interaction mechanism is added to the visualization display results of the same frequency at the same location, and based on the multi-touch interaction mechanism, independent visualization display configuration is performed in the background configuration section for the operating status of the bulk grain equipment, the image information of the surrounding environment, and the image information of the bulk grain system line; Based on the independent visualization display configuration, the operating status of the bulk grain equipment and the image information of the bulk grain system line and the surrounding environment are visualized.

[0049] In this embodiment, the visual display elements are the operating status of the bulk grain equipment and the image information of the bulk grain system line and the surrounding environment, that is, the content that needs to be displayed on the human-computer interaction interface.

[0050] In this embodiment, the display weight of the visualization display element refers to the importance of different visualization display elements when each visualization display element is displayed. The larger the value, the more important it is in the visualization display. It is related to the position and area allocated when allocating the display interface area.

[0051] In this embodiment, the element feature refers to the type of the visual display element and the object that needs to be displayed during the visual display.

[0052] In this embodiment, the display interface area refers to the display area allocated in the human-computer interaction interface for the operating status of the bulk grain equipment and the image information of the bulk grain system line and the surrounding environment. For example, when allocating, the display interface area of ​​the visualization display element with a greater display weight is closer to the center.

[0053] In this embodiment, the element name is used to mark the type of content displayed in each display interface area.

[0054] In this embodiment, the position association relationship is used to characterize the correspondence between the bulk grain equipment and the surrounding environment and each position in the bulk grain system line, so as to display the same position of the three at the same frequency during the visual display.

[0055] In this embodiment, the visual association path is used to represent the corresponding relationship between the visual display elements in each display interface area.

[0056] In this embodiment, the same-frequency visualization display at the same location means that the operating status of the bulk grain equipment and the image information of the surrounding environment change with the image information of the bulk grain system line. For example, when the image information of the bulk grain system line shows a certain equipment, the display interface area showing the operating status of the bulk grain equipment displays the operating status of the equipment, and the display interface area showing the image information of the surrounding environment displays the image information of the surrounding environment of the equipment.

[0057] In this embodiment, the preset interactive action is set in advance, for example, it may be a click or slide operation.

[0058] In this embodiment, the response state of the visual display screen refers to the situation where the display screen needs to change under each preset interactive action. For example, when the user clicks on the bulk grain equipment that needs to be viewed, the screen needs to change to the corresponding equipment screen immediately.

[0059] In this embodiment, the multi-touch interaction mechanism refers to a mechanism for adding a separate display to each display content, that is, associating each display content with a preset interactive action, in order to ensure that the corresponding display content can be called through the preset interactive action.

[0060] In this embodiment, independent visualization display configuration refers to configuring independent display for each display content, that is, displaying the content to be viewed according to the user's interaction needs without affecting the normal display of other screens.

[0061] The working principle and beneficial effects of the above technical solution are as follows: by determining the display weights of the operating status of the obtained bulk grain equipment and the image information of the bulk grain system line and the surrounding environment, the corresponding display interface area is allocated to different display contents in the human-computer interaction interface according to the display weights, and the corresponding element name is generated according to the element characteristics of each display interface area and the area is marked, so that different display interface areas are convenient for displaying corresponding contents. Secondly, the positional association relationship between each bulk grain equipment and the surrounding environment and the bulk grain system line is determined, and different display interface areas are associated according to the positional association relationship, so that when the drone is interactively operated, the image information of the operating status of the bulk grain equipment and the surrounding environment and the image information of the bulk grain system line are visualized at the same position and frequency, so that different dimensional information at the same position can be effectively understood and viewed through the human-computer interaction interface. Finally, a preset interactive action is added to the human-computer interaction interface on the background configuration end, so that the display content to be viewed can be retrieved and independently visualized through the preset interactive action, which improves the effect of human-computer interaction and facilitates users to quickly view the corresponding display content as needed.

[0062] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "including", "having" or any other variations thereof are intended to cover non-exclusive possessing, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.

[0063] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. The multi-sensor AI early warning system applied to the bulk grain system line is characterized by: include: Data collection unit, to obtain historical and real-time operation data of bulk grain equipment; A centralized processing unit pre-processes the acquired historical operation data and real-time operation data and extracts characteristic information from the historical operation data; The model building unit builds and trains a neural network model based on feature information, and adjusts the parameters of the neural network model to make the neural network model close to the actual operating state of the bulk grain equipment; Intelligent analysis unit, which uses neural network model to predict historical operation data and judge whether bulk grain equipment is operating normally; And compare the judgment results with the actual results to verify whether the neural network model is accurate; The model deployment unit deploys the verified neural network model to the actual bulk grain production system to predict the real-time operating status of the bulk grain equipment, including the first real-time operating status and the second real-time operating status; the environmental inspection unit uses drone equipment to obtain image information of the bulk grain system line and the surrounding environment; Human-computer interaction interface, visually displaying the operating status of bulk grain equipment and image information of bulk grain system lines and surrounding environment; The display configuration process of the operating status of the bulk grain equipment and the image information of the bulk grain system line and the surrounding environment includes: based on the multi-touch interaction mechanism, independent visual display configuration is performed for the operating status of the bulk grain equipment, the image information of the surrounding environment and the image information of the bulk grain system line in the background configuration section.

2. The multi-sensor AI early warning system for bulk grain system line according to claim 1 is characterized by: The centralized processing unit comprises: Data cleaning module, which removes missing values, duplicate values ​​and outliers from the operating data, removes noise and unnecessary redundant information from the operating data, and converts the format of the operating data; The feature extraction module analyzes the vibration spectrum, particle speed and size, particle density and flow rate, and temperature distribution of the bulk grain equipment to extract the characteristic information of the bulk grain equipment's operating status; The data storage module classifies and organizes the received operation data by category, and stores the organized operation data by time series and category to form a database.

3. The multi-sensor AI early warning system for bulk grain system line according to claim 1 is characterized by: The model building unit comprises: The sample division module divides the historical operation data and the extracted feature information into training sets and test sets; The label matching module collects the historical operating status of bulk grain equipment in the same period as the historical operating data; sets labels for each type of historical operating status, and then matches the labels with each type of historical operating status and historical operating data; The model building module takes the training set as the input set, builds and trains the neural network model based on the input set, and establishes the feature layer and learning process of the neural network model.

4. The multi-sensor AI early warning system for bulk grain system line according to claim 1 is characterized by: The intelligent analysis unit comprises: The model verification module inputs the test set into the trained neural network model for prediction and outputs the estimated state value of the bulk grain equipment; and compares the estimated state value with the actual result to verify whether the prediction ability of the neural network model is accurate; The result generation module determines whether the bulk grain equipment is in a normal working state and whether there is an abnormal situation based on the estimated state value of the bulk grain equipment, and generates corresponding prediction results.

5. The multi-sensor AI early warning system for bulk grain system line according to claim 4 is characterized by: The intelligent analysis unit further includes: The model optimization module regularly uses real-time operation data to update and iterate the neural network model to optimize the parameters and performance of the neural network model.

6. The multi-sensor AI early warning system for bulk grain system line according to claim 1 is characterized by: The model deployment unit includes: The model deployment module exports the verified neural network model into an executable format, and deploys the neural network model to the cloud platform loaded with the human-computer interaction interface according to the requirements of the neural network model and system characteristics; The timing prediction module predicts the operating status of bulk grain equipment regularly according to the feedback frequency of real-time operating data; The early warning prompt module sends a warning prompt to the human-computer interaction interface in time when the neural network model predicts that the bulk grain equipment and the drone detects abnormal conditions in the surrounding environment, reminding the management personnel to check and repair.

7. The multi-sensor AI early warning system for bulk grain system line according to claim 6 is characterized in that: The model deployment unit also includes: The model operation module performs real-time analysis based on the neural network model to determine the first real-time operation status of the bulk grain equipment; The monitoring module deploys the monitoring mechanism and calculates the operation status of the bulk grain equipment in real time according to the monitoring mechanism to obtain the second real-time operation status; Wherein, obtaining the second real-time operating status includes: The real-time measurement values ​​of each sensor in each sensor type are collected, and the comprehensive measurement values ​​of each type of bulk grain equipment are calculated based on the real-time measurement values ​​of each sensor.

8. The multi-sensor AI early warning system for bulk grain system line according to claim 7 is characterized in that: The composite measurement is calculated as follows: ； in, Indicates Comprehensive measurement values ​​of bulk grain equipment of each sensor under different sensor types; Indicates the number of sensors; Indicates the total number of sensors; Indicates Sensor Type The initial weights corresponding to the sensors; Indicates Sensor Type Dynamic weight adjustment factor corresponding to each sensor; Indicates Sensor Type Real-time measurement values ​​of sensors; An ordinal value indicating the sensor type; Based on the comprehensive measurement values ​​of the bulk grain equipment, the risk assessment value of the bulk grain equipment is calculated.

9. The multi-sensor AI early warning system for bulk grain system line according to claim 8 is characterized in that: The risk assessment value is calculated as follows: ； in, Indicates the risk assessment value of bulk grain equipment; Indicates the total number of sensor types; Indicates taking the maximum value; Indicates Safety measurement thresholds corresponding to the sensor types; Indicates The risk weights corresponding to the sensor types; Determine the second real-time operating status based on the risk assessment value of the bulk grain equipment. hour, , it means that the current bulk grain equipment is within the safe range; when , it means that the current bulk grain equipment is in the abnormal range; The report generating module is used to generate an evaluation report based on the first real-time operating status and the second real-time operating status, and transmit the evaluation report to the user terminal.

10. The multi-sensor AI early warning system for bulk grain system line according to claim 1 is characterized in that: Human-computer interaction interface, including: A parameter acquisition module, which acquires the operating status of the bulk grain equipment and the image information of the bulk grain system line and the surrounding environment, sets the operating status of the bulk grain equipment and the image information of the bulk grain system line and the surrounding environment as visual display elements, and determines the display weight of the visual display element based on the visual display requirements; A display configuration module extracts element features of the visual display elements, and allocates a display interface area for each visual display element in the human-computer interaction interface based on the element features and the display weight of the visual display elements. At the same time, an element name is generated for each display interface area based on the element features, and the display interface area is marked based on the element name. Determine the positional association relationship between each bulk grain equipment and the surrounding environment and the bulk grain system line, and add visual association paths to each display interface area in the human-computer interaction interface based on the positional association relationship; Based on the visual association path, the image information of the operating status of the bulk grain equipment and the surrounding environment and the image information of the bulk grain system line are visualized at the same location and frequency; The human-computer interaction configuration module adds preset interactive actions to the human-computer interaction interface at the background configuration end, and determines the response state of the visual display screen under each preset interactive action; Based on the response status of the visualization display screen under each preset interactive action, a multi-touch interaction mechanism is added to the visualization display results of the same frequency at the same location, and based on the multi-touch interaction mechanism, independent visualization display configuration is performed in the background configuration section for the operating status of the bulk grain equipment, the image information of the surrounding environment, and the image information of the bulk grain system line; Based on the independent visualization display configuration, the operating status of the bulk grain equipment and the image information of the bulk grain system line and the surrounding environment are visualized.

Images