Material monitoring method and device in assembly task execution process, equipment and medium

Abstract

The invention discloses a material monitoring method and device in an assembly task execution process, equipment and a medium. The method comprises the following steps: pre-constructing a material database matched with an aircraft assembly task; in the execution process of the assembly task, data of at least one pre-configured data source is collected in real time, and material management information in the material database is updated in real time; monitoring and displaying data updated in real time in the material database under the whole assembly process through a human-computer interaction interface, and giving an alarm when a preset alarm rule is met; calculating a material demand plan of each material in real time through a preset calculation rule; and a user is prompted when a preset threshold condition is met. According to different station requirements of aircraft assembly, corresponding material rules are selected to form the material database, and the assembly process and the state parameter information and alarm information of corresponding equipment are displayed, so that automation of aircraft assembly material management is realized, the quick response capability to assembly problems is enhanced, and the assembly efficiency and the assembly quality are improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of low-code development design, and particularly relates to a material monitoring method, device, equipment and medium in an assembly task execution process. BACKGROUND

[0002] With the promotion of intelligent manufacturing and digital transformation, the aircraft assembly industry gradually adopts a material management system to realize real-time monitoring and intelligent management of materials through real-time data acquisition and analysis.

[0003] In the prior art, the aircraft assembly material management system has high professional requirements, is prone to errors and low in efficiency, and the system functions often do not meet the actual needs, thereby increasing the time cost and labor cost. In addition, front-line operators are prone to operational errors due to high professional requirements, which increases the risk of system failure, thereby reducing assembly efficiency and assembly quality. SUMMARY

[0004] The present application provides a material monitoring method, device, equipment and medium in an assembly task execution process to solve the problems of high time cost, high labor cost, low assembly efficiency and poor assembly quality in the execution of an aircraft assembly task.

[0005] According to an aspect of an embodiment of the present application, a material monitoring method in an assembly task execution process is provided, which is executed by a material monitoring system developed in a low-code development platform. The method comprises:

[0006] A material database matched with the aircraft assembly task is pre-constructed, wherein the material database contains basic material information and material management information, the basic material information contains description information and inventory quantity of different materials, and the material management information contains usage and parameter change information of the materials in the assembly process;

[0007] In the execution process of the aircraft assembly task, data of at least one pre-configured data source is collected in real time, and the material management information in the material database is updated in real time according to the collection result;

[0008] The real-time updated data in the material database in the entire assembly process is monitored and displayed through a human-computer interaction interface, and an alarm is given when the real-time updated data meets a preset alarm rule;

[0009] MRP indicators of each material are calculated in real time through a preset calculation rule; and a user is prompted when the MRP indicators meet a preset threshold condition.

[0010] According to another aspect of an embodiment of the present application, a material monitoring device in an assembly task execution process is also provided, comprising:

[0011] The material database construction module is configured to construct a material database matched with the aircraft assembly task in advance.

[0012] The material management information updating module is configured to collect data of at least one pre-configured data source in real time during execution of the aircraft assembly task, and update material management information in the material database in real time according to the collection result.

[0013] The data monitoring and display module is configured to monitor and display the data updated in real time in the material database in the entire assembly process through a human-computer interaction interface, and alarm when the data updated in real time meets a preset alarm rule.

[0014] The MRP index calculation module is configured to calculate MRP indexes of each material in real time through a preset calculation rule, and prompt a user when the MRP indexes meet a preset threshold condition.

[0015] According to another aspect of the embodiments of the present application, an electronic device is also provided, which comprises:

[0016] at least one processor; and

[0017] a memory connected to the at least one processor in communication;

[0018] wherein the memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor to enable the at least one processor to execute the material monitoring method in the assembly task execution process according to any one of the embodiments of the present application.

[0019] According to another aspect of the embodiments of the present application, a computer readable storage medium is also provided, which stores computer instructions for enabling a processor to implement the material monitoring method in the assembly task execution process according to any one of the embodiments of the present application when executed by the processor.

[0020] According to another aspect of the embodiments of the present application, a computer program product is also provided, which comprises a computer program for enabling a processor to implement the steps of the method according to any one of the embodiments of the present application when executed by the processor.

[0021] The technical scheme of the embodiment of the application comprises the following steps: constructing a material database matched with an aircraft assembly task in advance; collecting data of at least one pre-configured data source in real time during execution of the aircraft assembly task, and updating material management information in the material database in real time according to the collection result; monitoring and displaying the data updated in real time in the material database in the entire assembly process through a man-machine interactive interface, and alarming when the data updated in real time meets preset alarm rules; calculating MRP indexes of each material in real time through preset calculation rules; and prompting a user when the MRP indexes meet preset threshold conditions. The material database is constructed by selecting corresponding material rules according to different station requirements of the aircraft assembly, and the state parameter information and alarm information of the assembly process and corresponding equipment are displayed, so that the automation of aircraft assembly material management is realized, the rapid response capability to assembly problems is enhanced, and the assembly efficiency and assembly quality are improved.

[0022] It should be understood that the content described in this part is not intended to identify key or important features of the embodiments of the application, nor is it used to limit the scope of the application. Other features of the application will become apparent from the following description. BRIEF DESCRIPTION OF DRAWINGS

[0023] In order to more clearly illustrate the technical solutions in the embodiments of the application, the following will briefly introduce the drawings needed to be used in the embodiment description. Obviously, the drawings in the following description are only some embodiments of the application, and other drawings can be obtained by those skilled in the art without creative labor.

[0024] Figure 1 is a flow chart of a material monitoring method in an assembly task execution process according to an embodiment of the application;

[0025] Figure 2 is a flow chart of a material monitoring method in an assembly task execution process according to an embodiment of the application;

[0026] Figure 3 is a schematic diagram of a material management platform suitable for the embodiment of the application;

[0027] Figure 4 is a flow chart of material rule calculation and result display suitable for the embodiment of the application;

[0028] Figure 5 is a schematic diagram of MRP calculation factors suitable for the embodiment of the application;

[0029] Figure 6 is a structural schematic diagram of a material monitoring device in an assembly task execution process according to an embodiment of the application;

[0030] Figure 7 Figure 1 is a structural schematic diagram of an electronic device for implementing a material monitoring method in an assembly task execution process according to an embodiment of the present application. DETAILED DESCRIPTION

[0031] In order to make the personnel in the technical field better understand the present application, the technical solutions in the embodiments of the present application will be described clearly and completely below in combination with the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by the personnel in the field without creative labor should belong to the protection scope of the present application.

[0032] It should be noted that the terms "first", "second", and the like in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and do not have to be used to describe a specific order or sequence. It should be understood that the data used in this way can be exchanged under appropriate circumstances, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device including a series of steps or units does not have to be limited to the clearly listed steps or units, but can include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0033] Embodiment one

[0034] Figure 1 Figure 1 is a flowchart of a material monitoring method in an assembly task execution process according to an embodiment of the present application. The embodiment can be applicable to the case of material management and state parameter monitoring and early warning of the assembly process and the corresponding equipment during the execution of the aircraft assembly task. The method can be executed by a material monitoring device in the assembly task execution process. The material monitoring device in the assembly task execution process can be realized in the form of hardware and / or software, and can generally be configured in an electronic device. As shown in the figure, the method comprises the following steps. Figure 1

[0035] S110, constructing a material database matched with the aircraft assembly task in advance.

[0036] In the material database, the basic material information includes the description information and the inventory quantity of different materials, and the material management information includes the usage and parameter change information of the materials in the assembly process.

[0037] ​In the embodiment of the present application, the material database refers to a software system for managing and organizing material information, including basic material information and material management information. The basic material information is the basic information about the material, including the description information and inventory quantity of different materials. The material management information relates to the use, monitoring and control of the material in the production and supply chain, including the usage and parameter change information of the material in the assembly process. The description information of the material can include: the basic information of the material such as name, size, model and unit of measurement. The inventory quantity can include: the current inventory quantity, inventory level, item source, inventory unit, item inventory category, maximum inventory quantity, purchase quantity and safety inventory quantity. The usage and parameter change information of the material in the assembly process refers to the actual usage and parameter change of the material in the material assembly process, which can specifically include: the theoretical usage and actual usage of the material, and the loss quantity, in-use quantity and unfinished usage quantity that may occur in the production process.

[0038] Among them, the current inventory refers to the actual available quantity of the material in the warehouse at the current time point. It includes the material that has been received but has not been arranged into the production plan or assembly plan, and the material that is being stored in the warehouse. The purchase quantity refers to the quantity of material ordered each time, that is, the quantity of material entering the inventory. The safety inventory quantity refers to the additional inventory quantity that needs to be maintained at least to cope with demand fluctuations or supply interruptions. The loss quantity refers to the loss quantity of the material due to various reasons (such as damage, expiration or operation error, etc.) in the receiving, storage, handling, assembly or use of the material. The in-use quantity refers to the quantity of material that has not yet completed to become the final product in the production process. The unfinished usage quantity refers to the quantity of material that has been planned for production but has not yet been actually used.

[0039] S120, in the execution process of the aircraft assembly task, the data of the at least one pre-configured data source is collected in real time, and the material management information in the material database is updated in real time according to the collection result.

[0040] Specifically, the monitoring requirements involved in the aircraft assembly task are analyzed in advance, the parameter information that needs to be collected is determined, and the material database matched with the assembly task is constructed. In the aircraft assembly task, the equipment data information from one or more pre-configured data sources is collected in real time, for example, the force sensor configured on the assembly equipment or assembly production line is used to measure the force applied in the assembly process, the numerical control positioner is used to accurately position the aircraft parts, and the part position and bearing force are recorded. The material management information in the material database is updated in real time, the usage and parameter change information of the material in the assembly process is updated in real time, and the recording and display of the assembly process are realized.

[0041] S130, monitoring and displaying the real-time updated data in the material database of the entire assembly process through the human-computer interaction interface, and alarming when the real-time updated data meets the preset alarm rule.

[0042] Specifically, the usage and parameter change information in the assembly process is recorded in the material database, and real-time display and monitoring is performed through the human-computer interaction interface, such as a control panel or a touch screen display, and an alarm is triggered when the real-time updated data meets the preset alarm rule, for example, when the applied force exceeds the preset maximum or minimum value, an alarm should be triggered, that is, if the force detected by the force sensor exceeds the set threshold, it indicates that there is a problem of over-tightening or insufficient tightening in the assembly process; when the deviation of the component position recorded by the numerical control positioner from the expected position exceeds the preset threshold, it indicates that the components are not correctly aligned or there is a deviation in the assembly process, which should also trigger an alarm, and after triggering the alarm, the abnormal information triggering the alarm can be stored in the description information of the corresponding material to track the historical use and performance of the material, and provide data support for quality control and improvement. By displaying the state parameter information of the assembly process and the corresponding equipment and the alarm information, the production transparency is improved, the monitoring of the assembly process is enhanced, the assembly problems are responded in time, and the assembly efficiency and assembly quality are improved.

[0043] S140, calculating the MRP index of each material in real time through a preset calculation rule; and prompting the user when the MRP index meets the preset threshold condition.

[0044] In the embodiment of the application, the MRP (Material Requirements Planning) index is a calculation index for planning and controlling the required raw materials and parts in the production process, which ensures sufficient material supply in the production process while avoiding excessive inventory.

[0045] Specifically, the MRP indicators of each material are calculated in real time through a preset calculation rule, for example, the MRP indicator of each material is calculated through the formula MRP indicator = current inventory - planned usage - safety stock, and a user is prompted when the MRP indicator meets a preset threshold condition. The current inventory and the planned usage can be obtained by manual statistical methods, the safety stock is a pre-set parameter, and the preset threshold condition can be that when the calculation result of the MRP indicator of the target material is greater than 0, that is, MRP indicator = current inventory - planned usage - safety stock > 0, it indicates that the existing inventory still has a surplus even after subtracting the planned usage and the safety stock, and the current inventory level is sufficient to cover the future planned usage demand, so that the construction of the production plan for the target material is suggested in the human-computer interaction interface, thereby improving the production efficiency and reducing the risk of inventory storage loss. When the calculation result of the MRP indicator of the target material is less than or equal to 0, it means that the inventory level is insufficient to meet the future demand after subtracting the planned usage and the safety stock from the current inventory, so the user can be prompted to arrange a procurement plan to supplement the inventory, thereby avoiding the occurrence of assembly interruption or material shortage, improving the efficiency of inventory management, reducing inventory backlog and shortage risk, enhancing the accuracy of assembly plan, avoiding assembly interruption, and improving the response speed of the supply chain. In addition, through real-time monitoring and prompting functions, the timeliness of problem handling is improved, and potential assembly risks are avoided.

[0046] The technical scheme of the embodiment of the present application pre-constructs a material database matched with an aircraft assembly task, collects data of at least one pre-configured data source in real time during the execution of the aircraft assembly task, and updates the material management information in the material database in real time according to the collection result. The real-time updated data in the material database in the entire assembly process is monitored and displayed through a human-computer interaction interface, and an alarm is given when the real-time updated data meets a preset alarm rule. The MRP indicators of each material are calculated in real time through a preset calculation rule, and a user is prompted when the MRP indicators meet a preset threshold condition. By selecting corresponding material rules to constitute the material database according to the different station requirements of the aircraft assembly, and displaying the state parameter information and alarm information of the assembly process and the corresponding equipment, the automation of aircraft assembly material management is realized, the rapid response capability to assembly problems is enhanced, and the assembly efficiency and assembly quality are improved.

[0047] Optionally, in the embodiment of the present application, the material database matched with the aircraft assembly task is pre-constructed, which comprises:

[0048] At least one basic material used in the aircraft assembly task is defined according to the task requirements of the aircraft assembly task.

[0049] The material rules matched with the material relationships are determined in response to the at least one material relationship selected by the user.

[0050] The material relationship includes at least one of a dependency relationship, a substitution relationship, and a batch relationship.

[0051] At least one associated material matching the base material is generated according to the material rule;

[0052] The base material information matching the base material and the associated material is constructed, and the description information of the material includes a material name of the material, a use position of the material, and an assembly link at which the material is used.

[0053] In the embodiment of the present application, the material rule defines the standards and specifications of various connections and interaction relationships between materials, ensuring clear identification, correct classification, and effective collaboration of materials in the entire supply chain and production process.

[0054] The material relationship includes at least one of a dependency relationship, a substitution relationship, and a batch relationship. The dependency relationship means that the demand or existence of one material depends on another material, for example, the assembly of a wing of an airplane depends on the supply of screws and rivets of a specific type, and there is a dependency relationship between the screws and the rivets. The substitution relationship means that one material can be used instead of another material, for example, if a certain type of alloy material is short, another alloy with similar performance may be selected as a substitute to ensure that production will not be interrupted, and the two alloy materials belong to a substitution relationship. The batch relationship means that the management and tracking of materials are based on batches, and the use of each batch of materials needs to be tracked to ensure the traceability of the quality of airplane parts, for example, a motor has multiple batches, and an airplane assembly may require different batches of products, and the combination relationship between different batches of products constitutes a batch relationship. Batch management helps to track the source and history of each material to ensure the safety and reliability of the airplane. In addition, custom relationships can also be included, which means that in addition to standard relationships, additional relationships between materials are defined according to business needs. For example, certain materials can only be used under certain conditions, such as a specific paint used in extreme weather conditions. This relationship needs to be custom set to ensure that the material production plan can be correctly constructed and the assembly process can be monitored and warned under certain conditions.

[0055] Specifically, according to the task requirements of the aircraft assembly task, at least one basic material (basic material, component or product) required in the aircraft assembly task is determined, and the material relationship such as dependency relationship, substitution relationship, batch relationship or self-defined relationship involved in the basic material is determined according to the task requirements, the material rule matched with the material relationship is determined, at least one associated material matched with the basic material is generated according to the material rule, and the basic material information matched with the basic material and the associated material is constructed, wherein the description information of the material includes: material name of the material, use position of the material and assembly link where the material is used. By clearly defining the material requirements and relationships, waiting and delays in assembly are reduced, and timely supply of required materials is ensured. At the same time, the material rule is formulated to enhance the assembly quality control, reduce the assembly product defect rate, improve the reliability of the final product, improve the flexibility of the production plan, and improve the assembly efficiency.

[0056] Optionally, in the embodiment of the present application, the data of at least one data source pre-configured is collected in real time, including:

[0057] The data of at least one data source is collected in real time through the data transmission interface configured on the assembly equipment and / or at least one sensor deployed in the assembly environment; or

[0058] The display image on at least one instrument in the assembly environment is collected by using an image collection device as the data of at least one data source collected.

[0059] Specifically, the pre-configured data source can be specifically divided into: new equipment with data docking function and old equipment without data docking function. For the new equipment to be monitored, such as numerical control equipment, which is equipped with a data transmission interface and / or at least one sensor, and supports standard industrial communication protocols, the data can be collected directly from the source without format conversion, such as the temperature or pressure of the assembly environment. For the old equipment to be monitored, such as instruments, which is not equipped with a data transmission interface and is not deployed with a sensor, the display image on at least one instrument in the assembly environment can be collected by using an image collection device as the data of at least one data source collected. The image collection device is a device that converts the actual scene into digital images or videos through optical or electronic technology, such as a camera. It can capture static images and convert them into digital signals that can be processed by a computer. For example, the dial of a temperature instrument or a pressure instrument in the assembly environment is photographed by a camera to obtain temperature or pressure information of the assembly environment.

[0060] Embodiment two

[0061] Figure 2A flowchart of a material monitoring method in an assembly task execution process provided for the second embodiment of the present application, which is a refinement of the above-mentioned "real-time updating of material management information in the material database according to the collection results", specifically includes: acquiring a current display image collected on the target instrument, and using a preset image optimization algorithm to perform image optimization on the current display image to obtain an optimized image; performing text recognition in the optimized image through a preset optical character recognition technology; if the target data is successfully recognized, converting the target data into matching usage or parameter change information, and then using the conversion result information to perform real-time updating of the material management information in the material database; if the target data is not successfully recognized, re-acquiring a new current display image on the target instrument, and returning to perform the operation of using the preset image optimization algorithm to perform image optimization on the current display image until the text recognition is successful or the re-acquisition times exceed the preset threshold limit; when the re-acquisition times exceed the preset threshold limit, prompting the user of the collection exception, and then performing camera inspection on the target image acquisition device matched with the target instrument, and automatically adjusting the positioning distance and focal length of the target image acquisition device.

[0062] Correspondingly, as shown in Figure 2 , the method comprises:

[0063] S210, a material database matched with an aircraft assembly task is constructed in advance.

[0064] S220, during the execution of the aircraft assembly task, data of at least one pre-configured data source is collected in real time.

[0065] S230, a current display image collected on the target instrument is acquired, and a preset image optimization algorithm is used to perform image optimization on the current display image to obtain an optimized image.

[0066] In the embodiment of the present application, the image optimization algorithm is a series of calculation steps and mathematical formulas for realizing image optimization. Image optimization refers to the process of using image optimization algorithms to improve the visual effect of images or extract useful information from images, which can include enhancing the features of images, reducing image noise or distortion.

[0067] Specifically, after the instrument image is collected, image optimization based on the Gaussian normal distribution image optimization algorithm is performed on the image to obtain an optimized image. The image optimization algorithm is as follows:

[0068] In the formula, (x, y) is the coordinate of a point in the image, sigma is a standard deviation, which controls the width of the distribution, x and y are both coordinate values with the center point of the kernel as the coordinate origin, and u and v are displacements in the x direction and u direction relative to the center point of the kernel. When sigma is small, the Gaussian distribution is relatively concentrated, the coefficient of the center of the Gaussian mask is relatively large, and the coefficients around the center are relatively small. Such a mask has a less obvious smoothing effect when smoothing the image, and is suitable for scenarios that require to retain image details. When sigma is large, the Gaussian distribution is relatively flat, and the coefficients of the mask are not much different. The weights of the center pixel and the surrounding pixels are more balanced. Such a mask has a more obvious smoothing effect when smoothing the image, and is suitable for scenarios that require strong smoothing effect, but will blur the edges and details of the image. The specific parameter setting is determined according to whether more image details need to be retained or a stronger smoothing effect is needed.

[0069] S240, text recognition is performed in the optimized image by a preset optical character recognition technology.

[0070] In the embodiment of the application, optical character recognition (OCR) is a process of converting text in an image into machine-encoded text. LSTM (Long Short-Term Memory) is a special recurrent neural network, which can process the sequence of characters in the image and identify the text information in the image in OCR.

[0071] S250, it is judged whether the target data is successfully recognized. If the target data is successfully recognized, S260 is executed, and if the target data is not successfully recognized, S290 is executed.

[0072] Specifically, after the collected instrument image is optimized by the normal distribution-based image optimization algorithm, the target data (i.e. text information such as temperature or air pressure measured by the instrument) in the image is recognized by the preset LSTM neural network to determine whether the target data is successfully recognized.

[0073] S260, after the target data is converted into matching usage or parameter change information, the converted result information is used to update the material management information in the material database in real time, and S270 is executed.

[0074] Specifically, if the target data is successfully recognized, the format of the target data is converted into a format matching the usage or parameter change information in the material database, and the material management information in the material database is updated in real time. By updating the usage and parameter change information of the material in the assembly process in real time, the assembly process is recorded and displayed.

[0075] S270, monitoring and displaying the real-time updated data in the material database of the entire assembly process through the human-computer interaction interface, and alarming when the real-time updated data meets the preset alarm rule, and performing S280.

[0076] S280, calculating the MRP index of each material in real time through the preset calculation rule; and prompting the user when the MRP index meets the preset threshold condition.

[0077] Specifically, the usage and parameter change information in the assembly process is recorded in the material database, and is displayed and monitored in real time through the human-computer interaction interface, and an alarm is given when the real-time updated data meets the preset alarm rule, and after the alarm is triggered, the abnormal information triggering the alarm can be stored in the description information of the corresponding material to track the historical use and performance of the material, and provide data support for future quality control and improvement. By displaying the state parameter information of the assembly process and the corresponding equipment and the alarm information, the production transparency is improved, the monitoring of the assembly process is enhanced, and the rapid response capability to assembly problems is enhanced, thereby improving the assembly efficiency and assembly quality. The MRP index of each material is calculated in real time through the preset calculation rule, the MRP index of each material is calculated, and the user is prompted when the MRP index meets the preset threshold condition. For example, if the current inventory level is sufficient to cover the future planned use demand, the construction of the production plan for the target material is suggested in the human-computer interaction interface, thereby improving the production efficiency and reducing the risk of inventory storage loss. If the inventory level is insufficient to meet the future demand, the user can be prompted to arrange a procurement plan to supplement the inventory to avoid assembly interruption or material shortage, which not only improves the efficiency of inventory management, reduces inventory accumulation and shortage risk, and enhances the accuracy of assembly planning, but also improves the timeliness of problem handling through real-time monitoring and prompting function, and avoids potential assembly risks.

[0078] S290, judging whether the number of reacquisition times exceeds the preset threshold limit: if yes, performing S2100; otherwise, returning to perform S230.

[0079] In the embodiment of the application, the preset threshold limit refers to the upper limit of the number of times of using the preset image optimization algorithm and OCR recognition method to successfully extract the target information in the instrument image.

[0080] Specifically, if the target data is not successfully recognized, a new current display image is reacquired on the target instrument, and a preset image optimization algorithm based on Gaussian normal distribution is used to optimize the image, and OCR recognition is performed through a preset LSTM neural network.

[0081] S2100, after the acquisition abnormality prompt is given to the user, camera inspection is performed on the target image acquisition device matched with the target instrument, and the positioning distance and focal length of the target image acquisition device are automatically adjusted.

[0082] Specifically, when the number of times of re-acquiring images exceeds the preset threshold, it indicates that an acquisition abnormality may occur, and the man-machine interaction interface can give an acquisition abnormality prompt to the user, and start the inspection process of the image acquisition device, such as the camera. The inspection content includes hardware connection, cleanliness and physical damage, etc., and the distance and focal length between the camera and the target object are automatically adjusted and optimized to ensure that the image is clear and within the field of view. In addition, after the man-machine interaction interface gives the acquisition abnormality prompt to the user, the abnormal information can also be stored in the corresponding material description information position of the material database, which is convenient for subsequent analysis and manual maintenance. This automatic monitoring and maintenance process helps to reduce production delay and improve the reliability and efficiency of assembly.

[0083] The technical scheme of the embodiment of the application, by pre-constructing a material database matched with an aircraft assembly task; in the execution process of the aircraft assembly task, real-time acquisition of data of at least one pre-configured data source; obtaining a current display image acquired on a target instrument, and using a preset image optimization algorithm to optimize the current display image, and using a preset optical character recognition technology to recognize text; determining whether the target data is successfully recognized; if the target data is successfully recognized, converting the target data into matched usage or parameter change information, and real-time updating the material management information in the material database; monitoring and displaying the real-time updated data in the material database in the entire assembly process through a man-machine interaction interface, and alarming when the real-time updated data meets a preset alarm rule; real-time calculating the MRP index of each material through a preset calculation rule; and prompting the user when the MRP index meets a preset threshold condition; if the target data is not successfully recognized, re-acquiring a new current display image on the target instrument, and returning to perform the operation of optimizing the current display image using the preset image optimization algorithm until the text recognition is successful or the number of re-acquisitions exceeds a preset threshold; when the number of re-acquisitions exceeds the preset threshold, giving an acquisition abnormality prompt to the user, performing camera inspection on the target image acquisition device matched with the target instrument, and automatically adjusting the positioning distance and focal length of the target image acquisition device, realizing the acquisition of data of old-fashioned devices such as instruments, reducing production delay, and improving the reliability and efficiency of assembly through the automatic monitoring and maintenance process.

[0084] Further, in the embodiment of the application, when the real-time updated data meets the preset alarm rule, the alarm can also include:

[0085] If it is determined that the real-time updated data is complex data, the performance of the model under different threshold settings is evaluated by a confusion matrix, a KS value, an F1 score, a precision-recall curve, and a cross-entropy loss function.

[0086] The alarm threshold is optimized using historical data and data generated by real-time monitoring, and the alarm system is back-tested to check whether the threshold setting can effectively identify historical abnormal events.

[0087] In the embodiments of the present application, the target data can be divided into simple data and complex data. Simple data refers to indicators that can be displayed intuitively and quantified easily, such as air pressure and temperature, which can be displayed intuitively on the display interface. For these simple numerical values, a specific threshold range is set, and when the measured value falls within this pre-set range, the display state on the interface will be "normal". Once the value exceeds this range, the system will change the display state to "abnormal" and notify the user through an alarm mechanism so that timely measures can be taken. Complex data can be understood as data that involves deeper analysis and processing, such as material property measurement data, including hardness, strength, and density. These data are usually obtained through a series of calculations, analyses, or conversions. In the aircraft assembly task application scenario involved in the embodiments of the present application, these complex data are obtained by taking pictures of instrument-type devices and performing image processing analysis.

[0088] Specifically, when the real-time updated data meets the pre-set alarm rule, an alarm is given, and if the real-time updated data is complex data, the corresponding verification data of the complex data and the collected complex data are calculated. To optimize the alarm threshold, the normal range of the data is first determined, and then a preliminary alarm threshold is set based on this range. The confusion matrix is used to distinguish between real abnormalities and false positives, and the KS value (Kolmogorov-Smirnov statistic, which measures the ability of the model to distinguish between positive and negative samples), the F1 value (F1 Score, which is used to balance the accuracy and completeness of the model), and the precision-recall curve (which shows the performance changes of the model under different thresholds) are used to evaluate the effect of different thresholds. In addition, the cross-entropy loss function is used to quantify the error classification cost under different threshold settings. By real-time monitoring of the updated data, historical data, and abnormal data triggering user feedback, the alarm system is back-tested, and the threshold is continuously adjusted and optimized. The threshold with higher KS value and F1 value and lower error classification cost is selected as the alarm threshold to ensure that the alarm system is both sensitive and accurate, effectively balancing false positives and false negatives, and responding to real abnormal situations in a timely manner.

[0089] Further, in the embodiments of the present application, while the real-time updated data in the material database of the entire assembly process is monitored and displayed through the human-computer interaction interface, it also includes:

[0090] In response to the user inputted manual control instruction, a first operation device matching the manual control instruction is identified in the assembly environment, and the manual control instruction is issued to the first operation device;

[0091] When it is determined that the real-time updated data satisfies an automatic control condition for a second operation device in the assembly environment, an automatic control instruction is generated and issued to the second operation device.

[0092] In the embodiment of the application, the first operation device can be specifically understood as: needing manual intervention to send a control instruction. When the actual environment changes or specific operation is needed, the operator must issue a control instruction to adjust the behavior of the device. For example, when a non-standard part or an abnormal situation appears on the production line (such as temperature or air pressure exceeding the preset threshold), the operator needs to manually issue a control instruction to adjust the device parameters or perform emergency shutdown, and the damaged parts or non-compliant parts are removed and placed in a special damaged part container for subsequent recycling or disposal, and the non-compliant parts are replaced with compliant parts to ensure the continuity of the production line and the consistency of the product.

[0093] The second operation device can be specifically understood as: being able to automatically generate and execute a control instruction according to the actual environment without human intervention. When the device satisfies the automatic control condition, it can automatically identify and respond to the environmental changes to generate a corresponding automatic control instruction. For example, an automated assembly line is equipped with a temperature sensor to detect the temperature of the assembly environment. When the sensor detects that the temperature exceeds the preset threshold, the second operation device will automatically shut down the device and end the assembly process without human intervention, and automatically remove the damaged parts or non-compliant parts and place them in a special damaged part container for subsequent recycling or disposal, and automatically replace the non-compliant parts with compliant parts to ensure the continuity of the production line and the consistency of the product.

[0094] Specifically, after receiving the user inputted manual control instruction, the man-machine interaction interface identifies a first operation device matching the manual control instruction in the assembly environment, and issues the manual control instruction to the first operation device. When it is determined that the real-time updated data satisfies an automatic control condition for a second operation device in the assembly environment, the man-machine interaction interface generates an automatic control instruction and issues the automatic control instruction to the second operation device, realizing the automation of aircraft assembly material management and improving the assembly efficiency and quality.

[0095] Optionally, in the embodiment of the application, the MRP indicators of each material are calculated in real time through a preset calculation rule; and when the MRP indicators satisfy a preset threshold condition, a user is prompted, including:

[0096] The MRP index of each material is calculated by the formula MRP index = CN + PO + PQ - SO - SS - LF.

[0097] CN is the current inventory, PO is the purchase in quantity, PQ is the in-use quantity, SO is the unfinished use quantity, SS is the safety stock, and LF is the loss quantity.

[0098] When the calculation result of the MRP index of the target material is greater than 0, the construction suggestion of the production plan of the target material is made in the man-machine interactive interface.

[0099] Specifically, the MRP index of each material is calculated in real time by the formula MRP index = CN + PO + PQ - SO - SS - LF. CN, PQ, SO, and LF can be measured manually or automatically updated to the database by configuring a laser detector at the target position to collect the corresponding quantity changes. SS is a preset fixed parameter, and PO is a parameter manually updated to the database according to the actual purchase plan. CN + PO + PQ represents the inventory quantity of the material, including the current inventory quantity, the material quantity of the purchase order that has been placed but not received (the quantity about to enter the inventory), and the in-use quantity (the material quantity that has been allocated to the production order and is about to be removed from the inventory but is still in the inventory). SO + SS + LF represents the inventory-removed material quantity, including the unfinished use quantity (the material quantity that has been put into the assembly production task but not yet used, which is no longer in the warehouse but has not been updated in the database due to not being used), the safety stock, and the loss quantity.

[0100] The preset threshold condition can be that when the calculation result of the MRP index of the target material is greater than 0, i.e., MRP index = CN + PO + PQ - SO - SS - LF > 0, it indicates that the inventory quantity of the material is sufficient to cover the future planned use demand even after subtracting the inventory-removed material quantity. The construction suggestion of the production plan of the target material is made in the man-machine interactive interface, thereby improving the production efficiency and reducing the risk of inventory storage loss. When the calculation result of the MRP index of the target material is less than or equal to 0, it means that the inventory quantity of the material is insufficient after subtracting the inventory-removed material quantity. The user can be prompted to arrange a purchase plan to supplement the inventory to avoid assembly interruption or material shortage. This not only improves the efficiency of inventory management, reduces inventory accumulation and shortage risk, enhances the accuracy of assembly planning, avoids assembly interruption, and improves the response speed of the supply chain, but also improves the timeliness of problem handling through real-time monitoring and prompting functions, avoiding potential assembly risks.

[0101] Specific application scenarios

[0102] To solve the problems of low efficiency and high error risk of manual operation, incomplete material management system, lack of key information management and quality control, such as material loss tracking, material adaptability and failure to adopt new products in the market in time, an embodiment of the present application proposes a technical solution of material monitoring executed by a material monitoring system based on a low-code development platform, which can:

[0103] 1. Establish a functional design module

[0104] Define the material information and material relationship used in the aircraft assembly scene through the man-machine interaction interface, and select the corresponding material rules to constitute the material database according to the different station requirements of the aircraft assembly. Among them, the aircraft assembly scene includes part positioning and alignment, automatic assembly and quality control scenes.

[0105] The functional design module interacts with the interface, defines the material information and material relationship used in the aircraft assembly scene, and performs material management tracking. Figure 3 is a schematic diagram of a material management platform suitable for an embodiment of the present application, as shown in Figure 3 The material management platform includes a functional design module, a data source configuration module, a deployment display module and an MRP calculation module. The functional design module records the material information in the assembly scene, sets the material management method and configures the material relationship rules.

[0106] The material information unit and the material management unit together constitute the material database. The material information unit defines the material name, description (including the assembly link of the material, the variable information involved in the MRP calculation and the abnormal information), specification and quantity information that need to be used in the scene based on the requirements of the aircraft assembly scene. The material management unit records the quantity and parameter changes of the material in the use process, and can realize the material tracking of the assembly process by real-time acquisition of updated quantity and parameter changes. By setting the alarm rules and setting the corresponding sensor to collect the alarm related indicators, the function of early warning is realized.

[0107] In one specific example, after the sensor is assembled in normal temperature and pressure environment, the next step is to test it in simulated high temperature and pressure environment. If the sensor passes the test in these extreme environments, it can be confirmed that it can withstand the conditions of subsequent processes, thereby excluding the impact of high temperature and high pressure environment on sensor assembly. At this time, the parameters recorded in the test will be updated to the description part of the corresponding material information unit in the material database, providing a reference for subsequent production. If the sensor fails to pass the test, a more in-depth manual analysis is needed to determine whether it is a material problem or an assembly operation problem by comprehensively considering factors such as material characteristics, environmental conditions and operation techniques during assembly. The analysis results are updated to the description part of the corresponding material information unit in the material database to provide data support for quality traceability and improvement of assembly process.

[0108] Material rules are formed based on material relationships, which include: the production and use of some materials depend on the supply of other materials to form a dependency relationship (such as screws and matching rivets); some materials are replaced by other materials based on price and supply fluctuations to form a substitution relationship (such as one alloy and another alloy with similar performance); some specific materials need to be tracked and managed to form a batch relationship (one motor has multiple batches, and one aircraft may need different batches of products, and the combination relationship between different product batches); and user-defined material relationships (such as paint used under certain conditions). Figure 4 is a flowchart of a material rule calculation and result display suitable for embodiments of the present application. The material relationship part is configured for materials that have been defined, and if there is a matching relationship between them, such as a 1:1 relationship between the screws and nuts needed during the bolt tightening process, the relationship is configured in the material relationship part, which is the material rule.

[0109] The function design module in the material management platform can be used to perform the material monitoring method in the assembly task execution process proposed by the embodiments of the present application, which includes:

[0110] (1) Pre-construct a material database matched with the aircraft assembly task, and construct material relationship rules

[0111] (2) During the execution of the aircraft assembly task, data configuration is performed with the data source configuration module to directly or indirectly collect data in real time, and the material management information in the material database is updated in real time

[0112] The quantity and parameter changes can be collected by direct data collection or indirect data collection. Direct data refers to data that can be collected without data conversion. Direct data can generally be collected directly from new equipment such as numerical control equipment provided with an interface or equipped with a sensor. Indirect data refers to target data that needs to be converted before being collected. Generally, old equipment such as instruments and meters without an interface or sensor needs to be collected by indirect data collection.

[0113] The process of indirect data collection is as follows: the image of the instrument picture is collected by the vision system, the image is optimized by the image optimization algorithm based on the Gaussian normal distribution, the neural network based on the LSTM structure is used for OCR recognition, if the recognition is successful, the recognized target data is updated to the database, if the recognition fails, the photo grabbing task is reinitiated, the picture is collected again, and the optimization and recognition steps are repeated, after the same number of recognitions exceeds the threshold, it is determined that the recognition fails, an alarm is processed, information is sent to inform the user, the camera is checked, the distance and focal length are repositioned, and the data stored in the database is processed.

[0114] (3) Cooperate with the deployment display module to monitor and display the real-time updated data in the material database of the entire assembly process through the human-computer interaction interface, and alarm when the real-time updated data meets the preset alarm rule

[0115] The data stored in the database can be divided into simple data and complex data. Simple data (such as air temperature and air pressure) is displayed on the display interface. When the simple value is within the set threshold range, it is displayed normally, and when it is outside the set threshold range, it is displayed abnormally and an alarm is given.

[0116] Complex data includes material property measurement data, including hardness, strength, and density, etc. The verification data and collected data are calculated, the confusion matrix is used to distinguish true anomalies and false positives, and the KS value, F1 value, and precision-recall curve are used to evaluate the effect of different thresholds. In addition, the cross-entropy loss function is used to quantify the error classification cost under different threshold settings. Through real-time monitoring of updated data, historical data, and abnormal data triggering user feedback, the alarm system is backtracked and tested, the threshold is continuously adjusted and optimized, and the threshold with high KS value and F1 value and low error classification cost is selected as the alarm threshold. The analysis and processing results of the collected complex data are displayed on the display interface, and when the complex data is outside the set threshold range, an alarm is given.

[0117] (4) Cooperate with the MRP calculation and formulation module to calculate the MRP index of each material in real time through the preset calculation rule, and prompt the user when the MRP index meets the preset threshold condition

[0118] 2. Establish a data source configuration module and configure the corresponding management interface

[0119] The data source configuration module configures the data source address, obtains device status, device parameters and material parameters (such as temperature, air pressure, material hardness and density, etc.), instantiates basic variables, array variables and structure variables, initializes the attributes in each variable, including variable name, variable type, connected database, parameter warning threshold, state control and description attributes, after instantiation, the components are bound in the canvas design, and the corresponding management interface is configured.

[0120] The data source configuration module covers drive configuration, supports three communication protocols (transmission layer communication protocol TCP based on byte stream, serial communication protocol MODBUS for industrial automation field, and communication protocol OPCUA for industrial automation and Internet of Things) and interaction with programmable logic controller PLC (such as PLC product of S7 series of Siemens), and also includes database configuration (such as relational database management system ORACLE and relational database management system MYSQL), which ensures that the data acquisition system can flexibly communicate with various devices and databases, realizes data monitoring and management.

[0121] 3. Establish a deployment display module

[0122] The deployment display module supports different environment deployment such as windows, linux and app, shows the whole process of aircraft assembly, builds deployment application, forms the display interface of the state parameter information of the assembly process and the corresponding equipment, generates report through collecting sensor and equipment data, and shows the production state and trend in a period of time. The operator can view these reports through the user interface, and issue manual instructions according to the actual situation, such as shutting down the equipment, manually replacing parts or removing the damaged products. At the same time, the system can also automatically execute the operation of shutting down the equipment, replacing the non-compliant parts and the like according to the preset automatic control logic in the case of temperature exceeding the standard, so as to ensure the continuity of the production process and the product quality. In addition, the system can also automatically manage the damaged objects, classify and process the damaged products.

[0123] 4. Establish an MRP calculation and formulation module to update the material database in real time

[0124] Figure 5 is a schematic diagram of an MRP calculation factor suitable for the embodiment of the present application, such as Figure 5As shown, MRP index = CN + PO + PQ - SO - SS - LF, wherein CN is current inventory, PO is purchase on order, PQ is in use, SO is unfinished use, SS is safety stock, and LF is loss. CN, PO, and LF are updated to the database by manual measurement, and SO and PQ can be collected by a laser detector, and updated to the database. The laser detector can be integrated with other systems, such as a PLC control system, to realize automatic control and data collection of the assembly line. When MRP is less than or equal to 0, no production plan needs to be arranged; when MRP is greater than 0, a suggestion to build a production plan is displayed on the display interface.

[0125] The embodiment of the present application realizes effective material management in aircraft assembly through low-code development, realizes automation of aircraft assembly material management, realizes automatic process and more efficient cooperation in the way of simplifying software development process and improving development efficiency; the function design module selects the corresponding material rule to constitute the material database according to the different station requirements of aircraft assembly, and the material rule is formed based on the material relationship, so that the selection of the material has multi-dimensionality, which is convenient for selecting the material more suitable for assembly requirements according to the actual assembly situation; the deployment display module can display the state parameter information of the assembly process and the corresponding equipment, and the material management tracking is carried out, so as to understand the effectiveness of the assembly, that is, to identify the effective use of the material in the assembly, to intuitively understand the real-time situation of the material, to avoid wasting the material, and to simplify the assembly of the material, to improve the assembly efficiency and the assembly quality.

[0126] Embodiment three

[0127] Figure 6 A structure schematic diagram of a material monitoring device in an assembly task execution process provided by the embodiment three of the present application is shown in the figure. Figure 6 As shown, the device comprises a material database construction module 610, a material management information updating module 620, a data monitoring display module 630, and an MRP index calculation module 640.

[0128] The material database construction module 610 is used to pre-construct a material database matched with the aircraft assembly task;

[0129] The material management information updating module 620 is used to collect data of at least one pre-configured data source in real time during the execution process of the aircraft assembly task, and update the material management information in the material database in real time according to the collection result;

[0130] The data monitoring display module 630 is used to monitor and display the data updated in real time in the material database under the entire assembly process through a human-computer interaction interface, and alarm when the real-time updated data meets the preset alarm rule;

[0131] The MRP index calculation module 640 is configured to calculate the MRP index of each material in real time according to a preset calculation rule, and to prompt a user when the MRP index meets a preset threshold condition.

[0132] The technical scheme of the embodiment of the application comprises the following steps: constructing a material database matched with an aircraft assembly task in advance; collecting data of at least one pre-configured data source in real time during the execution of the aircraft assembly task, and updating material management information in the material database in real time according to the collection result; monitoring and displaying the data updated in real time in the material database in the entire assembly process through a man-machine interactive interface, and alarming when the data updated in real time meets a preset alarm rule; calculating the MRP index of each material in real time according to a preset calculation rule; and prompting a user when the MRP index meets a preset threshold condition. The material database is constructed by selecting corresponding material rules according to the requirements of different stations of the aircraft assembly, and the state parameter information and alarm information of the assembly process and corresponding equipment are displayed, so that the automation of aircraft assembly material management is realized, the rapid response capability to assembly problems is enhanced, and the assembly efficiency and assembly quality are improved.

[0133] On the basis of the above-mentioned embodiments, the material database construction module 610 is specifically configured to:

[0134] defining at least one basic material used in the aircraft assembly task according to the task requirements of the aircraft assembly task;

[0135] determining a material rule matched with the material relationship in response to at least one material relationship selected by a user; and generating at least one associated material matched with the basic material according to the material rule;

[0136] constructing basic material information matched with the basic material and the associated material.

[0137] On the basis of the above-mentioned embodiments, the material management information updating module 620 is specifically configured to:

[0138] collecting data of at least one data source in real time through a data transmission interface configured on the assembly equipment and / or at least one sensor deployed in the assembly environment; or

[0139] collecting a display image on at least one instrument in the assembly environment by using an image collection device as the data of at least one data source collected.

[0140] Further, on the basis of the above-mentioned embodiments, the material management information updating module 620 can be specifically configured to:

[0141] acquiring a current display image collected on the target instrument, and performing image optimization on the current display image by using a preset image optimization algorithm to obtain an optimized image.

[0142] text recognition is performed on the optimized image through a preset optical character recognition technology;

[0143] If the target data is successfully recognized, the target data is converted into matching usage or parameter change information, and the converted result information is used to update the material management information in the material database in real time;

[0144] If the target data is not successfully recognized, a new current display image is collected on the target instrument again, and the operation of image optimization on the current display image using the preset image optimization algorithm is performed until the text recognition is successful or the number of re-collection exceeds the preset threshold limit;

[0145] When the number of re-collection exceeds the preset threshold limit, an abnormal collection prompt is given to the user, a camera inspection is performed on the target image collection device matched with the target instrument, and the positioning distance and focal length of the target image collection device are automatically adjusted.

[0146] Further, on the basis of each of the above embodiments, the material monitoring device in the assembly task execution process can further include a model performance evaluation module and a threshold setting inspection module.

[0147] The model performance evaluation module is configured to evaluate the performance of the model under different threshold settings through a confusion matrix, a KS value, an F1 score, a precision-recall curve, and a cross-entropy loss function if it is determined that the real-time updated data is complex data.

[0148] The threshold setting inspection module is configured to optimize the alarm threshold using historical data and data generated by real-time monitoring, and perform a backtracking test on the alarm system to check whether the threshold setting can effectively identify historical abnormal events.

[0149] Further, on the basis of each of the above embodiments, the material monitoring device in the assembly task execution process can further include an artificial control instruction response module and an automatic control instruction generation module.

[0150] The artificial control instruction response module is configured to identify a first operation device matched with the artificial control instruction in the assembly environment and issue the artificial control instruction to the first operation device in response to the artificial control instruction input by the user.

[0151] The automatic control instruction generation module is configured to generate an automatic control instruction and issue the automatic control instruction to a second operation device in the assembly environment when it is determined that the real-time updated data meets the automatic control condition of the second operation device.

[0152] On the basis of each of the above embodiments, the MRP index calculation module 640 is specifically configured to:

[0153] The MRP index of each material is calculated by the formula MRP index = CN+PO+PQ-SO-SS-LF.

[0154] When the calculation result of the MRP index of the target material is greater than 0, a construction suggestion of production planning of the target material is made in the man-machine interactive interface.

[0155] The material monitoring device in the assembly task execution process provided by the embodiment of the application can execute the material monitoring method in the assembly task execution process provided by any embodiment of the application, and has the corresponding function modules and beneficial effects of the execution method.

[0156] In the technical solution of the disclosure, the collection, storage, use, processing, transmission, provision and disclosure of user personal information comply with relevant laws and regulations and do not violate public order and good customs.

[0157] Example Four

[0158] Figure 7 A structural schematic diagram of an electronic device 10 that can be used to implement embodiments of the application is shown. The electronic device is intended to represent various forms of digital computers, such as laptops, desktops, tablets, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device can also represent various forms of mobile devices, such as personal digital assistants, cellular telephones, smart phones, wearable devices (e.g., headsets, glasses, watches, etc.), and other similar computing devices. The components shown here, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the applications described and / or claimed in this document.

[0159] As shown in Figure 7 The electronic device 10 includes at least one processor 11, and a memory, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., which is communicatively connected to the at least one processor 11, wherein the memory stores a computer program that can be executed by the at least one processor. The processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 into the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0160] A plurality of components in the electronic device 10 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a magnetic disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices through a computer network, such as the Internet, and / or various telecommunication networks.

[0161] The processor 11 can be various general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 performs various methods and processes described above, such as the material monitoring method in the execution process of the aircraft assembly task, that is:

[0162] A material database matching the aircraft assembly task is pre-constructed, wherein the material database contains basic material information and material management information, the basic material information contains description information and inventory quantity of different materials, and the material management information contains usage and parameter change information of the materials in the assembly process;

[0163] In the execution process of the aircraft assembly task, data of at least one pre-configured data source is collected in real time, and the material management information in the material database is updated in real time according to the collection result;

[0164] The real-time updated data in the material database under the entire assembly process is monitored and displayed through a human-computer interaction interface, and an alarm is given when the real-time updated data meets a preset alarm rule;

[0165] MRP indicators of each material are calculated in real time through a preset calculation rule; and a user is prompted when the MRP indicators meet a preset threshold condition.

[0166] In some embodiments, the material monitoring method during assembly task execution process can be implemented as a computer program tangibly embodied in a computer readable storage medium, e.g., storage unit 18. In some embodiments, parts or all of the computer program can be loaded and / or installed onto electronic device 10 via, e.g., ROM 12 and / or communication unit 19. When the computer program is loaded onto RAM 13 and executed by processor 11, one or more steps of the material monitoring method during assembly task execution process described above can be performed. Alternatively, in other embodiments, processor 11 can be configured to perform the material monitoring method during assembly task execution process by other means, e.g., with the aid of firmware.

[0167] Various implementations of the systems and techniques described above can be realized in digital electronic circuitry, integrated circuitry, a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on a chip (SOC), a programmable logic device (PLD), a computer hardware, firmware, software, and / or combinations thereof. These various implementations can include implementation in one or more computer programs that are executable and / or interpretable on a programmable system including at least one programmable processor, which can be special or general purpose, coupled to receive data and instructions from, and to transmit data and instructions to, a storage system, at least one input device, and at least one output device.

[0168] Computer programs used to implement the processes of the application can be written in any combination of one or more programming languages. These computer programs can be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the computer program, when executed by the processor, implements the functions / acts specified in the flowcharts and / or block diagrams. The computer program can be executed entirely on a machine, partially on a machine, partially on a machine as part of a standalone software package, partially on a machine and partially on a remote machine or entirely on a remote machine or server.

[0169] In the context of the present invention, computer-readable storage media can be tangible media that can contain or store a computer program for use with an instruction execution system, device or equipment or used in combination with an instruction execution system, device or equipment. Computer-readable storage media can include but are not limited to electronic, magnetic, optical, electromagnetic, infrared or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, computer-readable storage media can be machine-readable signal media. More specific examples of machine-readable storage media can include electrical connections based on one or more lines, portable computer disks, hard disks, random access memories (RAM), read-only memories (ROM), erasable programmable read-only memories (EPROM or flash memory), optical fibers, portable compact disk read-only memories (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0170] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0171] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0172] The computing system can include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system, to solve the defects of large management difficulty and weak business scalability in traditional physical host and VPS service.

[0173] It should be understood that the various forms of flow shown above can be used to reorder, add or delete steps. For example, each step described in the present application can be executed in parallel, sequentially or in a different order, as long as the desired results of the technical solutions of the present application can be achieved, which is not limited herein.

[0174] The above detailed description does not constitute a limitation on the scope of protection of the present application. Those skilled in the art should understand that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modifications, equivalent replacements and improvements made within the spirit and principles of the present application shall be included in the scope of protection of the present application.

Claims

1. A material monitoring method during the execution of an assembly task, characterized in that: Executed by a material monitoring system developed in a low-code development platform, the method includes: A material database matching the aircraft assembly task is pre-built. The material database contains basic material information and material management information. Basic material information includes descriptions and inventory quantities of different materials, while material management information includes information on material usage and parameter changes during the assembly process. During the execution of the aircraft assembly task, data from at least one pre-configured data source is collected in real time, and the material management information in the material database is updated in real time based on the collected data; The real-time updated data in the material database of the entire assembly process is monitored and displayed through the human-computer interaction interface, and an alarm is issued when the real-time updated data meets the preset alarm rules; The material requirement planning (MRP) indicators of each material are calculated in real time using preset calculation rules, and the user is prompted when the MRP indicators meet the preset threshold conditions.

2. The method according to claim 1, characterized in that Pre-built material database matching aircraft assembly tasks, including: According to the task requirements of the aircraft assembly task, define at least one basic material required for the aircraft assembly task; In response to at least one material relationship selected by a user, determining a material rule that matches the material relationship; wherein the material relationship includes at least one of a dependency relationship, a substitution relationship, and a batch relationship; Generate at least one associated material that matches the basic material according to the material rules; Build basic material information that matches the basic material and associated materials. The material description information includes: the material name, the material usage location, and the assembly link where the material is used.

3. The method according to claim 1, characterized in that Collect data from at least one pre-configured data source in real time, including: Collect data from at least one data source in real time through a data transmission interface configured on the assembly equipment and / or at least one sensor deployed in the assembly environment; or An image acquisition device is used to acquire a display image on at least one instrument in an assembly environment as data of at least one data source acquired.

4. The method according to claim 3, characterized in that Based on the collection results, the material management information in the material database is updated in real time, including: Acquire the current display image collected on the target instrument, and use a preset image optimization algorithm to optimize the current display image to obtain an optimized image; Recognize text in optimized images using preset optical character recognition technology; If the target data is successfully identified, the target data is converted into matching usage or parameter change information, and the material management information in the material database is updated in real time using the conversion result information; If the target data is not successfully recognized, a new current display image is collected on the target instrument, and the process returns to the default image optimization algorithm to optimize the current display image until the text recognition is successful or the number of re-collections exceeds the default threshold. When the number of re-collection times exceeds the preset threshold, the user is prompted with a collection abnormality prompt, a camera check is performed on the target image collection device that matches the target instrument, and the positioning distance and focal length of the target image collection device are automatically adjusted.

5. The method according to any one of claims 1 to 4, characterized in that When the real-time updated data meets the preset alarm rules, the alarm is triggered, and the following functions are also included: If the real-time updated data is determined to be complex data, the performance of the model under different threshold settings is evaluated through the confusion matrix, KS value, F1 score, precision-recall curve and cross entropy loss function; Use historical data and data generated by real-time monitoring to optimize alarm thresholds, and backtest the alarm system to check whether the threshold settings can effectively identify historical abnormal events.

6. The method according to any one of claims 1 to 5, characterized in that While monitoring and displaying the real-time updated data in the material database throughout the entire assembly process through the human-computer interaction interface, it also includes: In response to a manual control instruction input by a user, identifying a first operating device matching the manual control instruction in the assembly environment, and issuing the manual control instruction to the first operating device; When it is determined that the real-time updated data meets the automatic control condition for the second operating device in the assembly environment, an automatic control instruction is generated and sent to the second operating device.

7. The method according to claim 5, characterized in that Calculate the MRP indicators of each material in real time through preset calculation rules; When the MRP indicator meets the preset threshold conditions, the user will be prompted, including: The MRP index of each material is calculated using the formula MRP index = CN + PO + PQ - SO - SS - LF; Among them, CN is the current inventory, PO is the purchase quantity, PQ is the quantity in use, SO is the unfinished quantity, SS is the safety stock, and LF is the loss quantity; When it is determined that the calculation result of the MRP index of the target material is greater than 0, a production plan construction suggestion for the target material is made in the human-computer interaction interface.

8. A material monitoring device during the execution of an assembly task, characterized in that: include: A material database construction module is used to pre-build a material database that matches the aircraft assembly task; A material management information update module is used to collect data from at least one pre-configured data source in real time during the execution of the aircraft assembly task, and to update the material management information in the material database in real time based on the collected data; The data monitoring and display module is used to monitor and display the real-time updated data in the material database during the entire assembly process through a human-computer interaction interface, and to generate an alarm when the real-time updated data meets the preset alarm rules; The MRP indicator calculation module is used to calculate the material requirement plan MRP indicator of each material in real time according to the preset calculation rules; and to prompt the user when the MRP indicator meets the preset threshold conditions.

9. An electronic device, characterized in that: The electronic device comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the material monitoring method during the assembly task execution process according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the material monitoring method during the execution of an assembly task according to any one of claims 1 to 7 when executed.

Images