Method, system and edge server for determining production progress and order inventory

Abstract

A method, system and edge server for determining production progress and order inventory, wherein the method for determining production progress includes: collecting video frames of the operation area of ​​the production link in the production line; performing image recognition on the collected video frames to determine the brightness of the operation area in the video frames; when the brightness of the operation area in the video frames is less than a preset brightness threshold, determining that the operation of the production link is completed, and obtaining the time when the operation of the production link is completed. The above scheme can realize non-intrusive, automatic and accurate judgment of production progress.

Description

Technical Field

[0001] Embodiments of the present invention relate to the field of Internet of Things technology, and in particular to a method, system and edge server for determining production progress and order inventory. Background Art

[0002] During the order production process, the factory needs to promptly provide feedback on the production progress to customers. To this end, the factory needs to conduct an order inventory after the operation is completed every day. In some industries, such as the clothing manufacturing industry, there is a strong distinction between off-season and peak season, and the production progress fluctuates greatly, and may even be different every day. In order to promptly and accurately feedback the production progress to customers, it is necessary to conduct an inventory of the order production progress every day.

[0003] In order to accurately conduct production inventory, it is necessary to determine the end time of factory operations. The traditional solution is usually to manually set the end time of factory operations and upload it when the factory operations stop.

[0004] However, the method of manually setting the end time of factory operations to determine the production progress is not only inaccurate, but also requires a certain amount of labor costs to maintain, which in turn will lead to problems such as untimely or inaccurate order inventory. Summary of the invention

[0005] In view of this, one aspect of the embodiments of this specification provides a method, system and edge server for determining production progress, so as to achieve non-intrusive, automatic and accurate judgment of production progress.

[0006] Another aspect of the embodiments of this specification provides a method, system and edge server for order inventory counting to achieve timely and accurate order inventory counting.

[0007] An embodiment of the present specification provides a method for determining production progress, including: collecting video frames of an operating area of ​​a production link in a production line; performing image recognition on the collected video frames to determine the brightness of the operating area in the video frames; when the brightness of the operating area in the video frames is less than a preset brightness threshold, determining that the production link operation is completed, and obtaining the time when the production link operation is completed.

[0008] Optionally, the brightness threshold is set based on at least one of the following factors:

[0009] The time period in which the video frame is captured;

[0010] The geographical location of the production line;

[0011] The weather in the geographical location of the production line.

[0012] Optionally, when the brightness of the working area in the video frame is less than a preset brightness threshold, it is determined that the production link operation is completed, and the acquisition time of the video frame is used as the time when the production link operation is completed, including: when the brightness of the working area in the video frame acquired at a preset frequency and for a preset number of consecutive times is less than the brightness threshold, it is determined that the production link operation is completed, and the time when the production link operation is completed is obtained.

[0013] Optionally, when the brightness of the working area in the video frames collected according to a preset frequency and for a preset number of consecutive times is less than the brightness threshold, the production link operation is determined to be completed, and the time when the production link operation is completed is obtained, including: selecting the collection time of the video frame in which the brightness of the working area is less than the brightness threshold for the first, last or middle time among the preset number of consecutive times according to the pre-configuration as the time when the production link operation is completed.

[0014] Optionally, performing image recognition on the captured video frames to determine the brightness of the working area in the video frames includes: extracting key frames based on the state of the target object in the working area in the captured video frames, and determining the brightness of the target object area in the key frames.

[0015] Optionally, when the brightness of the working area in the video frame is less than a preset brightness threshold, it is determined that the production link operation is completed, and the time when the production link operation is completed is obtained, including: when the brightness of the target object area in a preset number of consecutive key frames is less than a preset brightness threshold, it is determined that the production link operation is completed, and the time when the production link operation is completed is obtained.

[0016] Optionally, when the brightness of the target object area in a consecutive preset number of key frames is less than a preset brightness threshold, the production link operation is determined to be completed, and the time when the production link operation is completed is obtained, including: selecting the acquisition time of the first, last or middle key frame in the consecutive preset number of key frames in which the brightness of the target object area is less than the preset brightness threshold according to the pre-configuration, as the time when the production link operation is completed.

[0017] Optionally, the target object is a worker or a part of a worker's body; and the method of extracting a key frame based on the state of the target object in the working area in the collected video frame includes: based on the movements of the worker or a part of the worker's body in the working area in the collected video frame, capturing a video frame at the moment when a preset movement is completed, and extracting it as the key frame.

[0018] Optionally, the target object is a moving part of a production equipment; and the method of extracting a key frame based on the state of the target object in the working area in the collected video frame includes: based on the motion state of the moving parts of the production equipment in the working area in the collected video frame, capturing a video frame at the moment of stopping operation, and extracting it as the key frame.

[0019] Optionally, before determining the brightness of the target object area in the key frame, it also includes: obtaining the acquisition time of the key frame, the geographical location of the production line and weather information; determining the sunlight intensity of the current environment of the production line based on the acquired acquisition time of the key frame, the geographical location of the production line and weather information; when the sunlight intensity of the current environment of the production line is greater than a preset light intensity threshold, determining to re-acquire the key frame, wherein the brightness value corresponding to the light intensity threshold is greater than the preset brightness threshold; adjusting the acquisition angle to re-acquire the key frame of the production link operation area in the production line.

[0020] Optionally, the method further includes: taking the latest completion time of all production links in the production line as the completion time of the production line operation.

[0021] The embodiments of the present specification provide an order inventory method, including: collecting video frames of the operation areas of each production link in the production line; performing image recognition on the collected video frames to determine the brightness of the operation areas in the video frames of the operation areas of each production link; when the brightness of the operation areas in the video frames of the operation areas of a certain production link is less than a preset brightness threshold, determining that the operation of the production link is completed, and obtaining the time when the operation of the production link is completed; when it is determined that the operation of each production link is completed, obtaining the order production information of the day for each production link, generating order inventory information and transmitting it to the target terminal.

[0022] Optionally, the brightness threshold is set based on at least one of the following factors:

[0023] The time period in which the video frame is captured;

[0024] The geographical location of the production line;

[0025] The weather in the geographical location of the production line.

[0026] Optionally, performing image recognition on the collected video frames to determine the brightness of the working area in the video frames of the working area of ​​each production link includes: intercepting the key frames of the working area of ​​each production link based on the state of the target object in the working area in the collected video frames of the working area of ​​each production link, and determining the brightness of the target object area in the key frames.

[0027] The embodiment of this specification also provides an edge server, including:

[0028] A first video acquisition unit, adapted to acquire video frames of an operation area of ​​a production link of a production line;

[0029] a first brightness determination unit, adapted to perform image recognition on the video frame acquired by the first video acquisition unit, and determine the brightness of the operation area in the video frame;

[0030] The first production progress determination unit is adapted to determine that the operation of the production link is completed when the brightness of the operation area in the video frame is less than a preset brightness threshold, and obtain the time when the operation of the production link is completed.

[0031] Optionally, the edge server further includes: a first brightness threshold setting unit, adapted to set the brightness threshold based on at least one of the following factors:

[0032] The time period in which the video frame is captured;

[0033] The geographical location of the production line;

[0034] The weather in the geographical location of the production line.

[0035] Optionally, the first production progress determination unit is suitable for determining that the operation of the production link is completed and obtaining the time when the operation of the production link is completed when the brightness of the operation area in the video frames collected at a preset frequency and for a preset number of consecutive times is less than the brightness threshold.

[0036] Optionally, the first brightness determination unit is adapted to extract a key frame based on a state of a target object in the working area in the acquired video frame, and determine the brightness of the target object area in the key frame.

[0037] Optionally, the first production progress determination unit is suitable for determining that the production link operation is completed when the brightness of the target object area in a preset number of consecutive key frames is less than a preset brightness threshold, and obtaining the time when the production link operation is completed.

[0038] Optionally, the edge server also includes: a reference information acquisition unit, adapted to acquire the acquisition time of the key frame, the geographical location of the production line and weather information before the first brightness determination unit determines the brightness of the target object area in the key frame; a deviation detection unit, adapted to determine the sunlight intensity of the current environment of the production line based on the acquisition time of the key frame, the geographical location of the production line and weather information acquired by the reference information acquisition unit, and determine that a judgment deviation exists when the sunlight intensity of the current environment of the production line is greater than a preset light intensity threshold; a correction control unit, adapted to output a control signal to adjust the acquisition angle to re-acquire the key frames of the production link operation area in the production line when the deviation detection unit determines that a judgment deviation exists.

[0039] Optionally, the edge server further comprises: a production line end time determination unit adapted to use the latest production link operation end time among all production links determined by the production progress determination unit as the production line operation end time.

[0040] The embodiment of this specification also provides another edge server, including:

[0041] A second video acquisition unit, adapted to acquire video frames of operation areas of each production link in the production line;

[0042] A second brightness determination unit, adapted to perform image recognition on the video frames acquired by the second video acquisition unit, and determine the brightness of the operation area in the video frames of the operation area of ​​each production link;

[0043] The second production progress determination unit is adapted to determine the end of the operation of a certain production link when the brightness of the operation area in the video frame of the operation area of ​​the production link is less than a preset brightness threshold, and obtain the end time of the operation of the production link;

[0044] The inventory information generating unit is adapted to obtain the order production information of each production link on the day and generate order inventory information when the second production schedule determining unit determines that each production link has completed operations.

[0045] Optionally, the edge server further includes: a second brightness threshold setting unit, adapted to set the brightness threshold based on at least one of the following factors:

[0046] The time period in which the video frame is captured;

[0047] The geographical location of the production line;

[0048] The weather in the geographical location of the production line.

[0049] Optionally, the second brightness determination unit is suitable for extracting key frames of the operation areas of each production link based on the state of the target object in the operation area in the collected video frames of the operation areas of each production link, and determining the brightness of the target object area in the key frames.

[0050] The embodiment of this specification also provides a production progress determination system, including: a video acquisition device and an edge server, wherein:

[0051] The video acquisition device is suitable for acquiring video frames of the operation area of ​​the production link in the production line and uploading them to the edge server;

[0052] The edge server is suitable for performing image recognition on the acquired video frames, determining the brightness of the working area in the video frames, and when the brightness of the working area in the video frames is less than a preset brightness threshold, determining that the production link operation is completed, and obtaining the time when the production link operation is completed.

[0053] The embodiment of this specification also provides an order inventory system, including: an edge server and multiple video acquisition devices, wherein:

[0054] The multiple video acquisition devices are respectively arranged at preset positions of each production link in the production line, and are suitable for acquiring video frames of the operation area of ​​the corresponding production link and uploading them to the edge server;

[0055] The edge server is suitable for performing image recognition on the acquired video frames to determine the brightness of the operating area in the video frames of the operating area of ​​each production link; when the brightness of the operating area in the video frames of the operating area of ​​a certain production link is less than a preset brightness threshold, it is determined that the operation of the production link is completed and the time when the operation of the production link is completed is obtained; when it is determined that the operation of each production link is completed, the order production information of the day of each production link is obtained, and the order inventory information is generated and transmitted to the target terminal.

[0056] The embodiments of the present specification also provide a computer-readable storage medium on which computer instructions are stored. When the computer instructions are executed, they are suitable for executing the steps of any method for determining a production schedule described in the aforementioned embodiments.

[0057] The embodiments of the present specification also provide a computer-readable storage medium on which computer instructions are stored. When the computer instructions are executed, they are suitable for executing the steps of any order inventory counting method described in the aforementioned embodiments.

[0058] The scheme for determining the production progress according to the embodiment of this specification is to perform image recognition on the video frames of the operation area of ​​the production link in the collected production line, determine the brightness of the operation area in the video frame, and when the brightness of the operation area in the video frame is less than the preset brightness threshold, it can be determined that the operation of the production link is finished, and the time when the operation of the production link is finished can be obtained. The above scheme does not require the information transformation or replacement of the production equipment in the production line, and does not rely on manual operation, so it can avoid the problem of easy forgetfulness or lag in manual operation, so it can realize non-intrusive, automatic and accurate judgment of production progress, which is particularly suitable for factories with flexible end time of production line production operations.

[0059] Furthermore, by setting the brightness threshold based on at least one of the factors such as the time period in which the video frame is captured, the geographical location of the production line, and the antenna at the geographical location of the production line, it is possible to avoid misjudgment of the end time of the production link operation due to huge differences in ambient natural light at different times and spaces or drastic changes in weather, and to further improve the accuracy of production progress judgment, making the determined end time of the production link operation more accurate.

[0060] Furthermore, when the brightness of the working area in the video frames collected at a preset frequency and for a preset number of consecutive times is less than the brightness threshold, the production link operation is determined to be completed, thereby avoiding misjudgment due to temporary power outages or operator errors, and further improving the accuracy of production progress judgment.

[0061] Furthermore, the acquisition time of the video frame in which the brightness of the operation area is less than the brightness threshold for the first time in the consecutive preset times is selected according to the pre-configuration as the end time of the production link operation, which can make the determined end time of the production link operation more accurate, timely and reliable.

[0062] Furthermore, based on the state of the target object in the working area in the collected video frame, a key frame is captured, and the brightness of the target object area in the key frame is determined, so that there is no need to make a judgment on each video frame, thereby reducing the amount of data processing. In addition, based on the state of the target object in the working area in the video frame, a key frame is captured, and the end time of the production link operation is determined by the brightness of the target object area in the key frame, which can further improve the accuracy of production progress judgment.

[0063] Furthermore, when the brightness of the target area in a preset number of key frames is less than a preset brightness threshold, the production link operation is determined to be completed, which can avoid misjudgment due to temporary power outages and other reasons, and can further improve the accuracy of production progress judgment.

[0064] Furthermore, the acquisition time of the video frame in which the brightness of the first target object area in the preset number of consecutive key frames is less than the brightness threshold is selected according to the pre-configuration as the end time of the production link operation, which can make the determined end time of the generation link operation more accurate, timely and reliable.

[0065] Furthermore, before determining the brightness of the target object area in the key frame, the sunlight intensity of the current environment of the production line is determined based on the acquisition time of the key frame, the geographical location of the production line and weather information, and when the sunlight intensity of the current environment of the production line is greater than a preset light intensity threshold, it is determined to re-acquire the key frame, wherein the brightness value corresponding to the light intensity threshold is greater than the preset brightness threshold, thereby avoiding misjudgment due to the video acquisition angle and further improving the accuracy of production progress judgment.

[0066] Furthermore, by using the latest completion time of all production links in the production line as the completion time of the production line operation, it is possible to achieve non-intrusive, automatic, accurate and timely judgment of the completion time of the production line operation.

[0067] The order inventory solution of the embodiment of this specification is adopted to determine the end time of each production link based on the brightness of the operation area in the video of the operation area of ​​each production link, and when each production link is completed, the order production information of the day of each production link can be obtained, and the order inventory information is generated and transmitted to the target terminal, so that the order inventory can be completed. This order inventory solution does not invade the production equipment of the production line, and the production equipment in the production line is transformed or replaced by information technology, and does not rely on manual operation. It is automatically completed after the operation of each production link on the day is completed, so that the problem of easy forgetting or delay in manual operation can be avoided. Therefore, the order inventory can be executed non-invasively, automatically and accurately, which is particularly suitable for factories with flexible end time of production line production operations. BRIEF DESCRIPTION OF THE DRAWINGS

[0068] In order to more clearly illustrate the technical solutions of the embodiments of this specification, the drawings required for use in the embodiments of this specification or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this specification. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0069] Figure 1 A flowchart of a method for determining production progress provided in an embodiment of this specification;

[0070] Figure 2 A flowchart of a method for determining production progress provided in another embodiment of this specification;

[0071] Figure 3 A flowchart of a method for determining production progress provided in another embodiment of this specification;

[0072] Figure 4 A flowchart of an order inventory method provided in an embodiment of this specification;

[0073] Figure 5 A schematic diagram of an order inventory scenario provided in an embodiment of this specification;

[0074] Figure 6 A schematic diagram of the structure of an edge server provided in an embodiment of this specification;

[0075] Figure 7 A schematic diagram of the structure of an edge server provided in another embodiment of this specification;

[0076] Figure 8 A schematic diagram of the structure of a production schedule determination system provided in an embodiment of this specification;

[0077] Fig. 9 A schematic diagram of the structure of an order inventory system provided in another embodiment of this specification. DETAILED DESCRIPTION

[0078] As mentioned above, for factories with floating factory operation hours, the factory operation end time is usually set manually, and after receiving the information about the end of the factory operation time, the order progress of each production link of the production line is manually counted, and then feedback is given to the customer. On the one hand, this solution requires manual maintenance, and on the other hand, due to manual settings, there may be problems of advance, delay or forgetfulness, which makes it impossible to accurately and timely judge the production progress, and then the order inventory cannot be carried out in a timely and accurate manner, and the production inventory may even be delayed until the next day, making it difficult to accurately and timely feedback the production progress to the customer.

[0079] In response to the above problems, the embodiments of the present specification perform image recognition on the collected video frames of the working area of ​​the production link in the production line to determine the brightness of the working area in the video frames. When the brightness of the working area in the video frames is less than the preset brightness threshold, it can be determined that the operation of the production link is completed, and the time when the operation of the production link is completed can be obtained.

[0080] The use of the embodiments of this specification does not require information transformation or replacement of the production equipment in the production line, and does not rely on manual operation, thus avoiding the problem of easy forgetfulness or delay in manual operation. Therefore, non-invasive, automatic and accurate judgment of production progress can be achieved, which is particularly suitable for factories with flexible end times for production line production operations.

[0081] In order to enable those skilled in the art to more clearly understand and implement the embodiments of this specification, the technical solutions in the embodiments of this specification will be clearly and completely described below in conjunction with the drawings in the embodiments of this specification. Obviously, the described embodiments are part of the embodiments of this specification, not all of the embodiments. Based on the embodiments in this specification, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of this specification.

[0082] like Figure 1 The flowchart of a method for determining production progress is shown in FIG. 1 . In an embodiment of the present invention, the production progress can be determined by the following steps:

[0083] S110, collecting video frames of the production operation area in the production line.

[0084] In a specific implementation, one or more video acquisition devices may be installed around the operation area of ​​each production link of the production line, for example, above the operation area of ​​the production link, to capture video frames toward the operation area of ​​the production link. In order to improve the clarity of the captured video frames, a high-definition camera may be used for video frame capture.

[0085] S120, performing image recognition on the collected video frames to determine the brightness of the working area in the video frames.

[0086] S130, when the brightness of the operation area in the video frame is less than a preset brightness threshold, it is determined that the operation of the production link is completed, and the time when the operation of the production link is completed is obtained.

[0087] During the specific research process, the inventors discovered that the key feature of the end of the production link of the production line is that the operator will turn off the lighting equipment in the production link working area at the end of the work. This action will cause a sudden change in the brightness of the production link working area. Therefore, by comparing the brightness of the working area in the collected video frame with the preset brightness threshold, it is possible to determine whether the work is completed.

[0088] Furthermore, by adopting the above-mentioned embodiment, the brightness of the working area in the video frame of the collected production line production environment working area is determined through image recognition, and when the brightness of the working area in the video frame is less than a preset brightness threshold, it can be determined that the production link operation is completed. This process is automatically executed without the need for manual maintenance or information-based transformation or replacement of existing production equipment, thereby achieving non-invasive, automatic and accurate judgment of production progress.

[0089] In a specific implementation, in order to improve the accuracy of production progress judgment and make the determined time of the end of the production link operation more accurate, the preset brightness threshold can be obtained based on multiple factors and through experiments, or by collecting a large number of data samples for machine training. In an embodiment of the present invention, the brightness threshold can be set based on at least one of the factors such as the time period of the video frame acquisition moment, the geographical location of the production line, and the antenna at the geographical location of the production line, so as to avoid misjudgment of the time of the end of the production link operation due to the huge difference in ambient natural light at different times and spaces or the drastic changes in weather.

[0090] For example: the acquisition time of a certain video frame is: 2019-2-10-17:58:46; the geographic location information is: specific location information, such as Jianshe Road, Nancheng Street, Dongguan, Guangdong, or specific longitude and latitude information. Obviously, technical personnel in this field can obtain the sunshine intensity at the location where the video frame is collected based on the time information and geographic location information of the video frame collection.

[0091] Therefore, the value of the preset brightness threshold corresponds to the time information and geographic location information of the video frame acquisition, such as: for the same geographic location, the same acquisition time in different seasons, or different acquisition times in the same season, correspond to different brightness thresholds. In other words, the value of the brightness threshold depends on the sunshine intensity at the location where the video frame is acquired based on the video frame acquisition time, geographic location, and weather. Obviously, when the sunshine intensity is high, the brightness threshold is large; when the sunshine intensity is low, the first threshold is small. Specifically, it can be set according to actual needs, and this embodiment does not impose any limitation on this.

[0092] In the specific implementation, in order to further improve the accuracy of production progress judgment, considering that temporary power outages or operator misoperation may also turn off the lighting equipment in the production link operation area of ​​the production line, resulting in a sudden change in the brightness of the production link operation area, in order to avoid the misjudgment caused by this situation, in one embodiment of the present specification, it can be avoided by making multiple judgments on the continuously collected video frames and repeatedly confirming them. Specifically, the acquisition frequency of the video frames can be set and the preset number of times can be set. When the brightness of the operation area in the video frames collected at the preset frequency and for the preset number of times is less than the brightness threshold, it is determined that the production link operation is completed. For example, it can be set to collect a video frame every 10 minutes. When the brightness of the operation area in the video frames collected three times in a row is less than the preset brightness threshold, it can be determined that the production link operation is completed.

[0093] In a specific implementation, when determining the time when the production link operation ends based on the brightness of the operation area in the video captured for multiple consecutive times, the specific time when the production link operation ends can be determined according to the pre-configuration. For example, the acquisition time of the video frame in which the brightness of the operation area is less than the brightness threshold for the first time in the consecutive preset times can be selected as the time when the production link operation ends, so that the determined time when the production link operation ends can be more accurate, timely and reliable.

[0094] In specific implementations, the above embodiments may be further expanded and optimized as needed.

[0095] Reference Figure 2 The flowchart of another method for determining the production progress in the embodiment of this specification shown is different from the previous embodiment in that this embodiment does not need to perform brightness recognition and generate progress judgment for each video frame collected in the production line production link operation area, but rather judges the production progress by the brightness of the target object area in the key frame captured based on the state of the target object in the operation area in the collected video frame. Figure 2 And explain it in detail with specific steps.

[0096] S210, collecting video frames of the production operation area in the production line.

[0097] As described in the previous embodiment, one or more video acquisition devices may be installed around the operating areas of each production link of the production line, for example, above the operating areas of the production links, to capture video frames toward the operating areas of the production links.

[0098] S220, extracting a key frame based on the state of the target object in the working area in the collected video frame, and determining the brightness of the target object area in the key frame.

[0099] In a specific implementation, the target object can be selected based on the specific characteristics of the factory production.

[0100] For example, for production lines with few or no production equipment and mainly operated manually, operators or parts of operators' limbs can be used as the target objects. For example, in the clothing cutting or sewing process of a clothing production line, the hand features of cutting operators or sewing operators can be used as target objects for identification and capture. In one embodiment of the present specification, based on the actions of operators or parts of operators' limbs in the working area in the collected video frames, the video frame at the moment when the preset action is completed is captured as the key frame.

[0101] For another example, for a production line with many production equipment or mainly production equipment, the moving parts of the production equipment can be used as the target object. For example, in the weaving link of a fabric production line, the moving parts of an automatic loom can be used as the target object for identification and capture. In one embodiment of the present specification, based on the motion state of the moving parts of the production equipment in the operating area in the collected video, the video frame at the time of stopping operation is captured and intercepted as the key frame.

[0102] In a specific implementation, preset target segmentation, target recognition, target detection and target tracking algorithms can be used to identify the state of the target object. For example, a threshold-based segmentation method, an edge-based segmentation method, a region-based segmentation method, an energy functional-based segmentation method, a wavelet-based segmentation method, and a neural network-based segmentation method can be used. For target recognition, a preset neural network model can be used after corresponding deep learning.

[0103] For image target tracking, a preset target tracking algorithm can be used to track the target object and identify the state of the target object. For example, one or more target tracking algorithms such as Kalman filter tracking algorithm, Monte Carlo filter algorithm, particle filter multi-target tracking based on probabilistic graphical model can be used, or a pre-trained machine learning model can be used to track the target object and identify the state of the target object.

[0104] S230, when the brightness of the operation area in the key frame is less than a preset brightness threshold, it is determined that the operation of the production link is completed, and the time when the operation of the production link is completed is obtained.

[0105] In a specific implementation, in order to improve the reliability of the obtained time when the production link operation is completed, it can be based on whether the brightness of a plurality of consecutive key frames detected is less than the preset brightness threshold. Specifically, when the brightness of the target object area in a preset number of consecutive key frames is less than the preset brightness threshold, it can be determined that the production link operation is completed, and the time when the production link operation is completed can be obtained.

[0106] In a specific implementation, the acquisition time of the first, last or middle key frame in which the brightness of the target object area is less than the preset brightness threshold value among the consecutive preset number of key frames can be selected according to the pre-configuration as the time when the production link operation ends. For example, among the three consecutive key frames in which the brightness of the target object area is less than the preset brightness threshold value, the acquisition time of the first key frame can be selected as the time when the production link operation ends.

[0107] It can be understood that in a specific implementation, the light intensity of the target object area corresponding to the video frame can be obtained by using the correspondence between the brightness and light intensity of the pre-obtained image, and the light intensity of the target object area corresponding to the video frame can be compared with a preset light intensity threshold to determine whether it is less than the preset light intensity threshold, thereby determining whether the production link has stopped operating. This is based on the same principle as the above embodiment.

[0108] In a specific implementation, after the completion time of each production link of the production line is determined, the latest completion time of all production links in the production line can be used as the completion time of the production line.

[0109] By adopting the above embodiment, key frames are captured based on the state of the target object in the working area in the collected video frame, and the brightness of the target object area in the key frame is determined, so that there is no need to make a judgment on each video frame, thereby reducing the amount of data processing. In addition, key frames are captured based on the state of the target object in the working area in the video frame, and the end time of the production link operation is determined by the brightness of the target object area in the key frame, which can further improve the accuracy of production progress judgment.

[0110] Reference Figure 3 A flowchart of a method for determining production progress in another embodiment of the present specification is shown, and is described in detail below through specific steps;

[0111] S310, collecting video frames of the production operation area in the production line.

[0112] S320: extract key frames based on the state of the target object in the operation area in the collected video frame.

[0113] S330, obtaining the acquisition time of the key frame, the geographical location of the production line and weather information.

[0114] S340, determining the sunlight intensity of the current environment of the production line based on the acquired acquisition time of the key frame, the geographical location of the production line and weather information.

[0115] S350, when the sunlight intensity of the current environment of the production line is greater than a preset light intensity threshold, determine to re-acquire a key frame, wherein the brightness value corresponding to the light intensity threshold is greater than the preset brightness threshold.

[0116] S360, adjusting the acquisition angle to re-acquire key frames of the operation area of ​​the production link in the production line.

[0117] S370: Determine the brightness of the target object area in the key frame.

[0118] S380, when the brightness of the operation area in the key frame is less than a preset brightness threshold, it is determined that the operation of the production link is completed, and the time when the operation of the production link is completed is obtained.

[0119] In a specific implementation, it may happen that the weather is clear and the sunlight is still very strong when getting off work during the day. If the video acquisition device is facing the sunlight or the sunlight area at this time, even if the indoor light source is turned off at this time, the brightness of the video frame captured by the video acquisition device is still much greater than the preset brightness threshold. To address this problem, the present embodiment can be used to avoid misjudgment. When it is determined that the sunlight intensity of the current environment of the production line is greater than the preset light intensity threshold, the acquisition angle is adjusted to re-capture the key frames of the production link operation area of ​​the production line, and the brightness of the re-captured key frames is compared with the preset brightness threshold to determine whether the production link operation of the production line has ended.

[0120] The following is an example of a specific application scenario.

[0121] For a certain type of clothing production line, the production links include cutting, sewing, quality inspection and packaging. Each production link corresponds to production equipment and operators that realize corresponding functions. For example, the function of the production equipment corresponding to the cutting link (such as a cutting machine) is to realize cutting. Then, in this embodiment, the video frames of the corresponding production materials passing through the production equipment can be collected by the cameras installed around the production equipment corresponding to each link. Then, the key frame images are selected from the video corresponding to each production equipment. The operation completion time of each production link is determined according to the selected key frame images, and then the operation completion time of the factory is determined based on the operation completion time of multiple links. That is, the time when the production equipment of each production link stops production can be determined according to the selected key frame images, and then the time when the production line stops working can be determined based on the time when multiple production equipment stops production.

[0122] The following takes the cutting process as an example to explain the process of selecting the key frame image in the present embodiment and the process of determining the time when the production equipment in the cutting process stops working.

[0123] The video frame captured in the cutting process at the moment when the cutting part of the cutting machine stops operating is selected as the key frame. The key frame can be analyzed and processed using the light intensity detection method to obtain the brightness of the moving part area of ​​the cutting machine in the key frame. Based on the brightness of the moving part area and the correspondence between the brightness and light intensity of the image obtained in advance, the light intensity of the current environment of the cutting part of the cutting machine can be known, that is, the light intensity of the current environment of the production equipment in the cutting process. When the brightness of the key frame is less than the preset brightness threshold, the operation end time of the production process corresponding to the key frame is determined, that is, the operation end time of the cutting process, that is, the operation of the cutting process for the day is completed, the production equipment of the cutting process stops working, and the operator has left work.

[0124] The process of determining the time of operations in other production links of the production line is similar to the above-mentioned cutting link. For the sake of brevity, it will not be repeated here.

[0125] The end time of each production link has been determined, such as: the production equipment in the cutting link stops working at 17:21, the production equipment in the sewing link stops working at 19:30, the production equipment in the quality inspection link stops working at 20:00, and the production equipment in the packaging link stops working at 21:00. The production line stops working at 21:00, that is, the factory's off-get off work time is 21:00.

[0126] It should be noted that the data here are merely examples to illustrate the technical solution of this embodiment and do not constitute any limitation to the embodiments of this specification.

[0127] For another example, the acquisition time of a key frame in the sewing operation area is: 2019-2-10-17:58:46. The geographical location information of the factory is: specific location information, such as Jianshe Road, Nancheng Street, Dongguan, Guangdong, or specific longitude and latitude information. Obviously, those skilled in the art can obtain the sunshine intensity at the location where the image is collected based on the time information, geographical location and weather information of the key frame acquisition. And when the sunshine intensity is greater than the preset light intensity threshold, it is determined to re-acquire the video frame. Specifically, the video frame can be re-acquired by sending a control instruction to the video acquisition device around the production equipment corresponding to the sewing link to control it to change the shooting angle, thereby reducing the impact of external sunlight on the brightness or ambient light intensity obtained by analyzing the key frame image.

[0128] The method for determining the production progress provided in the above embodiments of this specification can achieve non-intrusive, automatic and accurate judgment of the production progress by acquiring video frames of the production links in the production line and performing brightness recognition and comparative judgment on the selected key frame images, which is particularly suitable for the scenario of flexible off-get off work in factories.

[0129] In this embodiment, the acquisition time of the video frame and the geographical location of the factory production line are further considered to determine whether the shooting angle of the video acquisition equipment around the operation area of ​​the production link corresponding to the video frame needs to be changed, so as to reduce the impact of external daylight on the ambient light intensity obtained by image analysis of the video frame, thereby reducing the misjudgment of the end time of the operation of this link.

[0130] Obviously, if it is determined that the shooting angle of the video acquisition device around the production equipment corresponding to a certain link needs to be changed, it is necessary to select key frames from the video frames captured after adjusting the shooting angle to perform image analysis and determine the completion time of the operation of the production link based on the brightness of the working area obtained by analysis and the preset threshold.

[0131] Inventory is usually done by the corresponding person in charge, such as the factory owner or production line supervisor, after the factory operation is completed, to take inventory of the production status of each order of the day, including the production of the day and the cumulative production, and feedback to the corresponding customers so that the customers can view the production progress of the order. However, how to feedback the production progress to the customer as real-time as possible is a big challenge. This is because if the factory takes inventory before completing the operation, the production progress seen by the customer is incomplete; if the inventory is taken long after the operation is completed, such as after 12 o'clock in the evening, the corresponding person in charge is basically resting at this time, and the inventory is not taken until the next morning to feedback to the customer, which has lost real-time performance.

[0132] To this end, the embodiment of this specification provides an order inventory method, such as Figure 4 The flowchart of an order inventory method shown may include the following steps:

[0133] S410, collecting video frames of the operation areas of each production link in the production line.

[0134] S420, performing image recognition on the collected video frames to determine the brightness of the operating area in the video frames of the operating area of ​​each production link.

[0135] S430, when the brightness of the operation area in the video frame of the operation area of ​​a certain production link is less than a preset brightness threshold, it is determined that the operation of the production link is completed, and the time when the operation of the production link is completed is obtained.

[0136] In a specific implementation, huge differences in ambient natural light at different times and spaces or drastic changes in weather may lead to misjudgment of the end time of production operations. To this end, the brightness threshold can be set based on at least one of the factors such as the time period in which the video frame is captured, the geographical location of the production line, and the antenna at the geographical location of the production line, thereby improving the accuracy of production progress judgment and the accuracy and real-time nature of inventory time.

[0137] S440, when it is determined that all production links are completed, the order production information of each production link on the day is obtained, the order inventory information is generated and transmitted to the target terminal.

[0138] In a specific implementation, the generated order inventory information can be transmitted to the terminal device of the corresponding person in charge, who will check and confirm it before feeding back to the corresponding customer, or the generated order inventory information can be directly transmitted to the terminal device of the corresponding customer, so that the customer can track the order production progress in real time.

[0139] The terminal device may be a PC, a notebook or a handheld terminal such as a mobile phone, or other types of terminal devices as long as they can receive the order inventory information.

[0140] The order inventory method of the embodiment of this specification is used to determine the end time of each production link based on the brightness of the operation area in the video of the operation area of ​​each production link. When each production link is completed, the order production information of the day of each production link can be obtained, and the order inventory information is generated and transmitted to the target terminal to complete the order inventory. This order inventory solution does not invade the production equipment of the production line, and the production equipment in the production line is transformed or replaced by information technology, and does not rely on manual operation. It is automatically completed after the operation of each production link on the day is completed, thereby avoiding the problem of easy forgetting or delay in manual operation. Therefore, the order inventory can be executed non-invasively, automatically and accurately, which is particularly suitable for factories with flexible end time of production line production operations.

[0141] Reference Figure 5In the order inventory scene shown, it is assumed that a production line involves three production links, and the operation areas are operation areas 1, 2, and 3 respectively. The cameras 520, 522, and 524 can respectively capture video of the operation areas 1, 2, and 3, and the edge server 510 analyzes the brightness of the operation areas of the video frames captured by the cameras 520, 522, and 524, and can determine the brightness values ​​of the target object areas of the operation areas 1, 2, and 3 corresponding to the corresponding key frames. Then, the brightness values ​​of the target object areas of the operation areas in the determined corresponding key frames are compared with the preset brightness threshold, and the time when the operation of the operation areas of each production link ends can be determined, and then the operation end time of the entire line can be obtained. When it is determined that the entire production line stops operating, the order completion information and the corresponding completion time of each production link can be obtained, and the order inventory information can be generated. After that, the generated order inventory information can be transmitted to the target terminals 530, 532, 534, etc., some of which can be the terminal devices of the customers. In a specific implementation, the edge server 510 can communicate with the cameras 520, 522, 524 through a local area network to perform real-time transmission of video frames, and the edge server 510 can perform data communication with the target terminals 530, 532, 534, etc. through a local area network or the Internet.

[0142] As to how to determine the operation completion time of each production link, please refer to the aforementioned method embodiment for determining the production progress, which will not be repeated here for the sake of brevity.

[0143] It should be understood that in the embodiments of this specification, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this specification.

[0144] Combined with the above Figures 1 to 3 The technical solution of the method for determining the production progress provided in the embodiment of this specification is described in detail. Figure 6 A technical solution of an edge server provided in an embodiment of this specification is described in detail.

[0145] like Figure 6 The schematic diagram of the structure of an edge server shown in FIG. Figure 6 , the edge server 600 may include:

[0146] The first video acquisition unit 610 is adapted to acquire video frames of the operation area of ​​the production link of the production line;

[0147] A first brightness determination unit 620, adapted to perform image recognition on the video frame acquired by the first video acquisition unit, and determine the brightness of the operation area in the video frame;

[0148] The first production progress determination unit 630 is adapted to determine that the operation of the production link is completed when the brightness of the operation area in the video frame is less than a preset brightness threshold, and obtain the time when the operation of the production link is completed.

[0149] The edge server of the embodiment of this specification is used to perform image recognition on the video frames of the operation area of ​​the production link in the collected production line, and determine the brightness of the operation area in the video frame. When the brightness of the operation area in the video frame is less than the preset brightness threshold, it can be determined that the operation of the production link is completed, and the time when the operation of the production link is completed can be obtained. The above scheme does not require the information transformation or replacement of the production equipment in the production line, and does not rely on manual operation, so it can avoid the problem of easy forgetfulness or lag in manual operation, so it can realize non-intrusive, automatic and accurate judgment of production progress, which is particularly suitable for factories with flexible end time of production line production operations.

[0150] In a specific implementation, the edge server 600 may further include: a first brightness threshold setting unit 640, adapted to set the brightness threshold based on at least one of the following factors:

[0151] The time period in which the video frame is captured;

[0152] The geographical location of the production line;

[0153] The weather in the geographical location of the production line.

[0154] In one embodiment of the present specification, the first production progress determination unit 630 is suitable for determining the end of the operation of the production link when the brightness of the operation area in the video frames collected at a preset frequency and for a preset number of consecutive times is less than the brightness threshold, and obtaining the time when the operation of the production link is ended.

[0155] In an embodiment of the present specification, the first brightness determination unit 620 is adapted to extract key frames based on the state of the target object in the operation area in the acquired video frame, and determine the brightness of the target object area in the key frames.

[0156] In another embodiment of the present specification, the first production progress determination unit 630 is suitable for determining that the production link operation is completed when the brightness of the target object area in a preset number of consecutive key frames is less than a preset brightness threshold, and obtaining the time when the production link operation is completed.

[0157] In the specific implementation, continue to refer to Figure 6 The edge server 600 shown may also include:

[0158] A reference information acquisition unit 650, adapted to acquire the acquisition time of the key frame, the geographical location of the production line and weather information before the first brightness determination unit 620 determines the brightness of the target object area in the key frame;

[0159] The deviation detection unit 660 is adapted to determine the sunshine intensity of the current environment of the production line based on the acquisition time of the key frame acquired by the reference information acquisition unit 650, the geographical location of the production line and the weather information, and determine that there is a judgment deviation when the sunshine intensity of the current environment of the production line is greater than a preset light intensity threshold;

[0160] The deviation correction control unit 670 is adapted to output a control signal to adjust the acquisition angle and re-acquire the key frames of the operation area of ​​the production link in the production line when the deviation detection unit 650 determines that there is a judgment deviation.

[0161] In a specific implementation, the edge server 600 may further include: a production line end time determination unit 680, adapted to use the latest production link operation end time among all production links determined by the production progress determination unit as the production line operation end time.

[0162] Reference Figure 7 The schematic diagram of the structure of another edge server in the embodiment of this specification is shown in FIG. 1 , and the edge server can be used to implement order inventory, such as Figure 7 The edge server 700 shown may include:

[0163] The second video acquisition unit 710 is adapted to acquire video frames of the operation areas of each production link in the production line;

[0164] The second brightness determination unit 720 is adapted to perform image recognition on the video frames acquired by the second video acquisition unit 710 to determine the brightness of the operation area in the video frames of the operation area of ​​each production link;

[0165] The second production progress determination unit 730 is adapted to determine the end of the operation of a certain production link when the brightness of the operation area in the video frame of the operation area of ​​the production link is less than a preset brightness threshold, and obtain the end time of the operation of the production link;

[0166] The inventory information generating unit 740 is adapted to obtain the order production information of each production link on the day and generate order inventory information when the second production schedule determining unit 730 determines that each production link has completed operations.

[0167] The edge server of the above-mentioned embodiment is used to perform order inventory, and the end time of each production link is determined based on the brightness of the operation area in the video of the operation area of ​​each production link. When the operation of each production link is completed, the order production information of each production link on the day can be obtained, and the order inventory information is generated and transmitted to the target terminal to complete the order inventory. This order inventory solution does not invade the production equipment of the production line in any way, and the production equipment in the production line is information-transformed or replaced. It does not rely on manual operation, and is automatically completed after the operation of each production link on the day is completed. Therefore, the problem of easy forgetfulness or delay in manual operation can be avoided. Therefore, the order inventory can be executed non-invasively, automatically and accurately, and is particularly suitable for factories with flexible end times for production line production operations.

[0168] Continue to refer to Figure 7 In a specific implementation, the edge server 700 may further include: a second brightness threshold setting unit 750, adapted to set the brightness threshold based on at least one of the following factors:

[0169] The time period in which the video frame is captured;

[0170] The geographical location of the production line;

[0171] The weather in the geographical location of the production line.

[0172] In one embodiment of the present specification, the second brightness determination unit 720 is suitable for extracting the key frame of the operation area of ​​each production link based on the state of the target object in the operation area in the collected video frame of the operation area of ​​each production link, and determining the brightness of the target object area in the key frame.

[0173] The embodiments of this specification also provide an embodiment of a production schedule determination system corresponding to the aforementioned method embodiment for determining production schedule, which is described in detail below with reference to the accompanying drawings and through specific embodiments.

[0174] Reference Figure 8 The structural diagram of the production progress determination system shown in FIG. Figure 8 As shown, the production schedule determination system 800 may include a video acquisition device 810 and an edge server 820, wherein:

[0175] The video acquisition device 810 is suitable for acquiring video frames of the production process operation area in the production line and uploading them to the edge server;

[0176] The edge server 820 is suitable for performing image recognition on the acquired video frames to determine the brightness of the working area in the video frames. When the brightness of the working area in the video frames is less than a preset brightness threshold, it is determined that the production link operation is completed and the time when the production link operation is completed is obtained.

[0177] The specific video acquisition method of the video acquisition device 810 and the specific data processing method of the edge server 820 can be found in the introduction of the aforementioned production schedule determination method embodiment, and for the sake of brevity, they will not be described in detail here.

[0178] The production progress determination system of the embodiment of this specification is adopted, and the brightness of the operation area in the video frame is determined by performing image recognition on the collected video frames of the operation area of ​​the production link in the production line. When the brightness of the operation area in the video frame is less than the preset brightness threshold, it can be determined that the operation of the production link is completed, and the time when the operation of the production link is completed can be obtained. The above scheme does not require the information transformation or replacement of the production equipment in the production line, and does not rely on manual operation, so it can avoid the problem of easy forgetfulness or lag in manual operation, so it can realize non-intrusive, automatic and accurate judgment of production progress, which is particularly suitable for factories with flexible end time of production line production operations.

[0179] Reference Fig. 9 The structural diagram of the order inventory system shown in FIG. 1 is a schematic diagram of the structure of the order inventory system shown in FIG. 1 . In another embodiment of the present specification, as shown in FIG. 1 , Fig. 9 The order inventory system 900 shown may include: an edge server 910 and a plurality of video acquisition devices 920, wherein:

[0180] The multiple video acquisition devices 920 are respectively arranged at preset positions of each production link in the production line, and are suitable for acquiring video frames of the operation area of ​​the corresponding production link and uploading them to the edge server;

[0181] The edge server 910 is suitable for performing image recognition on the acquired video frames to determine the brightness of the operating area in the video frames of the operating area of ​​each production link; when the brightness of the operating area in the video frames of the operating area of ​​a certain production link is less than a preset brightness threshold, it is determined that the operation of the production link is completed and the time when the operation of the production link is completed is obtained; when it is determined that the operation of each production link is completed, the order production information of the day of each production link is obtained, and the order inventory information is generated and transmitted to the target terminal.

[0182] The specific inventory counting method of the order inventory counting system in the embodiments of this specification can be found in the introduction of the aforementioned order inventory counting method embodiment, which will not be repeated here.

[0183] The order inventory system of the embodiment of this specification determines the end time of each production link based on the brightness of the operation area in the video of the operation area of ​​each production link, and when each production link is completed, the order production information of the day of each production link can be obtained, and the order inventory information is generated and transmitted to the target terminal to complete the order inventory. This order inventory solution does not invade the production equipment of the production line in any way, and the production equipment in the production line is information-transformed or replaced, and does not rely on manual operation. It is automatically completed after the operation of each production link on the day is completed, thereby avoiding the problem of easy forgetfulness or delay in manual operation. Therefore, the order inventory can be executed non-invasively, automatically and accurately, and is particularly suitable for factories with flexible end times for production line production operations.

[0184] The present specification also provides a computer-readable storage medium on which computer instructions are stored. When the computer instructions are executed, they are suitable for executing the steps of the method for determining the production schedule described in the above embodiments of the present specification. The specific steps can be found in the detailed description of the method for determining the production schedule in the above embodiments, which will not be repeated here.

[0185] The present specification also provides a computer-readable storage medium on which computer instructions are stored. When the computer instructions are executed, they are suitable for executing the steps of the order inventory method described in the above embodiment of the present specification. The specific steps can be found in the detailed description of the order inventory method in the above embodiment, which will not be repeated here.

[0186] It is understandable that after reading this specification, those skilled in the art can conceive of any combination of some or all of the embodiments listed in this specification without creative work, and these combinations are also within the scope of disclosure and protection of this specification.

[0187] Of course, in addition to software implementation methods, the server and edge server of this application do not exclude other implementation methods, such as logic devices or a combination of software and hardware, etc. That is to say, the execution subject of the following processing flow is not limited to each logical unit, but can also be hardware or logic devices.

[0188] The systems, devices, modules or units described in the above embodiments may be implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer. Specifically, the computer may be, for example, a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.

[0189] It can be known from the above description of the implementation mode that the technicians in this field can clearly understand that the present specification can be implemented by means of software plus the necessary general hardware platform. Based on such an understanding, the technical solution of the present specification can be essentially or the part that contributes to the prior art can be embodied in the form of a software product, which can be stored in a storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present specification or some parts of the embodiments.

[0190] This specification can be used in many general or special computer system environments or configurations, such as personal computers, server computers, handheld or portable devices, tablet devices, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable consumer electronic devices, network PCs, minicomputers, mainframe computers, and distributed computing environments that include any of the above systems or devices.

[0191] This specification may be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. This specification may also be practiced in distributed computing environments where tasks are performed by remote processing devices connected through a communication network. In a distributed computing environment, program modules may be located in local and remote computer storage media, including storage devices.

[0192] Although the present specification is described through embodiments, those skilled in the art will appreciate that there are many modifications and changes to the present specification without departing from the spirit of the present specification, and it is intended that the appended claims include these modifications and changes without departing from the spirit of the present specification.

[0193] The above are only specific implementations of this specification, but the protection scope of this specification is not limited to them. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in this specification, and these modifications or replacements should be included in the protection scope of this specification. Therefore, the protection scope of this specification should be based on the protection scope of the claims.

Claims

1. A method for determining production progress, characterized in that: include: Collect video frames of the production operation area in the production line; Performing image recognition on the collected video frames to determine the brightness of the operation area in the video frames; When the brightness of the working area in the video frame is less than a preset brightness threshold, it is determined that the operation of the production link is completed, and the time when the operation of the production link is completed is obtained; the brightness threshold is set based on at least one of the following factors: the time period in which the video frame is captured; the geographical location of the production line; the weather at the geographical location of the production line.

2. The method according to claim 1, characterized in that When the brightness of the operation area in the video frame is less than a preset brightness threshold, determining that the operation of the production link is finished, and taking the acquisition time of the video frame as the time when the operation of the production link is finished, includes: When the brightness of the operation area in the video frames collected at a preset frequency and for a preset number of consecutive times is less than the brightness threshold, it is determined that the operation of the production link is completed, and the time when the operation of the production link is completed is obtained.

3. The method according to claim 2, characterized in that When the brightness of the operation area in the video frames collected at a preset frequency and for a preset number of consecutive times is less than the brightness threshold, determining that the operation of the production link is completed and obtaining the time when the operation of the production link is completed include: According to the pre-configuration, the acquisition time of the video frame in which the brightness of the operation area is less than the brightness threshold for the first, last or middle time among the consecutive preset times is selected as the end time of the production link operation.

4. The method according to claim 1, characterized in that: The performing image recognition on the collected video frame to determine the brightness of the operation area in the video frame includes: A key frame is captured based on the state of the target object in the operation area in the collected video frame, and the brightness of the target object area in the key frame is determined.

5. The method according to claim 4, characterized in that When the brightness of the operation area in the video frame is less than a preset brightness threshold, determining that the operation of the production link is completed, and obtaining the time when the operation of the production link is completed, includes: When the brightness of the target object area in a preset number of consecutive key frames is less than a preset brightness threshold, it is determined that the production link operation is completed, and the time when the production link operation is completed is obtained.

6. The method according to claim 5, characterized in that When the brightness of the target object area in a preset number of consecutive key frames is less than a preset brightness threshold, determining that the production link operation is completed and obtaining the time when the production link operation is completed includes: According to the pre-configuration, the acquisition time of the first, last or middle key frame in the preset number of consecutive key frames whose brightness of the target object area is less than the preset brightness threshold is selected as the end time of the production link operation.

7. The method according to claim 4, characterized in that The target object is a worker or a part of a limb of the worker; and extracting a key frame based on the state of the target object in the working area in the collected video frame includes: Based on the movements of the workers or the movements of the parts of the workers' limbs in the working area in the collected video frames, the video frame at the moment when the preset movement is completed is captured and intercepted as the key frame.

8. The method according to claim 4, characterized in that The target object is a moving part of a production device; and extracting a key frame based on the state of the target object in the working area in the acquired video frame includes: Based on the motion state of the moving parts of the production equipment in the working area in the collected video frames, the video frame at the moment of stopping operation is captured and intercepted as the key frame.

9. The method according to claim 4, characterized in that Before determining the brightness of the target object area in the key frame, the method further includes: Obtaining the acquisition time of the key frame, the geographical location of the production line and weather information; Determine the sunshine intensity of the current environment of the production line based on the acquired acquisition time of the key frame, the geographical location of the production line and weather information; When the sunlight intensity of the current environment of the production line is greater than a preset light intensity threshold, determining to reacquire a key frame, wherein the brightness value corresponding to the light intensity threshold is greater than the preset brightness threshold; The acquisition angle is adjusted to re-acquire key frames of the operation area of ​​the production link in the production line.

10. The method according to claim 1, characterized in that Also includes: The latest completion time of all production links in the production line is taken as the completion time of the production line operation.

11. An order inventory method, characterized in that: include: Collect video frames of each production process in the production line; Perform image recognition on the collected video frames to determine the brightness of the operating area in the video frames of the operating area of ​​each production link; When the brightness of the operation area in the video frame of a certain production link operation area is less than a preset brightness threshold, it is determined that the operation of the production link is finished, and the time when the operation of the production link is finished is obtained; the brightness threshold is set based on at least one of the following factors: the time period of the video frame acquisition moment; the geographical location of the production line; the weather at the geographical location of the production line; When it is determined that all production links are completed, the order production information of each production link on that day is obtained, and the order inventory information is generated and transmitted to the target terminal.

12. The method according to claim 11, characterized in that The performing of image recognition on the collected video frames to determine the brightness of the operation area in the video frames of the operation area of ​​each production link includes: Based on the state of the target object in the operation area of ​​each production link in the collected video frame of the operation area of ​​each production link, the key frame of the operation area of ​​each production link is intercepted, and the brightness of the target object area in the key frame is determined.

13. An edge server, characterized in that: include: A first video acquisition unit, adapted to acquire video frames of an operation area of ​​a production link of a production line; a first brightness determination unit, adapted to perform image recognition on the video frame acquired by the first video acquisition unit, and determine the brightness of the operation area in the video frame; The first brightness threshold setting unit is adapted to set the brightness threshold based on at least one of the following factors: the time period of the video frame acquisition moment; the geographical location of the production line; the weather at the geographical location of the production line; The first production progress determination unit is adapted to determine that the operation of the production link is completed when the brightness of the operation area in the video frame is less than a preset brightness threshold, and obtain the time when the operation of the production link is completed.

14. The edge server according to claim 13, characterized in that: The first production progress determination unit is suitable for determining that the operation of the production link is completed and obtaining the time when the operation of the production link is completed when the brightness of the operation area in the video frames collected at a preset frequency and for a preset number of consecutive times is less than the brightness threshold.

15. The edge server according to claim 13, characterized in that: The first brightness determination unit is adapted to extract a key frame based on the state of the target object in the operation area in the acquired video frame, and determine the brightness of the target object area in the key frame.

16. The edge server according to claim 15, characterized in that: The first production progress determination unit is suitable for determining that the production link operation is completed when the brightness of the target object area in a preset number of consecutive key frames is less than a preset brightness threshold, and obtaining the time when the production link operation is completed.

17. The edge server according to claim 15, characterized in that: Also includes: a reference information acquisition unit, adapted to acquire the acquisition time of the key frame, the geographical location of the production line and weather information before the first brightness determination unit determines the brightness of the target object area in the key frame; a deviation detection unit, adapted to determine the sunshine intensity of the current environment of the production line based on the acquisition time of the key frame acquired by the reference information acquisition unit, the geographical location of the production line and the weather information, and determine that there is a judgment deviation when the sunshine intensity of the current environment of the production line is greater than a preset light intensity threshold; The deviation correction control unit is adapted to output a control signal to adjust the acquisition angle and re-acquire the key frames of the operation area of ​​the production link in the production line when the deviation detection unit determines that there is a judgment deviation.

18. The edge server according to claim 13, characterized in that: Also includes: The production line end time determination unit is adapted to use the latest production link operation end time among all production links determined by the production progress determination unit as the production line operation end time.

19. An edge server, characterized in that: include: A second video acquisition unit, adapted to acquire video frames of operation areas of each production link in the production line; A second brightness determination unit, adapted to perform image recognition on the video frames acquired by the second video acquisition unit, and determine the brightness of the operation area in the video frames of the operation area of ​​each production link; The second brightness threshold setting unit is adapted to set the brightness threshold based on at least one of the following factors: the time period of the video frame acquisition moment; the geographical location of the production line; the weather at the geographical location of the production line; The second production progress determination unit is adapted to determine that the operation of a certain production link is finished when the brightness of the operation area in the video frame of the operation area of ​​the production link is less than a preset brightness threshold, and obtain the time when the operation of the production link is finished; The inventory information generating unit is adapted to obtain the order production information of each production link on the day and generate order inventory information when the second production progress determining unit determines that each production link has completed operations.

20. The edge server according to claim 19, characterized in that: The second brightness determination unit is adapted to extract key frames of the operation areas of each production link based on the states of the target objects in the operation areas in the collected video frames of the operation areas of each production link, and determine the brightness of the target object areas in the key frames.

21. A production progress determination system, characterized in that: include: Video acquisition device and edge server, wherein: The video acquisition device is suitable for acquiring video frames of the operation area of ​​the production link in the production line and uploading them to the edge server; The edge server is suitable for performing image recognition on the acquired video frames, determining the brightness of the working area in the video frames, and when the brightness of the working area in the video frames is less than a preset brightness threshold, determining that the operation of the production link is completed, and obtaining the time when the operation of the production link is completed; the brightness threshold is set based on at least one of the following factors: the time period in which the video frame is captured; the geographical location of the production line; the weather at the geographical location of the production line.

22. An order inventory system, characterized in that: include: Edge server and multiple video acquisition devices, including: The multiple video acquisition devices are respectively arranged at preset positions of each production link in the production line, and are suitable for acquiring video frames of the operation area of ​​the corresponding production link and uploading them to the edge server; The edge server is suitable for performing image recognition on the acquired video frames to determine the brightness of the operating area in the video frames of the operating area of ​​each production link; when the brightness of the operating area in the video frame of the operating area of ​​a certain production link is less than a preset brightness threshold, it is determined that the operation of the production link is completed, and the time when the operation of the production link is completed is obtained; when it is determined that the operation of each production link is completed, the daily order production information of each production link is obtained, and the order inventory information is generated and transmitted to the target terminal; the brightness threshold is set based on at least one of the following factors: the time period in which the video frame is captured; the geographical location of the production line; the weather at the geographical location of the production line.

23. A computer-readable storage medium having computer instructions stored thereon, characterized in that: The computer instructions are suitable for executing the steps of any one of claims 1 to 10 when executed.

24. A computer-readable storage medium having computer instructions stored thereon, characterized in that: The computer instructions are suitable for executing the steps of the method according to any one of claims 11 to 12 when executed.

Images