Method and System for Optimizing the Allocation of Steel Bar and Section Steel Processing Personnel

Abstract

A method and system for optimizing the allocation of steel bar and section steel processing personnel provided by the present application perform re-identification and tracking of materials and personnel on the first video image of the section steel processing site through a pre-trained material re-identification model and a personnel re-identification model, automatically determine the processing requirements of section steel materials in each section steel processing operation area and the status of each processing personnel according to the re-identification results, and then automatically allocate processing personnel to perform processing operations. In this way, the timeliness of the allocation of section steel processing personnel is effectively improved, and the risk of allocation errors can be reduced.

Description

Technical Field

[0001] This application relates to the technical field of artificial intelligence image recognition, and more specifically, to a method and system for optimizing the allocation of steel bar and section steel processing personnel. Background Art

[0002] Tunnel construction usually requires a large amount of steel bar and section steel materials for the support of the tunnel inner wall. Due to the size or structural differences in different tunnels or different positions of the tunnel, the section steel materials usually need to be adaptively processed before use. For example, cutting, cold bending, welding, drilling and other processes are required. In the case where the amount of section steel materials required for the tunnel is huge, or the section steel processing operations in multiple tunnel sections are concentrated in a section steel processing site for processing, the traditional method of relying on manual allocation of processing personnel to perform processing operations has problems of poor timeliness and easy errors. Summary of the Invention

[0003] In order to overcome the above deficiencies in the prior art, the purpose of this application is to provide a method for optimizing the allocation of steel bar and section steel processing personnel, and the method includes:

[0004] Obtain the warehousing information of the section steel materials sent into the section steel processing site, where the warehousing information includes the material batch information of the section steel materials and the warehousing stacking position in the section steel processing site, and obtain the first processing requirements corresponding to the material batch information;

[0005] Obtain the first video image of the section steel processing site through at least one image acquisition device fixedly arranged in the section steel processing site, and determine at least one processing operation area in the first video image;

[0006] Perform re-identification and tracking on the section steel materials in the first video image through a pre-trained material re-identification model to obtain a material re-identification result, where the material re-identification result includes the second processing requirements corresponding to each processing operation area;

[0007] Perform re-identification and tracking on the processing personnel in the first video image through a pre-trained personnel re-identification model to obtain the personnel re-identification result of each processing personnel; the personnel re-identification result includes the personnel operation type, personnel position information and personnel status of the processing personnel;

[0008] Determine the second processing requirements corresponding to each processing operation area according to the material re-identification result and the personnel re-identification result;

[0009] Allocate corresponding processing personnel to each processing operation area according to the second processing requirements of each processing operation area and the personnel re-identification result.

[0010] In some possible implementation manners, the step of re-identifying and tracking the profiled steel materials in the first video image through a pre-trained material re-identification model to obtain a material re-identification result includes:

[0011] For the idle processing operation area where the profiled steel materials are not stored, when it is detected that the profiled steel materials are transported and stored in this processing operation area, set the second processing requirement of this processing operation area to be the same as the first processing requirement of the profiled steel materials transported and stored in this processing operation area;

[0012] When it is detected that the profiled steel materials are transported away from the processing operation area, set the first processing requirement of the profiled steel materials leaving the processing operation area to be the same as the second processing requirement of this processing operation area;

[0013] Re-identify and track the profiled steel materials in the first video image through a pre-trained material re-identification model to determine the material batch information and the corresponding first processing requirement of the profiled steel materials in transportation.

[0014] In some possible implementation manners, the method further includes:

[0015] When it is detected that the residence time of the profiled steel materials in the processing operation area reaches the fourth threshold, determine that the profiled steel materials are transported and stored in this processing operation area, and stop performing re-identification and tracking on this profiled steel material.

[0016] In some possible implementation manners, the second processing requirement includes at least one required processing item; the step of determining the second processing requirement corresponding to each processing operation area according to the material re-identification result and the personnel re-identification result includes:

[0017] According to the personnel re-identification result, when it is detected that the processing personnel are in the target processing operation area and the duration of the personnel state of this processing personnel being in the working state reaches the first preset threshold, mark the required processing item corresponding to the personnel operation type of this processing personnel in the second processing requirement of this processing operation area as the processed state.

[0018] In some possible implementation manners, the step of allocating corresponding processing personnel to each processing operation area according to the second processing requirement of each processing operation area and the personnel re-identification result includes:

[0019] For the processing operation area where the required processing item is still in the unprocessed state, mark this processing operation area as the area to be allocated;

[0020] For the demand processing items in the second processing requirement for the to-be-allocated area that are in the unprocessed state, determine at least one processing personnel whose personnel operation type matches the demand processing item and whose personnel status is in the idle state as the target processing personnel according to the personnel re-identification result;

[0021] Allocate the target processing personnel to the to-be-allocated area to perform the processing operation, and mark the personnel status of the target processing personnel as allocated.

[0022] In some possible implementation manners, the step of marking the processing operation area where there are still unprocessed demand processing items as the to-be-allocated area includes:

[0023] For the processing operation area where there are still unprocessed demand processing items, when detecting whether the duration of not continuously transporting and storing the shaped steel materials into the area reaches a second preset threshold, mark the processing operation area as the to-be-allocated area;

[0024] The step of determining at least one processing personnel whose personnel operation type matches the demand processing item and whose personnel status is in the idle state as the target processing personnel according to the personnel re-identification result for the demand processing items in the second processing requirement for the to-be-allocated area that are in the unprocessed state includes:

[0025] For the demand processing items in the second processing requirement for the to-be-allocated area that are in the unprocessed state, determine at least one processing personnel whose personnel operation type matches the demand processing item and whose idle state duration is greater than a third preset threshold as the target processing personnel.

[0026] In some possible implementation manners, the method further includes:

[0027] Determine the current hoisting operation range of the hoisting equipment in the first video image through a pre-trained hoisting area recognition model;

[0028] The step of marking the processing operation area where there are still unprocessed demand processing items as the to-be-allocated area includes:

[0029] For the processing operation area where there are still unprocessed demand processing items and that does not overlap with the current hoisting operation range, mark the processing operation area as the to-be-allocated area.

[0030] In some possible implementation manners, the warehousing information further includes the warehousing time of the profiled steel materials; for the processing operation areas where there are still unprocessed states for the demand processing items, the step of marking the processing operation areas as to-be-allocated areas includes:

[0031] Obtain the waiting processing duration of each processing operation area where there are still unprocessed states for the demand processing items, that is, the duration between the warehousing time of the profiled steel materials corresponding to the processing operation area and the current time;

[0032] In the order from the longest to the shortest of the waiting processing duration, sequentially mark the processing operation areas where there are still unprocessed states for the demand processing items as to-be-allocated areas.

[0033] In some possible implementation manners, the method further includes:

[0034] For the processing operation areas where all the demand processing items are in a processed state, detect whether the duration without processing personnel in the processing operation area reaches a fifth preset threshold;

[0035] If so, update the state of the processing operation area to a to-be-outbound state, and send a corresponding outbound notice to the mobile terminal device of the transportation personnel.

[0036] The present application further provides an optimized configuration system for steel bar and profiled steel processing personnel. The system includes an image acquisition device and a data processing device;

[0037] The image acquisition device is used to acquire a first video image of a profiled steel processing site by an acquisition device;

[0038] The data processing device is used to obtain the warehousing information of the profiled steel materials sent into the profiled steel processing site. The warehousing information includes the material batch information of the profiled steel materials and the warehousing stacking position in the profiled steel processing site, and obtain a first processing demand corresponding to the material batch information;

[0039] The data processing device is further used to determine at least one processing operation area in the first video image;

[0040] The data processing device is further used to perform re-identification and tracking on the profiled steel materials in the first video image through a pre-trained material re-identification model to obtain a material re-identification result. The material re-identification result includes a second processing demand corresponding to each processing operation area;

[0041] The data processing device is also used to re-identify and track the processing personnel in the first video image through a pre-trained person re-identification model, and obtain the person re-identification results of each processing personnel; the person re-identification results include the person operation type, person position information and person status of the processing personnel;

[0042] The data processing device is also used to determine the corresponding second processing requirements for each of the processing operation areas according to the material re-identification results and the person re-identification results;

[0043] The data processing device is also used to allocate corresponding processing personnel to each of the processing operation areas according to the second processing requirements of each of the processing operation areas and the person re-identification results.

[0044] Compared with the prior art, the present application has the following beneficial effects:

[0045] A method and system for optimizing the allocation of steel bar and section steel processing personnel provided by the present application re-identify and track materials and personnel in the first video image of a section steel processing site through a pre-trained material re-identification model and person re-identification model, and automatically determine the processing requirements of section steel materials and the status of each processing personnel in each section steel processing operation area according to the re-identification results, and then automatically allocate processing personnel to perform processing operations. In this way, the timeliness of the allocation of section steel processing personnel is effectively improved, and the risk of allocation errors can be reduced. Description of the Drawings

[0046] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required to be used in the embodiments will be briefly introduced below. It should be understood that the following drawings only show some embodiments of the present application, and therefore should not be regarded as limiting the scope. For those of ordinary skill in the art, other related drawings can also be obtained according to these drawings without creative efforts.

[0047] Figure 1 It is a schematic diagram of a system for optimizing the allocation of steel bar and section steel processing personnel provided by an embodiment of the present application;

[0048] Figure 2 It is a schematic diagram of the step flow of a method for optimizing the allocation of steel bar and section steel processing personnel provided by an embodiment of the present application;

[0049] Figure 3 It is a schematic diagram of the sub-steps of step S130 provided by an embodiment of the present application;

[0050] Figure 4 It is a schematic diagram of the functional modules of a device for optimizing the allocation of steel bar and section steel processing personnel provided by an embodiment of the present application. Detailed Embodiments

[0051] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the following will clearly and completely describe the technical solutions in the embodiments of this application with reference to the accompanying drawings in the embodiments of this application. Obviously, the described embodiments are some, but not all, of the embodiments of this application. Components of the embodiments of this application described and illustrated in the accompanying drawings here can be arranged and designed in various different configurations.

[0052] Therefore, the following detailed description of the embodiments of this application provided in the accompanying drawings is not intended to limit the scope of this application that is claimed, but merely represents selected embodiments of this application. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in this application without creative efforts fall within the scope of protection of this application.

[0053] It should be noted that similar reference numerals and letters denote similar items in the following drawings. Therefore, once an item is defined in one drawing, it does not need to be further defined and explained in subsequent drawings.

[0054] In the description of this application, it should be noted that terms such as "horizontal", "vertical", "hanging" do not mean that the components are required to be absolutely horizontal or hanging, but can be slightly inclined. For example, "horizontal" only means that its direction is more horizontal relative to "vertical", and does not mean that the structure must be completely horizontal, but can be slightly inclined.

[0055] Please refer to Figure 1 , Figure 1 which is a schematic diagram of an optimized personnel allocation system for steel bar and section steel processing provided in this embodiment. The system may include a data processing device 100 and at least one image acquisition device 200 fixedly installed in the section steel processing site. The first video image of the section steel processing site is acquired by the image acquisition device 200, and then the data processing device 100 performs re-identification tracking of materials and personnel based on the first video image, and automatically determines the processing requirements of section steel materials in each section steel processing operation area and the status of each processing personnel according to the re-identification results, and then automatically allocates processing personnel to perform processing operations.

[0056] Among them, the data processing device 100 can be connected to the image acquisition device 200 by means of wired communication or wireless communication to obtain the first video image for identification processing.

[0057] An optimized personnel allocation method for steel bar and section steel processing provided in this embodiment can be mainly executed by the data processing device 100.

[0058] Specifically, please refer to Figure 2 , Figure 2Schematic diagram of the step flow of an optimized allocation method for steel bar and section steel processing personnel provided in this embodiment. This method may include the following steps.

[0059] Step S110: Obtain the warehousing information of the section steel materials delivered to the section steel processing site. The warehousing information includes the material batch information of the section steel materials and the warehousing stacking positions within the section steel processing site, and obtain the first processing requirements corresponding to the material batch information.

[0060] In this embodiment, section steel materials usually need to be transported to a unified section steel processing site for processing and then transported to the tunnel construction site for support installation. After the section steel materials are delivered to the section steel processing site, the data processing device can obtain the warehousing information of the section steel materials delivered to the section steel processing site through manual entry or from other electronic devices.

[0061] Optionally, the material batch information can be used to characterize the identity of the section steel materials. For example, it can include the numbers, quantities, dimensions of the section steel materials warehoused in this batch, and the tunnel projects that need to be used, etc., which are not specifically limited in this embodiment.

[0062] Optionally, different material batch information can correspond to different first processing requirements. The first processing requirements can include the processing actions that the section steel materials need to perform. For example, the section steel materials need to perform one or a combination of cutting, cold bending, welding, or punching. Optionally, the first processing requirements can also include the specific parameters of the processing action requirements. For example, the length after cutting, the radian after cold bending, the welding position, the hole opening position dimensions, etc., which are not specifically limited in this embodiment.

[0063] In this embodiment, section steel materials with different material batch information can be placed at different warehousing stacking positions in the section steel processing site. After warehousing, the corresponding relationship between the material batch information of the section steel materials and the warehousing stacking positions can be entered and recorded simultaneously.

[0064] Step S120: Obtain the first video image of the section steel processing site through at least one image acquisition device fixedly installed in the section steel processing site, and determine at least one processing operation area in the first video image.

[0065] Considering that in tunnel construction projects, the section steel processing site may usually be temporarily built near the tunnel construction location and demolished after the construction is completed, the optimized allocation scheme for processing personnel that requires complex interactive communication equipment is not applicable to such scenarios. In view of this, in this embodiment, image acquisition devices with simple installation settings are used to acquire the first video image, and the subsequent data processing device only needs the first video image to complete the automatic optimized allocation action of the processing personnel.

[0066] Optionally, since the profiled steel materials usually have a large weight and occupy a large space, after the profiled steel materials are transported to the profiled steel processing site, they usually need to be transported in batches to the corresponding processing operation areas for processing. For example, for the profiled steel materials that need to perform welding processing, 10 profiled steel materials can be transferred to a dedicated welding support frame in the welding processing operation area and stacked in sequence, and then the welding processing personnel perform welding processing on the 10 stacked profiled steel materials. After the welding of these 10 profiled steel materials is completed, the processing personnel leave the area, and then these 10 profiled steel materials are transported to other areas together. In this way, transportation accidents are avoided when transportation actions and processing actions are performed in the same area. That is, in a unified processing operation area, the first processing requirements of the profiled steel materials that coexist are usually the same.

[0067] In this embodiment, after obtaining the first video image, the positions of different processing operation areas in the first video image can be marked based on the first video image, and subsequent processing actions are all referenced based on the positions of the pre-labeled processing operation areas.

[0068] Step S130, re-identify and track the profiled steel materials in the first video image through a pre-trained material re-identification model to obtain a material re-identification result, where the material re-identification result includes the second processing requirements corresponding to each of the processing operation areas.

[0069] Specifically, the profiled steel processing site is usually a shed or factory building with connected spaces, little vision obstruction, the profiled steel materials have a relatively obvious shape and strong continuity of position change during transportation. Therefore, in this embodiment, the re-identification technology usually used for personnel or vehicles can be used as a reference to pre-train the material re-identification model to identify and re-identify and track the profiled steel materials in the input continuous video images.

[0070] Among them, since the material batch information of the profiled steel materials and the in-warehouse stacking positions in the profiled steel processing site are obtained in step S110, starting from this point for material re-identification and tracking, the material batch information of each profiled steel material during transportation and the corresponding first processing requirements can be determined.

[0071] After the profiled steel materials are transported to the processing operation area, the second processing requirements of the processing operation area can be determined according to the first processing requirements of the profiled steel materials.

[0072] Step S140, re-identify and track the processing personnel in the first video image through a pre-trained personnel re-identification model to obtain a personnel re-identification result of each processing personnel; the personnel re-identification result includes the personnel operation type, personnel position information, and personnel status of the processing personnel.

[0073] In this embodiment, the person re-identification model can identify information such as the face, body posture, clothing, and hand-held tools of the persons in the first video image, and perform person re-identification tracking based on this to determine the identity information and personnel position information of each processing person in the first video image, determine the person operation type of the processing person according to the identity information of each processing person, and at the same time can determine the person state of each processing person according to the posture and movement of each processing person. The person state can at least include a working state and an idle state.

[0074] Step S150: Determine the second processing requirements corresponding to each of the processing operation areas according to the material re-identification result and the person re-identification result.

[0075] In this embodiment, in step S130, the first processing requirements for the profiled steel materials in each processing operation area can be determined through the material re-identification result of the material re-identification model, and in step S140, the personnel position and personnel state of each processing person can be determined through the person re-identification model. According to the above information, it can be determined whether a processing person has performed processing operations in a certain processing operation area, and then the second processing requirements corresponding to the processing operation area can be obtained or updated.

[0076] Both the first processing requirements and the second processing requirements can include one or more required processing items, and the required processing items can include cutting, welding, cold bending, punching, etc.

[0077] For example, according to step S130, it can be determined that the required processing items in the first processing requirements for the profiled steel materials in processing operation area A include welding and cutting. Then, if it is determined according to step S140 that a processing person with a welding worker operation type has performed operations in processing operation area A, it can be considered that the profiled steel materials in processing operation area A have been welded, and the required processing item corresponding to welding in the second processing requirements for processing operation area A is marked as completed, while the required processing item corresponding to cutting remains in an uncompleted state.

[0078] In this way, according to the recognition results of step S130 and step S140, the automatic update of the processing requirements for the profiled steel materials can be completed in step S150.

[0079] Step S160: Assign corresponding processing persons to each of the processing operation areas according to the second processing requirements of each of the processing operation areas and the person re-identification result.

[0080] In this embodiment, according to the updated second processing requirements, it is possible to determine the processing operation areas where processing operations still need to be performed and the types of processing operations required. According to the personnel status in the personnel re-identification results, it is possible to determine the idle processing personnel and the types of operations of the processing personnel. In this way, the idle processing personnel can be assigned to the processing operation areas that need to perform processing operations to perform the processing operations.

[0081] Based on the above design, in the solution provided in this embodiment, the material re-identification model and the personnel re-identification model that are pre-trained are used to perform material and personnel re-identification tracking on the first video image of the section steel processing site. According to the re-identification results, the processing requirements of the section steel materials in each section steel processing operation area and the status of each processing personnel are automatically determined, and then the processing personnel are automatically assigned to perform the processing operations. In this way, the timeliness of the allocation of section steel processing personnel is effectively improved, and the risk of allocation errors can be reduced.

[0082] Furthermore, in the solution provided in this embodiment, the material re-identification model used in step S130 and the personnel re-identification model used in step S140 can adopt a general model structure and training method. The material re-identification model and the personnel re-identification model can be trained and used separately, or at least one of them can use an existing publicly disclosed model.

[0083] Among them, the actions of labeling the processing operation areas in step S120, the training and recognition processes of the material weight identification model and the personnel re-identification model are not strongly dependent on the background. The three steps are decoupled. Therefore, the recognition robustness of the entire action based on the first video image processing after the background image changes is relatively high. That is, the same set of processing methods is applicable to different section steel processing sites, or for image acquisition devices with different installation positions. It is especially suitable for section steel processing sites that are temporarily built, demolished after use, and then rebuilt at other positions without the need to specifically determine the installation position of the image acquisition device.

[0084] In some possible implementation manners, please refer to Figure 3 , step S130 may include the following sub-steps.

[0085] Step S131, for the idle processing operation area where the section steel material is not stored, when it is detected that the section steel material is transported and stored in this processing operation area, set the second processing requirement of this processing operation area to be the same as the first processing requirement of the section steel material transported and stored in this processing operation area.

[0086] Specifically, under normal circumstances, the first processing requirements for the same batch of profiled steel materials transported to a certain processing operation area are the same. In this case, for the idle processing operation area where the profiled steel materials are not stored, after the material re-identification model detects that profiled steel materials are stored in this processing operation area based on the first video image, the second processing requirements corresponding to this processing operation area can be set to be consistent with the first processing requirements of the profiled steel materials transported and stored in this processing operation area.

[0087] For example, through the material re-identification model, it is detected based on the first video image that the first processing requirements of profiled steel materials in a certain transportation process include that item A in the required processing items is in a processed state, and items B and C are in an unprocessed state. After detecting that the profiled steel materials are transported to and stored in a processing operation area, the second processing requirements of this processing operation area can be set such that item A is in a processed state, and items B and C are in an unprocessed state.

[0088] Furthermore, in this embodiment, when it is detected that the residence time of the profiled steel materials in the processing operation area reaches the fourth threshold, it is determined that the profiled steel materials are transported and stored in this processing operation area, and the re-identification tracking of the profiled steel materials is stopped.

[0089] That is, after it is determined that the profiled steel materials have been stored in a certain processing operation area, the tracking of the profiled steel materials is not continued.

[0090] Specifically, for some processing operations, such as cold bending processing, the profiled steel materials may be greatly blocked by a cold bending machine during the processing process, causing great interference to the material re-identification tracking. Also considering that the processing requirements of profiled steel materials in the same processing operation area are usually the same, therefore, after the profiled steel materials are transported and stored in the processing operation area, only the second processing requirements of the entire processing operation area need to be concerned, and there is no need to pay attention to the individual first processing requirements of each profiled steel material. In this way, the data processing difficulty can be reduced.

[0091] Step S132, when it is detected that the profiled steel materials are transported away from the processing operation area, the first processing requirements of the profiled steel materials leaving the processing operation area are set to be consistent with the second processing requirements of this processing operation area.

[0092] Specifically, in step S150, the second processing requirements of a certain processing operation area may be updated and adjusted in combination with the personnel re-identification results. In this case, when it is detected that starting from a certain processing operation area, profiled steel materials start to be transported and move away, the updated second processing requirements of this processing operation area can be copied to the first processing requirements of the profiled steel materials that will leave the processing operation area.

[0093] Step S133, re-identify and track the section steel materials in the first video image through a pre-trained material re-identification model, and determine the material batch information of the section steel materials during transportation and the corresponding first processing requirements.

[0094] That is, in this embodiment, for the section steel materials in a moving state during transportation, it is necessary to continuously perform re-identification and tracking through the material re-identification model.

[0095] Based on the above design, in the solution provided in this embodiment, when performing material re-identification and tracking, it is possible to only perform re-identification and tracking on the section steel materials during transportation. After the section steel materials are transported to the processing operation area for storage, no longer focus on the section steel materials themselves, but only focus on the second processing requirements of the entire processing operation area.

[0096] In some possible implementation manners, in step S150, according to the person re-identification result, when it is detected that the processing person is in the processing operation area and the duration of the person state of this processing person being in the working state reaches a first preset threshold, mark the demand processing items corresponding to the person operation type of this processing person in the second processing requirements of the processing operation area as the processed state.

[0097] For example, when it is detected that a processing person with the person operation type of welder is in a certain processing operation area and the duration of this processing operation person being in the working state in this area reaches the first preset threshold, it can be considered that this processing person performs welding operations in this processing operation area. Therefore, the demand processing items corresponding to welding in the second processing requirements of this processing operation area can be marked as the processed state.

[0098] In some possible implementation manners, step S160 may include the following sub-steps.

[0099] Step S161, for the processing operation area where the demand processing items still have an unprocessed state, mark this processing operation area as a to-be-allocated area.

[0100] Step S162, for the demand processing items with an unprocessed state in the second processing requirements of the to-be-allocated area, determine at least one processing person whose person operation type matches the demand processing items and whose person state is in the idle state as the target processing person according to the person re-identification result.

[0101] Step S163, allocate the target processing person to the to-be-allocated area to perform processing operations, and mark the person state of the target processing person as allocated.

[0102] For example, if the status of the demand processing item corresponding to welding in the second processing demand of the processing operation area A is the unprocessed status, then the processing operation area A is marked as an area to be allocated. Then, according to the personnel recognition result, a processing personnel who is in the idle state and whose personnel operation type matches welding is found as the target processing personnel. Then, the target personnel is allocated to the processing operation area A.

[0103] Further, in some possible implementation manners, in step S161, for the processing operation area where there are still demand processing items in the unprocessed status, when detecting whether the duration of not continuing to transport and store the profiled bar materials into the processing operation area reaches a second preset threshold, the processing operation area is marked as an area to be allocated.

[0104] That is, when a profiled bar material is being input into a processing operation area, the processing operation area is not determined as an area to be allocated for the time being, so as to avoid affecting the transportation operation when allocating processing personnel to this area at this time and generating potential safety hazards. After a period of time when the processing operation area does not continue to transport and store the profiled bar materials, it is considered that the transportation is completed, and then it is determined as an area to be allocated.

[0105] In step S162, for the demand processing items in the unprocessed status in the second processing demand of the area to be allocated, at least one processing personnel whose personnel operation type matches the demand processing item and whose idle state duration is greater than a third preset threshold is determined as the target processing personnel according to the personnel re-recognition result.

[0106] That is, when the idle state duration of a certain processing personnel is greater than the third preset threshold, it is only then determined that the processing personnel is in a state where it can be allocated. In this way, the risk of misidentifying a processing personnel as being in the idle state is reduced.

[0107] In some possible implementation manners, the method provided in this embodiment can also first determine the current lifting operation range of the lifting equipment in the first video image through a pre-trained lifting area recognition model.

[0108] In step S161, for the processing operation area where there are still demand processing items in the unprocessed status and that does not overlap with the current lifting operation range, the processing operation area is marked as an area to be allocated.

[0109] That is, in the solution provided in this embodiment, the processing operation area that overlaps with the current lifting operation area can be not determined as an area to be allocated for the time being. In this way, it is possible to avoid processing personnel entering the current lifting operation area and affecting the lifting operation, and reduce the risk of loading accidents.

[0110] In some possible implementation manners, the warehousing information further includes the warehousing time of the profiled steel materials. In step S161, the waiting processing duration of each processing operation area where the demand processing items still have an unprocessed status can be obtained, that is, the duration between the warehousing time of the profiled steel materials corresponding to the processing operation area and the current time. Then, in the order from largest to smallest of the waiting processing duration, the processing operation areas where the demand processing items still have an unprocessed status are sequentially marked as areas to be allocated.

[0111] That is, in this embodiment, the processing personnel can be allocated according to the warehousing time to preferentially process the profiled steel materials with a longer warehousing time, so as to ensure the timeliness of processing different batches of profiled steel materials.

[0112] In some possible implementation manners, the solution provided in this embodiment may further include the following steps.

[0113] Step S210, for each processing operation area where all the demand processing items are in a processed status, detect whether the duration without processing personnel in this processing operation area reaches a fifth preset threshold.

[0114] If so, execute step S220. If not, continue the detection.

[0115] Step S220, update the status of this processing operation area to a to-be-outbound status, and send a corresponding outbound notice to the mobile terminal device of the transportation personnel.

[0116] That is, in the solution provided in this embodiment, in the second processing requirements of a certain processing operation area, when all the demand processing items are in a processed status and whether the duration without processing personnel reaches a fifth preset threshold is detected, it can be determined that the processing operation area has completed the processing operation and the processing personnel have withdrawn. In this case, this processing operation area can be marked as a to-be-outbound status, and a corresponding outbound notice is sent to the mobile terminal device of the transportation personnel.

[0117] Please refer to Figure 4 , Figure 4 Yes Figure 1 is a block diagram of the data processing device 100 shown. The data processing device 100 includes a steel bar and profiled steel processing personnel optimization configuration device 110, a machine-readable storage medium 120, and a processor 130.

[0118] The machine-readable storage medium 120, the processor 130 and each element are electrically connected to each other directly or indirectly to realize data transmission or interaction. For example, these elements can be electrically connected to each other through one or more communication buses or signal lines. The device 110 for optimizing the configuration of steel bar processing personnel includes at least one software function module that can be stored in the machine-readable storage medium 120 in the form of software or firmware or solidified in the operating system (OS) of the data processing device 100. The processor 130 is used to execute the executable module stored in the machine-readable storage medium 120, such as the software function module and computer program included in the device 110 for optimizing the configuration of steel bar processing personnel.

[0119] The machine-readable storage medium 120 may be, but is not limited to, a random access memory (RAM), a read only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable read-only memory (EEPROM), etc. The machine-readable storage medium 120 is used to store a program, and the processor 130 executes the program / executable after receiving the execution instruction. The method for optimizing the configuration of steel bar processing personnel provided in this embodiment.

[0120] The processor 130 may be an integrated circuit chip with signal processing capabilities. The above-mentioned processor may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it may also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present application may be implemented or executed. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0121] In summary, the method and system for optimizing the allocation of steel bar and section steel processing personnel provided by this application perform re-identification and tracking of materials and personnel on the first video image of the section steel processing site through a pre-trained material re-identification model and personnel re-identification model, automatically determine the processing requirements of section steel materials and the status of each processing personnel in each section steel processing operation area according to the re-identification results, and then automatically allocate processing personnel to perform processing operations. In this way, the timeliness of the allocation of section steel processing personnel is effectively improved, and the risk of allocation errors can be reduced.

[0122] In the embodiments provided in this application, it should be understood that the disclosed devices and methods can also be implemented in other ways. The device embodiments described above are merely illustrative. For example, the flowcharts and block diagrams in the accompanying drawings show the possible architectures, functions, and operations of devices, methods, and computer program products according to multiple embodiments of this application. In this regard, each block in the flowchart or block diagram may represent a module, a program segment, or a part of code, and the module, program segment, or part of code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than marked in the accompanying drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, and the combination of blocks in the block diagram and / or flowchart, can be implemented by a dedicated hardware-based system for performing the specified functions or actions, or can be implemented by a combination of dedicated hardware and computer instructions.

[0123] In addition, the functional modules in each embodiment of this application can be integrated together to form an independent part, or each module can exist alone, or two or more modules can be integrated to form an independent part.

[0124] When the above-mentioned functions are implemented in the form of software function modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a part of this technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of this application. The aforementioned storage medium includes: various media such as USB flash drives, mobile hard disks, read-only memories (ROM, Read-Only Memory), random access memories (RAM, Random Access Memory), magnetic disks, or optical discs that can store program codes.

[0125] It should be noted that in this text, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the term "comprising", "including" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, but also includes other elements not expressly listed, or further includes elements inherent to such process, method, article or device. Without further limitations, an element defined by the statement "including one..." does not exclude the existence of additional identical elements in the process, method, article or device including the said element.

[0126] As described above, these are only various implementation manners of this application, but the protection scope of this application is not limited thereto. Any person skilled in the art within the technical scope disclosed by this application can easily think of changes or substitutions, which should all be covered within the protection scope of this application. Therefore, the protection scope of this application should be subject to the protection scope of the claims.

Claims

1. A method for optimizing the configuration of steel bar and steel section processing personnel, characterized in that: The method comprises: Obtaining storage information of steel materials delivered to a steel processing site, the storage information including material batch information of the steel materials and storage and stacking locations in the steel processing site, and obtaining a first processing requirement corresponding to the material batch information; Acquire a first video image of the section steel processing site by at least one image acquisition device fixedly arranged in the section steel processing site, and determine at least one processing operation area in the first video image; Re-identify and track the steel material in the first video image through a pre-trained material re-identification model to obtain a material re-identification result, wherein the material re-identification result includes a second processing requirement corresponding to each of the processing operation areas; Re-identify and track the processing personnel in the first video image through a pre-trained personnel re-identification model to obtain personnel re-identification results of each processing personnel; the personnel re-identification results include the personnel job type, personnel location information and personnel status of the processing personnel; According to the material re-identification result and the personnel re-identification result, updating the second processing requirements corresponding to each of the processing operation areas; Allocating corresponding processing personnel to each processing operation area according to the second processing requirements of each processing operation area and the personnel re-identification result; The step of re-identifying and tracking the steel material in the first video image by using a pre-trained material re-identification model to obtain a material re-identification result includes: For the idle processing operation area where the profiled steel material is not stored, when it is detected that the profiled steel material is transported and stored in the processing operation area, the second processing requirement of the processing operation area is set to be consistent with the first processing requirement of the profiled steel material transported and stored in the processing operation area; When it is detected that the steel material is transported out of the processing operation area, the first processing requirement of the steel material leaving the processing operation area is set to be consistent with the second processing requirement of the processing operation area; The steel material in the first video image is re-identified and tracked through a pre-trained material re-identification model to determine the material batch information of the steel material in transportation and the corresponding first processing requirement.

2. The method according to claim 1, characterized in that The method further comprises: When it is detected that the residence time of the steel material in the processing operation area reaches a fourth threshold, it is determined that the steel material is transported and stored in the processing operation area, and re-identification and tracking of the steel material is stopped.

3. The method according to claim 1, characterized in that The second processing requirement includes at least one required processing item; the step of updating the second processing requirement corresponding to each processing operation area according to the material re-identification result and the personnel re-identification result includes: According to the personnel re-identification result, when it is detected that the processing personnel is in the target processing operation area and the length of time that the processing personnel's personnel status is in the working state reaches a first preset threshold, the required processing item corresponding to the personnel operation type of the processing personnel in the second processing requirement of the processing operation area is marked as a processed state.

4. The method according to claim 3, characterized in that The step of allocating corresponding processing personnel to each processing operation area according to the second processing requirements of each processing operation area and the personnel re-identification result includes: For the processing operation area of ​​the required processing item that still has an unprocessed state, marking the processing operation area as an area to be allocated; For the processing item in the second processing requirement of the area to be assigned that is in an unprocessed state, determine, according to the personnel re-identification result, at least one processing personnel whose personnel job type matches the processing item and whose personnel state is in an idle state as a target processing personnel; The target processing personnel are assigned to the to-be-assigned area to perform processing work, and the personnel status of the target processing personnel is marked as assigned.

5. The method according to claim 4, characterized in that The step of marking the processing operation area in which the required processing item still has an unprocessed state as an area to be allocated comprises: For the processing operation area of ​​the required processing item that is still in an unprocessed state, when it is detected whether the time for which the steel material is not continuously transported and stored in the processing operation area reaches a second preset threshold, the processing operation area is marked as an area to be allocated; The step of determining, for the processing item in the second processing requirement of the area to be allocated and which is in an unprocessed state, at least one processing personnel whose job type matches the processing item and whose status is idle as a target processing personnel according to the personnel re-identification result, comprises: For the processing items in the second processing requirements of the area to be assigned that are in an unprocessed state, at least one processing personnel whose job type is consistent with the processing items and whose personnel status is in an idle state for a period longer than a third preset threshold is determined as the target processing personnel based on the personnel re-identification result.

6. The method according to claim 4, characterized in that The method further comprises: Determine the current hoisting operation range of the hoisting equipment in the first video image by using a pre-trained hoisting area recognition model; The step of marking the processing operation area in which the required processing item still has an unprocessed state as an area to be allocated comprises: For the processing items that are still in an unprocessed state and the processing operation area that does not overlap with the current lifting operation range, the processing operation area is marked as an area to be allocated.

7. The method according to claim 4, characterized in that The storage information also includes the storage time of the steel material; the step of marking the processing operation area in which the required processing item still has an unprocessed state as an area to be allocated includes: Obtain the waiting processing time of the processing operation area in which each of the required processing items is still in an unprocessed state, and the time between the storage time corresponding to the steel material corresponding to the processing operation area and the current time; In the descending order of the waiting processing time, the processing operation areas where the required processing items are still in an unprocessed state are marked as areas to be allocated.

8. The method according to claim 3, characterized in that The method further comprises: For the processing operation area in which all the required processing items are in a processed state, detecting whether the time period in which no processing personnel exist in the processing operation area reaches a fifth preset threshold; If so, the status of the processing operation area is updated to the waiting-for-delivery status, and a corresponding delivery notification is sent to the mobile terminal device of the transport personnel.

9. A steel bar and steel section processing personnel optimization configuration system, characterized in that: The system includes an image acquisition device and a data processing device; The image acquisition device is used to acquire a first video image of a section steel processing site; The data processing device is used to obtain storage information of the steel material sent to the steel processing site, the storage information includes material batch information of the steel material and the storage and stacking position in the steel processing site, and obtain the first processing requirement corresponding to the material batch information; The data processing device is also used to determine at least one processing operation area in the first video image; The data processing device is also used to re-identify and track the steel material in the first video image through a pre-trained material re-identification model to obtain a material re-identification result, wherein the material re-identification result includes a second processing requirement corresponding to each of the processing operation areas; The data processing device is also used to re-identify and track the processing personnel in the first video image through a pre-trained personnel re-identification model to obtain a personnel re-identification result of each processing personnel; the personnel re-identification result includes the personnel job type, personnel location information and personnel status of the processing personnel; The data processing device is also used to update the second processing requirements corresponding to each of the processing operation areas according to the material re-identification results and the personnel re-identification results; The data processing device is also used to allocate corresponding processing personnel to each processing operation area according to the second processing requirements of each processing operation area and the personnel re-identification result; The step of re-identifying and tracking the steel material in the first video image by the data processing device through the pre-trained material re-identification model to obtain the material re-identification result includes: For the idle processing operation area where the profiled steel material is not stored, when it is detected that the profiled steel material is transported and stored in the processing operation area, the second processing requirement of the processing operation area is set to be consistent with the first processing requirement of the profiled steel material transported and stored in the processing operation area; When it is detected that the steel material is transported out of the processing operation area, the first processing requirement of the steel material leaving the processing operation area is set to be consistent with the second processing requirement of the processing operation area; The steel material in the first video image is re-identified and tracked through a pre-trained material re-identification model to determine the material batch information of the steel material in transportation and the corresponding first processing requirement.

Images