Slab feeding determination method and device, electronic equipment and storage medium

Abstract

The invention discloses a slab feeding determination method and device, electronic equipment and a storage medium. The slab feeding determination method comprises the steps that target image data of a to-be-detected batch of slabs transported by target transportation equipment in a first target area is acquired; inputting the target image data into a trained image recognition model, and determining feature information corresponding to the batch of slabs to be detected, the feature information including label information and quantity information; based on the label information, the quantity information and a preset slab database, determining whether each slab in the to-be-detected batch of slabs exists or not and whether the label information of each slab is correct or not; if all the slabs exist and the label information of all the slabs is correct, basic attribute information corresponding to all the slabs is determined from a preset slab database. According to the invention, the problem of long time consumption of manual data recording is avoided, and the feeding efficiency and accuracy of the batch of slabs to be detected can be improved.

Description

Technical Field

[0001] The present application relates to the technical field of slab loading, and in particular to a method, device, electronic device and storage medium for determining slab loading. Background Art

[0002] At present, there are two modes for transporting continuous casting slabs across spans, namely manual operation and command operation. The manual operation process requires manual personnel to go to the site to count the number of slabs on each transport vehicle and use paper forms to record the slab numbers. After the slabs are stacked, the recorded data is sent to the main control room for manual stacking and data processing. Manual data recording here is time-consuming and inefficient, and the slab temperature at the operation site is high and the working environment is harsh, which leads to safety hazards in the operation of manual workers. The command operation relies on the management system of continuous casting slabs, which requires the offline area to achieve accurate and synchronous movement of physical objects and data throughout the process, and issue loading instructions after the physical objects and data are inspected and qualified, and then carry out corresponding loading and unloading.

[0003] However, with the increasing daily output required, the imperative over-span operation cannot meet the production demand, resulting in the storage volume in the offline area exceeding the storage capacity, which in turn leads to the inability to turn over the billet warehouse and inventory accumulation. At this time, the efficiency of the continuous casting slab warehouse loading operation is low. Summary of the invention

[0004] The embodiments of the present application provide a method, device, electronic device and storage medium for determining slab loading. The embodiments provided by the present application avoid the problem of time-consuming manual data recording, and the embodiments provided by the present application can improve the loading efficiency and accuracy of the slab batches to be inspected.

[0005] In a first aspect of the embodiments of the present application, the embodiments of the present application provide a method for determining slab loading, the method for determining slab loading comprising:

[0006] Acquire target image data of a batch of slabs to be inspected being transported by a target transport device in a first target area, wherein the first target area is used to characterize a monitoring area of ​​a target image acquisition device;

[0007] Input the target image data into a trained image recognition model to determine feature information corresponding to the batch of slabs to be detected, wherein the feature information includes label information and quantity information;

[0008] Based on the label information, the quantity information and a preset slab database, determining whether each slab in the batch of slabs to be inspected exists and whether the label information of each slab is correct;

[0009] If all slabs exist and the label information of each slab is correct, the basic attribute information corresponding to each slab is determined from the preset slab database, so that the target operation equipment in the second target area can perform loading operations based on the basic attribute information, wherein the second target area is used to characterize the area where slabs are used for loading.

[0010] In a feasible implementation manner, first image data and second image data of a target transport device transporting a batch of slabs to be inspected in a first target area are obtained, wherein the first image data is used to represent image data collected when the front of the target transport device enters the first target area, and the second image data is used to represent image data collected when the side of the target transport device enters the first target area;

[0011] Based on the first image data and the second image data, target image data of the target transportation equipment transporting the batch of slabs to be inspected in the first target area is determined.

[0012] In a feasible implementation manner, sample image data of a historical batch of slabs and labels of characteristic information of the historical slabs in each of the sample image data are obtained, wherein the labels are used to represent the real characteristic information corresponding to the historical slabs in the sample image data;

[0013] Inputting each sample image data into an initial classification recognition model to determine prediction feature information corresponding to the historical slab in each sample image data;

[0014] Based on the label and the predicted feature information, the initial classification recognition model is trained to determine a trained image recognition model.

[0015] In a feasible implementation manner, the initial classification recognition model is trained based on the label and the predicted feature information to determine the trained image recognition model, including:

[0016] When the loss value between the real feature information of the historical slab in each sample image data and the feature information of the historical slab in each sample image data is less than a preset threshold, the training is terminated and the trained image recognition model is determined.

[0017] In a feasible implementation manner, determining whether each slab in the batch of slabs to be inspected exists and whether the label information of each slab is correct based on the label information, the quantity information and a preset slab database includes:

[0018] Determining whether each slab in the batch of slabs to be detected exists according to quantity information corresponding to the batch of slabs to be detected and a preset slab database;

[0019] If so, it is determined whether the label information of each slab in the batch of slabs to be inspected is correct and / or repeated according to the label information corresponding to the batch of slabs to be inspected and a preset slab database.

[0020] In a feasible implementation manner, if each slab exists and the label information of each slab is correct, then basic attribute information corresponding to each slab is determined from a preset slab database so that the target operation equipment in the second target area performs a loading operation based on the basic attribute information, including:

[0021] If all slabs exist and the label information of all slabs is correct, then basic attribute information corresponding to each slab is determined from a preset slab database;

[0022] The initial slab information corresponding to each slab is determined according to the basic attribute information, label information and quantity information, so that the target operation equipment in the second target area can perform loading operation based on the initial slab information.

[0023] In a feasible implementation manner, determining the initial slab information corresponding to each slab according to the basic attribute information, the label information and the quantity information, so that the target operation equipment in the second target area performs the loading operation based on the initial slab information, includes:

[0024] Determine the initial slab information corresponding to each slab according to the basic attribute information, label information and quantity information;

[0025] Determine whether the initial slab information exists in a preset slab information management library;

[0026] If not, the initial slab information is determined as the target slab information corresponding to the slab, so that the target operation equipment in the second target area performs the loading operation based on the target slab information;

[0027] If so, it is determined that the initial slab information is repeated slab information.

[0028] The embodiment of the present application also includes a second aspect. The embodiment of the present application provides a device for determining slab loading, and the device for determining slab loading includes:

[0029] An acquisition module, used for acquiring target image data of a batch of slabs to be inspected being transported by a target transport device in a first target area, wherein the first target area is used for representing a monitoring area of ​​a target image acquisition device;

[0030] A first determination module is used to input the target image data into a trained image recognition model to determine feature information corresponding to the batch of slabs to be detected, wherein the feature information includes label information and quantity information;

[0031] A second determination module is used to determine whether each slab in the batch of slabs to be detected exists and whether the label information of each slab is correct based on the label information, the quantity information and a preset slab database;

[0032] The third determination module is used to determine the basic attribute information corresponding to each slab from a preset slab database if all slabs exist and the label information of each slab is correct, so that the target operation equipment in the second target area can perform loading operations based on the basic attribute information, wherein the second target area is used to characterize the area where slabs are used for loading.

[0033] The embodiment of the present application also includes a third aspect. The embodiment of the present application also provides an electronic device, including: a processor, a memory and a bus, the memory stores machine-readable instructions executable by the processor, when the electronic device is running, the processor and the memory communicate through the bus, and the machine-readable instructions are executed by the processor when running, such as the steps of the above-mentioned method for determining slab loading.

[0034] The embodiment of the present application also includes a fourth aspect. The embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is run by a processor, the steps of the method for determining slab loading as described above are executed.

[0035] The method, device, electronic device and storage medium for determining slab loading provided in the embodiments of the present application, compared with the prior art, the embodiments provided in the present application obtain target image data of the target transportation equipment in the first target area transporting the batch of slabs to be detected, and input the target image data into the trained image recognition model to determine the feature information corresponding to the batch of slabs to be detected, and then determine whether each slab in the batch of slabs to be detected exists and whether the label information of each slab is correct based on the label information, quantity information and a preset slab database, and when each slab exists and the label information of each slab is correct, determine the basic attribute information corresponding to each slab from the preset slab database, so that the target operation equipment in the second target area can perform loading operations based on the basic attribute information, avoiding the problem of time-consuming manual data recording, and the embodiments provided in the present application can improve the loading efficiency and accuracy of the batch of slabs to be detected.

[0036] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, preferred embodiments are specifically cited below and described in detail with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0038] Figure 1 A flowchart of a method for determining slab loading provided in an embodiment of the present application is shown;

[0039] Figure 2 A flowchart of an embodiment of a method for determining slab loading provided by an embodiment of the present application is shown;

[0040] Figure 3 A structural block diagram of a slab feeding system provided in an embodiment of the present application is shown;

[0041] Figure 4 A structural block diagram of a device for determining slab loading provided in an embodiment of the present application is shown;

[0042] Figure 5 A schematic structural diagram of an electronic device provided in an embodiment of the present application is shown.

[0043] Figure 4 and Figure 5 The corresponding relationship between the reference numerals and the names of the drawings is as follows:

[0044] 400 slab loading determination device; 410 acquisition module; 420 first determination module; 430 second determination module; 440 third determination module; 500 electronic device; 510 processor; 520 memory; 530 bus. DETAILED DESCRIPTION

[0045] In order to better understand the technical solutions provided by the embodiments of this specification, the technical solutions of the embodiments of this specification are described in detail below through the accompanying drawings and specific embodiments. It should be understood that the embodiments of this specification and the specific features in the embodiments are detailed descriptions of the technical solutions of the embodiments of this specification, rather than limitations on the technical solutions of this specification. In the absence of conflict, the embodiments of this specification and the technical features in the embodiments can be combined with each other.

[0046] In this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply that there is any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that the process, method, article or equipment including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or equipment. In the absence of more restrictions, the elements limited by the statement "comprise one..." do not exclude the existence of other identical elements in the process, method, article or equipment including the elements. The term "more than two" includes two or more than two situations.

[0047] First, the applicable application scenarios of the present application are introduced. In the case of an increasing daily output required, the imperative over-span operation provided by the embodiment of the present application cannot meet the production demand, resulting in the storage volume in the offline area exceeding the storage capacity, which in turn leads to the situation that the billet warehouse cannot be turned over and the inventory is piled up. At this time, the efficiency of the loading operation of the continuous casting slab warehouse is low.

[0048] Based on this, the embodiments of the present application provide a method, device, electronic device and storage medium for determining slab loading. The embodiments provided by the present application avoid the time-consuming problem of manual data recording, and the embodiments provided by the present application can improve the loading efficiency and accuracy of the slab batches to be inspected.

[0049] See also Figure 1 , Figure 1 This is a flowchart of a method for determining slab loading provided in an embodiment of the present application. Figure 1 As shown in , the method for determining slab loading provided in the embodiment of the present application includes the following steps:

[0050] S101. Acquire target image data of a batch of slabs to be inspected being transported by a target transport device in a first target area, wherein the first target area is used to represent a monitoring area of ​​a target image acquisition device.

[0051] In this step, in the embodiment provided by the present application, a corresponding acquisition device is installed in the unloading area to acquire target image data of the batch of slabs to be inspected being transported by the target transportation equipment in the first target area.

[0052] It can be understood that the target image acquisition device in the embodiments provided in the present application may specifically but not limited to include an industrial camera and a distance sensor.

[0053] Among them, the embodiment provided in this application can also use a fill light to fill in the light for an industrial camera, and the basic parameters are as follows: the adjustable exposure intensity is specifically: 300W, 120J, but is not limited to the above configuration.

[0054] Among them, the basic parameters of the industrial camera can be specifically set to: 800W pixels, global shutter, black and white, Gigabit Ethernet interface, area array camera, resolution 4096*2160, DC12V, but not limited to the above configurations.

[0055] Among them, the distance sensor is used to determine the position of the cross-car, and the basic parameters of the distance sensor are as follows: laser TOF sensor, 0-5000mm and red light, but not limited to the above configurations.

[0056] S102, inputting the target image data into the trained image recognition model to determine the feature information corresponding to the batch of slabs to be detected, wherein the feature information includes label information and quantity information.

[0057] In this step, after the target image data of the batch of slabs to be inspected is collected, the target image data needs to be input into the trained image recognition model to determine the feature information corresponding to the batch of slabs to be inspected. Here, the feature information corresponding to the batch of slabs to be inspected includes many types of features, but the main feature information to be used in the embodiments provided in the present application is specifically label information and quantity information.

[0058] It can be understood that the trained image recognition model in the embodiments provided in the present application is obtained by training based on a large amount of sample feature data.

[0059] In this way, the embodiment provided by the present application uses a trained image recognition model to identify label information in the target image data, thereby avoiding the occurrence of errors and deviations in manual identification and observation by operators, and greatly improving the accuracy of image recognition.

[0060] S103 , based on the label information, quantity information and a preset slab database, determine whether each slab in the batch of slabs to be inspected exists and whether the label information of each slab is correct.

[0061] In this step, in the embodiment provided by the present application, after determining the label information corresponding to the batch of slabs to be inspected, the label information is compared with the preset slab database to determine whether the preset slab database records all the label information of the batch of slabs to be inspected, so as to judge whether the preset slab database records all the batch of slabs to be inspected.

[0062] It can be understood that the preset slab database in the embodiment provided in the present application can be specifically but not limited to the use of a (Manufacturing Execution System, MES) manufacturing system. Here, the MES manufacturing system is used to query the relevant information of the batch of slabs to be inspected, and when the query is obtained, the corresponding relevant information will be sent to the server for storage.

[0063] S104. If all slabs exist and the label information of all slabs is correct, the basic attribute information corresponding to each slab is determined from the preset slab database so that the target operation equipment in the second target area can perform loading operations based on the basic attribute information, wherein the second target area is used to characterize the area where the slabs are used for loading.

[0064] In this step, after determining that each slab exists in the preset slab database and the label information of each slab is correct, the basic attribute information corresponding to each slab is determined from the preset slab database, and all the corresponding basic attribute information is sent to the target operation equipment in the loading area through a dedicated communication transmission method. In this way, the target operation equipment in the second target area representing the loading area can perform loading operations according to the corresponding basic attribute information.

[0065] It can be understood that the target operating equipment in the embodiments provided in the present application can be customized according to different application scenarios. It is assumed that the target operating equipment in the embodiments provided in the present application can be specifically set as an overhead crane.

[0066] Among them, it is assumed that the communication transmission method used in the embodiment provided by the present application can be specifically a ground communication station for the slab warehouse. Here, it means that after receiving the basic attribute information, the ground communication station for the slab warehouse sends the corresponding basic attribute information to the external slab warehouse management system. At this time, the external slab warehouse management system determines whether there are any errors in all the basic attribute information. If it is determined that all are correct, the operation instructions containing the above basic attribute information are sent to the target operation equipment in the second target area through the ground communication station for the slab warehouse, so that the target operation equipment can perform loading operations according to the corresponding basic attribute information, thereby improving the overall operation production efficiency of the slab.

[0067] In one embodiment, obtaining target image data of a target transport device transporting a batch of slabs to be inspected in a first target area includes the following sub-steps:

[0068] Sub-step 1011, obtaining first image data and second image data of the target transport equipment transporting the batch of slabs to be inspected in the first target area, wherein the first image data is used to represent the image data collected when the front of the target transport equipment enters the first target area, and the second image data is used to represent the image data collected when the side of the target transport equipment enters the first target area.

[0069] In this step, when the target transport equipment drags the batch of slabs to be inspected into the first target area, the transport speed of the target transport equipment is different in different situations, which may result in unclear images if only image data from one angle is acquired. Therefore, the embodiment provided in the present application uses an on-site industrial camera to acquire image data from two angles (first image data and second image data), and confirms the information of the image data from these two angles, so as to more accurately determine the image information of the batch of slabs to be inspected.

[0070] It can be understood that, assuming that the industrial camera in the embodiment provided by the present application is installed in the middle of the span between the loading area and the unloading area, the industrial camera is always in a waiting state when the batch of slabs to be inspected enters the span car from the unloading area and is transported to the loading area. When the span car enters the shooting range of the industrial camera, the first distance sensor is triggered. At this time, when the front of the batch of plates to be inspected on the span car passes the camera, the front is photographed by the industrial camera. After the front industrial camera finishes taking the photo, the second distance sensor is triggered. At this time, when the side of the batch of plates to be inspected on the span car passes the camera, the side is photographed by the industrial camera. That is to say, when the span car in the embodiment provided by the present application passes the first target area monitored by the industrial camera, it will be photographed twice (not limited to twice).

[0071] Here, it is assumed that the target transportation equipment (industrial camera) used in the embodiments provided in this application is specifically a Hikvision industrial camera.

[0072] Sub-step 1012: determining target image data of the target transportation equipment transporting the batch of slabs to be inspected in the first target area based on the first image data and the second image data.

[0073] This step assumes that after the embodiment provided in the present application determines the first image data collected when entering the first target area from the front and the second image data collected when entering the second target area from the side, the first image data and the second image data are fused to generate target image data of the target transport equipment transporting the batch of slabs to be inspected.

[0074] In one embodiment, the embodiment provided by the present application is to determine the trained image recognition model in the following manner, including the following sub-steps:

[0075] Sub-step 1: obtaining sample image data of historical batches of slabs and labels of feature information of historical slabs in each sample image data, wherein the labels are used to characterize the real feature information corresponding to the historical slabs in the sample image data.

[0076] In this step, the sample image data of the historical batch of slabs is used to represent the sample image data collected by the on-site industrial camera when the historical batch of slabs transported by the straddle carrier passed through the first target area in the historical operation task.

[0077] Sub-step 2: input each sample image data into the initial classification recognition model to determine the prediction feature information corresponding to the historical slab in each sample image data.

[0078] In this step, the initial classification recognition model in the embodiment provided in the present application is based on a relatively mature machine vision recognition model currently available on the market, specifically but not limited to a neural network model or a convolutional network model.

[0079] Sub-step 3: Based on the labels and predicted feature information, the initial classification recognition model is trained to determine the trained image recognition model.

[0080] In this step, the embodiment provided by the present application first determines the loss value between the real feature information of the historical slab in each sample image data and the feature information of the historical slab in each sample image data, and when the loss value is less than a preset threshold, determines the training cutoff, and then determines the trained image recognition model.

[0081] It can be understood that in the embodiments provided in the present application, some slab number rules can be added through lambda expressions to improve the accuracy of the slab number (label information).

[0082] In one embodiment, based on the label information, the quantity information and the preset slab database, determining whether each slab in the batch of slabs to be inspected exists and whether the label information of each slab is correct includes the following sub-steps:

[0083] Sub-step 1031 : determining whether each slab in the batch of slabs to be inspected exists according to the quantity information corresponding to the batch of slabs to be inspected and a preset slab database.

[0084] In this step, after the characteristic information of the batch of slabs to be inspected is identified, the label information in the characteristic information is compared with the data in the preset slab database to determine whether each slab in the batch of slabs to be inspected exists in the preset slab database.

[0085] Sub-step 1032: if so, determining whether the label information of each slab in the batch of slabs to be inspected is correct and / or repeated according to the label information corresponding to the batch of slabs to be inspected and the preset slab database.

[0086] In this step, if each slab in the batch of slabs to be inspected exists in the preset slab database, it is determined whether the label information of each slab in the batch of slabs to be inspected is unique, and it is necessary to determine whether the label information is repeated or missing.

[0087] It can be understood that the embodiment provided by the present application can display the identification results in a web interface. If there is duplication of label information (slab number), the storage operator will restrict the web interface and the submission of the web interface will fail. If the slab number cannot be found in the third-level query, the query result will also fail. At this time, it is necessary to modify the label information according to the prompts for query.

[0088] In one embodiment, if all slabs exist and the label information of all slabs is correct, basic attribute information corresponding to each slab is determined from a preset slab database so that the target operation equipment in the second target area performs a loading operation based on the basic attribute information, including the following sub-steps:

[0089] Sub-step 1041 : if all slabs exist and the label information of all slabs is correct, then determine the basic attribute information corresponding to each slab from a preset slab database.

[0090] In this step, when determining the label information of each slab in the preset slab database, the basic attribute information corresponding to each slab corresponding to the label information in the preset slab database is selected.

[0091] Sub-step 1042: Determine the initial slab information corresponding to each slab based on the basic attribute information, label information and quantity information, so that the target operation equipment in the second target area can perform loading operations based on the initial slab information.

[0092] In this step, the initial slab information that needs to be sent to the external slab warehouse management system is determined based on the above-selected attribute information, label information and quantity information.

[0093] Here, the initial slab information is information sent to the external slab warehouse management system and is not compared with the data of the external slab warehouse management system itself.

[0094] In one embodiment, the initial slab information corresponding to each slab is determined according to the basic attribute information, the label information and the quantity information, so that the target operation equipment in the second target area performs the loading operation based on the initial slab information, including the following sub-steps:

[0095] Sub-step 1: Determine the initial slab information corresponding to each slab according to the basic attribute information, label information and quantity information.

[0096] Sub-step 2: determine whether the initial slab information exists in the preset slab information management library.

[0097] In this step, the preset slab information management library can be specifically but not limited to being installed in an external slab library management system. At this time, after the external slab library management system receives the initial slab information, it is necessary to determine whether the initial slab information exists.

[0098] Sub-step 3: If it does not exist, the initial slab information is determined as the target slab information corresponding to the slab, so that the target operation equipment in the second target area performs the loading operation based on the target slab information.

[0099] In this step, if the initial slab information does not exist in the preset slab information management library, it means that the initial slab information is the data corresponding to the new slab. At this time, the initial slab information is determined as the target slab information corresponding to the slab, and the information is transported to the second target area through the straddle vehicle, so that the target operation equipment can perform loading operations based on the above target slab information.

[0100] Sub-step 4: If it exists, determine that the initial slab information is duplicate slab information.

[0101] In this step, if the initial slab information exists in the preset slab information management library, it means that the initial slab information is the data corresponding to the repeated slab. At this time, the repeated initial slab information needs to be annotated and an alarm reminder is issued.

[0102] See also Figure 2 , Figure 2 This is a flowchart of an embodiment of a method for determining slab loading provided in an embodiment of the present application. Figure 2 As shown in the embodiment of the present application, a process of loading a slab is specifically described through an embodiment:

[0103] Step 1: First, the industrial camera in the embodiment provided in the present application takes photos of the batch of slabs to be inspected on the straddle carrier.

[0104] Step 2: Store the photos in the server of the slab photo verification device.

[0105] Step 3: Use the trained image recognition model to identify the photo and determine the slab number of the batch of slabs to be tested.

[0106] Step 4: The slab checking device stores the identified slab number in a local database, and the operator reconfirms the identified slab number.

[0107] Step 5: After confirmation, the identified slab number is sent to the manufacturing MES device, and the preset slab database in the manufacturing MES device queries the identified slab number.

[0108] Step 6. When queried, the manufacturing MES equipment will feed back the basic attribute information of each slab corresponding to the slab number to the slab verification equipment (in this process, if the slab number queried by the manufacturing MES equipment is incorrect, the three-level query will be used to query and modify the basic attribute information of each slab, and the structure will be saved in the database).

[0109] Step 7: The slab inspection equipment sends the basic property information of each slab to the slab warehouse ground station equipment for communication.

[0110] Step 8: The slab warehouse ground station equipment forwards the basic attribute information of each slab to the slab warehouse management equipment.

[0111] See also Figure 3 , Figure 3 A structural block diagram of a slab feeding system provided in an embodiment of the present application is shown in FIG. Figure 3 As shown in , the slab feeding system will be controlled by applying the slab feeding determination method, such as Figure 3 As shown, the slab feeding system includes slab inspection equipment, slab warehouse management equipment, slab warehouse ground station equipment, manufacturing MES equipment, and overhead crane PLC control equipment.

[0112] In the above, the slab inspection equipment is directly connected to the slab warehouse ground station equipment and MES manufacturing equipment respectively. The slab warehouse management equipment is connected to the slab warehouse ground station equipment. The slab warehouse management equipment is connected to the overhead crane PLC control equipment, and the overhead crane PLC control equipment controls the overhead crane to perform overhead crane operations on the slabs.

[0113] In the above part, the above-mentioned blank viewing and verification equipment provided in the embodiment of the present application is used to identify and verify the blank number of the batch of blanks to be inspected. The above-mentioned blank viewing and verification equipment triggers the industrial camera to take images through a laser sensor (the timing of the laser sensor triggering the industrial camera to take pictures is executed by the controller in the control box), and the background detects the number of blanks in the target image data and identifies the blank number. The above-mentioned blank viewing and verification equipment displays the captured image and recognition result on the browser through the B / S mode. The operator of the above-mentioned blank viewing and verification equipment can manually modify the slab recognition result and submit it to the MES manufacturing equipment after confirmation. The above-mentioned slab viewing and verification equipment sends it to the MES equipment to query the slab information and receives the returned query result (if an error occurs, a reminder can be issued and modified by the operator). The above-mentioned slab viewing and verification equipment sends the query result to the slab warehouse management equipment through the slab warehouse ground station equipment. The slab warehouse management equipment produces the overhead crane operation instruction, and the overhead crane executes the instructed operation.

[0114] In this way, when the label information received by the slab warehouse management equipment is a duplicate slab, an exception will be sent to prompt that the slab to be inspected has been put into the warehouse, and the slab to be inspected will be marked as an abnormal state. Manual verification is required to verify why the slab has duplicate label information to ensure the uniqueness of the slab that has been put into the warehouse.

[0115] Here, the slab scanning and verification equipment server and the photographing equipment in the embodiment provided in this application are core equipment.

[0116] The slab inspection equipment includes a controller, a server, a sensor, a camera, a client general device or a field compatible device, wherein the controller is used for camera triggering, and the basic parameters are as follows: TCP / IP protocol, 4DI and 4DO, but not limited to the above configurations.

[0117] Among them, the server is used for graphics processing, and the basic parameters are as follows: CPUI7, graphics card RTX3080, 32G memory, 512GSSD, 2T mechanical hard disk and PCIE4-port Gigabit network card*2, etc., but not limited to the above configurations.

[0118] Among them, client universal devices or field compatible devices can log in to the web interface to perform basic operations.

[0119] It can be understood that the manufacturing MES equipment is used to establish communication with the slab inspection equipment. The basic parameters are as follows: TCPIP protocol, or message queue, or table to table, but not limited to the above protocols. The manufacturing MES equipment is used to meet the basic slab information required for overhead crane operation, and when the slab inspection equipment sends a message query request, the MES manufacturing equipment must promptly inform the slab inspection equipment of the query results.

[0120] It can be understood that the slab warehouse management equipment is used for the scheduling and management of slabs in the slab warehouse, and for managing all operations in the slab warehouse. Specifically, when receiving the basic information of the slabs passing through the car from the slab checking equipment, the slab warehouse management equipment generates an operation instruction, and sends it to the overhead crane PLC control equipment through the slab warehouse ground station equipment. When the overhead crane receives the operation instruction, it performs the overhead crane operation, sends the actual lifting data to the slab warehouse ground station equipment when lifting, and sends the actual lifting performance to the slab warehouse ground station equipment when lowering. The slab warehouse ground station equipment forwards this information to the slab warehouse management equipment in real time to complete each overhead crane operation.

[0121] This device does not communicate directly with external devices. The copper whiskers of this device and external devices need to rely on the billet warehouse ground station device to communicate directly. The basic parameters are as follows: The communication protocol uses TCPIP protocol, message queue, or table to table, but is not limited to the above content and protocols.

[0122] Among them, the basic parameters of the blank warehouse ground station equipment are as follows: the communication protocol can adopt TCPIP protocol, message queue, or table to table, but is not limited to the above content and protocol.

[0123] The method for determining slab loading provided in the embodiment of the present application, compared with the prior art, obtains target image data of the target transportation equipment in the first target area transporting the batch of slabs to be detected, and inputs the target image data into the trained image recognition model to determine the feature information corresponding to the batch of slabs to be detected, and then determines whether each slab in the batch of slabs to be detected exists and whether the label information of each slab is correct based on the label information, quantity information and the preset slab database, and when each slab exists and the label information of each slab is correct, determines the basic attribute information corresponding to each slab from the preset slab database, so that the target operation equipment in the second target area can perform loading operations based on the basic attribute information, avoiding the problem of time-consuming manual data recording, and the embodiment provided by the present application can improve the loading efficiency and accuracy of the batch of slabs to be detected.

[0124] See also Figure 4 , Figure 4 This is a structural block diagram of a device for determining slab loading provided in an embodiment of the present application. Figure 4 As shown in the figure, the slab loading determination device 400 provided in the embodiment of the present application includes:

[0125] The acquisition module 410 is used to acquire target image data of a target transportation device transporting a batch of slabs to be inspected in a first target area, wherein the first target area is used to represent a monitoring area of ​​a target image acquisition device.

[0126] In one embodiment, the acquisition module 410 is specifically configured to:

[0127] Acquire first image data and second image data of a batch of slabs to be inspected being transported by a target transport equipment in a first target area, wherein the first image data is used to represent image data collected when the front of the target transport equipment enters the first target area, and the second image data is used to represent image data collected when the side of the target transport equipment enters the first target area.

[0128] Based on the first image data and the second image data, target image data of a target transportation device transporting a batch of slabs to be inspected in the first target area is determined.

[0129] The first determination module 420 is used to input the target image data into the trained image recognition model to determine the feature information corresponding to the batch of slabs to be detected, wherein the feature information includes label information and quantity information.

[0130] In one embodiment, the trained image recognition model is determined in the following manner, including:

[0131] Sample image data of historical batches of slabs and labels of feature information of historical slabs in each sample image data are obtained, wherein the labels are used to characterize real feature information corresponding to the historical slabs in the sample image data.

[0132] Each sample image data is input into the initial classification recognition model to determine the prediction feature information corresponding to the historical slab in each sample image data.

[0133] Based on the label and predicted feature information, the initial classification recognition model is trained to determine the trained image recognition model.

[0134] In one embodiment, based on the label and the predicted feature information, the initial classification recognition model is trained to determine the trained image recognition model, including:

[0135] When the loss value between the real feature information of the historical slab in each sample image data and the feature information of the historical slab in each sample image data is less than a preset threshold, the training is terminated and the trained image recognition model is determined.

[0136] The second determination module 430 is used to determine whether each slab in the batch of slabs to be inspected exists and whether the label information of each slab is correct based on the label information, the quantity information and a preset slab database.

[0137] In one embodiment, the second determining module 430 is specifically configured to:

[0138] According to the quantity information corresponding to the batch of slabs to be inspected and a preset slab database, it is determined whether each slab in the batch of slabs to be inspected exists.

[0139] If so, it is determined whether the label information of each slab in the batch of slabs to be inspected is correct and / or repeated according to the label information corresponding to the batch of slabs to be inspected and a preset slab database.

[0140] The third determination module 440 is used to determine the basic attribute information corresponding to each slab from a preset slab database if all slabs exist and the label information of each slab is correct, so that the target operation equipment in the second target area can perform loading operations based on the basic attribute information, wherein the second target area is used to characterize the area where slabs are used for loading.

[0141] In one embodiment, the third determination module 440 is specifically configured to:

[0142] If all slabs exist and the label information of all slabs is correct, the basic attribute information corresponding to each slab is determined from the preset slab database.

[0143] The initial slab information corresponding to each slab is determined according to the basic attribute information, label information and quantity information, so that the target operation equipment in the second target area can perform loading operations based on the initial slab information.

[0144] In one embodiment, determining initial slab information corresponding to each slab based on basic attribute information, label information, and quantity information so that a target operation device in a second target area performs a loading operation based on the initial slab information includes:

[0145] The initial slab information corresponding to each slab is determined according to the basic attribute information, label information and quantity information.

[0146] Determine whether the initial slab information exists in the preset slab information management library.

[0147] If not, the initial slab information is determined as the target slab information corresponding to the slab, so that the target operation equipment in the second target area performs the loading operation based on the target slab information.

[0148] If it exists, it is determined that the initial slab information is duplicate slab information.

[0149] The device for determining slab loading provided in the embodiment of the present application, compared with the prior art, obtains target image data of the target transportation equipment in the first target area transporting the batch of slabs to be detected, and inputs the target image data into the trained image recognition model to determine the feature information corresponding to the batch of slabs to be detected, and then determines whether each slab in the batch of slabs to be detected exists and whether the label information of each slab is correct based on the label information, quantity information and the preset slab database, and when each slab exists and the label information of each slab is correct, determines the basic attribute information corresponding to each slab from the preset slab database, so that the target operation equipment in the second target area can perform loading operations based on the basic attribute information, avoiding the problem of time-consuming manual data recording, and the embodiment provided by the present application can improve the loading efficiency and accuracy of the batch of slabs to be detected.

[0150] See also Figure 5 , Figure 5 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Figure 5 As shown in , the electronic device 500 includes a processor 510 , a memory 520 , and a bus 530 .

[0151] The memory 520 stores machine-readable instructions executable by the processor 510. When the electronic device 500 is running, the processor 510 communicates with the memory 520 via the bus 530. When the machine-readable instructions are executed by the processor 510, the above-mentioned Figure 1 to Figure 2 The steps of the method for determining slab loading in the method embodiment shown in the figure, and the specific implementation method thereof can be referred to the method embodiment, which will not be described in detail here.

[0152] The present application also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the computer program can execute the above-mentioned Figure 1 to Figure 2 The steps of the method for determining slab loading in the method embodiment shown in the figure, and the specific implementation method thereof can be referred to the method embodiment, which will not be described in detail here.

[0153] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0154] It should be noted that in the above embodiments, the description of each embodiment has its own emphasis, and for parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0155] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-readable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-readable program code.

[0156] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded computer, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0157] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0158] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0159] An embodiment of the present application also provides a computer program product, which includes computer software instructions. When the computer software instructions are executed on a processing device, the processing device executes the process of the LDPC decoding method of the solid-state hard disk controller.

[0160] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, a computer, a server or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (digital subscriber line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium can be any available medium that a computer can store or a data storage device such as a server or a data center that includes one or more available media integration. The available medium can be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid state drive (SSD)), etc.

[0161] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0162] In the several embodiments provided in the present application, it should be understood that the disclosed devices, apparatuses and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0163] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0164] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0165] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), disk or optical disk and other media that can store program codes.

[0166] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

[0167] Although the preferred embodiments of this specification have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of this specification.

[0168] Obviously, those skilled in the art can make various changes and modifications to this specification without departing from the spirit and scope of this specification. Thus, if these modifications and variations of this specification fall within the scope of the claims of this specification and their equivalents, this specification is also intended to include these modifications and variations.

Claims

1. A method for determining slab loading, characterized in that: The method for determining slab loading comprises: Acquire target image data of a batch of slabs to be inspected being transported by a target transport device in a first target area, wherein the first target area is used to characterize a monitoring area of ​​a target image acquisition device; Input the target image data into a trained image recognition model to determine feature information corresponding to the batch of slabs to be detected, wherein the feature information includes label information and quantity information; Based on the label information, the quantity information and a preset slab database, determining whether each slab in the batch of slabs to be inspected exists and whether the label information of each slab is correct; If all slabs exist and the label information of each slab is correct, the basic attribute information corresponding to each slab is determined from the preset slab database, so that the target operation equipment in the second target area can perform loading operations based on the basic attribute information, wherein the second target area is used to characterize the area where slabs are used for loading.

2. The method for determining slab loading according to claim 1, characterized in that: The step of obtaining target image data of a batch of slabs to be inspected being transported by a target transport device in a first target area comprises: Acquire first image data and second image data of a target transport device transporting a batch of slabs to be inspected in a first target area, wherein the first image data is used to represent image data collected when the front of the target transport device enters the first target area, and the second image data is used to represent image data collected when the side of the target transport device enters the first target area; Based on the first image data and the second image data, target image data of the target transportation equipment transporting the batch of slabs to be inspected in the first target area is determined.

3. The method for determining slab loading according to claim 1, characterized in that: The trained image recognition model is determined by: Acquire sample image data of a historical batch of slabs and labels of feature information of the historical slabs in each of the sample image data, wherein the labels are used to represent real feature information corresponding to the historical slabs in the sample image data; Inputting each sample image data into an initial classification recognition model to determine prediction feature information corresponding to the historical slab in each sample image data; Based on the label and the predicted feature information, the initial classification recognition model is trained to determine a trained image recognition model.

4. The method for determining slab loading according to claim 3, characterized in that: The step of training the initial classification recognition model based on the label and the predicted feature information to determine a trained image recognition model includes: When the loss value between the real feature information of the historical slab in each sample image data and the feature information of the historical slab in each sample image data is less than a preset threshold, the training is terminated and the trained image recognition model is determined.

5. The method for determining slab loading according to claim 1, characterized in that: The determining, based on the label information, the quantity information and a preset slab database, whether each slab in the batch of slabs to be inspected exists and whether the label information of each slab is correct comprises: Determining whether each slab in the batch of slabs to be detected exists according to quantity information corresponding to the batch of slabs to be detected and a preset slab database; If so, it is determined whether the label information of each slab in the batch of slabs to be inspected is correct and / or repeated according to the label information corresponding to the batch of slabs to be inspected and a preset slab database.

6. The method for determining slab loading according to claim 1, characterized in that: If all slabs exist and the label information of all slabs is correct, basic attribute information corresponding to each slab is determined from a preset slab database so that the target operation equipment in the second target area performs a loading operation based on the basic attribute information, including: If all slabs exist and the label information of all slabs is correct, then basic attribute information corresponding to each slab is determined from a preset slab database; The initial slab information corresponding to each slab is determined according to the basic attribute information, label information and quantity information, so that the target operation equipment in the second target area can perform loading operation based on the initial slab information.

7. The method for determining slab loading according to claim 6, characterized in that: The determining of initial slab information corresponding to each slab according to the basic attribute information, the label information and the quantity information so that the target operation equipment in the second target area performs a loading operation based on the initial slab information includes: Determine the initial slab information corresponding to each slab according to the basic attribute information, label information and quantity information; Determining whether the initial slab information exists in a preset slab information management library; If not, the initial slab information is determined as the target slab information corresponding to the slab, so that the target operation equipment in the second target area performs the loading operation based on the target slab information; If so, it is determined that the initial slab information is repeated slab information.

8. A device for determining slab loading, characterized in that: The device for determining slab loading comprises: An acquisition module, used for acquiring target image data of a batch of slabs to be inspected being transported by a target transport device in a first target area, wherein the first target area is used for representing a monitoring area of ​​a target image acquisition device; A first determination module is used to input the target image data into a trained image recognition model to determine feature information corresponding to the batch of slabs to be detected, wherein the feature information includes label information and quantity information; A second determination module is used to determine whether each slab in the batch of slabs to be detected exists and whether the label information of each slab is correct based on the label information, the quantity information and a preset slab database; The third determination module is used to determine the basic attribute information corresponding to each slab from a preset slab database if all slabs exist and the label information of each slab is correct, so that the target operation equipment in the second target area can perform loading operations based on the basic attribute information, wherein the second target area is used to characterize the area where slabs are used for loading.

9. An electronic device, characterized in that: include: A processor, a memory and a bus, wherein the memory stores machine-readable instructions executable by the processor, and when the electronic device is running, the processor and the memory communicate via the bus, and the machine-readable instructions are executed by the processor to perform the steps of the method for determining slab loading as described in any one of claims 1-7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the method for determining slab loading as described in any one of claims 1 to 7 are executed.

Images