Steel coil label automatic reading method, system, equipment and program product

Abstract

The invention belongs to the technical field of label collection, and particularly discloses an automatic reading method, system and device for steel coil labels and a program product. Two-dimensional coordinates of all steel coils in a loading and unloading area are determined by collecting a monitoring image of a top visual angle of the loading and unloading area; then, a corresponding loading and unloading area side face monitoring camera is matched for each steel coil to carry out steel coil side face image collection so as to detect and determine a steel coil side face area and a label image area position in the steel coil side face area, and then the side face monitoring camera is adjusted according to the label image area position to collect label images in a targeted mode to carry out target detection; and finally, the label image is extracted for code scanning recognition, label reading information of the corresponding steel coil is obtained, and automatic steel coil label reading can be achieved. According to the invention, unmanned label reading of the warehouse-in and warehouse-out steel coil can be realized by using the monitoring camera, and the efficiency of reading the label of the warehouse-in and warehouse-out steel coil is improved.

Description

Technical Field

[0001] The present invention belongs to the technical field of label acquisition, and particularly relates to an automatic steel coil label reading method, system, device and program product. Background Art

[0002] In an intelligent steel coil warehouse, based on management requirements, it is necessary to read the label information (i.e., barcode or two-dimensional code data) of all steel coils on the transport vehicle when the steel coils are warehoused and out of the warehouse, and transmit the label information of the steel coils to the upper information system. The traditional method for reading steel coil labels is to manually use a scanning device (such as a handheld device with decoding function) for scanning, or use a fixed scanning device to read at a fixed position; the manual scanning method cannot meet the requirements of unmanned operation in the warehouse, and has high labor costs and low efficiency; while for the fixed scanning method, due to the parking accuracy of the steel coil transport vehicle in the loading and unloading area, the positions of the steel coils and the labels on the sides of the steel coils are not fixed, and the fixed scanning device often cannot effectively scan and read the steel coil label information due to misalignment, making it difficult to meet the actual demand for automatic steel coil label reading. Summary of the Invention

[0003] The purpose of the present invention is to provide an automatic steel coil label reading method, system, device and program product to solve the above problems existing in the prior art.

[0004] To achieve the above purpose, the present invention adopts the following technical solutions: In the first aspect, an automatic steel coil label reading method is provided, including: Obtaining a monitoring image of the loading and unloading area collected by a monitoring camera at the top of the loading and unloading area, where the monitoring image of the loading and unloading area contains several steel coils; Performing first target detection on the monitoring image of the loading and unloading area to determine each steel coil in the monitoring image of the loading and unloading area and the two-dimensional coordinates of the top surface corresponding to each steel coil; Matching the side monitoring cameras corresponding to each steel coil according to the two-dimensional coordinates of the top surface corresponding to each steel coil, and determining the first shooting azimuth adjustment information of the side monitoring camera matched by each steel coil according to the two-dimensional coordinates of the top surface corresponding to each steel coil and the two-dimensional coordinates of the side surface of the matched side monitoring camera; Sending the first shooting azimuth adjustment information to the corresponding side monitoring camera, so that the corresponding side monitoring camera adjusts the shooting azimuth according to the first shooting azimuth adjustment information, shoots the side of the corresponding steel coil to obtain a side shooting image, and obtains the side shooting image fed back by the corresponding side monitoring camera; Performing second target detection on the side shooting image to determine the steel coil side area in the side shooting image, and judging whether the area ratio of the steel coil side area in the side shooting image exceeds a first ratio threshold; When it is determined that the area ratio of the side area of the steel coil in the side captured image exceeds the first ratio threshold, perform third target detection on the side area of the steel coil to determine the first label image area in the side area of the steel coil and the image coordinate information of the first label image area in the side captured image; Generate second shooting azimuth adjustment information according to the image coordinate information, and send the second shooting azimuth adjustment information to the corresponding side monitoring camera, so that the corresponding side monitoring camera adjusts the shooting azimuth according to the second shooting azimuth adjustment information, shoots the label on the corresponding side of the steel coil, obtains the label captured image, and obtains the label captured image fed back by the corresponding side monitoring camera; Perform third target detection on the label captured image to determine the second label image area in the label captured image, and determine whether the area ratio of the second label image area in the label captured image exceeds the second ratio threshold; When it is determined that the area ratio of the second label image area in the label captured image exceeds the second ratio threshold, extract the second label image area and perform code scanning recognition on the second label image area to obtain the label reading information of the corresponding steel coil.

[0005] In a possible design, the method further includes: summarizing the label reading information corresponding to each steel coil and uploading it to the management system.

[0006] In a possible design, the matching of the side monitoring cameras corresponding to each steel coil according to the top surface two-dimensional coordinates of each steel coil, and determining the shooting azimuth adjustment information of the side monitoring cameras matched by each steel coil according to the top surface two-dimensional coordinates of each steel coil and the side two-dimensional coordinates of the side monitoring cameras matched by them includes: Determine the first coordinate position of each steel coil in the reference direction of the loading and unloading area according to the top surface two-dimensional coordinates of each steel coil, and determine the second coordinate position of each side monitoring camera in the reference direction of the loading and unloading area according to the side two-dimensional coordinates of each side monitoring camera; Determine the second coordinate position closest to the first coordinate position of the corresponding steel coil in the reference direction of the loading and unloading area, and use the side monitoring camera corresponding to the second coordinate position closest to the first coordinate position of the corresponding steel coil as the side monitoring camera matched by the corresponding steel coil; Determine the azimuth difference according to the first coordinate position of the steel coil in the reference direction of the loading and unloading area and the second coordinate position of the side monitoring camera matched by it in the reference direction of the loading and unloading area, and generate the shooting azimuth adjustment information of the side monitoring camera matched by the corresponding steel coil according to the azimuth difference.

[0007] In a possible design, before performing the second target detection on the side captured image, the method further includes: A. Determine the first center point of the side-shot image, and the first center coordinates of the first center point in the side-shot image, and determine the second center point of the side area of the steel coil, and the second center coordinates of the second center point in the side-shot image; B. When it is determined that the second center point is not within the first error range around the first center point according to the first center coordinates and the second center coordinates, generate first azimuth fine-tuning information according to the first center coordinates and the second center coordinates; C. Send the first azimuth fine-tuning information to the corresponding side monitoring camera, so that the corresponding side monitoring camera adjusts the shooting azimuth according to the first azimuth fine-tuning information, re-shoots the side of the corresponding steel coil, and obtains a new side-shot image; Repeat the above steps A-C using the new side-shot image until the second center point is within the first error range around the first center point, and obtain the adjusted side-shot image.

[0008] In a possible design, when it is determined that the area ratio of the side area of the steel coil in the side-shot image does not exceed the first ratio threshold, the method further includes: Generate first zoom information according to the area ratio of the side area of the steel coil in the side-shot image; Send the first zoom information to the corresponding side monitoring camera, so that the corresponding side monitoring camera re-zooms and shoots the side of the corresponding steel coil according to the first zoom information, and obtains a zoomed side-shot image; Use the zoomed side-shot image as the updated side-shot image, re-perform the second target detection on the updated side-shot image, and determine the side area of the steel coil and the area ratio of the side area of the steel coil therein.

[0009] In a possible design, before performing the third target detection on the label-shot image, the method further includes: a. Determine the third center point of the label-shot image, and the third center coordinates of the third center point in the label-shot image, and determine the fourth center point of the second label image area, and the fourth center coordinates of the fourth center point in the label-shot image; b. When it is determined that the fourth center point is not within the second error range around the third center point according to the third center coordinates and the fourth center coordinates, generate second azimuth fine-tuning information according to the third center coordinates and the fourth center coordinates; c. Send the second azimuth fine-tuning information to the corresponding side monitoring camera, so that the corresponding side monitoring camera adjusts the shooting azimuth according to the second azimuth fine-tuning information, re-shoots the label on the side of the corresponding steel coil, and obtains a new label-shot image; Repeat the above steps a - c for taking images with the new tag until the fourth center point is within the second error range around the third center point, and obtain the adjusted tag - taken image.

[0010] In a possible design, when it is determined that the area ratio of the second tag image area in the tag - taken image does not exceed the second ratio threshold, the method further includes: Generate second zoom information according to the area ratio of the second tag image area in the tag - taken image; Send the second zoom information to the corresponding side monitoring camera, so that the corresponding side monitoring camera zooms in on the tag on the corresponding side of the steel coil according to the second zoom information to obtain a zoomed - tag - taken image; Use the zoomed - tag - taken image as the updated tag - taken image, and re - perform the third target detection on the updated tag - taken image to determine the second tag image area therein and the area ratio of the second tag image area.

[0011] In a second aspect, a steel - coil label automatic reading system is provided, including a first acquisition unit, a first detection unit, a shooting matching unit, a second acquisition unit, a second detection unit, a third detection unit, a third acquisition unit, a fourth detection unit, and a label reading unit, where: The first acquisition unit is used to obtain the loading - and - unloading area monitoring image collected by the top monitoring camera in the loading - and - unloading area, and the loading - and - unloading area monitoring image contains several steel coils; The first detection unit is used to perform a first target detection on the loading - and - unloading area monitoring image to determine each steel coil in the loading - and - unloading area monitoring image and the top - surface two - dimensional coordinates corresponding to each steel coil; The shooting matching unit is used to match the corresponding side monitoring camera for each steel coil according to the top - surface two - dimensional coordinates corresponding to each steel coil, and determine the first shooting azimuth adjustment information of the side monitoring camera matched by each steel coil according to the top - surface two - dimensional coordinates corresponding to each steel coil and the side two - dimensional coordinates of its matched side monitoring camera; The second acquisition unit is used to send the first shooting azimuth adjustment information to the corresponding side monitoring camera, so that the corresponding side monitoring camera adjusts the shooting azimuth according to the first shooting azimuth adjustment information, shoots the side of the corresponding steel coil to obtain a side - shot image, and obtains the side - shot image fed back by the corresponding side monitoring camera; The second detection unit is used to perform a second target detection on the side - shot image to determine the steel - coil side area in the side - shot image, and judge whether the area ratio of the steel - coil side area in the side - shot image exceeds the first ratio threshold; A third detection unit, configured to perform third target detection on the side area of the steel coil when it is determined that the area ratio of the side area of the steel coil in the side captured image exceeds a first ratio threshold, to determine a first label image area in the side area of the steel coil and the image coordinate information of the first label image area in the side captured image; A third acquisition unit, configured to generate second shooting azimuth adjustment information according to the image coordinate information, and send the second shooting azimuth adjustment information to the corresponding side monitoring camera, so that the corresponding side monitoring camera adjusts the shooting azimuth according to the second shooting azimuth adjustment information, shoots the label on the corresponding side of the steel coil, obtains a label captured image, and acquires the label captured image fed back by the corresponding side monitoring camera; A fourth detection unit, configured to perform third target detection on the label captured image, determine a second label image area in the label captured image, and determine whether the area ratio of the second label image area in the label captured image exceeds a second ratio threshold; A label reading unit, configured to extract the second label image area when it is determined that the area ratio of the second label image area in the label captured image exceeds the second ratio threshold, and perform code scanning recognition on the second label image area to obtain the label reading information of the corresponding steel coil.

[0012] In a third aspect, there is provided an automatic steel coil label reading device, including: A memory, configured to store instructions; A processor, configured to read the instructions stored in the memory and execute any one of the methods in the first aspect according to the instructions.

[0013] In a fourth aspect, there is provided a computer-readable storage medium, on which instructions are stored. When the instructions are run on a computer, the computer is caused to execute any one of the methods in the first aspect. At the same time, there is also provided a computer program product, which when run on a computer, executes any one of the methods in the first aspect.

[0014] Beneficial effects: The present invention determines the two-dimensional coordinates of each steel coil in the loading and unloading area by collecting the monitoring images from the top view of the loading and unloading area, and then matches the corresponding side monitoring cameras in the loading and unloading area for each steel coil to collect the side images of the steel coil, so as to detect and determine the side area of the steel coil and the position of the label image area in the side area of the steel coil. Then, the side monitoring camera is adjusted according to the position of the label image area to specifically collect the label image for target detection. Finally, the label image is extracted for barcode scanning and recognition to obtain the label reading information of the corresponding steel coil, realizing automatic reading of the steel coil label. The present invention can use the monitoring camera to realize unmanned label reading of the incoming and outgoing steel coils, improve the reading efficiency of the labels of the incoming and outgoing steel coils, meet the intelligent and unmanned management requirements of the incoming and outgoing steel coils of the steel coils, and the present invention can save a large amount of manpower and financial resources, with a fast steel coil label reading speed and stable operation, which is conducive to popularization and use. Brief Description of the Drawings

[0015] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the following drawings are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0016] Figure 1 Schematic diagram of the layout of the top monitoring cameras in the loading and unloading area; Figure 2 Schematic diagram of the layout of the side monitoring cameras in the loading and unloading area; Figure 3 Schematic diagram of the steps of the method in Embodiment 1 of the present invention; Figure 4 Schematic diagram of the composition of the device in Embodiment 3 of the present invention. Detailed Embodiments

[0017] It should be noted here that the description of these embodiments is used to help understand the present invention, but does not constitute a limitation to the present invention. The specific structural and functional details disclosed herein are only used to describe the exemplary embodiments of the present invention. However, the present invention can be embodied in many alternative forms and should not be construed as limited to the embodiments set forth herein.

[0018] It should be understood that unless otherwise clearly specified and limited, the corresponding terms should be understood in a broad sense. For example, "connection" can be a fixed connection, a detachable connection, or an integral connection; it can be directly connected, or indirectly connected through an intermediate medium, and can be the internal communication of two components. For those of ordinary skill in the art, the specific meanings of the above terms in the embodiments can be understood according to the specific circumstances.

[0019] Specific details are provided in the following description to facilitate a complete understanding of the exemplary embodiments. However, those of ordinary skill in the art should understand that the exemplary embodiments can be implemented without these specific details. For example, devices can be shown in block diagrams to avoid obscuring the examples with unnecessary details. In other embodiments, well-known processes, structures, and technologies can be shown without unnecessary details to avoid obscuring the embodiments.

[0020] Embodiment 1: This embodiment provides an automatic steel coil label reading method, which can be applied to a corresponding processing host, such as Figures 1 to 2 As shown, the processing host establishes a data connection with the top monitoring camera and the side monitoring cameras in the loading and unloading area. As Figure 3 shown, the method includes the following steps: S1. Obtain the loading and unloading area monitoring image collected by the top monitoring camera in the loading and unloading area, where the loading and unloading area monitoring image contains several steel coils.

[0021] Specifically, when implementing, the steel coil products are transported by special vehicles. When carrying out inbound and outbound operations in the steel coil warehouse, the vehicles loaded with steel coils stop in a fixed loading and unloading area. The steel coil labels are located on the vertical planes on both sides of the steel coils, but the positions are not fixed. The diameter of the steel coils is generally nearly 1.5 meters, but the codes on the steel coil labels are very small. If the scheme of multi-camera stitching for image acquisition is adopted, a large number of cameras are required, and the stitching quality cannot be guaranteed. Moreover, with a large number of hardware components, the failure rate is high, and the overall reliability of the system is poor. If the line-scan camera method is adopted, complex motion mechanisms are required for cooperation, the cost is high, and the failure rate is also high. There are also problems with image stitching. Therefore, as Figures 1 to 2 shown, in this method, a top monitoring camera is set at the top of the loading and unloading area, and a small number of side monitoring cameras are set on both sides of the loading and unloading area. The top monitoring camera in the loading and unloading area faces the vehicles and steel coils in the loading and unloading area directly below, and first collects the loading and unloading area monitoring image. The loading and unloading area monitoring image contains the vehicles in the loading and unloading area and several steel coils on the vehicles. The top monitoring camera transmits the collected loading and unloading area monitoring image to the processing host.

[0022] S2. Perform a first target detection on the loading and unloading area monitoring image to determine each steel coil in the loading and unloading area monitoring image and the corresponding top surface two-dimensional coordinates of each steel coil.

[0023] Specifically, when implementing, the processing host performs a first target detection on the loading and unloading area monitoring image. A target detection model that has been trained and tested, such as the R-CNN series model or the YOLO series model, can be used to perform a first target detection on the loading and unloading area monitoring image. According to the target detection results, each steel coil in the loading and unloading area monitoring image is determined, and the corresponding top surface two-dimensional coordinates of each steel coil in the loading and unloading area monitoring image are determined.

[0024] S3. Match the side monitoring cameras corresponding to each steel coil according to the top surface two-dimensional coordinates of each steel coil, and determine the first shooting azimuth adjustment information of the side monitoring cameras matched by each steel coil according to the top surface two-dimensional coordinates of each steel coil and the side two-dimensional coordinates of the side monitoring cameras they match.

[0025] In specific implementation, the processing host can match the side monitoring cameras corresponding to each steel coil according to the top surface two-dimensional coordinates of each steel coil, and then use the top surface two-dimensional coordinates of each steel coil and the side two-dimensional coordinates of the side monitoring cameras they match to analyze and determine the first shooting azimuth adjustment information of the side monitoring cameras matched by each steel coil. Exemplarily, the processing host can first determine the first coordinate position of each steel coil in the reference direction of the loading and unloading area according to the top surface two-dimensional coordinates of each steel coil. At the same time, determine the second coordinate position of each side monitoring camera in the reference direction of the loading and unloading area according to the side two-dimensional coordinates of each side monitoring camera; then determine the second coordinate position closest to the first coordinate position of the corresponding steel coil in the reference direction of the loading and unloading area, and use the side monitoring camera corresponding to the second coordinate position closest to the first coordinate position of the corresponding steel coil as the side monitoring camera matched by the corresponding steel coil; finally, determine the azimuth difference according to the first coordinate position of the steel coil in the reference direction of the loading and unloading area and the second coordinate position of the side monitoring camera it matches in the reference direction of the loading and unloading area, and generate the shooting azimuth adjustment information of the side monitoring camera matched by the corresponding steel coil according to the azimuth difference.

[0026] S4. Send the first shooting azimuth adjustment information to the corresponding side monitoring camera, so that the corresponding side monitoring camera adjusts the shooting azimuth according to the first shooting azimuth adjustment information, shoots the side of the corresponding steel coil to obtain a side shooting image, and obtain the side shooting image fed back by the corresponding side monitoring camera.

[0027] In specific implementation, the processing host can send the first shooting azimuth adjustment information to the corresponding side monitoring camera, so that the corresponding side monitoring camera adjusts the shooting azimuth according to the first shooting azimuth adjustment information, that is, adjusts the rotation angle and pitch angle of the monitoring camera pan-tilt, shoots the side of the corresponding steel coil to obtain a side shooting image. After initially obtaining the side shooting image, the processing host also needs to determine whether the steel coil area is at the center position of the side shooting image. If it is not at the center position, fine-tuning of the shooting angle is also required to make the steel coil area at the center position of the side shooting image. This process includes: A. Determine the first center point of the side shooting image, and the first center coordinates of the first center point in the side shooting image, and determine the second center point of the side area of the steel coil, and the second center coordinates of the second center point in the side shooting image; B. When it is determined that the second center point is not within the first error range around the first center point according to the first center coordinate and the second center coordinate, generate first azimuth fine-tuning information based on the first center coordinate and the second center coordinate; C. Send the first azimuth fine-tuning information to the corresponding side monitoring camera, so that the corresponding side monitoring camera adjusts the shooting azimuth according to the first azimuth fine-tuning information, re-shoots the side of the corresponding steel coil, and obtains a new side shooting image; Repeat the above steps A - C using the new side shooting image until the second center point is within the first error range around the first center point, and obtain the adjusted side shooting image.

[0028] S5. Perform second target detection on the side shooting image, determine the steel coil side area in the side shooting image, and judge whether the area ratio of the steel coil side area in the side shooting image exceeds the first ratio threshold.

[0029] Specifically, after determining the finally adjusted side shooting image, the processing host can perform second target detection on the finally adjusted side shooting image (a trained and tested target detection model can be used, such as the R-CNN series model or the YOLO series model, etc.), detect the steel coil side area in the side shooting image, then determine the area ratio of the steel coil side area in the side shooting image, and judge whether the area ratio of the steel coil side area in the side shooting image exceeds the first ratio threshold. When the processing host determines that the area ratio of the steel coil side area in the side shooting image does not exceed the first ratio threshold, first zoom information can be generated according to the area ratio of the steel coil side area in the side shooting image; then the first zoom information is sent to the corresponding side monitoring camera, so that the corresponding side monitoring camera re-zooms and shoots the side of the corresponding steel coil according to the first zoom information, and obtains a zoomed side shooting image; then the zoomed side shooting image is used as the updated side shooting image, and second target detection is performed on the updated side shooting image again to determine the steel coil side area and the area ratio of the steel coil side area therein, and so on, until the area ratio of the steel coil side area in the finally obtained side shooting image exceeds the first ratio threshold.

[0030] S6. When it is determined that the area ratio of the steel coil side area in the side shooting image exceeds the first ratio threshold, perform third target detection on the steel coil side area, determine the first label image area in the steel coil side area, and the image coordinate information of the first label image area in the side shooting image.

[0031] In specific implementation, when the processing host determines that the area ratio of the steel coil side area in the side captured image exceeds the first ratio threshold, third target detection can be performed on the steel coil side area (a trained and tested target detection model can be used, such as the R-CNN series model or the YOLO series model, etc.) to detect the first label image area in the steel coil side area and determine the image coordinate information of the first label image area in the side captured image.

[0032] S7. Generate second shooting azimuth adjustment information according to the image coordinate information, and send the second shooting azimuth adjustment information to the corresponding side monitoring camera, so that the corresponding side monitoring camera adjusts the shooting azimuth according to the second shooting azimuth adjustment information, shoots the label on the corresponding steel coil side to obtain a label captured image, and acquire the label captured image fed back by the corresponding side monitoring camera.

[0033] In specific implementation, the processing host generates second shooting azimuth adjustment information according to the image coordinate information of the first label image area in the side captured image, and sends the second shooting azimuth adjustment information to the corresponding side monitoring camera, so that the corresponding side monitoring camera adjusts the shooting azimuth according to the second shooting azimuth adjustment information, that is, adjusts the rotation angle and pitch angle of the monitoring camera pan-tilt, shoots the label on the corresponding steel coil side to obtain a label captured image. After initially obtaining the label captured image, the processing host also needs to determine whether the label area is at the center position of the label captured image. If it is not at the center position, fine-tuning of the shooting angle is also required to make the label area at the center position of the label captured image. This process includes: a. Determine the third center point of the label captured image, and the third center coordinates of the third center point in the label captured image, and determine the fourth center point of the second label image area, and the fourth center coordinates of the fourth center point in the label captured image; b. When it is determined according to the third center coordinates and the fourth center coordinates that the fourth center point is not within the second error range around the third center point, generate second azimuth fine-tuning information according to the third center coordinates and the fourth center coordinates; c. Send the second azimuth fine-tuning information to the corresponding side monitoring camera, so that the corresponding side monitoring camera adjusts the shooting azimuth according to the second azimuth fine-tuning information, re-shoots the label on the corresponding steel coil side to obtain a new label captured image; Repeat the above steps a-c using the new label captured image until the fourth center point is within the second error range around the third center point to obtain an adjusted label captured image.

[0034] S8. Perform third target detection on the label captured image, determine the second label image area in the label captured image, and determine whether the area ratio of the second label image area in the label captured image exceeds the second ratio threshold.

[0035] In specific implementation, after obtaining the finally adjusted label captured image, the processing host performs third target detection on the label captured image (a trained and tested target detection model can be used, such as the R-CNN series model or the YOLO series model, etc.) to detect the second label image area in the label captured image, and determine whether the area ratio of the second label image area in the label captured image exceeds the second ratio threshold. If the area ratio of the second label image area in the label captured image does not exceed the second ratio threshold, the processing host can generate second zoom information according to the area ratio of the second label image area in the label captured image; then send the second zoom information to the corresponding side monitoring camera, so that the corresponding side monitoring camera performs zoom shooting on the label on the corresponding side of the steel coil according to the second zoom information to obtain a zoom label captured image; then use the zoom label captured image as the updated label captured image, perform third target detection on the updated label captured image again, determine the second label image area and the area ratio of the second label image area therein, and so on in a loop until the area ratio of the second label image area in the finally obtained label captured image exceeds the second ratio threshold.

[0036] S9. When it is determined that the area ratio of the second label image area in the label captured image exceeds the second ratio threshold, extract the second label image area and perform barcode scanning and recognition on the second label image area to obtain the label reading information of the corresponding steel coil.

[0037] In specific implementation, when it is determined that the area ratio of the second label image area in the label captured image exceeds the second ratio threshold, that is, a label image available for barcode scanning and reading is obtained. At this time, the processing host can extract the second label image area and perform barcode scanning and recognition on the second label image area to obtain the label reading information of the corresponding steel coil. And after the label reading information corresponding to each steel coil is simultaneously scanned and read, summarize and upload the label reading information corresponding to each steel coil to the management system.

[0038] This method can use the monitoring camera to realize unmanned label reading of the incoming and outgoing steel coils, improve the reading efficiency of the labels of the incoming and outgoing steel coils, meet the intelligent and unmanned management requirements of the steel coil incoming and outgoing, and the present invention can save a large amount of manpower and financial resources, has a fast steel coil label reading speed and stable operation, and is conducive to popularization and use.

[0039] Example 2: This embodiment provides an automatic steel coil label reading system, which includes a first acquisition unit, a first detection unit, a shooting and matching unit, a second acquisition unit, a second detection unit, a third detection unit, a third acquisition unit, a fourth detection unit, and a label reading unit, where: The first acquisition unit is used to obtain the loading and unloading area monitoring image collected by the monitoring camera at the top of the loading and unloading area. The loading and unloading area monitoring image contains several steel coils; The first detection unit is used to perform first target detection on the loading and unloading area monitoring image to determine each steel coil in the loading and unloading area monitoring image and the top surface two-dimensional coordinates corresponding to each steel coil; The shooting and matching unit is used to match the side monitoring camera corresponding to each steel coil according to the top surface two-dimensional coordinates corresponding to each steel coil, and determine the first shooting azimuth adjustment information of the side monitoring camera matched by each steel coil according to the top surface two-dimensional coordinates corresponding to each steel coil and the side two-dimensional coordinates of its matched side monitoring camera; The second acquisition unit is used to send the first shooting azimuth adjustment information to the corresponding side monitoring camera, so that the corresponding side monitoring camera adjusts the shooting azimuth according to the first shooting azimuth adjustment information, shoots the side of the corresponding steel coil to obtain a side shooting image, and obtains the side shooting image fed back by the corresponding side monitoring camera; The second detection unit is used to perform second target detection on the side shooting image to determine the steel coil side area in the side shooting image, and judge whether the area ratio of the steel coil side area in the side shooting image exceeds the first ratio threshold; The third detection unit is used to perform third target detection on the steel coil side area when it is determined that the area ratio of the steel coil side area in the side shooting image exceeds the first ratio threshold, determine the first label image area in the steel coil side area, and the image coordinate information of the first label image area in the side shooting image; The third acquisition unit is used to generate second shooting azimuth adjustment information according to the image coordinate information, and send the second shooting azimuth adjustment information to the corresponding side monitoring camera, so that the corresponding side monitoring camera adjusts the shooting azimuth according to the second shooting azimuth adjustment information, shoots the label on the side of the corresponding steel coil to obtain a label shooting image, and obtains the label shooting image fed back by the corresponding side monitoring camera; The fourth detection unit is used to perform third target detection on the label shooting image to determine the second label image area in the label shooting image, and judge whether the area ratio of the second label image area in the label shooting image exceeds the second ratio threshold; The label reading unit is used to extract the second label image area when it is determined that the area ratio of the second label image area in the label shooting image exceeds the second ratio threshold, and perform code scanning recognition on the second label image area to obtain the label reading information of the corresponding steel coil.

[0040] Example 3: This embodiment provides an automatic steel coil label reading device. As Figure 4 shown, at the hardware level, it includes: A data interface for establishing data docking between the processor and the top monitoring camera and side monitoring cameras in the loading and unloading area; A memory for storing instructions; A processor for reading the instructions stored in the memory and executing the automatic steel coil label reading method in Embodiment 1 according to the instructions.

[0041] Optionally, the device further includes an internal bus. The processor, memory, and data interface can be interconnected through the internal bus. The internal bus can be an ISA (Industry Standard Architecture) bus, a PCI (Peripheral Component Interconnect) bus, or an EISA (Extended Industry Standard Architecture) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc.

[0042] The memory can include, but is not limited to, a random access memory (RAM), a read only memory (ROM), a flash memory, a first input first output (FIFO) memory, and / or a first in last out (FILO) memory, etc. The processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

[0043] Example 4: This embodiment provides a computer-readable storage medium, on which instructions are stored. When the instructions run on a computer, the computer is caused to execute the automatic steel coil label reading method in Embodiment 1. Among them, the computer-readable storage medium refers to a carrier for storing data, which may but is not limited to include floppy disks, optical discs, hard disks, flash memories, USB flash drives, and / or memory sticks, etc. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices.

[0044] This embodiment also provides a computer program product. When the computer program product runs on a computer, it executes the automatic steel coil label reading method in Embodiment 1. Among them, the computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices.

[0045] Finally, it should be noted that the above are only preferred embodiments of the present invention and are not used to limit the protection scope of the present invention. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A method for automatically reading a steel coil label, characterized in that: include: Acquire a monitoring image of the loading and unloading area collected by a monitoring camera at the top of the loading and unloading area, wherein the monitoring image of the loading and unloading area includes a plurality of steel coils; Performing a first target detection on the monitoring image of the loading and unloading area, determining each steel coil in the monitoring image of the loading and unloading area, and the two-dimensional coordinates of the top surface corresponding to each steel coil; Matching the side monitoring camera corresponding to each steel coil according to the two-dimensional coordinates of the top surface corresponding to each steel coil, and determining the first shooting orientation adjustment information of the side monitoring camera matched to each steel coil according to the two-dimensional coordinates of the top surface corresponding to each steel coil and the side two-dimensional coordinates of the side monitoring camera matched to each steel coil; The first shooting orientation adjustment information is sent to the corresponding side monitoring camera, so that the corresponding side monitoring camera adjusts the shooting orientation according to the first shooting orientation adjustment information, shoots the side of the corresponding steel coil to obtain a side shooting image, and obtains the side shooting image fed back by the corresponding side monitoring camera; Performing a second target detection on the side-shot image, determining a side area of ​​the steel coil in the side-shot image, and judging whether an area ratio of the side area of ​​the steel coil in the side-shot image exceeds a first ratio threshold; When it is determined that the area ratio of the side area of ​​the steel coil in the side shot image exceeds the first ratio threshold, a third target detection is performed on the side area of ​​the steel coil to determine the first label image area in the side area of ​​the steel coil and the image coordinate information of the first label image area in the side shot image; Generate second shooting orientation adjustment information according to the image coordinate information, and send the second shooting orientation adjustment information to the corresponding side monitoring camera, so that the corresponding side monitoring camera adjusts the shooting orientation according to the second shooting orientation adjustment information, shoots the label on the side of the corresponding steel coil, obtains the label shooting image, and obtains the label shooting image fed back by the corresponding side monitoring camera; Performing a third target detection on the tag shot image, determining a second tag image region in the tag shot image, and judging whether an area ratio of the second tag image region in the tag shot image exceeds a second ratio threshold; When it is determined that the area ratio of the second label image area in the label shot image exceeds the second ratio threshold, the second label image area is extracted, and the second label image area is scanned and identified to obtain the label reading information of the corresponding steel coil.

2. The method for automatically reading a steel coil label according to claim 1, characterized in that: The method further includes: aggregating the label reading information corresponding to each steel coil and uploading it to a management system.

3. The method for automatically reading a steel coil label according to claim 1, characterized in that: The method matches the side monitoring camera corresponding to each steel coil according to the two-dimensional coordinates of the top surface corresponding to each steel coil, and determines the shooting orientation adjustment information of the side monitoring camera matched to each steel coil according to the two-dimensional coordinates of the top surface corresponding to each steel coil and the side two-dimensional coordinates of the side monitoring camera matched to each steel coil, including: Determine the first coordinate position of each steel coil in the reference direction of the loading and unloading area according to the two-dimensional coordinates of the top surface of each steel coil, and determine the second coordinate position of each side monitoring camera in the reference direction of the loading and unloading area according to the two-dimensional coordinates of the side surface of each side monitoring camera; Determine a second coordinate position closest to the first coordinate position of the corresponding steel coil in the reference direction of the loading and unloading area, and use the side monitoring camera corresponding to the second coordinate position closest to the first coordinate position of the corresponding steel coil as the side monitoring camera matched with the corresponding steel coil; The azimuth difference is determined based on the first coordinate position of the steel coil in the reference direction of the loading and unloading area and the second coordinate position of the side monitoring camera matched by it in the reference direction of the loading and unloading area, and the shooting azimuth adjustment information of the side monitoring camera matched by the corresponding steel coil is generated based on the azimuth difference.

4. The method for automatically reading a steel coil label according to claim 1, characterized in that: Before performing second target detection on the side-shot image, the method further includes: A. Determine a first center point of the side-view image and a first center coordinate of the first center point in the side-view image, and determine a second center point of the side area of ​​the steel coil and a second center coordinate of the second center point in the side-view image; B. when it is determined according to the first center coordinates and the second center coordinates that the second center point is not within a first error range around the first center point, generating first orientation fine-tuning information according to the first center coordinates and the second center coordinates; C. Sending the first position fine-tuning information to the corresponding side monitoring camera, so that the corresponding side monitoring camera adjusts the shooting position according to the first position fine-tuning information, re-shoots the side of the corresponding steel coil, and obtains a new side shooting image; The above steps AC are repeatedly performed using the new side-shot image until the second center point is within the first error range around the first center point, thereby obtaining an adjusted side-shot image.

5. The method for automatically reading a steel coil label according to claim 1, characterized in that: When it is determined that the area ratio of the side area of ​​the steel coil in the side shot image does not exceed the first ratio threshold, the method further includes: Generate first zoom information according to the area ratio of the side area of ​​the steel coil in the side shot image; The first zoom information is sent to the corresponding side monitoring camera, so that the corresponding side monitoring camera re-zooms and shoots the side of the corresponding steel coil according to the first zoom information to obtain a zoomed side shooting image; The zoomed side shot image is used as the updated side shot image, and the second target detection is re-performed on the updated side shot image to determine the side area of ​​the steel coil and the area ratio of the side area of ​​the steel coil.

6. The method for automatically reading a steel coil label according to claim 1, characterized in that: Before performing third target detection on the tag-shot image, the method further includes: a. Determine the third center point of the label image, and the third center coordinates of the third center point in the label image, and determine the fourth center point of the second label image area, and the fourth center coordinates of the fourth center point in the label image; b. when it is determined according to the third center coordinates and the fourth center coordinates that the fourth center point is not within the second error range around the third center point, generating second orientation fine-tuning information according to the third center coordinates and the fourth center coordinates; c. Sending the second position fine-tuning information to the corresponding side monitoring camera, so that the corresponding side monitoring camera adjusts the shooting position according to the second position fine-tuning information, re-shoots the label on the side of the corresponding steel coil, and obtains a new label shooting image; The above steps ac are repeatedly performed using a new label shot image until the fourth center point is within a second error range around the third center point, thereby obtaining an adjusted label shot image.

7. The method for automatically reading a steel coil label according to claim 1, characterized in that: When it is determined that the area ratio of the second label image region in the label shot image does not exceed the second ratio threshold, the method further includes: generating second zoom information according to the area ratio of the second tag image region in the tag shot image; The second zoom information is sent to the corresponding side monitoring camera, so that the corresponding side monitoring camera zooms and shoots the label on the side of the corresponding steel coil according to the second zoom information to obtain a zoom label shooting image; The zoomed tag shot image is used as the updated tag shot image, and the third target detection is performed again on the updated tag shot image to determine the second tag image area and the area ratio of the second tag image area.

8. A steel coil label automatic reading system, characterized in that: It includes a first acquisition unit, a first detection unit, a shooting and matching unit, a second acquisition unit, a second detection unit, a third detection unit, a third acquisition unit, a fourth detection unit and a tag reading unit, wherein: A first acquisition unit is used to acquire a monitoring image of the loading and unloading area acquired by a monitoring camera at the top of the loading and unloading area, wherein the monitoring image of the loading and unloading area includes a plurality of steel coils; A first detection unit is used to perform a first target detection on the monitoring image of the loading and unloading area, and determine each steel coil in the monitoring image of the loading and unloading area, and a two-dimensional coordinate of the top surface corresponding to each steel coil; A shooting matching unit is used to match the side monitoring camera corresponding to each steel coil according to the two-dimensional coordinates of the top surface corresponding to each steel coil, and determine the first shooting orientation adjustment information of the side monitoring camera matched to each steel coil according to the two-dimensional coordinates of the top surface corresponding to each steel coil and the two-dimensional coordinates of the side monitoring camera matched to each steel coil; The second acquisition unit is used to send the first shooting orientation adjustment information to the corresponding side monitoring camera, so that the corresponding side monitoring camera adjusts the shooting orientation according to the first shooting orientation adjustment information, shoots the side of the corresponding steel coil, obtains the side shooting image, and obtains the side shooting image fed back by the corresponding side monitoring camera; a second detection unit, configured to perform a second target detection on the side-shot image, determine a side area of ​​the steel coil in the side-shot image, and determine whether an area ratio of the side area of ​​the steel coil in the side-shot image exceeds a first ratio threshold; A third detection unit is used to perform a third target detection on the side area of ​​the steel coil when it is determined that the area ratio of the side area of ​​the steel coil in the side image exceeds a first ratio threshold, and determine the first label image area in the side area of ​​the steel coil, and the image coordinate information of the first label image area in the side image; The third acquisition unit is used to generate second shooting orientation adjustment information according to the image coordinate information, and send the second shooting orientation adjustment information to the corresponding side monitoring camera, so that the corresponding side monitoring camera adjusts the shooting orientation according to the second shooting orientation adjustment information, shoots the label on the side of the corresponding steel coil, obtains the label shooting image, and obtains the label shooting image fed back by the corresponding side monitoring camera; a fourth detection unit, configured to perform a third target detection on the label-shot image, determine a second label image region in the label-shot image, and determine whether an area ratio of the second label image region in the label-shot image exceeds a second ratio threshold; The label reading unit is used to extract the second label image area when it is determined that the area ratio of the second label image area in the label shot image exceeds a second ratio threshold, and scan and identify the second label image area to obtain the label reading information of the corresponding steel coil.

9. A steel coil label automatic reading device, characterized in that: include: A memory for storing instructions; A processor is used to read the instructions stored in the memory and execute the automatic reading method of steel coil labels according to any one of claims 1 to 7.

10. A computer program product, characterized in that When the computer program product is run on a computer, the method for automatically reading steel coil labels according to any one of claims 1 to 7 is executed.

Images