Blank number identification method and device for continuous casting slab, storage medium and electronic equipment

Abstract

The invention provides a blank number identification method and device for a continuous casting blank plate, a storage medium and electronic equipment, and belongs to the technical field of image identification. The method comprises the steps that a first image, shot by a first camera located at the position of a continuous casting slab number spraying machine, of a continuous casting slab is obtained; extracting a first continuous casting billet characteristic of the continuous casting billet at the position of the continuous casting billet number spraying machine from the first image, and identifying a first billet number of the continuous casting billet; storing the first continuous casting billet characteristics and the first billet number into a database; acquiring a second image of the continuous casting billet shot by a second camera at the entrance of the slab yard; and determining the slab number of the continuous casting slab at the entrance of the slab yard based on the second image and the first continuous casting slab feature and the first slab number stored in the database. According to the method, the blank number identification accuracy of the continuous casting blank can be improved.

Description

Technical Field

[0001] This application relates to the field of image recognition technology, and particularly to a method, device, storage medium, and electronic device for identifying the billet number of a continuous casting slab. Background Art

[0002] In modern steel production processes, the continuous casting process significantly improves production efficiency and material utilization rate by continuously casting molten steel into continuous casting billets of specific shapes (such as slab billets, square billets, etc.). Among them, slab billets, as a typical form of continuous casting billets (with a flat rectangular cross-section), are the core raw materials for rolling high-end steel products such as hot-rolled sheets and cold-rolled sheets. To ensure the traceability and quality control of the entire production process, each continuous casting billet needs to be assigned a unique billet number (i.e., product identification code) by a spray numbering machine during casting and be identified and tracked in subsequent processes (such as entering the hot slab storage).

[0003] Traditional billet number identification methods usually independently identify the billet number before the continuous casting billet is rolled into a rolled plate. For example, at the entrance of the slab storage, the billet number sprayed on the continuous casting billet is photographed, and some artificial intelligence image recognition technologies are used to independently identify the billet number on the continuous casting billet. However, in the existing billet number identification methods, before the continuous casting billet reaches the entrance of the slab storage, it will be in a complex environment, and the continuous casting billet will be oxidized, making it difficult to ensure the recognition accuracy of the sprayed billet number. In some cases, the billet number may be misidentified, or a non-existent billet number may be identified. Summary of the Invention

[0004] The purpose of this application is to provide a method, device, storage medium, and electronic device for identifying the billet number of a continuous casting slab to solve at least one of the above technical problems.

[0005] In the first aspect of this application, a method for identifying the billet number of a continuous casting slab is provided. The method includes: Obtaining a first image of the continuous casting billet captured by a first camera at the continuous casting billet spray numbering machine; Extracting the first continuous casting billet feature of the continuous casting billet at the continuous casting billet spray numbering machine from the first image and identifying the first billet number of the continuous casting billet; Storing the first continuous casting billet feature and the first billet number in a database; Obtaining a second image of the continuous casting billet captured by a second camera at the entrance of the slab storage; Determining the billet number of the continuous casting billet at the entrance of the slab storage based on the second image and the first continuous casting billet feature and the first billet number stored in the database.

[0006] Optionally, determining the billet number of the continuous casting billet at the entrance of the slab yard based on the second image and the first continuous casting billet features and the first billet number stored in the database includes: Extracting the second continuous casting billet features of the continuous casting billet at the entrance of the slab yard from the second image, and identifying the corresponding second billet number; Performing optimization search in the database based on the first continuous casting billet features and the second billet number, and determining the billet number of the continuous casting billet at the entrance of the slab yard according to the search result.

[0007] Optionally, performing optimization search in the database based on the first continuous casting billet features and the second billet number, and determining the billet number of the continuous casting billet at the entrance of the slab yard according to the search result includes: Querying in the database the first continuous casting billet features that are consistent with the second continuous casting billet features, and querying the first billet numbers that are consistent with the second billet number; When the first continuous casting billet features that meet the consistency and the first billet numbers that meet the consistency belong to the same image, taking the first billet number as the billet number of the continuous casting billet.

[0008] Optionally, before taking the first billet number as the billet number of the continuous casting billet, the method further includes: Detecting whether there is an occupancy mark for the identified first billet number that meets the consistency. When there is an occupancy mark, re-querying the first billet numbers that are consistent with the second billet number. When there is no occupancy mark, performing the step of taking the first billet number as the billet number of the continuous casting billet, where the occupancy mark indicates that the corresponding first billet number has been used as the billet number of the continuous casting billet at the entrance of the slab yard.

[0009] Optionally, the second continuous casting billet features include the oxidation features of the continuous casting billet. Performing optimization search in the database based on the first continuous casting billet features and the second billet number, and determining the billet number of the continuous casting billet at the entrance of the slab yard according to the search result includes: Identifying the billet number spraying duration corresponding to the continuous casting billet based on the oxidation features; Identifying the first billet numbers similar to the second billet number in the database; Calculating the first matching degree between the first continuous casting billet features corresponding to the identified first billet number and the second continuous casting billet features; Calculating the second matching degree between the generation time of the first image corresponding to the identified first billet number and the spraying duration; Determining the billet number of the continuous casting billet at the entrance of the slab yard based on the first matching degree and the second matching degree.

[0010] Optionally, the first continuous casting billet features include the first dimensional feature of the continuous casting billet, the first spraying feature of the first billet number, and the first surface texture feature; the second continuous casting billet features further include the second dimensional feature of the continuous casting billet, the second spraying feature of the second billet number, and the second surface texture feature. Calculating the first matching degree between the first continuous casting billet features corresponding to the first billet number identified by the calculation and the second continuous casting billet features includes: Calculating a first similarity degree between the first dimensional feature and the second dimensional feature; Calculating a second similarity degree between the first spraying feature and the second spraying feature; Calculating a third similarity degree between the first surface texture feature and the second surface texture feature; Calculating the first matching degree based on the first similarity degree, the second similarity degree, and the third similarity degree.

[0011] Optionally, the optimizing from the database based on the first continuous casting billet features and the second billet number, and determining the billet number of the continuous casting billet at the entrance of the slab library according to the optimization result includes: when the confidence level of the identified second billet number exceeds a preset first confidence level threshold, and the integrity of the billet number of the second billet number exceeds a first completion threshold, querying from the database whether there is a first billet number that is exactly the same as the second billet number, and when there is, using the second billet number as the billet number of the continuous casting billet at the entrance of the slab library.

[0012] In a second aspect of the present application, there is provided a billet number identification device for a continuous casting billet slab, the device including: A first image acquisition module, configured to acquire a first image of a continuous casting billet captured by a first camera at a continuous casting billet spraying machine; A first image processing module, configured to extract first continuous casting billet features of the continuous casting billet at the continuous casting billet spraying machine from the first image, and identify the first billet number of the continuous casting billet; A data storage module, configured to store the first continuous casting billet features and the first billet number in a database; A second image acquisition module, configured to acquire a second image of a continuous casting billet captured by a second camera at the entrance of a slab library; A billet number determination module, configured to determine the billet number of the continuous casting billet at the entrance of the slab library based on the second image and the first continuous casting billet features and the first billet number stored in the database.

[0013] In a third aspect of the present application, there is provided a computer-readable storage medium, on which executable instructions are stored, and when the executable instructions are executed by a processor, the processor is caused to execute the method described in any embodiment of the present application.

[0014] In the fourth aspect of the present application, an electronic device is provided, including: one or more processors; a memory for storing one or more programs, which, when executed by the one or more processors, cause the one or more processors to execute the method described in any embodiment of the present application.

[0015] In the method, device, storage medium, and electronic device for identifying the billet number of a continuous casting billet slab in the present application, a first camera is set at the continuous casting billet spraying number machine, and a second camera is set at the entrance of the slab yard. The images of the continuous casting billet are independently captured by the two cameras. Since the first image captured by the first camera contains the clear billet number of the continuous casting billet, after the second image captured by the second camera, it is possible to query from the first billet number and the first continuous casting billet features stored in the first image to find the first image representing the same continuous casting billet as the second image, and then determine the billet number of the continuous casting billet transferred to the entrance of the slab yard, improving the accuracy of identifying the billet number of the continuous casting billet. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for the embodiments will be briefly introduced below. It should be understood that the following drawings only show some embodiments of the present application and should not be regarded as limiting the scope of the present application.

[0017] Figure 1 It is a schematic flowchart of a method for identifying the billet number of a continuous casting billet slab in an embodiment; Figure 2 It is a schematic flowchart of optimizing from a database based on the first continuous casting billet features and the second billet number and determining the billet number of the continuous casting billet at the entrance of the slab yard according to the optimization result; Figure 3 It is a schematic flowchart of a method for identifying the billet number of a continuous casting billet slab in another embodiment; Figure 4 It is a schematic structural diagram of a device for identifying the billet number of a continuous casting billet slab in an embodiment; Figure 5 It is a schematic structural diagram of an electronic device in an embodiment. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0018] In order to make the objectives, technical solutions, and advantages of the present application clearer, the present application will be further described in detail below with reference to the drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0019] All terms used in this application (including technical and scientific terms) have the meanings commonly understood by those skilled in the art, unless otherwise defined. It should be noted that the terms used herein should be interpreted as having a meaning consistent with the context of this specification, and should not be interpreted in an idealized or overly rigid manner.

[0020] For example, terms such as "first", "second", etc. used in this application may be used herein to describe various elements, but these elements are not limited by these terms. These terms are only used to distinguish the first element from another element.

[0021] For another example, terms such as "comprising", "including", etc. used in this application indicate the presence of features, steps, operations, and / or components, but do not exclude the presence or addition of one or more other features, steps, operations, or components.

[0022] A method for identifying the billet number of a continuous casting slab is provided in this application, as Figure 1 shown. This method includes: Step 110, obtaining a first image of the continuous casting slab captured by a first camera at the continuous casting billet spraying machine.

[0023] In this embodiment, the first camera may specifically be a high-definition camera or an industrial camera, and the first camera is installed at the continuous casting billet spraying machine. Specifically, it may be directly above, diagonally above, diagonally below, etc. the continuous casting billet spraying machine at any suitable fixed position within a first distance range.

[0024] The first camera within this first distance range can capture a clear image including the cross-section of the continuous casting slab. The billet number of the continuous casting slab is sprayed on this cross-section. The billet number on the cross-section of the continuous casting slab in the first image captured by the first camera is usually freshly sprayed by the spraying machine and the billet number thereon is clearly visible.

[0025] Step 120, extracting the first continuous casting slab feature of the continuous casting slab at the continuous casting billet spraying machine from the first image, and identifying the first billet number of the continuous casting slab.

[0026] For each first image of the continuously cast billet captured, image preprocessing such as denoising, image enhancement, illumination equalization, and geometric correction is performed on it to obtain the preprocessed first image. Among them, the non-local means denoising (NL-Means) algorithm can be used to filter out the common high-temperature steam and dust interference in the continuous casting area and retain the character edge details. For the denoised image, adaptive histogram equalization (CLAHE) is used to enhance the local contrast of the image, solve the brightness difference caused by uneven supplementary lighting of the spraying machine, and at the same time perform color compensation on the non-sprayed area in the continuously cast billet, so that the image of the continuously cast billet displayed in the color-compensated image is consistent with the color of the cooled continuously cast billet. Geometric correction can be based on slab edge detection (Canny operator) to calculate the image perspective transformation matrix and correct the character deformation caused by camera tilt or slab movement.

[0027] For the preprocessed first image, extraction of the first continuously cast billet features is performed. The first continuously cast billet features refer to a multi-dimensional feature set extracted from the first image that can uniquely identify or distinguish different continuously cast billets. These features include the physical properties of the continuously cast billet itself (such as size, shape) and the geometric and physical characteristics of the sprayed numbers (such as position, font, ink characteristics).

[0028] The first continuously cast billet features may include one or more of the first size feature of the continuously cast billet, the first printing feature of the first billet number, the first surface texture feature of the continuously cast billet, etc.

[0029] The first size feature is used to reflect the overall geometric dimensions of the cross-section of the continuously cast billet, including the length, width, etc. of the continuously cast billet; the first printing feature may include the color feature of the sprayed ink and the size feature of the billet number. The color feature can be its RGB value, and the size feature can include the width and height of the sprayed billet number area, as well as the height, width, character spacing, top and bottom margins of each sprayed character, etc.; the first surface texture feature may include the physical state of the surface of the continuously cast billet, such as its roughness, flatness, and some shape patterns existing on the surface (such as crack texture patterns).

[0030] For the surface texture feature, the local binary pattern (LBP) can be used to convert the corresponding image into an LBP histogram, extract the surface texture distribution from this LBP histogram, and then use the method of Gaussian filtering and gradient magnitude to calculate the mean value of the gradient magnitude of the Sobel operator to obtain the richness of the texture details, thereby forming the surface texture feature.

[0031] For the first image captured, the billet number in it can be recognized by means of machine vision recognition, and the recognized billet number is used as the first billet number. Since the first camera is located at the continuously cast billet spraying machine, the billet number captured at this time is usually the billet number that has just been sprayed, and its billet number clarity is very high, and the billet number can be accurately recognized.

[0032] Step 130: Store the first continuous casting billet features and the first billet number in a database.

[0033] In this embodiment, the captured first image, the corresponding extracted first continuous casting billet features, and the first billet number can all be stored in the database. Each first image corresponds one-to-one to the corresponding extracted first continuous casting billet features and the first billet number. The database stores multiple frames of first images and their first continuous casting billet features and the first billet number.

[0034] Optionally, the database stores the shooting timestamp and / or occupancy mark of the corresponding first image. Based on this timestamp, the billet number spraying moment of the corresponding continuous casting billet can be known.

[0035] The occupancy mark is used to record whether the billet number has been assigned to the continuous casting billet at the entrance of the slab yard. When the occupancy mark is set for the first billet number stored in the database, it means that it has been used as the billet number of the continuous casting billet at the entrance of the slab yard. If the occupancy mark is not added, it means that it has not been used as the billet number of the continuous casting billet at the entrance of the slab yard.

[0036] Step 140: Obtain the second image of the continuous casting billet captured by the second camera at the entrance of the slab yard.

[0037] In this embodiment, the continuous casting billet is a product of the pre-process of plate rolling. After the billet number is sprayed on the continuous casting billet, it will go through processes such as heating and rolling, and finally form a rolled plate. When entering the entrance of the slab yard, the billet number of the continuous casting billet needs to be checked again. After the above processes, the billet number sprayed on the continuous casting billet may become blurred, or be damaged or even fall off, making it difficult to accurately identify the billet number in the second image. Among them, the entrance of the slab yard can specifically be the entrance of the hot-rolled slab yard.

[0038] A second camera is set at the entrance of the slab yard. Similarly, the second camera can also be a high-definition camera or an industrial camera, and the second camera is installed at the entrance of the slab yard. Specifically, it can be at any suitable fixed position directly above, diagonally above, or diagonally below the entrance of the slab yard within a first distance range from the entrance of the slab yard. The second camera within this first distance range can capture a clear image including the cross-section of the continuous casting billet.

[0039] The second camera can capture the continuous casting billet flowing to the preset position at the entrance of the slab yard to form the second image of the corresponding continuous casting billet. Capturing the continuous casting billet at the preset position can improve the consistency between each second image. For example, the billet number in each captured second image is in a fixed area of the image, improving the efficiency of subsequent second image processing.

[0040] Step 150: Determine the billet number of the continuous casting billet at the entrance of the slab yard based on the second image, the first continuous casting billet features, and the first billet number stored in the database.

[0041] In this embodiment, for the captured second image, it can be compared with the first image stored in the database and its corresponding first continuous casting billet features and first billet number, and the first image that represents the same continuous casting billet as the second image is found from the database.

[0042] After finding the first image that represents the same continuous casting billet, the first billet number identified in the first image can be used as the billet number of the continuous casting billet at the entrance of the slab yard.

[0043] In the billet number identification method for the continuous casting billet slab of this application, a first camera is set at the billet spraying machine, and a second camera is set at the entrance of the slab yard. The images of the continuous casting billet are independently captured by the two cameras. Since the first image captured by the first camera contains the clear billet number of the continuous casting billet, after the second image captured by the second camera, it can be queried from the first billet number and the first continuous casting billet features stored in the first image to find the first image that represents the same continuous casting billet as the second image, and then determine the billet number of the continuous casting billet transferred to the entrance of the slab yard, improving the accuracy of billet number identification for continuous casting billets.

[0044] In one embodiment, Step 150 includes: extracting the second continuous casting billet features of the continuous casting billet at the entrance of the slab yard from the second image, and identifying the corresponding second billet number; performing optimization search from the database based on the first continuous casting billet features and the second billet number, and determining the billet number of the continuous casting billet at the entrance of the slab yard according to the optimization search result.

[0045] Similar to the first image, image preprocessing such as denoising, image enhancement, illumination equalization, and geometric correction can be performed on the second image to obtain the preprocessed second image.

[0046] Perform second continuous casting billet feature extraction and second billet number identification on the preprocessed second image. The second continuous casting billet features refer to the multi-dimensional feature set extracted from the second image that can uniquely identify or distinguish different continuous casting billets. These features include the physical attributes of the continuous casting billet itself (such as size and shape) and the geometric and physical characteristics of the sprayed number characters (such as position, font, and ink characteristics).

[0047] The specific second continuous casting billet features may include one or more of the second dimension features of the continuous casting billet, the second spraying feature of the second billet number, the second surface texture feature of the continuous casting billet, etc. After the continuous casting billet is transferred from the continuous casting billet number spraying machine to the entrance of the slab yard, the obtained second continuous casting billet features may not be exactly the same as the first continuous casting billet features. For example, the oxidation degree, the color of the sprayed billet number, the color of the continuous casting billet, etc. have all changed, but there will still be some features that have not changed.

[0048] For the second image, the billet number (i.e., the second billet number) therein can be recognized. Optionally, when the second billet number is recognized, the confidence level and integrity of the second billet number can be recognized. The confidence level is used to reflect the accuracy of the characters in the recognized billet number. The electronic device has pre-set the naming rules for the billet numbers of the continuous casting billets, such as the spraying area of the billet number, the length of the billet number, whether the billet number at each position should be a number, a letter, or other special characters, etc. Specifically, the confidence level may include the individual confidence levels for each character in the billet number and the overall confidence level of the recognized second billet number.

[0049] Since the billet number in the second image may not be complete enough, the recognized second billet number is not unique either. The electronic device can recognize each possible second billet number from the spraying area in the second image and give the confidence level and integrity of each second billet number. Among them, the recognized second billet number may not be the complete billet number of the continuous casting billet.

[0050] After obtaining the second billet number, the first billet number matching the second billet number can be queried from the database. Since there may be multiple second billet numbers and the second billet number is not necessarily complete, the matching first billet numbers may also include multiple ones.

[0051] After matching the first billet numbers, further identify the consistency between the first continuous casting billet features corresponding to each matched first billet number and the second continuous casting billet features, and finally determine the billet number of the continuous casting billet at the entrance of the slab yard from the matched first billet numbers based on this consistency.

[0052] Optimizing in the database based on the recognized second billet number can further improve the accuracy of determining the billet number of the continuous casting billet at the entrance of the slab yard.

[0053] In one embodiment, optimizing from the database based on the first continuous casting billet features and the second billet number, and determining the billet number of the continuous casting billet at the entrance of the slab yard according to the optimization result, includes: querying the first continuous casting billet features that are consistent with the second continuous casting billet features from the database, and querying the first billet numbers that are consistent with the second billet number; when the queried first continuous casting billet features that meet the consistency and the first billet numbers that meet the consistency belong to the same image, taking the first billet number as the billet number of the continuous casting billet.

[0054] In this embodiment, consistency represents the degree of matching between two objects (the first continuous casting billet feature and the second continuous casting billet feature, as well as the first billet number and the second billet number). This matching is not exactly the same, but rather a similarity determination within an error range. For example, when the preset matching degree threshold is exceeded, the two objects are considered to have consistency.

[0055] Regarding the consistency of continuous casting billet features, the similarity between the first continuous casting billet feature and the second continuous casting billet feature in the database can be identified in one or more dimensions such as the size of the continuous casting billet, the stamping feature of the billet number, and the surface texture. Based on the similarity of each dimension, the matching degree between the two continuous casting billet features is calculated, and the first continuous casting billet feature that exceeds the preset matching degree threshold is used as the first continuous casting billet feature that meets the consistency.

[0056] Regarding the consistency of billet numbers, the electronic device can detect the matching degree of the text content between each first billet number and the second billet number stored in the database, and consider cases where there is a complete match (indicating that the text of the two billet numbers is exactly the same), a prefix match (indicating that the second billet number is the prefix of the first billet number, for example, the second billet number "20250520-00" and the first billet number "20250520-001A" belong to a prefix match), a logical reasoning match (indicating a match formed by complementing the incomplete part in combination with production rules, for example, the incomplete first billet number "202505" is logically deduced to "20250520", and its logical reasoning match with the first billet number containing "20250520"), etc. One or more first billet numbers in these matching situations are used as the first billet numbers with consistency. It can be understood that the matching degrees corresponding to various matching situations such as complete match, prefix match, and logical reasoning match are different.

[0057] After the first billet numbers with consistency and the first continuous casting billet features with consistency are retrieved, it can be detected whether each first continuous casting billet feature and each first billet number belong to the same first image.

[0058] When only one of the first continuous casting billet features and one of the first billet numbers belong to the same image, the billet number corresponding to the same image is used as the billet number of the continuous casting billet at the entrance of the slab library.

[0059] When multiple first continuous casting billet features and first billet numbers belong to the same image, the consistency degree of the billet number (such as the size of the matching degree) and the consistency degree of the continuous casting billet feature (such as the size of the matching degree) are comprehensively considered, the comprehensive matching degree is calculated, and the billet number corresponding to the first image with the largest comprehensive matching degree among those belonging to the same image is used as the billet number of the continuous casting billet at the entrance of the slab library.

[0060] In one embodiment, before using the first billet number as the billet number of the continuous casting billet, the method further includes: detecting whether there is an occupancy mark for the first billet number that is identified as meeting the consistency. When there is an occupancy mark, query again for the first billet number that is consistent with the second billet number. When there is no occupancy mark, use the first billet number as the billet number of the continuous casting billet. The occupancy mark indicates that the corresponding first billet number has already been used as the billet number of the continuous casting billet at the entrance of the slab yard.

[0061] Specifically, in step 150, before determining the billet number of the continuous casting billet at the entrance of the slab yard, it is further detected whether there is an occupancy mark for the first billet number that is about to be used as the continuous casting billet at the entrance of the slab yard.

[0062] When there is no occupancy mark, it indicates that the first billet number has not been used as the billet number of the continuous casting billet at the entrance of the slab yard. At this time, the first billet number can be used as the billet number of the continuous casting billet at the entrance of the slab yard (abbreviated as "current continuous casting billet").

[0063] When there is an occupancy mark, it indicates that the first billet number has been assigned to the previous continuous casting billet at the entrance of the slab yard (abbreviated as "previous continuous casting billet") before. At this time, it is necessary to re-identify the billet number of the continuous casting billet.

[0064] Further, when there is an occupancy mark, the comprehensive matching degree of the current continuous casting billet can be compared with that of the previous continuous casting billet. If the comprehensive matching degree of the current continuous casting billet is smaller, return to re-identify the billet number of the continuous casting billet. If the comprehensive matching degree of the current continuous casting billet is larger, it means that the first billet number is more suitable as the billet number of the current continuous casting billet, but it has been marked as the billet number of the previous continuous casting billet. At this time, the first billet number can be temporarily used as the billet number of the current continuous casting billet, and at the same time, a prompt message for the repetition of the billet number of the corresponding continuous casting billet is generated to prompt the relevant staff to check the correctness of the billet number of the current continuous casting billet and the previous continuous casting billet, and correct the billet number of the continuous casting billet in time.

[0065] In one embodiment, the oxidation characteristic of the continuous casting billet is included in the characteristics of the second continuous casting billet.

[0066] In this embodiment, the oxidation characteristic is used to reflect the oxidation degree and oxidation distribution characteristics on the surface of the continuous casting billet. Through the oxidation characteristic, the elapsed time (i.e., spraying duration) after the billet number is sprayed can be inferred.

[0067] After obtaining the second image and performing preprocessing, the preprocessed second image can be converted from the RGB color space to the HSV color space. Based on the performance of oxidation in the HSV color space, as well as morphological segmentation and texture analysis, it can be determined whether there is oxidation in each region and the oxidation degree, so as to obtain the oxidation characteristic of the continuous casting billet.

[0068] As shown Figure 2 in the figure, optimization is performed based on the first continuous casting billet characteristics and the second billet number from the database, and the billet number of the continuous casting billet at the entrance of the slab yard is determined according to the optimization result, including: Step 210, identifying the spraying duration of the billet number corresponding to the continuous casting billet based on the oxidation characteristics.

[0069] In this embodiment, the electronic device has previously established a spraying duration calculation model, which can be a random forest model. By training the calculation model according to the oxidation characteristics included in the historical second image and the corresponding marked spraying duration, a trained spraying duration calculation model is obtained.

[0070] Optionally, in the normal process, when the continuous casting billet at the continuous casting billet number spraying machine flows to the entrance of the slab yard, the time required for relevant process treatment is within dozens of minutes to several hours; when special reasons occur, such as when the continuous casting billet in the transfer process needs to be taken offline for other special treatments and then transferred to the slab yard, the time consumed will exceed this normal time, such as it may exceed 10 hours or even exceed one day.

[0071] By inputting the oxidation characteristics of the second image into the trained spraying duration calculation model and running the spraying duration calculation model, the spraying duration of the billet number of the continuous casting billet is obtained.

[0072] Step 220, identifying the first billet number similar to the second billet number in the database.

[0073] In this embodiment, the identification of the first billet number is the same as the above identification process, and the previously identified first billet number that meets the consistency can be used as the first billet number similar to the second billet number. For example, when the matching degree between the first billet number and the second billet number exceeds the preset matching degree threshold, it is used as the first billet number similar to the second billet number. It can be understood that the number of similar first billet numbers can be one or more, and the similarity degree (i.e., the matching degree) of each identified first billet number is not necessarily the same.

[0074] Step 230, calculating the first matching degree between the first continuous casting billet characteristics corresponding to the identified first billet number and the second continuous casting billet characteristics.

[0075] Similarly, for the identified first billet number, its corresponding first continuous casting billet characteristics can be extracted, and the first matching degree between the first continuous casting billet characteristics and the second continuous casting billet characteristics can be calculated. The first matching degree can represent the consistency degree of the above-mentioned continuous casting billet characteristics.

[0076] In one embodiment, the first matching degree is related to one or more of the size feature, the spraying feature, the surface texture feature, etc. of the continuous casting billet among the two continuous casting billet features, and the first matching degree can be comprehensively determined based on the similarity between the one or more factors.

[0077] Specifically, the first continuous casting billet feature includes the first size feature of the continuous casting billet, the first spraying feature of the first billet number, and the first surface texture feature; the second continuous casting billet feature further includes the second size feature of the continuous casting billet, the second spraying feature of the second billet number, and the second surface texture feature. Step 230 includes: calculating a first similarity between the first size feature and the second size feature; calculating a second similarity between the first spraying feature and the second spraying feature; calculating a third similarity between the first surface texture feature and the second surface texture feature; calculating the first matching degree based on the first similarity, the second similarity, and the third similarity.

[0078] In this embodiment, for the first similarity of the size feature, the length and width between the two size features can be calculated, and the first similarity can be obtained by using a normalized Euclidean distance calculation model. For the second similarity between the spraying features, the similarity of the shape and size of each character and the similarity of the character color can be calculated, and finally the second similarity can be obtained. For the third similarity of the texture feature, the matching degree between the LBP histograms of the surface texture features can be calculated to obtain the third similarity.

[0079] Furthermore, the weights of each dimension (size feature, spraying feature, texture feature) are preset. After calculating the three similarities, a weighted sum is performed based on the set weights to obtain the first matching degree.

[0080] Step 240, calculate a second matching degree between the generation time of the first image corresponding to the first billet number identified and the spraying duration.

[0081] The generation time of the first image is the above-mentioned shooting timestamp. Similarly, the second image also has a corresponding shooting timestamp (i.e., the generation time of the second image). Specifically, the shooting time interval between the first image and the second image can be calculated, and the absolute value of the time difference between the shooting time interval and the spraying duration can be calculated. The second matching degree is calculated based on the absolute value of the time difference. It can be understood that the smaller the absolute value of the time difference, the greater the second matching degree.

[0082] Step 250, determine the billet number of the continuous casting billet at the entrance of the slab yard based on the first matching degree and the second matching degree.

[0083] In this embodiment, the weights of the first matching degree and the second matching degree are also set. By performing weighted summation on the first matching degree and the second matching degree, the above-mentioned comprehensive matching degree can be obtained, and the billet number corresponding to the first image with the largest comprehensive matching degree is selected as the billet number of the continuous casting billet at the entrance of the slab yard.

[0084] In one implementation, step 250 includes: determining the billet number of the continuous casting billet at the entrance of the slab yard based on the similarity between the first matching degree, the second matching degree, the first billet number, and the second billet number.

[0085] When obtaining similar first billet numbers, the similarity between the two billet numbers can also be obtained. This similarity can be regarded as a factor, and a weight can be set for it. By performing weighted summation on the first matching degree, the second matching degree, and the similarity, the comprehensive matching degree can be obtained, which can improve the accuracy of calculating the comprehensive matching degree.

[0086] In one embodiment, optimizing from the database based on the first continuous casting billet characteristics and the second billet number, and determining the billet number of the continuous casting billet at the entrance of the slab yard according to the optimization result, includes: when the confidence of the identified second billet number exceeds the preset first confidence threshold, and the billet number integrity of the second billet number exceeds the first completion threshold, query the database to check if there is a first billet number that is exactly the same as the second billet number. When there is, the second billet number is used as the billet number of the continuous casting billet at the entrance of the slab yard.

[0087] In this embodiment, the second billet number can be identified by the optical character recognition (OCR) technology. For the identified second billet number, its confidence and integrity can be given. The confidence includes the individual confidence for each character in the billet number and the overall confidence of the identified second billet number. The final confidence is calculated based on the individual confidence and the overall confidence. This confidence can be the weighted summation of the individual confidences and the overall confidence.

[0088] It can be understood that the weights of the confidences of the characters in each position are not necessarily the same. Based on the naming rules of the billet numbers, for the billet numbers of the same batch of continuous casting billets or the continuous casting billets produced within a certain period of time, some of the characters are the same. For example, for the billet numbers produced on the same day, the first N symbols are the same, and only the last M symbols are different. Based on this, the weights corresponding to the first N symbols can be set relatively low, and the weights of the last M symbols can be set relatively high.

[0089] For the second image taken, when identifying its second billet number, if the confidence of a certain position character or the overall confidence identified is relatively low, the second billet number of the previous continuous casting billet corresponding to this second image can be referred to for confirmation to improve the identification accuracy of the second billet number.

[0090] It is understandable that the integrity reflects the proportion of the recognizable characters in the second billet number to the total number of characters in the standard billet number. The larger the proportion, the higher the integrity.

[0091] It is understandable that the first confidence threshold and the first integrity threshold can be any suitable values set arbitrarily. For example, the first confidence threshold can be set to 95%, and the first integrity threshold can be set to 98%.

[0092] When the recognized integrity exceeds the first integrity threshold and the confidence exceeds the preset first confidence threshold, the exactly same first billet number retrieved can be directly used as the billet number of the continuous casting billet at the entrance of the slab library, so as to improve the efficiency of billet number determination.

[0093] In one embodiment, another method for identifying the billet number of a continuous casting billet slab is provided. Combining Figure 3 as shown, the method includes: Step 302, obtain a first image of the continuous casting billet captured by a first camera at the continuous casting billet spraying machine.

[0094] The captured first image can be a continuous casting billet that has just been sprayed with the billet number not long ago, and the billet number on it is basically the clearest.

[0095] Step 304, extract the first continuous casting billet feature of the continuous casting billet at the continuous casting billet spraying machine from the first image, and identify the first billet number of the continuous casting billet.

[0096] In this embodiment, the first billet number obtained from the first image has a high confidence and integrity, and it can be used to represent the billet number of the corresponding continuous casting billet. The first continuous casting billet feature can include the first size feature of the continuous casting billet, the first spraying feature of the first billet number, and the first surface texture feature.

[0097] Step 306, store the first continuous casting billet feature and the first billet number in the database.

[0098] The first image, the first continuous casting billet feature, and the first billet number can all be stored in the database and associated with each other. This association relationship indicates that the three belong to the same continuous casting billet. The database also correspondingly records the shooting timestamp (generation time) of the first image. For the first billet number that has been used as the billet number of the continuous casting billet at the entrance of the slab library, an occupancy mark is also set for it.

[0099] Step 308, obtain a second image of the continuous casting billet captured by a second camera at the entrance of the slab library.

[0100] The continuous casting billet in the second image usually has undergone processes such as heating and rolling, and the clarity of the billet number on it is lower than that of the billet number in the first image.

[0101] Step 310, call a preset graph attention network model to extract the second continuous casting billet features of the continuous casting billet at the entrance of the slab yard from the second image.

[0102] In this embodiment, the second continuous casting billet features include the second dimensional features of the continuous casting billet, the second printing features of the second billet number, the second surface texture features, and the oxidation features of the continuous casting billet. The graph attention network model is a pre-trained model, which includes an input layer, a feature extraction layer, a graph attention layer, and an output layer.

[0103] By preprocessing the second image and inputting the preprocessed second image into the network model for analysis. The feature extraction layer uses ResNet-50 to extract image features. For example, the output feature map size is 16×16×2048, and then the feature map is divided into a preset number of nodes, and each node corresponds to a local region feature vector. For example, the feature map is divided into 16×16 = 256 nodes.

[0104] In the graph attention layer, a multi-head attention mechanism is adopted (such as 8 attention heads or 4 attention heads, etc.). Each head independently calculates the attention weights, and the multi-head outputs are concatenated and fused through a fully connected layer, and the generated second continuous casting billet feature vector is output in the output layer.

[0105] Step 312, identify the second billet number from the second continuous casting billet features, and output the confidence and integrity of the second billet number.

[0106] Step 314, when the confidence of the identified second billet number exceeds a preset first confidence threshold, and the billet number integrity of the second billet number exceeds the first integrity threshold, query the database to check if there is a first billet number that is exactly the same as the second billet number. When there is an exact match and the first billet number has no occupancy mark, use the second billet number as the billet number of the continuous casting billet at the entrance of the slab yard.

[0107] Step 316, when the confidence of the identified second billet number does not exceed the preset first confidence threshold, or the billet number integrity of the second billet number does not exceed the first integrity threshold, identify the first billet number similar to the second billet number in the database.

[0108] In this embodiment, for the identified first billet numbers, if there are multiple of them, when one of them is exactly the same as the first billet number, and the confidence of the second billet number exceeds the first confidence threshold and the billet number integrity of the second billet number exceeds the first integrity threshold, directly use the exactly the same and unoccupied first billet number as the billet number of the continuous casting billet at the entrance of the slab yard.

[0109] When the first billet number is not unique, and the confidence level of the second billet number does not exceed the preset first confidence level threshold, or the completeness of the billet number of the second billet number does not exceed the first completion threshold, it is necessary to consider multiple factors such as the matching degree between continuous casting billet features and the spraying duration to determine the billet number.

[0110] The similarity between the first billet number and the second billet number can be determined by analyzing one or more of the following factors: geometric feature similarity, character feature similarity, spray printing feature similarity, texture feature similarity, etc.

[0111] The geometric feature similarity includes the size similarity of the billet number and the position similarity of the billet number. The character similarity includes complete character matching and geometric similarity of incomplete characters. When the characters are complete, the character contents are directly compared to check whether they match exactly; for incomplete characters, the geometric feature similarity between the two can be compared to finally obtain the character similarity. For the spray printing feature, the color and edge features between the two can be compared to obtain the spray printing feature similarity. For the texture feature, the similarity between the textures within the spraying area can be compared.

[0112] After obtaining the similarities of the above multiple factors, weighted summation can be performed to obtain the final similarity, and the first billet number exceeding the preset similarity threshold is used as the first billet number similar to the second billet number.

[0113] Step 318, calculate the first matching degree between the first continuous casting billet features corresponding to the identified first billet number and the second continuous casting billet features.

[0114] Specifically, calculate the first similarity between the first size feature and the second size feature; calculate the second similarity between the first spray printing feature and the second spray printing feature; calculate the third similarity between the first surface texture feature and the second surface texture feature; calculate the first matching degree based on the first similarity, the second similarity, and the third similarity.

[0115] Step 320, identify the spraying duration of the billet number corresponding to the continuous casting billet based on the oxidation feature.

[0116] Specifically, input the oxidation feature of the second image into the trained spraying duration calculation model to obtain the spraying duration of the billet number.

[0117] Step 322, calculate the second matching degree between the generation time of the first image corresponding to the identified first billet number and the spraying duration.

[0118] Specifically, calculate the shooting time interval between the first image and the second image, and calculate the second matching degree based on the shooting time interval and the spraying duration.

[0119] Step 324: Determine the billet number of the continuous casting billet at the entrance of the slab yard based on the first matching degree and the second matching degree.

[0120] Specifically, by setting the weights of each matching degree, performing weighted summation on them to obtain the comprehensive matching degree, and taking the first billet number with the highest comprehensive matching degree and without an occupancy mark as the billet number of the continuous casting billet at the entrance of the slab yard.

[0121] After determining the billet number of the continuous casting billet at the entrance of the slab yard, set an occupancy mark for the corresponding first billet number.

[0122] The above billet number identification method for continuous casting billet slabs comprehensively considers the consistency (matching degree) of the billet numbers of the continuous casting billets between the first image and the second image, the matching of the continuous casting billet features, and the matching of the spraying duration, and finally determines the billet number of the continuous casting billet at the entrance of the slab yard, improving the accuracy of billet number determination.

[0123] In one embodiment, as Figure 4 shown, a billet number identification device for continuous casting billet slabs is provided. The device includes: A first image acquisition module 410, configured to acquire a first image of the continuous casting billet captured by a first camera at the continuous casting billet spraying machine.

[0124] A first image processing module 420, configured to extract the first continuous casting billet features of the continuous casting billet at the continuous casting billet spraying machine from the first image and identify the first billet number of the continuous casting billet.

[0125] A data storage module 430, configured to store the first continuous casting billet features and the first billet number in a database.

[0126] A second image acquisition module 440, configured to acquire a second image of the continuous casting billet captured by a second camera at the entrance of the slab yard.

[0127] A billet number determination module 450, configured to determine the billet number of the continuous casting billet at the entrance of the slab yard based on the second image and the first continuous casting billet features and the first billet number stored in the database.

[0128] In one embodiment, the billet number determination module 450 is further configured to extract the second continuous casting billet features of the continuous casting billet at the entrance of the slab yard from the second image and identify the corresponding second billet number; perform optimization search in the database based on the first continuous casting billet features and the second billet number, and determine the billet number of the continuous casting billet at the entrance of the slab yard according to the optimization search result.

[0129] In one embodiment, the billet number determination module 450 is further configured to query from the database the first continuous casting billet features that are consistent with the second continuous casting billet features, and query the first billet numbers that are consistent with the second billet numbers; when the first continuous casting billet features that meet the consistency and the first billet numbers that meet the consistency belong to the same image, use the first billet number as the billet number of the continuous casting billet.

[0130] In one embodiment, the billet number determination module 450 is further configured to detect whether there is an occupancy mark for the identified first billet number that meets the consistency. When there is an occupancy mark, re-query the first billet numbers that are consistent with the second billet numbers. When there is no occupancy mark, execute using the first billet number as the billet number of the continuous casting billet. The occupancy mark indicates that the corresponding first billet number has been used as the billet number of the continuous casting billet at the entrance of the slab yard.

[0131] In one embodiment, the billet number determination module 450 is further configured to identify the billet number spraying duration corresponding to the continuous casting billet based on the oxidation characteristics; identify the first billet numbers similar to the second billet number in the database; calculate the first matching degree between the first continuous casting billet features corresponding to the identified first billet number and the second continuous casting billet features; calculate the second matching degree between the generation time of the first image corresponding to the identified first billet number and the spraying duration; determine the billet number of the continuous casting billet at the entrance of the slab yard based on the first matching degree and the second matching degree.

[0132] In one embodiment, the billet number determination module 450 is further configured to calculate the first similarity between the first dimensional feature and the second dimensional feature; calculate the second similarity between the first printing feature and the second printing feature; calculate the third similarity between the first surface texture feature and the second surface texture feature; calculate the first matching degree based on the first similarity, the second similarity, and the third similarity.

[0133] In one embodiment, the billet number determination module 450 is further configured to, when the confidence level of the identified second billet number exceeds a preset first confidence threshold and the billet number integrity of the second billet number exceeds a first completion threshold, query from the database whether there is a first billet number that is exactly the same as the second billet number. When there is, use the second billet number as the billet number of the continuous casting billet at the entrance of the slab yard.

[0134] In one embodiment, a computer-readable storage medium is provided, on which executable instructions are stored. When the instructions are executed by a processor, the processor executes the steps in the above method embodiments.

[0135] In one embodiment, an electronic device is further provided, including one or more processors; a memory, and one or more programs are stored in the memory. Wherein, when the one or more programs are executed by the one or more processors, the one or more processors execute the steps in the above method embodiments.

[0136] In one embodiment, as Figure 5 shown, it shows a schematic structural diagram of an electronic device for implementing the embodiments of the present application. The electronic device 500 includes a central processing unit (CPU) 501, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 502 or the program loaded from the storage section 508 into the random access memory (RAM) 503. In the RAM 503, various programs and data required for the operation of the electronic device 500 are also stored. The CPU 501, ROM 502, and RAM 503 are connected to each other via a bus 504. The input / output (I / O) interface 505 is also connected to the bus 504.

[0137] The following components are connected to the I / O interface 505: an input section 506 including a keyboard, a mouse, etc.; an output section 507 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc. and a speaker, etc.; a storage section 508 including a hard disk, etc.; and a communication section 509 including a network interface card such as a LAN card, a modem, etc. The communication section 509 performs communication processing via a network such as the Internet. A drive 510 is also connected to the I / O interface 505 as required. A removable medium 511, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 510 as required, so that a computer program read from it can be installed into the storage section 508 as required.

[0138] Specifically, according to the embodiments of the present application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, the embodiments of the present application include a computer program product including a computer-readable medium carrying instructions. In such an embodiment, the instructions can be downloaded and installed from the network through the communication section 509, and / or installed from the removable medium 511. When the instructions are executed by the central processing unit (CPU) 501, the various method steps described in the present application are executed.

[0139] Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and are not intended to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: they can still modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements on some or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present application.

[0140] In addition, those skilled in the art will understand that although some embodiments herein include certain features included in other embodiments but not others, the combination of features of different embodiments is meant to be within the scope of this application and forms different embodiments. For example, all of the above embodiments can be used in any combination. The information disclosed in this background section is only intended to enhance the understanding of the overall background of this application and should not be regarded as an admission or any form of suggestion that this information constitutes prior art already known to those skilled in the art.

Claims

1. A method for identifying the billet number of a continuous casting slab, characterized in that, The method includes: Obtaining a first image of a continuous casting billet captured by a first camera at the continuous casting billet number spraying machine; Extracting first continuous casting billet features of the continuous casting billet at the continuous casting billet number spraying machine from the first image, and identifying a first billet number of the continuous casting billet, where the first continuous casting billet features include a first dimensional feature of the continuous casting billet, a first printing feature of the first billet number, and a first surface texture feature; Storing the first continuous casting billet features and the first billet number in a database; Obtaining a second image of the continuous casting billet captured by a second camera at the entrance of the slab yard; Extracting second continuous casting billet features of the continuous casting billet at the entrance of the slab yard from the second image, and identifying a corresponding second billet number, where the second continuous casting billet features further include a second dimensional feature of the continuous casting billet, a second printing feature of the second billet number, and a second surface texture feature; Performing optimization search in the database based on the first continuous casting billet features and the second billet number, and determining the billet number of the continuous casting billet at the entrance of the slab yard according to the optimization result.

2. The method according to claim 1, wherein The performing optimization search in the database based on the first continuous casting billet features and the second billet number, and determining the billet number of the continuous casting billet at the entrance of the slab yard according to the optimization result includes: Querying in the database for first continuous casting billet features that are consistent with the second continuous casting billet features, and querying for a first billet number that is consistent with the second billet number; When the queried first continuous casting billet features that meet the consistency and the first billet number that meets the consistency belong to the same image, taking the first billet number as the billet number of the continuous casting billet.

3. The method according to claim 2, characterized in that Before taking the first billet number as the billet number of the continuous casting billet, the method further includes: Detecting whether there is an occupancy mark for the identified first billet number that meets the consistency. When there is an occupancy mark, re-querying for a first billet number that is consistent with the second billet number. When there is no occupancy mark, performing the step of taking the first billet number as the billet number of the continuous casting billet, where the occupancy mark indicates that the corresponding first billet number has already been taken as the billet number of the continuous casting billet at the entrance of the slab yard.

4. The method according to claim 1, characterized in that, The second continuous casting billet features include an oxidation feature of the continuous casting billet; the performing optimization search in the database based on the first continuous casting billet features and the second billet number, and determining the billet number of the continuous casting billet at the entrance of the slab yard according to the optimization result includes: Identifying the spraying duration of the billet number corresponding to the continuous casting billet based on the oxidation feature; Identifying first billet numbers similar to the second billet number in the database; Calculating a first matching degree between the first continuous casting billet features corresponding to the identified first billet number and the second continuous casting billet features; Calculating a second matching degree between the generation time of the first image corresponding to the identified first billet number and the spraying duration; Determining the billet number of the continuous casting billet at the entrance of the slab yard based on the first matching degree and the second matching degree.

5. The method according to claim 4, wherein The calculating a first matching degree between the first continuous casting billet features corresponding to the identified first billet number and the second continuous casting billet features includes: Calculating a first similarity between the first dimensional feature and the second dimensional feature; Calculating a second similarity between the first printing feature and the second printing feature; Calculate a third similarity between the first surface texture feature and the second surface texture feature; Calculate the first matching degree based on the first similarity, the second similarity, and the third similarity.

6. The method according to claim 1, characterized in that The optimizing from the database based on the first continuous casting billet feature and the second billet number, and determining the billet number of the continuous casting billet at the entrance of the slab yard according to the optimization result includes: When the confidence of the identified second billet number exceeds a preset first confidence threshold and the integrity of the second billet number exceeds a first integrity threshold, query the database to check if there is a first billet number that is exactly the same as the second billet number. If it exists, use the second billet number as the billet number of the continuous casting billet at the entrance of the slab yard.

7. A billet number identification device for a continuous casting slab, characterized in that, The device includes: A first image acquisition module, configured to acquire a first image of a continuous casting billet captured by a first camera at the continuous casting billet number spraying machine; A first image processing module, configured to extract a first continuous casting billet feature of the continuous casting billet at the continuous casting billet number spraying machine from the first image, and identify a first billet number of the continuous casting billet. The first continuous casting billet feature includes a first dimension feature of the continuous casting billet, a first printing feature of the first billet number, and a first surface texture feature; A data storage module, configured to store the first continuous casting billet feature and the first billet number in a database; A second image acquisition module, configured to acquire a second image of a continuous casting billet captured by a second camera at the entrance of the slab yard; A billet number determination module, configured to extract a second continuous casting billet feature of the continuous casting billet at the entrance of the slab yard from the second image, and identify a corresponding second billet number. The second continuous casting billet feature further includes a second dimension feature of the continuous casting billet, a second printing feature of the second billet number, and a second surface texture feature; optimize from the database based on the first continuous casting billet feature and the second billet number, and determine the billet number of the continuous casting billet at the entrance of the slab yard according to the optimization result.

8. The device according to claim 7, characterized in that, The billet number determination module is further configured to query the database for a first continuous casting billet feature that is consistent with the second continuous casting billet feature, and query for a first billet number that is consistent with the second billet number; when the queried first continuous casting billet feature that meets the consistency and the first billet number that meets the consistency belong to the same image, use the first billet number as the billet number of the continuous casting billet.

9. A computer-readable storage medium, characterized in that, An executable instruction is stored on the computer-readable storage medium, and when the executable instruction is executed by a processor, the processor executes the method according to any one of claims 1 to 6.

10. An electronic device, characterized in that, Including: One or more processors; A memory, configured to store one or more programs, and when the one or more programs are executed by the one or more processors, the one or more processors execute the method according to any one of claims 1 to 6.

Images