A medium and thick plate material tracking method, device, equipment and medium

By using shooting equipment on the steel plate rolling production line for material tracking, the problems of low accuracy and high maintenance costs caused by the damage of the grating by the oxide iron sheet are solved, and more efficient material tracking and production management are achieved.

CN114399420BActive Publication Date: 2024-11-12BEIJING SHOUGANG AUTOMATION INFORMATION TECH
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202111595525.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-12-23
Publication Date
2024-11-12
Estimated Expiration
2041-12-23

AI Technical Summary

Technical Problem

In the prior art, when grating is used for material tracking, the high temperature of the steel plate entering the cold bed causes the iron oxide sheet to fall off, damage the grating, resulting in low material tracking accuracy and high maintenance costs.

Method used

The production line is photographed by shooting equipment. By obtaining the production line layout diagram and shooting parameters, the equipment layout position and quantity are determined, and the material tracking is tracked using image processing and machine learning models to avoid damage to the equipment by the iron oxide and improve tracking accuracy.

Benefits of technology

It reduces the failure rate and maintenance cost of shooting equipment, improves the accuracy of material tracking, facilitates production management of production lines, and improves production efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114399420B_ABST
    Figure CN114399420B_ABST
Patent Text Reader

Abstract

The present invention discloses a medium and thick plate material tracking method, device, equipment and medium, including: obtaining a production line layout diagram of a target medium and thick plate factory and shooting parameters of a target shooting device, the target shooting device is used to shoot a target production line in the target medium and thick plate factory; according to the production line layout diagram and the shooting parameters, determining the actual layout parameters of the target shooting device in the target medium and thick plate factory; wherein the actual layout parameters include the layout position and the layout quantity; when the target shooting device is laid out in the target medium and thick plate factory with the actual layout parameters, controlling the target shooting device to shoot the target production line of the medium and thick plate factory to obtain a target image; tracking the target material according to the target image. The present application can prevent the shooting device from being damaged by oxidized iron sheets, so that the failure rate of the shooting device is low and the maintenance cost is low; the actual image of the material on the production line can be obtained, and then it can be conveniently displayed to the relevant staff for viewing, which is more conducive to the production of the production line and ensures the production efficiency of production and sales.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to the field of rolling technology, and in particular to a medium and thick plate material tracking method, device, equipment and medium. Background Art

[0002] In the steel plate rolling production line, it is necessary to track the materials on the production line. In the related technology, the materials are mainly detected by grating, specifically, a large number of grating devices are deployed under the production line to determine the position of the steel plate.

[0003] However, since the temperature of the steel plate when entering the cooling bed is relatively high, reaching over 600°C, the grating set in this area is easily damaged by the iron oxide scale falling off the steel plate, resulting in low accuracy of material tracking. Summary of the invention

[0004] The embodiments of the present application solve the technical problem of low accuracy of material tracking using gratings in the prior art by providing a medium and thick plate material tracking method, device, equipment and medium, and achieve the technical effect of improving the accuracy of material tracking.

[0005] In a first aspect, the present application provides a method for tracking medium and thick plate materials, the method comprising:

[0006] Obtaining a production line layout diagram of a target medium and thick plate plant and shooting parameters of a target shooting device, where the target shooting device is used to shoot a target production line in the target medium and thick plate plant;

[0007] According to the production line layout diagram and shooting parameters, determine the actual layout parameters of the target shooting equipment in the target medium and thick steel plant; wherein the actual layout parameters include the layout position and the layout quantity;

[0008] When the target photographing device is arranged in the target medium and thick plate factory with the actual arrangement parameters, the target photographing device is controlled to photograph the target production line of the medium and thick plate factory to obtain a target image; wherein the target image includes an image of the target material on the target production line;

[0009] According to the target image, the target material is tracked.

[0010] Furthermore, according to the production line layout diagram and the shooting parameters, the actual layout parameters of the target shooting equipment in the target medium and thick steel plant are determined, including:

[0011] According to the production line layout diagram, a three-dimensional model of the target medium and thick plate plant is constructed, and the three-dimensional model includes a production line model of the target production line;

[0012] According to the shooting parameters, a shooting model corresponding to the target shooting device is constructed in the three-dimensional model;

[0013] Under the simulated layout parameters, the production line model is simulated photographed using the photographing model to obtain a first simulated image;

[0014] Determine whether a first coverage rate of the first simulation image for the production line model is greater than or equal to a target coverage rate;

[0015] When the first coverage rate is greater than or equal to the target coverage rate, the current simulated layout parameters are determined as actual layout parameters.

[0016] Further, when the first coverage is less than the target coverage, the method further includes:

[0017] Adjust simulation layout parameters;

[0018] Under the adjusted simulation layout parameters, the production line model is simulated photographed using the photographing model to obtain a second simulation image;

[0019] Determining whether a second coverage rate of the second simulation image for the production line model is greater than or equal to a target coverage rate;

[0020] When the second coverage is greater than or equal to the target coverage, the adjusted simulated layout parameters are determined as actual layout parameters.

[0021] Furthermore, the target shooting device is controlled to shoot the target production line of the medium and thick plate plant to obtain the target image, including:

[0022] Control the target shooting device to shoot the target production line and obtain the initial image;

[0023] The initial image is stabilized, stitched and perspective transformed to obtain the target image.

[0024] Furthermore, the target shooting device is controlled to shoot the target production line of the medium and thick plate plant to obtain the target image, including:

[0025] According to the shooting parameters, determine N different focal length values ​​corresponding to the target shooting device, where N is a positive integer;

[0026] Control the target shooting device to shoot the target production line at N different focal length values, and obtain N images to be selected corresponding to the N different focal length values;

[0027] A target image is determined from the N candidate images according to image qualities of the N candidate images.

[0028] Furthermore, before tracking the target material according to the target image, the method further includes:

[0029] Control the target shooting device to shoot the target production line and obtain sample images;

[0030] Label the target parameter items of the sample image;

[0031] According to the labeled sample images, the test set and training set are obtained;

[0032] According to the training set, the model to be trained is trained to obtain the model to be optimized;

[0033] According to the test set, the model to be optimized is optimized to obtain the target model, which is used to identify and track materials on the target production line.

[0034] Furthermore, according to the target image, the target material on the target production line is tracked, including:

[0035] The target image is input into the target model to track the target material.

[0036] In a second aspect, the present application provides a medium and thick plate material tracking device, the device comprising:

[0037] An acquisition module, used to acquire a production line layout diagram of a target medium and thick plate plant and shooting parameters of a target shooting device, where the target shooting device is used to shoot a target production line in the target medium and thick plate plant;

[0038] The actual layout parameter determination module is used to determine the actual layout parameters of the target shooting equipment in the target medium and thick plant according to the production line layout diagram and the shooting parameters; wherein the actual layout parameters include the layout position and the layout quantity;

[0039] A target image determination module is used to control the target shooting device to shoot the target production line of the medium and thick plate factory to obtain a target image when the target shooting device is deployed in the target medium and thick plate factory with actual deployment parameters; wherein the target image includes an image of a target material on the target production line;

[0040] The tracking module is used to track the target material according to the target image.

[0041] In a third aspect, the present application provides an electronic device, including:

[0042] processor;

[0043] a memory for storing processor-executable instructions;

[0044] The processor is configured to execute to implement a medium and thick plate material tracking method.

[0045] In a fourth aspect, the present application provides a non-temporary computer-readable storage medium, which, when the instructions in the storage medium are executed by a processor of an electronic device, enables the electronic device to implement a method for tracking medium and thick plate materials.

[0046] One or more technical solutions provided in the embodiments of the present application have at least the following technical effects or advantages:

[0047] This application realizes material tracking on the production line by using a camera to photograph the production line. On the one hand, since the camera is set higher than the production line, it can avoid the camera being damaged by oxidized iron sheets, so that the failure rate of the camera is low and the maintenance cost is low. On the other hand, the camera can be used to obtain the actual image of the material on the production line, which can then be conveniently displayed to relevant staff for viewing, which is more conducive to the production of the production line and ensures the production efficiency of production and sales. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0049] Figure 1 A schematic diagram of a process for tracking medium and thick plate materials provided in this application;

[0050] Figure 2 A schematic diagram of the structure of a medium and thick plate material tracking device provided in this application;

[0051] Figure 3 A schematic diagram of the structure of an electronic device provided in this application. DETAILED DESCRIPTION

[0052] The embodiment of the present application solves the technical problem of low accuracy of material tracking using gratings in the prior art by providing a method for tracking medium and thick plate materials.

[0053] The technical solution of the embodiment of the present application is to solve the above technical problems, and the overall idea is as follows:

[0054] A method for tracking medium and thick plate materials, the method comprising: obtaining a production line layout diagram of a target medium and thick plate factory and shooting parameters of a target shooting device, the target shooting device being used to shoot a target production line in the target medium and thick plate factory; determining actual layout parameters of the target shooting device in the target medium and thick plate factory according to the production line layout diagram and the shooting parameters; wherein the actual layout parameters include a layout position and a layout quantity; when the target shooting device is laid out in the target medium and thick plate factory with the actual layout parameters, controlling the target shooting device to shoot the target production line of the medium and thick plate factory to obtain a target image; wherein the target image includes an image of a target material on the target production line; and tracking the target material according to the target image.

[0055] This embodiment realizes material tracking on the production line by using a camera to photograph the production line. On the one hand, since the camera is set higher than the production line, it can avoid the camera being damaged by oxidized iron sheets, so that the failure rate of the camera is low and the maintenance cost is low. On the other hand, the camera can be used to obtain actual images of the materials on the production line, which can be conveniently displayed to relevant staff for viewing, which is more conducive to the production of the production line and ensures the production efficiency of production and sales.

[0056] In order to better understand the above technical solution, the above technical solution will be described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0057] First of all, the term "and / or" in this article is only a description of the association relationship of the associated objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.

[0058] In the related technology, gratings are mainly used to track materials. However, since the temperature of the steel plate is relatively high when it enters the cooling bed, the iron oxide scale on the steel plate is easy to fall off. When it falls on the grating, the grating is easily damaged. On the one hand, the grating is damaged, resulting in a significant reduction in the accuracy of material tracking. On the other hand, the grating needs to be replaced frequently, resulting in higher costs.

[0059] In order to solve the above technical problems, this embodiment provides Figure 1 A medium and thick plate material tracking method is shown, and the method includes steps S11 to S14.

[0060] Step S11, obtaining a production line layout diagram of a target medium and thick plate factory and shooting parameters of a target shooting device, where the target shooting device is used to shoot a target production line in the target medium and thick plate factory.

[0061] The production line layout diagram includes the flow direction of each production line, each process flow section on each production line, and the equipment components on the production line. The equipment components mainly include cooling beds, inspection stands, transverse stands and surrounding pillars.

[0062] This embodiment abandons the method of using grating tracking, and instead uses a camera to capture images and track materials through images. When using a camera to capture materials on the production line, the camera setting must be at a higher position than the production line, so that the iron oxide scale of the steel plate on the production line falls off, and it will not cause damage to the camera, thereby avoiding the camera being damaged by the iron oxide scale of the steel plate, avoiding frequent replacement of the camera, and reducing the maintenance cost of the camera later.

[0063] It should be noted that in this embodiment, the number of target shooting devices may be more than one, and the number of target production lines may be more than one.

[0064] Step S12, determining actual layout parameters of the target photography equipment in the target medium and thick steel plant according to the production line layout diagram and the photography parameters; wherein the actual layout parameters include the layout position and the layout quantity.

[0065] According to the shooting parameters of the target shooting equipment and the production line layout diagram, the layout position and layout quantity of the target shooting equipment in the target medium and thick steel plant are determined. The layout position can be determined according to the target production line (or process flow section) to be acquired by the target shooting equipment, and the layout quantity can be determined according to the shooting range of the target shooting equipment.

[0066] Step S13, when the target shooting device is deployed in the target medium and thick plate factory with actual deployment parameters, the target shooting device is controlled to shoot the target production line of the medium and thick plate factory to obtain a target image; wherein the target image includes an image of a target material on the target production line.

[0067] When the target photographing device is arranged in the target medium and thick plant according to the actual arrangement parameters, the target production line is photographed to obtain a target image containing the target material on the target production line. It should be noted that more than one target image may be obtained in this embodiment.

[0068] Since the image quality of the images obtained when the target shooting device shoots different images under the same shooting parameters is not necessarily the same, this embodiment adopts the following method when acquiring the target image, so that the image quality of the images obtained by different shooting devices when shooting different images is higher.

[0069] Step S21, determining N different focal length values ​​corresponding to the target shooting device according to the shooting parameters, where N is a positive integer;

[0070] Step S22, controlling the target shooting device to shoot the target production line at N different focal length values ​​respectively, to obtain N to-be-selected images corresponding to the N different focal length values;

[0071] Step S23: determining a target image from the N candidate images according to the image qualities of the N candidate images.

[0072] Steps S21 to S23 are performed for each of all deployed target shooting devices, so that the image quality obtained by each shooting device is relatively the best.

[0073] For example, the range between the minimum focal length and the maximum focal length of the target shooting device is divided into 50 levels, and the camera internal parameters and distortion coefficients corresponding to the focal length of each level are calculated using Zhang Zhengyou's calibration method; then, the images taken on site are subjected to distortion correction using 50 levels, and then the 50 images after distortion correction are analyzed to select the optimal image, and the target shooting device is bound to the level corresponding to the distortion-corrected image, so that the images obtained by the target shooting device in subsequent shooting processes are relatively the best.

[0074] In the process of each target shooting device obtaining the target image, the method further includes:

[0075] Step S31, controlling the target shooting device to shoot the target production line to obtain an initial image;

[0076] Step S32, performing anti-shake, splicing and perspective transformation on the initial image to obtain a target image.

[0077] All target shooting devices shoot the target production line. The image obtained by each target shooting device is called the initial image. Anti-shake processing is performed on each initial image. All initial images are stitched in sequence according to the flow direction of the production line to obtain a panoramic image. The image is then perspective transformed to convert the shot image from an oblique perspective to a perspective of shooting the production line vertically downward to obtain the target image.

[0078] Among them, the anti-shake processing can be implemented by edge detection based on the edge of the device in the picture. Specifically, the camera shake is within a fixed range, and the edge of the cooling bed (or inspection stand, horizontal moving stand) in the captured picture is a very obvious straight line. Opencv is used to perform edge detection within the specified range of the captured picture, and then the picture is moved to fix the edge at the specified position, so as to perform image anti-shake processing.

[0079] For example, there are four target shooting devices, which are M1, M2, M3, and M4 along the extension direction of the production line. The images obtained by the four target shooting devices are P1, P2, P3, and P4. P1, P2, P3, and P4 are respectively anti-shake and stitched to obtain a panoramic image, and then the panoramic image is perspective transformed to obtain a target image. The target image obtained after anti-shake, stitching, and perspective transformation determines that the material enters from one field of view to another, completing material tracking across shooting devices (images), which can improve the accuracy of material tracking.

[0080] Step S14: tracking the target material according to the target image.

[0081] The target image needs to cover the target production line as much as possible. The target image is analyzed and the target material can be tracked.

[0082] To summarize, this embodiment realizes material tracking on the production line by using a camera to photograph the production line. On the one hand, since the camera is set at a higher position than the production line, it can avoid the camera being damaged by oxidized iron sheets, so that the failure rate of the camera is low and the maintenance cost is low. On the other hand, the camera can be used to obtain the actual image of the material on the production line, which can then be conveniently displayed to relevant staff for viewing, which is more conducive to the production of the production line and ensures the production efficiency of production and sales.

[0083] On the basis of the above solution, this embodiment also provides a better technical solution, which is as follows:

[0084] When determining the actual layout parameters of the target shooting equipment in the target medium and thick plate mill based on the production line layout diagram and shooting parameters, the position of the shooting equipment can be manually adjusted in the medium and thick plate mill to determine the final placement of the target shooting equipment. Since the cooling bed, inspection stand and transverse stand of the medium and thick plate mill are generally large in area, taking the cooling bed as an example, its area is generally 80m*60m, and there are about two or three cooling beds in the factory, so the cost of this method is high, and there are safety hazards for personnel in the medium and thick plate mill. In addition to manual adjustment to determine the actual layout parameters, the actual layout parameters can also be determined by three-dimensional simulation, as follows:

[0085] Step S41, constructing a three-dimensional model of the target medium and thick plate plant according to the production line layout diagram, wherein the three-dimensional model includes a production line model of the target production line.

[0086] According to the production line layout diagram, a three-dimensional model of the target medium and thick plate plant is constructed using modeling tools. The three-dimensional model includes the production line model of the target production line, and the production line model includes a cooling bed model, an inspection bench model, a transverse bench model and surrounding pillar models.

[0087] Step S42: constructing a shooting model corresponding to the target shooting device in the three-dimensional model according to the shooting parameters.

[0088] According to the shooting parameters of the target shooting device, a shooting model is constructed in the three-dimensional model. The simulated actual layout parameters of the shooting model in the three-dimensional model can be adjusted at will.

[0089] Step S43: Under the simulated layout parameters, the production line model is simulated photographed using the photographing model to obtain a first simulated image.

[0090] The production line model is simulated photographed using the photographing model to obtain a first simulated image corresponding to the current simulated layout parameters of the photographing model.

[0091] Step S44, determining whether a first coverage rate of the first simulation image for the production line model is greater than or equal to a target coverage rate.

[0092] A first coverage rate of the production line model captured in the first simulation image is determined, and it is determined whether the first coverage rate is greater than or equal to a target coverage rate.

[0093] Step S45: when the first coverage is greater than or equal to the target coverage, the current simulated layout parameters are determined as actual layout parameters.

[0094] For example, the target coverage rate may be 99%. If the first coverage rate is equal to 100%, the first coverage rate is greater than the target coverage rate, indicating that the production line model can be fully covered under the current simulation layout parameters, and the current simulation layout parameters can be used as actual layout parameters.

[0095] Step S46: when the first coverage is less than the target coverage, adjust the simulation layout parameters.

[0096] Step S47, using the shooting model to simulate shooting of the production line model under the adjusted simulation layout parameters to obtain a second simulation image;

[0097] Step S48, determining whether the second coverage rate of the second simulation image for the production line model is greater than or equal to the target coverage rate;

[0098] Step S49: when the second coverage is greater than or equal to the target coverage, the adjusted simulated layout parameters are determined as actual layout parameters.

[0099] In addition, the number of shooting models can be optimized so that the target coverage can be achieved using a smaller number of shooting models, thereby reducing the number of shooting devices and reducing tracking costs.

[0100] To sum up, this embodiment determines the actual layout parameters of the target shooting equipment in the target medium and thick steel plant through three-dimensional simulation, which not only reduces the difficulty of determining the layout parameters, improves the efficiency of determining the layout parameters, but also reduces the cost of determining the layout parameters, and avoids the situation where layout personnel have to adjust the layout near the production line for a long time.

[0101] When the step S14 is specifically implemented, image analysis can be performed on each target image obtained to achieve material tracking, or image analysis can be automatically performed by machine learning to achieve material tracking, and the specific method is as follows:

[0102] Step S51, controlling the target shooting device to shoot the target production line to obtain a sample image;

[0103] Step S52, marking target parameter items of the sample image;

[0104] Step S53, obtaining a test set and a training set according to the labeled sample images;

[0105] Step S54, training the model to be trained according to the training set to obtain the model to be optimized;

[0106] Step S55, optimizing the model to be optimized according to the test set to obtain a target model, which is used to identify and track materials on the target production line.

[0107] Step S56, inputting the target image into the target model to track the target material.

[0108] The model to be trained can be an object detection algorithm model based on deep learning.

[0109] After the target shooting equipment is deployed in the medium and thick plate factory according to the layout parameters, the target shooting equipment can be used to shoot the target production line to obtain sample images. The number of sample images can be determined according to the accuracy of material tracking. Within a certain proficiency range, the more sample images there are, the higher the accuracy of the trained model will be, and the higher the accuracy of material tracking will be.

[0110] Label the sample images, divide the labeled sample images into training sets and test sets, use the training set to train the model to be trained, preliminarily determine the hyperparameters of the model to be trained, and obtain the model to be optimized. Use the test set to optimize the model to be optimized, adjust the hyperparameters in the model to be optimized, and obtain the final target model.

[0111] The target image obtained in step S13 is input into the target model, so that the material in the image can be automatically identified to achieve material tracking.

[0112] In summary, this embodiment uses a camera to shoot the target production line, which avoids damage to the camera by oxidized iron sheets, reduces the maintenance cost of the camera, and reduces the maintenance frequency of the camera. Tracking materials through image processing improves the accuracy of material tracking, and can also display material images in real time, which can more intuitively display the location of materials, realize material tracking, and provide an interface to send material location information to other systems in the factory, which is conducive to sharing information with other systems. Automatically track materials through machine learning models, thereby improving the efficiency of material tracking.

[0113] Based on the same inventive concept, this embodiment provides Figure 2 A medium and thick plate material tracking device is shown, the device comprising:

[0114] An acquisition module 21 is used to acquire a production line layout diagram of a target medium and thick plate factory and shooting parameters of a target shooting device, where the target shooting device is used to shoot a target production line in the target medium and thick plate factory;

[0115] The actual layout parameter determination module 22 is used to determine the actual layout parameters of the target shooting equipment in the target medium and thick steel plant according to the production line layout diagram and the shooting parameters; wherein the actual layout parameters include the layout position and the layout quantity;

[0116] The target image determination module 23 is used to control the target shooting device to shoot the target production line of the medium and thick plate factory to obtain a target image when the target shooting device is deployed in the target medium and thick plate factory with actual deployment parameters; wherein the target image includes an image of a target material on the target production line;

[0117] The tracking module 24 is used to track the target material according to the target image.

[0118] Furthermore, the actual deployment parameter determination module 22 includes:

[0119] A three-dimensional model building submodule is used to build a three-dimensional model of a target medium and thick plate plant according to a production line layout diagram, wherein the three-dimensional model includes a production line model of the target production line;

[0120] A shooting model building submodule is used to build a shooting model corresponding to the target shooting device in the three-dimensional model according to the shooting parameters;

[0121] A first simulation image determination module is used to simulate shooting of the production line model using the shooting model under the simulation layout parameters to obtain a first simulation image;

[0122] A coverage rate judgment submodule, used to judge whether a first coverage rate of the first simulation image for the production line model is greater than or equal to a target coverage rate;

[0123] The actual layout parameter determination submodule is used to determine the current simulation layout parameters as actual layout parameters when the first coverage rate is greater than or equal to the target coverage rate.

[0124] A simulation layout parameter adjustment submodule, used for adjusting the simulation layout parameters when the first coverage rate is less than the target coverage rate;

[0125] A second simulation image determination module is used to simulate shooting the production line model using the shooting model under the adjusted simulation layout parameters to obtain a second simulation image;

[0126] A coverage rate judgment submodule, used to judge whether a second coverage rate of the second simulation image for the production line model is greater than or equal to a target coverage rate;

[0127] The actual layout parameter determination submodule is used to determine the adjusted simulation layout parameters as the actual layout parameters when the second coverage is greater than or equal to the target coverage.

[0128] Furthermore, the target image determination module 23 includes:

[0129] The initial image acquisition submodule is used to control the target shooting device to shoot the target production line to obtain the initial image;

[0130] The processing submodule is used to perform anti-shake, splicing and perspective transformation on the initial image to obtain the target image.

[0131] Furthermore, the target image determination module 23 includes:

[0132] A focal length division submodule, used to determine N different focal length values ​​corresponding to the target shooting device according to the shooting parameters, where N is a positive integer;

[0133] The candidate image determination submodule is used to control the target shooting device to shoot the target production line at N different focal length values ​​to obtain N candidate images corresponding to the N different focal length values;

[0134] The target image determination submodule is used to determine a target image from the N candidate images according to the image qualities of the N candidate images.

[0135] Furthermore, the device also includes:

[0136] A sample image determination module is used to control the target shooting device to shoot the target production line to obtain a sample image;

[0137] A labeling module, used to label target parameter items of sample images;

[0138] A partitioning module is used to obtain a test set and a training set based on the labeled sample images;

[0139] The module for determining the model to be optimized is used to train the model to be trained according to the training set to obtain the model to be optimized;

[0140] The target model determination module is used to optimize the model to be optimized according to the test set to obtain the target model, and the target model is used to identify and track materials on the target production line.

[0141] The tracking module 24 is used to input the target image into the target model to track the target material.

[0142] Based on the same inventive concept, this embodiment provides Figure 3 An electronic device as shown includes:

[0143] Processor 31;

[0144] A memory 32 for storing instructions executable by the processor 31;

[0145] The processor 31 is configured to execute to implement a medium and thick plate material tracking method.

[0146] Based on the same inventive concept, this embodiment provides a non-temporary computer-readable storage medium. When the instructions in the storage medium are executed by the processor 31 of the electronic device, the electronic device can execute a method for tracking medium and thick plate materials.

[0147] Since the electronic device introduced in this embodiment is an electronic device used to implement the information processing method in the embodiment of the present application, based on the information processing method introduced in the embodiment of the present application, a person skilled in the art can understand the specific implementation of the electronic device of the present embodiment and its various variations, so how the electronic device implements the method in the embodiment of the present application is not described in detail here. As long as a person skilled in the art implements the electronic device used by the information processing method in the embodiment of the present application, it belongs to the scope of protection of this application.

[0148] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0149] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0150] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0151] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0152] Although the preferred embodiments of the present invention have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present invention.

[0153] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. A medium and thick plate material tracking method, characterized in that: The method comprises: Acquire a production line layout diagram of a target medium and thick plate factory and shooting parameters of a target shooting device, wherein the target shooting device is used to shoot a target production line in the target medium and thick plate factory; According to the production line layout diagram and the shooting parameters, determining the actual layout parameters of the target shooting equipment in the target medium and thick plant; wherein the actual layout parameters include the layout position and the layout quantity; When the target photographing device is arranged in the target medium and thick plate factory with the actual arrangement parameters, the target photographing device is controlled to photograph the target production line of the medium and thick plate factory to obtain a target image; wherein the target image includes an image of a target material on the target production line; Tracking the target material according to the target image; The step of determining actual layout parameters of the target shooting equipment in the target medium and thick steel plant according to the production line layout diagram and the shooting parameters includes: According to the production line layout diagram, a three-dimensional model of the target medium and thick plate plant is constructed, wherein the three-dimensional model includes the production line model of the target production line; according to the shooting parameters, a shooting model corresponding to the target shooting device is constructed in the three-dimensional model; under the simulated layout parameters, the production line model is simulatedly photographed using the shooting model to obtain a first simulated image; it is determined whether a first coverage rate of the first simulated image for the production line model is greater than or equal to a target coverage rate; when the first coverage rate is greater than or equal to the target coverage rate, the current simulated layout parameters are determined as the actual layout parameters; The controlling the target shooting device to shoot the target production line of the medium and thick plate factory to obtain the target image includes: controlling the target shooting device to shoot the target production line to obtain an initial image; and performing anti-shake, splicing and perspective transformation on the initial image to obtain the target image.

2. The method according to claim 1, characterized in that When the first coverage rate is less than the target coverage rate, the method further includes: adjusting the simulation layout parameters; Under the adjusted simulated layout parameters, using the shooting model to simulate shooting of the production line model to obtain a second simulated image; Determining whether a second coverage rate of the second simulation image for the production line model is greater than or equal to the target coverage rate; When the second coverage rate is greater than or equal to the target coverage rate, the adjusted simulation layout parameters are determined as the actual layout parameters.

3. The method according to claim 1, characterized in that The controlling the target photographing device to photograph the target production line of the medium and thick plate factory to obtain a target image includes: Determine, according to the shooting parameters, N different focal length values ​​corresponding to the target shooting device, where N is a positive integer; Controlling the target shooting device to shoot the target production line at the N different focal length values ​​respectively, to obtain N to-be-selected images corresponding to the N different focal length values; The target image is determined from the N images to be selected according to image qualities of the N images to be selected.

4. The method according to claim 1, characterized in that Before tracking the target material according to the target image, the method further includes: Controlling the target shooting device to shoot the target production line to obtain a sample image; Annotating target parameter items of the sample image; Obtaining a test set and a training set according to the labeled sample images; According to the training set, the model to be trained is trained to obtain a model to be optimized; According to the test set, the model to be optimized is optimized to obtain a target model, and the target model is used to identify and track materials on the target production line.

5. The method according to claim 4, characterized in that Tracking the target material on the target production line according to the target image includes: The target image is input into the target model to track the target material.

6. A medium and thick plate material tracking device, characterized in that: The device comprises: An acquisition module, used to acquire a production line layout diagram of a target medium and thick plate factory and shooting parameters of a target shooting device, wherein the target shooting device is used to shoot a target production line in the target medium and thick plate factory; An actual layout parameter determination module, used to determine the actual layout parameters of the target shooting device in the target medium and thick plant according to the production line layout diagram and the shooting parameters; wherein the actual layout parameters include the layout position and the layout quantity; a target image determination module, for controlling the target shooting device to shoot a target production line of the target plate mill to obtain a target image when the target shooting device is laid out in the target plate mill with the actual laying parameters; wherein the target image includes an image of a target material on the target production line; A tracking module, used for tracking the target material according to the target image; The actual layout parameter determination module includes: A three-dimensional model building submodule is used to build a three-dimensional model of a target medium and thick plate plant according to a production line layout diagram, wherein the three-dimensional model includes a production line model of the target production line; A shooting model building submodule is used to build a shooting model corresponding to the target shooting device in the three-dimensional model according to the shooting parameters; A first simulation image determination module is used to simulate shooting of the production line model using the shooting model under the simulation layout parameters to obtain a first simulation image; A coverage rate judgment submodule, used to judge whether a first coverage rate of the first simulation image for the production line model is greater than or equal to a target coverage rate; An actual layout parameter determination submodule, configured to determine the current simulated layout parameters as actual layout parameters when the first coverage is greater than or equal to the target coverage; The target image determination module includes: The initial image acquisition submodule is used to control the target shooting device to shoot the target production line to obtain the initial image; The processing submodule is used to perform anti-shake, splicing and perspective transformation on the initial image to obtain the target image.

7. An electronic device, characterized in that: include: processor; a memory for storing instructions executable by the processor; Wherein, the processor is configured to execute to implement a medium and thick plate material tracking method as described in any one of claims 1 to 5.

8. A non-transitory computer-readable storage medium, when the instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to implement a medium and thick plate material tracking method as described in any one of claims 1 to 5.