Steel billet monitoring management method and system

Abstract

The invention provides a billet monitoring management method and system, and the method comprises the steps: enabling a source IP address and an internal port of an enterprise server in the system to be mapped into an external IP address and an external port through an external firewall and an internal firewall, enabling the external IP address and the external port to be open in a public network, and enabling monitoring equipment which is disposed in a heating furnace and is provided with a mobile signal card to collect the video image of a billet in the heating furnace; and the video picture is sent to a wireless base station of an operator through the mobile signal card, so that the video picture is forwarded to an external IP address and an external port. And the switch forwards the video picture received by the external IP address and the external port to the internal port of the enterprise server, so that the video picture is analyzed and processed to obtain an analysis and processing result. According to the scheme, data transmission between the monitoring equipment in the heating furnace and the enterprise server is achieved through the operator wireless base station, the mobile signal card, the IP and the port mapping mode, the situation of steel billets in the heating furnace can be analyzed and processed in time through the enterprise server, and the steel tapping quality is guaranteed.

Description

Technical Field

[0001] The present invention relates to the field of monitoring technology, and in particular to a steel billet monitoring management method and system. Background Art

[0002] The steel-tapping process in the furnace is an important link in steel production. During the process, in addition to the strict management and control of the process equipment on site, it is also necessary to timely understand the situation of the steel billet in the heating furnace and upload it to the enterprise server in a unified manner to fully control the situation of the steel billet, so as to determine whether there is any abnormality in the steel billet and whether it needs to be adjusted accordingly and in a timely manner.

[0003] However, the heating furnace is in a high temperature state. Even if special high-temperature resistant monitoring equipment can be installed in the heating furnace to monitor the steel billets, it is impossible to lay communication cables in the heating furnace, resulting in obstruction in the transmission of video images of the steel billets. As a result, it is impossible to use the enterprise server to fully and timely grasp the situation of the steel billets in the heating furnace, and thus impossible to achieve timely analysis and timely regulation, making it difficult to ensure the quality of steel output. Summary of the invention

[0004] In order to at least overcome the above-mentioned deficiencies in the prior art, one of the objectives of the present invention is to provide a billet monitoring and management method and system.

[0005] In a first aspect, the present invention provides a billet monitoring and management method, which is applied to a billet monitoring and management system, wherein the billet monitoring and management system comprises a monitoring device provided in a heating furnace and having a mobile signal card, a wireless base station of an operator, an external firewall, a switch, an internal firewall and an enterprise server;

[0006] The monitoring device communicates with the operator's wireless base station through the mobile signal card, the source IP address and internal port of the enterprise server are mapped to an external IP address and an external port by the external firewall and the internal firewall and opened on the public network, and the method includes:

[0007] The monitoring device collects video images of the steel billets in the heating furnace, and sends the video images to the operator's wireless base station through the mobile signal card;

[0008] The operator's wireless base station forwards the video image to the external IP address and external port;

[0009] The switch forwards the video images received via the external IP address and the external port to the internal port of the enterprise server;

[0010] The enterprise server analyzes and processes the video image to obtain an analysis and processing result.

[0011] In an optional implementation manner, the internal firewall maps the source IP address of the enterprise server to an external IP address in the mobile Internet based on an IP address mapping relationship;

[0012] The external firewall maps the internal port of the enterprise server to an external port based on a port mapping relationship, and the external port is the TCP communication port of the external IP address.

[0013] In an optional implementation, the monitoring device includes a plurality of devices, and the step of the enterprise server analyzing and processing the video image to obtain an analysis result includes:

[0014] The enterprise server obtains the mobile tag of the mobile signal card of the monitoring device corresponding to each received video screen;

[0015] Determine the location information of each monitoring device based on the mobile tag corresponding to each monitoring device, and obtain the posture information of each monitoring device;

[0016] Based on the position information, posture information of each monitoring device and the spatial model of the heating furnace, the received multiple video images are spliced ​​to obtain a complete video image.

[0017] In an optional embodiment, the step of splicing the received multiple video images based on the position information, posture information of each monitoring device and the spatial model of the heating furnace to obtain a complete video image includes:

[0018] Based on the position information and posture information of each monitoring device and the spatial model of the heating furnace, determining the area in the heating furnace corresponding to the video images obtained by each monitoring device;

[0019] Determine the overlapping area in the area corresponding to each two video images, and perform deduplication processing on the overlapping area;

[0020] The multiple video images after deduplication processing are stitched together to obtain a complete video image.

[0021] In an optional implementation manner, the step of the enterprise server analyzing the video image to obtain an analysis result includes:

[0022] The enterprise server identifies the steel billet image in the video picture;

[0023] The method further comprises:

[0024] The enterprise server determines whether it is necessary to regulate the heating system, gas injection system and liquid system of the heating furnace based on the steel billet image.

[0025] In an optional implementation, the step of the enterprise server determining whether it is necessary to regulate the heating system of the heating furnace based on the steel billet image includes:

[0026] Performing line detection on the steel billet image to obtain a plurality of lines, and obtaining a pixel value of each of the lines, and judging whether a black line exists based on the pixel value of each of the lines, wherein the black line is a line whose pixel value is lower than a preset value and whose length exceeds a preset length;

[0027] If there is a black line and the interval time between the black line and the end time point of the preset heating time is less than the preset time, the heating time is increased, and the heating system of the heating furnace is controlled to continue heating according to the increased heating time.

[0028] In an optional embodiment, the billet monitoring and management system further comprises a temperature detection device, wherein a mobile signal card is inserted into the temperature detection device to communicate with the enterprise server;

[0029] The step of the enterprise server judging whether it is necessary to regulate the gas injection system of the heating furnace based on the steel billet image includes:

[0030] The enterprise server obtains the pixel value of each pixel point in the steel billet image, and calculates the average pixel value based on the pixel value of each pixel point;

[0031] Obtaining the temperature value in the heating furnace detected and sent by the temperature detection device;

[0032] When the average pixel value indicates that the color of the steel billet is abnormal, the gas flow rate injected into the heating furnace by the gas injection system of the heating furnace is adjusted until the received temperature value is within a preset temperature range.

[0033] In an optional implementation, the step of the enterprise server determining whether the hydraulic system of the heating furnace needs to be regulated based on the billet image includes:

[0034] The enterprise server obtains a three-dimensional point cloud of the steel billet in the steel billet image, performs edge detection on the three-dimensional point cloud, and obtains an edge curve;

[0035] Calculating normal vectors and tangent vectors of a plurality of position points of the edge curve;

[0036] Based on the normal vector and the tangential vector of each position point, it is determined whether the steel billet is bent. If bent, the hydraulic system of the heating furnace is controlled to correct the bending of the steel billet.

[0037] In an optional implementation, the step of performing edge detection on the three-dimensional point cloud to obtain an edge curve includes:

[0038] Identify a vacant area in the three-dimensional point cloud, and divide the three-dimensional point cloud into a plurality of block point clouds based on the vacant area, each of the block point clouds corresponding to a steel billet;

[0039] For each 3D point in each block point cloud, obtain a neighboring point of the 3D point, and determine whether the 3D point is an edge point based on the 3D point and the neighboring points;

[0040] An edge contour is constructed based on all the determined edge points, and a curve fitting is performed on the edge contour to obtain a corresponding edge curve.

[0041] In a second aspect, the present invention provides a billet monitoring and management system, the billet monitoring and management system comprising a monitoring device disposed in a heating furnace and having a mobile signal card, a carrier wireless base station, an external firewall, a switch, an internal firewall, and an enterprise server;

[0042] The monitoring device communicates with the operator's wireless base station through the mobile signal card, and the source IP address and internal port of the enterprise server are mapped to an external IP address and an external port by the external firewall and the internal firewall and are opened on the public network;

[0043] The monitoring device is used to collect video images of the steel billets in the heating furnace, and send the video images to the operator's wireless base station through the mobile signal card;

[0044] The operator wireless base station is used to forward the video image to the external IP address and external port;

[0045] The switch is used to forward the video images received via the external IP address and the external port to the internal port of the enterprise server;

[0046] The enterprise server is used to analyze and process the video images to obtain analysis and processing results.

[0047] Compared with the prior art, the present invention has the following beneficial effects:

[0048] The present invention provides a billet monitoring and management method and system, in which the source IP address and internal port of the enterprise server in the system are mapped to the external IP address and external port by the external firewall and the internal firewall and opened to the public network, and the monitoring equipment with a mobile signal card arranged in the heating furnace collects the video picture of the billet in the heating furnace, and sends the video picture to the operator's wireless base station through the mobile signal card, so as to forward it to the external IP address and external port. The switch forwards the video picture received via the external IP address and the external port to the internal port of the enterprise server, thereby analyzing and processing the video picture to obtain the analysis and processing result. In this scheme, the data transmission between the monitoring equipment in the heating furnace and the enterprise server is realized by means of the operator's wireless base station, the mobile signal card, the IP and the port mapping, and the situation of the billet in the heating furnace can be timely analyzed and processed by the enterprise server to ensure the quality of steel output. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for use in the embodiments are briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present invention and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without creative work.

[0050] Figure 1 A structural block diagram of a steel billet monitoring and management system provided by an embodiment of the present invention;

[0051] Figure 2 A flow chart of a method for monitoring and managing steel billets provided by an embodiment of the present invention;

[0052] Figure 3 for Figure 2 A flowchart of the sub-steps included in S14;

[0053] Figure 4 for Figure 3 A flowchart of the sub-steps included in S143;

[0054] Figure 5 One of the flow charts of the control method in the billet monitoring and management method provided in the embodiment of the present invention;

[0055] Figure 6 The second flowchart of the control method in the billet monitoring and management method provided by the embodiment of the present invention;

[0056] Figure 7 The third flowchart of the control method in the billet monitoring and management method provided by the embodiment of the present invention;

[0057] Figure 8 for Figure 7Flowchart of the sub-steps included in S41. DETAILED DESCRIPTION

[0058] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Generally, the components of the embodiments of the present invention described and shown in the drawings here can be arranged and designed in various different configurations.

[0059] Therefore, the following detailed description of the embodiments of the present invention provided in the accompanying drawings is not intended to limit the scope of the invention claimed for protection, but merely represents selected embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0060] It should be noted that similar reference numerals and letters denote similar items in the following drawings, and therefore, once an item is defined in one drawing, further definition and explanation thereof is not required in subsequent drawings.

[0061] In the description of the present invention, it is also necessary to explain that, unless otherwise clearly specified and limited, the terms "set", "install", "connect", and "connect" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two elements. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0062] See also Figure 1 , which is a schematic diagram of an application scenario of the billet monitoring and management method provided in an embodiment of the present invention. The application scenario includes a billet monitoring and management system, which includes a monitoring device arranged in a heating furnace and having a mobile signal card, an operator wireless base station, an external firewall, a switch, an internal firewall and an enterprise server.

[0063] The monitoring device can communicate with the operator's wireless base station through a mobile signal card, and then communicate with the enterprise server. The mobile signal card can be a 5G signal card, a 4G signal card, etc.

[0064] If the port of the enterprise server is directly exposed to the public network of the mobile Internet, there is a risk of attack and information leakage. Therefore, the source IP address and internal port of the enterprise server will be mapped to the external IP address and external port by the external firewall and the internal firewall and opened to the public network.

[0065] In this way, the monitoring equipment can access the external IP address and external port exposed to the public network through the operator's wireless base station, and then communicate with the enterprise server to realize the transmission of data, instructions, etc.

[0066] Please refer to Figure 2 , is a flow chart of a billet monitoring and management method provided by an embodiment of the present invention. The billet monitoring and management method is applied to the above-mentioned billet monitoring and management system. The billet monitoring and management method is specifically implemented in the following manner:

[0067] S11, the monitoring device collects video images of the steel billets in the heating furnace, and sends the video images to the operator's wireless base station through the mobile signal card.

[0068] S12, the operator's wireless base station forwards the video image to the external IP address and external port.

[0069] S13, the switch forwards the video images received via the external IP address and the external port to the internal port of the enterprise server.

[0070] S14, the enterprise server analyzes and processes the video image to obtain an analysis result.

[0071] In this embodiment, the monitoring device is a video camera device. Since the monitoring device is arranged in a heating furnace, and the temperature in the heating furnace is very high and the environment is harsh, the monitoring device can be made of special materials, such as sapphire or quartz glass, etc. In this way, the monitoring device can withstand high temperatures and has good light transmittance, ensuring that high-quality visual information can be obtained even in harsh environments.

[0072] In addition, since the steel billet in the heating furnace is in a high temperature state as a whole, and the environment in the heating furnace is harsh, there may be many impurities in the air, which may cause the video images collected by the monitoring device to be unclear. Based on this consideration, in this embodiment, an infrared sensor can be installed in the monitoring device, and the infrared sensor can capture the infrared radiation emitted by the high-temperature object in the heating furnace, that is, the infrared radiation emitted by the steel billet, and thus can obtain clear and stable image information.

[0073] The monitoring equipment sends the collected video images of the steel billets in the heating furnace to the operator's wireless base station via mobile signals. Through the forwarding function of the operator's wireless base station, the video images are sent to the external IP address and external port of the enterprise server exposed on the public network.

[0074] The switch stores the source IP address and external IP address of the enterprise server before and after mapping, as well as the internal port and external port of the enterprise server. Therefore, the video images received via the external IP address and external port can be converted to the corresponding source IP address and internal port after being processed by the switch. In this way, the video images sent by the monitoring device can be successfully received without exposing the real source IP address and internal port of the enterprise server to the public network.

[0075] On this basis, the enterprise server analyzes and processes the video images, including the analysis and processing of the billet status and heating uniformity of the billet in the heating furnace, so as to determine whether there is any abnormality in the billet during the process, which helps to intervene in time.

[0076] The billet monitoring and management solution provided in this embodiment realizes data transmission between the monitoring equipment in the heating furnace and the enterprise server through the operator's wireless base station, mobile signal card, IP and port mapping. The enterprise server can timely analyze and process the situation of the billet in the heating furnace to ensure the quality of steel output.

[0077] In this embodiment, the internal firewall maps the source IP address of the enterprise server to an external IP address in the mobile Internet based on the IP address mapping relationship. The external firewall maps the internal port of the enterprise server to the external port based on the port mapping relationship, and the external port is the TCP communication port of the external IP address.

[0078] Specifically, the enterprise server configures the corresponding service to generate a storage container and opens the internal port, such as port 5060. The internal firewall stores the IP address mapping relationship, and can map the source IP address of the enterprise server to the external IP address based on the IP address mapping relationship. For example, the source IP address of the enterprise server is 10.80.3.4, and the source IP address is mapped to the external IP address 172.16.168.40 through the mapping of the external firewall. The external firewall can perform port mapping and map the internal port 5060 to an external port, such as 5080. In this way, the external IP address and external port are open to the public network.

[0079] After the monitoring device is inserted with the mobile signal card, the protocol and parameter configuration can be performed, for example, the T28181 protocol and APN parameters can be configured to ensure that the monitoring device can communicate with the operator's wireless base station. Based on the policy routing configured by the operator, the traffic of the mobile signal card can be directed to access the port opened on the public network, that is, the external port mentioned above, and then access the internal port of the enterprise server after conversion by the switch.

[0080] In this embodiment, relevant configurations may also be performed on the switch, so as to control the traffic between the monitoring device and the enterprise server, optimize network performance, and perform security protection, etc. The switch here may be a convergence switch.

[0081] Specifically, an ACL is configured on the switch, and rule parameters are configured in the ACL. The rule parameters are arranged in order, and the program executes each rule parameter from top to bottom. Once one of the rule parameters is hit, the traversal will be jumped out and ended.

[0082] In this embodiment, the rule parameters in the ACL can be configured from aspects such as TCP, UDP, source IP address (here refers to the IP address of the data source) and destination IP address, which can be used to filter out some IP addresses with illegal access, and can also limit the access range of monitoring equipment in certain areas to optimize network resources. For example, setting rules to limit the flow of data packets of a specific type or source can prevent the video stream of the monitoring device from being too large and occupying too much bandwidth, thereby affecting the network communication of other key services of the enterprise server. In addition, some illegal access or malicious data packets can be filtered out to protect the network security of the management system. In addition, priority can be set for some IP addresses or types of book traffic to ensure that some key data can be transmitted first and improve real-time performance.

[0083] The following are examples of ACL configuration from the aspects of TCP, UDP, source IP address, and destination IP address:

[0084] acl number 3001

[0085] description jiaohuachang-1

[0086] rule 5deny tcp destination-port eq 445

[0087] rule 10deny udp destination-port eq 445

[0088] rule 15deny tcp destination-port eq 135

[0089] rule 20deny udp destination-port eq 135

[0090] rule 25deny tcp destination-port eq 139

[0091] rule 30deny udp destination-port eq netbios-ssn

[0092] rule 40deny tcp destination-port eq 5632

[0093] rule 45deny udp destination-port eq 5632

[0094] rule 50deny tcp destination-port eq 5900

[0095] rule 55deny udp destination-port eq 5900

[0096] rule 60deny tcp destination-port eq domain

[0097] rule 65deny udp destination-port eq dns

[0098] rule 70deny tcp destination-port eq 1900

[0099] rule 75deny udp destination-port eq 1900

[0100] rule 76deny udp destination-port eq 8800

[0101] rule 77deny udp destination-port eq 63995

[0102] rule 78 deny udp destination-port eq 56787rule 79 deny udpdestination-port eq 39350rule 80 deny tcp destination-port eq 8010rule 81deny tcp destination-port eq 6021rule 82 deny tcp destination-port eq49152rule 83 deny udp destination-port eq 3705rule 84 deny udp destination-port eq 37020rule 85 deny udp destination-port eq 36533rule 86 deny udpsource-port eq 5060 destination-port eq 5060rule 87 deny udp source-port eq3702 destination-port eq 61772rule 88 deny udp source-port eq 46399destination-port eq ntprule 89 deny udp source-port eq 34839 destination-porteq ntprule 90 deny udp source-port eq 37020 destination-port eq 37020rule 100deny udp source-port eq 3702 destination-port eq 3705rule 103 permit ipdestination 10.250.252.111 0rule 105 permit ip destination 10.80.3.00.0.0.255

[0103] rule 110 permit ip destination 10.50.67.0 0.0.0.255

[0104] rule 115 permit ip destination 10.50.68.0 0.0.0.255

[0105] rule 120 permit ip destination 10.50.69.0 0.0.0.255

[0106] rule 125 permit ip destination 10.50.98.0 0.0.0.255

[0107] rule 130 permit ip destination 10.50.99.0 0.0.0.255

[0108] rule 132permit ip destination 10.50.133.0 0.0.0.255

[0109] rule 135permit ip destination 10.100.100.0 0.0.0.255

[0110] rule 140permit ip destination 10.10.10.0 0.0.0.255

[0111] rule 141permit ip source 10.50.67.230 0destination10.50.200.00.0.0.255

[0112] rule 155permit ip destination 10.50.92.20 0

[0113] rule 156permit ip destination 10.50.92.21 0

[0114] rule 200deny ip

[0115] Based on the above, the switch can forward the video under the configuration information. After successfully obtaining the video of the heating furnace sent by the monitoring equipment, the enterprise server can analyze and process the video to determine whether there is any abnormality in the steel billet in the heating furnace and whether the control system related to the heating furnace needs to be controlled.

[0116] Since the heating furnace has a large spatial range and the field of view of a single monitoring device is limited, a single monitoring device cannot obtain a complete image of the heating furnace. Therefore, it is generally necessary to set up multiple monitoring devices in the heating furnace. In this way, the enterprise server can obtain the video images sent by each monitoring device. In order to restore the actual and complete image of the heating furnace, the enterprise server can process the video images as follows after receiving them, in conjunction with the reference Figure 3 :

[0117] S141, the enterprise server obtains the mobile tag of the mobile signal card of the monitoring device corresponding to each received video screen.

[0118] S142, determining the location information of each monitoring device based on the mobile tag corresponding to each monitoring device, and obtaining the posture information of each monitoring device.

[0119] S143, based on the position information, posture information of each monitoring device and the spatial model of the heating furnace, the received multiple video images are spliced ​​to obtain a complete video image.

[0120] In this embodiment, each mobile signal card has a corresponding mobile tag, and the enterprise server can determine the mobile tag corresponding to each received video screen through the information of the mobile tag identified by the operator base station.

[0121] Based on the analysis of the received video images by the operator base station, the enterprise server can determine the location information of each mobile tag, that is, the location information of each monitoring device. In addition, the monitoring device can also send its own posture information to the enterprise server.

[0122] Based on the location information of each monitoring device and the spatial model of the heating furnace, the relative position of each monitoring device in the space of the heating furnace can be restored. The current shooting angle of the monitoring device can be determined based on the posture information of the monitoring device. In this way, the relative position relationship of the video images captured by each monitoring device in the space of the heating furnace can be determined, and then multiple video images can be spliced ​​to obtain a complete video image of the heating furnace.

[0123] Each monitoring device has a different field of view, but the video images taken by different monitoring devices may overlap, which may cause anomalies in the complete spliced ​​video image, and thus fail to accurately reflect the overall situation in the heating furnace. Based on this consideration, please refer to Figure 4 In this embodiment, based on the position information, posture information of each monitoring device and the spatial model of the heating furnace, the step of splicing the received multiple video images to obtain a complete video image can be achieved by the following method:

[0124] S1431, based on the position information, posture information of each monitoring device and the spatial model of the heating furnace, determining the area in the heating furnace corresponding to the video image obtained by each monitoring device.

[0125] S1432, determining the overlapping area in the area corresponding to every two video frames, and performing deduplication processing on the overlapping area.

[0126] S1433, stitching the multiple video images after deduplication processing to obtain a complete video image.

[0127] In this embodiment, for the monitoring device with adjustable shooting angle, the corresponding shooting range, shooting depth, etc. of the monitoring device in different postures are different. Therefore, the corresponding area in the heating furnace that can be photographed by the monitoring device can be determined according to the position information and posture information of the monitoring device, that is, the area corresponding to the video screen.

[0128] Since the spatial model of the heating furnace is known, after determining the corresponding area of ​​each video screen in the heating furnace, the overlapping area of ​​each two video screens can be determined. Then, the overlapping area is deduplicated. For example, for two video screens, the overlapping area in one of the video screens is removed.

[0129] In this way, the overlapping areas in all video images can be removed. Finally, the areas corresponding to each video image in the heating furnace are spliced ​​according to the relative position relationship of the areas to obtain a complete video image.

[0130] In this embodiment, the complete video picture inside the heating furnace is obtained by analysis, which helps the staff to understand the overall situation of the heating furnace and observe the overall situation of the steel billets in the heating furnace.

[0131] In addition to the need to understand the overall situation of the steel billets in the heating furnace, specific information about the steel billets in the heating furnace also needs to be obtained in a timely manner, so that the control system related to the heating furnace can be adjusted in a timely manner when necessary. Based on this, in this embodiment, when the enterprise server analyzes and processes the video screen to obtain the analysis and processing result, it can be an image of the steel billet in the video screen.

[0132] On this basis, the enterprise server can determine whether the heating system, gas injection system and hydraulic system of the heating furnace need to be regulated based on the billet image.

[0133] Specifically, see Figure 5 The step of the enterprise server judging whether the heating system of the heating furnace needs to be regulated based on the billet image can be achieved in the following ways:

[0134] S21, performing line detection on the steel billet image to obtain a plurality of lines, and obtaining a pixel value of each of the lines, and judging whether there is a black line based on the pixel value of each of the lines, wherein the black line is a line whose pixel value is lower than a preset value and whose length exceeds a preset length.

[0135] S22, if there is a black line and the interval time between the black line and the end time point of the preset heating time is less than the preset time, the heating time is increased, and the heating system of the heating furnace is controlled to continue heating according to the increased heating time.

[0136] If the heating time of the steel billet is not long enough, black lines will appear in the steel billet. Based on this, in this embodiment, multiple lines are obtained by performing line detection on the steel billet image. Since the edge of the steel billet and other objects in the space of the heating furnace may be detected as lines, multiple lines may be obtained when detecting the steel billet image.

[0137] By analyzing the color of each detected line, the pixel value of each line can be obtained, specifically, the pixel value of each pixel point.

[0138] Whether there is a black line is determined based on the pixel value of each line. Specifically, on the one hand, it can be detected whether the pixel value of the line is lower than a preset value, for example, whether the pixel values ​​of each pixel channel of the pixel point are all lower than the preset value. On the other hand, it can be detected whether the length of the line exceeds the preset length. If both of the above two conditions are met, it can be determined that the corresponding line is a black line.

[0139] In this embodiment, by detecting the values ​​of each pixel channel of the line, the line with black pixels can be accurately determined. In addition, by detecting the length of the line, it is possible to avoid the situation where some black pixels in the form of dots are judged as black lines due to detection errors.

[0140] If it is determined that there are black lines in the steel billet, it means that the current heating time of the steel billet is not enough. When heating the steel billet, a heating time will be set in advance, and the heating system will heat according to the heating time, and stop heating after the heating time is reached. If the interval between the current time point and the end time point of the set heating time is less than the preset time, it means that the steel billet may not meet the requirements when the end time point is reached. Therefore, the heating time can be modified at this time to increase the heating time. The heating system is controlled based on the increased heating time, so that the heating system can heat according to the increased heating time to ensure that the steel billet is fully heated, thereby eliminating the black lines presented therein.

[0141] The temperature in the heating furnace directly affects the quality of steel. Although the temperature sensor in the heating furnace can detect the temperature, the optimal temperature required may be different due to different gas quality and different heating furnace environment. Therefore, the temperature detected by the temperature sensor cannot be used as the judgment standard alone. However, the temperature detected by the temperature sensor can be used as an auxiliary judgment standard.

[0142] Based on this, in this embodiment, the billet monitoring and management system also includes a temperature detection device, and the temperature detection device is inserted with a mobile signal card so as to communicate with the enterprise server. The communication method between the temperature detection device and the enterprise server is similar to the communication method between the monitoring device and the enterprise server, and this embodiment will not be repeated here.

[0143] See also Figure 6 The step of the enterprise server judging whether the gas injection system of the heating furnace needs to be regulated based on the billet image can be achieved in the following ways:

[0144] S31, the enterprise server obtains the pixel value of each pixel point in the steel billet image, and calculates the average pixel value based on the pixel value of each pixel point.

[0145] S32, obtaining the temperature value in the heating furnace detected and sent by the temperature detection device.

[0146] S33, when the average pixel value indicates that the color of the steel billet is abnormal, adjusting the gas flow rate injected into the heating furnace by the gas injection system of the heating furnace until the received temperature value is within a preset temperature range.

[0147] The flow rate of the gas injected into the heating furnace affects the temperature in the heating furnace, and the temperature in the heating furnace affects the color of the billet during heating. Specifically, if the temperature in the heating furnace is too high, the color of the billet will be too red.

[0148] Based on this, the pixel value of each pixel point in the billet image can be obtained and the average pixel value can be calculated. The average pixel value can be analyzed to obtain the pixel value of each pixel channel in the average pixel value, where the pixel channel includes a red channel, a green channel, and a blue channel. It is detected whether the pixel value of the red channel exceeds the preset value. If it exceeds the preset value, it can be determined that the color of the billet is abnormal, that is, the color of the billet is too red. At this time, it indicates that the temperature in the heating furnace is too high, which also means that the flow rate of the gas injected into the heating furnace is too large.

[0149] In addition, the temperature value in the heating furnace detected by the temperature detection device can also be obtained. If the color of the steel billet is determined to be abnormal at this time, it can be shown that under the current environment in the heating furnace, the temperature value at this time will cause the color of the steel billet to be abnormal. Therefore, the current temperature value can be used as a reference, and a preset temperature range can be set based on the current temperature value. For example, the preset temperature range can be lower than the current temperature value.

[0150] In addition, the gas flow rate injected into the heating furnace by the gas injection system of the heating furnace is adjusted, specifically, the gas flow rate injected into the heating furnace is reduced, so that the temperature can be lowered based on the current temperature. Until the temperature value in the heating path is within the preset temperature range, the gas injection system can be controlled to continue to work in the current state, so as to remain within the preset temperature range.

[0151] In this embodiment, the detected pixel value of the steel billet and the detected temperature value in the heating furnace are combined, so that when the color of the steel billet is determined to be abnormal, the temperature value corresponding to the abnormality is obtained, so that a reasonable preset temperature range can be set. Then, the preset temperature range is used to control the gas injection system to regulate the gas flow. Combining pixel value detection and temperature detection, it can adapt to different environmental conditions of the heating furnace and ensure the quality of steel output.

[0152] In addition, considering that the position of the steel billet may shift during the heating process, which may cause abnormalities during the steel tapping or movement process, and may also cause problems such as uneven heating. Based on this, in this embodiment, the enterprise server can also identify the position of the steel billet in the steel billet image to determine whether the steel billet is shifted. If there is a shift, the position of the steel billet can be adjusted by mechanical equipment in the hydraulic system, such as a mechanical arm.

[0153] Considering that the steel billet may bend during the heating process, which may cause the product to fail to meet the requirements, when this happens, it is necessary to use the straightening in the hydraulic system to straighten the bent steel billet.

[0154] Based on this, see Figure 7 In this embodiment, the step of the enterprise server judging whether the hydraulic system of the heating furnace needs to be regulated based on the billet image can be implemented in the following ways:

[0155] S41, the enterprise server obtains the three-dimensional point cloud of the steel billet in the steel billet image, performs edge detection on the three-dimensional point cloud, and obtains an edge curve.

[0156] S42, calculating normal vectors and tangent vectors of a plurality of position points of the edge curve.

[0157] S43, judging whether the steel billet is bent based on the normal vector and the tangent vector of each position point, and if bent, controlling the hydraulic system of the heating furnace to correct the bending of the steel billet.

[0158] The steel billets in the heating furnace are often in the shape of strips. When detecting whether the steel billets are bent, it is necessary to detect the edges of the steel billets in multiple directions to determine whether the steel billets are bent in various directions.

[0159] The monitoring device may be a depth camera. A three-dimensional point cloud of the steel billet may be obtained based on the steel billet image collected by the monitoring device. The three-dimensional point cloud is a point cloud corresponding to the steel billet and composed of multiple three-dimensional points.

[0160] Edge detection is performed on the three-dimensional point cloud to obtain edge curves, and the edge curves mainly include the curves of the circumferential edges of the strip-shaped steel billet.

[0161] Specifically, see Figure 8 In this embodiment, edge detection can be performed on the three-dimensional point cloud to obtain edge curves in the following manner:

[0162] S411, identifying a vacant area in the three-dimensional point cloud, and dividing the three-dimensional point cloud into a plurality of block point clouds based on the vacant area, each of the block point clouds corresponding to a steel billet.

[0163] S412: For each 3D point in each block point cloud, obtain a neighboring point of the 3D point, and determine whether the 3D point is an edge point based on the 3D point and the neighboring points.

[0164] S413: construct an edge contour based on all the determined edge points, and perform curve fitting on the edge contour to obtain a corresponding edge curve.

[0165] Since the video footage captured by the monitoring equipment often contains more than one steel billet, the 3D point cloud obtained based on the steel billet image in the video footage may be the point cloud corresponding to multiple steel billets. During the inspection, each steel billet needs to be inspected, so the point cloud of each steel billet needs to be extracted.

[0166] There are gaps between the billets, that is, the gaps do not have the three-dimensional points of the billets. Based on this, the vacant areas in the three-dimensional point cloud can be identified, that is, the gaps between the billets mentioned above. Based on the vacant areas, the three-dimensional point cloud can be divided into multiple block point clouds, and one block point cloud corresponds to a billet.

[0167] In this way, each block point cloud can be analyzed and processed to detect whether each steel billet is bent.

[0168] Since there are 3D points of the steel billet and 3D points of non-steel billet, i.e. 3D points of the background area, near the 3D points of the edge of the steel billet, therefore, for each 3D point, the neighboring points of the 3D point can be obtained, and the neighboring points can be 3D points within a preset radius centered on the 3D point. The neighboring points are analyzed to determine whether there are 3D points of the background area among the neighboring points. If there are 3D points of the background area, the targeted 3D point can be determined to be an edge point. Otherwise, it indicates that the targeted 3D point is not an edge point.

[0169] By using the above method to determine the edge points in the regional point cloud, all edge points can be spliced ​​to construct the edge contour. Since the intervals between the determined edge points may not be uniform, resulting in concavity after splicing, the corresponding edge curve can be obtained by curve fitting the edge contour.

[0170] On this basis, the normal vector and tangent vector of multiple position points of the edge curve can be calculated. For example, a position point can be determined at intervals of a preset length on the edge curve. In this way, multiple sections of the edge curve can be analyzed to determine whether there is a bend.

[0171] For each position point, it is determined whether the corresponding segment has a bend based on its normal vector and tangent vector. Specifically, the angle between the normal vector and the tangent vector can be calculated. If the difference between the angle between the two and 90 degrees is within a preset angle range, it can be determined that there is no bend, and if it exceeds the preset angle range, it is determined that there is a bend.

[0172] In this way, if it is determined through the above method that a certain steel billet is bent, the bending of the steel billet can be corrected by controlling the straightener in the hydraulic system, thereby avoiding problems affecting product quality.

[0173] Based on the same inventive concept, an embodiment of the present invention further provides a billet monitoring and management system, which includes a monitoring device disposed in a heating furnace and having a mobile signal card, an operator wireless base station, an external firewall, a switch, an internal firewall, and an enterprise server;

[0174] The monitoring device communicates with the operator's wireless base station through the mobile signal card, and the source IP address and internal port of the enterprise server are mapped to the external IP address and external port by the external firewall and the internal firewall and opened on the public network.

[0175] The monitoring device is used to collect video images of the steel billets in the heating furnace and send the video images to the operator's wireless base station through a mobile signal card;

[0176] The operator's wireless base station is used to forward the video images to the external IP address and external port;

[0177] The switch is used to forward the video images received via the external IP address and the external port to the internal port of the enterprise server;

[0178] The enterprise server is used to analyze and process the video images to obtain analysis and processing results.

[0179] As a possible implementation method, the internal firewall maps the source IP address of the enterprise server to an external IP address in the mobile Internet based on an IP address mapping relationship;

[0180] The external firewall maps the internal port of the enterprise server to an external port based on a port mapping relationship, and the external port is the TCP communication port of the external IP address.

[0181] As a possible implementation, the monitoring device includes multiple devices, and the enterprise server is used to obtain the analysis and processing results in the following manner:

[0182] Obtaining the mobile tag of the mobile signal card of the monitoring device corresponding to each received video screen;

[0183] Determine the location information of each monitoring device based on the mobile tag corresponding to each monitoring device, and obtain the posture information of each monitoring device;

[0184] Based on the position information, posture information of each monitoring device and the spatial model of the heating furnace, the received multiple video images are spliced ​​to obtain a complete video image.

[0185] As a possible implementation, the enterprise server is specifically used to obtain the complete video screen in the following manner:

[0186] Based on the position information and posture information of each monitoring device and the spatial model of the heating furnace, determining the area in the heating furnace corresponding to the video images obtained by each monitoring device;

[0187] Determine the overlapping area in the area corresponding to each two video images, and perform deduplication processing on the overlapping area;

[0188] The multiple video images after deduplication processing are stitched together to obtain a complete video image.

[0189] As a possible implementation method, the enterprise server can also be used to obtain analysis and processing results in the following ways:

[0190] The enterprise server identifies the steel billet image in the video picture;

[0191] Enterprise Server can also be used to:

[0192] The enterprise server determines whether it is necessary to regulate the heating system, gas injection system and liquid system of the heating furnace based on the steel billet image.

[0193] As a possible implementation, the enterprise server is used to control the heating system in the following ways:

[0194] Performing line detection on the steel billet image to obtain a plurality of lines, and obtaining a pixel value of each of the lines, and judging whether a black line exists based on the pixel value of each of the lines, wherein the black line is a line whose pixel value is lower than a preset value and whose length exceeds a preset length;

[0195] If there is a black line and the interval time between the black line and the end time point of the preset heating time is less than the preset time, the heating time is increased, and the heating system of the heating furnace is controlled to continue heating according to the increased heating time.

[0196] As a possible implementation, the billet monitoring and management system further includes a temperature detection device, wherein a mobile signal card is inserted into the temperature detection device to communicate with the enterprise server, and the enterprise server regulates the gas injection system in the following manner:

[0197] The enterprise server obtains the pixel value of each pixel point in the steel billet image, and calculates the average pixel value based on the pixel value of each pixel point;

[0198] Obtaining the temperature value in the heating furnace detected and sent by the temperature detection device;

[0199] When the average pixel value indicates that the color of the steel billet is abnormal, the gas flow rate injected into the heating furnace by the gas injection system of the heating furnace is adjusted until the received temperature value is within a preset temperature range.

[0200] As a possible implementation, the enterprise server controls the hydraulic system in the following ways:

[0201] The enterprise server obtains a three-dimensional point cloud of the steel billet in the steel billet image, performs edge detection on the three-dimensional point cloud, and obtains an edge curve;

[0202] Calculating normal vectors and tangent vectors of a plurality of position points of the edge curve;

[0203] Based on the normal vector and the tangential vector of each position point, it is determined whether the steel billet is bent. If bent, the hydraulic system of the heating furnace is controlled to correct the bending of the steel billet.

[0204] As a possible implementation method, the enterprise server obtains the edge curve in the following way:

[0205] Identify a vacant area in the three-dimensional point cloud, and divide the three-dimensional point cloud into a plurality of block point clouds based on the vacant area, each of the block point clouds corresponding to a steel billet;

[0206] For each 3D point in each block point cloud, obtain a neighboring point of the 3D point, and determine whether the 3D point is an edge point based on the 3D point and the neighboring points;

[0207] An edge contour is constructed based on all the determined edge points, and a curve fitting is performed on the edge contour to obtain a corresponding edge curve.

[0208] The billet monitoring and management system provided in this embodiment can realize the relevant functions of the billet monitoring and management method under any one of the implementation modes in the above embodiments. The technical effect of the billet monitoring and management system in this embodiment can refer to the technical effect of the billet monitoring and management method under any one of the implementation modes in the above embodiments, and will not be repeated here.

[0209] In summary, the billet monitoring and management method and system provided by the embodiment of the present invention, the source IP address and internal port of the enterprise server in the system are mapped to the external IP address and external port by the external firewall and the internal firewall and opened to the public network, and the monitoring equipment installed in the heating furnace and equipped with a mobile signal card collects the video images of the billet in the heating furnace, and sends the video images to the operator's wireless base station through the mobile signal card, so as to forward them to the external IP address and external port. The switch forwards the video images received via the external IP address and the external port to the internal port of the enterprise server, thereby analyzing and processing the video images to obtain the analysis and processing results. In this scheme, the data transmission between the monitoring equipment in the heating furnace and the enterprise server is realized by means of the operator's wireless base station, the mobile signal card, the IP and the port mapping, and the situation of the billet in the heating furnace can be timely analyzed and processed by the enterprise server to ensure the quality of steel output.

[0210] The above are only various embodiments of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed by the present invention, which should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

Claims

1. A method for monitoring and managing steel billets, characterized in that: Applied to a billet monitoring and management system, the billet monitoring and management system includes a monitoring device arranged in a heating furnace and having a mobile signal card, a wireless base station of an operator, an external firewall, a switch, an internal firewall and an enterprise server; The monitoring device communicates with the operator's wireless base station through the mobile signal card, the source IP address and internal port of the enterprise server are mapped to an external IP address and an external port by the external firewall and the internal firewall and opened on the public network, and the method includes: The monitoring device collects video images of the steel billets in the heating furnace, and sends the video images to the operator's wireless base station through the mobile signal card; The operator's wireless base station forwards the video image to the external IP address and external port; The switch forwards the video images received via the external IP address and the external port to the internal port of the enterprise server; The enterprise server analyzes and processes the video image to obtain an analysis and processing result.

2. The steel billet monitoring and management method according to claim 1, characterized in that: The internal firewall maps the source IP address of the enterprise server to an external IP address in the mobile Internet based on the IP address mapping relationship; The external firewall maps the internal port of the enterprise server to an external port based on a port mapping relationship, and the external port is the TCP communication port of the external IP address.

3. The steel billet monitoring and management method according to claim 1, characterized in that: The monitoring device includes a plurality of devices, and the step of the enterprise server analyzing and processing the video image to obtain the analysis and processing result includes: The enterprise server obtains the mobile tag of the mobile signal card of the monitoring device corresponding to each received video screen; Determine the location information of each monitoring device based on the mobile tag corresponding to each monitoring device, and obtain the posture information of each monitoring device; Based on the position information, posture information of each monitoring device and the spatial model of the heating furnace, the received multiple video images are spliced ​​to obtain a complete video image.

4. The method for monitoring and managing steel billets according to claim 3, characterized in that: The step of splicing the received multiple video images based on the position information, posture information of each monitoring device and the spatial model of the heating furnace to obtain a complete video image includes: Based on the position information and posture information of each monitoring device and the spatial model of the heating furnace, determining the area in the heating furnace corresponding to the video images obtained by each monitoring device; Determine the overlapping area in the area corresponding to each two video images, and perform deduplication processing on the overlapping area; The multiple video images after deduplication processing are stitched together to obtain a complete video image.

5. The steel billet monitoring and management method according to claim 1, characterized in that: The step of the enterprise server analyzing and processing the video image to obtain an analysis result includes: The enterprise server identifies the steel billet image in the video picture; The method further comprises: The enterprise server determines whether it is necessary to regulate the heating system, gas injection system and liquid system of the heating furnace based on the steel billet image.

6. The steel billet monitoring and management method according to claim 5, characterized in that: The step of the enterprise server judging whether it is necessary to regulate the heating system of the heating furnace based on the steel billet image includes: Performing line detection on the steel billet image to obtain a plurality of lines, and obtaining a pixel value of each of the lines, and judging whether a black line exists based on the pixel value of each of the lines, wherein the black line is a line whose pixel value is lower than a preset value and whose length exceeds a preset length; If there is a black line and the interval time between the black line and the end time point of the preset heating time is less than the preset time, the heating time is increased, and the heating system of the heating furnace is controlled to continue heating according to the increased heating time.

7. The steel billet monitoring and management method according to claim 5, characterized in that: The billet monitoring and management system further comprises a temperature detection device, wherein a mobile signal card is inserted into the temperature detection device to communicate with the enterprise server; The step of the enterprise server judging whether it is necessary to regulate the gas injection system of the heating furnace based on the steel billet image includes: The enterprise server obtains the pixel value of each pixel point in the steel billet image, and calculates the average pixel value based on the pixel value of each pixel point; Obtaining the temperature value in the heating furnace detected and sent by the temperature detection device; When the average pixel value indicates that the color of the steel billet is abnormal, the gas flow rate injected into the heating furnace by the gas injection system of the heating furnace is adjusted until the received temperature value is within a preset temperature range.

8. The method for monitoring and managing steel billets according to claim 5, characterized in that: The step of the enterprise server judging whether it is necessary to regulate the hydraulic system of the heating furnace based on the steel billet image includes: The enterprise server obtains a three-dimensional point cloud of the steel billet in the steel billet image, performs edge detection on the three-dimensional point cloud, and obtains an edge curve; Calculating normal vectors and tangent vectors of a plurality of position points of the edge curve; Based on the normal vector and the tangential vector of each position point, it is determined whether the steel billet is bent. If bent, the hydraulic system of the heating furnace is controlled to correct the bending of the steel billet.

9. The steel billet monitoring and management method according to claim 8, characterized in that: The step of performing edge detection on the three-dimensional point cloud to obtain an edge curve comprises: Identify a vacant area in the three-dimensional point cloud, and divide the three-dimensional point cloud into a plurality of block point clouds based on the vacant area, each of the block point clouds corresponding to a steel billet; For each 3D point in each block point cloud, obtain a neighboring point of the 3D point, and determine whether the 3D point is an edge point based on the 3D point and the neighboring points; An edge contour is constructed based on all the determined edge points, and a curve fitting is performed on the edge contour to obtain a corresponding edge curve.

10. A billet monitoring and management system, characterized in that: The billet monitoring and management system includes a monitoring device provided in a heating furnace and having a mobile signal card, a wireless base station of an operator, an external firewall, a switch, an internal firewall and an enterprise server; The monitoring device communicates with the operator's wireless base station through the mobile signal card, and the source IP address and internal port of the enterprise server are mapped to an external IP address and an external port by the external firewall and the internal firewall and are opened on the public network; The monitoring device is used to collect video images of the steel billets in the heating furnace, and send the video images to the operator's wireless base station through the mobile signal card; The operator wireless base station is used to forward the video image to the external IP address and external port; The switch is used to forward the video images received via the external IP address and the external port to the internal port of the enterprise server; The enterprise server is used to analyze and process the video images to obtain analysis and processing results.

Images