Device for visualizing rolling process information

The device addresses the challenge of accurately grasping rolling process information in steel plants by generating and displaying three-dimensional visualization of rolling equipment and materials, thereby enhancing maintenance, quality, and yield.

WO2025057334A1PCT designated stage expired Publication Date: 2025-03-20TMEIC CORP
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2023/033390
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-09-13
Publication Date
2025-03-20

AI Technical Summary

Technical Problem

In steel plants, accurately grasping rolling process information is challenging, especially in areas without cameras or with camera blind spots, leading to difficulties in equipment maintenance and product quality improvement.

Method used

A device that visualizes rolling process information using a processor-based system, which acquires real-time data from the control system, generates three-dimensional visualization information of rolling equipment and materials, and displays it on a device.

Benefits of technology

Enables detailed and easy understanding of the rolling process, improving equipment maintenance, product quality, and yield by providing a comprehensive visual representation of the rolling line.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2023033390_20032025_PF_FP_ABST
    Figure JP2023033390_20032025_PF_FP_ABST
Patent Text Reader

Abstract

This device visualizes the rolling process information of a rolling line. This device comprises: a specification information memory in which specification information about a rolling facility installed in a rolling line and a rolled material to be processed by the rolling line is registered; a program memory in which a plurality of executable instructions are stored; and one or more processors communicatively coupled to the specification information memory and the program memory. The plurality of instructions are configured to cause the one or more processors to: acquire rolling process information in real time from a control system that controls the rolling line; generate three-dimensional visualization information for visualizing at least one of the rolling facility and the rolled material in three-dimensional representation using the rolling process information and the specification information; and display the three-dimensional visualization information on a display device.
Need to check novelty before this filing date? Find Prior Art

Description

A device that visualizes rolling process information

[0001] The present disclosure relates to a device for visualizing rolling process information of a rolling line in a steel plant.

[0002] In the rolling line of a steel plant, it is important to accurately grasp rolling process information, including information on rolling equipment and the material being rolled. Therefore, conventionally, methods have been used to provide various rolling process information in a visually easy-to-understand manner, such as by using an imaging device called an ITV (Industrial Television) or animation displays on the screen of an HMI (Human Machine Interface). For example, Patent Literature 1 proposes a manufacturing performance image display system that quickly provides images showing the manufacturing performance of a product by storing, as a single video file, video images captured by a camera showing the state of product manufacturing and images based on manufacturing-related data.

[0003] However, there may be locations on a rolling line where cameras are not installed. Also, because the range of video footage captured by cameras is limited, there may be blind spots. In these locations, it is difficult to accurately visually grasp rolling process information, limiting understanding of the rolling process status. This can hinder correct situational assessment and lead to incorrect countermeasures when improving equipment maintenance and increasing yields through improved product quality.

[0004] Japanese Patent Application Publication No. 2015-64665

[0005] The present disclosure has been made in view of the above-mentioned problems, and an object of the present disclosure is to enable detailed and easy understanding of the state of the rolling process in a rolling line of a steel plant.

[0006] The present disclosure provides an apparatus for achieving the above objectives.

[0007] A first aspect of the present disclosure provides an apparatus for visualizing rolling process information of a rolling line, the apparatus comprising a specification information memory, a program memory, and one or more processors. The specification information memory is registered with specification information for each of the rolling equipment installed in the rolling line and the rolled material processed in the rolling line. The program memory stores a plurality of executable instructions. The one or more processors are communicatively coupled to the specification information memory and the program memory. The instructions stored in the program memory are configured to cause the one or more processors to acquire rolling process information in real time from a control system that controls the rolling line, generate three-dimensional visualization information for visualizing at least one of the rolling equipment and the rolled material in a three-dimensional representation using the rolling process information and the specification information, and display the three-dimensional visualization information on a display device. The three-dimensional visualization information may include three-dimensional operation information for at least one of the rolling equipment and the rolled material. The three-dimensional visualization information may further include visualization information that represents one-dimensional information of at least one of the rolling equipment and the rolled material in an image.

[0008] According to a second aspect of the present disclosure, the device further includes an information storage device for storing three-dimensional visualization information. According to the second aspect of the device, the instructions are configured to cause the one or more processors to receive a specified time period input via a user interface, retrieve three-dimensional visualization information for the specified time period from the information storage device, and display the three-dimensional visualization information for the specified time period on a display device. The instructions may also cause the one or more processors to receive a specified speed input via the user interface and display the three-dimensional visualization information for the specified time period at the specified speed on a display device. The instructions may also cause the one or more processors to display the three-dimensional visualization information and the three-dimensional visualization information for the specified time period side by side on a display device, or to display the three-dimensional visualization information for the specified time period superimposed on the three-dimensional visualization information on a display device.

[0009] According to a third aspect of the present disclosure, the device of the first aspect further includes an information storage device for storing rolling process information. According to the device of the third aspect, the instructions are configured to cause the one or more processors to further execute the following: accept a designated period input to a user interface; acquire rolling process information for the designated period from the information storage device; generate three-dimensional visualization information for the designated period of at least one of the rolling equipment and the rolled material using the rolling process information for the designated period and the specification information; and display the three-dimensional visualization information for the designated period on a display device.

[0010] An apparatus according to a fourth aspect of the present disclosure is the apparatus according to the first aspect, further comprising a simulated information generator that generates simulated information that simulates rolling process information. According to the apparatus of the fourth aspect, the instructions are configured to cause the one or more processors to further execute the following: generate simulated three-dimensional visualization information of at least one of the rolling equipment and the rolled material using the simulated information and the specification information; and display the simulated three-dimensional visualization information on a display device. The simulated information may be information that simulates normal rolling process information or information that simulates abnormal rolling process information.

[0011] According to the present disclosure, by visualizing at least one of the rolling equipment and the material being rolled in three dimensions, managers in charge of the rolling line of a steel plant can easily grasp the state of the rolling process in detail, which improves equipment maintenance, product quality, and yield.

[0012] FIG. 1 is a block diagram showing a configuration of a system according to a first embodiment of the present disclosure. FIG. 2 is a block diagram showing functions of a system according to a first embodiment of the present disclosure. FIG. 3 is a diagram showing an example of a three-dimensional display of a rolling line. FIG. 4 is a diagram showing an example of a three-dimensional display of rolling equipment constituting a rolling line. FIG. 5 is a diagram showing an example of a three-dimensional display of a material to be rolled. FIG. 6 is a block diagram showing a configuration of a system according to a second embodiment of the present disclosure. FIG. 7 is a block diagram showing a first function of a system according to a second embodiment of the present disclosure. FIG. 8 is a block diagram showing a second function of a system according to a second embodiment of the present disclosure. FIG. 9 is a diagram showing an example of a display mode of a three-dimensional animation by the first function and the second function of a system according to a second embodiment of the present disclosure. FIG. 10 is a block diagram showing a third function of a system according to a second embodiment of the present disclosure. FIG. 11 is a diagram showing an example of a first display mode of a three-dimensional animation by the third function of a system according to a second embodiment of the present disclosure. FIG. 12 is a block diagram showing a configuration of a system according to a third embodiment of the present disclosure. FIG. 13 is a block diagram showing a first function of a system according to a third embodiment of the present disclosure. FIG. 14 is a block diagram showing a second function of a system according to a third embodiment of the present disclosure. FIG. 15 is a block diagram showing a third function of a system according to a third embodiment of the present disclosure.

[0013] 1. First embodiment 1-1. Configuration of visualization system according to first embodiment A system according to a first embodiment of the present disclosure will be described using figures. The system according to this embodiment is a system that visualizes and displays rolling process information of a rolling line of a steel plant using a three-dimensional representation. Hereinafter, the system according to this embodiment will be referred to as a visualization system. Note that systems according to second to fourth embodiments, which will be described later, are also systems that visualize rolling process information of a rolling line of a steel plant, like the system according to this embodiment. These systems will also be referred to as visualization systems.

[0014] The configuration of the visualization system according to this embodiment will be described with reference to Fig. 1. The visualization system 1 according to this embodiment visualizes and displays rolling process information provided from a control system 20 in three-dimensional form. The control system 20 includes a process computer 21 that performs process calculations for controlling the rolling process, a controller 22 that controls actuators of the rolling line in accordance with the calculation results of the process computer 21, and a data collection system 23 that collects rolling process information. The rolling process information represents the current state of the rolling process, and is collected from the process computer 21, the controller 22, and a number of process sensors (not shown) arranged in the rolling line. The process computer 21, the controller 22, the data collection system 23, and the process sensors are connected by a control network 24.

[0015] The visualization system 1 includes a visualization device 11 that visualizes rolling process information, and a three-dimensional animation display device 30 and an XR (cross reality) display device 40 as three-dimensional display devices. The visualization device 11 is connected to a control network 24. The rolling process information collected by a data collection system 23 is transmitted in real time from the data collection system 23 to the visualization device 11 via the control network 24.

[0016] The visualization device 11 includes a processor 101, a program memory 102, a specification information memory 103, a communication module 104, and a user interface 105. The processor 101 may be a CPU, a GPU, a RISC, a DSP, an FPGA, an ASIC, a PLD, or another processing unit, may be a combination of two or more of these, or may be a dedicated processor for the visualization device 11. In this embodiment, the number of processors 101 is one, but the visualization device 11 may be provided with multiple processors 101.

[0017] The program memory 102 is communicatively coupled to the processor 101. The program memory 102 stores a program made up of a plurality of instructions INST that can be executed by the processor 101. The program made up of the instructions INST can be acquired using a computer-readable non-transitory storage medium or via a network. The program memory 102 may be built into the processor 101.

[0018] The specification information memory 103 is communicatively coupled to the processor 101. The specification information memory 103 has registered therein specification information SPEC for each of the rolling equipment installed in the rolling line and the rolled material processed in the rolling line. The specification information SPEC includes information that is not included in the rolling process information but is necessary for generating the three-dimensional visualization information described below, such as the position, angle, and dimensions of the rolling equipment, the position, angle, and dimensions of each device that makes up the rolling equipment, and the end shape and dimensions of the rolled material at each stage during processing. The specification information SPEC can be acquired via a network. The specification information memory 103 may be built into the processor 101.

[0019] The communication module 104 is communicatively coupled to the processor 101. The communication module 104 is provided for communication with external devices. The external devices include a data collection system 23 which is an input source of rolling process information, and a three-dimensional animation display device 30 and an XR display device 40 which are output destinations of three-dimensional visualization information described below. The user interface 105 is communicatively coupled to the processor 101. The user interface 105 is provided for input of information by a manager of the rolling line. The specification information SPEC can also be registered by manual input by the manager via the user interface 105.

[0020] The three-dimensional animation display device 30 is a device that displays three-dimensional visualization information (described later) in the form of three-dimensional animation. The three-dimensional animation display device 30 is connected to the visualization device 11 by wire. However, the three-dimensional animation display device 30 and the visualization device 11 may also be connected wirelessly. Furthermore, the three-dimensional animation display device 30 may be integrated into the visualization device 11.

[0021] The XR display device 40 is a device that displays three-dimensional visualization information (described later) as a three-dimensional hologram. The XR display device 40 is wirelessly connected to a wireless communication device 25 on the control network 24. The XR display device 40 communicates with the visualization device 11 via the wireless communication device 25. However, the XR display device 40 and the visualization device 11 may also be connected by wire.

[0022] 1-2. Functions of the visualization system of the first embodiment The functions of the visualization system 1 configured as described above will be explained using Fig. 2. Among the functions of the visualization system 1 described below, the function of the visualization device 11 is realized by reading the instruction INST from the program memory 102 and executing it in the processor 101.

[0023] First, the visualization device 11 acquires rolling process information INF01 from the control system 20 in real time. The visualization device 11 executes processing PRC01 using the rolling process information INF01 and specification information SPEC. Processing PRC01 is processing for generating three-dimensional visualization information INF02. The three-dimensional visualization information INF02 is information for visualizing the rolling equipment and the rolled material in three dimensions. The three-dimensional visualization information INF02 is generated by editing and integrating the rolling process information INF01 based on the specification information SPEC. The three-dimensional visualization information INF02 includes three-dimensional operation information of the rolling equipment and the rolled material, and visualization information that represents one-dimensional information of the rolling equipment and the rolled material in images.

[0024] In the case of equipment that is under open-loop control, feedback of its status cannot be obtained from the rolling process information INF01. For such equipment, under the assumption that no abnormalities have occurred in the status, the status at each point in time is estimated by interpolation calculation based on the expected change amount or operation amount and response characteristics such as the change speed of the actuator. Then, the three-dimensional visualization information INF02 is generated using the estimated status value.

[0025] The visualization device 11 executes a process PRC02 for transmitting three-dimensional visualization information INF02. The three-dimensional visualization information INF02 is transmitted to the three-dimensional animation display device 30 and the XR display device 40 by the process PRC02. The processes PRC01 and PRC02 executed by the visualization device 11 may be executed by the same processor, or may be executed by separate processors. Furthermore, the visualization device 11 may be configured with a device that executes the process PRC01 and a device that executes the process PRC02. The same can be said for each process executed by the visualization devices according to the second to fourth embodiments described below.

[0026] The three-dimensional animation display device 30 generates and displays a three-dimensional animation ADS01 from the three-dimensional visualization information INF02 through processing PRC11. Processing PRC11 uses an equipment three-dimensional model MDL and equipment operation definition information DEF, which are pre-stored in the memory of the three-dimensional animation display device 30. The equipment three-dimensional model MDL is mechanical three-dimensional model information of the rolling equipment and the rolled material for three-dimensional display. Information for operating this equipment three-dimensional model MDL is three-dimensional operation information contained in the three-dimensional visualization information INF02. Furthermore, equipment operation definition information DEF is definition information that indicates how each part of the equipment three-dimensional model MDL operates based on the three-dimensional operation information contained in the three-dimensional visualization information INF02. The three-dimensional operation information contained in the three-dimensional visualization information INF02 can be said to be information for operating the equipment three-dimensional model MDL in accordance with the operation of the actual rolling equipment and the operation and shape changes of the actual rolled material identified in the rolling process information INF01. While the three-dimensional visualization information INF02 is information that changes according to the rolling process information INF01, the equipment three-dimensional model MDL and the equipment operation definition information DEF are fixed information. However, if there is a change in the target rolling line, the equipment three-dimensional model MDL and the equipment operation definition information DEF are updated to reflect the change.

[0027] The three-dimensional animation display device 30 accepts the specification of a viewpoint VP from a user interface. In process PRC11, a three-dimensional animation ADS01 is generated in which the equipment three-dimensional model MDL is viewed from the direction of the specified viewpoint VP. The administrator can specify any viewpoint VP to monitor the operation and status of the rolling equipment and the rolled material from various directions. Note that if the three-dimensional animation display device 30 is integrated into the visualization device 11, the user interface 105 of the visualization device 11 may be used to specify the viewpoint VP.

[0028] The XR display device 40 generates and displays a 3D hologram HDS01 from the 3D visualization information INF02 using processing PRC21. Processing PRC21 uses a 3D device model MDL and device operation definition information DEF. These are the same as those used in the 3D animation display device 30 and are pre-stored in the memory of the XR display device 40. To generate the 3D hologram HDS01, for example, a technology is used that displays images from different viewpoints to both eyes to create a stereoscopic visualization. The 3D hologram HDS01 allows the wearer of the device to freely obtain visual 3D information from their own viewpoint.

[0029] 1-3. Three-dimensional display by the visualization system of the first embodiment Three-dimensional display by the visualization system 1 having the above-described functions will be described exemplarily with reference to Figs. 3 to 5. Figs. 3 to 5 show an example of a three-dimensional animation ADS01 displayed by a three-dimensional animation display device 30. The three-dimensional animation ADS01 is converted into a hologram to produce a three-dimensional hologram HDS01 displayed by an XR display device 40.

[0030] FIG. 3 is a diagram showing an example of a three-dimensional display of a rolling line. While the visualization system 1 can be applied to both hot and cold rolling lines, the rolling line 200 shown in FIG. 3 is a hot rolling line. The screen of the three-dimensional animation display device 30 displays rolling equipment such as a heating furnace 210, a sizing press 220, a roughing mill 230, a bar heater 240, a crop shear 250, a descaling device 260, a finishing mill 270, a run-out table 280, and a down coiler 290 that make up the rolling line 200 in three dimensions. For the roughing mill 230, for example, the first edger E1, the first horizontal rolling stand R1, the second edger E2, and the second horizontal rolling stand R2 are each displayed in three dimensions. For the finishing mill 270, for example, seven rolling stands F1-F7 arranged in series are displayed in three dimensions. The rolled material 300 flowing through the rolling line 200 is also displayed.

[0031] By displaying the entire rolling line 200 in three dimensions as shown in Figure 3, it is possible to easily grasp the operation of each piece of rolling equipment constituting the rolling line 200 and the transport state of the rolled material 300 flowing through the rolling line 200. In particular, by visualizing the sizing press 220, roughing mill 230, crop shear 250, finishing mill 270, run-out table 280, down coiler 290 shown as examples, as well as coil boxes and the like not shown as examples, it is easier to grasp their states than when they are represented numerically. The leading and trailing end positions, dimensions, shape, camber, and vertical warpage of the rolled material 300 can also be easily grasped using the three-dimensional display.

[0032] The visualization system 1 can also perform three-dimensional display for each piece of rolling equipment that makes up the rolling line 200. Fig. 4 is a diagram showing an example of a three-dimensional display of the first edger E1 and first horizontal rolling stand R1 of the roughing mill 230, which is one piece of rolling equipment. The left and right edger rolls 231L, 231R that make up the first edger E1 and the upper and lower horizontal rolls 232U, 232D that make up the first horizontal rolling stand R1 are displayed in three-dimensional form. Furthermore, motors that drive the horizontal rolls 232U, 232D, hydraulic cylinders that press down the horizontal rolls 232U, 232D in the vertical direction, and hydraulic cylinders that press down the edger rolls 231L, 231R in the width direction can also be added to the three-dimensional display.

[0033] The position, angle, shape, etc. of the rolled material 300 are depicted for each stage. In the example of FIG. 4 , the three-dimensional shapes of the rolled material 300A before being fed into the first edger E1, the rolled material 300B during width rolling by the first edger E1, and the rolled material 300C after horizontal rolling by the first horizontal rolling stand R1 are depicted. The end shape of the rolled material 300 during processing, specifically the crop shape at the leading and trailing ends, is an essential element for depiction, although no measured values ​​are available. Therefore, for example, a crop shape estimated from the amount of processing is generated by enlarging or reducing a representative dimensional shape stored in advance according to the amount of processing. Using such a method, the three-dimensional shape of the rolled material 300 during horizontal rolling by the first horizontal rolling stand R1 can also be depicted.

[0034] Furthermore, one-dimensional information of the roughing mill 230 that cannot be expressed in three-dimensional operation is visualized in three-dimensional representation based on image information. In the example of Figure 4, arrows representing the widthwise rolling loads PL and PR acting on the first edger E1 are displayed in three dimensions. Also, an arrow representing the vertical rolling load PW acting on the work side of the first horizontal rolling stand R1 and an arrow representing the vertical rolling load PD acting on the drive side are displayed in three dimensions. The length, thickness, or color of each arrow represents the magnitude of the rolling load.

[0035] By extracting the roughing mill 230 from the rolling line 200 and displaying it in detail in three dimensions, it is possible to more easily grasp, for example, the camber of the material 300 being rolled during rough rolling. Furthermore, by displaying images of the widthwise rolling loads PL, PR acting on the first edger E1 and the vertical rolling loads PW, PD acting on the first horizontal rolling stand R1 in three dimensions, it is possible to easily grasp the state of the roughing mill 230. Furthermore, by displaying these three-dimensional images in real time while the rolling line 200 is operating, it is possible to accurately manually intervene in the control.

[0036] Detailed three-dimensional display of each rolling equipment can also be performed for rolling equipment other than the roughing mill 230. For example, when a detailed three-dimensional display of the finishing mill 270 is performed, it is possible to more easily grasp the meandering of the rolled material 300 during finish rolling and the shape of the rolled material 300 after the finish rolling is completed. Although the thickness of the rolled material 300 and the gap between the rolling rolls during finish rolling are small changes, by enlarging and displaying the finishing mill 270 in three dimensions, it is possible to visually grasp these conditions. Furthermore, if the finishing mill 270 is equipped with a looper, the three-dimensional display can easily grasp movements such as hunting. In the case of the down coiler 290, the three-dimensional display makes it easy to distinguish between the four wrapper rolls around the mandrel and identify abnormal wrapper rolls.

[0037] Three-dimensional displays based on visualization information can also be applied to the three-dimensional display of one-dimensional information such as tension, rolling equipment and motor vibration, current, voltage, and motor temperature. For tension, the direction and magnitude can be expressed by the length and direction of an arrow. For vibration, current, voltage, and temperature, the magnitude can be expressed by color. When the three-dimensional visualization information includes visualization information, the three-dimensional animation display device 30 and the XR display device 40 generate images for three-dimensional display from the visualization information using pre-registered definition information. Combining three-dimensional displays based on three-dimensional operation information with three-dimensional displays based on visualization information allows for a more detailed and easier understanding of the state of the rolling process. For example, if a temperature abnormality is detected in the runout table 280, the color of the motor in question changes, making it easy to identify the motor with the temperature abnormality among multiple motors.

[0038] The three-dimensional display by the visualization system 1 can also be enlarged to more clearly display the movement and changes in shape of the rolled material 300. FIG. 5 is a diagram showing an example of a three-dimensional display of the rolled material 300. Side guides 271W and 271D are installed at the entrance of each rolling stand of the finishing rolling mill 270. In the finishing rolling mill 270, the rolled material 300 often enters the rolling stands at high speed. For this reason, the opening of the side guides 271W and 271D is set in advance to a width that includes a margin in addition to the width of the rolled material 300. FIG. 5 shows the rolled material 300 passing between the side guides 271W and 271D from a perspective from directly above.

[0039] Although the tail end 301 of the material to be rolled 300 is constricted, it is difficult to obtain actual measurements of the dimensions and shape of the constriction. For this reason, for example, when a collision with side guides 271W, 271D is detected, a change in the shape of the tail end 301 is estimated based on which of the two side guides 271W, 271D the material to be rolled collided with and the collision position of the material to be rolled 300. The change in shape includes the tail end 301 being cut or folded due to the collision. Figure 5 shows the tail end 301 of the material to be rolled 300 bending toward the side guide 271W and colliding with it.

[0040] 1-4. Effects of the visualization system of the first embodiment According to the visualization system 1, three-dimensional visualization information is generated from real-time rolling process information obtained from the rolling line. A manager who manages the rolling line can easily grasp the state of the rolling process in detail from the three-dimensional visualization information displayed on the three-dimensional display device. This improves equipment maintenance, improves product quality, and increases yield.

[0041] 2. Second Embodiment 2-1. Configuration of the Visualization System of the Second Embodiment The configuration of the visualization system according to the second embodiment of the present disclosure will be described with reference to Fig. 6. The difference between the visualization system 2 according to this embodiment and the visualization system 1 according to the first embodiment lies in the configuration of the visualization device that visualizes the rolling process information.

[0042] The visualization device 12 constituting the visualization system 2 includes a processor 101, a program memory 102, a specification information memory 103, a communication module 104, a user interface 105, and an information storage 106. Elements other than the information storage 106 are the same as those of the visualization device 11 according to the first embodiment, and therefore a description thereof will be omitted. However, in order to realize functions specific to this embodiment, which will be described later, the instructions INST according to this embodiment stored in the program memory 102 differ in content from the instructions INST according to the first embodiment.

[0043] The information storage 106 is communicatively coupled to the processor 101. The information storage 106 accumulates the 3D visualization information output to the 3D animation display device 30 and the XR display device 40. A database for managing the 3D visualization information is constructed in the information storage 106. The date and time when the 3D visualization information is recorded in the information storage 106 are managed in the database, so that 3D visualization information from any past time can be read from the information storage 106. The information storage 106 may be built in the visualization device 12 or may be externally attached to the visualization device 12.

[0044] 2-2. Functions of the visualization system of the second embodiment The functions of the visualization system 2 configured as described above will be explained using Figures 7 to 12. However, explanations of processes that are the same as the processes executed in the visualization system 1 according to the first embodiment will be omitted or simplified. Furthermore, explanations of information that is the same as the information used in the visualization system 1 according to the first embodiment will be omitted or simplified. Among the functions of the visualization system 2 described below, the function of the visualization device 12 is a function that is realized when the instruction INST according to this embodiment is read from the program memory 102 and executed by the processor 101.

[0045] 7 shows the real-time display function of three-dimensional visualization information, which is the first function of the visualization system 2. The visualization device 12 generates three-dimensional visualization information INF02 using rolling process information INF01 and specification information SPEC acquired in real time from the control system 20. The visualization device 12 then transmits the three-dimensional visualization information INF02 to the three-dimensional animation display device 30 and the XR display device 40, and stores all of the generated three-dimensional visualization information INF02 in the information storage 106.

[0046] The processing executed by the 3D animation display device 30 and the XR display device 40 upon receiving the 3D visualization information INF02 is the same as that in the visualization system 1.

[0047] FIG. 8 shows the second function of the visualization system 2, which is the function of reproducing and displaying past 3D visualization information. The visualization device 12 receives input of a designated period PBP and a designated speed PBS, and executes process PRC03 in accordance with the designated period PBP and the designated speed PBS. The user interface 105 is used to input the designated period PBP and the designated speed PBS. Process PRC03 reads 3D visualization information INF03 corresponding to the designated period PBP from the information storage 106 and reproduces it at the designated speed PBS. The designated period PBP is determined by a reproduction start time and a reproduction end time. However, it is also possible to start reproduction by specifying only the reproduction start time, and end reproduction at any time after the start of reproduction. The visualization device 12 executes process PRC02 and transmits 3D visualization information INF03 to the 3D animation display device 30 and the XR display device 40.

[0048] The three-dimensional animation display device 30 generates and displays a three-dimensional animation ADS02 from the three-dimensional visualization information INF03 by processing PRC11. The three-dimensional animation ADS02 is displayed at a specified speed PBS over a specified period PBP. The XR display device 40 generates and displays a three-dimensional hologram HDS02 from the three-dimensional visualization information INF03 by processing PRC21. The three-dimensional hologram HDS02 is displayed at a specified speed PBS over a specified period PBP.

[0049] 9 is a diagram showing an example of a display mode of a three-dimensional animation by the real-time display function and playback display function of the visualization system 2. In parallel with the display of the three-dimensional animation ADS01, the three-dimensional visualization information INF02 that is the basis of the three-dimensional animation ADS01 is accumulated in the information storage 106. The manager can grasp the state of the rolling process by the three-dimensional animation ADS01 that is displayed in real time.

[0050] After the 3D animation ADS01 has finished, the administrator may want to review a certain scene again. In such a case, the administrator operates the user interface 105 of the visualization device 12 and inputs the period of time that the administrator wants to review as the designated period PBP. In the example shown in FIG. 9 , the period from time t1 to time t2 is input as the designated period PBP. The administrator can also operate the user interface 105 of the visualization device 12 to input the designated speed PBS. The designated speed PBS is set to normal speed by default.

[0051] The three-dimensional visualization information INF03 corresponding to the specified period PBP is read from the information storage 106, and the read three-dimensional visualization information INF03 is played back at the specified speed PBS. The three-dimensional animation ADS02 generated from the three-dimensional visualization information INF03 is displayed, allowing the manager to reconfirm the state of the rolling process.

[0052] Figure 9 shows, from top to bottom, the playback period of the 3D animation ADS02 when the specified speed PBS is normal speed (x1.0), the playback period of the 3D animation ADS02 when the specified speed PBS is 0.5x speed (x0.5), and the playback period of the 3D animation ADS02 when the specified speed PBS is 2x speed (x2.0). As shown, the specified speed PBS can be made faster or slower than normal speed. The bottom row also shows the playback period of the 3D animation ADS02 when the specified speed PBS is changed in the order 2x speed, 0.5x speed, and normal speed. By changing the specified speed PBS in this way, it is possible to reduce the overall playback time while carefully observing a scene of interest.

[0053] FIG. 10 illustrates the third function of the visualization system 2, which is the simultaneous display function of real-time 3D visualization information and past 3D visualization information. The visualization device 12 executes process PRC01 on rolling process information INF01 acquired in real time from the control system 20, and generates 3D visualization information INF02 using the rolling process information INF01 and the specification information SPEC. In parallel with process PRC01, the visualization device 12 executes process PRC03 upon receiving a specified period PBP and reads out 3D visualization information INF03 corresponding to the specified period PBP from the information storage 106. Note that when the simultaneous display function is used, the specified speed PBS of the 3D visualization information INF03 is fixed to normal speed. The visualization device 12 executes process PRC02 and transmits the 3D visualization information INF02 and the 3D visualization information INF03 to the 3D animation display device 30 and the XR display device 40.

[0054] The three-dimensional animation display device 30 generates a three-dimensional animation ADS01 from the three-dimensional visualization information INF02 and generates a three-dimensional animation ADS02 from the three-dimensional visualization information INF03 by processing PRC11. The XR display device 40 generates a three-dimensional hologram HDS01 from the three-dimensional visualization information INF02 and generates a three-dimensional hologram HDS02 from the three-dimensional visualization information INF03 by processing PRC21.

[0055] 11 and 12 are diagrams showing examples of three-dimensional animation display modes using the simultaneous display function of the visualization system 2. In the first display mode shown in FIG. 11, the three-dimensional animation display device 30 displays three-dimensional animation ADS01 and three-dimensional animation ADS02 in parallel. Three-dimensional animation ADS01 represents the operation of the upper and lower rolls 272U and 272D and the state of the rolled material 300 at the current time. Three-dimensional animation ADS02 represents the operation of the upper and lower rolls 272U and 272D and the state of the rolled material 300 at a specified time in the past. By comparing the three-dimensional animation ADS01 and the three-dimensional animation ADS02, the manager can easily grasp changes in the operation of the rolls 272U and 272D and changes in the state of the rolled material 300. Note that the display screen displaying the three-dimensional animation ADS01 and the display screen displaying the three-dimensional animation ADS02 may be separate screens.

[0056] In the second display mode shown in Fig. 12, the three-dimensional animation display device 30 displays three-dimensional animation ADS02 superimposed on three-dimensional animation ADS01. In Fig. 12, three-dimensional animation ADS01 is shown by a dashed line, and three-dimensional animation ADS02 is shown by a solid line. By superimposing three-dimensional animation ADS02 on three-dimensional animation ADS01, the manager can more easily grasp changes in the operation of the rolling rolls 272U, 272D and changes in the state of the rolled material 300.

[0057] 2-3. Effects of the visualization system of the second embodiment According to the visualization system 2, three-dimensional visualization information reproduced from any past time is displayed on the three-dimensional display device. A manager who manages the rolling line can easily grasp the state of the past rolling process in detail from the three-dimensional visualization information displayed on the three-dimensional display device. This improves the accuracy of fault analysis, leading to improved product quality. In addition, all generated three-dimensional visualization information is stored in the information storage 107, making it possible to display multiple pieces of three-dimensional visualization information at different times in parallel or superimposed fashion.

[0058] 3. Third Embodiment 3-1. Configuration of the Visualization System of the Third Embodiment The configuration of the visualization system according to the third embodiment of the present disclosure will be described with reference to Fig. 13. The difference between the visualization system 3 according to this embodiment and the visualization system 1 according to the first embodiment lies in the configuration of the visualization device that visualizes the rolling process information.

[0059] The visualization device 12 constituting the visualization system 3 includes a processor 101, a program memory 102, a specification information memory 103, a communication module 104, and a user interface 105, as well as an information storage 107. Elements other than the information storage 107 are the same as those of the visualization device 11 according to the first embodiment, and therefore a description thereof will be omitted. However, in order to realize functions specific to this embodiment, which will be described later, the instructions INST according to this embodiment stored in the program memory 102 differ in content from the instructions INST according to the first embodiment.

[0060] The information storage 107 is communicatively coupled to the processor 101. The information storage 107 accumulates rolling process information acquired from the control system 20. A database for managing the rolling process information is constructed in the information storage 107. The date and time when the rolling process information is recorded in the information storage 107 are managed in the database, so that rolling process information from any time in the past can be read out from the information storage 107. The information storage 107 may be built in the visualization device 12 or may be externally attached to the visualization device 12.

[0061] 3-2. Functions of the visualization system of the third embodiment The functions of the visualization system 3 configured as described above will be explained using Figures 14 to 16. However, explanations of processes that are the same as the processes executed in the visualization system 1 or the visualization system 2 will be omitted or simplified. Also, explanations of information that is the same as the information used in the visualization system 1 or the visualization system 2 will be omitted or simplified. Among the functions of the visualization system 3 described below, the function of the visualization device 13 is a function that is realized when the instruction INST according to this embodiment is read from the program memory 102 and executed by the processor 101.

[0062] 14 shows the real-time display function of three-dimensional visualization information, which is the first function of the visualization system 3. The visualization device 13 generates three-dimensional visualization information INF02 using rolling process information INF01 and specification information SPEC acquired in real time from the control system 20, and stores all of the acquired rolling process information INF01 in the information storage 107. The visualization device 13 transmits the three-dimensional visualization information INF02 to the three-dimensional animation display device 30 and the XR display device 40.

[0063] The processing executed by the 3D animation display device 30 and the XR display device 40 upon receiving the 3D visualization information INF02 is the same as that in the visualization system 1.

[0064] 15 shows the second function of the visualization system 3, which is the function of reproducing and displaying past three-dimensional visualization information. The visualization device 13 receives input of a designated period PBP and a designated speed PBS, and executes process PRC04 in accordance with the designated period PBP and the designated speed PBS. The user interface 105 is used to input the designated period PBP and the designated speed PBS. Process PRC04 is a process of reading out rolling process information INF04 corresponding to the designated period PBP from the information storage 107 and reproducing it at the designated speed PBS. The designated period PBP is determined by a reproduction start time and a reproduction end time. However, it is also possible to start reproduction by specifying only the reproduction start time, and end reproduction at any time after the start of reproduction.

[0065] The visualization device 13 executes process PRC05 using the generated rolling process information INF04 and specification information SPEC. Process PRC05 is a process for generating three-dimensional visualization information INF03 for the specified period PBP. The three-dimensional visualization information INF03 is generated by editing and integrating the rolling process information INF04 based on the specification information SPEC. The visualization device 12 executes process PRC02 and transmits the three-dimensional visualization information INF03 to the three-dimensional animation display device 30 and the XR display device 40.

[0066] The processing executed by the 3D animation display device 30 and the XR display device 40 in response to the input of the 3D visualization information INF03 is the same as that in the visualization system 2.

[0067] 16 shows the function of simultaneously displaying real-time three-dimensional visualization information and past three-dimensional visualization information, which is the third function of the visualization system 3. The visualization device 13 executes processing PRC01 on rolling process information INF01 acquired in real time from the control system 20, and generates three-dimensional visualization information INF02 using the rolling process information INF01 and specification information SPEC.

[0068] In parallel with process PRC01, the visualization device 13 receives input of the designated period PBP and executes process PRC04, reading out rolling process information INF04 corresponding to the designated period PBP from the information storage 107. Furthermore, the visualization device 13 executes process PRC05 on the rolling process information INF04 read out from the information storage 107, and generates three-dimensional visualization information INF03 using the rolling process information INF04 and the specification information SPEC. The visualization device 12 executes process PRC02 and transmits three-dimensional visualization information INF02 and three-dimensional visualization information INF03 to the three-dimensional animation display device 30 and the XR display device 40.

[0069] The processing executed by the 3D animation display device 30 and the XR display device 40 in response to the input of the 3D visualization information INF02 and the 3D visualization information INF03 is the same as that in the visualization system 2.

[0070] 3-3. Effects of the visualization system of the third embodiment According to the visualization system 3, three-dimensional visualization information is generated using rolling process information reproduced from any past time, and the three-dimensional visualization information is displayed on a three-dimensional display device. A manager who manages a rolling line can easily grasp the state of past rolling processes in detail from the three-dimensional visualization information displayed on the three-dimensional display device. In addition, since the history of all information included in the rolling process information is stored in the information storage 107, the manager can analyze the displayed three-dimensional visualization information in conjunction with the history of the stored information. As a result, the accuracy of fault analysis is improved, which leads to improved equipment maintenance, improved product quality, and increased yield.

[0071] 4. Fourth Embodiment 4-1. Configuration of the Visualization System of the Fourth Embodiment The configuration of the visualization system according to the fourth embodiment of the present disclosure will be described with reference to Fig. 17. The difference between the visualization system 4 according to this embodiment and the visualization system 1 according to the first embodiment lies in the configuration of the visualization device that visualizes the rolling process information.

[0072] The visualization device 14 constituting the visualization system 4 includes a processor 101, a program memory 102, a specification information memory 103, a communication module 104, and a user interface 105, as well as a simulated information generator 108. The elements other than the simulated information generator 108 are the same as those of the visualization device 11 according to the first embodiment, and therefore a description thereof will be omitted.

[0073] The simulated information generator 108 is communicatively coupled to the processor 101. The simulated information generator 108 is a device that generates simulated information that simulates rolling process information. The simulated information may be information that simulates normal rolling process information, or information that simulates abnormal rolling process information. The rolling process information that forms the basis of the simulated information may be information that is actually obtained from the control system 20, or may be artificially created information. The simulated information generator 108 may be external to the visualization device 14 or may be built in.

[0074] 4-2. Functions of the visualization system of the fourth embodiment The functions of the visualization system 3 configured as described above will be explained using FIG. 18 . However, explanations of processes that are the same as those executed by the visualization system 1 will be omitted or simplified. Explanations of information that is the same as that used in the visualization system 1 will also be omitted or simplified. Among the functions of the visualization system 3 described below, the function of the visualization device 14 is a function that is realized when the instruction INST according to this embodiment is read from the program memory 102 and executed by the processor 101.

[0075] The visualization device 14 executes process PRC01 on the simulation information INF11 acquired from the simulation information generator 108, and generates simulated 3D visualization information INF12 using the simulation information INF11 and the specification information SPEC. Then, the visualization device 14 executes process PRC02 and transmits the simulated 3D visualization information INF12 to the 3D animation display device 30 and the XR display device 40.

[0076] The three-dimensional animation display device 30 generates a three-dimensional animation ADS11 from the simulated three-dimensional visualization information INF12 by processing PRC11. The XR display device 40 generates a three-dimensional hologram HDS11 from the simulated three-dimensional visualization information INF12 by processing PRC21.

[0077] 4-3. Effects of the visualization system of the fourth embodiment According to the visualization system 4, simulated three-dimensional visualization information is generated using simulated information that simulates rolling process information, and the simulated three-dimensional visualization information is displayed on a three-dimensional display device. A manager who manages a rolling line can easily grasp the state of the simulated rolling in detail from the simulated three-dimensional visualization information displayed on the three-dimensional display device. In particular, when information that simulates normal rolling process information is used as simulated information, the manager can find bugs in the three-dimensional equipment model or the equipment operation definition information based on abnormalities in the display content of the three-dimensional display device. Furthermore, when information that simulates abnormal rolling process information is used as simulated information, the manager can grasp in advance problems that may occur in the rolling line based on abnormalities in the display content of the three-dimensional display device.

[0078] 1, 2, 3, 4 Visualization system 11, 12, 13, 14 Visualization device 20 Control system 24 Control network 25 Wireless communication device 30 Three-dimensional animation display device 40 XR display device 101 Processor 102 Program memory 103 Specifications information memory 104 Communication module 105 User interface 106 Information storage 107 Information storage 108 Simulated information generator

Claims

1. A device for visualizing rolling process information of a rolling line, comprising: a specification information memory in which specification information of rolling equipment installed in the rolling line and rolled materials processed in the rolling line is registered; a program memory in which a plurality of executable instructions are stored; and one or more processors communicatively coupled to the specification information memory and the program memory, wherein the plurality of instructions are configured to cause the one or more processors to execute the following: acquire the rolling process information in real time from a control system that controls the rolling line; generate three-dimensional visualization information using the rolling process information and the specification information to visualize at least one of the rolling equipment and the rolled materials in three dimensions; and display the three-dimensional visualization information on a display device.

2. An apparatus for visualizing rolling process information according to claim 1, characterized in that the three-dimensional visualization information includes three-dimensional motion information of at least one of the rolling equipment and the rolled material.

3. An apparatus for visualizing rolling process information according to claim 2, characterized in that the three-dimensional visualization information further includes visualization information that expresses one-dimensional information of at least one of the rolling equipment and the rolled material in the form of an image.

4. An apparatus for visualizing rolling process information as described in claim 1, further comprising an information storage for storing the three-dimensional visualization information, wherein the plurality of instructions are configured to cause the one or more processors to further execute the following: accept a specified period inputted to a user interface; obtain the three-dimensional visualization information for the specified period from the information storage; and display the three-dimensional visualization information for the specified period on the display device.

5. An apparatus for visualizing rolling process information as described in claim 4, characterized in that the plurality of instructions are configured to cause the one or more processors to further execute the following: accept a specified speed input to the user interface; and display three-dimensional visualization information for the specified period on the display device at the specified speed.

6. An apparatus for visualizing rolling process information as described in claim 4, characterized in that the plurality of instructions are configured to cause the one or more processors to further execute the following: display the three-dimensional visualization information and the three-dimensional visualization information for the specified period in parallel on the display device.

7. An apparatus for visualizing rolling process information as described in claim 4, characterized in that the plurality of instructions are configured to cause the one or more processors to further execute the following: superimpose three-dimensional visualization information for the specified period on the three-dimensional visualization information and display the superimposed three-dimensional visualization information on the display device.

8. An apparatus for visualizing rolling process information as described in claim 1, further comprising an information storage for storing the rolling process information, wherein the plurality of instructions are configured to cause the one or more processors to further execute the following: accept a designated period inputted to a user interface; obtain rolling process information for the designated period from the information storage; generate three-dimensional visualization information for the designated period of at least one of the rolling equipment and the rolled material using the rolling process information for the designated period and the specification information; and display the three-dimensional visualization information for the designated period on the display device.

9. An apparatus for visualizing rolling process information as described in claim 1, further comprising a simulated information generator for generating simulated information simulating the rolling process information, wherein the instructions are configured to cause the one or more processors to further execute the following: generating simulated three-dimensional visualization information of at least one of the rolling equipment and the rolled material using the simulated information and the specification information; and displaying the simulated three-dimensional visualization information on the display device.

10. An apparatus for visualizing rolling process information according to claim 9, characterized in that the simulated information is information simulating normal rolling process information.

11. The rolling process information visualization device according to claim 9, wherein the simulated information is information simulating abnormal rolling process information.

Citation Information

Patent Citations

  • Visualization support device, control method for same, and interprocess visualization system

    JP2007114036A

  • Rolling line display system

    JP2019048337A

  • State detection system, method and program of mechanical equipment

    JP2021076594A