Facility temperature management system, facility temperature management program, and facility temperature management method

Abstract

To provide a facility temperature management system capable of highly accurately detecting radiation heat loss from a facility surface in a short time.SOLUTION: The facility temperature management system includes an imaging apparatus, an area calculation part, and a radiation heat loss calculation part. The imaging apparatus acquires a visible image 51a and a thermal image of a facility surface region 31a including a first AR marker 31, and acquires a visible image and a thermal image of a facility peripheral region including a second AR marker. The area calculation part calculates an area of a radiation heat loss calculation area R2 from the size of the first AR marker 31 captured in the visible image 51a. The radiation heat loss calculation part calculates radiation heat loss from a facility surface 10a from the area of the radiation heat loss calculation area R2, a facility surface temperature calculated from the thermal image of the facility surface region 31a, and an atmospheric temperature of the facility peripheral region.SELECTED DRAWING: Figure 9

Description

[Technical Field]

[0001] The present invention relates to a facility temperature control system, a program, and a method for controlling the temperature of a facility. [Background technology]

[0002] Conventionally, equipment such as paint drying ovens has been used to dry paint applied to workpieces such as automobile bodies. For this reason, hot air is constantly supplied to the oven to ensure that the paint dries reliably. Furthermore, the entire inner surface of the oven is covered with heat insulating material (not shown) to prevent heat from escaping outside. However, as the insulating material deteriorates over time, its insulating properties decrease, and heat inside the oven may leak to the outside. Therefore, technologies have been proposed to detect heat leakage by periodically capturing images of the oven surface using a thermal camera or the like to check the temperature (see, for example, Patent Documents 1 and 2). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 10-111714 [Patent Document 2] Japanese Patent Application Publication No. 6-138003 Summary of the Invention [Problem to be solved by the invention]

[0004] However, since the surface temperature of the drying oven is measured at only a few points, there is a high possibility that the error in the amount of heat radiated from the surface of the drying oven will be large. Although the error can be reduced by increasing the number of measurement points, the problem is that the measurement work takes a long time.

[0005] The present invention has been made in consideration of the above-mentioned problems, and its purpose is to provide an equipment temperature management system, equipment temperature management program, and equipment temperature management method that can detect the amount of heat radiated from the surface of equipment with high accuracy in a short period of time. [Means for solving the problem]

[0006] In order to solve the above problem, the invention described in claim 1 is a system for managing the temperature of equipment, comprising: a first AR marker provided in contact with a surface of the equipment; a second AR marker provided at a distance from the surface of the equipment; an imaging device that captures an image of the equipment surface area including the first AR marker to obtain a visible image and a thermal image of the equipment surface area, and captures an image of a peripheral area of ​​the equipment including the second AR marker to obtain a visible image and a thermal image of the peripheral area of ​​the equipment; a display device that displays the visible image and the thermal image of the equipment surface area and the visible image and the thermal image of the peripheral area of ​​the equipment on a display screen; and a display device that displays the visible image and the thermal image of the equipment surface area in which the first AR marker is captured. The gist of the present invention is an equipment temperature management system comprising: a calculation area setting unit that, when a specific area in an image is selected on the display screen, sets the selected specific area as a radiated heat calculation area; an area calculation unit that calculates the area of ​​the set radiated heat calculation area from the size of the first AR marker that appears in the visible image of the equipment surface area; and a radiated heat calculation unit that calculates the amount of heat radiated from the equipment surface from the calculated area of ​​the radiated heat calculation area, the equipment surface temperature calculated based on the thermal image of the equipment surface area, and the ambient temperature of the equipment surrounding area calculated based on the thermal image of the equipment surrounding area.

[0007] In the invention described in claim 1, the equipment surface temperature is calculated based on a thermal image of the equipment surface area, the ambient temperature is calculated based on a thermal image of the area surrounding the equipment, and the area of ​​the radiated heat calculation area is calculated based on the size of the first AR marker captured in the visible image of the equipment surface area.The radiated heat calculation unit then calculates the amount of heat radiated from the equipment surface based not only on the equipment surface temperature but also on the ambient temperature and the area of ​​the radiated heat calculation area, thereby enabling highly accurate detection of the amount of radiated heat.In addition, since the amount of radiated heat can be calculated without measuring the equipment surface temperature at multiple measurement points, the amount of radiated heat can be detected in a short time.

[0008] The imaging device may be a fixed imaging device or a non-fixed imaging device, but it is preferable to use a non-fixed imaging device. Non-fixed imaging devices are generally cheaper than fixed ones, so the temperature of the facility can be managed at low cost. Furthermore, when a non-fixed imaging device is used, it is possible to capture images of all of the first AR marker and the second AR marker with a single imaging device by moving the imaging location. Therefore, it is not necessary to install multiple imaging devices to capture images of all of the first AR marker and the second AR marker. Therefore, compared to using a fixed imaging device, the cost required to manage the temperature of the facility can be significantly reduced.

[0009] The invention described in claim 2 is based on claim 1 and further comprises an automatic image recognition unit that, when the first AR marker is included in the image acquired by the imaging device, recognizes the image as a visible image and a thermal image of the surface area of ​​the equipment, and, when the second AR marker is included, recognizes the image as a visible image and a thermal image of the area surrounding the equipment.

[0010] In the invention described in claim 2, the automatic image recognition unit distinguishes the type of AR marker, thereby recognizing whether the image acquired by the imaging device is an image of the equipment surface area or an image of the equipment's surrounding area. This eliminates the need for the worker to distinguish between the images acquired by the imaging device, thereby reducing the workload on the worker.

[0011] The invention described in claim 3 is based on claim 2 and further comprises an image correction unit that, if the visible image of the equipment surface area in which the first AR marker is captured is not a front view, corrects the visible image of the equipment surface area to a front view before the calculation area setting unit sets the dissipation heat calculation area.

[0012] When a non-fixed imaging device is used, the angle of view of the visible image of the equipment surface area changes each time it is captured. This makes it impossible to accurately compare visible images captured at different times, and it is therefore impossible to accurately manage the area of ​​the radiated heat calculation area calculated based on the visible image of the equipment surface area. Therefore, in claim 3, if the visible image of the equipment surface area is not a front-on view, the visible image of the equipment surface area is corrected to a front-on view before setting the radiated heat calculation area. As a result, it becomes possible to compare visible images, and the area of ​​the radiated heat calculation area can be accurately managed. Furthermore, because the image correction unit automatically corrects the visible image of the equipment surface area, the worker does not have to capture the image to a front-on view each time, thereby reducing the worker's workload.

[0013] The invention described in claim 4 is characterized in that, in claim 1, the dissipated heat amount calculation unit further includes a memory unit that stores the dissipated heat amount calculated in the past, and the display device is capable of displaying the past dissipated heat amount together with the current dissipated heat amount on the display screen.

[0014] In the invention described in claim 4, the current amount of heat dissipated as well as past amounts of heat dissipated are displayed on the display screen of the display device, so that the worker can see the changes in the amount of heat dissipated by looking at the display on the screen.

[0015] The invention described in claim 5 is based on claim 4 and further comprises a transition graph generation unit that generates a transition graph showing the transition of the amount of heat dissipated from the past to the present based on the current amount of heat dissipated and the past amount of heat dissipated, and the display device is capable of displaying the transition graph on the display screen.

[0016] In the invention described in claim 5, a graph showing the change in the amount of radiated heat is displayed on the display screen of the display device, so that the worker can easily understand the change in the amount of radiated heat by looking at the graph, making it easier to predict how much the amount of radiated heat will increase.

[0017] The invention described in claim 6 is summarized in that, in claim 5, it further includes a transition prediction unit that predicts the future transition of the amount of dissipated heat based on the transition graph generated by the transition graph generation unit.

[0018] According to the invention described in claim 6, the transition prediction unit predicts the transition of the amount of heat dissipated, so that workers can estimate the time for repairing the equipment based on the predicted transition of the amount of heat dissipated.

[0019] The invention described in claim 7 is based on claim 6 and further comprises a threshold setting unit that sets a threshold for the amount of heat dissipated that indicates an abnormality has occurred in the equipment, and an abnormality occurrence time prediction unit that predicts when an abnormality will occur in the equipment based on the result of comparing the amount of heat dissipated in the future predicted by the transition prediction unit with the threshold.

[0020] According to the invention of claim 7, the abnormality occurrence time prediction unit predicts when an abnormality will occur in the equipment, so that the worker can know the exact time to repair the equipment. Also, since the worker does not have to predict when an abnormality will occur in the equipment, the workload of the worker can be reduced.

[0021] The invention described in claim 8 is an equipment temperature management program that causes a processor controlling a system for managing the temperature of equipment to execute the following steps: an image display step of displaying, on a display screen of a display device, a visible image and a thermal image of an equipment surface area obtained by capturing an image of the equipment surface area including a first AR marker provided in contact with the equipment surface, and a visible image and a thermal image of the equipment peripheral area obtained by capturing an image of the equipment peripheral area including a second AR marker provided at a distance from the equipment surface; a calculation area setting step of setting, when a specific area in the visible image of the equipment surface area in which the first AR marker is captured is selected on the display screen, the selected specific area as a radiated heat amount calculation area; an area calculation step of calculating an area of ​​the set radiated heat amount calculation area from the size of the first AR marker captured in the visible image of the equipment surface area; and a radiated heat amount calculation step of calculating the amount of heat radiated from the equipment surface from the area of ​​the calculated radiated heat amount calculation area, the equipment surface temperature calculated based on the thermal image of the equipment surface area, and the ambient temperature of the equipment peripheral area calculated based on the thermal image of the equipment peripheral area.

[0022] The invention of claim 9 is a method for managing the temperature of equipment, comprising: an equipment surroundings imaging step of imaging an equipment surface area including a first AR marker provided in contact with the equipment surface to obtain a visible image and a thermal image of the equipment surface area, and imaging an equipment surrounding area including a second AR marker provided at a distance from the equipment surface to obtain a visible image and a thermal image of the equipment surrounding area; an image display step of displaying the visible image and the thermal image of the equipment surface area and the visible image and the thermal image of the equipment surrounding area on a display screen of a display device; and a step of displaying a specific area in the visible image of the equipment surface area in which the first AR marker is captured on the display screen of a display device. The gist of this equipment temperature management method is that it includes a calculation area setting step of selecting the specific area on a display screen and setting the selected specific area as a radiated heat calculation area; an area calculation step of calculating the area of ​​the set radiated heat calculation area from the size of the first AR marker captured in the visible image of the equipment surface area; and a radiated heat calculation step of calculating the amount of heat radiated from the equipment surface from the calculated area of ​​the radiated heat calculation area, the equipment surface temperature calculated based on the thermal image of the equipment surface area, and the ambient temperature of the equipment surrounding area calculated based on the thermal image of the equipment surrounding area. [Effects of the Invention]

[0023] As described above in detail, according to the inventions set forth in claims 1 to 9, the amount of heat radiated from the surface of equipment can be detected with high accuracy in a short time. [Brief explanation of the drawings]

[0024] [Figure 1] 1 is a schematic configuration diagram showing an equipment temperature management system according to an embodiment of the present invention; [Figure 2] Photograph showing a visible image of the equipment surface area. [Figure 3] Photograph showing visible image of the area around the facility. [Figure 4] Photograph showing a thermal image of a surface area of ​​equipment. [Figure 5] Photograph showing a thermal image of the area around the facility. [Figure 6]10 is a flowchart showing a process for managing the temperature of a drying oven. [Figure 7] FIG. 10 is an explanatory diagram showing a method for determining a frame portion. [Figure 8] FIG. 10 is a schematic diagram showing a visible image in which a frame is set. [Figure 9] FIG. 10 is an explanatory diagram showing a method for setting a dissipation heat amount calculation area. [Figure 10] 10 is a graph showing the change in heat dissipation from the past to the present. [Figure 11] 10 is a graph showing a trend of predicted future changes in the amount of heat dissipation. [Figure 12] 10 is a graph showing when an abnormality will occur in the drying furnace. DETAILED DESCRIPTION OF THE INVENTION

[0025] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will now be described in detail with reference to the accompanying drawings.

[0026] As shown in FIG. 1, the facility temperature management system 1 of this embodiment is a system for managing the temperature of a drying furnace 10 (facility). The drying furnace 10 is used to dry paint applied to the surface of a workpiece W1 (an automobile body in this embodiment) that has passed through a paint booth (not shown). The drying furnace 10 is formed into a substantially rectangular parallelepiped shape using a wall material such as a steel plate, and includes a ceiling 11, a floor 12, and a pair of side walls 13. Furthermore, a heat insulating material (not shown) is attached to the entire inner surface of the drying furnace 10. A conveyor 21 is provided on the floor 12 of the drying furnace 10. The conveyor 21 is a device that transports multiple carts 22, each carrying the workpiece W1, along a transport direction (to the right in FIG. 1).

[0027] As shown in FIGS. 1 and 2, a plurality of first AR (Augmented Reality) markers 31 are provided along the conveyance direction on the sidewall 13 of the drying furnace 10. Each of the first AR markers 31 is provided at a specific measurement point A1 to A13 in the drying furnace 10. Each of the first AR markers 31 has different geometric characteristics for each of the measurement points A1 to A13 and is a two-dimensional plate-like member provided in contact with the equipment surface 10a of the drying furnace 10. The first AR marker 31 in this embodiment is a marker member (ArUco marker) having a geometric pattern 34 made of two colors (white and black) with different brightness displayed on the surface 33 of a square-shaped base 32 made of a material with high thermal conductivity (aluminum).

[0028] As shown in FIGS. 1 and 3, a second AR marker 41 is provided on the side wall 13 of the drying oven 10. The second AR marker 41 is provided at a location in the factory that is not affected by sunlight, specifically, at a specific measurement point A0 in the drying oven 10. The second AR marker 41 has geometric characteristics different from those of the first AR markers 31 and is a two-dimensional plate-like member provided at a distance of 100 mm or more from the equipment surface 10a of the drying oven 10. The second AR marker 41 is suspended from a beam 15 of a marker support frame 14 installed near the side wall 13. The second AR marker 41 in this embodiment is a marker member (ArUco marker) having a geometric pattern 44 made of two colors (white and black) of different brightness displayed on the surface 43 of a square-shaped base 42 made of a material with high thermal conductivity (aluminum).

[0029] As shown in FIG. 1, the facility temperature management system 1 includes a thermal camera 50, which is a non-fixed (i.e., portable) imaging device. The thermal camera 50 captures an image of the facility surface area 31a (see FIGS. 2 and 4) including the first AR marker 31, thereby simultaneously acquiring a visible image 51a (see FIG. 2) and a thermal image 52a (see FIG. 4) of the facility surface area 31a. The thermal camera 50 also captures an image of the facility peripheral area 41a (see FIGS. 3 and 5) including the second AR marker 41, thereby simultaneously acquiring a visible image 51b (see FIG. 3) and a thermal image 52b (see FIG. 5) of the facility peripheral area 41a. The thermal camera 50 then outputs image data of the captured visible images 51a and 51b and thermal images 52a and 52b. The visible images 51a and 51b are color images, and the thermal images 52a and 52b are infrared images.

[0030] Next, the electrical configuration of the facility temperature control system 1 will be described.

[0031] As shown in FIG. 1, the facility temperature control system 1 includes a personal computer (not shown), which includes a control device 60 (processor) that controls the entire system. The control device 60 is configured using a well-known computer including a CPU 61, ROM 62, RAM 63, etc. An input device 64 of the personal computer is electrically connected to the CPU 61. The input device 64 is configured, for example, with a keyboard, switches, various pointing devices, etc., and is used for inputting instructions from workers, inputting parameters, etc. Examples of pointing devices include a touchpad, touch panel, mouse, pen tablet, trackball, joystick, etc.

[0032] The CPU 61 is also electrically connected to a display 65 (display device) of the personal computer. A visible image 51a and a thermal image 52a of the equipment surface area 31a, and a visible image 51b and a thermal image 52b of the equipment peripheral area 41a are displayed on a display screen 65a (see FIG. 9) of the display 65. Furthermore, in this embodiment, the thermal camera 50 is electrically connected to the CPU 61 by connecting the thermal camera 50 to the control device 60 via a USB (Universal Serial Bus) cable. As a result, the visible images 51a, 51b and thermal images 52a, 52b acquired by the thermal camera 50 are stored in the RAM 63. Furthermore, the ROM 62 stores a program for controlling the equipment temperature control system 1 (equipment temperature control program).

[0033] The CPU 61 controls the temperature of the drying furnace 10 based on an equipment temperature control program stored in the ROM 62.

[0034] 6, the worker captures an image of the equipment surrounding area 41a including the second AR marker 41 at the measurement point A0 while holding the thermal camera 50, thereby acquiring a visible image 51b (see FIG. 3) and a thermal image 52b (see FIG. 5) of the measurement point A0. The thermal camera 50 of this embodiment is a handheld camera that simultaneously captures the visible image 51b and the thermal image 52b on a common optical axis.

[0035] In step S20, the worker, while holding the thermal camera 50, captures an image of the equipment surface area 31a including the first AR marker 31 at any one of the measurement points A1 to A13, thereby obtaining a visible image 51a (see FIG. 2) and a thermal image 52a (see FIG. 4) of the selected measurement point. The thermal camera 50 of this embodiment simultaneously obtains the visible image 51a and the thermal image 52a along a common optical axis.

[0036] After capturing the images of the measurement points, the operator connects the thermal camera 50 to the PC control device 60 using a USB cable. At this point, the thermal camera 50 outputs the image data of the captured visible images 51a, 51b and thermal images 52a, 52b to the CPU 61. The CPU 61 then stores the visible images 51a, 51b and thermal images 52a, 52b represented by the input image data in the RAM 63. The CPU 61 then performs an image display step, and controls the display of the visible image 51a and thermal image 52a of the equipment surface area 31a and the visible image 51b and thermal image 52b of the equipment peripheral area 41a stored in the RAM 63 on the display screen 65a of the display 65.

[0037] Next, the CPU 61 determines the types of the AR markers 31, 41 captured by the thermal camera 50 based on the geometric features captured in the visible images 51a, 51b. Specifically, the CPU 61 performs processes such as binarization, contour extraction, and intersection calculation on the visible images 51a, 51b stored in the RAM 63, and controls the extraction of the AR markers 31, 41 from the visible images 51a, 51b. Furthermore, the CPU 61 calculates ID numbers (0 to 13) of the extracted AR markers 31, 41 from the shapes of the geometric patterns 34, 44 displayed on the AR markers 31, 41. The ID numbers (0 to 13) are numbers associated with the measurement points A0 to A13.

[0038] If the calculated ID number is "0", the CPU 61 automatically recognizes that the extracted AR marker is the second AR marker 41 and that the second AR marker 41 is included in the image acquired by the thermal camera 50 (step S30). In this case, the CPU 61 recognizes that the acquired image is a visible image 51b and a thermal image 52b of the equipment peripheral area 41a. That is, the CPU 61 has a function as an "automatic image recognition unit."

[0039] Furthermore, if the calculated ID number is any one of "1" to "13," the CPU 61 automatically recognizes that the extracted AR marker is the first AR marker 31 and that the first AR marker 31 is included in the image acquired by the thermal camera 50 (step S40). In this case, the CPU 61 recognizes that the acquired image is the visible image 51a and the thermal image 52a of the equipment surface area 31a.

[0040] When the CPU 61 recognizes that the second AR marker 41 is included in the acquired image (step S30), the CPU 61 performs the process of step S50. Specifically, the CPU 61 calculates the surface temperature of the second AR marker 41 based on the thermal image 52b of the equipment surrounding area 41a, and determines the ambient temperature of the equipment surrounding area 41a based on the calculated surface temperature. More specifically, the CPU 61 measures the temperatures of a plurality of pixels (points) located on the surface 43 of the second AR marker 41 among the pixels (points) of the thermal image 52b. The CPU 61 then calculates the average value of the temperatures of the measured pixels, and determines the calculated average value as the ambient temperature.

[0041] Furthermore, when the CPU 61 recognizes that the first AR marker 31 is included in the acquired image (step S40), the CPU 61 performs the process of step S60. Specifically, if the visible image 52a in which the first AR marker 31 is captured is not in a frontal view state, the CPU 61 performs control to correct the visible image 51a to a frontal view state before setting the dissipation heat amount calculation area R2 (step S70), which will be described later. That is, the CPU 61 functions as an "image corrector." More specifically, the CPU 61 sets a frame 35 (see FIGS. 7 and 8) consisting of red straight lines in the visible image 51a based on shape information of the first AR marker 31 present in the visible image 51a.

[0042] 7, the range of the frame 35 is defined by the lengths of the top, bottom, left, and right directions with the center C1 of the first AR marker 31 as the reference. The frame 35 is set so as not to protrude from the visible image 51a and to occupy as large an area as possible within the visible image 51a. The frame 35 does not have to be red and may be a dashed line. Although the frame 35 in this embodiment is displayed on the display screen 65a of the display 65, it does not have to be displayed.

[0043] Then, the CPU 61 performs control to display the frame 35 in its initial state on the display screen 65a, superimposed on the visible image 51a. The frame 35 in its initial state is a frame having a shape similar to that of the first AR marker 31. First, the CPU 61 performs control to expand the frame 35 until one of the four vertices P1 (see FIGS. 7 and 8) of the frame 35 contacts the outer peripheral edge of the visible image 51a. Next, the CPU 61 determines whether or not the frame 35 can be extended along the length of the diagonal line passing through the vertex P1 that contacts the outer peripheral edge, out of the two diagonals of the frame 35. If it is determined that the frame 35 can be extended, the CPU 61 performs control to extend the frame 35 along the length of the diagonal line until one of the remaining three vertices P1 that are not contacting the outer peripheral edge contacts the outer peripheral edge. Furthermore, if there are still two vertices P1 that are not in contact with the outer periphery of the visible image 51a and the two vertices P1 are adjacent to each other, the CPU 61 performs control to extend the frame 35 in a direction perpendicular to the edge connecting the two vertices P1. For example, if the upper left vertex P1 and the upper right vertex P1 are not in contact with the outer periphery of the visible image 51a, the CPU 61 performs control to extend the frame 35 upward. At this point, the frame 35 is set on the visible image 51a (see FIG. 8). Note that the frame 35 may be set using a method different from the above method.

[0044] Next, the CPU 61 performs control to correct the misalignment of the angle of view of the visible image 51a and the frame 35. Specifically, the CPU 61 calculates a perspective transformation matrix for the frame 35 displayed in the visible image 51a and performs perspective transformation to correct the frame 35 to a rectangle having the same area and shape as the visible image 51a, and this is defined as the corrected visible image 51a. As a result, the angle of view of the corrected visible image 51a matches the angle of view in the case of a frontal view, and the visible image 51a is corrected to be in the state of a frontal view.

[0045] In the subsequent step S70 (calculation area setting step), the worker selects a specific area R1 (see FIG. 9) in the visible image 51a of the equipment surface area 31a, in which the first AR marker 31 is captured, on the display screen 65a of the display 65, and the CPU 61 sets the specific area R1 based on the selection. Specifically, first, the worker clicks the mouse, which is the input device 64, to specify a "horizontal" field 71, and then operates the keyboard, which is also the input device 64, to input the number of horizontal divisions ("20" in FIG. 9). The worker also clicks the mouse to specify a "vertical" field 72, and then operates the keyboard to input the number of vertical divisions ("20" in FIG. 9). Then, the worker presses the apply button 73 by operating the mouse. As a result, 400 squares 74 forming a grid of 20 horizontal rows (1 to 20) and 20 vertical columns (A to T) are displayed in the visible image 51a. The apply button 73 is a rectangular icon labeled "apply." By changing the number of divisions entered in the "horizontal" field 71 or the "vertical" field 72, the number and size of the squares 74 can be changed as desired.

[0046] The RAM 63 stores previously selected specific regions R1. In this embodiment, the selection of a specific region R1 is permitted only within the range of the previously selected specific region R1. The display screen 65a of the display 65 can display a selectable range R0 of the specific region R1 (see FIG. 9).

[0047] Next, the operator selects multiple squares 74 using the mouse and sets the selected squares 74 as the specific area R1. In this embodiment, the specific area R1 is the same as the selectable range R0. The operator then presses the area setting button 75 using the mouse. This causes the CPU 61 to set the selected specific area R1 as the radiated heat amount calculation area R2 (see FIG. 9). In other words, the CPU 61 functions as a "calculation area setting unit." The area setting button 75 is a rectangular icon labeled "Area Setting." In FIG. 9, the selectable range R0, the specific area R1, and the radiated heat amount calculation area R2 are indicated by hatching. When the operator presses the area cancellation button 76 using the mouse, the setting of the radiated heat amount calculation area R2 and the selection of the specific area R1 are cancelled. The area cancellation button 76 is a rectangular icon labeled "Area Cancel."

[0048] In the next step S80, the CPU 61 calculates the surface temperature of the first AR marker 31 based on the thermal image 52a of the equipment surface region 31a, and calculates the surface temperature of the drying oven 10 based on the calculated surface temperature. Specifically, the CPU 61 measures the temperatures of a plurality of pixels located on the surface of each of the plurality of squares 74 constituting the dissipation heat amount calculation area R2, among the pixels (points) of the thermal image 52a. Next, the CPU 61 calculates an average value of the measured temperatures of each pixel in each square 74, and determines the calculated average value as the surface temperature for each square 74. Furthermore, the CPU 61 selects the square 74 with the highest surface temperature and the square 74 with the lowest surface temperature from the squares 74 for which the surface temperatures have been determined. The CPU 61 also calculates an average value of the surface temperatures of each square 74, and determines the calculated average value as the surface temperature of the drying oven 10.

[0049] In the next step S90, the worker inputs the size of the first AR marker 31, specifically the length of one side of the square-shaped first AR marker 31, into the RAM 63. Specifically, the worker clicks the mouse to specify the "marker size" field 81, and then operates the keyboard to input the size of the first AR marker 31 ("10 cm" in FIG. 9). In this embodiment, the number "10" is normally input in the field 81, and when using an AR marker of a different size from the first AR marker 31, the worker changes the number input in the field 81.

[0050] In the next step S100 (area calculation step), the CPU 61 calculates (automatically calculates) the area of ​​the set radiated heat quantity calculation area R2 from the size of the first AR marker 31 captured in the visible image 51a of the equipment surface area 31a. That is, the CPU 61 functions as an "area calculation unit." Specifically, the CPU 61 calculates the area of ​​the radiated heat quantity calculation area R2 based on the number of squares 74 and the ratio between the size of the squares 74 and the size of the first AR marker 31. The calculated area of ​​the radiated heat quantity calculation area R2 is displayed in a field 82 (see FIG. 9) to the right of the "marker size" field 81.

[0051] In the next step S110, the CPU 61 inputs the heat quantity calculation conditions. Specifically, the operator clicks the mouse to specify the "emissivity" field 83, and then operates the keyboard to input the emissivity of the equipment surface 10a ("0.8" in FIG. 9). The operator also clicks the mouse to specify the "convective heat transfer coefficient" field 84, and then operates the keyboard to input the convective heat transfer coefficient ("7 W / m2k" in FIG. 9), thereby confirming that the heat quantity calculation conditions have been met.

[0052] In the following step S120, when the operator presses the calculation button 85 (see FIG. 9) by operating the mouse, the CPU 61 starts calculation. The calculation button 85 is a rectangular icon with the word "execute" attached to it.

[0053] In the following step S130 (dissipated heat amount calculation step), the CPU 61 calculates the amount of heat radiated from the equipment surface 10a based on the area of ​​the radiated heat amount calculation area R2 calculated in step S100, the surface temperature (equipment surface temperature) of the drying oven 10 calculated in step S80, and the ambient temperature calculated in step S50. That is, the CPU 61 functions as a "dissipated heat amount calculation unit." Specifically, the CPU 61 first calculates the temperature difference between the surface temperature of the drying oven 10 and the ambient temperature. Note that the temperature difference is calculated when the surface temperature of the drying oven 10 is higher than the ambient temperature. Next, the CPU 61 calculates the product of the area of ​​the radiated heat amount calculation area R2 calculated in step S100, the convective heat transfer coefficient input in step S110, and the above-mentioned temperature difference, and sets the calculated value as the amount of heat radiated.

[0054] The current amount of dissipated heat calculated by the CPU 61 is stored in the RAM 63. In addition, amounts of dissipated heat calculated by the CPU 61 in the past are also stored in the RAM 63. That is, the RAM 63 functions as a "storage unit."

[0055] In the next step S140, the CPU 61 generates a transition graph (see FIG. 10) showing the transition of the amount of heat dissipation from the past to the present, based on the current amount of heat dissipation and the past amount of heat dissipation stored in the RAM 63. That is, the CPU 61 functions as a "transition graph generator." The CPU 61 then controls the display of the generated transition graph on the display screen 65a of the display 65. This enables the display 65 to display the past amounts of heat dissipation (December 16, 2023 and December 18, 2023 in FIG. 10) on the display screen 65a, along with the current amount of heat dissipation (December 20, 2023 in FIG. 10). The transition graph shows a broken line L(ave) showing the transition of the average value of the amount of heat dissipation, a broken line L(max) showing the transition of the maximum value of the amount of heat dissipation, and a broken line L(min) showing the transition of the minimum value of the amount of heat dissipation.

[0056] Therefore, according to this embodiment, the following effects can be obtained.

[0057] (1) In this embodiment, the equipment temperature management system 1 calculates the equipment surface temperature based on the thermal image 52a (see FIG. 4) of the equipment surface area 31a, and calculates the ambient temperature based on the thermal image 52b (see FIG. 5) of the equipment peripheral area 41a. The CPU 61 calculates the radiated heat amount calculation area R2 based on the size of the first AR marker 31 (see FIG. 9) captured in the visible image 51a of the equipment surface area 31a. The CPU 61 calculates the radiated heat amount from the equipment surface 10a based not only on the equipment surface temperature but also on the ambient temperature and the area of ​​the radiated heat amount calculation area R2, enabling highly accurate detection of the radiated heat amount. Therefore, if an operator detects an abnormally high radiated heat amount when viewing the trend graph, the operator can assume that heat is leaking outside the drying oven 10 due to deterioration of the insulation, and can therefore begin repairing the insulation. Furthermore, by rechecking the radiated heat amount after repair, the operator can confirm whether the repair was properly performed. Furthermore, since the amount of radiated heat can be calculated without measuring the equipment surface temperature at many measurement points A1 to A13, the amount of radiated heat can be detected in a short time.

[0058] (2) In this embodiment, when calculating the amount of radiated heat, the surface temperature (equipment surface temperature) of the drying furnace 10 is calculated based on the thermal image 52a in which the first AR marker 31 appears, and the ambient temperature is determined based on the second thermal image 52b in which the second AR marker 41 appears. Then, the temperature difference between the surface temperature and the ambient temperature is calculated in advance. This cancels out changes in the surface temperature caused by changes in the ambient temperature. Therefore, by measuring the transition of the amount of radiated heat from the equipment surface 10a in this state, the amount of radiated heat can be detected with high accuracy without being affected by the ambient temperature.

[0059] (3) In this embodiment, the worker selects the specific region R1 while a plurality of grid-like squares 74 are displayed on the visible image 51a. At this time, the worker uses the square 74 selected by the mouse as the specific region R1, which makes it easy to select the specific region R1 and, in turn, makes it easy to set the dissipation heat amount calculation area R2 based on the specific region R1.

[0060] (4) In this embodiment, the base 42 constituting the second AR marker 41 is made of aluminum, which has high thermal conductivity and heat resistance capable of withstanding temperatures of several hundred degrees Celsius (at least 100 degrees Celsius or higher). This makes it easier for the surface temperature of the second AR marker 41 to follow the ambient temperature. As a result, by capturing an image of the second AR marker 41 with a thermal camera 50, the ambient temperature can be accurately calculated based on the second AR marker 41 captured in the thermal image 52b. Furthermore, because the bases 32, 42 constituting the AR markers 31, 41 are not made of flammable materials such as resin, the AR markers 31, 41 can be suitably used in a drying oven 10 that uses hot air.

[0061] (5) In this embodiment, the second AR marker 41 is provided at a position 100 mm or more away from the equipment surface 10a of the drying furnace 10, and is therefore less susceptible to the influence of the surface temperature of the drying furnace 10. Therefore, the surface temperature of the second AR marker 41, and therefore the ambient temperature, can be accurately calculated.

[0062] The above embodiment may be modified as follows.

[0063] In the above embodiment, the CPU 61 displays a transition graph (see FIG. 10) showing the transition of the amount of heat dissipation from the past to the present. However, instead of the transition graph, the CPU 61 may display, on the display screen 65a of the display 65, a table or the like showing numerical values ​​showing the transition of the amount of heat dissipation from the past to the present. Furthermore, the CPU 61 may perform control so that only the numerical values ​​of the current amount of heat dissipation are displayed on the display screen 65a.

[0064] In the above embodiment, after generating the transition graph (after step S140 shown in FIG. 6), the CPU 61 may predict the future transition of the amount of dissipated heat based on the generated transition graph. That is, the CPU 61 may function as a "transition prediction unit." In this case, the CPU 61 controls the display screen 65a of the display 65 to display a transition graph (see FIG. 11) predicting the future transition of the amount of dissipated heat. This allows the display 65 to display the future amount of dissipated heat on the display screen 65a in addition to the current amount of dissipated heat (December 20, 2023) and the past amounts of dissipated heat (December 16, 2023 and December 18, 2023). For example, if the operator clicks the mouse to specify the "Prediction Target" field 91 and then operates the keyboard to input a date and time ("Prediction for 3 days later" in FIG. 11), the amount of dissipated heat three days later (December 23, 2023) will be displayed on the display screen 65a. In addition, the broken line L(ave) showing the trend in the average value of the amount of heat dissipated, the broken line L(max) showing the trend in the maximum value of the amount of heat dissipated, and the broken line L(min) showing the trend in the minimum value of the amount of heat dissipated, have the predicted portion of the trend in the amount of heat dissipated (specifically, the period from the present to the future) shown as a dashed line.

[0065] In the above embodiment, the CPU 61 may set a threshold value for the amount of radiated heat that indicates an abnormality in the drying oven 10 (e.g., heat leakage to the outside of the drying oven 10). That is, the CPU 61 may function as a "threshold value setting unit." After generating the transition graph, the CPU 61 may predict a future transition in the amount of radiated heat based on the transition graph, and predict when an abnormality will occur in the drying oven 10 based on the result of comparing the predicted future amount of radiated heat with a threshold value (120°C in this embodiment). That is, the CPU 61 may function as an "abnormality occurrence time predicting unit." In this case, the CPU 61 controls the display 65 to display a prediction graph (see FIG. 12) that predicts when an abnormality will occur in the drying oven 10 on the display screen 65a. As a result, the display 65 can display on the display screen 65a the current (December 20, 2023) and past (December 16 and December 18, 2023) dissipated heat amounts, as well as the time when an abnormality will occur in the drying oven 10 (December 28, 2023). For example, if an operator clicks the mouse to select the "Abnormal Setpoint" field 92 and then operates the keyboard to input a temperature (in FIG. 12, "Predicted 30°C Increase"), the dissipated heat amount when the temperature rises by 30°C (December 28, 2023) is displayed on the display screen 65a. Additionally, a horizontal line L1 indicating the abnormal setpoint (threshold) is displayed on the prediction graph. Therefore, the operator can take advantage of the fact that the drying oven 10 has reached the time when an abnormality will occur, as predicted by the CPU 61, to inspect or repair the drying oven 10.

[0066] In the above embodiment, the CPU 61 calculates the average value of the temperatures of the pixels (points) located on the surface of each of the plurality of squares 74 that make up the dissipation heat calculation area R2, and determines the calculated average value as the surface temperature of the single square 74. However, the CPU 61 may also determine the maximum value, minimum value, etc. of the temperatures of the pixels located on the surface of the square 74 as the surface temperature of the single square 74.

[0067] Furthermore, the CPU 61 in the above embodiment calculates the average value of the surface temperatures of the multiple squares 74 and determines the calculated average value as the surface temperature of the drying furnace 10. However, the CPU 61 may select the square 74 with the highest or lowest surface temperature from among the squares 74 for which the surface temperatures have been determined, and determine the surface temperature of the selected square 74 as the surface temperature of the drying furnace 10.

[0068] In the above embodiment, the CPU 61 calculates the average value of the temperatures of multiple pixels (points) in the second AR marker 41 and determines the calculated average value as the ambient temperature. However, the CPU 61 may also determine the maximum or minimum value of the temperatures of each pixel in the second AR marker 41 as the ambient temperature.

[0069] The AR markers 31 and 41 in the above embodiments are two-dimensional ArUco markers, but they may be other two-dimensional markers such as AprilTag. Furthermore, other two-dimensional objects such as pictures, letters, and symbols may also be used as AR markers.

[0070] In the above embodiment, the square-shaped AR markers 31 and 41 are used, but AR markers in the shape of rectangles, parallelograms, diamonds, trapezoids, circles, ellipses, etc. may also be used.

[0071] In the above embodiment, the thermal camera 50 was used as the imaging device, capturing images of the equipment surface area 31a to simultaneously acquire the visible image 51a and the thermal image 52a, and capturing images of the equipment peripheral area 41a to simultaneously acquire the visible image 51b and the thermal image 52b. However, the imaging device may also be composed of a visible image imaging camera that captures the visible images 51a and 51b, and a thermal image imaging camera that is provided separately from the visible image imaging camera and captures the thermal images 52a and 52b. It is preferable that the visible image imaging camera and the thermal image imaging camera are positioned as close to each other as possible.

[0072] Although the thermal camera 50 in the above embodiment transmits image data to the control device 60 via a USB cable, other means may be used to transmit image data to the control device 60. For example, the thermal camera 50 may transmit image data to the control device 60 via communication means such as Bluetooth (a registered trademark of Bluetooth SIG, Inc.), infrared communication, or an internet line (such as a telephone line).

[0073] The equipment temperature management system 1 in the above embodiment is a system for managing the temperature of the drying furnace 10, but it may also be a system for managing the temperature of other equipment such as a paint booth for painting the workpiece W1 or a chemical plant.

[0074] Next, in addition to the technical ideas set forth in the claims, the technical ideas grasped by the above-described embodiments will be listed below.

[0075] (1) In any one of claims 4 to 7, the memory unit stores the specific area selected in the past, and selection of the specific area in the visible image of the equipment surface area in which the first AR marker is captured is permitted only within the range of the specific area selected in the past.

[0076] (2) The facility temperature management system according to any one of claims 1 to 7, wherein the display device is capable of displaying a selection allowable range of the specific area on the display device.

[0077] (3) In any one of claims 1 to 7, the calculation area setting unit controls the display of a plurality of grid-like squares with a plurality of rows and a plurality of columns on the visible image of the equipment surface area in response to input of the number of horizontal divisions and the number of vertical divisions on the display screen, and controls the determination of the selected squares as the specific area in response to selection of a plurality of the squares.

[0078] (4) The facility temperature management system according to any one of claims 1 to 7, wherein the imaging device is a non-fixed imaging device. [Explanation of symbols]

[0079] 1...Facility temperature control system 10...Drying furnace as equipment 10a…Equipment surface 31...First AR marker 31a…Equipment surface area 41...Second AR marker 41a...Area surrounding the facility 50...Thermal camera as an imaging device 51a...Visible image of equipment surface area 52a...Thermal image of the equipment surface area 51b...Visible image of the area around the facility 52b...Thermal image of the area around the facility 60...Control device as a processor 61...CPU as a calculation area setting unit, an area calculation unit, a heat dissipation calculation unit, an automatic image recognition unit, an image correction unit, a transition graph generation unit, a transition prediction unit, a threshold setting unit, and an abnormality occurrence time prediction unit 63...RAM as memory 65...Display as a display device 65a…Display screen R1…specific area R2: Heat dissipation calculation area

Claims

1. A system for managing the temperature of equipment, a first AR marker provided in contact with a surface of the equipment; a second AR marker provided at a distance from the surface of the equipment; an imaging device that captures an image of a surface area of ​​equipment including the first AR marker to obtain a visible image and a thermal image of the surface area of ​​the equipment, and captures an image of a peripheral area of ​​the equipment including the second AR marker to obtain a visible image and a thermal image of the peripheral area of ​​the equipment; a display device that displays a visible image and a thermal image of the surface area of ​​the equipment and a visible image and a thermal image of the area around the equipment on a display screen; a calculation area setting unit that, when a specific area in a visible image of the equipment surface area in which the first AR marker is captured is selected on the display screen, sets the selected specific area as a dissipation heat amount calculation area; an area calculation unit that calculates the area of ​​the set radiated heat amount calculation area from the size of the first AR marker captured in the visible image of the equipment surface area; a radiated heat amount calculation unit that calculates the amount of heat radiated from the surface of the equipment based on the calculated area of ​​the radiated heat amount calculation area, the equipment surface temperature calculated based on the thermal image of the equipment surface area, and the ambient temperature of the equipment peripheral area calculated based on the thermal image of the equipment peripheral area; An equipment temperature control system comprising:

2. The equipment temperature management system described in claim 1, further comprising an automatic image recognition unit that recognizes, if the first AR marker is included in the image acquired by the imaging device, that the image is a visible image and a thermal image of the equipment surface area, and, if the second AR marker is included, that the image is a visible image and a thermal image of the area surrounding the equipment.

3. The equipment temperature management system described in claim 2, further comprising an image correction unit that, if the visible image of the equipment surface area in which the first AR marker is captured is not a front-on view, corrects the visible image of the equipment surface area so that it is a front-on view before the calculation area setting unit sets the dissipation heat calculation area.

4. a storage unit configured to store the amount of radiated heat previously calculated by the radiated heat amount calculation unit; The display device is capable of displaying the past amount of heat dissipation on the display screen together with the current amount of heat dissipation. The facility temperature management system according to claim 1 .

5. a transition graph generating unit that generates a transition graph showing a transition of the amount of heat dissipation from the past to the present based on the current amount of heat dissipation and the past amount of heat dissipation, The display device is capable of displaying the transition graph on the display screen. The facility temperature management system according to claim 4 .

6. The equipment temperature management system according to claim 5 , further comprising a transition prediction unit that predicts a future transition of the amount of radiated heat based on the transition graph generated by the transition graph generation unit.

7. a threshold setting unit that sets a threshold value for the amount of dissipated heat that indicates an abnormality in the equipment; an abnormality occurrence time prediction unit that predicts when an abnormality will occur in the equipment based on a result of comparing the amount of heat dissipation in the future predicted by the transition prediction unit with the threshold value; The facility temperature management system according to claim 6, further comprising:

8. The processor that controls the system that manages the temperature of the facility an image display step of displaying, on a display screen of a display device, a visible image and a thermal image of an equipment surface area obtained by imaging the equipment surface area including a first AR marker provided in contact with the equipment surface, and a visible image and a thermal image of the equipment peripheral area obtained by imaging the equipment peripheral area including a second AR marker provided at a distance from the equipment surface; a calculation area setting step of, when a specific area in a visible image of the equipment surface area in which the first AR marker is captured is selected on the display screen, setting the selected specific area as a dissipation heat amount calculation area; an area calculation step of calculating an area of ​​the set radiated heat amount calculation area from the size of the first AR marker captured in the visible image of the equipment surface area; a radiated heat amount calculation step of calculating the amount of heat radiated from the surface of the equipment from the calculated area of ​​the radiated heat amount calculation area, the equipment surface temperature calculated based on the thermal image of the equipment surface area, and the ambient temperature of the equipment peripheral area calculated based on the thermal image of the equipment peripheral area; This is a facility temperature control program that executes the following.

9. 1. A method for controlling the temperature of a facility, comprising: an equipment surroundings imaging step of imaging an equipment surface area including a first AR marker provided in contact with the equipment surface to obtain a visible image and a thermal image of the equipment surface area, and imaging an equipment surroundings area including a second AR marker provided away from the equipment surface to obtain a visible image and a thermal image of the equipment surroundings area; an image display step of displaying a visible image and a thermal image of the equipment surface area and a visible image and a thermal image of the equipment surrounding area on a display screen of a display device; a calculation area setting step of selecting, on the display screen, a specific area in a visible image of the equipment surface area in which the first AR marker is captured, and setting the selected specific area as a dissipation heat amount calculation area; an area calculation step of calculating an area of ​​the set radiated heat amount calculation area from the size of the first AR marker captured in the visible image of the equipment surface area; a radiated heat amount calculation step of calculating the amount of heat radiated from the surface of the equipment from the calculated area of ​​the radiated heat amount calculation area, the equipment surface temperature calculated based on the thermal image of the equipment surface area, and the ambient temperature of the equipment peripheral area calculated based on the thermal image of the equipment peripheral area; An equipment temperature management method comprising:

Images