Image display device

Abstract

The present application provides an image display device. A control unit (11) sets a temperature at a first position included in a first infrared image (19a) corresponding to a surrounding environment in a thermal image to a first temperature, sets a temperature at a second position included in a second infrared image (19b) corresponding to a pipe or the like in the thermal image to a second temperature, calculates an upper limit value and a lower limit value of a temperature range using the first temperature and the second temperature, and displays the thermal image on a display unit (13) in a manner that the temperature distribution of an object is represented by colors within the temperature range of the calculated upper limit value and lower limit value.

Description

Technical Field

[0001] This invention relates to an image display device. Background Technology

[0002] Patent Document 1 discloses a method for diagnosing the blockage of slurry piping based on a thermal image obtained by processing a photographic image of the transitional temperature change of the outer surface of the piping at the diagnostic location captured by an infrared camera using an image processing device.

[0003] Existing technical documents

[0004] Patent documents

[0005] Patent Document 1: Japanese Patent Application Publication No. 2013-83666 Summary of the Invention

[0006] The problem the invention aims to solve

[0007] However, in the prior art disclosed in Patent Document 1, when there is an object around the diagnostic site that generates a large temperature difference with the diagnostic site, a wide temperature range including the temperature of the object is set in the thermal image containing the diagnostic site and the object around the diagnostic site.

[0008] In this situation, in order to display the minute temperature difference at the diagnostic site in the thermal image, the user must manually adjust the temperature range to determine the temperature range that can be displayed even for minute temperature differences. This operation is very cumbersome for the user.

[0009] The present invention was made in view of the above-mentioned problems, and its object is to realize an image display device that can save the labor and time of users adjusting the temperature range when displaying thermal images.

[0010] Solution for solving the problem

[0011] To address the aforementioned problems, one aspect of the present invention relates to an image display device comprising: a display unit having a screen for displaying a thermal image representing the temperature distribution of a subject by means of color, the subject including a pipe or the like having fluid flowing inside and an surrounding environment in which the pipe or the like is disposed; and a control unit controlling the display unit, wherein the control unit sets a temperature obtained from the thermal image at a first position contained in a first image corresponding to the surrounding environment in the thermal image as a first temperature, and sets a temperature obtained from the thermal image at a second position contained in a second image corresponding to the pipe or the like as a second temperature, the control unit calculating an upper limit and a lower limit of a temperature range using the first temperature and the second temperature, and the control unit displaying the thermal image on the display unit in such a way that the temperature distribution of the subject is represented by color within the temperature range in which the upper limit and the lower limit are calculated.

[0012] The effects of the invention

[0013] According to one aspect of the present invention, it is possible to save the effort and time of the user in adjusting the temperature range when displaying thermal images. Attached Figure Description

[0014] Figure 1 This is a diagram showing the appearance of the image display device according to Embodiment 1, and is a view of the image display device from the front side.

[0015] Figure 2 This is a diagram showing the appearance of the image display device according to Embodiment 1, and is a view of the image display device from the rear side.

[0016] Figure 3 This is a block diagram showing the internal structure of the image display device according to Embodiment 1.

[0017] Figure 4 This is a diagram showing the functional structure of the control unit included in the image display device according to Embodiment 1.

[0018] Figure 5 This is a flowchart illustrating the operation of the image display device according to Embodiment 1.

[0019] Figure 6 This is an example of the ambient temperature setting screen when determining the ambient temperature.

[0020] Figure 7 This is an example of an output screen that displays the reference temperature and temperature range.

[0021] Figure 8 This is an example of a display that compares a thermal image with a visible light image.

[0022] Figure 9 This is an example of a screen for setting the coefficients of a calculation formula.

[0023] Figure 10 This is an example of a screen that displays the settings for changing the multiplier of a calculation formula.

[0024] Figure 11 This is an example of a settings screen used to adjust the upper and lower limits of the temperature range in manual mode.

[0025] Figure 12 This is a diagram illustrating the functional structure of the control unit included in the image display device according to Embodiment 2.

[0026] Figure 13 This is a flowchart illustrating the operation of the image display device according to Embodiment 2. Detailed Implementation

[0027] [Implementation Method 1]

[0028] Figure 1 and Figure 2 This is a diagram showing the appearance of the image display device 10 according to Embodiment 1 of the present invention. Figure 1 This is a diagram showing the image display device 10 viewed from the front side. Figure 2 This is a diagram showing the image display device 10 viewed from the rear side. (See diagram below.) Figure 1 and Figure 2 As shown, the image display device 10 is a wireless terminal that a user can carry. The image display device 10 is, for example, a mobile phone, a smartphone, a tablet computer, or a laptop computer. Additionally, as... Figure 1 As shown, the image display device 10 has a screen 10a on its front side. Additionally, as... Figure 2 As shown, the image display device 10 has a visible light camera 17 and an infrared camera 19 on its rear side. However, the visible light camera 17 is not a necessary structure for the image display device 10.

[0029] Furthermore, the image display device 10 is not limited to a user-carryable wireless terminal. The image display device 10 can also be a fixed device. Examples of fixed devices include desktop personal computers. In the case of a fixed device, the image display device 10 may have a structure that allows the visible light camera 17 and the infrared camera 19 to be separated from the main body of the image display device 10. In this case, the visible light camera 17 and the infrared camera 19 become portable. The visible light camera 17 and the infrared camera 19 are each connected to the main body of the image display device 10 wirelessly or via a wired connection.

[0030] Furthermore, the following description will take an embodiment in which the image display device 10 is a wireless terminal that can be carried by the user as an example.

[0031] Visible light camera 17 is a camera that is sensitive in the visible light wavelength region and detects visible light from a subject to capture visible light images. Infrared camera 19 is a camera that is sensitive in the infrared wavelength region and detects infrared light from a subject to capture infrared images. The imaging range of visible light camera 17 is approximately the same as that of infrared camera 19. Figure 1 In this system, the camera range of both the visible light camera 17 and the infrared camera 19 is the same as the camera range FA. The image display device 10 is a portable wireless terminal, allowing the user to move to any location and orient the camera range FA of both the visible light camera 17 and the infrared camera 19 in any direction.

[0032] In addition, Figure 1 The image shows the image display device 10 capturing a view of pipe D1. Pipe D1 is, for example, a conduit for transporting fluid flowing within it. Fluid is a general term for liquids and gases. Conduits include, for example, pipes, shock absorbers, and devices that utilize fluid energy. Pipe D1 is, for example, installed in buildings such as steel mills for purposes such as air conditioning, ventilation, and smoke extraction. Pipe D1 is an example of conduit. Furthermore, the portion of pipe D1's appearance included within the aforementioned imaging range FA is an example of the subject captured by the image display device 10. In addition, the imaging range FA may also include the surrounding environment of pipe D1 besides pipe D1. The surrounding environment includes, for example, support members that support pipe D1, devices arranged around pipe D1 when viewed from the image display device 10, and walls. In this case, the subject also includes these surrounding environments.

[0033] In addition, Figure 1 Inside pipe D1, there exists a deposit X1, which is formed by dust adhering to and accumulating on the inner wall of pipe D1. Due to the different heat transfer from the fluid flowing inside pipe D1 to the deposit X1 and the inner wall of pipe D1, the heat dissipation methods for the deposit X1 and the inner wall of pipe D1 are different. Therefore, a temperature difference is generated on the surface of pipe D1 between the surface portion facing the inner wall where the deposit X1 is deposited, the periphery of that surface portion, and the remaining surface portions. The image display device 10 detects the boundary between the two by observing this temperature difference using an infrared camera 19. The user determines the presence of the deposit X1 based on the presence of this detected boundary.

[0034] exist Figure 1In this display, the image display device 10 overlays a visible light image captured by the visible light camera 17 with a thermal image based on an infrared image captured by the infrared camera 19 onto a screen 10a. The screen 10a displays an image corresponding to pipe D1 (pipe image D1a) and an image corresponding to the deposit X1 (deposit image X1a). Pipe image D1a is included in the visible light image. Deposit image X1a is included in the thermal image. Because the user can simultaneously observe the deposit image X1a contained in the thermal image and the pipe image D1a contained in the visible light image, the user can easily identify the location of the deposit image X1a.

[0035] Figure 3 This is a block diagram showing the internal structure of the image display device 10. The image display device 10 includes: a control unit 11 for controlling the overall operation of the image display device 10; a display unit 13 for displaying various information; a touch panel 15 for user operation; a storage unit 16 for storing data and programs; a communication unit 21 for connecting to a network; and an interface unit 23 for connecting to external devices. Furthermore, as described above, the image display device 10 includes a visible light camera 17 and an infrared camera 19. Additionally, the image display device 10 may also include a temperature sensor 25.

[0036] The display unit 13 is, for example, composed of a liquid crystal display or an organic EL display. The touch panel 15 is, for example, an input device that detects touch operations performed by a user's finger or stylus. The touch panel 15 is configured such that its operating area overlaps with the display area of ​​the display unit 13. Figure 1 The screen 10a includes a display unit 13 and a touch panel 15.

[0037] Communication unit 21 is a device for connecting to a network (not shown). Communication unit 21 communicates with the network according to communication standards such as 3G, 4G, LTE, and 5G. Interface unit 23 is a device for connecting to an external device (not shown).

[0038] Storage unit 16 is a recording medium that stores parameters, data, and control programs required to perform the specified functions. Storage unit 16 may be composed of, for example, a hard disk, a semiconductor storage device, or a semiconductor memory.

[0039] The storage unit 16 stores an image display program 16a, temperature range data 16b, and calculation data 16c for implementing the functions of the image display device 10, which will be described later. The image display program 16a is an example of a control program. Details regarding the temperature range data 16b and calculation data 16c will be described later.

[0040] The control unit 11 includes a CPU (Central Processing Unit). The control unit 11 executes the image display program 16a via the CPU to implement the functions of the image display device 10 described below. Alternatively, the control unit 11 may be implemented using only hardware circuitry specifically designed to achieve the specified functions.

[0041] Figure 4 This diagram illustrates the functional structure of the control unit 11. The control unit 11 includes a first image processing unit 11a, a second image processing unit 11b, a third image processing unit 11c, and a display processing unit 11d. The aforementioned processing units 11a, 11b, 11c, and 11d included in the control unit 11 are implemented by the control unit 11 executing the image display program 16a.

[0042] The following is an explanation Figure 4 The operation of the control unit 11.

[0043] The image display device 10 has an image display function that overlays a visible light image captured by the visible light camera 17 with a thermal image based on an infrared image captured by the infrared camera 19 onto the display unit 13. Here, the thermal image refers to an image generated by setting the color of each pixel in the infrared image based on temperature information representing the temperature of the subject contained in each pixel. Furthermore, the color of each pixel is set within a temperature range with upper and lower limits. Thus, a thermal image is generated that shows the temperature distribution of the subject through color within the aforementioned temperature range. This image display function is implemented by the image display program 16a.

[0044] Furthermore, the color of each pixel can be set by changing at least one of the three color attributes—hue, chroma, and lightness—based on the temperature of each pixel. For example, the hue can be fixed while the chroma and lightness are varied, or the chroma and lightness can be fixed while the hue is varied. In this embodiment, an example of fixing the chroma and lightness while varying the hue will be described as an implementation.

[0045] Next, use Figure 5 To explain the operation of the image display device 10. Additionally, refer to the following as appropriate. Figure 3 and Figure 4 . Figure 5 It is shown Figure 4 The flowchart of the operation of the control unit 11.

[0046] Additionally, the following should also be appropriately referenced. Figure 6 and Figure 7 , Figure 6 and Figure 7This is a diagram showing an example of screen 10a. Here, before explaining the operation of the image display device 10, let's first explain... Figure 6 and Figure 7 .

[0047] Figure 6 This is an example of a screen 10a displayed by the image display device 10, showing a visible light image and a thermal image. (See figure below.) Figure 6 As shown, in screen example 60, which is screen 10a, a visible light image including pipe D6 and wall W6, which is the surrounding environment of pipe D6, and a thermal image generated based on an infrared image including pipe D6 and wall W6 are superimposed and displayed. The thermal image is an image obtained by changing the hue of each pixel in the infrared image according to the temperature information of each pixel contained in the infrared image. In addition, each hue is assigned to each temperature within the temperature range between the minimum and maximum temperature values ​​in the infrared image. Furthermore, pipe D6 is an example of a pipework, etc. In addition, pipe D6 and wall W6 are examples of subjects.

[0048] In addition, Figure 6 In screen example 60, the reference position mark 61 is displayed superimposed on the visible light image and the thermal image. The reference position mark 61 is positioned, for example, at the center (first position) of screen 10a. For example, to position the reference position mark 61 on the wall W6, the user only needs to align the center of the camera range FA of the image display device 10 towards the wall W6. Furthermore, the reference position mark 61 does not necessarily have to be positioned at the center of screen 10a. The reference position mark 61 can also be located near the upper right end, the lower left end, etc. of screen 10a. In addition, the position of the reference position mark 61 can be preset or arbitrarily set by the user. In the case where the user sets the position of the reference position mark 61, for example, the position of the reference position mark 61 can be set by touch operation performed by the user's finger or stylus. Hereinafter, in this embodiment, an example in which the reference position mark 61 is positioned at the center of screen 10a will be described as an implementation.

[0049] In addition, Figure 6 In example 60, a temperature display bar 61a displaying "20.0℃" is shown near the reference position mark 61. Additionally, in Figure 6 In screen example 60, an OK button 62 is displayed to prompt the user to perform a touch operation, and a comment bar 63 displays the message "Ambient temperature needs to be specified. Please center the screen towards a location close to the ambient temperature." This comment is a message for the user. The temperature display bar 61a, the OK button 62, and the comment bar 63 will be explained together with the description of the operation of the image display device 10.

[0050] Figure 7 This is another example of a screen 10a displayed by the image display device 10, showing a visible light image and a thermal image. For example... Figure 7 As shown, in screen example 70, which is screen 10a, a visible light image including pipe D7 and its surrounding environment, and a thermal image generated from an infrared image including pipe D7 and its surrounding environment are superimposed and displayed. The thermal image is an image obtained by changing the hue of each pixel in the infrared image based on the temperature information of each pixel contained in the infrared image. Furthermore, pipe D7 is an example of a pipework, etc. Additionally, pipe D7 and its surrounding environment are an example of a subject. Furthermore, pipe D7 is associated with... Figure 6 The pipe connected to pipe D6.

[0051] exist Figure 7 In area 71 of screen example 70, the color bar 71a (first rectangular image) is displayed overlaid with the thermal image. Additionally, in Figure 7 In area 74 of screen example 70, a magnification adjustment bar 74a (second rectangular image) is displayed. In particular, the magnification adjustment bar 74a is a user interface for the user to set the magnification k (third variable) described later by touch operation. Thus, intuitive operation can be provided to the user.

[0052] In addition, Figure 7 In screen example 70, the reference position mark 72 is displayed superimposed on the thermal image. The reference position mark 72 is positioned, for example, in the center (second position) of screen 10a. The structure and function of the reference position mark 72 are the same as those of the reference position mark 72. Figure 6 The structure and function of the reference position mark 61 are the same, so the explanation of the structure and function of the reference position mark 72 is omitted here.

[0053] exist Figure 7 In screen example 70, a temperature display bar 72a displaying "35.0°C" is shown near the reference position mark 72. Additionally, screen example 70 displays a temperature display bar 73 displaying "20.0°C". Temperature display bar 73 displays... Figure 6 The temperature display bar 61a shows "20.0℃". Furthermore, the temperature display bar 710 is displayed in screen example 70. The temperature display bar 710 shows "Avg. 25.2℃" (marked 710a), "Max. 43.8℃" (marked 710b), and "Min. 9.3℃" (marked 710c). Additionally, in... Figure 7In screen example 70, below area 74 are displayed a mode change button 75, a motion image capture button 76, a screenshot button 77, a folder reference button 78, and a settings button 79 to prompt the user to perform touch operations. The elements shown in screen example 70 will be explained along with the description of the operation of the image display device 10. Furthermore, the aforementioned elements include, for example, a color bar 71a, a magnification adjustment bar 74a, various temperature display bars, and various buttons.

[0054] The above was conducted with Figure 6 and Figure 7 Therefore, the operation of the image display device 10 will be explained next.

[0055] Step S101: The control unit 11 acquires a first infrared image 19a, including the pipe D6 and the wall W6, captured by the infrared camera 19. The control unit 11 stores the first infrared image 19a acquired by the infrared camera 19 into the storage unit 16.

[0056] More specifically, in step S101, when the control unit 11 causes the display unit 13 to display... Figure 6 When displaying screen example 60, the user, following the annotation in annotation column 63, "Ambient temperature needs to be specified. Please point the center of the screen towards a location close to the ambient temperature," directs the center of the image display device 10's camera range FA towards the wall W6. The temperature of the wall W6 is close to the outside temperature. Hereinafter, this temperature will be referred to as the ambient temperature (first temperature). When the reference position mark 61 is oriented towards the wall W6, the user touches the confirmation button 62. Through this touch operation, the control unit 11 causes the storage unit 16 to store the first infrared image 19a. The first infrared image (first image) 19a stored in the storage unit 16 is as follows: Figure 6 The infrared image of the reference position mark 61 facing the wall W6.

[0057] Step S102: The first image processing unit 11a of the control unit 11 reads the first infrared image 19a stored in the storage unit 16 and obtains the temperature information of each pixel contained in the read first infrared image 19a. The first image processing unit 11a uses the temperature of each pixel in the first infrared image 19a that overlaps with the reference position mark 61 and the surrounding area of ​​the reference position mark 61 to set the ambient temperature. If the temperatures of each pixel are different, the ambient temperature can be set to the average value of the temperatures of each pixel. Figure 6 In example screen 60, such as temperature display bar 61a, the ambient temperature is "20.0°C". The ambient temperature is stored in storage unit 16. Alternatively, the ambient temperature can be obtained from temperature sensor 25.

[0058] In addition, regarding Figure 6 For each element in screen example 60 other than the thermal image and the visible light image, the first image processing unit 11a generates its own image and outputs each image to the display processing unit 11d. The display processing unit 11d displays the images input by the first image processing unit 11a on screen 10a.

[0059] Step S103: The control unit 11 acquires a visible light image 17a, including the pipe D7 and its surrounding environment, captured by the visible light camera 17. Simultaneously, the control unit 11 acquires a second infrared image 19b, including the pipe D7 and its surrounding environment, captured by the infrared camera 19. The control unit 11 then instructs the storage unit 16 to store the visible light image 17a acquired by the visible light camera 17 and the second infrared image 19b acquired by the infrared camera 19.

[0060] More specifically, in step S103, the user moves the center of the image display device 10's camera range FA from... Figure 6 The direction of the wall W6 turns Figure 7 The image is positioned near the center of the interior of the pipe D7. When the center of the image field FA of the image display device 10 is oriented towards the center of the interior of the pipe D7, the user stops the operation of the image display device 10 to prevent the center of the image field FA from deviating from the direction near the center of the interior of the pipe D7. By stopping the operation of the image display device 10, the control unit 11 causes the storage unit 16 to store the visible light image 17a and the second infrared image 19b. The visible light image 17a and the second infrared image (second image) 19b stored in the storage unit 16 are respectively as follows: Figure 7 The reference position mark 72 is a visible light image and an infrared image of the direction near the center of the interior of pipe D7.

[0061] Step S104: The second image processing unit 11b of the control unit 11 reads the second infrared image 19b stored in the storage unit 16 and obtains the temperature information of each pixel contained in the read second infrared image 19b. The second image processing unit 11b uses the temperature of each pixel in the second infrared image 19b that overlaps with the reference position mark 72 and the surrounding pixels to set a reference temperature (second temperature). If the temperatures of each pixel are different, the reference temperature can be set to the average value of the temperatures of each pixel. Figure 7 In screen example 70, as in temperature display bar 72a, the reference temperature is "35.0℃".

[0062] Step S105: The second image processing unit 11b calculates the upper limit value Tw+ and the lower limit value Tw- of the temperature range using the following formula.

[0063] Tw = k × A × (T2 - T1) B +C···(1)

[0064] Tw+=T2+D×Tw···(2)

[0065] Tw-=T2-(1-D)×Tw···(3)

[0066] Here, k is the multiplier (3rd coefficient), A, B, C and D are specified coefficients, T1 is the ambient temperature (1st coefficient), and T2 is the reference temperature (2nd coefficient).

[0067] Equations (1) to (3) are stored in storage unit 16 as calculation formula data 16c. In addition, coefficients A, B and C are stored in storage unit 16 as calculation formula data 16c.

[0068] exist Figure 6 and Figure 7 In the example, the ambient temperature T1 is "20.0℃" and the reference temperature T2 is "35.0℃". Additionally, for example, coefficient A is set to "0.58", coefficient B to "1.0", coefficient C to "0", and coefficient D to "0.25". Furthermore, the multiplier k is set to "1". In this case, by substituting into equations (1) to (3), the upper limit Tw+ and lower limit Tw- of the temperature range are calculated as follows.

[0069] Tw = 1 × 0.58 × (35.0 - 20.0) 1.0 +0 = 8.7

[0070] Tw+=35.0+0.25×8.7=37.2

[0071] Tw-=35.0-(1-0.25)×8.7=28.5

[0072] As described above, the upper limit of the temperature range, Tw+, is "37.2°C", and the lower limit of the temperature range, Tw-, is "28.5°C". The second image processing unit 11b sets the upper limit Tw+ and the lower limit Tw- of the temperature range as described above. Since the upper limit Tw+ and the lower limit Tw- of the temperature range are set by the second image processing unit 11b, the user does not need to spend time and effort setting the upper limit Tw+ and the lower limit Tw-.

[0073] The second image processing unit 11b assigns a hue to each temperature within a temperature range defined by an upper and lower limit. The second image processing unit 11b generates an image of a color bar 71a reflecting the hue assigned to each temperature. The image of the color bar 71a is, for example, an image that changes from a lower limit value Tw- to an upper limit value Tw+, displaying "blue," "green," and "red." The second image processing unit 11b determines the hue assigned to each temperature by referring to temperature range data 16b stored in the storage unit 16. The hue assigned to each temperature is stored in the storage unit 16 as temperature range data 16b. Furthermore, the hue assigned to each temperature can be changed by the user at any time.

[0074] In addition, such as Figure 7 As shown, near the upper end of color bar 71a, there is an upper limit display bar 71c displaying "37.2°C" as the upper limit value Tw+. Near the lower end of color bar 71a, there is a lower limit display bar 71d displaying "28.5°C". In addition, color bar 71a displays a reference temperature mark 71b indicating a location equivalent to "35.0°C" as the reference temperature T2.

[0075] Furthermore, the second image processing unit 11b sets the temperature information of each pixel contained in the second infrared image 19b. Figure 7 The average temperature, maximum temperature, and minimum temperature shown in screen example 70. The average temperature, maximum temperature, and minimum temperature set in this way are displayed in the temperature display bar 710 as “Avg. 25.2℃” (label 710a), “Max. 43.8℃” (label 710b), and “Min. 9.3℃” (label 710c), respectively.

[0076] Here, the magnification adjustment bar 74a will be explained. Table 1 shows the correspondence between the magnification k and the integer values ​​displayed on the magnification adjustment bar 74a.

[0077] Table 1

[0078] Integer value 1 2 3 4 5 6 7 8 9 Multiplier k 1 / 5 1 / 4 1 / 3 1 / 2 1 2 3 4 5

[0079] As shown in Table 1, when the magnification k is "1 / 5", the integer value displayed at the location marked 74b is "1". The location marked 74b is as follows... Figure 7 That is located near the center of the magnification adjustment bar 74a. When the magnification k is "1", the integer value displayed at the location marked 74b is "5". In this way, the magnification k corresponds to the integer value displayed at the aforementioned location.

[0080] exist Figure 7In screen example 70, the integer value "5" corresponding to the magnification k is displayed at the mark 74b. The integer values ​​"4", "3", "2", and "1", which decrease sequentially to the left of the area displaying "5", correspond to the positions of the vertical lines 74c arranged at predetermined intervals along the horizontal axis of the magnification adjustment bar 74a. The minimum value "1" corresponds to the position of the vertical line 74c at the left end of the magnification adjustment bar 74a. Similarly, the integer values ​​"6", "7", "8", and "9", which increase sequentially to the right of the area displaying "5", correspond to the positions of the vertical lines 74c arranged at predetermined intervals along the horizontal axis of the magnification adjustment bar 74a. The maximum value "9" corresponds to the position of the vertical line 74c at the right end of the magnification adjustment bar 74a. The user can select the magnification k by touching the vertical lines 74c arranged on the magnification adjustment bar 74a. In addition, users can select the magnification k by touching the triangular markers 74d and 74e, which are respectively positioned at both ends of the magnification adjustment bar 74a, to move the circular marker 74f to the left or right.

[0081] Furthermore, when the multiplier k increases, i.e., when the integer value becomes larger, according to equations (1) to (3), the upper limit of the temperature range Tw+ increases, and the lower limit Tw- decreases. That is, the width of the temperature range increases. On the other hand, when the multiplier k decreases, i.e., when the integer value becomes smaller, according to equations (1) to (3), the upper limit of the temperature range Tw+ decreases, and the lower limit Tw- increases. That is, the width of the temperature range decreases.

[0082] also, Figure 7 The display positions of the color bar 71a, the magnification adjustment bar 74a, and other elements displayed on screen example 70 are only examples and are not limited to specific cases. Figure 7 The location shown.

[0083] The second image processing unit 11b generates images for displaying the color bar 71a, the magnification adjustment bar 74a, and other elements displayed on the screen example 70 on the screen 10a.

[0084] Step S106: The second image processing unit 11b reads the second infrared image 19b stored in the storage unit 16, and generates a thermal image based on the read second infrared image 19b, which uses color to represent the temperature distribution of pipe D7 and its surrounding environment within a temperature range obtained by setting an upper limit value Tw+ and a lower limit value Tw-. More specifically, the second image processing unit 11b refers to the temperature range data 16b stored in the storage unit 16, determines the color of each pixel based on the temperature of each pixel in the second infrared image 19b, and generates a thermal image in which each pixel is assigned a color corresponding to the temperature.

[0085] Alternatively, the second image processing unit 11b may fix the hue for the portion of the thermal image consisting of pixels that have reached a temperature exceeding the upper limit value Tw+ (upper limit image) and the portion consisting of pixels that have reached a temperature below the lower limit value Tw- (lower limit image). In this embodiment, as described above, the "chroma" and "brightness" are fixed, while the "hue" is changed. By fixing the "hue" for the upper limit image and the lower limit image, the "hue" can be changed only for thermal images generated within the temperature range obtained by setting the upper limit value Tw+ and the lower limit value Tw-. By fixing the "hue" for thermal images at temperatures deviating from the upper and lower limits of the temperature range, the user can easily identify only the "hue" of the temperature range they want to measure. Unlike this embodiment, for example, if the "hue" is fixed and the "chroma" and "brightness" are changed, then it is sufficient to fix at least one of the "chroma" and "brightness" for the upper limit image and the lower limit image.

[0086] exist Figure 7 In the example, the surface portion of pipe D7 that has a temperature difference with its surroundings due to the presence of deposit X7 is given a different color than its surroundings.

[0087] Step S107: The second image processing unit 11b outputs images to the display processing unit 11d for displaying the color bar 71a, the magnification adjustment bar 74a, and other elements displayed on the screen example 70 on the screen 10a. Additionally, the second image processing unit 11b outputs a thermal image to the display processing unit 11d. The third image processing unit 11c reads the visible light image 17a stored in the storage unit 16 and outputs the read visible light image 17a to the display processing unit 11d.

[0088] The display processing unit 11d overlays the images input from the second image processing unit 11b and the third image processing unit 11c onto the screen 10a. Figure 7 In Example 70, the image of pipe D7 in the visible light image overlaps with the image of deposit X7 in the thermal image. Therefore, the user can easily determine the location of deposit X7.

[0089] Step S108: If there is no user operation from the touch panel 15 (Step S108: "No"), the control unit 11 proceeds to the next step S109.

[0090] On the other hand, if there is a user operation from the touch panel 15 (step S108: "Yes"), the control unit 11 will execute the processing of step S105 again.

[0091] More specifically, in step S108, by... Figure 7The magnification k is selected by touching the vertical lines 74c on the magnification adjustment bar 74a or the triangular marks 74d and 74e at both ends of the magnification adjustment bar 74a. The touch panel 15 detects the integer value selected by the touch operation performed by the user's finger or stylus. In step S105, the second image processing unit 11b calculates the upper limit value Tw+ and the lower limit value Tw- of the temperature range by substituting the magnification k corresponding to the integer value detected by the touch panel 15 into equations (1) to (3). The processing steps S105 to S108 described above are then performed.

[0092] The user simply observes the thermal image displayed on screen 10a while... Figure 7 By touching the vertical lines 74c on the magnification adjustment bar 74a or the triangular marks 74d and 74e at both ends of the magnification adjustment bar 74a, the aforementioned upper and lower limits can be changed with simple operation. By displaying a thermal image within a temperature range of upper and lower limits that can be freely set by the user, a user-friendly method is provided.

[0093] Furthermore, typical infrared cameras automatically identify the minimum and maximum temperatures in captured images, assigning different hues to each temperature within the range between these values. For example, when an object in the captured image exhibits a large temperature difference from its surroundings, the infrared camera automatically identifies that object's temperature as either the minimum or maximum. Consequently, subtle hue changes at locations the user wants to identify become coarse, making it impossible for the user to discern the temperature difference through hue variations.

[0094] According to the image display device 10, in this case, the user can simply change the upper and lower limits to remove the object's temperature from the temperature range. Thus, the user can display a thermal image generated within the changed upper and lower temperature range to show the minute temperature difference at the location the user wants to identify.

[0095] Step S109: If it is not necessary to reset the reference temperature (Step S109: "No"), the control unit 11 ends the operation.

[0096] On the other hand, if it is necessary to reset the reference temperature (step S109: "Yes"), the control unit 11 will execute the processing of step S103 again.

[0097] More specifically, suppose the user begins to turn the center of the image field FA of the image display device 10 in a new direction different from the current direction. Then, when the center of the image field FA of the image display device 10 turns towards the new direction, the user stops the operation of the image display device 10 to prevent the center of the image field FA from deviating from the new direction. The control unit 11 determines that the reference temperature needs to be reset upon the cessation of the operation of the image display device 10, and again stores the visible light image 17a and the second infrared image 19b in the storage unit 16. Then, the processing steps S103 to S109 described above are executed.

[0098] Alternatively, the control unit 11 may store the visible light image 17a and the second infrared image 19b in the storage unit 16 whenever a predetermined time has elapsed, regardless of whether the operation of the image display device 10 has stopped. In this case, in step S109, if a predetermined time has elapsed since the last time the visible light image 17a and the second infrared image 19b were stored in the storage unit 16, the control unit 11 determines that the reference temperature needs to be reset.

[0099] [Modification 1 of Implementation Method 1]

[0100] Figure 8 This is an example of a screen 10a displayed by the image display device 10, showing a visible light image and a thermal image. (See figure below.) Figure 8 As shown, in screen example 80, which is screen 10a, image 81, which displays a superimposed visible light image and a thermal image, and image 82, which displays only the visible light image contained in image 81, are arranged adjacent to each other. The control unit 11 generates the image of screen example 80 and displays the image on screen 10a.

[0101] like Figure 8 As shown, the image display device 10 compares and displays image 81 and image 82, allowing the user to easily determine which part of image 82, which is a visible light image, shows the area where the temperature distribution change has occurred. Therefore, the user can easily identify which part of the pipe contains deposits.

[0102] [Modification 2 of Implementation Method 1]

[0103] Figure 9 This is a diagram showing an example of the screen 10a of the image display device 10. For example... Figure 9 As shown, screen example 90, which is an example of screen 10a, is a screen for the user to change the values ​​of coefficients A, B, C and D included in the above formulas (1) to (3). The control unit 11 generates an image of screen example 90 and displays the image on screen 10a.

[0104] In screen example 90, table 94 is displayed, which maps the names of coefficients A, B, C, and D to their current values. Specifically, column 94a records the names of coefficients A, etc., and column 94b records the current values ​​of coefficients A, etc. In screen example 90, equation (1) marked with 91, equation (2) marked with 92, and equation (3) marked with 93 are also displayed.

[0105] The user of the image display device 10 can change the values ​​of coefficients A, B, C, and D from the screen example 90. For example, the user can change the value of coefficient A by touching the record field showing the current value of coefficient A, "0.58". Similarly, the values ​​of coefficients B, C, and D can also be changed by touching the record fields that show their current values.

[0106] Figure 10 This is a diagram showing an example of the screen 10a of the image display device 10. For example... Figure 10 As shown, screen example 100, which is an example of screen 10a, is a screen for the user to change the value of the magnification k contained in the above formula (1). The control unit 11 generates an image of screen example 90 and displays the image on screen 10a.

[0107] In screen example 100, it is shown that there will be Figure 7 Table 102 is obtained by mapping the integer values ​​displayed at the mark 74b to the values ​​of the multiplier k. Specifically, the integer values ​​are recorded in the column marked 102a. The values ​​of the multiplier k are recorded in the column marked 102b. In screen example 100, equation (1) marked 101 is also displayed at the same time.

[0108] The user of the image display device 10 can change the value of the multiplier k corresponding to each integer value to any value. For example, the user can change the value of the multiplier k corresponding to the integer value "9" by touching the record field containing the value "5" of the multiplier k corresponding to the integer value "9". Similarly, for the integer values ​​"1", "2", "3", "4", "5", "6", "7", and "8", the user can also change the value by touching the record field containing the corresponding multiplier k.

[0109] In this way, since the user can change various coefficients A, B, C and D, integer values, and the corresponding magnification k, it is possible to handle various display modes of temperature distribution of the image display device 10.

[0110] [Modification 3 of Implementation Method 1]

[0111] Figure 11 This is a diagram showing an example of the screen 10a of the image display device 10. For example... Figure 11 As shown, screen example 111, which is an example of screen 10a, is a setting screen for setting the upper and lower limits of the temperature range in manual mode.

[0112] In Implementation 1, after setting the ambient temperature T1 and the reference temperature T2, the upper limit value Tw+ and the lower limit value Tw- of the temperature range are calculated using the above formulas (1) to (3).

[0113] In this variation, such as Figure 11 As shown, by touching the triangular markers 111e and 111f located near the upper limit display bar 111c and lower limit display bar 111d of the color bar 111a, the user can change the upper limit value Tw+ and the lower limit value Tw- of the temperature range.

[0114] Users can switch to manual mode by touching the Auto / Manual switch button 115 in the lower right corner of the screen 111.

[0115] Therefore, users can manually set the upper limit Tw+ and the lower limit Tw- of the temperature range, so that they can handle situations where they want to make small changes to the temperature range of the displayed thermal image.

[0116] In addition, regarding Figure 11 The elements shown, except for the triangular marks 111e and 111f, are due to their relationship with... Figure 7 The elements shown correspond to each other, so they will not be explained again here. Regarding... Figure 11 The various elements and Figure 7 The elements are those elements that are in the same position in each picture example and correspond to each other.

[0117] [Modification 4 of Implementation Method 1]

[0118] As mentioned above, in Figure 7 In screen example 70, below area 74 are displayed a mode change button 75, a motion capture button 76, a screenshot button 77, a folder reference button 78, and a settings button 79 to remind the user to perform touch operations. These are displayed in screen example 70.

[0119] The mode change button 75 is used to switch the mode of the image display device 10. By touching the mode change button 75, the user can switch the mode of the image display device 10 between automatic and manual modes. Furthermore, the automatic mode is the mode that performs the operations of the image display device 10 as described in Embodiment 1 above. The manual mode is the mode that performs the operations of the image display device 10 as described in Modification 3 of Embodiment 1 above.

[0120] The motion image capture button 76 is used to capture motion images when the subject is moving. For example, if the subject includes a moving structure, the user touches the motion image capture button 76. This touch operation generates a visible light image and a thermal image of the moving structure, and displays the motion image on screen 10a. Furthermore, the generated motion image is stored in a designated storage device within the image display device 10. For example, the motion image is stored in storage unit 16.

[0121] The screenshot button 77 is used to take a screenshot of the screen 10a. For example, when a moving image is displayed on the screen 10a by touching the moving image capture button 76, the user can touch the screenshot button 77 at a desired time. A still image is generated by this touch operation. Furthermore, the generated still image is stored in a designated storage device within the image display device 10. For example, the moving image is stored in the storage unit 16.

[0122] The folder reference button 78 is used to access moving images generated by touching the moving image capture button 76 and still images generated by touching the screenshot button 77. For example, the moving images and still images are stored in a folder created within a specified storage device. The user can access the folder and display or delete the moving and still images within it by touching the folder reference button 78.

[0123] Furthermore, the image display device 10 is connected to a network via the communication unit 21. The image display device 10 can upload the aforementioned moving images and still images from the folder to a server connected to the network via the network. The server can download the uploaded moving images and still images to other devices connected to the network via the network.

[0124] Setting button 79 is used to set the above. Figure 9 Example 90 and Figure 10 Example 100 shows the button on screen 10a. The user can control the settings by touching the setting button 79. Figure 9 Example 90 and Figure 10Example 100 of the screen is displayed on screen 10a. In addition, the user can display various settings for changing the image display device 10 on screen 10a by touching the setting button 79.

[0125] [Implementation Method 2]

[0126] Other embodiments of the present invention will now be described. Furthermore, for ease of explanation, components having the same function as those described in the above embodiments will be labeled with the same reference numerals, and their descriptions will not be repeated.

[0127] This embodiment does not include the visible light camera 17 of Embodiment 1. Figure 12 This diagram illustrates the functional structure of the control unit 11 included in the image display device 10 according to Embodiment 2. The control unit 11 includes a first image processing unit 11a, a second image processing unit 11b, and a display processing unit 11d. The aforementioned processing units 11a, 11b, and 11d included in the control unit 11 are implemented by the control unit 11 executing the image display program 16a. Figure 12 Control unit 11 and Figure 4 The difference of the control unit 12 is that it does not require a third image processing unit 11c.

[0128] The image display device 10 has an image display function that displays a thermal image based on an infrared image captured by the infrared camera 19 on the display unit 13. This image display function is implemented by the image display program 16a.

[0129] Figure 13 This is a flowchart illustrating the operation of the image display device according to Embodiment 2. Figure 13 The flowchart is a flowchart of the structure of the image display device 10 without using the visible light image 17a captured by the visible light camera 17. Figure 13 The steps S201 to S209 of the flowchart are the same as those of the previous steps. Figure 5 The flowchart corresponds to each step S201 to S209. Figure 13 Flowcharts and Figure 5 The only difference in the flowchart is that it does not use points from the visible light images captured by the visible light camera 17. Therefore, for Figure 13 The flowchart steps are not described in detail.

[0130] This invention is not limited to the above-described embodiments, and various modifications can be made within the scope indicated by the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of this invention.

[0131] Explanation of reference numerals in the attached figures

[0132] 10: Image display device; 10a: Screen; 11: Control unit; 13: Display unit.

Claims

1. An image display device, characterized in that, have: A display unit having a screen for displaying a thermal image representing the temperature distribution of a subject by means of color, the subject including internal piping with fluid flow and the surrounding environment in which the piping is disposed; and The control unit controls the display unit. Specifically, the control unit sets the temperature obtained from the thermal image at a first position on the surrounding environment, contained in a first image corresponding to the surrounding environment, as a first temperature, i.e., the ambient temperature; and sets the temperature obtained from the thermal image at a second position on the surface of the piping, etc., contained in a second image corresponding to the piping, etc., as a second temperature, i.e., a reference temperature. The control unit uses the first temperature and the second temperature to calculate the upper and lower limits of the temperature range based on the following formula. Tw=k×A×(T2-T1) B +C···(1) Tw+=T2+D×Tw···(2) Tw-=T2-(1-D)×Tw···(3) Here, k is the multiplier, A, B, C, and D are specified coefficients, T1 is the ambient temperature, and T2 is the reference temperature. The control unit displays the thermal image on the display unit in a manner that uses color to represent the temperature distribution of the subject within a temperature range in which the upper and lower limits have been calculated.

2. The image display device according to claim 1, characterized in that, The multiplier is one of several predetermined different values.

3. The image display device according to claim 1 or 2, characterized in that, Whenever the image display device moves, the control unit resets the second temperature.

4. The image display device according to claim 1 or 2, characterized in that, Whenever the upper and lower limits are calculated, the control unit displays a first rectangular image representing the temperature range on the display unit in a manner that overlays the thermal image. The length direction of the first rectangular image is the direction in which the temperature increases or decreases within the temperature range. One end of the first rectangular image along its length corresponds to the upper limit value, and the other end corresponds to the lower limit value.

5. The image display device according to claim 1 or 2, characterized in that, The control unit displays the thermal image on the display unit in such a way that the temperature distribution of the subject is represented by changes in at least one of hue, chroma, and brightness.

6. The image display device according to claim 5, characterized in that, When the control unit causes the display unit to display the thermal image, it fixes at least one of hue, chroma, and brightness regarding the upper limit image of the thermal image where the temperature exceeds the upper limit value and the lower limit image where the temperature is below the lower limit value.

7. The image display device according to claim 2, characterized in that, The control unit displays the second rectangular image on the display unit in a manner that overlays the thermal image. This second rectangular image serves as a user interface for changing the magnification in the calculation formula. The length direction of the second rectangular image is the direction in which the multiple different values ​​are arranged in ascending or descending order. One end of the second rectangular image along its length corresponds to the minimum value among the plurality of different values, and the other end corresponds to the maximum value. Each position separated at a predetermined interval along the length of the second rectangular image corresponds to a value among the plurality of different values ​​other than the minimum value and the maximum value.

8. The image display device according to claim 1 or 2, characterized in that, The display unit also displays a visible light image of the subject. The control unit displays the visible light image and the thermal image superimposed on the display unit.

9. The image display device according to claim 1 or 2, characterized in that, The image display device is a portable terminal that the user can carry.

Images