Image processing device, image processing system, image processing method, and program

Abstract

Image processing device 1 includes an output control unit (control unit 11) that outputs a gas confirmation image obtained by spatially adding pixels to an input infrared image and converting it to a lower resolution, and an unconverted shooting scene confirmation image.

Description

Technical Field

[0001] The present disclosure relates to an image processing apparatus, an image processing system, an image processing method, and a program.

Background Art

[0002] Conventionally, gas inspection using a gas camera has been performed. In gas inspection, a gas confirmation image for confirming gas, such as a frequency image or a time difference image, and a shooting scene confirmation image for confirming a shooting scene of gas, such as an infrared image or a temperature image, are used.

[0003] In these various images, binning is performed for the purpose of noise reduction. Further, Patent Document 1 describes a method of reducing noise by adding pixel values in the time and space directions.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, when binning is performed, in the gas confirmation image, the sensitivity is improved and it becomes easier to view, but in the shooting scene confirmation image, the resolution decreases and it looks rough.

[0006] Therefore, an object of the present disclosure is to make the images used for gas inspection easier to view.

Means for Solving the Problems

[0007] In order to solve the above problems, an image processing apparatus according to the present disclosure for the input infrared image 、A gas confirmation image that has undergone a conversion process to convert the pixels to a lower resolution by spatial summing, and a shooting scene confirmation image that has not undergone the aforementioned conversion process, Display together It includes an output control unit. Furthermore, the image processing apparatus relating to this disclosure is The system includes an output control unit that outputs a gas confirmation image obtained by spatially adding pixels to an input infrared image and converting it to a lower resolution, and an unconverted shooting scene confirmation image. The output control unit outputs a composite image obtained by combining the image obtained by converting the gas confirmation image, which has been converted to a low resolution, to the same resolution as the shooting scene confirmation image, with the shooting scene confirmation image.

[0008] Furthermore, the image processing system related to this disclosure is An image processing system comprising an imaging device for capturing an input infrared image and an image processing device, The aforementioned image processing device is For the input infrared image 、 A gas confirmation image that has undergone a conversion process to convert the pixels to a lower resolution by spatial summing, and a shooting scene confirmation image that has not undergone the aforementioned conversion process, Display together It includes an output control unit. Furthermore, the image processing system related to this disclosure is An image processing system comprising an imaging device for capturing an input infrared image and an image processing device, The aforementioned image processing device is The system includes an output control unit that outputs a gas confirmation image obtained by spatially adding pixels to an input infrared image and converting it to a lower resolution, and an unconverted shooting scene confirmation image. The output control unit outputs a composite image obtained by combining the image obtained by converting the gas confirmation image, which has been converted to a low resolution, to the same resolution as the shooting scene confirmation image, with the shooting scene confirmation image.

[0009] Furthermore, the image processing method relating to this disclosure is In an image processing method performed by an image processing device, For the input infrared image 、 A gas confirmation image that has undergone a conversion process to convert the pixels to a lower resolution by spatial summing, and a shooting scene confirmation image that has not undergone the aforementioned conversion process, Display together Includes an output step. Furthermore, the image processing method relating to this disclosure is In an image processing method performed by an image processing device, The output step includes outputting a gas confirmation image obtained by spatially adding pixels to an input infrared image and converting it to a lower resolution, and an image for confirming the shooting scene that has not undergone the aforementioned conversion process. The output step outputs a composite image obtained by combining the image obtained by converting the gas confirmation image, which has been converted to a low resolution, to the same resolution as the shooting scene confirmation image, with the shooting scene confirmation image.

[0010] Furthermore, the program related to this disclosure is The computer of the image processing device, For the input infrared image 、The pixel is subjected to a conversion process of spatially adding pixels and converting them to low resolution, and an image for gas confirmation obtained through the conversion process and an image for confirmation of a photographed scene that has not undergone the conversion process are Display together caused to function as an output control unit. Furthermore, the program related to this disclosure is The computer of the image processing device, It functions as an output control unit that outputs a gas confirmation image obtained by spatially adding pixels to the input infrared image and converting it to a lower resolution, and a shooting scene confirmation image that has not undergone the aforementioned conversion process. The output control unit outputs a composite image obtained by combining the image obtained by converting the gas confirmation image, which has been converted to a low resolution, to the same resolution as the shooting scene confirmation image, with the shooting scene confirmation image.

Advantages of the Invention

[0011] According to the present disclosure, the image used for gas inspection becomes easier to view.

Brief Description of the Drawings

[0012] [Figure 1] It is a block diagram showing the configuration of an image processing system. [Figure 2] It is a flowchart of output processing. [Figure 3] It is an image diagram of an image for gas confirmation. [Figure 4] It is an image diagram of an image for gas confirmation. [Figure 5] It is an image diagram of an image for confirmation of a photographed scene. [Figure 6] It is an image diagram of an image for confirmation of a photographed scene. [Figure 7] It is a flowchart of output processing. [Figure 8] It is an image diagram of a composite image. [Figure 9] It is an image diagram of a composite image. [Figure 10] It is an image diagram of a composite image.

Modes for Carrying Out the Invention

[0013] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. However, the scope of the present disclosure is not limited to those described in the following embodiments and drawings.

[0014] <Image Processing System 100> First, the configuration of the image processing system 100 will be explained using Figure 1. As shown in Figure 1, the image processing system 100 is configured by connecting the image processing device 1 and the gas camera 2 (imaging device) via a communication network 1000 such as a LAN (Local Area Network).

[0015] Image processing device 1 is a device that processes input infrared images acquired from gas camera 2. Gas camera 2 is a camera that captures infrared light emitted from a gas to acquire an input infrared image. The input infrared image is a raw data image captured by the gas camera 2. The input infrared image acquired from the infrared image sensor in the gas camera 2 is typically 13 to 16 bits of data.

[0016] Furthermore, the image processing device 1 and the gas camera 2 may be integrated into a single unit. For example, an integrated configuration of the image processing device 1 and the gas camera 2 would be a handheld gas camera with the functions of the image processing device 1 built-in.

[0017] <Image Processing Device 1> Next, the configuration of the image processing device 1 will be explained using Figure 1. As shown in Figure 1, the image processing device 1 includes a control unit 11, an operation unit 12, a communication unit 13, a storage unit 14, and a display unit 15.

[0018] The control unit 11 is composed of a CPU (Central Processing Unit), RAM (Random Access Memory), etc. The CPU of the control unit 11 reads various programs stored in the memory unit 14, loads them into the RAM, executes various processes according to the loaded programs, and controls the operation of each part of the image processing device 1.

[0019] The control unit 11 performs a conversion process (binning) from the input infrared image, spatially adding pixels to convert it to a lower resolution, and generates an image for gas confirmation. The gas confirmation image includes one of the following: a frequency image obtained by extracting specific frequencies from the input infrared image; a time-difference image obtained by taking the time difference of pixel values; or a gas cloud image in which the gas is visualized.

[0020] The control unit 11 generates an image for confirming the captured scene from the input infrared image without performing a conversion process (binning) that spatially adds pixels to convert them to a lower resolution. Images used to confirm the shooting scene are images used to confirm the shooting scene of the gas. The image used for confirming the shooting scene includes either an infrared image that has undergone image processing for display, or a thermal image that has undergone temperature conversion processing. Here, the former image processing for display includes processes such as converting a 13-16 bit input infrared image to an 8 bit image and adjusting the contrast.

[0021] The control unit 11 may generate a composite image by combining the image obtained by converting the gas confirmation image, which has been converted to a low resolution, to the same resolution as the shooting scene confirmation image, with the shooting scene confirmation image. In this way, the gas and the shooting scene can be confirmed on a single composite image.

[0022] The control unit 11 functions as an output control unit that outputs a gas confirmation image and a shooting scene confirmation image. The control unit 11 may also output a composite image as an output control unit. The control unit 11, acting as an output control unit, may exclusively output the gas confirmation image and the shooting scene confirmation image. For example, if the control unit 11 outputs and displays the gas confirmation image on the display unit 15, it may choose not to output and display the shooting scene confirmation image on the display unit 15. The control unit 11, acting as an output control unit, may simultaneously output the gas confirmation image and the shooting scene confirmation image. For example, the control unit 11 may simultaneously output and display the gas confirmation image and the shooting scene confirmation image on the display unit 15. Furthermore, the user may configure whether the output is exclusive or simultaneous.

[0023] The operation unit 12 includes a keyboard equipped with cursor keys, number input keys, various function keys, a pointing device such as a mouse, and a touch panel laminated on the surface of the display unit 15. The operation unit 12 is configured to be operable by the operator. The operation unit 12 also outputs various signals to the control unit 11 based on the operations performed by the operator.

[0024] The communication unit 13 is capable of sending and receiving various signals and data with other devices connected via the communication network 1000.

[0025] The memory unit 14 is composed of non-volatile semiconductor memory or a hard disk, and stores various programs executed by the control unit 11, parameters necessary for program execution, and various data.

[0026] The display unit 15 is composed of a monitor such as an LCD (Liquid Crystal Display) and displays various screens, etc., according to the instructions of the display signals input from the control unit 11.

[0027] <Output Processing Case 1> Next, the output processing in the image processing device 1 will be explained using Figure 2. First, the control unit 11 acquires an input infrared image from the gas camera 2 (step S1).

[0028] Next, the control unit 11 binns the input infrared image to generate a gas identification image (step S2).

[0029] Next, the control unit 11 generates an image for confirming the shooting scene without binning the input infrared image (step S3).

[0030] Next, the control unit 11 outputs the generated images (step S4) and terminates the output process.

[0031] Here, we will explain the various images that were generated. Figures 3 and 4 illustrate examples of images used for gas detection. Image I1 in Figure 3, used for gas confirmation, is an example of a time-difference image. Image I2 in Figure 4, used for gas identification, is an example of a frequency image. Figures 5 and 6 illustrate examples of images used to confirm the shooting scene. Image I3 in Figure 5, used for confirming the shooting scene, is an example of an infrared image. Image I4 in Figure 6, used for confirming the shooting scene, is an example of a temperature image.

[0032] Changes in infrared images caused by gas are extremely small; for example, in the case of methane leakage of about 1 L / min, the infrared brightness value often changes by only about 0.1°C when converted to a temperature value. Therefore, even when gas is being emitted as shown in Figures 3 and 4, it is often not visible in the infrared or temperature images as shown in Figures 5 and 6, and these images are often used to confirm the temperature of the shooting scene or subject. Thus, increasing the sensitivity of the gas confirmation images in Figures 3 and 4 is extremely important in order to capture such minute changes.

[0033] First, let's explain the image used for confirming the shooting scene. As an example, we'll show a 14-bit image with a resolution of 640 x 512 pixels from the input infrared image, and then convert it to an 8-bit image for display as shown in Figure 5. At this stage, you may perform contrast adjustments or other processing to improve visibility. Furthermore, the input infrared image is converted to temperature values, and a temperature image is created as shown in Figure 6.

[0034] Next, we will explain the image used for gas confirmation. By performing spatial pixel binning, which adds the pixel values ​​for every 2x2 pixels of the input infrared image, a 16-bit image with 320x256 pixels is created. If the input image is 16-bit, the pixel values ​​can be added and then divided by the number of pixels (4) to output the average value. Since spatial pixel binning reduces sensor noise, the gas sensitivity is doubled. Next, by taking the difference with the image from 0.2 seconds ago, a time-difference image is created as shown in Figure 3. In addition, by capturing the changes in gas fluctuation due to wind, such as in WO2017 / 073430, and creating a frequency image by extracting the frequency components corresponding to the gas, a frequency image is created as shown in Figure 4.

[0035] In this way, by creating images for confirming the shooting scene and images for confirming the gas, it is possible to achieve both gas sensitivity and resolution.

[0036] <Output Processing Case 2> Next, the output processing in the image processing device 1 will be explained using Figure 7. The processes other than steps S13 and S15 are the same as the processes of the same name shown in Figure 2, so their explanation will be omitted.

[0037] Next, the control unit 11 converts the resolution of the gas confirmation image (step S13). As described above, the control unit 11 converts the resolution of the gas confirmation image, which has been converted to a lower resolution (step S12), so that it has the same resolution as the image used to confirm the shooting scene.

[0038] Next, the control unit 11 generates a composite image by combining the image converted in resolution in step S15 and the image for confirming the shooting scene (step S15).

[0039] Here, we will explain examples of composite images using Figures 8, 9, and 10. Figure 8, composite image I5, is an example of a composite image created by combining an infrared image and a time-difference image. The composite image I6 in Figure 9 is an example of a composite image created by combining an infrared image and a frequency image. Figure 10, composite image I7, is an example of a composite image created by combining an infrared image and a gas cloud image.

[0040] Only the differences from Case 1 will be described. The time-difference image and frequency image created in Case 1 at 320 x 256 pixels are converted to 640 x 512 pixels by resolution conversion. A general resolution conversion such as bilinear conversion is acceptable. Furthermore, it is combined with the infrared image. Combination is performed, for example, by adding the pixel values ​​by 50% each. The combined image of the infrared image and time-difference image is shown in Figure 8, and the combined image of the infrared image and frequency image is shown in Figure 9. In addition, Figure 10 shows a combined image of the gas cloud image, in which gas is visualized by identifying pixels above a certain value in the frequency image as gas, and the infrared image. In this way, gas and the shooting scene can be confirmed on a single combined image.

[0041] <Effects> As described above, the image processing device 1 includes an output control unit (control unit 11) that outputs a gas confirmation image obtained by spatially adding pixels to the input infrared image and converting it to a lower resolution, and an unconverted shooting scene confirmation image. Therefore, the images used for gas inspection become easier to see. Specifically, by outputting images generated using image processing methods appropriate for each image's purpose, the images used for gas inspection become easier to see. In other words, by binning the images used for gas confirmation and not binning the images used for confirming the shooting scene, the images used for gas confirmation become more sensitive to gas, and the images used for confirming the gas shooting scene become higher resolution.

[0042] Furthermore, the output control unit (control unit 11) outputs a composite image which is a combination of the image obtained by converting the gas confirmation image, which has been converted to a low resolution, to the same resolution as the shooting scene confirmation image, and the shooting scene confirmation image. Therefore, the images used for gas detection become easier to see. Specifically, in composite images, by re-enhancing the gas confirmation image and combining it, it is possible to achieve both high resolution and high gas sensitivity.

[0043] Furthermore, the image processing system 100 is an image processing system comprising an imaging device (gas camera 2) that captures an input infrared image and an image processing device 1, wherein the image processing device 1 includes an output control unit (control unit 11) that outputs a gas confirmation image obtained by spatially adding pixels to the input infrared image and converting it to a lower resolution, and an unconverted shooting scene confirmation image. This makes the images used for gas inspections easier to see.

[0044] Furthermore, the image processing method, in the image processing method executed by the image processing device 1, includes an output step (steps S4, S16) which outputs a gas confirmation image obtained by spatially adding pixels to the input infrared image and converting it to a lower resolution, and an unconverted shooting scene confirmation image. This makes the images used for gas inspections easier to see.

[0045] Furthermore, the program causes the computer of the image processing device 1 to function as an output control unit (control unit 11) that outputs a gas confirmation image, which is a converted image obtained by spatially adding pixels to the input infrared image and converting it to a lower resolution, and an unconverted shooting scene confirmation image. This makes the images used for gas inspections easier to see.

[0046] Although the present disclosure has been described in detail based on embodiments, it goes without saying that the present disclosure is not limited to the above embodiments and can be modified as appropriate without departing from its essence. For example, the above description disclosed examples in which hard disks or semiconductor non-volatile memory were used as computer-readable media for the program relating to this disclosure, but the disclosure is not limited to these examples. Portable recording media such as CD-ROMs can also be used as other computer-readable media.

[0047] Furthermore, the detailed configuration and operation of each device can be modified as appropriate, without departing from the spirit of the invention. [Industrial applicability]

[0048] This disclosure can be used in image processing devices, image processing systems, image processing methods, and programs. [Explanation of symbols]

[0049] 100 Image Processing Systems 1 Image processing device 11 Control Unit (Output Control Unit) 12 Control section 13 Communications Department 14 Storage section 15 Display 2. Gas camera (imaging device)

Claims

1. An image processing apparatus comprising an output control unit that displays together an input infrared image, an image for gas confirmation that has been converted by spatially adding pixels to convert it to a lower resolution, and an image for shooting scene confirmation that has not undergone the conversion process.

2. The image processing apparatus according to claim 1, wherein the gas confirmation image includes any of a frequency image obtained by processing to extract the frequency, a time difference image obtained by performing a time difference operation, and a gas cloud image obtained by visualizing the gas.

3. The image processing apparatus according to claim 1, wherein the image for confirming the shooting scene includes either an infrared image or a thermal image.

4. The image processing apparatus according to claim 1, wherein the output control unit outputs a composite image obtained by combining an image obtained by converting the resolution of a gas confirmation image converted to a low resolution to the same resolution as the shooting scene confirmation image, and the shooting scene confirmation image.

5. An output control unit that outputs a gas confirmation image obtained by converting the input infrared image to a lower resolution by spatially adding pixels, and a shooting scene confirmation image which has not undergone the conversion process, The output control unit is an image processing device that outputs a composite image obtained by combining the image obtained by converting the resolution of the gas confirmation image, which has been converted to a low resolution, to the same resolution as the shooting scene confirmation image, with the shooting scene confirmation image.

6. An image processing system comprising an imaging device for capturing an input infrared image and an image processing device, The aforementioned image processing device is An image processing system comprising an output control unit that displays together an input infrared image, an image for gas confirmation that has been converted to a lower resolution by spatially adding pixels, and an image for shooting scene confirmation that has not undergone the conversion process.

7. An image processing system comprising an imaging device for capturing an input infrared image and an image processing device, The aforementioned image processing device is The system includes an output control unit that outputs a gas confirmation image obtained by spatially adding pixels to an input infrared image and converting it to a lower resolution, and an unconverted shooting scene confirmation image. The output control unit is an image processing system that outputs a composite image obtained by combining the image obtained by converting the gas confirmation image, which has been converted to a low resolution, to the same resolution as the shooting scene confirmation image, with the shooting scene confirmation image.

8. The image processing system according to claim 6 or 7, wherein the imaging device and the image processing device are integrated.

9. In an image processing method performed by an image processing device, An image processing method including an output step of displaying together an input infrared image, an image for gas confirmation that has been converted by spatially adding pixels to convert it to a lower resolution, and an image for shooting scene confirmation that has not undergone the conversion process.

10. An image processing method performed by an image processing device, The output step includes outputting a gas confirmation image obtained by spatially adding pixels to an input infrared image and converting it to a lower resolution, and an image for confirming the shooting scene that has not undergone the aforementioned conversion process. The output step is an image processing method that outputs a composite image obtained by combining the image obtained by converting the resolution of the gas confirmation image, which has been converted to a low resolution, to the same resolution as the shooting scene confirmation image, with the shooting scene confirmation image.

11. The computer of the image processing device, A program that functions as an output control unit to display together an image for gas confirmation, which has been converted to a lower resolution by spatially adding pixels to the input infrared image, and an image for shooting scene confirmation that has not undergone the conversion process.

12. The computer of the image processing device, It functions as an output control unit that outputs a gas confirmation image obtained by spatially adding pixels to the input infrared image and converting it to a lower resolution, and a shooting scene confirmation image that has not undergone the aforementioned conversion process. The output control unit is a program that outputs a composite image obtained by combining the image obtained by converting the gas confirmation image, which has been converted to a low resolution, to the same resolution as the shooting scene confirmation image, with the shooting scene confirmation image.

Images