Test support system, test support method, and program

Abstract

We provide inspection support systems, inspection support methods, and programs that can reduce inspection errors and improve inspection efficiency. [Solution] The inspection support system has an insertion unit and a control unit. The control unit acquires an appearance image which is an image of each end of two or more tubes, or an image of a figure indicating each of the two or more ends of the two or more tubes. The control unit identifies the object to be inspected in the appearance image based on two or more pieces of identification information and inspection information corresponding to the two or more tubes in the appearance image. Before the insertion unit is inserted into any one of the two or more tubes, or when the insertion unit is inserted into any one of the two or more tubes, the control unit outputs the appearance image and the object to be inspected information to a display.

Description

Technical Field

[0001] The present invention relates to an inspection support system, an inspection support method, and a program.

Background Art

[0002] Industrial endoscope devices are used for inspections (endoscopic inspections) of abnormalities and corrosion inside boilers, pipes, aircraft engines, heat exchangers, etc. The endoscope device has an insertion portion for acquiring an image. The user inserts the insertion portion into the subject and acquires an image of the inspection site inside the subject. The user observes the image and inspects the inspection site. The insertion portion has a bending portion for bending the insertion portion. The user can bend the insertion portion by performing a bending operation.

[0003] The heat exchanger has a large number of thin tubes. The insertion portion is inserted into each tube via the access port of each tube, and an image inside the tube is acquired.

[0004] Patent Document 1 discloses an inspection method for a heat exchanger. Hereinafter, the details of the inspection method disclosed in Patent Document 1 will be described.

[0005] A display terminal is worn on the user's head. The display terminal acquires an external appearance image including two or more access ports and displays the external appearance image. The user designates the access port in the external appearance image by pointing. The display terminal identifies the access port designated by the user and assigns a feature (color or character) to the access port in the external appearance image. The external appearance image with the feature assigned is transmitted to the main body and stored in a folder associated with the access port. Therefore, the user can easily recognize which access port the image acquired by the insertion portion is an image of by checking the external appearance image.

Prior Art Documents

Patent Documents

[0006] [Patent Document 1] Japanese Patent Publication No. 2016-218322 [Overview of the project] [Problems that the invention aims to solve]

[0007] In the inspection method disclosed in Patent Document 1, the display terminal assigns features to access ports in the appearance image based on the user's gestures. This inspection method assumes that the user has prior knowledge of the access port to be inspected. Therefore, the user may not correctly recognize the access port to be inspected and may specify the wrong access port. Even if the user has prior knowledge of the access port to be inspected, the user may still specify the wrong access port.

[0008] The present invention aims to provide an inspection support system, an inspection support method, and a program that can reduce inspection errors and improve inspection efficiency. [Means for solving the problem]

[0009] The present invention relates to an inspection support system for assisting in endoscopic inspection of a heat exchanger having two or more tubes, comprising: an insertion unit that generates an image of the inside of at least one of the two or more tubes; a control unit that acquires an external image which is an image of the end of each of the two or more tubes, or an image of a figure showing the end of each of the two or more tubes; assigns identification information to each of the two or more tubes in the external image; acquires inspection information which includes identification information of the tube that is included in the two or more tubes and is the subject of inspection; identifies the subject of inspection in the external image based on the two or more identification information and the inspection information corresponding to the two or more tubes in the external image; and outputs the external image and the subject of inspection information to a display before the insertion unit is inserted into any one of the two or more tubes, or when the insertion unit is inserted into any one of the two or more tubes.

[0010] In the inspection support system of the present invention, the control unit processes the image generated by the insertion unit to identify the tube into which the insertion unit is inserted, and determines whether or not the tube into which the insertion unit is inserted is the object to be inspected.

[0011] In the inspection support system of the present invention, when it is determined that the tube into which the insertion portion is inserted is not the object to be inspected, the control unit outputs a warning to the display.

[0012] In the inspection support system of the present invention, the control unit receives an instruction to select an inspection mode corresponding to an endoscopic inspection of the heat exchanger, and after the instruction is received, acquires the external image.

[0013] In the inspection support system of the present invention, the control unit processes the image generated by the insertion unit to identify the tube into which the insertion unit is inserted, and outputs insertion tube information indicating the tube into which the insertion unit is inserted to the display.

[0014] In the inspection support system of the present invention, the control unit acquires the image generated by the insertion unit as the external image from the insertion unit or storage medium.

[0015] In the inspection support system of the present invention, the control unit acquires an image generated by a camera different from the insertion unit from the camera as the external image.

[0016] In the inspection support system of the present invention, the control unit acquires the appearance image, which is an image of the graphic, from a storage medium.

[0017] In the inspection support system of the present invention, the control unit acquires unique information of the heat exchanger, determines whether the inspection information including the unique information is stored in the storage medium, and after determining that the inspection information is not stored in the storage medium, saves the inspection information including the unique information to the storage medium.

[0018] In the inspection support system of the present invention, the control unit stores the inspection information, which includes the external image and inspection result information indicating the result of the endoscopic examination of the tube associated with any one of the two or more pieces of identification information, on the storage medium.

[0019] In the inspection support system of the present invention, when the control unit determines that the inspection information including the unique information is not stored in the storage medium, it generates two or more folders in the storage medium, associates each of the two or more folders with one of the two or more identification information, and after the endoscopic examination is performed, saves the inspection result information in the folder associated with the identification information of the tube on which the endoscopic examination was performed.

[0020] In the inspection support system of the present invention, the control unit sets the display state of the inspection target information according to the inspection result information.

[0021] In the inspection support system of the present invention, when it is determined that the inspection information including the unique information is not stored in the storage medium, the control unit outputs information to the display prompting the camera to photograph each of the ends of the two or more tubes in order to acquire the external image.

[0022] In the inspection support system of the present invention, when it is determined that the inspection information including the unique information is not stored in the storage medium, the control unit identifies all of the two or more tubes as the objects to be inspected.

[0023] In the inspection support system of the present invention, when it is determined that the inspection information including the unique information is stored in the storage medium, the control unit acquires the inspection information from the storage medium.

[0024] In the inspection support system of the present invention, the control unit detects the two or more tubes by processing the appearance image, and assigns the identification information to each of the two or more tubes detected from the appearance image.

[0025] In the inspection support system of the present invention, the control unit superimposes the inspection target information on the appearance image.

[0026] The inspection support system of the present invention includes an endoscope device having the insertion unit and the control unit.

[0027] The inspection support system of the present invention includes an endoscope device having the insertion unit, and the control unit is separated from the endoscope device.

[0028] The present invention is an inspection support method for supporting an endoscope inspection of a heat exchanger having two or more tubes, in which a control unit acquires an appearance image that is an image of each end of the two or more tubes or an image of a figure indicating each end of the two or more tubes, assigns identification information to each of the two or more tubes in the appearance image, acquires inspection information including the identification information of the tube included in the two or more tubes and being the inspection target, identifies the inspection target in the appearance image based on the two or more identification information corresponding to the two or more tubes in the appearance image and the inspection information, and outputs the appearance image and inspection target information indicating the inspection target to a display before the insertion unit is inserted into any one of the two or more tubes or when the insertion unit is inserted into any one of the two or more tubes.

[0029] The present invention is a program for causing a computer to perform the following steps: acquire an appearance image which is an image of each end of two or more tubes having a heat exchanger, or an image of a figure showing each of the two or more ends of the two or more tubes; assign identification information to each of the two or more tubes in the appearance image; acquire inspection information which includes identification information of a tube that is included in the two or more tubes and is to be inspected; identify the object to be inspected in the appearance image based on the two or more identification information and the inspection information which correspond to the two or more tubes in the appearance image; and output the appearance image and the object to be inspected information to a display before an insertion unit which generates an image of the inside of at least one of the two or more tubes is inserted into any one of the two or more tubes, or when the insertion unit is inserted into any one of the two or more tubes. [Effects of the Invention]

[0030] According to the present invention, the inspection support system, inspection support method, and program can reduce inspection errors and improve inspection efficiency. [Brief explanation of the drawing]

[0031] [Figure 1] This block diagram shows an example of the configuration of an endoscope system according to the first embodiment of the present invention. [Figure 2] This figure shows the structure of a heat exchanger in the first embodiment of the present invention. [Figure 3] This flowchart shows an example of the preparation process performed by an endoscope system according to the first embodiment of the present invention. [Figure 4] This figure shows an example of the screen of the display unit of an endoscope system according to the first embodiment of the present invention. [Figure 5] This figure shows an example of the screen of the display unit of an endoscope system according to the first embodiment of the present invention. [Figure 6]This figure shows an example of the screen of the display unit of an endoscope system according to the first embodiment of the present invention. [Figure 7] This figure shows an example of the screen of the display unit of an endoscope system according to the first embodiment of the present invention. [Figure 8] This figure shows an example of a management table in the first embodiment of the present invention. [Figure 9] This figure shows an example of the screen of the display unit of an endoscope system according to the first embodiment of the present invention. [Figure 10] This flowchart shows an example of an examination process performed by an endoscope system according to the first embodiment of the present invention. [Figure 11] This figure shows an example of the screen of the display unit of an endoscope system according to the first embodiment of the present invention. [Figure 12] This figure shows an example of the screen of the display unit of an endoscope system according to the first embodiment of the present invention. [Figure 13] This flowchart shows an example of the information update process performed by an endoscope system according to the first embodiment of the present invention. [Figure 14] This figure shows an example of the screen of the display unit of an endoscope system according to the first embodiment of the present invention. [Figure 15] This figure shows an example of the screen of the display unit of an endoscope system according to the first embodiment of the present invention. [Figure 16] This block diagram shows an example of the configuration of an endoscope system according to a first modification of the first embodiment of the present invention. [Figure 17] This block diagram shows an example of the configuration of an endoscope system according to a second modification of the first embodiment of the present invention. [Figure 18] This flowchart shows an example of the preparation process performed by an endoscope system according to a second embodiment of the present invention. [Figure 19] This figure shows an example of the screen of the display unit of an endoscope system according to a second embodiment of the present invention. [Figure 20] This figure shows an example of a management table in a second embodiment of the present invention. [Figure 21] This flowchart shows an example of an examination process performed by an endoscope system according to a second embodiment of the present invention. [Figure 22] This flowchart shows an example of an examination process performed by an endoscope system according to a second embodiment of the present invention. [Figure 23] This figure shows an example of the screen of the display unit of an endoscope system according to a second embodiment of the present invention. [Figure 24] This figure shows an example of the screen of the display unit of an endoscope system according to a second embodiment of the present invention. [Figure 25] This figure shows an example of the screen of the display unit of an endoscope system according to a second embodiment of the present invention. [Figure 26] This figure shows an example of the screen of the display unit of an endoscope system according to a second embodiment of the present invention. [Figure 27] This figure shows an example of the screen of the display unit of an endoscope system according to a second embodiment of the present invention. [Figure 28] This figure shows an example of the screen of the display unit of an endoscope system according to a second embodiment of the present invention. [Modes for carrying out the invention]

[0032] Embodiments of the present invention will be described below with reference to the drawings. In the following, an endoscope system will be described as an example of an inspection support system.

[0033] (First Embodiment) Figure 1 shows an example of the configuration of an endoscope system 1 according to a first embodiment of the present invention. The endoscope system 1 shown in Figure 1 has an insertion section 2, a main body 3, an insertion length detection section 4, and an optical adapter 5. The insertion section 2 and the main body 3 constitute an endoscope device.

[0034] The insertion unit 2 is inserted into the inside of the subject being observed. The subject is a tube from a heat exchanger. The insertion unit 2 is a long, slender tube and is bendable. The user performs the insertion operation and inserts the insertion unit 2 into the subject. The insertion unit 2 acquires an optical image of the inside of the subject. The insertion unit 2 has an image sensor 21, an LED (Light-Emitting Diode) 22, and a wire fixing part 23.

[0035] The image sensor 21, LED 22, and wire fixing portion 23 are located at the tip portion 20, which includes the tip of the insertion portion 2.

[0036] The image sensor 21 is an image sensor such as a CCD (Charge-Coupled Device) image sensor or a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor. The image sensor 21 generates an image (endoscopic image) based on the optical image acquired by the insertion section 2. The image generated by the image sensor 21 is output to the main unit 3. The LED 22 generates illumination light. The illumination light generated by the LED 22 is irradiated into the inside of the subject. The wire fixing section 23 is connected to the wire that bends the insertion section 2 and fixes the wire in place.

[0037] The optical adapter 5 is attached to the tip portion 20. The optical adapter 5 has an optical lens 50 and an identifier storage unit 51.

[0038] Illumination light reflected from inside the subject enters the optical lens 50. The light that enters the optical lens 50 passes through the optical lens 50 and enters the image sensor 21. The identifier storage unit 51 stores the type of optical lens 50 and the corresponding identifier.

[0039] The main unit 3 includes an image sensor drive unit 30, an image processing unit 31, an LED drive unit 32, a motor 33, a curvature control unit 34, an optical adapter identification unit 35, a display unit 36, a memory 37, an operation unit 38, an external device interface 39, and a control unit 40.

[0040] The image sensor drive unit 30 drives the image sensor 21. The image processing unit 31 controls the image sensor drive unit 30. The image processing unit 31 also performs image processing, such as noise reduction, on the image output from the image sensor 21 and outputs the image to the control unit 40.

[0041] The LED drive unit 32 drives the LED 22. The motor 33 pulls the wire connected to the wire fixing unit 23, thereby bending the insertion unit 2 in a predetermined direction. The bending control unit 34 controls the motor 33.

[0042] The optical adapter identification unit 35 detects an identifier stored in the identifier storage unit 51 and identifies the type of optical adapter 5 that corresponds to that identifier. For example, the type of optical adapter 5 is either a straight-view adapter or a side-view adapter. A straight-view adapter is an optical adapter for observing a subject in a direction parallel to the longitudinal direction of the insertion unit 2. A side-view adapter is an optical adapter for observing a subject in a direction perpendicular to the longitudinal direction of the insertion unit 2.

[0043] The display unit 36 ​​is a display such as an LCD (Liquid Crystal Display). The display unit 36 ​​displays the image generated by the image sensor 21.

[0044] Memory 37 is SRAM (Static Random Access Memory), EPROM (Erasable Programmable Read-Only Memory), EEPROM (Electrically Erasable Programmable ROM), or flash memory. Memory 37 may be detachable from the main unit 3. Memory 37 stores images generated by the image sensor 21 and various information processed by the control unit 40.

[0045] The control unit 38 has buttons and other controls that can be operated by the user, and accepts various information input from the user. The main unit 3 may have a touch panel located on the screen of the display unit 36. The user may input various information to the main unit 3 by operating the touch panel.

[0046] The external device interface 39 communicates with the external device 6 via wired or wireless communication. The external device 6 is a personal computer or a server on a cloud network, and stores inspection setting information. The inspection setting information includes information indicating the tube to be inspected. The external device interface 39 receives the inspection setting information from the external device 6.

[0047] Memory 37 stores the inspection setting information received from the external device 6. After the inspection is performed, memory 37 also stores the inspection history, including the inspection results.

[0048] The control unit 40 controls each part of the main body 3. At least one of the control unit 40, image processing unit 31, LED drive unit 32, curvature control unit 34, and optical adapter identification unit 35 may be composed of at least one processor and logic circuit. For example, the processor is at least one of a CPU (Central Processing Unit), a DSP (Digital Signal Processor), and a GPU (Graphics Processing Unit). For example, the logic circuit is at least one of an ASIC (Application Specific Integrated Circuit) and an FPGA (Field-Programmable Gate Array). At least one of the control unit 40, image processing unit 31, LED drive unit 32, curvature control unit 34, and optical adapter identification unit 35 may include one or more processors. At least one of the control unit 40, image processing unit 31, LED drive unit 32, curvature control unit 34, and optical adapter identification unit 35 may include one or more logic circuits.

[0049] The computer of the endoscope system 1 may load a program and execute the loaded program. The program includes instructions that define the operation of at least one of the control unit 40, image processing unit 31, LED drive unit 32, bending control unit 34, and optical adapter identification unit 35. In other words, at least one function of the control unit 40, image processing unit 31, LED drive unit 32, bending control unit 34, and optical adapter identification unit 35 may be implemented by software.

[0050] The above program may be provided on a "computer-readable recording medium," such as flash memory. The program may be transmitted from the computer holding the program to the endoscope system 1 via a transmission medium or by transmission waves within the transmission medium. The "transmission medium" for transmitting the program is a medium that has the function of transmitting information. A medium that has the function of transmitting information includes networks such as the Internet and communication lines such as telephone lines. The above program may implement some of the functions described above. Furthermore, the above program may be a differential file (differential program). The functions described above may be implemented by a combination of a program already recorded on the computer and a differential program.

[0051] The insertion length detection unit 4 has a sensor 41. For example, the sensor 41 is an optical sensor that detects the amount of movement of the insertion part, thereby detecting the length of the insertion part 2 inserted into the space inside the subject (insertion length). The insertion length corresponds to the position of the tip 20. The sensor 41 outputs a signal corresponding to the insertion length to the control unit 40.

[0052] Figure 2 shows the structure of the heat exchanger HE150. The heat exchanger HE150 has two or more tubes HT150. Each tube HT150 is assigned a number as an ID. The end HT150a of each tube HT150 is located at the end HE150a of the heat exchanger HE150. The end HT150a is a hole. Insertion part 2 is inserted into or removed from the end HT150a. Although the numbers of each tube HT150 are shown in Figure 2, the numbers are not actually displayed.

[0053] Figure 3 shows an example of the preparatory processes performed by the endoscope system 1 before a heat exchanger inspection is carried out. Before a particular heat exchanger is inspected for the first time, the endoscope system 1 performs the preparatory processes shown in Figure 3. Figure 3 will be used to illustrate the operation of the endoscope system 1.

[0054] Two or more inspection modes are pre-configured. For example, inspection modes such as a heat exchanger mode for inspecting heat exchangers and a pipe mode for inspecting pipes are provided. The user inputs mode information indicating the heat exchanger mode as the inspection mode to the endoscope system 1 by operating the control unit 38. The control unit 40 receives the mode information (step S100). After the mode information indicating the heat exchanger mode is received, the endoscope system 1 operates in heat exchanger mode.

[0055] The user inputs selection information into the endoscope system 1 to select inspection setting information for a specific heat exchanger by operating the control unit 38. The control unit 40 receives the selection information. The control unit 40 reads the inspection setting information indicated by the selection information from the memory 37 (step S101). The inspection setting information includes the heat exchanger's unique information and the number of the tube to be inspected.

[0056] Figure 4 shows an example of the screen of the display unit 36 ​​in step S101. The display unit 36 ​​has a screen SC1. The control unit 40 displays the inspection setting information IF1 for a specific heat exchanger on screen SC1. For example, a folder for each heat exchanger is prepared in memory 37. When the user selects a folder corresponding to a specific heat exchanger, the inspection setting information IF1 contained in that folder is displayed. When the user performs a predetermined operation, selection information for selecting the inspection setting information IF1 is input to the endoscope system 1.

[0057] The user may input heat exchanger information indicating a specific heat exchanger to the endoscope system 1 by operating the control unit 38. The control unit 40 may receive the heat exchanger information. The control unit 40 may read inspection setting information, which includes unique information corresponding to the heat exchanger indicated by the heat exchanger information, from the memory 37.

[0058] After step S101, the control unit 40 outputs information to the display unit 36 ​​prompting the user to take a photograph of the heat exchanger's exterior, and displays the information on the display unit 36. The user then points the tip 20 of the insertion unit 2 towards the heat exchanger according to the information and takes a photograph of the heat exchanger's exterior. The image sensor 21 generates an image showing the ends of two or more tubes. The image processing unit 31 processes the image. The control unit 40 acquires the image processed by the image processing unit 31 (step S102).

[0059] Figure 5 shows an example of the screen SC1 of the display unit 36 ​​in step S102. The image sensor 21 continuously captures the appearance of the heat exchanger and sequentially generates two or more live images. The image processing unit 31 sequentially processes the two or more live images. The control unit 40 sequentially acquires the two or more live images processed by the image processing unit 31 and sequentially displays the two or more live images on the screen SC1. For example, the control unit 40 displays the live image LI1 on the screen SC1.

[0060] The control unit 40 displays message MS1 on screen SC1. Message MS1 prompts the user to take a photograph of the heat exchanger's exterior so that the ends of all the tubes are within the dashed line DL1 displayed on the live image LI1.

[0061] When the user instructs the camera to take a picture in the above state, the control unit 40 instructs the image sensor 21 to freeze the image in order to acquire an exterior image. The image sensor 21 generates an exterior image as a still image, and the image processing unit 31 processes the exterior image. The control unit 40 acquires the exterior image processed by the image processing unit 31 (step S103).

[0062] The user may take a photograph of the heat exchanger's appearance using a camera such as a digital camera, smartphone, or tablet. The control unit 40 may acquire the appearance image from the camera via the external device interface 39.

[0063] Memory 37 may pre-store a schematic image of a figure showing the arrangement of two or more tubes of the heat exchanger. For example, the figure may include a circle representing the end face of the heat exchanger and two or more circles representing the ends of the two or more tubes. The control unit 40 may acquire this image from memory 37 as an external image.

[0064] After step S103, the control unit 40 processes the appearance image and detects the ends of two or more tubes. For example, the control unit 40 detects the ends of two or more tubes by using the function of AI (Artificial Intelligence) (step S104).

[0065] After step S104, the control unit 40 associates the numbers with each tube by assigning a number to each tube. At this time, the control unit 40 automatically assigns a number to each tube detected in step S104. For example, the control unit 40 assigns sequential numbers from the upper left tube to the lower right tube in the appearance image. Alternatively, the user may input the number of each tube by operating the operation unit 38, and the control unit 40 may assign that number to each tube detected in step S104. The control unit 40 stores the tube information, including the position of each tube in the appearance image and the number of each tube, in the memory 37. The control unit 40 also superimposes the number of each tube onto the appearance image (step S105).

[0066] The user inputs unique information corresponding to the individual heat exchanger into the endoscope system 1 by operating the control unit 38. The unique information indicates the name and individual number of the heat exchanger. The control unit 40 receives the unique information (step S106).

[0067] Figure 6 shows an example of the screen SC1 of the display unit 36 ​​in step S105. The control unit 40 displays the appearance image EI1 on the screen SC1. Each end EP1 of two or more tubes is shown in the appearance image EI1, and the number of each tube is superimposed on the end EP1. The control unit 40 displays the button BT1 on the appearance image EI1. The user presses the button BT1 by operating the operation unit 38.

[0068] Figure 7 shows an example of screen SC1 of the display unit 36 ​​in step S106. The control unit 40 displays the input window IW1 on screen SC1. The user inputs unique information, such as the name and individual number of the heat exchanger, into the endoscope system 1 by operating the operation unit 38. It is assumed that the unique information entered by the user matches the unique information included in the inspection setting information. After entering the unique information, the user presses button BT2 by operating the operation unit 38. At this time, the control unit 40 receives the unique information entered by the user.

[0069] After step S106, the control unit 40 creates folders in memory 37 for storing unique information, etc. At this time, the control unit 40 creates folders for each tube under the folder for each heat exchanger. Since a heat exchanger has two or more tubes, the control unit 40 creates two or more folders. The control unit 40 associates each of the two or more folders with the number of each tube. For example, the name of each folder includes the number of each tube (step S107).

[0070] After step S107, the control unit 40 stores the inspection history, including the unique information received in step S106 and the appearance image processed in step S105, in the memory 37 (step S108). The inspection history may also include information indicating the relationship between each folder and each tube number.

[0071] Memory 37 pre-stores a management table for managing the objects to be inspected. The management table contains information indicating whether or not each tube is an object to be inspected. Before the initial inspection begins, the management table contains information indicating that all tubes are objects to be inspected. After step S108, the control unit 40 reads the management table from memory 37 (step S109).

[0072] Figure 8 shows an example of a management table. The management table TL1 shown in Figure 8 includes the number of each tube, a flag to be inspected, an inspection order, and a completion flag. These are related to each other.

[0073] The inspection flag indicates whether each tube is subject to inspection. The value of the inspection flag is either 1 or 0. When the value of the inspection flag is 1, the tube associated with the inspection flag is subject to inspection. When the value of the inspection flag is 0, the tube associated with the inspection flag is not subject to inspection. Before the initial inspection begins, the inspection flag value for all tubes is 1.

[0074] The inspection order indicates the order in which the tests are performed. The completion flag indicates whether the test for each tube has been completed. The value of the completion flag is either 1 or 0. If the test is completed, the value of the completion flag is 1. If the test is not completed, the value of the completion flag is 0. Before the initial test begins, the value of the completion flag for all tubes is 0.

[0075] After step S109, the control unit 40 determines, based on the management table, that all tubes are subject to inspection and superimposes blue on all tubes in the appearance image (step S110). After step S110, the control unit 40 outputs the appearance image to the display unit 36 ​​and displays the appearance image on the display unit 36 ​​(step S111). When step S111 is executed, the preparation process shown in Figure 3 is completed.

[0076] Figure 9 shows an example of the screen SC1 of the display unit 36 ​​in step S110. The control unit 40 displays the external image EI2 on the screen SC1. Each end EP2 of two or more tubes is displayed in blue.

[0077] The tubes to be inspected are superimposed with blue. Users can determine from the visual image that the blue tubes are the ones to be inspected. Generally, all tubes are inspected in the initial inspection. In the preparation process, all tubes are superimposed with blue. In each embodiment, the color superimposed on the tubes in the visual image is not limited to the color shown in each embodiment.

[0078] Figure 10 shows an example of the examination process performed by the endoscope system 1 after the preparation process has been completed. The operation of the endoscope system 1 will be explained using Figure 10.

[0079] The user holds the insertion part 2 and brings the tip 20 of the insertion part 2 close to the heat exchanger. The user inserts the insertion part 2 into the tube to be inspected. In the first inspection, the user inserts the insertion part 2 into, for example, the upper left tube.

[0080] The image sensor 21 continuously captures images of the heat exchanger's exterior and sequentially generates two or more live images. The image processing unit 31 sequentially processes the two or more live images. The control unit 40 sequentially acquires the two or more live images processed by the image processing unit 31 and sequentially displays the two or more live images on the display unit 36. The control unit 40 detects the insertion unit 2 and the end of each tube in each live image and identifies the tube into which the insertion unit 2 is inserted. The control unit 40 also refers to the tube information stored in the memory 37. The tube information includes the position of each tube in the exterior image and the number of each tube. The control unit 40 acquires the number of the tube into which the insertion unit 2 is inserted (step S200).

[0081] After step S200, the control unit 40 outputs the external image to the display unit 36 ​​and displays the external image on the display unit 36. The control unit 40 also makes the tube into which the insertion unit 2 is inserted blink in the external image (step S201).

[0082] Figure 11 shows an example of the screen SC1 of the display unit 36 ​​in step S201. The control unit 40 displays the live image LI2 and the appearance image EI3 on ​​screen SC1. The control unit 40 displays the insertion length IL1, device setting information DI1, and device setting information DI2 on the live image LI2. For example, the insertion length IL1 is displayed in white. The device setting information DI1 includes the magnification of the image, the brightness of the illumination, and the date and time. The device setting information DI1 may also include information regarding the curvature control of the insertion unit 2. The device setting information DI2 indicates the type of optical adapter 5.

[0083] The insertion unit 2 is inserted into tube number 1. The control unit 40 makes tube number 1 TB1 blink in the external image EI3. As a result, the control unit 40 displays insertion tube information indicating the tube into which the insertion unit 2 is inserted. The user can confirm which tube the insertion unit 2 is inserted into.

[0084] The method for notifying the user of which tube the insertion unit 2 is inserted into is not limited to flashing a specific tube in the external image. For example, the control unit 40 may display an arrow, specific characters, specific shapes, or specific symbols near the specific tube in the external image. Alternatively, the control unit 40 may display the number of the specific tube in the external image.

[0085] After step S201, the control unit 40 determines whether or not the insertion unit 2 has been inserted into the object to be inspected (step S202).

[0086] Step S202 will now be explained in detail. The control unit 40 refers to the management table stored in memory 37. The control unit 40 retrieves information from the management table that matches the number obtained in step S200. When the value of the inspection target flag associated with that number is 1 and the value of the termination flag associated with that number is 0, the control unit 40 determines that the insertion unit 2 has been inserted into the inspection target. When the value of the inspection target flag associated with that number is 0, the control unit 40 determines that the insertion unit 2 has been inserted into a tube that is not an inspection target. The control unit 40 also determines that the insertion unit 2 has been inserted into a tube that is not an inspection target when the value of the inspection target flag associated with that number is 1 and the value of the termination flag associated with that number is 1.

[0087] When the control unit 40 determines in step S202 that the insertion unit 2 has been inserted into the object to be inspected, the control unit 40 performs an anomaly detection process using the live image generated by the image sensor 21. For example, in the anomaly detection process, the control unit 40 detects an anomaly that has a specific color or shape. The control unit 40 may also detect an anomaly by using the AI ​​function (step S203).

[0088] After step S203, the control unit 40 determines whether or not an abnormality has been detected (step S204).

[0089] The user may observe the live image displayed on the display unit 36 ​​and determine whether or not an abnormality is visible in the live image. If an abnormality is visible in the live image, the user may input information indicating that an abnormality has been detected to the endoscope system 1 by operating the operation unit 38. In step S204, the control unit 40 may determine that an abnormality has been detected based on that information.

[0090] When the control unit 40 determines in step S204 that an abnormality has been detected, the control unit 40 outputs a message to the display unit 36 ​​prompting the user to acquire an abnormality image, which is an image showing the abnormality, and displays the message on the display unit 36. The user inputs an instruction to acquire the abnormality image to the endoscope system 1 by operating the operation unit 38. The control unit 40 accepts the instruction and saves the abnormality image and insertion length information, which indicates the insertion length, to the memory 37. The insertion length is indicated by a signal output from the sensor 41 of the insertion length detection unit 4. The live image and insertion length information are saved in a folder associated with the tube number identified in step S200 and are included in the examination history (step S205).

[0091] After step S205, the control unit 40 saves the inspection result indicating NG to the memory 37. The inspection result is saved in the folder associated with the tube number identified in step S200 and is included in the inspection history. The control unit 40 changes the value of the termination flag associated with the tube number in the management table to 1 (step S206).

[0092] If the control unit 40 determines in step S204 that no abnormality was detected, the control unit 40 changes the value of the termination flag associated with the tube number in the management table to 1 (step S209).

[0093] After step S206 or step S209, the control unit 40 determines whether the insertion length is 0m or not (step S207).

[0094] If the control unit 40 determines in step S207 that the insertion length is not 0m, that is, that the insertion length is greater than 0m, the determination in step S207 continues. If the control unit 40 determines in step S207 that the insertion length is 0m, the control unit 40 determines that the insertion part 2 has been removed from the tube (step S208). When step S208 is executed, the inspection process shown in Figure 10 is completed.

[0095] If the control unit 40 determines in step S202 that the insertion unit 2 has been inserted into a tube that is not the subject of inspection, the control unit 40 outputs a message to the display unit 36 ​​indicating that the insertion unit 2 has been inserted into a tube that is not the subject of inspection, and displays the message on the display unit 36 ​​(step S210). After step S210, step S207 is executed.

[0096] Figure 12 shows an example of the screen SC1 of the display unit 36 ​​in step S210. The control unit 40 displays the live image LI3 and the appearance image EI4 on the screen SC1.

[0097] In the example shown in Figure 12, the inspection of tubes number 1 and 2 has been completed. As will be described later, the tubes that have been inspected will have a color superimposed according to the inspection result. In the example shown in Figure 12, the insertion unit 2 is inserted into tube number 1, and that tube blinks in the external image. Since the insertion unit 2 is inserted into a tube that has been inspected, the control unit 40 displays message MS2 on screen SC1 as a warning. Message MS2 indicates that the tube into which the insertion unit 2 is inserted is not the target of inspection. The user can determine that the insertion unit 2 is inserted into a tube that is not the target of inspection.

[0098] Figure 13 shows an example of the information update process performed by the endoscope system 1 after the examination process is completed. The operation of the endoscope system 1 will be explained using Figure 13.

[0099] The control unit 40 refers to the inspection history stored in the memory 37 and determines whether the inspection result of the tube identified in step S200 shown in Figure 10 is OK or not (step S300). If the inspection history includes an inspection result indicating NG, the control unit 40 determines that the inspection result is NG. If the inspection history does not include an inspection result indicating NG, the control unit 40 determines that the inspection result is OK.

[0100] When the control unit 40 determines in step S300 that the inspection result is OK, the control unit 40 identifies the tube in the external image corresponding to the number acquired in step S200 and superimposes yellow on that tube in the external image (step S301).

[0101] If the control unit 40 determines in step S300 that the inspection result is NG, the control unit 40 identifies the tube in the external image corresponding to the number acquired in step S200 and superimposes orange on that tube in the external image (step S302).

[0102] Steps S301 and S302 are described in detail. The control unit 40 refers to the tube information stored in memory 37. The tube information includes the position of each tube in the external image and the number of each tube. The control unit 40 obtains the position associated with the same number as the number obtained in step S200. The control unit 40 superimposes yellow or orange on the tube at that position in the external image.

[0103] After step S301 or step S302, the control unit 40 saves the device setting information to the memory 37 (step S303). The device setting information includes the image magnification, image brightness, and date and time. The device setting information may also include parameters for image processing in the image processing unit 31. The device setting information is included in the inspection history.

[0104] After step S303, the control unit 40 determines whether the inspection of all inspection targets has been completed (step S304).

[0105] When the control unit 40 determines in step S304 that the inspection of all inspection targets has been completed, the control unit 40 outputs information indicating the completion of the inspection to the display unit 36 ​​and displays that information on the display unit 36. In this way, the control unit 40 notifies the user that the inspection has been completed (step S305). When step S305 is executed, the information update process shown in Figure 13 is completed.

[0106] If the control unit 40 determines in step S304 that one or more inspection targets have not yet been inspected, the control unit 40 reads the management table from memory 37 (step S306).

[0107] After step S306, the control unit 40 refers to the management table and identifies the tube to be inspected next. The control unit 40 superimposes green on that tube (step S307). When the appearance image is displayed next, the user can determine that the green tube is the one to be inspected.

[0108] After step S307, the control unit 40 outputs the appearance image to the display unit 36 ​​and displays the appearance image on the display unit 36 ​​(step S308). When step S308 is executed, the information update process shown in Figure 13 is completed. After that, the inspection process shown in Figure 10 is executed. The inspection process and information update process are repeated until the inspection of all inspection targets is completed.

[0109] Step S307 will now be explained in detail. The control unit 40 retrieves information with the same number as the number obtained in step S200 from the management table and refers to the information of the next number in the inspection sequence. That number is the number of the tube to be inspected next. The control unit 40 refers to the tube information stored in memory 37. The control unit 40 retrieves the position associated with the number of the tube to be inspected next. The control unit 40 superimposes green on the tube at that position in the appearance image.

[0110] Figure 14 shows an example of screen SC1 of the display unit 36 ​​in step S305. The control unit 40 displays the live image LI4 and the appearance image EI5 on screen SC1. Appearance image EI5 is the same as appearance image EI3 shown in Figure 11. In appearance image EI5, tube number 1 blinks. The control unit 40 displays message MS3 on screen SC1. Message MS3 indicates the completion of inspection of tube number 1.

[0111] Figure 15 shows an example of screen SC1 of the display unit 36 ​​in step S307. The control unit 40 displays the live image LI5 and the appearance image EI6 on screen SC1. In the appearance image EI6, yellow is superimposed on tube number 1. The user can determine that tube number 1 is not abnormal. In the appearance image EI6, green is superimposed on tube number 2. The user can determine that tube number 2 is the next object to be inspected. Therefore, the number of inspection errors in which the user inserts the insertion unit 2 into a tube that is not the object to be inspected is reduced.

[0112] Each aspect of the present invention provides an endoscope system 1 (inspection support system) that assists in the endoscopic inspection of a heat exchanger having two or more tubes. The endoscope system 1 includes an insertion unit 2 and a control unit 40. The insertion unit 2 generates an image of the inside of at least one of the two or more tubes. The control unit 40 acquires an external image which is an image of each end of the two or more tubes, or an image of a figure showing each end of the two or more tubes.

[0113] The control unit 40 assigns identification information to each of the two or more tubes. In the example above, the identification information is a number. The control unit 40 obtains inspection information that includes the identification information of the tube that is included in the two or more tubes and is the object to be inspected. In the example above, the inspection information corresponds to a management table. The control unit 40 identifies the object to be inspected in the appearance image based on the two or more tubes in the appearance image, the two or more corresponding identification information, and the inspection information. In the example above, the two or more identification information is included in the tube information. For example, when the identification information of a tube in the appearance image is the same as the identification information in the inspection information, the control unit 40 identifies that tube as the object to be inspected.

[0114] Before the insertion unit 2 is inserted into one of the two or more tubes, or while the insertion unit 2 is inserted into one of the two or more tubes, the control unit 40 outputs an external image and inspection target information indicating the object to be inspected to the display unit 36 ​​(display). In the above example, before the insertion unit 2 is inserted into the tube, the control unit 40 outputs the external image and inspection target information to the display unit 36 ​​in step S308. Also in the above example, when the insertion unit 2 is inserted into the tube, the control unit 40 outputs the external image and inspection target information to the display unit 36 ​​in step S201. In the above example, the inspection target information corresponds to the color superimposed on the tube in the external image.

[0115] Each aspect of the present invention provides an inspection support method for endoscopic inspection of a heat exchanger having two or more tubes. The inspection support method comprises first to fifth steps. In the first step (step S103), the control unit 40 acquires an external image. In the second step (step S105), the control unit 40 assigns identification information to each of the two or more tubes. In the third step (step S306), the control unit 40 acquires inspection information. In the fourth step (step S307), the control unit 40 identifies the object to be inspected in the external image based on the two or more tubes in the external image, the two or more pieces of identification information corresponding to them, and the inspection information. In the fifth step (steps S201 and S308), the control unit 40 outputs the external image and inspection object information indicating the object to be inspected to the display unit 36.

[0116] A program according to each aspect of the present invention causes a computer to execute the first to fifth steps described above.

[0117] Each aspect of the present invention may include the following modifications. The control unit 40 identifies the tube into which the insertion unit 2 is inserted by processing the image generated by the insertion unit 2 (step S200). The control unit 40 determines whether or not the tube into which the insertion unit 2 is inserted is the object to be inspected (step S202).

[0118] Each aspect of the present invention may include the following modifications. When it is determined that the tube into which the insertion portion 2 is inserted is not subject to inspection, the control unit 40 outputs a warning to the display unit 36 ​​(step S210).

[0119] Each aspect of the present invention may include the following modifications. The control unit 40 receives an instruction to select an inspection mode corresponding to an endoscopic inspection of the heat exchanger (step S100). After receiving the instruction, the control unit 40 acquires an external image (step S103).

[0120] Each aspect of the present invention may include the following modifications. The control unit 40 identifies the tube into which the insertion unit 2 is inserted by processing the image generated by the insertion unit 2 (step S200). The control unit 40 outputs insertion tube information indicating the tube into which the insertion unit 2 is inserted to the display unit 36 ​​(step S201). In the above example, the insertion tube information is indicated by the blinking of a specific tube in the external image.

[0121] Each aspect of the present invention may include the following modifications. The control unit 40 acquires the image generated by the insertion unit 2 from the insertion unit 2 as an external image (step S103).

[0122] Each aspect of the present invention may include the following modifications. The control unit 40 acquires an image generated by a different camera from the insertion unit 2 as an external image from that camera.

[0123] Each aspect of the present invention may include the following modifications. The control unit 40 acquires an appearance image, which is a graphic image showing each of the ends of two or more tubes, from the memory 37 (storage medium).

[0124] Each aspect of the present invention may include the following modifications: The control unit 40 detects two or more tubes by processing an external image (step S104). The control unit 40 assigns identification information to each of the two or more tubes detected from the external image (step S105).

[0125] Each aspect of the present invention may include the following modifications. The control unit 40 superimposes the inspection target information onto the appearance image (step S307).

[0126] Each aspect of the present invention may include the following modifications. The endoscope system 1 has an endoscope device having an insertion section 2 and a control section 40.

[0127] In the first embodiment, the control unit 40 outputs an external image and information about the object to be inspected to the display unit 36. As a result, the endoscope system 1 can reduce inspection errors and improve inspection efficiency.

[0128] The control unit 40 outputs insertion tube information to the display unit 36, indicating the tube into which the insertion unit 2 is inserted. The endoscope system 1 can then notify the user of the tube into which the insertion unit 2 is inserted.

[0129] When the insertion unit 2 is inserted into a tube that is not the target of the examination, the control unit 40 outputs a warning to the display unit 36. The endoscope system 1 can notify the user that the insertion unit 2 is inserted into a tube that is not the target of the examination, thereby reducing examination errors.

[0130] (First modification of the first embodiment) A first modification of the first embodiment of the present invention will now be described. Figure 16 shows an example of the configuration of an endoscope system 1a according to the first modification of the first embodiment. Parts that are the same as those shown in Figure 1 will not be described. The same blocks as those shown in Figure 1 are assigned the same reference numerals as those shown in Figure 1.

[0131] The endoscope system 1a shown in Figure 16 comprises an insertion section 2, a main body 3a, an insertion length detection unit 4, an optical adapter 5, and a base unit 7. The insertion section 2 and the main body 3a constitute the endoscope device.

[0132] The insertion section 2 shown in Figure 16 is the same as the insertion section 2 shown in Figure 1. The insertion length detection section 4 shown in Figure 16 is the same as the insertion length detection section 4 shown in Figure 1. The optical adapter 5 shown in Figure 16 is the same as the optical adapter 5 shown in Figure 1.

[0133] The main unit 3 shown in Figure 1 is replaced with the main unit 3a shown in Figure 16. The main unit 3a includes an image sensor drive unit 30, an image processing unit 31, an LED drive unit 32, a motor 33, a curvature control unit 34, an optical adapter identification unit 35, a control unit 40, and a communication unit 42. The communication unit 42 has a communication circuit and performs wired or wireless communication with the base unit 7 for purposes such as curvature control.

[0134] The base unit 7 includes a control unit 70, a communication unit 71, a display unit 36, a memory unit 37, an operation unit 38, and an external device interface 39. The control unit 70 controls each part of the base unit 7. The communication unit 71 has a communication circuit and performs wired or wireless communication with the main unit 3a for purposes such as curve control.

[0135] At least one of the control unit 40 and the control unit 70 performs the processes shown in Figures 3, 10, and 13. When it is necessary to share information between the main body 3a and the base unit 7, the control unit 40 and the control unit 70 perform communication via the communication unit 42 and the communication unit 71.

[0136] Each aspect of the present invention may include the following modifications. The endoscope system 1a has an endoscope device having an insertion section 2. The control unit 70 is separated from the endoscope device.

[0137] In the first modification of the first embodiment, the endoscope system 1a can reduce inspection errors and increase inspection efficiency, similar to the first embodiment.

[0138] (Second modification of the first embodiment) A second modification of the first embodiment of the present invention will now be described. Figure 17 shows an example of the configuration of an endoscope system 1b according to the second modification of the first embodiment. Parts that are the same as those shown in Figure 1 will not be described. The same blocks as those shown in Figure 1 are assigned the same reference numerals as those shown in Figure 1.

[0139] The endoscope system 1b shown in Figure 17 comprises an insertion unit 2, a main body 3b, an insertion length detection unit 4, an optical adapter 5, and a base unit 7b. The insertion unit 2 and the main body 3b constitute the endoscope device. The main body 3b and the base unit 7b are connected by a cable 9.

[0140] The insertion section 2 shown in Figure 17 is the same as the insertion section 2 shown in Figure 1. The insertion length detection section 4 shown in Figure 17 is the same as the insertion length detection section 4 shown in Figure 1. The optical adapter 5 shown in Figure 17 is the same as the optical adapter 5 shown in Figure 1.

[0141] The main unit 3 shown in Figure 1 is changed to the main unit 3b shown in Figure 17. The main unit 3b has an image sensor drive unit 30, an LED drive unit 32, a motor 33, a curvature control unit 34, and an optical adapter identification unit 35. The base unit 7b has an image processing unit 31, a display unit 36, a memory 37, an operation unit 38, an external device interface 39, and a control unit 40.

[0142] Each aspect of the present invention may include the following modifications. The endoscope system 1b has an endoscope device having an insertion section 2. The control unit 40 is separated from the endoscope device.

[0143] In a second modification of the first embodiment, the endoscope system 1b can reduce inspection errors and increase inspection efficiency, similar to the first embodiment.

[0144] (Second embodiment) A second embodiment of the present invention will now be described. In the second embodiment, the endoscope system 1 shown in Figure 1 is used. The endoscope system 1a shown in Figure 16 or the endoscope system 1b shown in Figure 17 may be used instead.

[0145] In the second embodiment, the heat exchanger is inspected two or more times. For example, periodic inspections of the heat exchanger are performed every six months or every year. Figure 18 shows an example of the preparatory processes performed by the endoscope system 1 before the heat exchanger inspection is performed. The operation of the endoscope system 1 will be explained using Figure 18. The explanation of the same processes as shown in Figure 3 will be omitted.

[0146] Before the initial inspection begins, the inspection history, including the heat exchanger's unique information, is not stored in memory 37. During the initial inspection, the inspection history, including the unique information, is stored in memory 37, similar to the first embodiment. Before the second or subsequent inspections begin, the inspection history, including the unique information, is stored in memory 37.

[0147] In step S101, the control unit 40 reads inspection setting information, including unique information of the heat exchanger, from the memory 37. After step S101, the control unit 40 determines whether or not an inspection history containing unique information that matches the read unique information is stored in the memory 37 (step S120). Before the initial inspection is started, the control unit 40 determines that no inspection history containing unique information is stored in the memory 37. After the initial inspection is performed, an inspection history containing unique information is stored in the memory 37. If that unique information matches the unique information contained in the inspection setting information, the control unit 40 determines that an inspection history containing unique information is stored in the memory 37.

[0148] If the control unit 40 determines in step S120 that no inspection history containing unique information is stored in memory 37, step S102 is executed. If the control unit 40 determines in step S120 that no inspection history containing unique information is stored in memory 37, the control unit 40 reads the inspection history from memory 37 (step S121). The inspection history includes unique information, appearance images, inspection results, and device setting information.

[0149] After step S121, the control unit 40 identifies the object to be inspected based on the inspection setting information (step S122). The inspection setting information corresponds to the inspection information.

[0150] Step S122 will now be explained in detail. The inspection setting information includes information indicating the tube to be inspected. For example, the inspection setting information includes the number of the tube to be inspected. This number corresponds to the number assigned to each tube in step S105 when the initial inspection was performed. The control unit 40 identifies the tube to which the number corresponding to the number included in the inspection setting information has been assigned. That tube is to be inspected. Tubes to which the number not corresponding to the number included in the inspection setting information has not been assigned are not to be inspected.

[0151] Regardless of the inspection setting information, the control unit 40 may identify the inspection target based on the inspection history. For example, the control unit 40 may identify the folder containing the inspection result indicating NG and the corresponding tube as the inspection target.

[0152] After step S122, the control unit 40 superimposes color onto the tube in the external image according to the inspection result (step S123).

[0153] Step S123 is described in detail. The control unit 40 refers to the tube information stored in the memory 37. The tube information includes the position of each tube in the external image and the number of each tube. The control unit 40 obtains the position associated with the number of a tube that is not being inspected. The control unit 40 superimposes white on the tube at that position in the external image.

[0154] The control unit 40 refers to the inspection result associated with the number of the tube being inspected. The control unit 40 also obtains the position associated with that number from the tube information. The control unit 40 superimposes a color on the tube at that position in the appearance image according to the inspection result. When the inspection result indicates NG, the control unit 40 superimposes red on the tube in the appearance image. When no inspection result indicating NG is stored in the folder, and the value of the inspection target flag in the management table stored in memory 37 is 1, the control unit 40 superimposes blue on the tube in the appearance image.

[0155] After step S123, the control unit 40 outputs the external image to the display unit 36 ​​and displays the external image on the display unit 36 ​​(step S124).

[0156] After step S124, the control unit 40 updates the management table stored in memory 37 (step S125). When step S125 is executed, the preparation process shown in Figure 18 is completed.

[0157] Figure 19 shows an example of screen SC1 of the display unit 36 ​​in step S124. The control unit 40 displays the appearance image EI7 on screen SC1. In the appearance image EI7, tube TB2 is not the object of inspection, and white is superimposed on tube TB2. In the appearance image EI7, the inspection result for tube TB3 is NG, and red is superimposed on tube TB3. In the appearance image EI7, the inspection result for tube TB4 is not NG, and blue is superimposed on tube TB4.

[0158] Figure 20 shows an example of a management table. The control unit 40 updates the management table TL1 shown in Figure 8 and saves the management table TL2 shown in Figure 20 to memory 37. The control unit 40 changes the value of the inspection target flag associated with the number of a tube that is not to be inspected to 0. The control unit 40 also changes the inspection order associated with the number of a tube that is to be inspected.

[0159] Figures 21 and 22 show examples of examination processes performed by the endoscope system 1 after the preparation process has been completed. The operation of the endoscope system 1 will be explained using Figures 21 and 22. The explanation of processes that are the same as those shown in Figure 10 will be omitted.

[0160] After step S200, the control unit 40 reads the device setting information included in the examination history from the memory 37. The control unit 40 performs the settings of the endoscope system 1 based on the device setting information. For example, the control unit 40 sets the magnification of the image sensor 21 to the same magnification as the magnification of the image included in the device setting information. Alternatively, the control unit 40 sets the brightness of the LED 22 based on the brightness of the illumination included in the device setting information (step S220). Step S220 is not performed in the first examination. After step S220, step S201 is performed.

[0161] In step S201, the control unit 40 outputs the external image to the display unit 36 ​​and displays the external image on the display unit 36. Also in step S201, the control unit 40 makes the tube into which the insertion unit 2 is inserted blink in the external image.

[0162] Figure 23 shows an example of screen SC1 of the display unit 36 ​​in step S201. The control unit 40 displays the live image LI6 and the appearance image EI8 on screen SC1. The control unit 40 displays the insertion length IL1 on screen SC1. The insertion length IL1 is displayed in white. The insertion unit 2 is inserted into tube number 2. The control unit 40 makes tube TB5 number 2 blink in appearance image EI8. As a result, the control unit 40 displays insertion tube information indicating the tube into which the insertion unit 2 is inserted.

[0163] After step S203, the control unit 40 refers to the inspection results stored in the folder associated with the tube number identified in step S200. The control unit 40 determines whether or not an abnormality was detected in a previously performed inspection (step S221). If the inspection result indicates NG, the control unit 40 determines that an abnormality was detected. If no inspection results indicating NG are stored in the folder, the control unit 40 determines that no abnormality was detected.

[0164] If the control unit 40 determines in step S221 that no abnormality was detected, step S204 is executed. If the control unit 40 determines in step S221 that an abnormality was detected, the control unit 40 compares the current insertion length with the insertion length at which an abnormality was detected in a previously performed inspection. The current insertion length is indicated by the signal output from the sensor 41 of the insertion length detection unit 4. The insertion length at which an abnormality was detected is indicated by the insertion length information included in the inspection history (step S222).

[0165] After step S222, the control unit 40 determines whether the difference between the two insertion lengths is greater than -0.1m and less than 0.1m (step S223).

[0166] If the control unit 40 determines in step S223 that the above conditions are not met, step S222 is executed again. The current insertion length changes while the user is moving the insertion unit 2. If the control unit 40 determines in step S223 that the above conditions are met, the control unit 40 changes the color of the insertion length displayed on the display unit 36 ​​from white to yellow (step S224). The user can determine that the tip 20 is approaching the location of the abnormal part detected in a previously performed inspection.

[0167] After step S224, the control unit 40 reads abnormal images, which are images of abnormal parts detected in inspections performed in the past, from a folder associated with the tube number identified in step S200. The control unit 40 arranges the abnormal images and the live images generated by the image sensor 21 side by side, either horizontally or vertically. The control unit 40 outputs the abnormal images and the live images to the display unit 36 ​​and displays the abnormal images and the live images on the display unit 36 ​​(step S225).

[0168] Figure 24 shows an example of screen SC1 of the display unit 36 ​​in step S225. The control unit 40 displays the abnormal image AI1 and the live image LI7 on screen SC1. The control unit 40 displays the insertion length IL2 on screen SC1. The insertion length IL2 is displayed in yellow. The abnormal part AP1 is visible in the abnormal image AI1 and the live image LI7. The control unit 40 displays message MS4, which includes the insertion length stored in memory 37 along with the abnormal image AI1, on screen SC1. The control unit 40 may also display an appearance image on screen SC1 along with the abnormal image AI1 and the live image LI7.

[0169] After step S225, the control unit 40 determines whether the current insertion length matches the insertion length at which an abnormality was detected in a previously performed inspection (step S226).

[0170] If the control unit 40 determines in step S226 that the current insertion length is different from the insertion length at which an abnormality was detected in a previously performed inspection, step S226 is executed again. The current insertion length changes while the user is moving the insertion unit 2. If the control unit 40 determines in step S226 that the current insertion length matches the insertion length at which an abnormality was detected in a previously performed inspection, the control unit 40 changes the color of the insertion length displayed on the display unit 36 ​​from yellow to green (step S227).

[0171] After step S227, the control unit 40 outputs a message to the display unit 36 ​​indicating that the insertion unit 2 has reached the position where the abnormal part was detected, and displays the message on the display unit 36 ​​(step S228).

[0172] Figure 25 shows an example of screen SC1 of the display unit 36 ​​in step S228. The control unit 40 displays the abnormal image AI1 and the live image LI8 on screen SC1. The abnormal image AI1 shown in Figure 25 is the same as the abnormal image AI1 shown in Figure 24. The control unit 40 displays the insertion length IL3 on screen SC1. The insertion length IL3 is displayed in green. The abnormal part AP1 is visible in the abnormal image AI1 and the live image LI8. The control unit 40 displays message MS4 on screen SC1. The message MS4 shown in Figure 25 is the same as message MS4 shown in Figure 24. The control unit 40 displays message MS5 on screen SC1 indicating that the insertion unit 2 has reached the position where the abnormal part was detected. The control unit 40 may also display an appearance image on screen SC1 together with the abnormal image AI1 and the live image LI8.

[0173] After step S228, the control unit 40 acquires the image processed by the image processing unit 31 and saves the image to the memory 37. The image is saved to a folder associated with the tube number identified in step S200 and is included in the examination history (step S229).

[0174] If an abnormality different from one detected in a previously performed examination is found, the user inputs a command to acquire an abnormal image to the endoscope system 1 by operating the control unit 38. The control unit 40 receives the command and saves the abnormal image and insertion length information, which indicates the insertion length, to the memory 37. The insertion length is indicated by a signal output from the sensor 41 of the insertion length detection unit 4. The live image and insertion length information are saved in a folder associated with the tube number identified in step S200 and are included in the examination history (step S230).

[0175] After step S230, the control unit 40 changes the value of the termination flag associated with the tube number in the management table to 1 (step S231). After step S231, step S207 is performed.

[0176] In step S210, the control unit 40 outputs a message to the display unit 36 ​​indicating that the insertion unit 2 has been inserted into a tube that is not the object to be inspected, and displays the message on the display unit 36. Figure 26 shows an example of the screen SC1 of the display unit 36 ​​in step S210. The control unit 40 displays the live image LI9 and the appearance image EI9 on the screen SC1.

[0177] In the example shown in Figure 26, tube number 3 is not the object of inspection, and white is superimposed on it. In the example shown in Figure 26, the insertion unit 2 is inserted into tube number 3, and that tube blinks in the external image. Because the insertion unit 2 is inserted into a tube that is not the object of inspection, the control unit 40 displays message MS6 on screen SC1 as a warning. Message MS6 indicates that the tube into which the insertion unit 2 is inserted is not the object of inspection.

[0178] After the inspection process shown in Figures 21 and 22 is performed, the endoscope system 1 performs the information update process shown in Figure 13.

[0179] In step S305, the control unit 40 outputs information indicating the completion of the inspection to the display unit 36 ​​and displays that information on the display unit 36. Figure 27 shows an example of the screen SC1 of the display unit 36 ​​in step S305. The control unit 40 displays the live image LI10 and the appearance image EI10 on the screen SC1. In the appearance image EI10, tube number 4 blinks. The control unit 40 displays message MS7 on the screen SC1. Message MS7 indicates the completion of the inspection of tube number 4.

[0180] In step S308, the control unit 40 outputs the external image to the display unit 36 ​​and displays the external image on the display unit 36. Figure 28 shows an example of the screen SC1 of the display unit 36 ​​in step S308. The control unit 40 displays the live image LI11 and the external image EI11 on the screen SC1. In the external image EI11, orange is superimposed on tube number 2. The user can determine that an abnormality has been detected in tube number 2. In the external image EI11, yellow is superimposed on tube number 4. The user can determine that tube number 4 is not abnormal.

[0181] In the external image EI11, red is superimposed on tube number 11. The user can determine that an abnormality was detected in tube number 11 during a previous inspection. In the external image EI11, green is superimposed on tube number 5. The user can determine that tube number 5 is the next target for inspection. Therefore, the number of inspection errors in which the user inserts insertion part 2 into a tube that is not the target for inspection is reduced.

[0182] In each embodiment of the present invention, the control unit 40 identifies the object to be inspected in the appearance image based on two or more identification pieces of information and inspection information corresponding to two or more tubes in the appearance image (steps S307 and S122). In the above example, the two or more identification pieces of information are included in the tube information. In the above example, the inspection information corresponds to a management table or inspection setting information. The control unit 40 outputs the appearance image and the object to be inspected information to the display unit 36 ​​(steps S201, S308, and S124).

[0183] Each aspect of the present invention may include the following modifications. The control unit 40 acquires the image generated by the insertion unit 2 as an external image from the memory 37 (storage medium) (step S121).

[0184] Each aspect of the present invention may include the following modifications. The control unit 40 acquires unique information of the heat exchanger (step S101) and determines whether inspection information including the unique information is stored in the memory 37 (step S120). In the above example, the inspection information corresponds to the inspection history. After it is determined that the inspection information is not stored in the memory 37, the control unit 40 saves the inspection information including the unique information in the memory 37 (step S108).

[0185] Each aspect of the present invention may include the following modifications. The control unit 40 stores inspection information, including an external image and inspection result information, in the memory 37 (steps S108 and S206). The inspection result information indicates the result of an endoscopic examination of the tube associated with one of two or more pieces of identification information.

[0186] Each aspect of the present invention may include the following modifications. When it is determined that no examination information containing unique information is stored in the memory 37, the control unit 40 creates two or more folders in the memory 37 (step S107) and associates each of the two or more folders with one of two or more identification information (step S107). After the endoscopic examination is performed, the control unit 40 saves the examination result information in the folder associated with the identification information of the tube on which the endoscopic examination was performed (step S206).

[0187] Each aspect of the present invention may include the following modifications. The control unit 40 sets the display state of the inspection target information according to the inspection result information (steps S123, S301, and S302).

[0188] Each aspect of the present invention may include the following modifications. When it is determined that no inspection information containing unique information is stored in the memory 37, the control unit 40 outputs information to the display unit 36 ​​prompting the camera to photograph each end of two or more tubes in order to acquire an external image (step S102).

[0189] Each aspect of the present invention may include the following modifications. When it is determined that no inspection information containing unique information is stored in the memory 37, the control unit 40 identifies all of the two or more tubes as targets for inspection (step S110).

[0190] Each aspect of the present invention may include the following modifications. When it is determined that inspection information containing unique information is stored in the memory 37, the control unit 40 retrieves the inspection information from the memory 37 (step S121).

[0191] In the second embodiment, the heat exchanger is inspected two or more times. When each inspection is performed, the control unit 40 outputs an external image and information about the object being inspected to the display unit 36. As a result, the endoscope system 1 can reduce inspection errors and increase inspection efficiency.

[0192] The control unit 40 determines whether inspection information, including unique information of the heat exchanger, is stored in the memory 37. Before the first inspection is started, inspection information including unique information is not stored in the memory 37. Before the second or subsequent inspections are started, the inspection history including unique information is stored in the memory 37. The endoscope system 1 can determine the number of times the inspection has been performed.

[0193] When no examination information containing unique information is stored in memory 37, the control unit 40 identifies all of the two or more tubes as subjects for examination. When examination information containing unique information is stored in memory 37, the control unit 40 identifies the subjects for examination based on the examination information obtained from memory 37. The endoscopy system 1 can identify the subjects for examination according to the number of times the examination has been performed.

[0194] While preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments and their variations. Additions, omissions, substitutions, and other modifications are possible without departing from the spirit of the invention. Furthermore, the present invention is not limited by the foregoing description, but only by the scope of the appended claims. [Explanation of symbols]

[0195] 1,1a,1b Endoscopic System 2 Insertion part 3,3a,3b Main body 4. Insertion length detection unit 5 Optical Adapters 7,7b Base Unit 20 Tip 21 Image sensor 22 LED 23 Wire fixing part 30 Image sensor drive unit 31 Image Processing Unit 32 LED driver unit 33 Motor 34 Curve Control Unit 35 Optical adapter identification section 36 Display section 37 memory 38 Control section 39 External device interface 40,70 Control Unit 41 sensors 42,71 Communications Department 50 Optical Lenses 51 Identifier Storage Unit

Claims

1. An examination support system for assisting endoscopic examination of a heat exchanger having two or more tubes, An insertion unit that generates an image of the inside of at least one of the two or more tubes, A control unit, Obtain an external image which is an image of each end of the two or more tubes, or an image of a figure showing each of the two or more ends of the tubes. Identification information is assigned to each of the two or more tubes in the external image. Obtain inspection information that includes identification information of the tubes contained in the two or more tubes and that are to be inspected, Based on the two or more tubes in the aforementioned external image, the two or more identification pieces of information corresponding to them, and the inspection information, the object to be inspected in the external image is identified. Before the insertion portion is inserted into any one of the two or more tubes, or when the insertion portion is inserted into any one of the two or more tubes, a control unit outputs the external image and the inspection target information indicating the inspection target to a display, A testing support system that has the following features.

2. The control unit, By processing the image generated by the insertion part, the tube into which the insertion part is inserted is identified. It is determined whether the tube into which the insertion portion is inserted is the object to be inspected. The inspection support system according to claim 1.

3. When the control unit determines that the tube into which the insertion part is inserted is not the object to be inspected, the control unit outputs a warning to the display. The inspection support system according to claim 2.

4. The control unit, The system receives an instruction to select an examination mode corresponding to the endoscopic examination of the heat exchanger. After the aforementioned instruction is received, the aforementioned external image is acquired. The inspection support system according to claim 1.

5. The control unit, By processing the image generated by the insertion part, the tube into which the insertion part is inserted is identified. The insertion part outputs insertion tube information, indicating the tube into which the insertion part is inserted, to the display. The inspection support system according to claim 1.

6. The control unit acquires the image generated by the insertion unit as the external image from the insertion unit or storage medium. The inspection support system according to claim 1.

7. The control unit acquires an image generated by a different camera from the insertion unit from the camera as the external image. The inspection support system according to claim 1.

8. The control unit acquires the appearance image, which is an image of the graphic, from the storage medium. The inspection support system according to claim 1.

9. The control unit, The unique information of the heat exchanger is obtained, Determine whether the inspection information, including the aforementioned unique information, is stored in the storage medium. After it is determined that the inspection information is not stored in the storage medium, the inspection information, including the unique information, is saved to the storage medium. The inspection support system according to claim 1.

10. The control unit stores the inspection information, which includes the external image and inspection result information indicating the result of the endoscopic examination of the tube associated with one of the two or more pieces of identification information, on the storage medium. The inspection support system according to claim 9.

11. The control unit, When it is determined that the inspection information containing the aforementioned unique information is not stored in the storage medium, two or more folders are created within the storage medium. Each of the two or more folders is associated with one of the two or more identification pieces. After the endoscopic examination is performed, the examination result information is saved to a folder associated with the identification information of the tube in which the endoscopic examination was performed. The inspection support system according to claim 10.

12. The control unit sets the display state of the inspection target information according to the inspection result information. The inspection support system according to claim 10.

13. When it is determined that the inspection information including the unique information is not stored in the storage medium, the control unit outputs information to the display prompting the camera to photograph each of the two or more tubes' ends in order to acquire the external image. The inspection support system according to claim 9.

14. When it is determined that the inspection information including the unique information is not stored in the storage medium, the control unit identifies all of the two or more tubes as the objects to be inspected. The inspection support system according to claim 13.

15. When it is determined that the inspection information, including the unique information, is stored in the storage medium, the control unit retrieves the inspection information from the storage medium. The inspection support system according to claim 9.

16. The control unit, By processing the aforementioned external image, the two or more tubes are detected. Assign the aforementioned identification information to each of the two or more tubes detected from the external image. The inspection support system according to claim 1.

17. The control unit superimposes the inspection target information onto the appearance image. The inspection support system according to claim 1.

18. Endoscope device having the aforementioned insertion section and the aforementioned control section The inspection support system according to claim 1.

19. The endoscope device has the aforementioned insertion section, The control unit is separated from the endoscope device. The inspection support system according to claim 1.

20. An examination support method for assisting endoscopic examination of a heat exchanger having two or more tubes, The control unit, Obtain an external image which is an image of each end of the two or more tubes, or an image of a figure showing each of the two or more ends of the tubes. Identification information is assigned to each of the two or more tubes in the external image. Obtain inspection information that includes identification information of the tubes contained in the two or more tubes and that are to be inspected, Based on the two or more tubes in the aforementioned external image, the two or more identification pieces of information corresponding to them, and the inspection information, the object to be inspected in the external image is identified. Before the insertion unit that generates an image of the inside of at least one of the two or more tubes is inserted into any one of the two or more tubes, or when the insertion unit is inserted into any one of the two or more tubes, the external image and the inspection target information indicating the inspection target are output to the display. Testing support methods.

21. On the computer, The steps include obtaining an external image which is an image of each end of two or more tubes having a heat exchanger, or an image of a figure showing each of the two or more ends of the tubes, A step of assigning identification information to each of the two or more tubes in the appearance image, A step of obtaining inspection information that includes identification information of the tubes contained in the two or more tubes and that are to be inspected, A step of identifying the object to be inspected in the appearance image based on the two or more tubes in the appearance image, the two or more identification pieces of information corresponding to the two or more tubes in the appearance image, and the inspection information, Before the insertion unit that generates an image of the inside of at least one of the two or more tubes is inserted into any one of the two or more tubes, or when the insertion unit is inserted into any one of the two or more tubes, the step of outputting the external image and the inspection target information indicating the inspection target to a display, A program to execute.

Images