Inspection image display method, inspection support device, inspection support system, and program
The inspection support system addresses the reliance on user expertise by using past inspection data to prioritize and display abnormalities, enhancing the accuracy of flaw detection in industrial inspections.
Patent Information
- Application Number
- JP2022031000
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2021-09-08
- Filing Date
- 2022-03-01
- Publication Date
- 2025-11-12
- Estimated Expiration
- 2042-03-01
AI Technical Summary
Existing inspection systems rely on user knowledge and skills to recognize abnormalities, leading to potential oversight or misassessment of flaws during inspections, especially for inexperienced inspectors.
An inspection support system that displays inspection support information based on past inspection results, prioritizing abnormalities by their frequency and type, using an endoscope device to assist in capturing and displaying images with overlaid support information.
Reduces the likelihood of overlooking or misjudging abnormalities by providing guided inspection support through prioritized display of past inspection data and real-time imaging assistance.
Smart Images

Figure 0007768802000001 
Figure 0007768802000002 
Figure 0007768802000003
Abstract
Description
[Technical Field]
[0001] The present invention provides Inspection image display method , an inspection support device, an inspection support system, and a program. [Background technology]
[0002] Industrial endoscope devices are used to inspect the interior of boilers, pipes, aircraft engines, etc. for abnormalities and corrosion. A user uses the endoscope device to inspect an area within the inspection object. The user checks whether any abnormalities, such as scratches, have occurred in the inspection area during the inspection. To leave evidence of the inspection, images (still images or videos) of the inspection area are recorded. If an abnormality is found, information indicating the type and condition of the abnormality is also recorded.
[0003] The inspection target includes a large number of inspection sites, and the type and state of abnormalities vary depending on the inspection site. Therefore, the inspector needs knowledge and skills regarding the inspection perspective and the likelihood of abnormalities occurring in each inspection site. For example, if an inspector with little experience performs the inspection, there is a possibility that abnormalities will be overlooked.
[0004] The technology disclosed in Patent Document 1 provides a method for drawing a user's attention to an image. When a still image is recorded, the type and state of the abnormality are selected by the user. Information indicating the type and state selected by the user is recorded together with the still image. In addition, an inspection history table containing past inspection results is updated. When the amount of inspection results indicating an abnormality in the inspection target in the inspection history satisfies a predetermined condition, the user is drawn to the image. [Prior art documents] [Patent documents]
[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2018-166959 Summary of the Invention [Problem to be solved by the invention]
[0006] The technology disclosed in Patent Document 1 requires the inspector to recognize specific examples of abnormalities in the inspection object, and the correct inspection results are reflected in the inspection history table. If the inspector lacks knowledge or skills regarding abnormalities, there is a possibility that the inspector will overlook the abnormality or be unable to correctly determine the type of flaw.
[0007] The present invention can reduce the possibility that a user will miss or misassess an anomaly. Inspection image display method The present invention aims to provide an inspection support device, an inspection support system, and a program. [Means for solving the problem]
[0008] The present invention includes a receiving step in which a receiving unit receives inspection part information relating to an inspection part that constitutes at least a part of an inspection object; the number of abnormalities detected in the test site for each type of abnormality, an acquisition step of connecting to a storage medium that stores results and acquiring the results of the examination region corresponding to the examination region information from the storage medium; and a display control unit, based on the results acquired in the acquisition step, The aforementioned an inspection support step of displaying inspection support information on a display unit to notify a user of information related to an abnormality; and after the inspection support information is displayed, an imaging step of capturing an image of the examination site by an imaging element of an endoscope inserted into the examination object; The display control unit The aforementioned and an image display step of displaying an image on the display unit, wherein when two or more of the results are acquired in the acquisition step, the display control unit displays the examination assistance information on the display unit based on a predetermined priority in the examination assistance step, and the priority is determined based on the order of the number of abnormalities for each type of abnormality. The aforementioned This is an inspection image display method that is set according to the number of
[0011] In the inspection image display method of the present invention, the inspection support step includes the step of: The aforementioneda first inspection support step of displaying the inspection support information on the display unit based on the result; and after the first inspection support step is executed, the display control unit displays the inspection support information having a second priority lower than the first priority. The aforementioned and a second examination support step of displaying the examination support information on the display unit based on the result.
[0013] The present invention Inspection image display method In the inspection support step, the inspection support step includes a first inspection support step in which the display control unit displays the inspection support information on the display unit based on the results indicating the types of the abnormalities detected a first number of times, and a second inspection support step in which, after the first inspection support step is executed, the display control unit displays the inspection support information on the display unit based on the results indicating the types of the abnormalities detected a second number of times, which is smaller than the first number.
[0014] The present invention Inspection image display method The method further includes an information display step in which the display control unit displays the examination region information on the display unit before the receiving step is executed.
[0015] The present invention Inspection image display method In the information display step, the display control unit refers to an examination plan including the examination site information regarding the examination site to be examined, and displays the examination site information on the display unit based on the examination plan.
[0016] The present invention Inspection image display method In the information display step, the display control unit displays an image of the examination object on the display unit, and displays the examination region information on the image.
[0017] The present invention Inspection image display method In the method, the examination site information indicates a folder on the storage medium in which the results are saved, the folder is prepared for each examination site and is associated with the examination site, and in the acquisition step, the acquisition unit acquires the results of the examination site from the folder indicated by the examination site information.
[0018] The present invention Inspection image display method In the method, the inspection assistance information includes an image of the abnormality detected in a past inspection.
[0019] The present invention Inspection image display method In the test support information, the number of abnormalities for each type of abnormality is indicated.
[0020] The present invention Inspection image display method In the method, the inspection support information indicates the ratio of the number of abnormalities of each type detected in the inspection region to the total number of abnormalities previously detected in the inspection region.
[0021] The present invention Inspection image display method In the acquiring step, the acquiring unit acquires the results of an inspection previously performed on the same object as the inspection target or an object of the same type as the inspection target.
[0022] The present invention Inspection image display method In the acquisition step, the acquisition unit searches for the results of the inspection area on an object of the same type as the inspection target, and if the results of the inspection area cannot be acquired, the acquisition unit acquires the results of the inspection area on an object of the same type as the inspection target in the acquisition step.
[0023] The present invention Inspection image display method In the examination support step, the display control unit displays one of two or more images of the examination region that are successively generated on the display unit.
[0024] In the examination image display method of the present invention, after the examination assistance information is displayed, The aforementioned When movement of the insertion portion of the endoscope is detected, the display control unit hides the examination assistance information or reduces the area of the examination assistance information displayed on the display unit.
[0025] Inspection image display method of the present invention further comprising a second imaging step of capturing a second image of the examination region by the imaging element, and a second image display step of the display control unit displaying the second image on the display unit, The display control unit displays the examination assistance information in the examination assistance step. The second After the inspection assistance information is displayed on the image, The aforementioned When a movement of the insertion portion of the endoscope is detected, the display control unit changes the transmittance of the examination assistance information.
[0026] The present invention includes a receiving unit that receives inspection region information relating to an inspection region that constitutes at least a part of an inspection object, and a past inspection the number of abnormalities detected in the test site for each type of abnormality, an acquisition unit that is connected to a storage medium that stores the results and acquires the results of the examination region corresponding to the examination region information from the storage medium; and The aforementioned an inspection support unit that displays inspection support information on a display unit to notify a user of information related to an abnormality; and an endoscope that is inserted into the object to be examined and has an imaging element that captures an image of the examination site; of the inspection site The aforementioned and an image display unit that displays an image on the display unit, and when two or more of the results are obtained, the examination support unit displays the examination support information on the display unit based on a predetermined priority, and the priority is determined based on the number of abnormalities for each type of abnormality. The aforementioned This is an inspection support device that can be set according to the number of patients.
[0027] The present invention includes an examination support device and a server, the examination support device including a receiving unit that receives examination region information relating to an examination region that constitutes at least a part of an examination target, and a receiving unit that transmits the examination region information to the server and receives past examinations of the examination region. the number of abnormalities detected in the test site for each type of abnormality, a first communication unit that receives a result from the server; and based on the result received by the first communication unit, The aforementioned an inspection support unit that displays inspection support information on a display unit to notify a user of information related to an abnormality; and an endoscope that is inserted into the object to be examined and has an imaging element that captures an image of the examination site; of the inspection site The aforementioned and an image display unit that displays an image on the display unit, and when two or more of the results are received, the examination support unit displays the examination support information on the display unit based on a predetermined priority, and the priority is determined based on the number of abnormalities for each type of abnormality. The aforementionedThe server is configured according to the number of past inspections. The aforementioned The testing support system has an acquisition unit that is connected to a storage medium that stores results and acquires the results of the testing area corresponding to the testing area information from the storage medium, and a second communication unit that receives the testing area information from the testing support device and transmits the results acquired by the acquisition unit to the testing support device.
[0028] The present invention includes a receiving step of receiving inspection part information relating to an inspection part that constitutes at least a part of an inspection object, and a step of receiving inspection part information relating to a past inspection the number of abnormalities detected in the test site for each type of abnormality, an acquisition step of connecting to a storage medium that stores results and acquiring the results of the inspection site corresponding to the inspection site information from the storage medium; and The aforementioned an inspection support step of displaying inspection support information on a display unit to notify a user of information related to an abnormality; and after the inspection support information is displayed, an imaging step of capturing an image of the examination site by an imaging element of an endoscope inserted into the examination object; of the inspection site The aforementioned an image display step of displaying an image on the display unit, wherein, when two or more of the results are acquired in the acquisition step, the inspection assistance information is displayed on the display unit based on a preset priority, and the priority is determined based on the order of the number of abnormalities for each type of abnormality. The aforementioned It is a program that is set according to the number. [Effects of the Invention]
[0029] According to the present invention, Inspection image display method The inspection support device, inspection support system, and program can reduce the possibility that a user will overlook an abnormality or make an incorrect evaluation of the abnormality. [Brief explanation of the drawings]
[0030] [Figure 1] 1 is a block diagram showing a configuration of an inspection system according to a first embodiment of the present invention. [Figure 2]1 is a perspective view of an endoscope apparatus according to a first embodiment of the present invention. [Figure 3] 1 is a block diagram showing the configuration of an endoscope apparatus and a server according to a first embodiment of the present invention. [Figure 4] 2 is a block diagram showing the configuration of a control unit included in the endoscope device according to the first embodiment of the present invention. FIG. [Figure 5] 2 is a block diagram showing the configuration of a control unit included in the server according to the first embodiment of the present invention. FIG. [Figure 6] 5 is a flowchart showing the procedure of processing executed by the endoscope device according to the first embodiment of the present invention. [Figure 7] 5 is a flowchart showing a procedure of a process executed by a server according to the first embodiment of the present invention. [Figure 8] 3A and 3B are diagrams showing examples of examination support information displayed on a display unit of the endoscope apparatus according to the first embodiment of the present invention. [Figure 9] 3A and 3B are diagrams showing examples of examination support information displayed on a display unit of the endoscope apparatus according to the first embodiment of the present invention. [Figure 10] 3A and 3B are diagrams showing examples of examination support information displayed on a display unit of the endoscope apparatus according to the first embodiment of the present invention. [Figure 11] 3A and 3B are diagrams showing examples of examination support information displayed on a display unit of the endoscope apparatus according to the first embodiment of the present invention. [Figure 12] 3A and 3B are diagrams showing examples of examination support information displayed on a display unit of the endoscope apparatus according to the first embodiment of the present invention. [Figure 13] 3A and 3B are diagrams showing examples of examination support information displayed on a display unit of the endoscope apparatus according to the first embodiment of the present invention. [Figure 14] 3A and 3B are diagrams showing examples of examination support information displayed on a display unit of the endoscope apparatus according to the first embodiment of the present invention. [Figure 15] 6 is a flowchart showing the procedure of processing executed by the endoscope apparatus according to the first modified example of the first embodiment of the present invention. [Figure 16]FIG. 10 is a diagram showing an example of an information button displayed on a display unit included in the endoscope device according to the first modified example of the first embodiment of the present invention. [Figure 17] 10 is a flowchart showing the procedure of processing executed by the endoscope apparatus according to the second modified example of the first embodiment of the present invention. [Figure 18] FIG. 10 is a diagram showing an example of examination support information displayed on a display unit of an endoscope apparatus according to a second modified example of the first embodiment of the present invention. [Figure 19] FIG. 10 is a diagram showing an example of the structure of an examination folder in a third modified example of the first embodiment of the present invention. [Figure 20] 10 is a flowchart showing the procedure of processing executed by an endoscope apparatus according to a third modified example of the first embodiment of the present invention. [Figure 21] 10A and 10B are diagrams showing an example of changes in examination folder information displayed on a display unit of an endoscope device in a third modified example of the first embodiment of the present invention. [Figure 22] 10 is a flowchart showing the procedure of processing executed by an endoscope apparatus according to a fourth modified example of the first embodiment of the present invention. [Figure 23] FIG. 10 is a diagram showing an example of an image displayed on a display unit included in an endoscope device according to a fourth modified example of the first embodiment of the present invention. [Figure 24] 10 is a flowchart showing the procedure of processing executed by an endoscope apparatus according to a fifth modified example of the first embodiment of the present invention. [Figure 25] FIG. 10 is a diagram showing an example of an image displayed on a display unit included in an endoscope device according to a fifth modified example of the first embodiment of the present invention. [Figure 26] 10 is a flowchart showing the procedure of processing executed by an endoscope apparatus according to a sixth modified example of the first embodiment of the present invention. [Figure 27] FIG. 4 is a block diagram showing the configuration of an endoscope apparatus according to a second embodiment of the present invention. [Figure 28] FIG. 10 is a block diagram showing the configuration of a control unit included in an endoscope apparatus according to a second embodiment of the present invention. [Figure 29]10 is a flowchart showing the procedure of processing executed by an endoscope apparatus according to a second embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION
[0031] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In each embodiment of the present invention, an inspection object is an industrial product. The inspection object has one or more inspection parts. For example, if the inspection object is an airplane engine, the inspection part may be a combustion tube or a high-pressure turbine. The inspection part may be the entire inspection object. Below, an example will be described in which the abnormality is a flaw. For example, the flaw may be a crack, a dent, or a chip.
[0032] (First embodiment) A first embodiment of the present invention will be described. Fig. 1 shows the configuration of an inspection system 100 according to the first embodiment. The inspection system 100 shown in Fig. 1 includes an endoscope device 1 and a server 8. The endoscope device 1 and the server 8 communicate with each other. For example, the server 8 is a cloud server.
[0033] 2 shows the appearance of the endoscope device 1. The endoscope device 1 shown in FIG.
[0034] The insertion section 2 constitutes an endoscope. The insertion section 2 is inserted into the interior of the object to be examined. A tip section 20 is disposed at the tip of the insertion section 2. The insertion section 2 is a long, thin tube that is bendable from the tip section 20 to the base end. An optical adapter 10 is attached to the tip section 20. A bending section 21 is disposed on the base end side of the tip section 20. The bending section 21 can be bent in a predetermined direction. The base end of the insertion section 2 is connected to the operation section 4.
[0035] The operation unit 4 is connected to the main body 3 by a cable 6. The operation unit 4 has various buttons including a freeze button and a record button, and various joysticks including a curvature joystick.
[0036] The user operates the freeze button to input a still image acquisition instruction to the endoscope device 1 to acquire a still image. The user operates the record button to input a still image recording instruction to record the acquired still image to the endoscope device 1. The user operates the bending joystick to input a bending instruction to bend the bending section 21 to the endoscope device 1. The user operates buttons and the like on the operation unit 4 to input various information to the endoscope device 1. The operation unit 4 outputs the instructions or information input by the user to the main body unit 3. The insertion unit 2 and the operation unit 4 constitute a scope 7.
[0037] The display unit 5 is disposed on the surface of the main body 3. The display unit 5 is a monitor (display) such as an LCD (Liquid Crystal Display). The display unit 5 may be a touch panel. When the display unit 5 is configured as a touch panel, the user touches the screen of the display unit 5 using a part of the body (for example, a finger) or a tool.
[0038] 3 shows the configuration of the endoscope device 1 and the server 8. The configuration of the scope 7 and the main body 3 of the endoscope device 1 is shown in FIG.
[0039] The scope 7 has an operation unit 4, an image sensor 51, and an LED 52. The image sensor 51 and the LED 52 are arranged at the tip 20. The image sensor 51 is an image sensor such as a CCD sensor or a CMOS sensor. The image sensor 51 continuously generates two or more images (frames). The two or more images form a video. The image sensor 51 outputs each generated image to the main body 3. When a still image acquisition instruction is output from the main body 3, the image sensor 51 generates a still image and outputs the generated still image to the main body 3. The LED 52 generates illumination light. The illumination light generated by the LED 52 is irradiated onto the subject.
[0040] The main body 3 has a display unit 5, a memory card 11, a control unit 31, a ROM 32, a RAM 33, I / Fs 35 to 41, a touch panel 42, a connector 43, and a communication unit 44. The control unit 31, the ROM 32, the RAM 33, and the I / Fs 35 to 41 are connected to one another via a bus 34. Each of the I / Fs 35 to 41 is an interface.
[0041] The control unit 31 controls each unit of the endoscope device 1. The control unit 31 is configured with at least one of a processor and a logic circuit. For example, the processor is at least one of a CPU (Central Processing Unit), a DSP (Digital Signal Processor), and a GPU (Graphics Processing Unit). For example, the logic circuit is at least one of an ASIC (Application Specific Integrated Circuit) and an FPGA (Field-Programmable Gate Array). The control unit 31 may include one or more processors. The control unit 31 may include one or more logic circuits.
[0042] The computer of the endoscope device 1 may load and execute a program. The program includes instructions that define the operation of the control unit 31. In other words, the functions of the control unit 31 may be realized by software.
[0043] The above program may be provided by a "computer-readable recording medium" such as a flash memory. The program may be transmitted from a computer storing the program to the endoscope device 1 via a transmission medium or by transmission waves in the transmission medium. A "transmission medium" that transmits the program is a medium that has the function of transmitting information. Media that have the function of transmitting information include networks (communication networks) such as the Internet and communication lines (communication lines) such as telephone lines. The above program may realize some of the functions described above. Furthermore, the above program may be a difference file (difference program). The functions described above may be realized by combining a program already recorded on a computer with a difference program.
[0044] The ROM 32 stores the above programs. The RAM 33 temporarily stores information and data processed by the control unit 31. The I / F 35 transmits a drive signal to the image sensor 51 and receives an image output from the image sensor 51. The I / F 36 transmits a drive signal to the LED 52.
[0045] The I / F 37 receives instructions or information output from the operation unit 4. The I / F 38 outputs a drive signal to the touch panel 42 and receives a signal output from the touch panel 42. The touch panel 42 is incorporated into the screen of the display unit 5. The I / F 39 outputs an image received by the I / F 35 to the display unit 5. A display unit disposed outside the endoscope device 1 may be used instead of the display unit 5. The I / F 40 is connected to the memory card 11 via a connector 43. The I / F 40 records an image received by the I / F 35 on the memory card 11 and reads the image from the memory card 11. When a still image recording instruction is output from the control unit 31, the I / F 40 records the still image on the memory card 11. The memory card 11 is detachably attached to the connector 43.
[0046] The I / F 41 is connected to the communication unit 44. The communication unit 44 is a communication device having a communication circuit. For example, the communication unit 44 is a wireless communication device. The communication unit 44 communicates with the server 8.
[0047] The server 8 has a communication unit 81, a control unit 82, and an examination result storage unit 83. The communication unit 81 is a communication device having a communication circuit. For example, the communication unit 81 is a wireless communication device. The communication unit 81 communicates with the endoscope device 1.
[0048] The control unit 82 controls each unit of the server 8. The control unit 82 is configured with at least one of a processor and a logic circuit. The control unit 82 may include one or more processors. The control unit 82 may include one or more logic circuits.
[0049] The computer of the server 8 may load a program and execute the loaded program. The program includes instructions that define the operation of the control unit 82. In other words, the functions of the control unit 82 may be realized by software. The program may be realized in the same way as the program that realizes the functions of the control unit 31.
[0050] The test result storage unit 83 stores test result information indicating the test results. The test result storage unit 83 is a non-volatile recording medium. For example, the test result storage unit 83 is at least one of an SRAM (Static Random Access Memory), an EPROM (Erasable Programmable Read-Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), and a flash memory.
[0051] 4 shows the configuration of the control unit 31. The control unit 31 has a device control unit 310, a reception unit 311, a display control unit 312, and a communication control unit 313. The device control unit 310 controls each unit of the endoscope device 1.
[0052] The reception unit 311 receives instructions or information input by the user via the operation unit 4. When the user operates the freeze button on the operation unit 4, the reception unit 311 receives a still image acquisition instruction and outputs the still image acquisition instruction to the image sensor 51. When the user operates the record button on the operation unit 4, the reception unit 311 receives a still image recording instruction and outputs the still image recording instruction to the I / F 40.
[0053] Still images acquired during an examination are recorded in an examination folder in the memory card 11. An examination folder is prepared for each examination region. The user operates the joystick of the operation unit 4 to input examination folder information indicating the examination folder into the endoscope device 1. This allows the user to select the examination folder in which the still images will be recorded. When the user inputs the examination folder information, the reception unit 311 accepts the examination folder information. Since the examination folder and the examination region are associated with each other, the examination folder information indicates the examination region.
[0054] The display control unit 312 outputs the image received by the I / F 35 to the display unit 5 via the I / F 39. As a result, the display control unit 312 displays the image on the display unit 5.
[0055] As will be described later, test result information is received from the server 8. The test result information indicates past test results for the test area corresponding to the test folder information. The display control unit 312 outputs the test result information as test assistance information to the display unit 5 via the I / F 39. Alternatively, the display control unit 312 outputs test assistance information generated based on the test result information to the display unit 5 via the I / F 39. As a result, the display control unit 312 displays the test assistance information on the display unit 5. The test assistance information notifies the user of information regarding abnormalities in the test area detected in past tests. For example, the test assistance information is an image of the test area. The test assistance information may also include information regarding the condition of abnormalities discovered in past tests.
[0056] For example, the image of the examination site is a two-dimensional image (2D image) generated by the imaging element 51. The image of the examination site may be a three-dimensional image (3D image) generated by using the 2D image.
[0057] The communication control unit 313 controls the communication unit 44 via the I / F 41 and communicates with the server 8. The communication control unit 313 uses the communication unit 44 to transmit examination folder information to the server 8. The communication control unit 313 also uses the communication unit 44 to receive examination result information from the server 8. The communication control unit 313 may also use the communication unit 44 to transmit images such as still images to the server 8.
[0058] 5 shows the configuration of the control unit 82. The control unit 82 has a server control unit 820, an examination region detection unit 821, an examination result acquisition unit 822, and a communication control unit 823.
[0059] The server control unit 820 controls each unit of the server 8. The examination part detection unit 821 detects the examination part corresponding to the examination folder indicated by the examination folder information. The examination result acquisition unit 822 acquires the examination result information of the examination part detected by the examination part detection unit 821 from the examination result storage unit 83.
[0060] The communication control unit 823 controls the communication unit 81 and communicates with the endoscope device 1. The communication control unit 823 receives examination folder information from the endoscope device 1 by using the communication unit 81. The communication control unit 823 also transmits examination result information to the endoscope device 1 by using the communication unit 81. The communication control unit 823 may receive images, such as still images, from the endoscope device 1 by using the communication unit 81. The received images may be recorded in the examination result storage unit 83.
[0061] The processing executed by the endoscope device 1 will be described with reference to Fig. 6. Fig. 6 shows the procedure of the processing executed by the endoscope device 1.
[0062] The image sensor 51 continuously generates images (frames). The display control unit 312 outputs the images generated by the image sensor 51 to the display unit 5 via the I / F 39. The display unit 5 continuously displays the images, thereby displaying a live image of the subject. The process for generating and displaying the image of the subject is executed in parallel with the process shown in FIG. 6.
[0063] Before or when the examination is started, the user operates the joystick of the operation unit 4 to input examination folder information to the endoscope device 1. The reception unit 311 receives the examination folder information (step S100).
[0064] After step S100, the communication control unit 313 outputs the examination folder information to the communication unit 44 via the I / F 41, and transmits the examination folder information to the server 8 (step S101).
[0065] After step S101, the communication control unit 313 receives the test result information or an error notification from the server 8 by using the communication unit 44 (step S102).
[0066] If the examination result information of the examination part corresponding to the examination folder information is recorded in the examination result storage unit 83 of the server 8, the server 8 transmits the examination result information to the endoscope device 1. The examination result information is received in step S102. If the examination result information of the examination part corresponding to the examination folder information is not recorded in the examination result storage unit 83 of the server 8, the server 8 transmits an error notification to the endoscope device 1. In this case, the error notification is received in step S102.
[0067] After step S102, device control unit 310 determines whether test result information has been received (step S103). If an error notification is received in step S102, device control unit 310 determines that test result information has not been received. If test result information is received in step S102, device control unit 310 determines that test result information has been received.
[0068] If the device control unit 310 determines in step S103 that the test result information has not been received, step S105, which will be described later, is executed. If the device control unit 310 determines in step S103 that the test result information has been received, the display control unit 312 outputs the test result information as test assistance information to the display unit 5 via the I / F 39. Alternatively, the display control unit 312 generates test assistance information based on the test result information and outputs the test assistance information to the display unit 5 via the I / F 39. As a result, the display control unit 312 displays the test assistance information on the display unit 5 (step S104).
[0069] The examination support information is displayed on the display unit 5 before the examination of the examination area to be examined is carried out. By checking the examination support information, the user can recognize the type and condition of any flaws that have been previously detected in the examination area. The user can carry out the examination while being aware of the type and condition of the flaws. This reduces the possibility that the user will overlook an abnormality or make an incorrect evaluation of an abnormality.
[0070] Thereafter, the user checks the live image displayed on the display unit 5 and moves the tip 20 of the insertion unit 2 to the examination site. The user operates the freeze button on the operation unit 4 to acquire a still image. At this time, the reception unit 311 receives a still image acquisition instruction and outputs the still image acquisition instruction to the image sensor 51. The image sensor 51 generates a still image and outputs the generated still image to the main body unit 3. The I / F 35 receives the still image and outputs it to the control unit 31. The display control unit 312 outputs the still image to the display unit 5 via the I / F 39. The display unit 5 displays the still image (step S105).
[0071] After the still image is displayed, the user operates the operation unit 4 to input the type and rank of the wound into the endoscope device 1. The reception unit 311 receives the type and rank of the wound (step S106).
[0072] For example, the user selects the type of damage from a list registered in advance. The damage rank indicates the condition (severity) of the damage. For example, the damage rank can be one of "Accept", "Replacement required", "Repair required", and "Re-inspection required". "No Mark" may also be specified as the damage rank.
[0073] After step S106, the device control unit 310 records the still image on the memory card 11 via the I / F 40 (step S107). At this time, the still image is recorded in the examination folder indicated by the examination folder information. When step S107 is executed, the process shown in FIG. 6 ends.
[0074] The file name of a still image recorded on the memory card 11 includes a folder name, a serial number, and a file mark. For example, the file format of a still image is JPEG. The type of scratch is included in the EXIF information.
[0075] The folder name is the name of the folder in which the still image is recorded. The sequential number is the number following the last number contained in the file name of a still image recorded in that folder. The file mark is a character that indicates the rank of the damage. For example, the file mark corresponding to "Accept" is "A". The file mark corresponding to "Reject" is "B". The file mark corresponding to "Repair" is "C". The file mark corresponding to "Re-Inspect" is "D". The file mark corresponding to "No Mark" is "X". If "No Mark" is specified as the rank of damage, a file name that does not include a file mark may be used.
[0076] For example, the folder name is "HPC_STAGE1_ZONE." A still image whose file name includes the number 00005 is recorded in a folder with that folder name. For example, the file mark "A" is selected. In this case, the file name of the still image is "HPC_STAGE1_ZONE_00006_A.JPG."
[0077] 6 is completed, the device control unit 310 generates inspection result information indicating the inspection results. For example, the inspection result information includes the still image displayed on the display unit 5 in step S105. The inspection result information may also include information indicating the type and rank of the scratch. The communication control unit 313 outputs the inspection result information to the communication unit 44 via the I / F 41, and transmits the inspection result information to the server 8.
[0078] The process executed by the server 8 will be described with reference to Fig. 7. Fig. 7 shows the procedure of the process executed by the server 8.
[0079] The communication control unit 823 receives the examination folder information from the endoscope device 1 by using the communication unit 81 (step S200).
[0080] After step S200, the examination part detection unit 821 detects an examination part based on the examination folder information received in step S200 (step S201). An examination folder is prepared for each examination part and is associated with the examination part. The relationship between the examination folder and the examination part is set in advance. For example, the examination result storage unit 83 stores information indicating this relationship. In step S201, the examination part detection unit 821 detects an examination part associated with the examination folder indicated by the examination folder information.
[0081] After step S201, the test result acquisition unit 822 searches for test result information of the test region detected in step S201 in the test result storage unit 83. Based on the search result, the test result acquisition unit 822 determines whether or not there is past test result information of the test region (step S202).
[0082] If the test result information of the test site detected in step S201 is stored in the test result storage unit 83, the test result acquisition unit 822 determines that there is past test result information of the test site. If the test result information of the test site detected in step S201 is not stored in the test result storage unit 83, the test result acquisition unit 822 determines that there is no past test result information of the test site.
[0083] If the examination result acquiring unit 822 determines in step S202 that there is past examination result information for the examination region, the examination result acquiring unit 822 acquires the examination result information from the examination result storage unit 83 (step S203).
[0084] After step S203, the communication control unit 823 transmits the examination result information acquired in step S203 to the endoscope device 1 by using the communication unit 81. If the examination result acquisition unit 822 determines in step S202 that there is no past examination result information for the examination region, the communication control unit 823 transmits an error notification to the endoscope device 1 by using the communication unit 81 (step S204). When step S204 is executed, the processing shown in FIG. 7 ends.
[0085] The examination site may be changed. For example, the distal end 20 of the insertion unit 2 is placed at a first position, and an examination of the first examination site is performed. After the examination of the first examination site is performed, the distal end 20 of the insertion unit 2 is placed at a second position, and an examination of the second examination site is performed. The second position is different from the first position, and the second examination site is different from the first examination site.
[0086] An image of the second examination site may be pre-recorded on the memory card 11. Alternatively, the communication control unit 313 may receive the image of the second examination site from the server 8 using the communication unit 44. The device control unit 310 may perform image processing to compare the image generated by the imaging element 51 with the image of the second examination site. When the image generated by the imaging element 51 and the image of the second examination site are similar, the device control unit 310 may determine that the second examination site is included in the image. This allows the device control unit 310 to detect that the tip portion 20 of the insertion unit 2 has been placed at the second position. At this time, the display control unit 312 may display examination support information related to the second examination site on the display unit 5.
[0087] Another example in which the device control section 310 detects that the distal end portion 20 of the insertion section 2 is placed in the second position will be described.
[0088] The tip portion 20 of the insertion section 2 may have a gravity sensor. The gravity sensor detects the direction of gravity acting on the tip portion 20. Because the gravity sensor is fixed to the tip portion 20, the relative orientation of the gravity sensor with respect to the tip portion 20 does not change. When the orientation of the tip portion 20 with respect to the direction of gravity changes, the direction of gravity detected by the gravity sensor changes. Therefore, the device control section 310 can detect the moving direction of the tip portion 20.
[0089] Two rollers may be arranged to sandwich the base end of the insertion portion 2, and a rotary encoder may also be arranged between them. The two rollers are in contact with the insertion portion 2. When the insertion portion 2 moves, the two rollers rotate. The rotary encoder detects the amount of rotation of at least one of the two rollers, thereby detecting the length of the portion of the insertion portion 2 inserted into the test subject (insertion length). The rotary encoder outputs information on the detected insertion length to the device control unit 310.
[0090] The route information may be pre-recorded in the memory card 11. The route information indicates the route to each examination site to be examined. The communication control unit 313 may receive the route information from the server 8 by using the communication unit 44.
[0091] The device control unit 310 calculates the position of the tip portion 20 based on the moving direction of the tip portion 20 and the insertion length of the insertion unit 2. When the position of the tip portion 20 reaches the position of the second examination region indicated by the path information, the device control unit 310 determines that the tip portion 20 has been placed at the second position. At this time, the display control unit 312 may display examination support information related to the second examination region on the display unit 5.
[0092] Examples of the examination support information will be described using Figures 8 to 14. Figures 8 to 14 show examples of the examination support information displayed on the display unit 5 in step S104.
[0093] 8 shows examination support information INF10 and a live image IMG10 displayed on the display unit 5. The live image IMG10 is displayed on the display unit 5, and the examination support information INF10 is displayed on top of the live image IMG10. The examination support information INF10 is an image of an examination site having a flaw. The examination support information INF10 overlaps with the live image IMG10, hiding part of the live image IMG10.
[0094] The inspection support information INF10 may be a reference image. The reference image is an image of a flaw model. For example, CAD data of the inspection site is processed, and a flaw is added to the inspection site. The reference image is generated by converting the processed data into a 2D or 3D image.
[0095] 9 shows examination support information INF11 displayed on the display unit 5. The examination support information INF11 is an image of an examination site having a flaw. The examination support information INF11 is displayed on the entire screen of the display unit 5.
[0096] FIG. 10 shows inspection support information INF12 and a live image IMG10 displayed on the display unit 5. The live image IMG10 is displayed on the display unit 5, and the inspection support information INF12 is displayed on top of the live image IMG10. The inspection support information INF12 includes text indicating the type and rank of the flaw. The inspection support information INF12 overlaps with the live image IMG10, obscuring part of the live image IMG10. The inspection support information INF12 may be displayed over the entire screen of the display unit 5.
[0097] FIG. 11 shows examination support information INF13 and a live image IMG10 displayed on the display unit 5. The live image IMG10 is displayed on the display unit 5, and the examination support information INF13 is displayed on top of the live image IMG10. The examination support information INF13 includes an image of the examination area having a flaw and text indicating the type and rank of the flaw. The examination support information INF13 overlaps with the live image IMG10, obscuring part of the live image IMG10. The examination support information INF13 may be displayed over the entire screen of the display unit 5.
[0098] FIG. 12 shows inspection support information INF14 and a live image IMG10 displayed on the display unit 5. The live image IMG10 is displayed on the display unit 5, and the inspection support information INF14 is displayed on the live image IMG10. The inspection support information INF14 indicates the incidence of each type of flaw previously detected in the inspection area. The incidence indicates the ratio of the number of each type of flaw to the total number of flaws previously detected in the inspection area. The inspection support information INF14 may also indicate the number of each type of flaw previously detected in the inspection area. The incidence indicates the number of each type of flaw previously detected in the inspection area. The inspection support information INF14 overlaps with the live image IMG10 and obscures part of the live image IMG10. The inspection support information INF14 may also be displayed on the entire screen of the display unit 5.
[0099] When the inspection result information transmitted from the endoscope device 1 is stored in the inspection result storage unit 83 of the server 8, the server control unit 820 may calculate the incidence rate of each type of wound or the number of occurrences of each type of wound based on the inspection result information stored in the inspection result storage unit 83. The server control unit 820 may store the calculated incidence rate or number of occurrences in the inspection result storage unit 83. In step S203, the inspection result acquisition unit 822 may acquire the incidence rate or number of occurrences from the inspection result storage unit 83 as inspection result information.
[0100] When the test result acquisition unit 822 acquires the test result information from the test result storage unit 83 in step S203, the server control unit 820 may calculate the incidence rate or the number of occurrences of each type of wound based on the test result information. The communication control unit 823 may transmit the incidence rate or the number of occurrences to the endoscope device 1 as test result information in step S204.
[0101] FIG. 13 shows examination support information INF15 and a live image IMG10 displayed on the display unit 5. The live image IMG10 is displayed on the display unit 5, and the examination support information INF15 is displayed on top of the live image IMG10. The examination support information INF15 includes an image of the examination area having a flaw, information indicating the position of the measurement target, and information indicating the measurement results. The examination support information INF15 overlaps with the live image IMG10 and hides part of the live image IMG10. The examination support information INF15 may be displayed over the entire screen of the display unit 5.
[0102] The examination support information INF15 includes an arrow AR10 and a measurement value MSR10. The arrow AR10 indicates the position of a flaw (measurement target) previously detected in the examination area. The measurement value MSR10 indicates the measurement result of the size (length or depth) of the flaw. When the still image is recorded on the memory card 11, the arrow AR10 and the measurement value MSR10 are added to the examination support information INF15 by the user. Alternatively, after the still image is recorded on the memory card 11, the arrow AR10 and the measurement value MSR10 are added to the examination support information INF15 by the user at any time.
[0103] Two or more flaws may be of the same or similar type or rank. The flaw measurement values are displayed as inspection support information, allowing the user to determine the importance of two or more flaws by referring to the measurement values.
[0104] FIG. 14 shows examination support information INF16 and a live image IMG10 displayed on the display unit 5. The live image IMG10 is displayed on the display unit 5, and the examination support information INF16 is displayed on top of the live image IMG10. The examination support information INF16 includes an image of the examination area having a flaw and a message regarding the flaw. The examination support information INF16 overlaps with the live image IMG10, hiding part of the live image IMG10. The examination support information INF16 may be displayed over the entire screen of the display unit 5.
[0105] The inspection support information INF16 includes a message MSG10. The message MSG10 includes a character string indicating the flaw with the highest occurrence rate or number of occurrences. In other words, the message MSG10 includes a character string indicating the tendency of flaws to occur. In the example shown in FIG. 14, the occurrence rate or number of cracks is the highest. The message MSG10 also includes a character string indicating the location of the flaw. In the example shown in FIG. 14, the flaw is located in the center of the inspection area.
[0106] Message MSG10 relates to a crack in the center of the inspection area. The message displayed on display 5 may also indicate a dent in the tip of the inspection area, or a chip in the tip of the inspection area, etc. If the inspection area has two or more similar parts, a message may be displayed for each part. For example, if the inspection area has two or more blades in a turbine, the message may indicate the type and location of a flaw in a particular blade.
[0107] Two or more scratches may have the same or similar type, occurrence rate, or number of scratches. A message indicating the type, location, and occurrence trend of the scratches is displayed, allowing the user to predict the type and location of scratches that require attention in advance. This reduces the possibility that the user will miss a scratch.
[0108] The display control unit 312 may set the transmittance (transparency) of the inspection assistance information displayed on the live image. For example, the transmittance ranges from 0 to 100%. When the transmittance is 0%, the live image does not transmit the inspection assistance information in the area where the inspection assistance information overlaps with the live image (overlapping area). The user can see the inspection assistance information but cannot see the live image in the overlapping area. When the transmittance is greater than 0% and less than 100%, the live image transmits the inspection assistance information in the overlapping area. The user can see both the inspection assistance information and the live image in the overlapping area. When the transmittance is 100%, the inspection assistance information is transparent. The user can see the live image in the overlapping area but cannot see the inspection assistance information.
[0109] For example, the display control unit 312 sets the transmittance to 0% in step S104. The display control unit 312 may set the transmittance to a value greater than 0% in step S104.
[0110] After the examination assistance information is displayed on the live image, the user may input an instruction to change the transmittance to the endoscope device 1 by operating the operation unit 4 or the touch panel 42. For example, the user may input an instruction to increase the transmittance to the endoscope device 1. The reception unit 311 may receive the instruction. The display control unit 312 may change the transmittance based on the instruction. Because the transmittance can be changed, the visibility of the live image for the user can be improved.
[0111] The inspection assistance information does not need to be displayed together with the live image. The display control unit 312 may display the inspection assistance information on the display unit 5 and then display the live image on the display unit 5.
[0112] After the examination support information is displayed on the display unit 5, the display control unit 312 may hide the examination support information in response to a movement or bending operation of the insertion unit 2. Alternatively, the display control unit 312 may reduce the display area in which the examination support information is displayed in response to a movement or bending operation of the insertion unit 2. The size of the display area after this control is executed is smaller than the size of the display area before this control is executed. For example, when the insertion unit 2 is moved while the examination support information is displayed on the display unit 5, the display control unit 312 may hide the examination support information or reduce the display area. Alternatively, when the user inputs a bending instruction to the endoscopic device 1 while the examination support information is displayed on the display unit 5, the display control unit 312 may hide the examination support information or reduce the display area.
[0113] The display control unit 312 may change the transmittance of the examination support information in accordance with the movement or bending operation of the insertion unit 2. For example, when the insertion unit 2 moves while the examination support information is displayed on the display unit 5, the display control unit 312 may increase the transmittance. Alternatively, when the user inputs a bending instruction to the endoscope device 1 while the examination support information is displayed on the display unit 5, the display control unit 312 may increase the transmittance. In these cases, the display control unit 312 may set the transmittance to 100%.
[0114] If the tip portion 20 of the insertion portion 2 has an acceleration sensor, the device control unit 310 may detect the movement of the insertion portion 2 based on the acceleration detected by the acceleration sensor. The device control unit 310 may calculate the amount of movement of the subject in the image generated by the image sensor 51, and detect the movement of the insertion portion 2 based on the amount of movement.
[0115] Another example of the processing in step S203 will be described. A model number according to the type of inspection object is assigned to the inspection object. Also, a serial number is assigned to each individual inspection object. If the model number of inspection object A is the same as the model number of inspection object B, inspection object A and inspection object B are inspection objects of the same type. If the model number of inspection object A is the same as the model number of inspection object B and the serial number of inspection object A is different from the serial number of inspection object B, inspection object A and inspection object B are inspection objects of the same type but are different individuals.
[0116] For example, the inspection result acquisition unit 822 acquires inspection result information of inspection object A1, including the inspection site detected in step S201, from the inspection result storage unit 83. There may be cases where past inspection result information for inspection object A1 does not exist. In that case, the inspection result acquisition unit 822 may acquire inspection result information for inspection object A2 from the inspection result storage unit 83. The model number of inspection object A1 is the same as the model number of inspection object A2. The serial number of inspection object A1 is different from the serial number of inspection object A2. In other words, inspection object A1 and inspection object A2 are inspection objects of the same type, but are different individuals. If past inspection result information for inspection object A1 does not exist, the inspection result acquisition unit 822 may acquire a reference image of inspection object A1 from the inspection result storage unit 83.
[0117] When a 3D image is displayed as the examination assistance information, the 3D image may be rotatable in response to a user operation. Specifically, the user may input an instruction to rotate the 3D image to the endoscope device 1 by operating the operation unit 4 or the touch panel 42. The reception unit 311 may receive the instruction. The display control unit 312 may change the orientation of the examination region in the 3D image by rotating the 3D image based on the instruction.
[0118] When a 2D image is displayed as examination support information, the user can only view the examination area from one direction. When a 3D image is displayed as examination support information, the 3D image contains three-dimensional information (such as depth). Therefore, by rotating the 3D image, the user can view the examination area from various directions. This allows the user to view abnormalities previously detected in the examination area from various perspectives, reducing the possibility that the user will miss an abnormality.
[0119] The control unit 31 may generate a 3D image by using a known method. Two methods for generating a 3D image are described below.
[0120] First, a method for generating a 3D image by using one or more stereo images will be described. The stereo images include a 2D image of a subject viewed from a first viewpoint (first 2D image) and a 2D image of the subject viewed from a second viewpoint different from the first viewpoint (second 2D image). A stereo optical system having two different fields of view is attached to the distal end 20 of the insertion section 2 as an optical adapter 10.
[0121] The stereo optical system has a first optical system and a second optical system. The endoscope device 1 may switch between a first state and a second state. In the first state, only light passing through the first optical system is incident on the imaging element 51. In the second state, only light passing through the second optical system is incident on the imaging element 51. The imaging element 51 generates a first 2D image in the first state and generates a second 2D image in the second state. A combination of the first 2D image and the second 2D image constitutes a stereo image. The control unit 31 generates a 3D image by using one or more first 2D images and one or more second 2D images.
[0122] Next, another method for generating a 3D image will be described. A monocular optical system having one field of view is attached to the distal end 20 of the insertion section 2 as the optical adapter 10. Two or more images are acquired when the monocular optical system is attached to the distal end 20 of the insertion section 2. The control unit 31 generates a 3D image by applying a technique called structure from motion (SfM) to the two or more images.
[0123] The examination assistance method according to each aspect of the present invention includes a receiving step, an acquiring step, an examination assistance step, and an image display step. The accepting unit 311 accepts examination site information (examination folder information) relating to an examination site constituting at least a part of an examination target (receiving step (step S100)). The examination result acquiring unit 822 connects to a storage medium (examination result storage unit 83) that stores the results of past examinations and acquires the examination results of the examination site from the storage medium (acquisition step (step S203)). The display control unit 312 displays examination assistance information on the display unit 5 based on the results acquired in the acquiring step (examination assistance step (step S104)). The examination assistance information notifies the user of information regarding abnormalities in the examination site detected in past examinations. After the examination assistance information is displayed, the display control unit 312 displays an image of the examination site on the display unit 5 (image display step (step S105)). The image may be a still image or a live image generated by the image sensor 51 after the examination assistance information is displayed.
[0124] The examination support system according to each aspect of the present invention includes an endoscopic device 1 (examination support device) and a server 8. The endoscopic device 1 includes a reception unit 311, a communication unit 44 (first communication unit), and a display control unit 312 (examination support unit, image display unit). The reception unit 311 receives examination site information (examination folder information) related to an examination site constituting at least a part of an examination target. The communication unit 44 transmits the examination site information to the server 8 and receives results of past examinations of the examination site from the server 8. The display control unit 312 displays examination support information on the display unit 5 based on the results received by the communication unit 44. The examination support information notifies the user of information related to abnormalities in the examination site detected in past examinations. After the examination support information is displayed, the display control unit 312 displays an image of the examination site on the display unit 5. The server 8 includes an examination result acquisition unit 822 and a communication unit 81 (second communication unit). The examination result acquisition unit 822 is connected to a storage medium (examination result storage unit 83) that stores the results of past examinations, and acquires the examination results of the examination site corresponding to the examination site information from the storage medium. The communication unit 81 receives the examination site information from the endoscope device 1, and transmits the results acquired by the examination result acquisition unit 822 to the endoscope device 1.
[0125] Each aspect of the present invention may include the following modifications. Examination site information (examination folder information) indicates a folder in a storage medium (examination result storage unit 83) in which the results of past examinations are saved. The folder is prepared for each examination site and is associated with the examination site. In an acquisition step (step S203), the examination result acquisition unit 822 acquires the results of the examination of the examination site from the folder indicated by the examination site information.
[0126] Each aspect of the present invention may include the following variations: The examination support information (INF10, INF11, INF13) includes an image of an abnormality detected in a previous examination. For example, the image is acquired when the examination site is examined. The image may be a reference image. The image of the abnormality is a 2D image or a 3D image. The reference image is a 2D image or a 3D image.
[0127] Each aspect of the present invention may include the following modifications: The inspection assistance information indicates the number of abnormalities for each type of abnormality.
[0128] Each aspect of the present invention may include the following variations: The examination support information (INF14) indicates the ratio of the number of abnormalities of each type previously detected in the examination region to the total number of abnormalities previously detected in the examination region.
[0129] Each aspect of the present invention may include the following modifications: In the acquisition step (step S203), the inspection result acquisition unit 822 acquires the results of an inspection previously performed on the same object as the inspection target or on an object of the same type as the inspection target.
[0130] Each aspect of the present invention may include the following modifications: In an acquisition step (step S203), the inspection result acquisition unit 822 searches for the results of an inspection of an inspection area in an object of the same type as the inspection target. If the results of the inspection area cannot be acquired, the inspection result acquisition unit 822 acquires the results of an inspection of an inspection area in an object of the same type as the inspection target in the acquisition step (step S203).
[0131] Each aspect of the present invention may include the following modifications: In the examination support step (step S104), the display control unit 312 displays one of two or more images (live images) of the examination region that are continuously generated on the display unit 5.
[0132] Each aspect of the present invention may include the following modifications: After the examination assistance information is displayed, when movement of the insertion section 2 inserted into the examination subject is detected, the display control section 312 hides the examination assistance information or reduces the area of the examination assistance information displayed on the display section 5.
[0133] Each aspect of the present invention may include the following modifications. In the examination support step (step S104), the display control unit 312 displays examination support information on an image of the examination region. After the examination support information is displayed, when movement of the insertion unit 2 inserted into the examination subject is detected, the display control unit 312 changes the transparency of the examination support information.
[0134] In the first embodiment, the endoscope device 1 displays the examination assistance information on the display unit 5. Therefore, the endoscope device 1 can reduce the possibility that the user will overlook an abnormality or make an incorrect evaluation of the abnormality.
[0135] (First Modification of the First Embodiment) A first modified example of the first embodiment of the present invention will be described. The display control unit 312 displays an information button on the screen of the display unit 5. When the information button is pressed, the display control unit 312 displays examination assistance information on the display unit 5.
[0136] The processing executed by the endoscope device 1 will be described using Fig. 15. Fig. 15 shows the procedure of the processing executed by the endoscope device 1. The description of the same processing as that shown in Fig. 6 will be omitted.
[0137] If the device control unit 310 determines in step S103 that the test result information has been received, the display control unit 312 outputs an image of the information button to the display unit 5 via the I / F 39. As a result, the display control unit 312 displays the information button on the display unit 5 (step S110).
[0138] 16 shows the information button BT10 and live image IMG10 displayed on the display unit 5 in step S110. The live image IMG10 is displayed on the display unit 5, and the information button BT10 is displayed on the live image IMG10.
[0139] The user operates the operation unit 4 to input an instruction to press the information button BT10 to the endoscope device 1. Alternatively, the user operates the touch panel 42 to input an instruction to press the information button BT10 to the endoscope device 1. The instruction output from the operation unit 4 is input to the control unit 31 via the I / F 37. Alternatively, the instruction output from the touch panel 42 is input to the control unit 31 via the I / F 38.
[0140] After step S110, device control unit 310 determines whether or not the information button BT10 has been pressed (step S111). If an instruction to press the information button BT10 has not been output from operation unit 4 or touch panel 42, device control unit 310 determines that the information button BT10 has not been pressed. If an instruction to press the information button BT10 has been output from operation unit 4 or touch panel 42, device control unit 310 determines that the information button BT10 has been pressed.
[0141] If the device control section 310 determines in step S111 that the information button BT10 has been pressed, the display control section 312 displays the examination assistance information on the display section 5 in step S104.
[0142] If device control unit 310 determines in step S111 that information button BT10 has not been pressed, device control unit 310 determines whether a predetermined operation has been performed (step S112). For example, the predetermined operation is pressing the freeze button. The predetermined operation may also be an operation to hide information button BT10.
[0143] If device control unit 310 determines in step S112 that a predetermined operation has not been performed, step S111 is executed. If device control unit 310 determines in step S112 that a predetermined operation has been performed, step S105 is executed. At this time, display control unit 312 may hide information button BT10.
[0144] 15, when the information button BT10 is pressed, the display control unit 312 displays the examination assistance information on the display unit 5 in step S104. When the information button BT10 is not pressed, the display control unit 312 does not display the examination assistance information on the display unit 5.
[0145] In the first modified example of the first embodiment, when the information button BT10 is pressed, the endoscope device 1 displays examination assistance information on the display unit 5. The user can select whether or not to display the examination assistance information.
[0146] (Second Modification of the First Embodiment) A second modified example of the first embodiment of the present invention will be described. The test result storage unit 83 stores test result information indicating two or more test results. The test result acquisition unit 822 acquires the test result information indicating two or more test results from the test result storage unit 83. The display control unit 312 displays test assistance information on the display unit 5 based on a preset priority.
[0147] For example, the priority is set according to the rank of the damage. The more serious the damage, the higher the priority. For example, the rank of a damage can be "Reject", "Repair", "Re-Inspect", "No Mark", or "Accept". The priority is set in this order.
[0148] The priority may be set according to the number of scratches of each type, which indicates the incidence or number of scratches. The more scratches there are, the higher the priority.
[0149] The memory card 11 stores priority information indicating the type of priority. The type of priority indicates the rank of the damage or the number of damages. The device control unit 310 reads the priority information from the memory card 11 via the I / F 40.
[0150] For example, after the inspection support information corresponding to the inspection result C1 is displayed on the display unit 5, the user inputs an instruction to the endoscope device 1 to switch the inspection support information. When the instruction is input, the inspection support information corresponding to the inspection result C2 is displayed on the display unit 5. The priority of the inspection result C1 is higher than the priority of the inspection result C2. Specifically, the rank of the inspection result C1 is higher than the rank of the inspection result C2. Alternatively, the number of lesions indicated by the inspection result C1 is greater than the number of lesions indicated by the inspection result C2.
[0151] The processing executed by the endoscope device 1 will be described using Fig. 17. Fig. 17 shows the procedure of the processing executed by the endoscope device 1. The description of the same processing as that shown in Fig. 6 will be omitted.
[0152] In step S203, the inspection result acquisition unit 822 of the server 8 acquires inspection result information indicating two or more inspection results from the inspection result storage unit 83. For example, each inspection result includes information indicating the type and rank of the injury in addition to a still image of the inspection area. The inspection result information received in step S102 indicates two or more inspection results.
[0153] If the device control unit 310 determines in step S103 that the test result information has not been received, step S105 is executed. If the device control unit 310 determines in step S103 that the test result information has been received, the device control unit 310 determines the priority of two or more test results by using the priority information (step S120).
[0154] If the priority information indicates a scratch rank, the device control unit 310 determines the priority of two or more test results based on the scratch rank. If an test result includes information indicating a high rank, the device control unit 310 determines that the test result has a high priority. If an test result includes information indicating a low rank, the device control unit 310 determines that the test result has a low priority.
[0155] If the priority information indicates the number of scratches, the device control unit 310 determines the priority of two or more test results based on the number of scratches. The test result information indicates the incidence rate of each type of scratch or the number of occurrences of each type of scratch. Two or more test results correspond to two or more types of scratches. The device control unit 310 determines the priority of two or more types of scratches. If the incidence rate or number of scratches is high, the device control unit 310 determines that the priority of the scratch is high. If the incidence rate or number of scratches is low, the device control unit 310 determines that the priority of the scratch is low.
[0156] After step S120, device control section 310 selects one of two or more test results (step S121). Device control section 310 first selects the test result with the highest priority.
[0157] After step S121, in step S104, the display control unit 312 displays the examination assistance information on the display unit 5. At this time, the display control unit 312 displays the examination result information indicating the examination result selected in step S121 as the examination assistance information on the display unit 5. Alternatively, the display control unit 312 displays the examination assistance information generated based on the examination result information on the display unit 5. In addition, the display control unit 312 displays a "Close" button and a "Next" button on the display unit 5 together with the examination assistance information.
[0158] FIG. 18 shows examination support information INF10, a live image IMG10, a "Close" button BT11, and a "Next" button BT12 displayed on the display unit 5. The live image IMG10 is displayed on the display unit 5, and the examination support information INF10 is displayed on the live image IMG10. The examination support information INF10 is an image of an examination site having a flaw. The examination support information INF10 hides a portion of the live image IMG10. In addition, the "Close" button BT11 and the "Next" button BT12 are displayed on the examination support information INF10. The "Close" button BT11 and the "Next" button BT12 may be displayed on the live image IMG10.
[0159] The user operates the operation unit 4 to input an instruction to press the "Close" button BT11 or the "Next" button BT12 to the endoscope device 1. Alternatively, the user operates the touch panel 42 to input an instruction to press the "Close" button BT11 or the "Next" button BT12 to the endoscope device 1. The instruction output from the operation unit 4 is input to the control unit 31 via the I / F 37. Alternatively, the instruction output from the touch panel 42 is input to the control unit 31 via the I / F 38.
[0160] After step S104, device control unit 310 determines whether or not the "close" button BT11 has been pressed (step S122). If an instruction to press the "close" button BT11 has not been output from operation unit 4 or touch panel 42, device control unit 310 determines that the "close" button BT11 has not been pressed. If an instruction to press the "close" button BT11 has been output from operation unit 4 or touch panel 42, device control unit 310 determines that the "close" button BT11 has been pressed.
[0161] If the device control section 310 determines in step S122 that the "close" button BT11 has been pressed, the display control section 312 hides the examination assistance information (step S123). After step S123, step S105 is executed.
[0162] If device control unit 310 determines in step S122 that the "Close" button BT11 has not been pressed, device control unit 310 determines whether or not the "Next" button BT12 has been pressed (step S124). If an instruction to press the "Next" button BT12 has not been output from operation unit 4 or touch panel 42, device control unit 310 determines that the "Next" button BT12 has not been pressed. If an instruction to press the "Next" button BT12 has been output from operation unit 4 or touch panel 42, device control unit 310 determines that the "Next" button BT12 has been pressed.
[0163] If the device control unit 310 determines in step S124 that the "Next" button BT12 has not been pressed, step S122 is executed. If the device control unit 310 determines in step S124 that the "Next" button BT12 has been pressed, step S121 is executed. In step S121, the device control unit 310 selects a test result with a lower priority than the priority of the previously selected test result.
[0164] If the priority information indicates the rank of the flaw, the device control unit 310 selects the inspection result of the flaw having a predetermined rank (first rank) in the first executed step S121. In step S104, the display control unit 312 displays inspection support information indicating the inspection result on the display unit 5. For example, the inspection support information relates to a flaw having a rank of "replacement required (Reject)."
[0165] In step S121, which is executed again, the device control unit 310 selects the inspection results of the flaws having a second rank lower than the first rank. In step S104, the display control unit 312 displays inspection support information indicating the inspection results on the display unit 5. For example, the inspection support information relates to flaws having a rank of "Repair Required." The type of flaw having the second rank may be different from or the same as the type of flaw having the first rank.
[0166] If the priority information indicates the number of flaws, the device control unit 310 selects the inspection results of a predetermined number (first number) of flaws in the first executed step S121. In step S104, the display control unit 312 displays inspection support information indicating the inspection results on the display unit 5. For example, the inspection support information relates to the flaws with the highest incidence rate or number of occurrences.
[0167] In step S121, which is executed again, device control unit 310 selects the inspection results for a second number of flaws that is smaller than the first number. In step S104, display control unit 312 displays inspection support information indicating the inspection results on display unit 5. For example, the inspection support information relates to the flaws with the second highest incidence rate or number of occurrences. The type of the second number of flaws is different from the type of the first number of flaws.
[0168] In the first embodiment described above, the inspection support information may include two or more inspection results arranged according to priority. For example, when inspection support information similar to inspection support information INF12 shown in FIG. 10 is displayed, the type of flaw may be displayed at a position according to the flaw's rank. For example, flaws with higher ranks may be displayed at the top of the screen of display unit 5, and flaws with lower ranks may be displayed at the bottom of the screen of display unit 5.
[0169] Alternatively, when inspection support information similar to inspection support information INF14 shown in Fig. 12 is displayed, the type of flaw may be displayed at a position corresponding to the incidence rate or number of flaws. For example, flaws with a high incidence rate or number of flaws may be displayed at the top of the screen of display unit 5, and flaws with a low incidence rate or number of flaws may be displayed at the bottom of the screen of display unit 5.
[0170] Each aspect of the present invention may include the following modifications: When two or more results are acquired in the acquisition step (step S203), the display control unit 312 displays examination assistance information on the display unit 5 based on a preset priority in the examination assistance step (step S104).
[0171] Each aspect of the present invention may include the following modifications: Priority is set according to the state of the abnormality.
[0172] Each aspect of the present invention may include the following modifications: In the first examination support step (step S104), the display control unit 312 displays examination support information on the display unit 5 based on a result indicating a state having a first priority. After the first examination support step is executed, in the second examination support step (step S104), the display control unit 312 displays examination support information on the display unit 5 based on a result indicating a state having a second priority that is lower than the first priority.
[0173] Each aspect of the present invention may include the following modifications: Priority is set according to the number of abnormalities for each type of abnormality.
[0174] Each aspect of the present invention may include the following modifications: In the first inspection support step (step S104), the display control unit 312 displays inspection support information on the display unit 5 based on a result indicating a first number of types of abnormalities detected. After the first inspection support step is executed, the display control unit 312 displays inspection support information on the display unit 5 based on a result indicating a second number of types of abnormalities detected, which is smaller than the first number, in the second inspection support step (step S104).
[0175] In the second modified example of the first embodiment, the endoscope device 1 displays the examination assistance information on the display unit 5 in accordance with the priority. The user can check the examination assistance information in order of priority.
[0176] (Third Modification of the First Embodiment) A third modification of the first embodiment of the present invention will be described. In the third modification of the first embodiment, the examination folder information includes the name of the examination region. The user selects the examination region to select the examination folder.
[0177] The server 8 manages the relationship between the examination folder and the examination region. The communication control unit 313 of the endoscope device 1 receives information indicating the relationship from the server 8 by using the communication unit 44. The information is recorded on the memory card 11.
[0178] Fig. 19 shows an example of the structure of an inspection folder in the inspection result storage unit 83. In Fig. 19, each inspection folder and the files contained in that inspection folder are shown schematically. An example is shown in which the inspection folder has two levels (classes).
[0179] A "root" folder is created in the inspection result storage unit 83. Under the "root" folder is a "DCIM" folder, and under the "DCIM" folder is an "IV70001" folder.
[0180] Under the "root" folder there is an "ENGINE1_SN001" folder, and under the "ENGINE1_SN001" folder there are the "HPC_STAGE1_ZONE1_1" folder, the "HPC_STAGE1_ZONE1_2" folder, and the "HPC_STAGE1_ZONE2_1" folder.
[0181] Folders other than the "HPC_STAGE1_ZONE1_1", "HPC_STAGE1_ZONE1_2", and "HPC_STAGE1_ZONE2_1" folders may be located under the "ENGINE1_SN001" folder. Folders other than the "DCIM" and "ENGINE1_SN001" folders may be located under the "root" folder.
[0182] In the name of the "ENGINE1_SN001" folder, "ENGINE1" indicates the engine name. "SN001" indicates the serial number, etc. "ENGINE1_SN001" indicates the inspection target.
[0183] Still image files are stored in the "HPC_STAGE1_ZONE1_1" folder, the "HPC_STAGE1_ZONE1_2" folder, and the "HPC_STAGE1_ZONE2_1" folder. The files stored in each folder make up the examination result information. "HPC_STAGE1_ZONE1_1," "HPC_STAGE1_ZONE1_2," and "HPC_STAGE1_ZONE2_1" each indicate an examination area.
[0184] The processing executed by the endoscope device 1 will be described using Fig. 20. Fig. 20 shows the procedure of the processing executed by the endoscope device 1. The description of the same processing as that shown in Fig. 6 will be omitted.
[0185] The display control unit 312 outputs information including the name of the examination folder to the display unit 5 via the I / F 39. As a result, the display control unit 312 displays the information on the display unit 5 (step S130). The name of the examination folder includes the name of the examination region. After step S130, step S100 is executed.
[0186] The display control unit 312 may display a list of names of examination folders on the display unit 5. The display control unit 312 may display a live image of the examination region and the names of the examination folders on the display unit 5.
[0187] The user selects the name of the examination folder by operating the joystick of the operation unit 4. In this way, the user inputs the name into the endoscope device 1. The reception unit 311 receives the name in step S100. The reception unit 311 generates examination folder information corresponding to the name of the examination region by using information indicating the relationship between the examination folder and the examination region.
[0188] 21 shows an example of changes in the examination folder information displayed on the display unit 5 in step S130. A live image of the examination subject and the name of the examination folder are displayed. Immediately after the power of the endoscope device 1 is turned on, image IMG20 is displayed on the display unit 5. Image IMG20 includes a character string indicating the name of the "DCIM" folder under the "root" folder.
[0189] The user can select an examination folder by operating the joystick on the operation unit 4. The user tilts the joystick in one of the directions: up (U), down (D), left (L), and right (R). Depending on the direction of the joystick, one of multiple examination folders is selected. When the user tilts the joystick in a predetermined direction and presses a button on the operation unit 4, examination folder information indicating the selected examination folder is input to the endoscope device 1.
[0190] When image IMG20 is displayed, the user tilts the joystick, for example, downward (D). This selects the "ENGINE1_SN001" folder under the "DCIM" folder, and image IMG21 is displayed on the display unit 5. Image IMG21 includes a character string indicating the name of the "ENGINE1_SN001" folder. The character string includes the name of the object to be inspected.
[0191] When image IMG21 is displayed, the user tilts the joystick, for example, upward (U). As a result, the "DCIM" folder above the "ENGINE1_SN001" folder is selected, and image IMG20 is displayed on the display unit 5.
[0192] When image IMG21 is displayed, the user tilts the joystick, for example, to the right (R). This selects the "HPC_STAGE1_ZONE1_1" folder from the three examination folders under the "ENGINE1_SN001" folder, and image IMG22 is displayed on the display unit 5. Image IMG22 includes a character string indicating the name of the "HPC_STAGE1_ZONE1_1" folder. The character string includes the name of the examination area.
[0193] When image IMG22 is displayed, the user tilts the joystick, for example, to the left (L). As a result, the "ENGINE1_SN001" folder above the "HPC_STAGE1_ZONE1_1" folder is selected, and image IMG21 is displayed on the display unit 5.
[0194] When image IMG22 is displayed, the user tilts the joystick, for example, downward (D). This selects the "HPC_STAGE1_ZONE1_2" folder, which is at the same level as the "HPC_STAGE1_ZONE1_1" folder, and image IMG23 is displayed on the display unit 5. Image IMG23 includes a character string indicating the name of the "HPC_STAGE1_ZONE1_2" folder. The character string includes the name of the examination area.
[0195] When image IMG23 is displayed, the user tilts the joystick, for example, upward (U), which selects the "HPC_STAGE1_ZONE1_1" folder, which is at the same level as the "HPC_STAGE1_ZONE1_2" folder, and image IMG22 is displayed on the display unit 5.
[0196] When image IMG23 is displayed, the user tilts the joystick, for example, downward (D). This selects the "HPC_STAGE1_ZONE2_1" folder, which is at the same level as the "HPC_STAGE1_ZONE1_2" folder, and image IMG24 is displayed on the display unit 5. Image IMG24 includes a character string indicating the name of the "HPC_STAGE1_ZONE2_1" folder. The character string includes the name of the examination area.
[0197] When image IMG24 is displayed, the user tilts the joystick, for example, upward (U), which selects the "HPC_STAGE1_ZONE1_2" folder, which is at the same level as the "HPC_STAGE1_ZONE2_1" folder, and image IMG23 is displayed on the display unit 5.
[0198] When image IMG22 is displayed, the user tilts the joystick, for example, upward (U), which selects the "HPC_STAGE1_ZONE2_1" folder, which is at the same level as the "HPC_STAGE1_ZONE1_1" folder, and image IMG24 is displayed on the display unit 5.
[0199] When image IMG24 is displayed, the user tilts the joystick, for example, downward (D). As a result, the "HPC_STAGE1_ZONE1_1" folder, which is at the same level as the "HPC_STAGE1_ZONE2_1" folder, is selected, and image IMG22 is displayed on the display unit 5.
[0200] When image IMG23 or image IMG24 is displayed, the user tilts the joystick, for example, to the left (L), which selects the "ENGINE1_SN001" folder above the "HPC_STAGE1_ZONE1_2" folder or the "HPC_STAGE1_ZONE2_1" folder, and image IMG21 is displayed on the display unit 5.
[0201] The endoscope device 1 may have a code reader. The endoscope device 1 may read a two-dimensional code by using the code reader. The two-dimensional code is attached to an examination region and contains information about the examination region. The endoscope device 1 may generate examination folder information corresponding to the examination region indicated by the two-dimensional code.
[0202] Each aspect of the present invention may include the following modifications: Before the receiving step (step S100) is executed, the display control unit 312 displays examination site information (examination site name) on the display unit 5 in an information display step (step S130).
[0203] In the third modification of the first embodiment, the user can input examination folder information into the endoscope device 1 by selecting the name of the examination region displayed on the display unit 5.
[0204] (Fourth Modification of the First Embodiment) A fourth modified example of the first embodiment of the present invention will be described. In the fourth modified example of the first embodiment, the display control unit 312 displays an image of the examination object on the display unit 5, and also displays the name of the examination region on the image. The user selects an examination region, thereby selecting an examination folder. The memory card 11 stores in advance information indicating the relationship between the examination folder and the examination region.
[0205] The processing executed by the endoscope device 1 will be described using Fig. 22. Fig. 22 shows the procedure of the processing executed by the endoscope device 1. The description of the same processing as that shown in Fig. 6 will be omitted.
[0206] The display control unit 312 outputs an image including the entire image of the examination object and the name of the examination region to the display unit 5 via the I / F 39. As a result, the display control unit 312 displays the image on the display unit 5 (step S140). After step S140, step S100 is executed.
[0207] The user selects the name of the examination region by operating the touch panel 42. In response, the user inputs the name into the endoscope device 1. The reception unit 311 receives the name in step S100. The reception unit 311 generates examination folder information corresponding to the name of the examination region by using information indicating the relationship between the examination folder and the examination region.
[0208] 23 shows an example of an image displayed on the display unit 5 in step S140. Image IMG30, name NM30, name NM31, name NM32, name NM33, and name NM34 are displayed on the display unit 5. Image IMG30 is an image of the entire object to be examined. Each of names NM30 to NM34 indicates the name of the examination region.
[0209] The positions of each of the inspection site IP30, inspection site IP31, inspection site IP32, inspection site IP33, and inspection site IP34 are displayed on the image IMG30. The inspection site IP30 has the name NM30, the inspection site IP31 has the name NM31, the inspection site IP32 has the name NM32, the inspection site IP33 has the name NM33, and the inspection site IP34 has the name NM34.
[0210] In the example shown in FIG. 23, the user selects the name NM31. The color of the name NM31 is changed, and an area RG31 of the examination part IP31 having the name NM31 is displayed on the image IMG30. The user can deselect the name and select another name by operating the joystick. For example, when the user selects the name NM32, the color of the name NM32 is changed, and an area of the examination part IP32 having the name NM32 is displayed on the image IMG30. At this time, the color of the name NM31 returns to its original color, and the area RG31 of the examination part IP31 is hidden. Furthermore, the user operates the joystick to input examination folder information corresponding to the examination part having the selected name into the endoscope device 1.
[0211] Alternatively, when the user operates the touch panel 42 to select one of the names NM30 to NM34, examination folder information corresponding to the examination area having the selected name is input to the endoscope device 1.
[0212] Each aspect of the present invention may include the following modifications: In an information display step (step S140), the display control unit 312 displays an image of the examination target on the display unit 5, and also displays examination region information (the name of the examination region) on the image.
[0213] In the fourth modification of the first embodiment, the user can confirm the position of the examination region within the entire examination object. The user can input examination folder information into the endoscope device 1 by selecting the name of the examination region displayed on the display unit 5.
[0214] (Fifth Modification of the First Embodiment) A fifth modified example of the first embodiment of the present invention will be described. In the fifth modified example of the first embodiment, the display control unit 312 displays an image of the object to be inspected on the display unit 5, and also displays the name of the inspection area on the image. The display control unit 312 also displays information regarding the number of scratches on the display unit 5. The number of scratches is the incidence rate or number of scratches. The user selects an inspection area, thereby selecting an inspection folder. The memory card 11 stores in advance information indicating the relationship between the inspection folder and the inspection area.
[0215] The processing executed by the endoscope device 1 will be described using Fig. 24. Fig. 24 shows the procedure of the processing executed by the endoscope device 1. The description of the same processing as that shown in Fig. 22 will be omitted.
[0216] After step S140, the display control unit 312 outputs an image including information about the number of scratches to the display unit 5 via the I / F 39. As a result, the display control unit 312 displays the image on the display unit 5 (step S141). After step S141, step S100 is executed.
[0217] The user selects the name of the examination region by operating the joystick or the touch panel 42. In this way, the user inputs the name into the endoscope device 1. The reception unit 311 receives the name in step S100. The reception unit 311 generates examination folder information corresponding to the name of the examination region by using information indicating the relationship between the examination folder and the examination region.
[0218] 25 shows an example of images displayed on the display unit 5 in step S141. Image IMG30, image IMG31, name NM30, name NM31, name NM32, name NM33, and name NM34 are displayed on the display unit 5. Image IMG30 is an image of the entire object to be examined. Each of names NM30 to NM34 indicates the name of the examination region.
[0219] The positions of inspection site IP30, inspection site IP31, inspection site IP32, inspection site IP33, and inspection site IP34 are displayed on image IMG30. The relationship between inspection sites IP30 to IP34 and names NM30 to NM34 is the same as that shown in Figure 23. Image IMG31 shows the incidence or number of each type of flaw previously detected in the inspection site.
[0220] In the example shown in Figure 25, the user selects the name NM31. The color of the name NM31 is changed, and an area RG31 of the inspection area IP31 having the name NM31 is displayed on the image IMG30. Also, an image IMG31 relating to the inspection area corresponding to the name NM31 is displayed. The image IMG31 shows the incidence or number of defects previously detected in the inspection area corresponding to the name NM31.
[0221] The user can deselect a name and select another name by operating the joystick. For example, when the user selects the name NM32, the color of the name NM32 changes, and the area of the examination region IP32 with the name NM32 is displayed on the image IMG30. At this time, the color of the name NM31 returns to its original color, and the area RG31 of the examination region IP31 is hidden. Furthermore, the image IMG31 is hidden, and an image of the examination region corresponding to the name NM32 is displayed in place of the image IMG31. Furthermore, the user operates the joystick to input examination folder information corresponding to the examination region with the selected name into the endoscope device 1.
[0222] Alternatively, when the user operates the touch panel 42 to select one of the names NM30 to NM34, examination folder information corresponding to the examination area having the selected name is input to the endoscope device 1.
[0223] In the fifth modification of the first embodiment, the user can confirm the position of the examination region within the entire examination object. The user can also confirm the number of abnormalities in the examination region. The user can input examination folder information into the endoscope device 1 by selecting the name of the examination region displayed on the display unit 5.
[0224] (Sixth Modification of the First Embodiment) A sixth modified example of the first embodiment of the present invention will be described. In the sixth modified example of the first embodiment, the memory card 11 stores an examination plan in advance. The examination plan includes information about examination sites to be examined in examinations that have not yet been performed. For example, the information includes the names of the examination sites, the positions of the examination sites, and the order of the examinations. The display control unit 312 displays information about the examination sites on the display unit 5 based on the examination plan. The memory card 11 stores in advance information indicating the relationship between examination folders and examination sites.
[0225] The processing executed by the endoscope device 1 will be described using Fig. 26. Fig. 26 shows the procedure of the processing executed by the endoscope device 1. The description of the same processing as that shown in Fig. 6 will be omitted.
[0226] The device control unit 310 reads the examination plan from the memory card 11 via the I / F 40. The display control unit 312 refers to the examination plan and extracts information on the examination region from the examination plan. The display control unit 312 outputs the extracted information to the display unit 5 via the I / F 39. As a result, the display control unit 312 displays the information on the display unit 5 (step S150). For example, the display control unit 312 displays a list of the names of the examination region on the display unit 5. After step S150, step S100 is executed.
[0227] The user selects the name of the examination region by operating the joystick or the touch panel 42. In this way, the user inputs the name into the endoscope device 1. The reception unit 311 receives the name in step S100. The reception unit 311 generates examination folder information corresponding to the name of the examination region by using information indicating the relationship between the examination folder and the examination region.
[0228] Each aspect of the present invention may include the following modifications: In an information display step (step S150), the display control unit 312 refers to the examination plan and displays examination site information based on the examination plan on the display unit 5. The examination plan includes examination site information related to the examination site to be examined.
[0229] In the sixth modification of the first embodiment, the user can input examination folder information into the endoscope device 1 by selecting the name of the examination region displayed on the display unit 5.
[0230] (Second embodiment) A second embodiment of the present invention will be described. The endoscope device 1 shown in FIG. 3 is changed to an endoscope device 1a shown in FIG. 27. FIG. 27 shows the configuration of the endoscope device 1a. Description of the same configuration as that shown in FIG. 3 will be omitted. In the second embodiment, it is not necessary to use a server 8.
[0231] The main body 3 shown in FIG. 3 is changed to a main body 3a shown in FIG. 27. In the main body 3a, the control unit 31 shown in FIG. 3 is changed to a control unit 31a shown in FIG. 27. In the main body 3a, the RAM 33 shown in FIG. 3 is changed to a RAM 33a. The RAM 33a has an inspection result storage unit 45. The inspection result storage unit 45 stores inspection result information indicating the inspection results. The main body 3a does not have the I / F 41 and the communication unit 44 shown in FIG. 3.
[0232] The control unit 31a is configured with at least one of a processor and a logic circuit. The control unit 31a may include one or more processors. The control unit 31a may include one or more logic circuits.
[0233] 28 shows the configuration of the control unit 31a. The control unit 31a has a device control unit 310, a reception unit 311, a display control unit 312, an examination region detection unit 314, and an examination result acquisition unit 315. Description of the same components as those shown in FIG. 4 will be omitted.
[0234] The control unit 31a does not have the communication control unit 313 shown in Fig. 4. The examination part detection unit 314 detects the examination part corresponding to the examination folder indicated by the examination folder information. The examination result acquisition unit 315 acquires the examination result information of the examination part detected by the examination part detection unit 314 from the examination result storage unit 45.
[0235] The processing executed by the endoscope device 1a will be described using Fig. 29. Fig. 29 shows the procedure of the processing executed by the endoscope device 1a. Description of the same processing as that shown in Fig. 6 will be omitted.
[0236] After step S100, the examination region detection unit 314 detects an examination region based on the examination folder information input in step S100 (step S160). Step S160 is similar to step S201 shown in FIG.
[0237] After step S160, the test result acquiring unit 315 searches the test result information of the test region detected in step S160 in the test result storage unit 45. Based on the search result, the test result acquiring unit 315 determines whether or not there is past test result information of the test region (step S161). Step S161 is the same as step S202 shown in FIG. 7.
[0238] If the test result acquisition unit 315 determines in step S161 that there is no past test result information for the test region, step S105 is executed. If the test result acquisition unit 315 determines in step S161 that there is past test result information for the test region, the test result acquisition unit 315 acquires the test result information from the test result storage unit 45 (step S162). Step S162 is the same as step S203 shown in Fig. 7. After step S162, step S104 is executed.
[0239] The process shown in Fig. 29 may include steps S110 to S112 shown in Fig. 15. The process shown in Fig. 29 may include steps S120 to S124 shown in Fig. 17. The process shown in Fig. 29 may include step S130 shown in Fig. 20. The process shown in Fig. 29 may include step S140 shown in Fig. 22. The process shown in Fig. 29 may include steps S140 and S141 shown in Fig. 24. The process shown in Fig. 29 may include step S150 shown in Fig. 26.
[0240] The examination support device (endoscopic device 1a) according to each aspect of the present invention includes a reception unit 311, an examination result acquisition unit 315, and a display control unit 312 (examination support unit, image display unit). The reception unit 311 receives examination site information relating to an examination site constituting at least a part of an examination subject. The examination result acquisition unit 315 is connected to a storage medium (examination result storage unit 45) that stores the results of past examinations, and acquires the examination results of the examination site corresponding to the examination site information from the storage medium. The display control unit 312 displays examination support information on the display unit 5 based on the results acquired by the examination result acquisition unit 315. The examination support information notifies the user of information regarding abnormalities in the examination site detected in past examinations. After the examination support information is displayed, the display control unit 312 displays an image of the examination site on the display unit 5.
[0241] In the second embodiment, the endoscope device 1a displays examination support information on the display unit 5. Therefore, the endoscope device 1a can reduce the possibility that the user will overlook an abnormality or make an incorrect evaluation of the abnormality.
[0242] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments and their modifications. Addition, omission, substitution, and other modifications of the configuration are possible within the scope of the spirit of the present invention. Furthermore, the present invention is not limited by the above description, but is limited only by the scope of the appended claims. [Explanation of symbols]
[0243] 1,1a Endoscopic device 2 Insertion section 3,3a Main body 4 Control section 5 Display section 6 Cables 7. Scope 8 Server 10 Optical adapter 11. Memory Card 20 Tip 21 Curved section 31, 31a, 82 Control section 32 ROM 33,33a RAM 34 Bus 35, 36, 37, 38, 39, 40, 41 Interfaces 42 Touch Panel 43 Connector 44,81 Communications Department 45,83 Test result storage unit 51 Image sensor 52 LED 100 Inspection Systems 310 Device control section 311 Reception 312 Display control unit 313,823 Communication Control Unit 314,821 Examination area detection unit 315,822 Test Result Acquisition Department 820 Server control unit
Claims
1. a receiving step in which a receiving unit receives examination region information regarding an examination region that constitutes at least a part of the examination object; an acquiring step in which the acquiring unit connects to a storage medium that stores the results of the inspection, including the number of abnormalities for each type of abnormality in the inspection region detected in a past inspection, and acquires the results of the inspection region corresponding to the inspection region information from the storage medium; an examination support step in which a display control unit displays examination support information on a display unit to notify a user of information related to the abnormality based on the result acquired in the acquisition step; an imaging step of capturing an image of the examination region by an imaging element of an endoscope inserted into the examination object after the examination assistance information is displayed; an image display step in which the display control unit displays the image of the examination region on the display unit; and When two or more of the results are acquired in the acquiring step, the display control unit displays the examination assistance information on the display unit based on a preset priority in the examination assistance step; The priority is set according to the number of abnormalities for each type of abnormality. Inspection image display method.
2. The inspection support step includes: a first examination assistance step in which the display control unit displays the examination assistance information on the display unit based on the result having a first priority; a second examination support step in which, after the first examination support step is executed, the display control unit displays the examination support information on the display unit based on the result having a second priority lower than the first priority; The method of claim 1 , further comprising:
3. The inspection support step includes: a first inspection support step in which the display control unit displays the inspection support information on the display unit based on the results indicating the types of the first number of detected abnormalities; a second inspection support step in which, after the first inspection support step is executed, the display control unit displays the inspection support information on the display unit based on the result indicating the types of the abnormalities detected a second number of times, the second number being smaller than the first number; The method of claim 1 , further comprising:
4. The method further includes an information display step in which the display control unit displays the examination region information on the display unit before the receiving step is executed. The method for displaying an inspection image according to claim 1 .
5. In the information display step, the display control unit refers to an examination plan including the examination site information regarding the examination site to be examined, and displays the examination site information on the display unit based on the examination plan.
5. The method for displaying an inspection image according to claim 4.
6. The display control unit displays an image of the examination object on the display unit and displays the examination region information on the image in the information display step.
5. The method for displaying an inspection image according to claim 4.
7. the examination site information indicates a folder in the storage medium in which the results are to be saved; the folder is prepared for each of the examination regions and is associated with the examination region; In the acquiring step, the acquiring unit acquires the results of the examination region from the folder indicated by the examination region information. The method for displaying an inspection image according to claim 1 .
8. The examination assistance information includes an image of the abnormality detected in a past examination. The method for displaying an inspection image according to claim 1 .
9. The inspection support information indicates the number of abnormalities for each type of abnormality. The method for displaying an inspection image according to claim 1 .
10. The examination support information indicates a ratio of the number of abnormalities of each type detected in the examination region to the number of all abnormalities previously detected in the examination region. The method for displaying an inspection image according to claim 1 .
11. In the acquiring step, the acquiring unit acquires the results of an inspection previously performed on the same object as the inspection target or an object of the same type as the inspection target. The method for displaying an inspection image according to claim 1 .
12. The acquisition unit searches for the result of the inspection region in the same object as the inspection target in the acquisition step; If the result of the inspection region cannot be acquired, the acquiring unit acquires the result of the inspection region of an object of the same type as the type of the inspection target in the acquiring step. The method for displaying an inspection image according to claim 1 .
13. The display control unit displays one of the two or more images of the examination region that are successively generated on the display unit in the examination support step. The method for displaying an inspection image according to claim 1 .
14. When a movement of the insertion part of the endoscope is detected after the examination assistance information is displayed, the display control unit hides the examination assistance information or reduces the area of the examination assistance information displayed on the display unit. The method for displaying an inspection image according to claim 1 .
15. A second imaging step of capturing a second image of the inspection site by the imaging element; a second image display step in which the display control unit displays the second image on the display unit; and the display control unit displays the examination assistance information on the second image in the examination assistance step; When a movement of the insertion part of the endoscope is detected after the examination assistance information is displayed, the display control unit changes the transmittance of the examination assistance information. The method for displaying an inspection image according to claim 1 .
16. a receiving unit that receives examination region information relating to an examination region that constitutes at least a part of an examination object; an acquisition unit connected to a storage medium that stores the results of the inspection, including the number of abnormalities for each type of abnormality in the inspection region detected in the past inspection, and that acquires the results of the inspection region corresponding to the inspection region information from the storage medium; an examination support unit that displays examination support information on a display unit to notify a user of information related to the abnormality based on the result acquired by the acquisition unit; an endoscope that is inserted into the subject to be examined after the examination assistance information is displayed and has an imaging element that captures an image of the examination region; an image display unit that displays the image of the examination region on the display unit; and When two or more of the results are obtained, the examination support unit displays the examination support information on the display unit based on a preset priority; The priority is set according to the number of abnormalities for each type of abnormality. Inspection support equipment.
17. It has an inspection support device and a server, The inspection support device includes: a receiving unit that receives examination region information relating to an examination region that constitutes at least a part of an examination object; a first communication unit that transmits the inspection site information to the server and receives inspection results from the server, the inspection results including the number of abnormalities for each type of abnormality detected in a previous inspection of the inspection site; an examination support unit that displays, on a display unit, examination support information that notifies a user of information related to the abnormality based on the result received by the first communication unit; an endoscope that is inserted into the subject to be examined after the examination assistance information is displayed and has an imaging element that captures an image of the examination region; an image display unit that displays the image of the examination region on the display unit; and When two or more of the results are received, the examination support unit displays the examination support information on the display unit based on a preset priority; the priority is set according to the number of abnormalities for each type of abnormality; The server an acquisition unit that is connected to a storage medium that stores the results of past examinations and acquires the results of the examination region corresponding to the examination region information from the storage medium; a second communication unit that receives the examination region information from the examination support device and transmits the results acquired by the acquisition unit to the examination support device; An inspection support system having:
18. a receiving step of receiving examination region information relating to an examination region constituting at least a part of an examination object; an acquisition step of connecting to a storage medium that stores the results of the inspection, including the number of abnormalities for each type of abnormality in the inspection region detected in a past inspection, and acquiring the results of the inspection region corresponding to the inspection region information from the storage medium; an examination support step of displaying examination support information on a display unit to notify a user of information related to the abnormality based on the results acquired in the acquisition step; an imaging step of capturing an image of the examination region by an imaging element of an endoscope inserted into the examination object after the examination assistance information is displayed; an image display step of displaying the image of the examination region on the display unit; A program for causing a computer to execute the above, When two or more of the results are acquired in the acquisition step, the examination assistance information is displayed on the display unit based on a preset priority in the examination assistance step; The priority is set according to the number of abnormalities for each type of abnormality. program.
Citation Information
Patent Citations
Remote visual inspection support system, and remote visual inspection support computer program
JP2010009479A
Component inspection support device, control method and program
JP2015163847A
Endoscope apparatus, endoscope system and endoscopic image display method
JP2018166959A
Inspection support system and inspection support method, and program
JP2019153238A
Inspection image display control method, inspection image display controller and inspection image display control system
JP2019200463A