Inspection support system, inspection support method, control method for medical device, and recording medium recording a program

Abstract

This inspection assistance system assists an inspection that uses a medical image and has one or more processors having hardware, wherein the processor acquires a video signal that includes information about the medical image, and is able to output inspection assistance information for assisting an inspection by carrying out a recognition process on the basis of the video signal, and determines, on the basis of the video signal, whether the video signal is a video signal used for recognition process.

Description

Inspection support system, inspection support method, and recording medium having inspection support program recorded thereon

[0001] The present invention relates to an inspection support system, an inspection support method, and a recording medium on which an inspection support program is recorded that are suitable for devices that perform AI judgments.

[0002] In recent years, medical systems that use AI (artificial intelligence) to make various judgments have been developed in the medical field. For example, in colonoscopy, an AI endoscope operation support system is sometimes adopted to perform high-quality endoscopic examinations with minimal burden on the patient. This system uses AI to determine the current status of the endoscopic examination and presents support information appropriate to that status.

[0003] To enable highly accurate AI judgment, it is necessary to use endoscopic images suitable for AI judgment. However, even if endoscopic images suitable for AI judgment are captured, if a wiring error occurs between the video processor device of the endoscopic system and a device that outputs operation support information, etc. by AI based on the endoscopic images (hereinafter referred to as the examination support device), AI judgment using the appropriate endoscopic images will not be performed.

[0004] As a technique for preventing such wiring errors, Japanese Patent Application Laid-Open Publication No. 2010-268063 discloses a technique for authenticating a connected device in order to manage whether or not information communication between electronic devices is permitted. In this proposal, when an image forming device detects a connection to an external device, it acquires the external device ID of the external device, and permits use of the external device if the acquired external device ID matches a pre-stored external device ID.

[0005] By applying this technology to a video processor device and an inspection support device, it is possible to confirm that the device at the other end of the communication connection is correct.

[0006] JP 2010-268063 A

[0007] However, two types of connections are used between the video processor device and the examination support device: a communication connection for transmitting identification signals and control signals, and a video connection for transmitting endoscopic image video signals. Therefore, even if the technology of JP 2010-268063 A is applied to the connection between the video processor device and the examination support device and it is possible to confirm that the communication connection destination device is correct, this does not guarantee that the video signal destination device is correct. Furthermore, the video processor device may be configured to output video from multiple output ports for each image transmission format. In this case, even if the video signal destination device is correct, incorrect wiring may result in a video signal that is not intended for AI judgment being transmitted to the examination support device. The present invention aims to provide an examination support system, an examination support method, and a recording medium having an examination support program recorded thereon that can check whether the video signal input to the examination support device is an appropriate video signal.

[0008] An examination support system according to one embodiment of the present invention is an examination support system that supports examinations using medical images, and has one or more processors with hardware, wherein the processor acquires a video signal containing information about the medical image, performs recognition processing based on the video signal, and is capable of outputting examination support information to support the examination, and determines, based on the video signal, whether the video signal is a video signal for the recognition processing.

[0009] An examination support method according to one aspect of the present invention is an examination support method for supporting an examination using a medical image, and includes the steps of acquiring a video signal containing information about the medical image, determining based on the video signal whether the video signal is a video signal for the recognition processing, and outputting examination support information for supporting the examination using the medical image by performing recognition processing based on the video signal.

[0010] A recording medium having recorded thereon an examination assistance program according to one aspect of the present invention records thereon an examination assistance program that causes a computer to execute the following processes: acquiring a video signal containing information about the medical image; determining, based on the video signal, whether the video signal is a video signal for the recognition processing; and outputting examination assistance information for assisting an examination using the medical image by performing recognition processing based on the video signal.

[0011] According to the present invention, it is possible to check whether or not a video signal input to an examination support device is an appropriate video signal.

[0012] Fig. 1 is a configuration diagram showing an inspection support system according to a first embodiment of the present invention. Fig. 2 is an explanatory diagram for explaining an example of a determination method for input eligibility determination by the AI ​​information confirmation unit 13b. Fig. 3 is an explanatory diagram for explaining an example of a determination method for input eligibility determination by the AI ​​information confirmation unit 13b. Fig. 4 is a flowchart showing AI determination control by the AI ​​information confirmation unit 13b. Fig. 5 is a flowchart showing device legitimacy determination by the connection destination confirmation unit 13a. Fig. 6 is a block diagram showing a modified example.

[0013] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

[0014] 1 is a block diagram showing an examination support system according to a first embodiment of the present invention. This embodiment makes it possible to check whether medical images suitable for AI judgment are input to the examination support device.

[0015] Although this embodiment is an application of the examination support system to endoscopic examination, the system is not limited to endoscopic examination and can be applied to various AI processes that employ AI judgment. For example, the system can be applied to AI processes that output endoscopic operation guide information based on endoscopic images, AI processes that output control information for an automatically inserted endoscope based on endoscopic images, and AI processes that output identification information for lesions or organ sites based on endoscopic images.

[0016] FIG. 1 shows the configuration of an inspection support device 10 constituting an inspection support system according to a first embodiment of the present invention, and a video processor device 20 that outputs information used for AI judgment to the inspection support device.

[0017] The video processor device 20 includes a device information output unit 21 and an input information output unit 22. For example, the video processor device 20 may be connected to an endoscope (not shown) that is inserted into a subject and captures endoscopic images of the inside of a body cavity, and endoscopic images such as endoscopic examination images may be supplied from the endoscope. The video processor device 20 is capable of acquiring not only endoscopic images but also various other information. For example, the video processor device 20 may be configured to acquire information regarding whether an endoscope is connected to the video processor device 20 and whether an endoscopic examination has started. Furthermore, the video processor device 20 may be configured to acquire information regarding switching between various observation modes of the endoscope, such as NBI (narrowband imaging) mode and RDI (infrared imaging) mode.

[0018] The device information output unit 21 transmits source device information relating to the device (source device) that is the source of input information for the examination support device 10, i.e., the video processor device 20 that is the connection destination of the examination support device 10, via the first communication cable C1 that constitutes the first communication route. Note that the source device information transmitted by the device information output unit 21 may include, for example, ID information that identifies the video processor device 20, as well as information relating to the operation of the video processor device 20 (operation information), information relating to the manipulation of the video processor device 20 (operation information), and information relating to the video format of the video signal output from the video processor device 20. The operation information and operation information in the source device information include information on whether an endoscope is connected to the video processor device 20, information on whether an endoscopic examination has started, information on switching the observation mode of the endoscope, etc.

[0019] The input information output unit 22 outputs the input information of the examination support device 10 via a second communication cable C2 constituting a second communication route. That is, the input information output unit 22 outputs a video signal of an image for AI judgment, for example, an image including an endoscopic image such as an endoscopic examination image, as input information for the examination support device 10. Note that the image based on the video signal output by the input information output unit 22 includes an endoscopic image, which is a medical image, in a partial area of ​​the image.

[0020] Although the first and second communication routes have been described as being constituted by the first communication cable C1 and the second communication cable C2, this is not limited to this, and the first and second communication routes may also be constituted by wireless routes.

[0021] The test support device 10 includes a device information acquisition unit 11, an input information acquisition unit 12, an input information confirmation unit 13, and an AI determination unit 14. The entire test support device 10, or at least one of the device information acquisition unit 11, the input information acquisition unit 12, the input information confirmation unit 13, and the AI ​​determination unit 14, may be configured with one or more processors using a CPU (Central Processing Unit), an FPGA (Field Programmable Gate Array), or the like, and may operate according to a program stored in a memory (not shown) to control each unit, or may realize some or all of its functions using a hardware electronic circuit.

[0022] The device information acquisition unit 11 acquires source device information transmitted from the device information output unit 21 via the first communication route, and outputs the acquired source device information to the input information confirmation unit 13. The input information acquisition unit 12 acquires input information transmitted from the input information output unit 22 via the second communication route, and outputs the acquired input information to the input information confirmation unit 13.

[0023] The input information confirmation unit 13 includes a connection destination confirmation unit 13a and an AI information confirmation unit 13b. The connection destination confirmation unit 13a is provided with source device information from the device information output unit 21. The connection destination confirmation unit 13a uses the source device information to determine the legitimacy of the destination device, i.e., whether the destination device is a correct device as the source device of the endoscopic image, which is input information for determining the content of support to be provided in the examination support device 10, and confirms the legitimacy of the device.

[0024] The AI ​​information confirmation unit 13b receives input information from the input information output unit 22. The AI ​​information confirmation unit 13b performs an input eligibility determination as to whether the input information is suitable for predetermined recognition processing such as AI determination, and outputs the input eligibility determination result, which is the determination result, to the AI ​​determination unit 14.

[0025] The AI ​​determination unit 14 is provided with input information and the input eligibility determination result from the AI ​​information confirmation unit 13b. The AI ​​determination unit 14 determines whether or not to use the input information for AI determination based on the input eligibility determination result. That is, when the AI ​​determination unit 14 is provided with an input eligibility determination result from the AI ​​information confirmation unit 13b indicating that the input information is suitable for recognition processing, the AI ​​determination unit 14 performs recognition processing such as AI determination based on the input information. The AI ​​determination unit 14 outputs the AI ​​determination result, which is the recognition result of the recognition processing, to the connection destination confirmation unit 13a. Furthermore, when the AI ​​determination unit 14 is provided with an input eligibility determination result from the AI ​​information confirmation unit 13b indicating that the input information is not suitable for recognition processing, the AI ​​determination unit 14 does not perform recognition processing such as AI determination based on the input information.

[0026] In addition, the AI ​​information confirmation unit 13b may be configured to supply the input information to the AI ​​judgment unit 14 only when an input eligibility judgment result is given indicating that the input information is suitable for recognition processing.

[0027] When the connection destination confirmation unit 13a receives the AI ​​judgment result from the AI ​​judgment unit 14, it determines whether to adopt the AI ​​judgment result based on the judgment result of device legitimacy for the device that is the sender of the input information used in the AI ​​judgment. That is, when the connection destination confirmation unit 13a confirms that the device is legitimate based on the judgment result of device legitimacy, it adopts the AI ​​judgment result and outputs the AI ​​judgment result to the display unit 30. On the other hand, when the connection destination confirmation unit 13a confirms that the device is invalid based on the judgment result of device legitimacy, it does not output the AI ​​judgment result to the display unit 30.

[0028] The display unit 30 displays on the display screen the information from the input information confirmation unit 13. When the AI ​​judgment result is input, the display unit 30 displays the input AI judgment result on the display screen. The input information confirmation unit 13 may provide the judgment result of device validity and the judgment result of input eligibility to the display unit 30 for display.

[0029] (Input Eligibility Determination) FIGS. 2 and 3 are explanatory diagrams for explaining an example of a determination method for input eligibility determination by the AI ​​information confirmation unit 13b.

[0030] The video processor device 20 performs predetermined video signal processing on an image signal obtained by imaging using an endoscope (not shown) to generate a video signal of a predetermined video format in which video parameters such as resolution, color gamut, and frame rate are appropriately set. The video processor device 20 encodes the generated video signal using a predetermined codec such as MPEG-4 or H.265 / HEVC, containerizes the encoded video signal in various file formats such as AVI, MOV, WMV, and FLV, and transmits it via an output terminal conforming to a predetermined transmission standard such as DVI or SDI. Note that the video format of the video signal that can be transmitted is determined depending on the transmission standard.

[0031] If a video format that is not suitable for AI judgment is adopted, a highly reliable AI judgment result cannot be obtained. Also, even if an image in a video format suitable for AI judgment is input to the video processor device 20, an image that does not suit AI judgment may be transmitted to the inspection support device 10 due to wiring errors, etc. In this case, a highly reliable AI judgment result cannot be obtained either.

[0032] Image P1 in Figure 2 shows an example of an image suitable for AI judgment by the AI ​​judgment unit 14, and is obtained by imaging the video signal output from the input information output unit 22. Image P1 has a display area P1R that displays an endoscopic image over a relatively wide range of the entire image. This display area P1R includes an endoscopic image P1Ra in which the effective image area is octagonal in shape due to mask areas (filled-in areas) with triangular corners. This endoscopic image P1Ra has a relatively high resolution. The AI ​​judgment unit 14 obtains an AI judgment result by performing recognition processing on this endoscopic image P1Ra.

[0033] In contrast, image P2 in Figure 2 shows an example of an image that does not conform to the AI ​​judgment of the AI ​​judgment unit 14. For example, if the type of endoscope connected to the video processor device 20 is inappropriate or if the video processor device 20 is incorrectly configured, it is expected that image P2 will be obtained by imaging the video signal from the input information output unit 22. That is, image P2 includes an endoscopic image P1Rb in a display area P1R, which is a relatively large range within the entire image, in which the effective image area is octagonal due to triangular mask areas (filled-in areas) at the four corners. This endoscopic image P1Rb has a different aspect ratio from endoscopic image P1Ra. That is, endoscopic image P1Ra and endoscopic image P1Rb are positioned differently in the image based on the video signal, which is input information. Therefore, even if the AI ​​judgment unit 14 performs recognition processing on this endoscopic image P1Rb, it is not necessarily able to obtain a correct AI judgment result.

[0034] Furthermore, if the wrong endoscope is connected to the video processor device 20, if there is an error in the settings, or if an image not intended for AI judgment, such as an image intended for a printer, is input to the examination support device 10, the resolution of the endoscopic image P1Rb input to the examination support device 10 may be lower than the resolution of the endoscopic image P1Ra. In such cases, even if the AI ​​judgment unit 14 performs recognition processing on the endoscopic image P1Rb, it may not be able to obtain a correct AI judgment result. Furthermore, if an image that should be output to another device (not shown) is mistakenly provided to the examination support device 10, another image P2a may be superimposed on a portion of the endoscopic image P1Rb using picture-in-picture (PIP). In such cases, the AI ​​judgment unit 14 may not obtain a correct AI judgment result.

[0035] The AI ​​information confirmation unit 13b may determine that the video signal is not a video signal for the recognition processing when at least one of the aspect ratio and image quality of the training medical image used to generate the inference model of the AI ​​judgment unit 14 differs from the aspect ratio and image quality of the medical image that is the input information, or when another image is superimposed on the medical image.

[0036] For such a determination, for example, the AI ​​information confirmation unit 13b may have a memory (not shown) that stores information about image characteristics suitable for AI determination. The AI ​​information confirmation unit 13b performs image analysis on the input information and analysis of metadata associated with the input information to compare the information in the memory with the input information regarding characteristics such as image quality format, frame rate, aspect ratio, and superimposition of other information, thereby determining the eligibility of the input information and obtaining an input eligibility determination result. For example, the AI ​​information confirmation unit 13b may determine the position of a medical image in an image based on a video signal, which is the input information, and obtain an input eligibility determination result based on the degree of correspondence between the determined position and the position of the medical image in the image suitable for AI determination.

[0037] Fig. 2 illustrates an example in which the validity of input information is determined by image analysis of an endoscopic image, which is the input information. In contrast, Fig. 3 illustrates an example in which the input information includes information that directly indicates the validity of the input information.

[0038] In the image P3 in Fig. 3, identification information P3a indicating that the endoscopic image P1Ra is an image suitable for AI judgment is superimposed in the display area P1R. In the example of Fig. 3, the identification information P3a is image information. The identification information P3a is arranged in mask areas at the four corners of the display area P1R, and the identification information P3a ensures that almost no information in the effective image area of ​​the endoscopic image P1Ra is missing.

[0039] The identification information P3a may be, for example, a barcode or a QR code (registered trademark). Although Fig. 3 shows an example in which the identification information P3a is visually recognizable, the identification information P3a may be invisible.

[0040] In addition, the identification information P3a may not only be included as an image in the image based on the video signal, but may also be included in the header information of the video signal, and metadata indicating that the endoscopic image P1Ra is an image suitable for AI judgment may be included in the input information.

[0041] The AI ​​information confirmation unit 13b can determine the suitability of the input information by checking the identification information P3a. In this way, the AI ​​information confirmation unit 13b determines, based on the video signal, whether the video signal is suitable for recognition processing such as AI judgment.

[0042] The AI ​​information confirmation unit 13b performs the input eligibility determination at an appropriate timing. For example, the AI ​​information confirmation unit 13b may perform the input eligibility determination when the examination support device 10 is started up, or may perform the input eligibility determination when an endoscope (not shown) is connected to the video processor device 20. The AI ​​information confirmation unit 13b may also perform the input eligibility determination when the settings of the video processor device 20 that supplies input information to the examination support device 10 are changed, or may perform the input eligibility determination at a predetermined interval.

[0043] If the AI ​​information confirmation unit 13b determines that the input information is not suitable for AI judgment based on the result of the input eligibility judgment, it may generate display information to display a warning message (alert) on the display screen of the display unit 30, such as ``This is not the target endoscope'' or ``The settings are different,'' and supply this information to the display unit 30.

[0044] (Device Validity Determination) The destination confirmation unit 13a may have a memory storing ID information related to legitimate devices to determine device validity. The destination confirmation unit 13a may determine device validity by comparing the information stored in the memory with the source device information. For example, when endoscopic images are acquired in multiple examination rooms, it is possible that, due to a wiring error or the like, an endoscopic image acquired in a room other than the target examination room is input as input information from the video processor device 20 to the AI ​​information confirmation unit 13b. Even in this case, the AI ​​determination of the input image is correct. Therefore, unless the source device information is confirmed, operational assistance will be provided based on an endoscopic image from a room other than the target examination room. In this embodiment, the destination confirmation unit 13a determines device validity by comparing the information stored in the memory with the source device information. If the ID information stored in the memory differs from the ID information from the video processor device 20, the AI ​​information confirmation unit 13b determines that the source device is unauthorized, thereby preventing erroneous operational assistance from being provided to the user.

[0045] Furthermore, as described above, the source device information received by the connection destination confirmation unit 13a includes not only the ID information of the video processor device 20, but also information on the operation and manipulation information of the video processor device 20, including information on the endoscope to be connected and information on the examination, as well as information on the video format, etc. The connection destination confirmation unit 13a may determine the legitimacy of the device based on this information on the operation, manipulation, and video format, etc. Furthermore, the connection destination confirmation unit 13a may determine the legitimacy of the device using information from the AI ​​information confirmation unit 13b and the results of AI determination.

[0046] For example, when the AI ​​information confirmation unit 13b determines that the same image has been continuously input in a case where the endoscopic image of the input information should change due to a change in the operation of the video processor device 20, the connection destination confirmation unit 13a may determine that the device is invalid, and when the AI ​​information confirmation unit 13b determines that the image has changed, the connection destination confirmation unit 13a may determine that the device is valid if the video format information matches the video format information determined by the AI ​​information confirmation unit 13b, and may determine that the device is invalid if they do not match. In this way, the connection destination confirmation unit 13a can determine the validity of the device based on the source device information from the video processor device 20 and the image recognition result of the AI ​​information confirmation unit 13b.

[0047] Furthermore, when operation information indicating that an endoscopic examination has started is input, for example, the connection destination confirmation unit 13a may determine that the device is legitimate if the AI ​​determination of the AI ​​determination unit 14 determines that the input image has changed to an image capturing the inside of the body, that is, a recognition result that the examination has started. Furthermore, the connection destination confirmation unit 13a may determine the legitimacy of the device based on whether or not operation information regarding an observation mode such as NBI or RDI matches the observation mode determined by the AI ​​determination result.

[0048] That is, the video processor device 20, which is a medical image generating device, can set an observation mode for the endoscope. Whether or not an endoscopic image obtained in the observation mode set by the video processor device 20 has been supplied as input information to the examination support device 10 is obtained by the AI ​​determination result. That is, the validity of the device is determined by determining whether or not the medical image generating device connected to the first communication route and the medical image generating device connected to the second communication route are the same.

[0049] In addition, if the connection destination confirmation unit 13a determines that the device is fraudulent through device validity judgment, it may be configured to output a signal to the AI ​​judgment unit 14 to stop the operation of the AI ​​judgment unit 14.

[0050] (Various Determinations) The AI ​​determination unit 14 may be capable of performing various AI determinations. For example, the AI ​​determination unit 14 may be capable of outputting endoscopic operation guide information as examination support information. The AI ​​determination unit 14 may also be capable of outputting control information for an automatically inserted endoscope. The AI ​​determination unit 14 may also be capable of outputting identification information for lesions and organ sites.

[0051] The input information confirmation unit 13 may be configured to control the AI ​​determination unit 14 not to output the examination assistance information when a device validity determination indicating that the sending device is invalid or an input eligibility determination indicating that the input information is not suitable for AI determination is obtained. Also, if the endoscope connected to the video processor device 20 is an automatically controlled endoscope capable of automatic insertion, when a device validity determination indicating that the sending device is invalid or an input eligibility determination indicating that the input information is not suitable for AI determination is obtained, the input information confirmation unit 13 may be configured to operate an emergency stop device (not shown) to stop the automatic insertion of the automatically controlled endoscope.

[0052] That is, when the input information confirmation unit 13 determines that the destination transmission device of the first communication route is the same as the destination transmission device of the second communication route, it outputs the inspection assistance information. Also, when the input information confirmation unit 13 determines that the destination transmission device of the first communication route is different from the destination transmission device of the second communication route, it outputs alert information related to the destination of the first communication route and the destination of the second communication route.

[0053] (Operation) Next, the operation of the embodiment configured as above will be described with reference to Fig. 4 to Fig. 6. Fig. 4 is a flowchart showing AI determination control by the AI ​​information confirmation unit 13b. Fig. 5 and Fig. 6 are flowcharts showing device legitimacy determination by the connection destination confirmation unit 13a.

[0054] An endoscope is connected to the video processor device 20, and an endoscopic image is obtained by driving the endoscope using the video processor device 20. For example, in order to provide operational support for an endoscopic examination, the input information output unit 22 of the video processor device 20 outputs an endoscopic image obtained by the endoscope to the examination support device 10 via the second communication route. Furthermore, the device information output unit 21 of the video processor device 20 outputs source device information, including information such as operational information and operation information of the video processor device 20 and the video format of the endoscopic image, to the examination support device 10 via the first communication route.

[0055] In S1 of FIG. 4, the AI ​​information confirmation unit 13b receives input information from the input information output unit 22 of the video processor device 20 to determine the input eligibility of the input information. The AI ​​information confirmation unit 13b determines whether the input information is an image suitable for AI judgment by performing image analysis on the medical image, which is the received input information, and analyzing the metadata of the input information (S2). If the AI ​​information confirmation unit 13b determines that the input information is an image suitable for AI judgment (YES determination in S2), it outputs an input eligibility determination result to the AI ​​judgment unit 14 to cause the AI ​​judgment unit 14 to perform AI judgment (S3). On the other hand, if the AI ​​information confirmation unit 13b determines that the input information is not an image suitable for AI judgment (NO determination in S2), it outputs an input eligibility determination result to the AI ​​judgment unit 14 to prevent the AI ​​judgment unit 14 from performing AI judgment (S4).

[0056] In this case, the AI ​​determination unit 14 does not perform AI determination. In addition, the input information confirmation unit 13 displays a warning message such as "This is not the target endoscope" or "The settings are different" on the display screen of the display unit 30.

[0057] If the AI ​​information confirmation unit 13b determines that the input information is suitable for AI judgment, it provides the input information to the AI ​​judgment unit 14. The AI ​​judgment unit 14 obtains an AI judgment result by recognition processing of the input information. The AI ​​judgment unit 14 outputs this AI judgment result to the input information confirmation unit 13.

[0058] 5, the connection destination confirmation unit 13a of the input information confirmation unit 13 receives source device information from the device information output unit 21 of the video processor device 20 to determine the authenticity of the source device. The connection destination confirmation unit 13a compares the received source device information with information stored in memory to determine whether the source device that transmitted the source device information is the target device (S12). If the connection destination confirmation unit 13a determines that the source device is authentic (YES determination in S12), it displays the AI ​​determination from the AI ​​determination unit 14 on the display unit 30 (S13). If the connection destination confirmation unit 13a determines that the source device is unauthorized (NO determination in S12), it does not display the AI ​​determination result from the AI ​​determination unit 14 on the display unit 30 (S14).

[0059] The example in Figure 5 shows an example in which the connection destination confirmation unit 13a determines the legitimacy of the sending device, for example, based on the ID information of the sending device, and decides whether to display or hide the AI ​​judgment result. However, the connection destination confirmation unit 13a may also use the output of the AI ​​information confirmation unit 13b and the AI ​​judgment unit 14 to determine the legitimacy of the sending device and decide whether to display or hide the AI ​​judgment result.

[0060] Fig. 6 shows an example of this case. In S31 of Fig. 6, the AI ​​information confirmation unit 13b of the input information confirmation unit 13 determines whether the input information is suitable for AI judgment. If the input information is not suitable for AI judgment, as described above, the AI ​​judgment is not performed. If the input information is suitable for AI judgment, the AI ​​judgment is performed, and the AI ​​judgment result is provided to the input information confirmation unit 13.

[0061] In S32, the input information confirmation unit 13 determines the legitimacy of the source device based on ID information, etc. (source determination). If the input information confirmation unit 13 determines that the source device is legitimate (YES determination in S33), it determines the start of inspection in the next S34. That is, when the input information confirmation unit 13 detects that inspection has started based on the source device information, it obtains an AI determination result indicating whether inspection has started from the AI ​​determination unit 14. If both the source device information and the AI ​​determination result indicate the start of inspection (YES determination in S35), the input information confirmation unit 13 determines the observation mode in the next S36.

[0062] When the input information confirmation unit 13 detects the observation mode based on the transmission source device information, it obtains an AI judgment result for the observation mode from the AI ​​judgment unit 14. If the transmission source device information and the AI ​​judgment result both indicate the same observation mode (YES judgment in S37), the input information confirmation unit 13 determines in the next S38 that the transmission source is a legitimate device. In this case, the input information confirmation unit 13 displays the AI ​​judgment result from the AI ​​judgment unit 14 on the display unit 30.

[0063] On the other hand, if the input information confirmation unit 13 judges NO in S33, S35, and S37, the input information confirmation unit 13 judges in S39 that the sender is not a legitimate device. In this case, the input information confirmation unit 13 does not display the AI ​​judgment result from the AI ​​judgment unit 14 on the display unit 30. In this case, the input information confirmation unit 13 displays a warning message on the display screen of the display unit 30, such as "This is not the target endoscope" or "The settings are different."

[0064] In this way, in this embodiment, not only is the legitimacy of the sending device determined, but the appropriateness of the input information is also determined, so it is possible to reliably determine that input information suitable for AI judgment has been input from the target device. This makes it possible to prevent an inappropriate AI judgment result from being displayed when an image inappropriate for AI processing is input due to a connection error or when AI judgment is performed on input information from a non-target device.

[0065] (Modification) Fig. 7 is a block diagram showing a modification. In Fig. 1, an example has been described in which the video processor device 20 transmits source device information and input information to the test assistance device 10. In the modification of Fig. 7, when identification information is superimposed on the input information and transmitted, information similar to this identification information is transmitted to the test assistance device 10 via a third communication cable C3 constituting a third communication route.

[0066] The video processor device 20A is obtained by adding an identification information output unit 23 to the video processor device 20. When identification information is added to input information from the device information output unit 21 and the input information is transmitted, the identification information output unit 23 outputs identification information having the same content as the identification information added to the input information to the test support device 10 via the third communication cable C3. The device information acquisition unit 11 of the test support device 10 receives the identification information output from the identification information output unit 23 and provides it to the input information confirmation unit 13.

[0067] Although an example has been shown in which the identification information output unit 23 outputs the identification information to the inspection support device 10 via the third communication cable C3, the third communication cable C3 may be omitted and the identification information may be supplied to the inspection support device 10 via the first communication cable C1.

[0068] The device information acquisition unit 11 of the test support device 10 provides the received identification information to the AI ​​information confirmation unit 13b. The AI ​​information confirmation unit 13b compares the identification information added to the input information with the identification information received via the third communication cable C3, and if it determines that these pieces of information have the same content, it may determine that the sender of the input information and the sender of the sending device match, and in some cases, it may further determine that the input information is suitable for AI judgment.

[0069] Other configurations and operations are the same as those of the embodiment shown in FIG.

[0070] According to the modified example configured in this manner, the same identification information is transmitted via the first communication route and the second (or third) communication route, making it relatively easy to determine the legitimacy of the sender of the input information.

[0071] The present invention is not limited to the above-described embodiments, and the components can be modified and embodied in practice without departing from the spirit of the invention. Furthermore, various inventions can be formed by appropriately combining multiple components disclosed in the above-described embodiments. For example, some of the components shown in the embodiments may be omitted. Furthermore, components from different embodiments may be appropriately combined.

Claims

1. An inspection support system, comprising: one or more processors having hardware; The processor, obtaining a video signal including information of the medical image; By performing a recognition process based on the video signal, examination assistance information for assisting the examination can be output, acquiring identification information included in the video signal and different from information of the medical image; Based on the identification information, it is determined whether the video signal is a video signal for the recognition process. An inspection support system comprising:

2. The processor, acquiring source device information relating to a source device that is a source of the medical image obtained by imaging the subject via a first communication route connected to the source device, and determining whether the source device to be connected is appropriate based on the source device information; The video signal is acquired via a second communication route connected to the transmission source device, and based on the video signal, it is determined whether or not the video signal is a video signal for the recognition process.

2. The inspection support system according to claim 1.

3. The processor determines whether the video signal is a video signal for the recognition processing based on a position of the medical image on an image obtained by imaging the video signal.

2. The inspection support system according to claim 1.

4. The processor determines whether the video signal is a video signal for the recognition process based on an aspect ratio of the medical image.

2. The inspection support system according to claim 1.

5. The processor determines whether the video signal is a video signal for the recognition process based on the image quality of the medical image.

2. The inspection support system according to claim 1.

6. The processor determines whether or not the video signal is a video signal for the recognition processing based on whether or not an image different from the medical image is superimposed on the medical image when the video signal is visualized.

2. The inspection support system according to claim 1.

7. The processor, If the video signal is appropriate, the recognition process is performed.

2. The inspection support system according to claim 1.

8. The identification information is a QR code.

8. The inspection support system according to claim 7.

9. The processor, obtaining information regarding the content of the identification information via a first communication route connected to a source device that is a source of the medical image; acquiring the identification information via a second communication route connected to the source device; Based on information regarding the content of the identification information acquired via the first communication route and the identification information acquired via the second communication route, it is determined whether or not a source device at a destination of the first communication route is the same as a source device at a destination of the second communication route.

8. The inspection support system according to claim 7.

10. the transmission source device is a medical image generating device that sets an observation mode and generates the medical image by observing a subject in the set observation mode; The processor, Obtaining information related to the setting of an observation mode via the first communication route acquiring the video signal via the second communication route; Based on whether the video signal corresponds to the setting of the observation mode, it is determined whether the medical image generating device connected to the first communication route is the same as the medical image generating device connected to the second communication route.

3. The inspection support system according to claim 2.

11. The processor outputs an alert when it determines that the video signal is not a video signal for the recognition process.

2. The inspection support system according to claim 1.

12. The processor, When it is determined that the image signal is not an image signal for the recognition process, the inspection support information is not output. When it is determined that the image signal is a video signal for the recognition process, the inspection support information is output.

2. The inspection support system according to claim 1.

13. The processor, outputting the inspection support information when it is determined that the first communication route is connected to a source device and the second communication route is connected to a source device; When it is determined that a source device at a destination of the first communication route is different from a source device at a destination of the second communication route, alert information relating to the destination of the first communication route and the destination of the second communication route is output.

10. The inspection support system according to claim 9.

14. The processor, outputting the inspection support information when it is determined that the first communication route is connected to a source device and the second communication route is connected to a source device; When it is determined that a source device at a destination of the first communication route is different from a source device at a destination of the second communication route, alert information relating to the destination of the first communication route and the destination of the second communication route is output. The inspection support system according to claim 10 .

15. The processor, performing the recognition process by inputting the video signal to a recognition processing device that has been trained using a training medical image; When at least one of the aspect ratio and image quality of the medical image is different from the aspect ratio and image quality of the learning medical image, or when another image is superimposed on the medical image, the video signal is determined to be not a video signal for the recognition processing.

2. The inspection support system according to claim 1.

16. The processor outputs, as the examination support information, operation guide information for an endoscope.

2. The inspection support system according to claim 1.

17. The processor outputs control information for an automatically controlled endoscope as the examination support information.

2. The inspection support system according to claim 1.

18. A method for assisting an examination, comprising: obtaining a video signal containing information of the medical image; obtaining identification information included in the video signal and different from information of the medical image; determining whether the video signal is a video signal for the recognition process based on the identification information; outputting examination assistance information for assisting an examination using the medical image by performing recognition processing based on the video signal; An inspection support method comprising:

19. Acquire source device information relating to a source device that is a source of a medical image, determining whether the destination transmission device is appropriate based on the transmission source device information; obtaining a video signal including information of the medical image; By performing a recognition process based on the video signal, examination assistance information for assisting the examination can be output, Based on the video signal, it is determined whether the video signal is a video signal for the recognition process. A method for controlling a medical device.

20. Obtaining source device information relating to a source device that is a source of a medical image; determining whether the destination transmission device is appropriate based on the transmission source device information; obtaining a video signal including information of the medical image; By performing a recognition process based on the video signal, examination assistance information for assisting the examination can be output, Based on the video signal, it is determined whether the video signal is a video signal for the recognition process. A recording medium on which a program for causing a computer to execute a procedure is recorded.