Practical skill training system for ultrasonic examination

Abstract

To provide a practical skill training system that supports improvement of the visualization technique by an examiner of an ultrasonic diagnostic apparatus.SOLUTION: A practical skill training system includes: an intake unit that takes in a visualization cross section output from an ultrasonic diagnostic apparatus; a determination unit that determines the quality of the taken-in visualization cross section by performing internal processing on the basis of the visualization state of all or part of a structure being the visualization target in the visualization cross section, and the visualization state of a structure adjacent to the structure being the visualization target in the visualization cross section; an output unit that outputs the result of the determination; and a presentation unit that presents an instruction to support visualization of the cross section according to the determination result output from the output unit. Accordingly, even without guidance from an instructor, the examiner can achieve appropriate cross-sectional visualization by performing scanning in accordance with the instruction presented by the presentation unit.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to a practical training system that supports practical training in ultrasonic inspection and enables an inspector to acquire echoes through self-study.

Background Art

[0002] An ultrasonic diagnostic apparatus system is known that images internal structures such as a subject's organs from the outside using an ultrasonic diagnostic apparatus and displays the image on a monitor. Recently, in image diagnosis using an endoscope or the like, an inspection support apparatus that automatically analyzes the captured image by the system and notifies the inspector of the result of the analysis to assist in the diagnosis is also becoming widespread (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, such existing inspection support apparatuses are solely aimed at assisting in diagnosis, such as automatically analyzing the captured image and presenting a diagnosis result, and do not support the education of inspectors, such as proper operation of the diagnostic apparatus by the inspector and improvement of drawing techniques. As a result, in order for the inspector to improve drawing techniques, it is necessary to learn from a supervisor such as a senior doctor, and the guidance cost is high in a busy medical field. In addition, since the opportunity to receive guidance is limited, it cannot be said that the improvement of drawing techniques has been achieved efficiently.

[0005] The present invention has been made to solve such problems, and provides a practical training system that supports improvement of the drawing technique by an inspector by performing quality determination of a drawn cross-section drawn by the inspector using an ultrasonic diagnostic apparatus.

Means for Solving the Problem

[0006] The practical education system in the present invention includes an acquisition unit that acquires a depicted cross-section output from an ultrasonic diagnostic apparatus, a determination unit that internally processes the determination of the quality of the acquired depicted cross-section based on the depicted state of the whole or a part of the structure to be depicted in the depicted cross-section and the depicted state of the structure adjacent to the structure to be depicted in the depicted cross-section, an output unit that outputs the result of the determination, and a presentation unit that presents an instruction for supporting the depiction of the cross-section according to the result of the determination output from the output unit.

Advantages of the Invention

[0007] According to the present invention, an inspector can achieve appropriate cross-section depiction by performing scanning according to the instruction by the presentation unit without receiving guidance from an instructor.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Embodiments for Carrying Out the Invention

[0009] Hereinafter, the present invention will be described through embodiments of the invention. However, the invention according to the claims is not limited to the following embodiments. Also, not all of the configurations described in the embodiments are necessarily essential as means for solving the problems.

Example

[0010] The practical education system 110 in Example 1 of the present invention supports the improvement of the drawing technique by the examiner for the ultrasonic examination of the heart (echocardiogram).

[0011] The practical education system 110 in Example 1 of the present invention includes an acquisition unit 111 that acquires the echocardiogram cross-section 6 of the heart output from the ultrasonic diagnostic apparatus 1, and determines the quality of the acquired echocardiogram cross-section 6 based on the drawing state of all or part of the structure to be drawn in the echocardiogram cross-section 6 and the drawing state of the structure adjacent to the structure to be drawn in the echocardiogram cross-section 6. A determination unit 112 that performs internal processing, an output unit 113 that outputs the result of the determination, and a presentation unit 114 that presents an instruction to support the drawing of the cross-section according to the result of the determination output from the output unit 113. Hereinafter, each configuration will be described.

[0012] The acquisition unit 111 included in the hardware 8 of the present practical education system 110 acquires the echocardiogram cross-section 6 of the heart drawn by the examiner 3 scanning the ultrasonic diagnostic apparatus 1. This acquisition can be performed by directly imaging the monitor screen 5 of the ultrasonic diagnostic apparatus 1 with a camera when the acquisition unit 111 is equipped with a camera, and when not equipped with a camera or not using a camera, the data can be acquired by a general wired connection or wireless connection between the acquisition unit 111 and the ultrasonic diagnostic apparatus 1. As the hardware 8 of the present practical education system 110, a dedicatedly designed terminal / device or an existing terminal such as a personal computer, a smartphone, or a tablet can be used.

[0013] When the capturing unit 111 captures the drawing cross-section 6, it pattern-recognizes and cuts out the drawing cross-section 6 from the echo output screen, which is the raw data captured from the ultrasonic diagnostic apparatus 1 and includes various displays other than the drawing cross-section 6.

[0014] Next, the determination unit 112 determines the quality of the captured drawing cross-section 6. The determination unit 112 is included in the hardware 8 of the present practical education system 110. The determination unit 112 has a storage unit, and the storage unit stores an algorithm 100 described later. The algorithm 100 may be pre-implemented in the storage unit, or may be installed or updated in the storage unit through an electric communication line such as the Internet or a memory terminal. The determination unit 112 applies the captured drawing cross-section 6 to the algorithm 100, thereby determining the quality of the drawing cross-section 6. In this determination, the target structure that should originally be included in the drawing cross-section 6 is automatically picked up. Then, the determination is made by the algorithm 100 based on the drawing state of the whole or a part of the structure to be drawn in the drawing cross-section 6 and the drawing state of the structure adjacent to the structure to be drawn in the drawing cross-section 6. Briefly speaking, this determination aims to determine whether the drawing cross-section 6 has a sufficient quality to be used for diagnosis.

[0015] For example, in the case of a four-chamber view (a cross-section in which the four chambers of the left atrium, left ventricle, right atrium, and right ventricle are drawn. Here, mainly the four chambers of the left atrium, left ventricle, right atrium, and right ventricle correspond to the structures to be drawn), which is one of the typical drawing cross-sections 6 in ultrasonic diagnosis of the heart, all four chambers of the left atrium, left ventricle, right atrium, and right ventricle need to be drawn in an appropriate shape in the cross-section that can be used for diagnosis. In the determination by the algorithm 100 of the determination unit 112, the quality is determined based on how many of the four chambers of the left atrium, left ventricle, right atrium, and right ventricle are included in the drawing cross-section 6, whether the drawn shape of the drawn chambers is appropriate, and what and in what shape the structures around the four chambers are drawn. Examples of the structures around the four chambers (structures adjacent to the structure to be drawn) include the mitral valve, tricuspid valve, liver, superior vena cava, ascending aorta, pulmonary artery, etc.

[0016] Here, the criteria for quality determination were described by taking the four-chamber view of the heart as an example. However, in cross-sections other than the four-chamber view (including basic cross-sections frequently used in echocardiography of the heart, such as the long-axis cross-section and short-axis cross-section of the heart), the quality determination is commonly based on the depiction state of the whole or a part of the target structure, and the depiction state of the structure adjacent to the target structure depicted in the depicted cross-section 6.

[0017] In the quality determination, based on the depiction state of the whole or a part of the target structure, and the depiction state of the structure adjacent to the target structure depicted in the depicted cross-section 6, it is determined how much the captured depicted cross-section 6 deviates from an appropriate cross-section (hereinafter referred to as the ideal cross-section 7) originally used for diagnosis. The deviation is calculated in two ways. In the first way, it is calculated as the matching rate (%) between the depicted cross-section 6 and the ideal cross-section 7. For example, if the depicted cross-section 6 is determined to be identical to the ideal cross-section 7, the matching rate is 100%, and as the depicted cross-section 6 deviates from the ideal cross-section 7, the matching rate decreases. And if the matching rate exceeds a threshold set as appropriate, an "OK" determination is output, and if it is below the threshold, an "NG" determination is output.

[0018] The above-mentioned algorithm 100 is a known machine learning algorithm such as a convolutional neural network (CNN), and the above-mentioned appropriately set threshold is appropriately set according to the learning accuracy of the machine learning algorithm and the usability of the practical training system 110. Needless to say, by changing the target cross-section of the teacher data used in machine learning (in the case of the heart, the echocardiogram depicted cross-section image is the teacher data), the present practical training system 110 can be applied to various depicted cross-sections of the heart. Also, in the present invention, by using the depicted cross-section image as the teacher data, it has become possible to easily collect and learn the teacher data compared to the case of using other data (such as 3D data, etc.) as the teacher data.

[0019] In the second system, the direction of deviation of the drawn cross-section 6 from the ideal cross-section 7 is calculated. By analyzing, with algorithm 100, the drawn state of the whole or a part of the structure to be drawn and the drawn state of the structure adjacent to the structure to be drawn in the drawn cross-section 6, it is possible to quantitatively determine in which direction (position and angle) and by how much the captured drawn cross-section 6 deviates from the ideal cross-section 7.

[0020] As an example, FIG. 5 shows a state of a drawn cross-section 6 in which, when the four chambers of the left atrium, left ventricle, right atrium, and right ventricle are the structures to be drawn, the ventricular septum, a part of the tricuspid valve, and a part of the wall between the right ventricle and the right atrium that should originally be included in the ideal cross-section 7 are not included. The algorithm 100 of this embodiment can quantitatively determine in which direction (position and angle) and by how much the captured drawn cross-section 6 deviates from the ideal cross-section 7 by analyzing the drawn state of the drawn cross-section 6.

[0021] Next, the output unit 113 outputs the result of the above determination to the presentation unit 114. The output unit 113 and the presentation unit 114 are included in the hardware 8 of the present practical education system 110.

[0022] The presentation unit 114 presents instructions for supporting the drawing of cross-sections. As instructions, various forms can be considered as long as they support the drawing of cross-sections by the examiner 3. In this embodiment, for example, the conformity rate calculated in the first system and the "OK" or "NG" determination 121 are output. The presentation unit 114 has a display device 9, and the above output is performed on the display device 9. As the display device 9, any one or a combination of a monitor, a speaker, and a light source can be used. It is also possible to output and display the time (TIME) required until the conformity rate becomes "OK".

[0023] The prompting unit 114 can also present, as an instruction, the scanning 122 necessary to bring the drawn cross-section 6 closer to the ideal cross-section 7 according to the deviation from the ideal cross-section 7 calculated in the second system. The necessary scanning 122 includes changes in the contact position of the probe 2 of the ultrasonic diagnostic apparatus 1 (the terminal used for examination by contacting the subject 4) on the body surface, the contact angle, and the direction. By scanning the probe 2 along this instruction, the examiner 3 can finally draw the same cross-section as the ideal cross-section 7 by himself / herself. This instruction is also presented in a form that is easy for the examiner 3 to refer to by any one or a combination of a monitor, a speaker, and a light source, which are the display devices 9.

[0024] In the first embodiment, it was assumed that the determination unit 112 and the output unit 113 are included in the hardware 8 of the practical skill education system 110. However, it is also possible to adopt a configuration in which the determination unit 112 and / or the output unit 113 are included in a server located at a place away from the site where the examiner 3 scans the ultrasonic diagnostic apparatus 1. When the determination unit 112 and / or the output unit 113 are included in the server, the determination unit 112 and / or the output unit 113 communicate with other components of the practical skill education system 110 through an electric communication line such as the Internet.

Embodiment

[0025] Next, a second embodiment of the present invention will be described. Also in the second embodiment, the basic configuration of the invention is the same as that of the first embodiment, but it is different in that it has an information processing unit 215 having the following functions (however, it does not mean that there is no information processing unit for performing general information processing in the first embodiment either). The information processing unit 215 may be included in either the hardware 8 of the practical skill education system 210 or a server located at a place away from the site where the examiner 3 scans the ultrasonic diagnostic apparatus 1.

[0026] The information processing unit 215 performs information processing on the imaging cross-section 6 output from the ultrasonic diagnostic apparatus 1 and captured by the capture unit 211, processes it into a cross-section in the event of a disease occurring in the structure included in the imaging cross-section 6, and outputs it to the output unit 213 and the presentation unit 214. The result of this output is presented to the examiner 3 through the display device 9.

[0027] Here, the four-chamber image (a cross-section in which the four chambers of the left atrium, left ventricle, right atrium, and right ventricle are imaged. Here, the four chambers of the left atrium, left ventricle, right atrium, and right ventricle correspond to the target structure) used in the description of Example 1 will be taken as an example again for explanation. In the four-chamber image, for example, there is a disease in which the interventricular septum 223 between the right ventricle and the left ventricle is defective, which is called ventricular septal defect. The information processing unit can perform information processing on the imaging cross-section 6 without abnormalities to delete the interventricular septum 223, thereby outputting a cross-section as if it were a ventricular septal defect (hereinafter, a cross-section that has been information-processed as if it were some kind of disease will be referred to as a false disease cross-section 224). Naturally, the false disease cross-sections 224 that can be output as a result of information processing include those of various heart diseases and are not limited to ventricular septal defect.

[0028] For the output of this false disease cross-section 224, an adversarial generation network model, which is a derivative model of a neural network, or a model equivalent thereto is used. The adversarial generation network model is a general-purpose technology that has already been used in image processing tasks (such as converting a person's expression), and can also be implemented by using the same technology in this embodiment.

[0029] Also, with the adversarial generation network model or a model equivalent thereto, in this embodiment, it is also possible to complement and reproduce the imaging target organ that has become invisible due to artifacts (when ribs or surrounding organs block the ultrasonic waves emitted from the probe 2 and a shadow is projected onto the imaging cross-section 6) through information processing.

[0030] As a result, even when the examiner 3 is practicing an ultrasonic examination of the heart on a healthy subject, he or she can learn how various heart disease cross-sections look.

[0031] In any of the above-described first and second embodiments, the presentation of the instruction for supporting the drawing of the cross-section can also be performed in real time according to the result of the determination by the determination unit. As a result, the examiner 3 can correct the scanning position, angle, and direction in real time while referring to the instruction, and can practice efficiently.

[0032] In addition, in the above embodiment, the ultrasonic examination targeting the heart has been described as an example. However, the target of the practical education system of the present invention is not limited to the heart, and it can be applied to each organ and part that is the target of the ultrasonic examination. Needless to say, by changing the target organ and part of the teacher data used for machine learning (the drawn cross-sectional images of each organ and part are the teacher data), the present practical education system can be applied to the drawn cross-sections of various organs and parts. For example, it includes the target organs and parts of abdominal echocardiogram and vascular echocardiogram, and the target organs and parts of FAST, which are important in the emergency treatment of trauma patients.

[0033] Furthermore, the practical education system of the present invention can also include a tutorial that summarizes the basic knowledge required for the ultrasonic examination of each organ (for example, including general knowledge required for appropriately performing the ultrasonic examination, such as the positional relationship of anatomical organs, etc.) and the operation method of this system, and can be presented to the examiner 3 through the display device 9. The examiner 3 can improve skills more smoothly by practicing ultrasonic examination with reference to or while referring to the tutorial. For example, FIG. 2 shows a state in which the ideal cross-section 7 of the heart is displayed on the display device 9 (monitor display screen) of the present practical education system. As a result, the examiner 3 can practice efficiently while always checking the ideal cross-section 7. Of course, the presentation of the tutorial is not limited to such a form, and both the form and content of the presentation can be in various forms that contribute to the efficient practice of the examiner.

Explanation of reference numerals

[0034] 1 Ultrasonic diagnostic apparatus 2 Probe 3 Examiner 4 Subject to be examined 5 Monitor screen 6 Drawn cross-section 7 Ideal cross-section 8 Hardware 9 Display device

Claims

1. A hands-on education system for supporting ultrasonic diagnosis practice, comprising: a capturing unit that captures a tomographic image output from an ultrasonic diagnostic apparatus; a determination unit that internally processes and determines the quality of the captured tomographic image based on the depiction state of all or part of the structure to be depicted in the tomographic image and the depiction state of the structure adjacent to the structure to be depicted in the tomographic image; an output unit that outputs the result of the determination; and a presentation unit that presents an instruction for supporting the depiction of the cross-section according to the result of the determination output from the output unit.

2. The hands-on education system according to claim 1, wherein the capturing unit captures the tomographic image of the ultrasonic diagnostic apparatus by means of a camera, a wired connection or a wireless connection.

3. The hands-on education system according to claim 1, wherein the presentation of the instruction for supporting the depiction of the cross-section is performed in real time according to the result of the determination.

4. The hands-on education system according to claim 1, further comprising an information processing unit that performs information processing on the tomographic image output from the ultrasonic diagnostic apparatus and captured by the capturing unit, and outputs the processed image of the cross-section in the case of a disease occurring in the structure included in the tomographic image.

Images