Information processing method, information processing device, program, and information processing system

Abstract

To evaluate comprehensiveness of an endoscopic examination without a restriction condition related to information obtained by the endoscopic examination.SOLUTION: In a secondary image reading support method, a computer executes a step of acquiring an endoscopic image obtained by an endoscopic examination on a subject, and executes a step of evaluating the comprehensiveness of the endoscopic examination on the basis of the endoscopic image.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to a secondary image interpretation support method, a secondary image interpretation support device, and a program. [Background technology]

[0002] Generally, after an endoscopic image is obtained during an endoscopic examination by a doctor in charge of the endoscopic examination (hereinafter referred to as the "endoscopic examiner"), a primary reading is performed by the endoscopy examiner, and a secondary reading is performed by a medical professional in charge of secondary reading (hereinafter referred to as the "secondary reading examiner"). The quality of the endoscopy and the primary reading each depend on the skill of the endoscopist. If the endoscopy technician lacks the necessary skills, it is difficult to make an appropriate diagnosis through secondary reading. For this reason, in secondary interpretation, it is particularly important to consider whether the person performing the endoscopy has thoroughly observed the organs that are the subject of the endoscopic examination (hereafter referred to as "target organs") (i.e., comprehensiveness).

[0003] Techniques are known that allow a secondary image reader to easily check the completeness. For example, Patent Document 1 discloses a medical information processing device equipped with a processor, which executes a spatial information acquisition process that sequentially acquires spatial information of a lumen based on endoscopic images acquired sequentially by an endoscope scope, an estimation process that estimates at least one of a three-dimensional environmental map of the lumen and the tip position of the endoscope scope based on the sequentially acquired spatial information, a reference information acquisition process that acquires reference information regarding the shape and / or absolute size of the lumen, and a correction process that uses the reference information to correct one or more of the spatial information, the three-dimensional environmental map, and the tip position of the endoscope scope. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] International Publication No. WO2022-202520 Summary of the Invention [Problem to be solved by the invention]

[0005] The technique of Patent Document 1 executes an estimation process for estimating at least one of a three-dimensional environmental map of a lumen and the tip position of an endoscope. Therefore, if a 3D environmental map of the lumen and the tip position of the endoscope cannot be obtained, the comprehensiveness cannot be evaluated. In other words, when assessing comprehensiveness, there are constraints regarding the information that can be obtained through endoscopic examination.

[0006] The object of the present invention is to evaluate the comprehensiveness of an endoscopic examination without any constraints regarding the information obtained by the endoscopic examination. [Means for solving the problem]

[0007] One aspect of the present invention is The computer Acquiring an endoscopic image obtained by an endoscopic examination on a subject; a step of evaluating the comprehensiveness of the endoscopic examination based on the endoscopic image; It is. [Brief description of the drawings]

[0008] [Figure 1] 1 is a block diagram showing a configuration of an information processing system according to an embodiment of the present invention; [Diagram 2] FIG. 2 is a functional block diagram of the information processing system of FIG. 1. [Diagram 3] FIG. 1 is an explanatory diagram of an overview of the present embodiment. [Figure 4] FIG. 2 is a diagram showing a data structure of a database according to the present embodiment. [Diagram 5] FIG. 1 is a diagram showing an overall configuration of information processing according to an embodiment of the present invention. [Figure 6] FIG. 11 is a sequence diagram of the process of primary interpretation. [Figure 7]7A and 7B are diagrams showing examples of screens displayed in the information processing of FIG. 6. [Figure 8] FIG. 4 is a sequence diagram of an evaluation process according to the present embodiment. [Figure 9] FIG. 2 is a sequence diagram of the process of secondary interpretation according to the present embodiment. [Figure 10] 10A and 10B are diagrams illustrating an example of a screen displayed in the information processing of FIG. 9. [Figure 11] FIG. 13 is a sequence diagram of an evaluation process according to the first modified example. [Figure 12] FIG. 12 is an explanatory diagram of the classification process in FIG. [Figure 13] FIG. 11 is a sequence diagram of the secondary interpretation process of the first modified example. [Figure 14] 14 is a diagram showing an example of a screen displayed in the information processing of FIG. 13. [Figure 15] FIG. 11 is an explanatory diagram of an overview of Modification 2. [Figure 16] FIG. 13 is a sequence diagram of an evaluation process according to the second modified example. [Figure 17] FIG. 11 is a sequence diagram of the secondary interpretation process of the modified example 2. [Figure 18] 13A and 13B are diagrams showing example screens displayed in information processing according to the second modified example. [Figure 19] FIG. 13 is an explanatory diagram of an overview of Modification 3. [Figure 20] FIG. 13 is a sequence diagram of an evaluation process according to the third modified example. [Figure 21] FIG. 11 is a sequence diagram of the secondary interpretation process of the modified example 3. [Figure 22] 13A and 13B are diagrams showing examples of screens displayed in information processing according to the third modified example. [Diagram 23] FIG. 23 is a diagram showing a specific example of the progress map image in FIG. 22. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. In the drawings for explaining the embodiment, the same components are generally designated by the same reference numerals, and the repeated description will be omitted.

[0010] In this embodiment, the terms are used in the following sense.

[0011] Comprehensiveness is the ratio of the area covered by endoscopic images to the entire organ that is the subject of endoscopic examination (hereinafter referred to as the "target organ"). The higher the comprehensiveness, the more thoroughly the target organ can be observed during endoscopic examination.

[0012] (1) Information Processing System Configuration The configuration of the information processing system will be described below. Fig. 1 is a block diagram showing the configuration of the information processing system of this embodiment. Fig. 2 is a functional block diagram of the information processing system of Fig. 1.

[0013] As shown in FIG. 1, the information processing system 1 includes a secondary interpretation client device 10, a primary interpretation client device 20, a server 30, and an endoscope device 40. The secondary interpretation client device 10, the primary interpretation client device 20, and the server 30 are connected to each other via the Internet or an intranet.

[0014] The client device 10 for secondary interpretation and the client device 20 for primary interpretation are computers (examples of "secondary interpretation support devices") that transmit requests to the server 30. The client device 10 for secondary interpretation and the client device 20 for primary interpretation are, for example, a smartphone, a tablet terminal, or a personal computer.

[0015] The endoscopic device 40 is configured to generate an endoscopic image of the inside of the organ by imaging the inside of the organ. The endoscopic image may include, for example, at least one of the following: Multiple still images Video (i.e. a collection of multiple still images)

[0016] The server 30 is a computer (an example of a "secondary interpretation support device") that provides a response to a request transmitted from the client device 10 for secondary interpretation or the client device 20 for primary interpretation to the client device 10 for secondary interpretation or the client device 20 for primary interpretation. The server 30 is, for example, a web server.

[0017] (1-1) Configuration of the secondary reading client device The configuration of the secondary interpretation client device 10 will be described.

[0018] As shown in FIG. 2, the secondary interpretation client device 10 includes a storage device 11, a processor 12, an input / output interface 13, and a communication interface .

[0019] The storage device 11 is configured to store programs and data. The storage device 11 is, for example, a combination of a Read Only Memory (ROM), a Random Access Memory (RAM), and a storage (for example, a flash memory or a hard disk).

[0020] The programs include, for example, the following programs: ·OS (Operating System) programs Parameters, functions, and models used in information processing · Programs for applications that process information (e.g. web browsers)

[0021] The data includes, for example, the following data: Databases referenced in information processing Data obtained by performing information processing (i.e., the results of performing information processing)

[0022] The processor 12 is configured to realize the functions of the secondary interpretation client device 10 by starting a program stored in the storage device 11. The processor 12 is, for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or a combination of these.

[0023] The input / output interface 13 is configured to receive user instructions from an input device connected to the client apparatus 10 for secondary interpretation, and to output information to an output device connected to the client apparatus 10 for secondary interpretation. The input device is, for example, a keyboard, a pointing device, a touch panel, or a combination thereof. The output device is, for example, a display.

[0024] The communication interface 14 is configured to control communication between the secondary interpretation client device 10 and the server 30 .

[0025] (1-2) Configuration of the client device for endoscopic examination The configuration of the primary image interpretation client device 20 will be described.

[0026] As shown in FIG. 2, the primary interpretation client device 20 includes a storage device 21, a processor 22, an input / output interface 23, and a communication interface 24.

[0027] The storage device 21 is configured to store programs and data, and is, for example, a combination of a ROM, a RAM, and a storage (for example, a flash memory or a hard disk).

[0028] The programs include, for example, the following programs: ·OS (Operating System) programs Parameters, functions, and models used in information processing · Programs for applications that process information (e.g. web browsers)

[0029] The data includes, for example, the following data: Databases referenced in information processing Data obtained by performing information processing (i.e., the results of performing information processing)

[0030] The processor 22 is configured to realize the functions of the primary interpretation client device 20 by starting a program stored in the storage device 21. The processor 22 is, for example, a CPU, a GPU, an ASIC, an FPGA, or a combination thereof.

[0031] The input / output interface 23 is configured to receive user instructions from an input device connected to the primary image interpretation client apparatus 20 and to output information to an output device connected to the primary image interpretation client apparatus 20 . The input device is, for example, a keyboard, a pointing device, a touch panel, or a combination thereof. The output device is, for example, a display.

[0032] The communication interface 24 is configured to control communication between the primary interpretation client device 20 and the server 30 .

[0033] (1-3) Server configuration The configuration of the server 30 will now be described.

[0034] As shown in FIG. 2, the server 30 includes a storage device 31, a processor 32, an input / output interface 33, and a communication interface .

[0035] The storage device 31 is configured to store programs and data, and is, for example, a combination of a ROM, a RAM, and a storage (for example, a flash memory or a hard disk).

[0036] The programs include, for example, the following programs: -OS programs Parameters, functions, and models used in information processing Application programs that perform information processing

[0037] The data includes, for example, the following data: Databases referenced in information processing Results of information processing

[0038] The processor 32 is configured to realize the functions of the server 30 by running a program stored in the storage device 31. The processor 32 is, for example, a CPU, a GPU, an ASIC, an FPGA, or a combination thereof.

[0039] The input / output interface 33 is configured to receive user instructions from an input device connected to the server 30 , and to output information to an output device connected to the server 30 . The input device is, for example, a keyboard, a pointing device, a touch panel, or a combination thereof. The output device is, for example, a display.

[0040] The communication interface 34 is configured to control communication between the server 30 and the secondary interpretation client device 10 and the primary interpretation client device 20 .

[0041] (2) Overview of the embodiment An overview of this embodiment will be described below with reference to Fig. 3, which is an explanatory diagram of the overview of this embodiment.

[0042] As shown in FIG. 3, an endoscopy technician uses an endoscopy device 40 to capture endoscopic images of the subject's organs while performing primary interpretation of the endoscopic images, thereby diagnosing the condition of the subject's organs. The person in charge of the endoscopy transmits the endoscopic image to the server 30 using the client device 20 for primary image interpretation.

[0043] The server 30 evaluates the comprehensiveness of the endoscopic examination based on the endoscopic images transmitted from the primary image interpretation client device 20.

[0044] The person in charge of secondary image interpretation uses the client device 10 for secondary image interpretation to obtain the endoscopic images and the evaluation result of the comprehensiveness from the server 30. The person in charge of secondary interpretation refers to the endoscopic images and the comprehensiveness evaluation results, and performs secondary interpretation of the endoscopic images to diagnose the condition of the subject's organs.

[0045] (3) Database The database of this embodiment will now be described with reference to Fig. 4, which shows the data structure of the database of this embodiment.

[0046] The database of FIG.

[0047] (3-1) User database The user database of this embodiment will now be described.

[0048] User information is stored in the user database of Fig. 4. The user information is information relating to a user of the information processing system 1. The user database includes a "user ID" field, a "user name" field, and a "user attribute" field. Each field is associated with another.

[0049] The "user ID" field stores user identification information. User identification information is information for identifying a user.

[0050] The "user name" field stores user name information. The user name information is information related to the user name.

[0051] The "user attribute" field stores user attribute information. The user attribute information is information related to the attributes of a user. The "user attribute" field includes a "gender" field, an "age" field, a "role" field, and an "affiliation" field.

[0052] The "gender" field stores gender information. The gender information is information about the gender of the user.

[0053] The "age" field stores age information. The age information is information about the age of the user.

[0054] The "role" field stores role information. The role information is information about the role of the user. The role includes, for example, the following: Endoscopy technician Secondary reader

[0055] The "affiliation" field stores affiliation information. The affiliation information is information related to the affiliation of the user. The affiliation may be, for example, at least one of the following: Medical institutions ·Academia ·University

[0056] (3-2) Subject Database The subject database of this embodiment will be described.

[0057] Subject information is stored in the subject database in Fig. 4. The subject information is information relating to subjects. The subject database includes a "subject ID" field, a "subject name" field, and a "subject attribute" field. Each field is associated with another.

[0058] The "Subject ID" field stores subject identification information. The subject identification information is information for identifying a subject.

[0059] The "subject name" field stores subject name information. The subject name information is information about the subject's name.

[0060] The "subject attribute" field stores subject attribute information. The subject attribute information is information related to the attributes of the subject. The "subject attribute" field includes a "gender" field and an "age" field.

[0061] The "gender" field stores gender information. The gender information is information about the gender of the subject.

[0062] The "age" field stores age information. The age information is information about the age of the subject.

[0063] (3-3) Endoscopic examination log database The endoscopic examination log database of this embodiment will be described.

[0064] Endoscopic examination log information is stored in the endoscopic examination log database of Fig. 4. The endoscopic examination log information is information relating to the history of endoscopic examinations. The endoscopic examination log database includes an "endoscopic examination log ID" field, a "timestamp" field, a "status" field, a "subject ID" field, an "endoscopic examination" field, a "primary reading" field, a "classification" field, an "evaluation" field, and a "secondary reading" field. Each field is associated with another.

[0065] The "endoscopic examination log ID" field stores endoscopic examination log identification information. The endoscopic examination log identification information is information for identifying an endoscopic examination log.

[0066] The "Timestamp" field stores information regarding the date and time the endoscopy was performed.

[0067] The "status" field stores status information. The status information is information about the status of the endoscopy. The status includes, for example, the following: "Complete (endoscopy)" means that the endoscopy has been completed. "Complete (first reading)": means that the first reading has been completed "Complete (Evaluation)": Indicates that the evaluation of the endoscopic image has been completed. "Complete (secondary reading)": means that the secondary reading has been completed.

[0068] The "subject ID" field stores subject identification information (hereinafter referred to as "target subject identification information") of a subject who is the subject of an endoscopic examination (hereinafter referred to as "target subject").

[0069] The "endoscopic examination" field stores endoscopic examination information. The endoscopic examination information is information related to an endoscopic examination. The "endoscopic examination" field includes an "endoscopic examination specialist ID" field, an "endoscopic image" field, and a "primary diagnosis" field.

[0070] The "endoscopic examination practitioner ID" field stores identification information for identifying the person in charge of endoscopic examination. The identification information for identifying the person in charge of endoscopic examination is information for identifying the person in charge of endoscopic examination.

[0071] The "endoscopic image" field stores an endoscopic image obtained by an endoscopic examination.

[0072] The "primary diagnosis" field stores primary diagnosis information. The primary diagnosis information is information about the result of a diagnosis (hereinafter referred to as "primary diagnosis") made by an endoscopy technician on an endoscopic image (e.g., the findings of the endoscopy technician).

[0073] The "classification" field stores classification information. The classification information is information on the accuracy rate for each classification of the parts of the organs captured in the endoscopic image.

[0074] The "Evaluation" field stores evaluation information. The evaluation information is information regarding the evaluation of an endoscopic examination. The evaluation information is generated by the server 30. The "Evaluation" field includes a "Comprehensiveness" field, an "Image Quality" field, a "Skill" field, and a "Progress" field.

[0075] The "Comprehensiveness" field stores the evaluation result of the comprehensiveness. A higher comprehensiveness evaluation result means that more parts of the organ are captured in the endoscopic image (i.e., the coverage range is larger).

[0076] The "image quality" field stores the evaluation result of the image quality. A higher evaluation result of the image quality means a clearer endoscopic image.

[0077] The "skill" field stores the skill evaluation result. A higher skill evaluation result indicates that the endoscopist's skill is higher (i.e., the endoscopist has performed an endoscopic examination).

[0078] The "degree of progression" field stores the evaluation result of the degree of progression. The degree of progression means the presence or absence or the degree of a lesion occurring in an organ. The higher the evaluation result of the degree of progression, the higher the degree of progression of the lesion in the target organ (e.g., the higher the need for treatment).

[0079] The "secondary interpretation" field stores secondary interpretation information. The secondary interpretation information is information related to secondary interpretation. The "secondary interpretation" field includes a "secondary interpretation person ID" field and a "secondary diagnosis" field.

[0080] The "secondary image interpretation person ID" field stores user identification information of the secondary image interpretation person.

[0081] The "secondary diagnosis" field stores secondary diagnosis information. The secondary diagnosis information is information about the result of a diagnosis (hereinafter referred to as "secondary diagnosis") made by a secondary image reader on an endoscopic image (e.g., the findings of the secondary image reader).

[0082] (4) Information processing The information processing of this embodiment will be described with reference to Fig. 5, which is a diagram showing the overall configuration of the information processing of this embodiment.

[0083] As shown in FIG. 5, the information processing of the present invention includes the following processes. · Primary Reading (PR11) Rating(PR12) Secondary Reading (PR13)

[0084] (4-1) Primary Reading (PR11) The process of the primary interpretation (PR11) of this embodiment will be described below. Fig. 6 is a sequence diagram of the process of the primary interpretation. Fig. 7 is a diagram showing an example of a screen displayed in the information processing of Fig. 6.

[0085] The process in FIG. 6 is triggered by the entry of a user ID by the person in charge of endoscopy.

[0086] <Request to end primary interpretation (S1120)> As shown in FIG. 6, the primary interpretation client device 20 executes a primary interpretation end request (S1120). Specifically, the processor 22 displays a screen P1120 (FIG. 7) on the display.

[0087] The screen P1120 includes an operation object B1120 and a field object F1120.

[0088] The operation object B 1120 is an object that receives a user instruction for finalizing an input to the field object F 1120.

[0089] The field object F1120 is an object that receives a user instruction to obtain the next information input. Subject Identification Information Date and time of endoscopy Endoscopic images -Identification information of the endoscopy technician Primary diagnosis information

[0090] When the person in charge of endoscopy inputs each piece of information into the field object F1120 and operates the operation object B1120, the processor 22 transmits primary interpretation end request data to the server 30. The primary interpretation end request data includes, for example, the following information: Information regarding the execution date and time of step S1120 - Information entered in field object F1120

[0091] <Database update (S1130)> After step S1120, the server 30 executes updating of the database (S1130). Specifically, the processor 32 adds a new record to the endoscopy log database (FIG. 4) and stores the following information in each field of the new record: "Endoscopy Log ID" field: New endoscopy log identification information "Timestamp" field: Information regarding the execution date and time of step S1120 "Status" field: Status "Completed (Endoscopy)" "Subject ID" field: Subject identification information included in the request data for completion of first reading "Endoscopy examiner ID" field: Endoscopy examiner identification information included in the first interpretation end request data "Endoscopic image" field: Endoscopic image included in the request data for the end of primary interpretation - "Primary Diagnosis" field: Primary diagnosis information included in the request data for the completion of primary interpretation "Classification" field: blank code "NULL" "Rating" field: blank code "NULL" - "Secondary Reading" field: Blank code "NULL"

[0092] (4-2) Evaluation (PR12) The evaluation process (PR12) of this embodiment will be described with reference to Fig. 8, which is a sequence diagram of the evaluation process of this embodiment.

[0093] <Determining the record to be evaluated (S1230)> As shown in FIG. 8, the server 30 executes the determination of records to be evaluated (S1230). Specifically, the processor 32 refers to the endoscopic examination log database (FIG. 4) and determines records (hereinafter referred to as "evaluation target records") that satisfy the following conditions: - The status information "Completed (initial reading)" is stored in the "Status" field. - The "Timestamp" field contains information about the oldest date and time.

[0094] <Overall Coverage Evaluation (S1231)> After step S1230, the server 30 performs an overall coverage evaluation (S1231). Specifically, the storage device 31 stores an overall coverage evaluation model. The overall coverage evaluation model is a model for evaluating the overall coverage of an endoscopic examination (hereinafter referred to as "overall coverage"). The global coverage evaluation model may be, for example, a supervised learning model or an unsupervised learning model. The overall coverage evaluation model represents the correlation between image features and overall coverage.

[0095] The processor 32 inputs the endoscopic image stored in the "endoscopic image" field of the evaluation target record into the overall coverage evaluation model. The overall coverage evaluation model outputs an evaluation result of the overall coverage (for example, a percentage value indicating the coverage) based on the endoscopic image.

[0096] <Image quality evaluation (S1232)> In parallel with step S1231, the server 30 performs an evaluation of the image quality (S1232). Specifically, the storage device 31 stores an image quality assessment model. The image quality assessment model is a model for evaluating the suitability of image quality of an endoscopic image in an endoscopic examination (that is, whether or not the image quality is sufficient for appropriate diagnosis in primary and secondary interpretations). The image quality assessment model may be, for example, a supervised learning model or an unsupervised learning model. The image quality assessment model represents the correlation between image features and image quality.

[0097] The processor 32 inputs the endoscopic image stored in the "endoscopic image" field of the record to be evaluated into the image quality evaluation model. The image quality evaluation model outputs an evaluation result of the quality of the endoscopic image (for example, a numerical value indicating image quality) based on the endoscopic image.

[0098] <Database update (S1233)> After steps S1231 to S1232, the server 30 executes updating of the database (S1233). Specifically, the processor 32 stores the following information in each field of the record to be evaluated: "Status" field: Status "Complete (Evaluation)" "Comprehensiveness" field: Overall comprehensiveness obtained in step S1231 "Image Quality" field: Image quality obtained in step S1232

[0099] (4-3) Secondary Reading (PR13) Secondary interpretation (PR13) will now be described. Fig. 9 is a sequence diagram of the process of secondary interpretation in this embodiment. Fig. 10 is a diagram showing an example of a screen displayed in the information processing of Fig. 9.

[0100] The process of Fig. 9 is triggered by the input of user identification information by the secondary image reader. When the secondary image reader inputs his / her own user identification information (i.e., the user identification information of the secondary image reader), the server 30 transmits at least a part of the information stored in the endoscopic examination log database (Fig. 4) associated with the user identification information to the secondary image interpretation client device 10.

[0101] <Request to start secondary interpretation (S1310)> As shown in FIG. 9, the secondary interpretation client device 10 executes a secondary interpretation start request (S1310). Specifically, the processor 12 displays screen P1310 (FIG. 10) on the display.

[0102] The screen P1310 includes an operation object B1310 and a field object F1310.

[0103] The operation object B1310 is an object that receives a user instruction for finalizing an input to the field object F1310.

[0104] The field object F1310 is an object that receives a user instruction for specifying endoscopic examination log identification information.

[0105] When the user specifies the desired subject identification information in the field object F1310 and operates the operation object B1310, the processor 12 transmits secondary interpretation start request data to the server 30. The secondary interpretation start request data includes, for example, the following information. · Endoscopy log identification information specified in field object F1310

[0106] <Identification of subjects for secondary reading (S1330)> After step S1310, the server 30 executes identification of a secondary interpretation target (S1330). Specifically, the processor 32 refers to the endoscopic examination log database (Figure 4) to identify a record (hereinafter referred to as the "secondary interpretation target record") associated with the endoscopic examination log identification information included in the secondary interpretation start request data.

[0107] <Secondary interpretation start response (S1331)> After step S1330, the server 30 executes a secondary interpretation start response (S1331). Specifically, the processor 32 transmits secondary interpretation start response data to the secondary interpretation client device 10. The secondary interpretation start response data includes, for example, the following information. Information on the record to be subjected to secondary interpretation identified in step S1330

[0108] <Display of secondary reading target (S1311)> After step S1331, the secondary interpretation client device 10 executes display of the secondary interpretation target (S1311). Specifically, the processor 12 displays screen P1311 (FIG. 10) on the display.

[0109] The screen P1311 includes display objects A1311a to A1311c, operation objects B1311a to B1311b, and a field object F1311.

[0110] The display object A 1311a is an object that displays an endoscopic image of the record to be subjected to secondary interpretation.

[0111] The display object A1311b is an object that displays the date and time of the endoscopic examination, the name of the person in charge of the endoscopic examination, and the primary diagnosis information of the record to be subjected to secondary interpretation.

[0112] The display object A 1311c is an object that displays the evaluation result of the overall coverage.

[0113] The operation object B 1311a is an object that receives a user instruction for finalizing a user instruction for the field object F 1311.

[0114] The operation object B 1311b is an object that receives a user instruction for generating a report.

[0115] The field object F1311 is an object for receiving a user instruction for acquiring secondary diagnosis information.

[0116] <Generate report (S1312)> After step S1311, the secondary interpretation client device 10 generates a report (S1312). Specifically, when the person in charge of secondary image interpretation operates the operation object B1311b, the processor 12 generates a report based on the information displayed on the screen P1311. The report includes, for example, the following items: Endoscopic image displayed on display object A1311a Information displayed in display object A1311b - Secondary diagnostic information entered in field object F1311 Information displayed in display object A1311c

[0117] The processor 12 outputs the report. The report output mode may include, for example, at least one of the following: Display on the screen Printing on a printer -Transmission to an external server connected to server 30

[0118] <Request to end secondary interpretation (S1313)> After step S1312, the secondary interpretation client device 10 executes a secondary interpretation end request (S1313). Specifically, when the person in charge of secondary interpretation inputs information into the field object F 1311 and operates the operation object B 1311 a, the processor 12 transmits to the server 30 a request data for ending secondary interpretation. The secondary interpretation end request data includes, for example, the following information: - Endoscopy examination log identification information included in the secondary reading start request data - Information entered in field object F1311

[0119] <Database update (S1332)> After step S1313, the server 30 executes updating of the database (S1332). Specifically, the processor 32 stores the following information in each field of the secondary target record: "Status" field: Status "Completed (secondary reading)" - "Secondary interpretation person ID" field: User identification information included in the secondary interpretation end request data - "Secondary diagnosis" field: Secondary diagnosis information included in the secondary interpretation completion request data

[0120] (5) Summary of the present embodiment According to this embodiment, a computer (e.g., processor 32) executes a step (e.g., step S1230) of acquiring endoscopic images obtained during an endoscopic examination on a subject, and executes a step (e.g., step S1231) of evaluating the comprehensiveness of the endoscopic examination based on the endoscopic images. This makes it possible to evaluate the comprehensiveness of endoscopic examinations without any constraints on the information obtained from the endoscopic examination.

[0121] (6) Variations A modification of this embodiment will now be described.

[0122] (6-1) Variation 1 A description will now be given of Modification 1. Modification 1 is an example in which the parts of an organ captured in an endoscopic image are classified, and the comprehensiveness is evaluated based on the results of the classification.

[0123] (6-1-1) Information processing of modification example 1 The information processing of the first modification will be described.

[0124] (6-1-1-1) Rating (PR12) The following describes the evaluation (PR12) process of Modification 1. Fig. 11 is a sequence diagram of the evaluation process of Modification 1. Fig. 12 is an explanatory diagram of the classification process of Fig. 11.

[0125] <Determination of Record to be Evaluated (S1230) - Evaluation of Image Quality (S1232)> As shown in FIG. 11, the server 30 executes the steps from determining the record to be evaluated (S1230) to evaluating the image quality (S1232) in the same manner as in FIG. It should be noted that the evaluation of image quality (S1232) is performed in parallel with steps S1231 and S2230 to S2231.

[0126] <Classification (S2230)> After step S1232, the server 30 performs classification (S2230). Specifically, a classification model is stored in the storage device 31. The classification model is a model for classifying parts of an organ reflected in an endoscopic image. The classification model is, for example, a supervised learning model or an unsupervised learning model. The classification model describes the correlation between the feature amount of an image and the accuracy rate for each part of an organ. Parts of an organ include, for example: In the following description, a classification argument is information that identifies a part of an organ. (Classification argument = 0) Pharynx (Classification argument = 1) Esophagus (Classification Argument = 2) Esophagogastric Junction (Classification argument = 3) Upper stomach (Classification argument = 4) Mid-stomach (Classification argument = 5) Lower stomach ·(classification argument=6) anterior stomach wall ·(Classification argument=7) Posterior wall of stomach (Classification argument = 8) Pylorus (Classification Argument=9) Duodenum

[0127] The processor 32 inputs the endoscopic image included in the primary interpretation end request data into the classification model. The classification model outputs, for each still image included in the endoscopic image, a rate of accuracy for each classification argument based on the feature amount of each still image. As a result, as shown in FIG. 12, the accuracy rate for each part of an organ can be obtained for one still image. By executing step S2230 for all still images included in the endoscopic image, the accuracy rate for each part of the organ based on the endoscopic image is obtained.

[0128] <Classification Comprehensiveness Evaluation (S2231)> After step S2230, the server 30 executes classification coverage evaluation (S2231). Specifically, the storage device 31 stores a classification comprehensiveness evaluation model. The classification comprehensiveness evaluation model is a model for evaluating the comprehensiveness for each part of an organ (hereinafter referred to as "classification comprehensiveness"). The classification coverage evaluation model is, for example, a supervised learning model or an unsupervised learning model. The classification comprehensiveness evaluation model represents the correlation between the image feature amount, the classification result by the classification model, and the comprehensiveness for each part.

[0129] The processor 32 inputs a combination of each still image contained in the endoscopic image stored in the "endoscopic image" field of the evaluation target record and the evaluation result of the classification model into the classification comprehensiveness evaluation model. The classification comprehensiveness evaluation model outputs an evaluation result of the classification comprehensiveness based on a combination of each still image included in the endoscopic image and the evaluation result of the classification model. The evaluation result of the classification comprehensiveness is, for example, a percentage value indicating the comprehensiveness for each part.

[0130] <Database update (S2232)> After steps S1232 and S2231, the server 30 executes updating of the database (S2232). Specifically, the processor 32 stores the following information in each field of the record to be evaluated: "Status" field: Status "Complete (Evaluation)" "Classification" field: The classification result obtained in step S2230. "Comprehensiveness" field: Overall comprehensiveness obtained in step S1231 and classification comprehensiveness obtained in step S2231 "Image Quality" field: Image quality obtained in step S1232

[0131] (6-1-1-2) Secondary Reading (PR13) A description will be given of the secondary interpretation (PR13) of Modification 1. Fig. 13 is a sequence diagram of the process of the secondary interpretation of Modification 1. Fig. 14 is a diagram showing an example of a screen displayed in the information processing of Fig. 13.

[0132] The process of Fig. 13 is triggered by the input of user identification information by the secondary image reader. When the secondary image reader inputs his / her own user identification information (i.e., the user identification information of the secondary image reader), the server 30 transmits at least a part of the information stored in the endoscopic examination log database (Fig. 4) associated with the user identification information to the secondary image interpretation client device 10.

[0133] <Request to start secondary interpretation (S1310)> As shown in FIG. 13, the secondary interpretation client device 10 executes a secondary interpretation start request (S1310) in the same manner as in FIG.

[0134] <Identification of subjects for secondary reading (S1330)> After step S1310, the server 30 executes the specification of the secondary interpretation target (S1330) in the same manner as in FIG.

[0135] <Generating coverage map (S2330)> After step S1330, the server 30 generates a coverage map (S2330). Specifically, the processor 32 generates a coverage map image expressing the coverage for each part, based on the information in the "coverage" field of the secondary interpretation target record identified in step S1330.

[0136] <Secondary interpretation start response (S2331)> After step S2330, the server 30 executes a secondary interpretation start response (S2331). Specifically, the processor 32 transmits secondary interpretation start response data to the secondary interpretation client device 10. The secondary interpretation start response data includes, for example, the following information. Information on the record to be subjected to secondary interpretation identified in step S1330 Coverage map image obtained in step S2330

[0137] <Display of secondary reading target (S2310)> After step S1331, the secondary interpretation client device 10 executes display of the secondary interpretation target (S2310). Specifically, the processor 12 displays screen P2310 (FIG. 14) on the display.

[0138] The screen P1311 includes display objects A1311a to A1311b and A2310, operation objects B1311a to B1311b, and a field object F1311. Display objects A1311a to A1311b, operation objects B1311a to B1311b, and field object F1311 are the same as those in FIG.

[0139] A display object A2310 is an object that displays the evaluation result of the overall coverage and the coverage map image IMG2310 obtained in S2330. The coverage map image IMG2310 has the shape of an organ (e.g., a stomach) and the organ is divided into a number of regions, each of which corresponds to a part SECi (i is a classification argument). The coverage map image IMG2310 shows the classification coverage in the form of a heat map image. This makes it possible to easily visually confirm the evaluation results of coverage for each part.

[0140] <Generate report (S2311)> After step S2310, the secondary interpretation client device 10 generates a report (S2311). Specifically, when the person in charge of secondary image interpretation operates the operation object B1311b, the processor 12 generates a report based on the information displayed on the screen P2310. The report includes, for example, the following items: Endoscopic image displayed on display object A1311a Information displayed in display object A1311b - Secondary diagnostic information entered in field object F1311 Information displayed on display object A2310

[0141] The processor 12 outputs the report. The report output mode may include, for example, at least one of the following: Display on the screen Printing on a printer -Transmission to an external server connected to server 30

[0142] <Request to end secondary interpretation (S1313)> After step S2311, the secondary interpretation client device 10 executes a secondary interpretation end request (S1313) in the same manner as in FIG.

[0143] <Database update (S1332)> After step S1313, the server 30 executes updating of the database (S1332) in the same manner as in FIG.

[0144] (6-1-2) Summary of Modification 1 According to variant example 1, a computer (e.g., processor 32) executes a step (e.g., step S2230) of classifying parts of an organ reflected in an endoscopic image, and a step (e.g., step S2231) of evaluating the comprehensiveness may evaluate the classification comprehensiveness, which is the comprehensiveness for each part, based on the results of the classification. This allows the person in charge of secondary image interpretation to easily know the coverage according to the imaging conditions for each part of the organ.

[0145] According to the first variation, a step of generating a coverage map image indicating the classification coverage (eg, step S2330) may be performed. This allows the person in charge of secondary image interpretation to easily know the coverage according to the imaging conditions for each part of the organ.

[0146] According to the first modification, the coverage map image may be an image in which an organ is divided into a plurality of regions, and in which the classification coverage is indicated for each region. This allows the person in charge of secondary image interpretation to know in detail the coverage according to the imaging conditions for each part of the organ.

[0147] According to variant example 1, a computer (e.g., processor 32) executes a step of generating a report (e.g., S2311), and the report may include an endoscopic image, a comprehensiveness assessment result, and a result of a secondary diagnosis. This allows the person performing the secondary image interpretation to easily obtain a report including the endoscopic image, the comprehensiveness evaluation result, and the result of the secondary diagnosis.

[0148] (6-2) Variation 2 A description will now be given of Modification 2. Modification 2 is an example of evaluating the skill of an endoscopy technician.

[0149] (6-2-1) Overview of Modification 2 An overview of Modification 2 will be described below. FIG 15 is an explanatory diagram of an overview of Modification 2.

[0150] As shown in FIG. 15, an endoscopy technician uses an endoscopy device 40 to capture endoscopic images of the subject's organs while performing primary interpretation of the endoscopic images, thereby diagnosing the condition of the subject's organs. The person in charge of the endoscopy transmits the endoscopic image to the server 30 using the client device 20 for primary image interpretation.

[0151] The server 30 evaluates the comprehensiveness of the endoscopic examination and the skill of the person in charge of the endoscopy based on the endoscopic images transmitted from the primary image interpretation client device 20.

[0152] The person in charge of secondary interpretation uses the client device 10 for secondary interpretation to obtain the endoscopic images, the evaluation results of the comprehensiveness, and the evaluation results of the skill from the server 30. The person in charge of secondary interpretation refers to the endoscopic images, the comprehensiveness evaluation results, and the skill evaluation results, and performs secondary interpretation of the endoscopic images to diagnose the condition of the subject's organs.

[0153] (6-2-2) Information processing of variation 2 The information processing of the second modification will be described.

[0154] (6-2-2-1) Evaluation of Modification 2 (PR12) The process of evaluation (PR12) of Modification Example 2 will be described below. FIG 16 is a sequence diagram of the process of evaluation of Modification Example 2.

[0155] <Determination of records to be evaluated (S1230)~Classification comprehensiveness evaluation (S2231)> As shown in FIG. 16, the server 30 executes the steps from determining the record to be evaluated (S1230) to evaluating the image quality (S1232) in the same manner as in FIG. After step S1232, the server 30 executes classification (S2230) to classification comprehensiveness evaluation (S2231) in the same manner as in FIG. It should be noted that the evaluation of image quality (S1232) is performed in parallel with steps S1231, S2230 to S2231, and S3230.

[0156] <Skill Evaluation (S3230)> After step S2231, the server 30 executes a skill evaluation (S3230). Specifically, the storage device 31 stores a skill evaluation model. The skill evaluation model is a model for evaluating the skill of an endoscopy technician. The skill evaluation model represents the correlation between the evaluation result of the classification model, the classification comprehensiveness, and the skill for each part. In the skill evaluation model, the difficulty of imaging each part is predefined. Processor 32 inputs the evaluation result of the classification model obtained in step S2230 and the classification comprehensiveness obtained in step S2231 into the skill evaluation model. The skill evaluation model outputs an evaluation result of the skill for each body part (hereinafter referred to as "classification skill") based on a combination of the evaluation result of the classification model, the classification comprehensiveness, and the difficulty of photographing each body part. The processor 32 calculates the overall skill by inputting the classification skills into a predetermined function, for example a function that calculates the average value of the classification skills.

[0157] <Database update (S3231)> After steps S1232 and S3230, the server 30 executes updating of the database (S3231). Specifically, the processor 32 stores the following information in each field of the record to be evaluated: "Status" field: Status "Complete (Evaluation)" "Classification" field: The classification result obtained in step S2230. "Comprehensiveness" field: Overall comprehensiveness obtained in step S1231 and classification comprehensiveness obtained in step S2231 "Image Quality" field: Image quality obtained in step S1232 "Skill" field: Classification skills and overall skills obtained in step S3230

[0158] (6-2-2-2) Secondary reading of variant 2 (PR13) The following describes the process of secondary interpretation (PR13) in Modification 2. Fig. 17 is a sequence diagram of the process of secondary interpretation in Modification 2. Fig. 18 is a diagram showing an example of a screen displayed in the information processing in Modification 2.

[0159] <Request to start secondary interpretation (S1310)> The secondary interpretation client device 10 executes a secondary interpretation start request (S1310) in the same manner as in FIG.

[0160] <Identification of subjects for secondary reading (S1330)> After step S1310, the server 30 executes the specification of the secondary interpretation target (S1330) in the same manner as in FIG.

[0161] <Generating coverage map (S2330)> After step S1330, the server 30 generates a coverage map (S2330) in the same manner as in FIG.

[0162] <Skill Map Generation (S3330)> After step S2330, the server 30 generates a skill map (S3330). Specifically, a skill map image representing the classification skills is generated based on the information in the "skill" field of the record to be subjected to secondary interpretation identified in step S1330. The capacity map image IMG3310 has the shape of an organ (e.g., a stomach) and the organ is divided into a number of regions, each of which corresponds to a part SECi (i is a classification argument). Skill map image IMG3310 shows classification skills in the form of a heat map image. This makes it easy to visually check the skill evaluation results for each part of the body.

[0163] <Secondary interpretation start response (S3331)> After step S3330, the server 30 executes a secondary interpretation start response (S3331). Specifically, the processor 32 transmits secondary interpretation start response data to the secondary interpretation client device 10. The secondary interpretation start response data includes, for example, the following information. Information on the record to be subjected to secondary interpretation identified in step S1330 Coverage map image obtained in step S2330 The skill map image obtained in step S3330

[0164] <Display of secondary reading target (S3310)> After step S3331, the secondary interpretation client device 10 executes display of the secondary interpretation target (S3310). Specifically, the processor 12 displays screen P3310 (FIG. 18) on the display.

[0165] The screen P3310 includes display objects A1311a to A1311b and A3310, an operation object B1311a, and a field object F1311. The display objects A1311a to A1311b, the operation object B1311a, and the field object F1311 are the same as those in FIG.

[0166] Display object A3310 is an object that displays the overall coverage evaluation result, the coverage map image IMG2310 obtained in S2330, the overall skill evaluation result indicating the overall skill, and the skill map image IMG3310 obtained in S3130. In the skill map image IMG3310, an organ (e.g., the stomach) is divided into parts SECi. In the skill map image IMG3310, the evaluation result of the classification skill indicating the skill for each part SECi is expressed in the form of a heat map.

[0167] <Generating Reports (S3311)> After step S3310, the secondary interpretation client device 10 generates a report (S3311). Specifically, when the person in charge of secondary image interpretation operates the operation object B1311b, the processor 12 generates a report based on the information displayed on the screen P3310. The report includes, for example, the following items: Endoscopic image displayed on display object A1311a Information displayed in display object A1311b - Secondary diagnostic information entered in field object F1311 Skill map image displayed on display object A3310

[0168] The processor 12 outputs the report. The report output mode may include, for example, at least one of the following: Display on the screen Printing on a printer -Transmission to an external server connected to server 30

[0169] <Request to end secondary interpretation (S1313)> After step S3311, the secondary interpretation client device 10 executes a secondary interpretation end request (S1313) in the same manner as in FIG.

[0170] <Database update (S1332)> After step S1313, the server 30 executes updating of the database (S1332) in the same manner as in FIG.

[0171] (6-2-3) Summary of Modification 2 According to variant example 2, the computer (e.g., processor 32) may execute a step (e.g., step S3230) of evaluating the skill of the endoscopist (i.e., the degree of endoscopic examination technique) based on the evaluation result of the classification comprehensiveness. This allows the person in charge of secondary interpretation to perform secondary interpretation taking into consideration not only the comprehensiveness but also the skill of the person in charge of endoscopy.

[0172] According to the second modification, the step of evaluating the skill (for example, step S3230) may evaluate the classification skill, which is the skill for each body part, by referring to the difficulty of photographing each body part. This allows the person in charge of secondary interpretation to perform secondary interpretation taking into account the detailed skills of the person in charge of endoscopy.

[0173] According to the second modification, a computer (eg, processor 32) may execute a step (eg, step S3330) of generating a skill map image showing the evaluation result of the classification skill. This allows the person in charge of secondary interpretation to easily grasp the detailed skills of the person in charge of endoscopy.

[0174] According to a second modification, the skill map image may be an image in which an organ is divided into a plurality of regions, and a classification skill is indicated for each region. This allows the person in charge of secondary interpretation to easily grasp the detailed skills of the person in charge of endoscopy.

[0175] According to the second modification, the step of evaluating the skill (eg, step S3230) may evaluate an overall skill, which is the overall skill of the endoscopic examination, based on the classified skills. This allows the person in charge of secondary interpretation to easily grasp the overall skill level of the person in charge of endoscopy.

[0176] (6-3) Variation 3 A description will now be given of Modification 3. Modification 3 is an example of evaluating the degree of progression of a target organ in an endoscopic examination.

[0177] (6-3-1) Overview of Modification 3 An overview of Modification 3 will be described below. Fig. 19 is an explanatory diagram of an overview of Modification 3.

[0178] As shown in FIG. 19, an endoscopy technician uses an endoscopy device 40 to capture endoscopic images of the subject's organs while performing primary interpretation of the endoscopic images, thereby diagnosing the condition of the subject's organs. The person in charge of the endoscopy transmits the endoscopic image to the server 30 using the client device 20 for primary image interpretation.

[0179] The server 30 evaluates the completeness of the endoscopic examination and the degree of progression of the target organ based on the endoscopic images transmitted from the primary image interpretation client device 20.

[0180] The person in charge of secondary image interpretation uses the client device 10 for secondary image interpretation to obtain the endoscopic images, the evaluation result of the comprehensiveness, and the evaluation result of the progress level from the server 30. The person in charge of secondary interpretation refers to the endoscopic images, the comprehensiveness evaluation results, and the progress evaluation results, and performs secondary interpretation of the endoscopic images to diagnose the condition of the subject's organs.

[0181] (6-3-2) Information processing of modification example 3 The information processing of the third modification will be described.

[0182] (6-3-2-1) Evaluation of Modification 3 (PR12) The following describes the process of evaluation (PR12) of Modification Example 3. FIG 20 is a sequence diagram of the process of evaluation of Modification Example 3.

[0183] <Determination of records to be evaluated (S1230)~Classification comprehensiveness evaluation (S2231)> As shown in FIG. 20, the server 30 executes the steps from determining the record to be evaluated (S1230) to evaluating the image quality (S1232) in the same manner as in FIG. After step S1232, the server 30 executes classification (S2230) to classification comprehensiveness evaluation (S2231) in the same manner as in FIG. It should be noted that the evaluation of image quality (S1232) is performed in parallel with steps S1231, S2230 to S2231, and S4230.

[0184] <Progress Assessment (S4230)> After step S2231, the server 30 executes a progress evaluation (S4230). Specifically, the storage device 31 stores a progress evaluation model. The progression assessment model is a model for assessing the progression of a lesion in an organ. The progress assessment model may be, for example, a supervised learning model or an unsupervised learning model. The progression assessment model represents the correlation between the image features, the classification results of the classification model, and the assessment of the lesion. The processor 32 inputs the endoscopic image stored in the “endoscopic image” field of the evaluation target record and the classification result obtained in S2230 into the progress evaluation model. The progression evaluation model outputs an evaluation result of the progression of the lesion. The evaluation result of the progression of the lesion is, for example, at least one of the following: Presence or absence of lesions in each area Probability of lesions present at each site The lesion may be, for example, at least one of the following: ·Atrophic gastritis ·Intestinal metaplasia

[0185] <Database update (S4231)> After steps S1232 and S4230, the server 30 executes updating of the database (S4231). Specifically, the processor 32 stores the following information in each field of the record to be evaluated: "Status" field: Status "Complete (Evaluation)" "Classification" field: The classification result obtained in step S2230. "Comprehensiveness" field: Overall comprehensiveness obtained in step S1231 and classification comprehensiveness obtained in step S2231 "Image Quality" field: Image quality obtained in step S1232 "Progress" field: Progress evaluation result obtained in step S4230

[0186] (6-3-2-2) Secondary reading of variant 3 (PR13) The process of secondary interpretation (PR12) of Modification 3 will be described. Fig. 21 is a sequence diagram of the process of secondary interpretation of Modification 3. Fig. 22 is a diagram showing an example of a screen displayed in information processing of Modification 3. Fig. 23 is a diagram showing a specific example of the progress map image of Fig. 22.

[0187] <Request to start secondary interpretation (S1310)> As shown in FIG. 21, the secondary interpretation client device 10 executes a secondary interpretation start request (S1310) in the same manner as in FIG.

[0188] <Identification of subjects for secondary reading (S1330)> After step S1310, the server 30 executes the specification of the secondary interpretation target (S1330) in the same manner as in FIG.

[0189] <Generating coverage map (S2330)> After step S1330, the server 30 generates a coverage map (S2330) in the same manner as in FIG.

[0190] <Creating a progress map (S4330)> After step S2330, the server 30 generates a progress map (S4330). Specifically, a progression map image expressing the progression is generated based on the information in the "progression" field of the record to be subjected to secondary interpretation identified in step S1330. The progression map image is, for example, based on the Kimura-Takemoto classification.

[0191] <Secondary interpretation start response (S4331)> After step S4330, the server 30 executes a secondary interpretation start response (S4331). Specifically, the processor 32 transmits secondary interpretation start response data to the secondary interpretation client device 10. The secondary interpretation start response data includes, for example, the following information. Information on the record to be subjected to secondary interpretation identified in step S1330 Coverage map image obtained in step S2330 The progress map image obtained in step S4330

[0192] <Display of secondary reading target (S4310)> After step S4331, the secondary interpretation client device 10 executes display of the secondary interpretation target (S4310). Specifically, the processor 12 displays screen P4310 (FIG. 22) on the display.

[0193] The screen P4310 includes display objects A1311a to A1311b and A4310, an operation object B1311a, and a field object F1311. The display objects A1311a to A1311b, the operation object B1311a, and the field object F1311 are the same as those in FIG.

[0194] Display object A4310 is an object that displays the evaluation result of the overall coverage, the coverage map image IMG2310 obtained in S2330, and the progress map image IMG4310 (FIG. 23) obtained in S4330.

[0195] As shown in Figure 23, the Kimura-Takemoto classification is a classification of the extent of atrophic gastritis based on endoscopic findings of atrophy and histopathological findings of atrophy in biopsy specimens. In the Kimura-Takemoto classification, the progression of atrophic gastritis is evaluated based on the planar extent of the gastric mucosa. "CLOSED TYPE (C-1 to C-3)" indicates that the endoscopic atrophy border does not extend beyond the cardia on the lesser curvature side of the gastric body. "OPEN TYPE" indicates that the endoscopic atrophy border extends beyond the cardia on the lesser curvature side of the gastric body toward the greater curvature.

[0196] When atrophic gastritis of the stomach is evaluated in step S4230, the evaluation result of the degree of progression is displayed in the form of a map image of the degree of progression of atrophic gastritis of the stomach based on the Kimura-Takemoto classification. When intestinal metaplasia is evaluated in step S4230, the evaluation result of the degree of progression is displayed in the form of a map image of the degree of progression of intestinal metaplasia based on the Kimura-Takemoto classification. This makes it possible to easily visually confirm the evaluation results of the extent of the lesion.

[0197] <Generate Report (S4311)> After step S4310, the secondary interpretation client device 10 generates a report (S4311). Specifically, when the person in charge of secondary image interpretation operates the operation object B1311b, the processor 12 generates a report based on the information displayed on the screen P4310. The report includes, for example, the following items: Endoscopic image displayed on display object A1311a Information displayed in display object A1311b - Secondary diagnostic information entered in field object F1311 Information displayed on display object A4310

[0198] The processor 12 outputs the report. The report output mode may include, for example, at least one of the following: Display on the screen Printing on a printer -Transmission to an external server connected to server 30

[0199] <Request to end secondary interpretation (S1313)> After step S4311, the secondary interpretation client device 10 executes a secondary interpretation end request (S1313) in the same manner as in FIG.

[0200] <Database update (S1332)> After step S1313, the server 30 executes updating of the database (S1332) in the same manner as in FIG.

[0201] (6-3-3) Summary of Variation 3 According to the third modification, a computer (eg, the processor 32) may execute a step (eg, step S4230) of evaluating the extent of progression of a lesion based on the endoscopic image and the evaluation result of the classification comprehensiveness. This enables the secondary reader to easily identify the condition of the area being examined by the endoscope.

[0202] According to the third modification, the computer (eg, the processor 32) may execute a step (eg, step S4330) of generating a progress map image based on the evaluation result of the progress. This enables the secondary reader to easily identify the condition of the area being examined by the endoscope.

[0203] According to a third modification, the progress map image may be a progress map image based on the Kimura-Takemoto classification. This enables the secondary reader to easily identify the condition of the area being examined by the endoscope.

[0204] According to the third modification, the step of assessing the degree of progression (eg, step S4230) may assess the degree of progression of at least one of atrophic gastritis and intestinal metaplasia. This enables the secondary reader to easily identify the degree of progression of at least one of atrophic gastritis and intestinal metaplasia at the site of the endoscopic examination.

[0205] (7) Other modifications Other modifications will now be described.

[0206] The primary reading (PR11) in FIG. 6 can be omitted. In this case, the person in charge of the secondary image interpretation or a person in charge at the institution to which the secondary image interpretation belongs stores the endoscopic images in the server 30. The server 30 refers to the endoscopic image and performs evaluation (PR12).

[0207] In the present embodiment, an example has been shown in which a heat map image is generated in generating the coverage map (S2330) and the skill map (S3330), but the scope of the present embodiment is not limited to this. This embodiment can be applied to any type of image as long as the image has a format that allows the evaluation result for each part to be expressed.

[0208] In this embodiment, the coverage for each endoscopy technician may be tallied. Specifically, the processor 32 references the "endoscopy technician ID" field in the endoscopy log database (FIG. 4) to identify a record associated with a particular endoscopy technician identification information. The processor 32 calculates the coverage for each endoscopy technician by aggregating the information stored in the "coverage" field of the record. This makes it possible to easily identify the distribution of classification coverage and the tendency of coverage for each part for each endoscopy technician.

[0209] In this embodiment, the skill level of each endoscopy technician may be tallied. Specifically, the processor 32 references the "endoscopy technician ID" field in the endoscopy log database (FIG. 4) to identify a record associated with a particular endoscopy technician identification information. The processor 32 calculates the skill level of each endoscopist by aggregating the information stored in the "skill" field of the corresponding record. This makes it possible to easily identify the level of skill of each endoscopy examiner or the strengths and weaknesses of imaging each part of the body.

[0210] The storage device 11 may be connected to the secondary interpretation client device 10 via a network NW. The storage device 21 may be connected to the primary interpretation client device 20 via a network NW. The storage device 31 may be connected to the server 30 via a network NW.

[0211] Each step of the above information processing can be executed by either the secondary interpretation client device 10 or the server 30. For example, if the client device 10 for secondary interpretation is capable of executing all the steps of the above-mentioned information processing, the client device 10 for secondary interpretation functions as an information processing device operating in a stand-alone manner without transmitting a request to the server 30.

[0212] Although the embodiment of the present invention has been described in detail above, the scope of the present invention is not limited to the above embodiment. Furthermore, the above embodiment can be improved or modified in various ways without departing from the spirit of the present invention. Furthermore, the above embodiment and the modified examples can be combined. [Explanation of symbols]

[0213] 1: Information processing system 10: Client device for secondary reading 11:Storage device 12: Processor 13: Input / Output Interface 14: Communication interface 20: Client device for primary image reading 21:Storage device 22: Processor 23: Input / Output Interface 24: Communication interface 30: Server 31:Storage device 32 : Processor 33: Input / Output Interface 34: Communication interface 40: Endoscopic device

Claims

1. A computer-based information processing method, The computer then performs the step of acquiring endoscopic images obtained from an endoscopic examination of a subject. The computer performs the step of evaluating the comprehensiveness of the endoscopic examination based on the endoscopic images. Information processing methods.

2. The computer performs the step of classifying the parts of organs that are captured in the endoscopic image, The step of evaluating the comprehensiveness involves evaluating the classification comprehensiveness, which is the comprehensiveness for each part, based on the results of the classification. The information processing method according to claim 1.

3. The computer performs the step of generating a comprehensive map image that shows the comprehensiveness of the classification. The information processing method according to claim 2.

4. The comprehensive map image is an image in which an organ is divided into multiple regions, and the comprehensive classification is shown for each region. The information processing method according to claim 3.

5. The computer then performs a step of evaluating the skills of the endoscopist based on the results of the classification comprehensiveness evaluation. The information processing method according to claim 2.

6. The step of evaluating the aforementioned skill involves evaluating the classification skill, which is the skill level for each body part, by referring to the difficulty level of photography for each body part. The information processing method according to claim 5.

7. The computer performs the step of generating a skill map image showing the evaluation results of the classification skill. The information processing method according to claim 6.

8. The aforementioned skill map image is an image in which an organ is divided into multiple regions, and the classification skill is shown for each region. The information processing method according to claim 7.

9. The step of evaluating the skills involves evaluating the overall skill, which is the overall skill of the endoscopic examination, based on the classified skills. The information processing method according to claim 6.

10. The computer performs the step of evaluating the degree of lesion progression based on the endoscopic image and the classification coverage evaluation results. The information processing method according to claim 2.

11. The computer performs the step of generating a progress map image based on the progress evaluation result. The information processing method according to claim 10.

12. The aforementioned progress map image is a progress map image based on the Kimura-Takemoto classification. The information processing method according to claim 11.

13. The step of evaluating the progression involves evaluating the progression of atrophic gastritis and the progression of at least one of intestinal metaplasia. The information processing method according to claim 10.

14. The computer then performs the step of generating a report, The report includes the endoscopic images, the results of the comprehensiveness evaluation, and the results of the secondary diagnosis. The information processing method according to any one of claims 1 to 13.

15. The system includes means for acquiring endoscopic images obtained during endoscopic examinations of subjects, The system includes means for evaluating the comprehensiveness of the endoscopic examination based on the endoscopic images. Information processing device.

16. Computers, It functions as a means of acquiring endoscopic images obtained during endoscopic examinations of subjects. A program for functioning as a means of evaluating the comprehensiveness of the endoscopic examination based on the endoscopic images.

17. An information processing system comprising a client device and a server, The system includes means for acquiring endoscopic images obtained during endoscopic examinations of subjects, The system includes means for evaluating the comprehensiveness of the endoscopic examination based on the endoscopic images. Information processing system.

Images