Triage policy modification system, triage policy modification apparatus, triage policy modification method, and non-transitory computer-readable recording medium storing program

Abstract

This triage policy modification system generates, based on a triage policy and patient information, a triage result and presents the triage result to a user, acquires feedback from the user, determines, based on a history of information presented to the user and the feedback from the user, whether there is a query and whether there is a modification to be made to the triage policy, and presents the query to the user and modifies the triage policy.

Description

TRIAGE POLICY MODIFICATION SYSTEM, TRIAGE POLICY MODIFICATION APPARATUS, TRIAGE POLICY MODIFICATION METHOD, AND NON-TRANSITORY COMPUTER-READABLE RECORDING MEDIUM STORING PROGRAM

[0001] The present disclosure relates to a triage policy modification system, a triage policy modification apparatus, a triage policy modification method, and a triage policy modification program.

[0002] In a hospital, which accepts many incoming patients, in a case where all the patients cannot be treated at a time, it is necessary to triage the patients according to the degree of urgency. At present, human nurses perform triage. However, in a case where there are many patients, triage itself can become difficult. Thus, a triage system, which automatically performs triage, is useful. For example, Patent Literature 1 discloses a technique for evaluating a patient's risk via a module trained with use of training data.

[0003] PTL 1: International Publication No. WO 2017 / 106770

[0004] If it is possible for a user such as, for example, a medical professional to interactively improve the triage policy of a triage system, the accuracy of a triage result can be improved. However, with the technique disclosed in Patent Literature 1, it is not possible for the user to interactively improve the triage policy.

[0005] The present disclosure has been made in view of the above problem, and an example object thereof is to provide a technique for a user to interactively improve a triage policy.

[0006] A triage policy modification system in accordance with an example aspect of the present disclosure includes: an acquisition means for acquiring patient information regarding a patient; a triage means for generating, based on the patient information and a triage policy for performing triage, a triage result for the patient, and presenting the triage result to a user; and a feedback processing means for acquiring feedback from the user, the feedback processing means being configured to: based on a history of information presented to the user and the feedback from the user, determine whether there is a query to be presented to the user and whether there is a modification to be made to the triage policy; in a case where there is the query, present the query to the user and further acquire the feedback; and in a case where there is the modification, modify the triage policy.

[0007] A triage policy modification apparatus in accordance with an example aspect of the present disclosure includes: an acquisition means for acquiring patient information regarding a patient; a triage means for generating, based on the patient information and a triage policy for performing triage, a triage result for the patient, and presenting the triage result to a user; and a feedback processing means for acquiring feedback from the user, the feedback processing means being configured to: based on a history of information presented to the user and the feedback from the user, determine whether there is a query to be presented to the user and whether there is a modification to be made to the triage policy; in a case where there is the query, present the query to the user and further acquire the feedback; and in a case where there is the modification, modify the triage policy.

[0008] A triage policy modification method in accordance with an example aspect of the present disclosure includes: acquiring patient information regarding a patient; generating, based on the patient information and a triage policy for performing triage, a triage result for the patient, and presenting the triage result to a user; acquiring feedback from the user; determining, based on a history of information presented to the user and the feedback from the user, whether there is a query to be presented to the user and whether there is a modification to be made to the triage policy; presenting the query to the user and further acquiring the feedback, in a case where there is the query; and modifying the triage policy in a case where there is the modification.

[0009] A triage policy modification program in accordance with an example aspect of the present disclosure causes at least one computer to carry out: acquiring patient information regarding a patient; generating, based on the patient information and a triage policy for performing triage, a triage result for the patient, and presenting the triage result to a user; acquiring feedback from the user; determining, based on a history of information presented to the user and the feedback from the user, whether there is a query to be presented to the user and whether there is a modification to be made to the triage policy; presenting the query to the user and further acquiring the feedback, in a case where there is the query; and modifying the triage policy in a case where there is the modification.

[0010] An example aspect of the present disclosure provides an example advantage of making it possible to provide a technique for a user to interactively improve a triage policy.

[0011] Fig. 1 is a block diagram illustrating an example configuration of a triage policy modification system in accordance with the present disclosure.Fig. 2 is a block diagram illustrating an example of a triage result in accordance with the present disclosure.Fig. 3 is a block diagram illustrating an example configuration of a triage policy modification apparatus in accordance with the present disclosure.Fig. 4 is a flowchart illustrating an example flow of a triage policy modification method in accordance with the present disclosure.Fig. 5 is a block diagram illustrating an example configuration of a triage policy modification system in accordance with the present disclosure.Fig. 6 is a flowchart illustrating an example operation of the triage policy modification system in accordance with the present disclosure.Fig. 7 is a diagram illustrating an example stage of the triage policy modification method in accordance with the present disclosure.Fig. 8 is a diagram illustrating an example stage of the triage policy modification method in accordance with the present disclosure.Fig. 9 is a representation of an example of a triage policy used in the triage policy modification method in accordance with the present disclosure.Fig. 10 is a diagram illustrating an example stage of the triage policy modification method in accordance with the present disclosure.Fig. 11 is a diagram illustrating an example stage of the triage policy modification method in accordance with the present disclosure.Fig. 12 is a representation of an example of a feedback reflection policy used in the triage policy modification method in accordance with the present disclosure.Fig. 13 is a diagram illustrating an example stage of the triage policy modification method in accordance with the present disclosure.Fig. 14 is a diagram illustrating an example stage of the triage policy modification method in accordance with the present disclosure.Fig. 15 is a diagram illustrating an example stage of the triage policy modification method in accordance with the present disclosure.Fig. 16 is a diagram illustrating an example stage of the triage policy modification method in accordance with the present disclosure.Fig. 17 is a diagram illustrating an example stage of the triage policy modification method in accordance with the present disclosure.Fig. 18 is a diagram illustrating an example stage of the triage policy modification method in accordance with the present disclosure.Fig. 19 is a diagram illustrating an example stage of the triage policy modification method in accordance with the present disclosure.Fig. 20 is a diagram illustrating an example stage of the triage policy modification method in accordance with the present disclosure.Fig. 21 is a diagram illustrating a stage of the triage policy modification method in accordance with the present disclosure.Fig. 22 is a block diagram illustrating an example configuration of a computer which functions as the apparatuses of the triage policy modification system in accordance with the present disclosure and the triage policy modification apparatus in accordance with the present disclosure.

[0012] The following description will discuss example embodiments of the present invention. However, the present invention is not limited to the example embodiments described below, but can be altered by a skilled person in the art within the scope of the claims. For example, any embodiment derived by appropriately combining techniques (some or all of products or methods) adopted in differing example embodiments described below can be within the scope of the present invention. Further, any embodiment derived by appropriately omitting one or more of the techniques adopted in differing example embodiments described below can be within the scope of the present invention. Furthermore, the advantage mentioned in each of the example embodiments described below is an example advantage expected in that example embodiment, and does not define the extension of the present invention. That is, any embodiment which does not provide the example advantages mentioned in the example embodiments described below can also be within the scope of the present invention.

[0013] <First example embodiment> 　　The following description will discuss a first example embodiment, which is an example embodiment of the present invention, in detail with reference to the drawings. The present example embodiment is basic to each of the example embodiments which will be described later. It should be noted that the applicability of the techniques adopted in the present example embodiment is not limited to the present example embodiment. That is, the techniques adopted in the present example embodiment can be adopted in another example embodiment included in the present disclosure, to the extent of constituting no specific technical obstacle. Further, the techniques illustrated in the drawings referred to for the description of the present example embodiment can be adopted in another example embodiment included in the present disclosure, to the extent of constituting no specific technical obstacle.

[0014] (Configuration of triage policy modification system) 　　The configuration of a triage policy modification system 1 is described here with reference to Fig. 1. Fig. 1 is a block diagram illustrating the configuration of the triage policy modification system 1. The triage policy modification system 1 includes an acquisition unit (acquisition means) 11, a triage unit (triage means) 12, and a feedback processing unit (feedback processing means) 13, as illustrated in Fig. 1.

[0015] A user 5 is a user who uses the triage policy modification system 1 and is, for example, a medical professional. For example, the user 5 can use an information terminal or the like to interact with the triage policy modification system 1.

[0016] The acquisition unit 11 acquires patient information regarding a patient. For example, the patient information may include information which indicates the attributes of a patient such as age and gender and information which indicates the patient's conditions such as symptoms, appearance, and vital signs. For example, the acquisition unit 11 may be information processing equipment for acquiring patient information from a database in which the patient information is stored, or may be input equipment for accepting the input of the patient information. The patient is not limited to a current patient, but may be a past patient whose treatment has been completed, or may be an imaginary patient who is set for the modification of a triage policy.

[0017] The triage unit 12 performs, based on a triage policy and the patient information, triage on patients, generates triage results, and presents the triage results to the user 5. The triage unit 12 is, for example, information processing equipment.

[0018] Triage is to determine priorities of treatment to be assigned to patients. The triage result is the priority of treatment assigned to a patient. For example, the triage result may be such that patients are classified into several levels of categories in terms of a time (e.g. the time until treatment is provided) and a place (e.g. the place where treatment is provided). As an example, Fig. 2 is a diagram illustrating triage categories in the Australian triage system (ATS), by which patients are classified into several levels of triage categories according to the maximum waiting time.

[0019] The triage policy is a rule which indicates how to determine, based on the patient information, the priorities to be assigned to patients. For example, the triage policy may be in human-readable text form as illustrated in Fig. 9, or may be in computer-readable binary data form. In an example aspect, the triage policy may be parameters of a trained model which has been trained by machine learning so as to receive the patient information as an input and output a triage result. The triage policy may be based on a known triage policy, such as the ATS described above.

[0020] The feedback processing unit 13 acquires feedback from the user 5. Further, the feedback processing unit 13 carries out a process based on the feedback from the user 5.

[0021] The feedback from a user is in, for example, text form, and examples thereof include advice, a question, comments, etc. about the triage result, and an answer to a query (described later).

[0022] The feedback processing unit 13 determines, based on a history of information presented to the user 5 and the feedback from the user, whether there is a query to be presented to the user 5 and whether there is a modification to be made to the triage policy. The history of information presented to the user 5 includes a triage result and a query (if any) which were presented by the triage policy modification system 1 to the user 5 in the past. The history of feedback from the user 5 includes feedback on the triage result and feedback (if any) on the query which were acquired by the triage policy modification system 1 from the user 5 in the past. For example, in a case where the feedback from the user is inconsistent with a reference triage policy, such as the ATS described above, the feedback processing unit 13 may determine that there is a query to be presented to the user 5. For example, in a case where the feedback from the user indicates that the current triage policy should be modified, the feedback processing unit 13 may determine that there is a modification to be made to the triage policy.

[0023] In a case where there is a query to be presented to the user 5, the feedback processing unit 13 presents the query to the user 5 to further acquire feedback from the user 5. For example, in a case where the feedback from the user is inconsistent with a reference triage policy, such as the ATS described above, the feedback processing unit 13 may present a query indicating such a fact to the user 5.

[0024] In a case where there is a modification to be made to the triage policy, the feedback processing unit 13 modifies the triage policy. For example, in a case where the feedback from the user indicates that the current triage policy should be modified, the feedback processing unit 13 may subject the triage policy to addition or change.

[0025] For example, the feedback processing unit 13 is information processing equipment. The acquisition unit 11, the triage unit 12, and the feedback processing unit 13 may be separate pieces of information processing equipment, or may be a single piece of information processing equipment.

[0026] (Example advantage of triage policy modification system) 　　As above, in the triage policy modification system 1, the user 5 can interactively modify the triage policy. In this modification, even if the user 5 is a medical professional, the feedback from the user 5 on the triage result can be ambiguous, or can be incorrect. Thus, in some cases, modifying a triage policy by, for example, simply reflecting the feedback from the user 5 does not improve the triage policy.

[0027] In contrast, in the triage policy modification system 1, on the basis of the history of information presented to the user 5 and the feedback from the user 5, a query is presented to the user 5 to acquire feedback, and a triage policy is modified. Thus, the triage policy modification system 1 makes it possible to acquire necessary information from the user 5 by presenting a necessary query to the user 5 on the basis of the history of interactions with the user 5 and acquiring feedback accordingly. With the triage policy modification system 1, a triage policy is modified based on the history of interactions with the user 5, not by simply reflecting feedback from the user 5 in the triage policy. This provides an example advantage of making it possible to properly modify the triage policy. Thus, the triage policy modification system 1 provides an example advantage of making it possible for the user 5 to interactively improve a triage policy.

[0028] (Triage policy modification apparatus) 　　The triage policy modification system 1 can be configured in the form of an apparatus. Fig. 3 is a block diagram illustrating the configuration of a triage policy modification apparatus 100. The triage policy modification apparatus 100 includes an acquisition unit 11, a triage unit 12, and a feedback processing unit 13, as illustrated in Fig. 3. The configurations of the respective units are the same as those of the triage policy modification system 1, and descriptions thereof are not repeated. Also with the triage policy modification apparatus 100, the example advantage of making it possible for the user 5 to interactively improve a triage policy is obtained.

[0029] (Flow of triage policy modification method) 　　The flow of a triage policy modification method S1 is described here with reference to Fig. 4. Fig. 4 is a flowchart illustrating the flow of the triage policy modification method S1. The triage policy modification method S1 includes steps S11 to S18, as illustrated in Fig. 4. The triage policy modification method S1 can be carried out by the triage policy modification system or the triage policy modification apparatus.

[0030] In step S11, the triage policy modification system or the triage policy modification apparatus acquires patient information regarding a patient.

[0031] In step S12, the triage policy modification system or the triage policy modification apparatus generates, based on the patient information and a triage policy for performing triage, a triage result for the patient, and presents the triage result to a user.

[0032] In step S13, the triage policy modification system or the triage policy modification apparatus acquires feedback from the user.

[0033] In step S14, the triage policy modification system or the triage policy modification apparatus determines, based on a history of information presented to the user and the feedback from the user, whether there is a query to be presented to the user and whether there is a modification to be made to the triage policy.

[0034] In a case where there is a query (YES in step S15), in step S16, the triage policy modification system or the triage policy modification apparatus presents the query to the user, and further acquires feedback from the user.

[0035] In a case where there is a modification to be made to the triage policy (YES in step S17), in step S18, the triage policy modification system or the triage policy modification apparatus modifies the triage policy.

[0036] Although a determination (step S15) on whether there is a query is carried out first and a determination (step S17) on whether there is a modification is then carried out in the flowchart of Fig. 4, these steps may be carried out in a different order, or may be carried out in parallel.

[0037] (Example advantage of triage policy modification method) 　　As above, in the triage policy modification method S1, on the basis of a history of interactions with a user, a query is presented to a user to acquire feedback, and a triage policy is modified accordingly. Thus, the triage policy modification method S1 provides an example advantage of making it possible for a user to interactively improve a triage policy.

[0038] <Second example embodiment> 　　The following description will discuss a second example embodiment, which is an example embodiment of the present invention, in detail with reference to the drawings. A component having the same function as a component described in the above example embodiment is assigned the same reference sign, and the description thereof is omitted where appropriate. It should be noted that the applicability of the techniques adopted in the present example embodiment is not limited to the present example embodiment. That is, the techniques adopted in the present example embodiment can be adopted in another example embodiment included in the present disclosure, to the extent of constituting no specific technical obstacle. Further, the techniques illustrated in the drawings referred to for the description of the present example embodiment can be adopted in another example embodiment included in the present disclosure, to the extent of constituting no specific technical obstacle.

[0039] (Configuration of triage policy modification system) 　　The configuration of a triage policy modification system 1A is described here with reference to Fig. 5. Fig. 5 is a block diagram illustrating the configuration of the triage policy modification system 1A. The triage policy modification system 1A includes an authentication unit (authentication means) 14, a triage policy DB 15, a triage result-query-feedback history DB 16, a feedback reflection policy DB 17, a reflection unit 18, a query generation unit 19, and a medical professional's terminal 20, in addition to the acquisition unit 11, the triage unit 12, and the feedback processing unit 13 of the triage policy modification system 1.

[0040] (Terminal) 　　The medical professional's terminal 20 is a terminal operated by a user who is a medical professional. In the present example embodiment, the case where the user is a medical professional is described. However, the user may be other than a medical professional. The medical professional's terminal 20 may include output equipment (e.g. a display, etc.) for presenting patient information, a triage result, a query, etc. to the user and input equipment (e.g. a keyboard, a mouse, a touch panel, etc.) for accepting the input of feedback from the user.

[0041] (Authentication unit) 　　The authentication unit 14 authenticates a user. The authentication unit 14 accepts the input of authentication credentials from the medical professional's terminal 20, and authenticates a user who provides the feedback processing unit 13 with feedback. Examples of the authentication credentials include the login ID, the password, biological information (such as a fingerprint) for biometric authentication, and a captured image for face authentication of a user.

[0042] The feedback processing unit 13 may be configured so as to acquire feedback from a user who has been authenticated by the authentication unit 14. For example, the authentication unit 14 may notify the feedback processing unit 13 of the user ID of the authenticated user. The feedback processing unit 13 may acquire feedback from the user who has the user ID notified by the authentication unit 14. For example, the feedback processing unit 13 may acquire the feedback including the user ID.

[0043] This makes it possible to avoid an unauthorized user changing a triage policy for the worse.

[0044] (Database) 　　The triage policy DB 15 is a database in which to store a triage policy.

[0045] The triage result-query-feedback history DB 16 is a database in which to store a history of: triage results having been presented by the triage unit 12 to a user; queries (if any) having been presented by the feedback processing unit 13 to the user; and pieces of feedback (if any) having been acquired by the feedback processing unit 13 from the user. The triage unit 12 may provide the feedback processing unit 13 with triage results having been presented to the user, and the feedback processing unit 13 may accumulate the triage results, queries, and pieces of feedback in the triage result-query-feedback history DB 16.

[0046] The feedback reflection policy DB 17 is a database in which to store feedback reflection policies. The feedback reflection policy is a rule which indicates how to modify a triage policy on the basis of the feedback from a user and when to put a query to a user, and is used to judge whether there is a query and whether there is a modification to be made to a triage policy.

[0047] (Triage unit) 　　The triage unit 12 generates a triage result based on the patient information acquired from the acquisition unit 11 and the triage policy acquired from the triage policy DB 15. The triage unit 12 may transmit to the medical professional's terminal 20 the generated triage result together with the patient information, and present the triage result and the patient information to the user on the medical professional's terminal 20.

[0048] In response to the triage policy being modified by the feedback processing unit 13, the triage unit 12 may again generate, based on the modified triage policy and the patient information, a triage result for the patient, and present the triage result to the user.

[0049] This makes it possible for the user to check whether the modification to the triage policy is proper. In a case where the modification to the triage policy is improper or insufficient, the feedback processing unit 13 can further modify the triage policy by acquiring feedback from the user on the triage result generated again.

[0050] (Feedback processing unit) 　　The feedback processing unit 13 may internally include the reflection unit 18 and the query generation unit 19.

[0051] The query generation unit 19 receives, as an input, the history of triage results, queries, and feedback, and refers to the feedback reflection policy to output whether there is a query to be presented to the user and the details of the query.

[0052] The reflection unit 18 receives, as an input, the history of triage results, queries, and feedback, and refers to the feedback reflection policy to output whether to modify the triage policy and the details of the modification to be made to the triage policy.

[0053] The above-described history of triage results, queries, and pieces of feedback may include the most recent feedback acquired by the feedback processing unit 13 and a past history which is stored in the triage result-query-feedback history DB 16. The feedback reflection policy may be one that is stored in the feedback reflection policy DB 17.

[0054] The reflection unit 18 and the query generation unit 19 may be separate components, or may be unified. That is, the reflection unit 18 and the query generation unit 19 that are unified may receive, as an input, the history of triage results, queries, and feedback, and refer to the feedback reflection policy to output whether there is a query to be presented to the user, the details of the query, whether to modify the triage policy, and the details of the modification to the triage policy.

[0055] (Use of language model) 　　The triage unit 12 and the feedback processing unit 13 may use a generative model to carry out the above-described processes. As the generative model, a language model may be used.

[0056] For example, the triage unit 12 may input a triage policy and patient information to a first language model, to generate a triage result. The triage unit 12 may include the first language model, or may interact over a network with the first language model that is included in another computer.

[0057] For example, the feedback processing unit 13 may (i) input, to a second language model, the feedback reflection policy and the history of information (a triage result and a query if the query is presented) presented to the user and feedback from the user, to generate output information which indicates whether there is a query to be presented to the user and whether there is a modification to be made to the triage policy, and (ii) determine, based on the output information, whether there is a query to be presented to the user and whether there is a modification to be made to the triage policy.

[0058] The first language model and the second language model may be separate language models, or may be one and the same.

[0059] For example, the first language model and the second language model may be language models trained by machine learning to learn arrangements of components (words, etc.) of sentences in the sentences and arrangements of sentences in text. For example, as the language models, Generative Pre-Trained Transformer (GPT) can be used which outputs a sentence that contains an inputted character string by predicting a character string that has a high probability of following the inputted character string. Besides the above, examples of the language models can include Text-to-Text Transfer Transformer (T5), Bidirectional Encoder Representations from Transformers (BERT), Robustly optimized BERT approach (RoBERTa), and Efficiently Learning an Encoder that Classifies Token Replacements Accurately (ELECTRA).

[0060] The triage policy and the feedback reflection policy to be inputted to the language models may include a prompt. In addition to the triage policy, the triage unit 12 may further input a prompt to the first language model. In addition to the feedback reflection policy, the feedback processing unit 13 may input a prompt to the second language model.

[0061] (Operation of triage policy modification system) 　　Fig. 6 is a flowchart illustrating an example operation of the triage policy modification system 1A.

[0062] In step S21, the authentication unit 14 authenticates a user based on authentication credentials inputted to the medical professional's terminal 20. The authentication unit 14 notifies the feedback processing unit 13 of the user ID of the authenticated user.

[0063] In step S22, the acquisition unit 11 acquires patient information and provides the triage unit 12 with the patient information.

[0064] In step S23, the triage unit 12 generates a triage result based on the patient information and a triage policy stored in the triage policy DB 15, and presents the triage result together with the patient information to the user via the medical professional's terminal 20. The triage unit 12 transmits the triage result also to the feedback processing unit 13, and the feedback processing unit 13 accumulates the triage result in the triage result-query-feedback history DB 16.

[0065] In a case where the feedback processing unit 13 has acquired feedback from the user on the triage result via the medical professional's terminal 20 (YES in step S24), in step S25, based on a history of information presented to the user and feedback from the user, the history being stored in the triage result-query-feedback history DB 16 or being most recently acquired, the feedback processing unit 13 determines whether there is a query to be presented to the user and whether there is a modification to be made to the triage policy.

[0066] In a case where there is a query (YES in step S26), in step S27, the feedback processing unit 13 presents the query to the user via the medical professional's terminal 20, and returns to step S24 and waits for feedback from the user.

[0067] In a case where there is not a query (NO in step S26) and there is a modification to be made to the triage policy (YES in step S28), in step S29, the feedback processing unit 13 modifies the triage policy stored in the triage policy DB 15. The triage unit 12 again generates a triage result based on the patient information and the modified triage policy. The triage unit 12 presents the patient information and the triage result generated again to the user via the medical professional's terminal 20, and returns to step S24 and waits for feedback from the user.

[0068] In a case where the feedback processing unit 13 has failed to acquire feedback from the user on the triage result or the query (NO in step S24) and in a case where there is not a query (NO in step S26) and there is not a modification to be made to the triage policy (NO in step S28), the processing may be ended. Alternatively, instead of ending the processing, with a return to step S22, another piece of patient information may be acquired.

[0069] (Examples) 　　Two examples are described here with reference to the drawings. In both of the examples, the triage unit 12 and the feedback processing unit 13 (the reflection unit 18 and the query generation unit 19) carried out processes with use of a language model.

[0070] A first example was carried out as follows.

[0071] The authentication unit 14 used authentication credentials 30 acquired from the medical professional's terminal 20 to perform user authentication, as illustrated in Fig. 7. The authentication credentials 30 indicate that the user ID is 1467.

[0072] As illustrated in Fig. 8, the triage unit 12 generated a triage result 32 based on a triage policy stored in the triage policy DB 15 and patient information 31 acquired by the acquisition unit 11. The triage result 32 indicates that: the first classification is ATS Category 2; the degree of confidence of that first classification is very high; the second classification is ATS Category 3; and the degree of confidence of that second classification is high.

[0073] Fig. 9 is a representation of the triage policy used in the example. This triage policy stipulates that: patients should be classified on the basis of the ATS Category Description; classifications which have the highest and second highest degrees of confidence should be outputted; and the degrees of confidence and rationales should be provided in combination.

[0074] As illustrated in Fig. 10, a user checked the triage result 32 on the medical professional's terminal 20, and inputted feedback 33. The feedback 33 indicates that the patient is classified as Category 1, not as Category 3, and also indicates the rationale for this classification.

[0075] As illustrated in Fig. 11, the reflection unit 18 generated, based on the feedback 33 from the authenticated user ID and a feedback reflection policy stored in the feedback reflection policy DB 17, a rule 34 to be incorporated into the triage policy (with a determination that there was a modification to be made to the triage policy), and added the rule 34 to the triage policy stored in the triage policy DB 15.

[0076] Fig. 12 is a representation of the feedback reflection policy used in the example. This feedback reflection policy stipulates that: a rule to be incorporated into a triage policy should be generated on the basis of feedback from a user; and in a case where the feedback might be incorrect on the basis of the ATS Category Description, a query should be presented.

[0077] As illustrated in Fig. 13, the triage unit 12 generated a triage result 35 based on the patient information 31 and the triage policy into which the rule 34 had been incorporated and which was stored in the triage policy DB 15. The triage result 35 indicates that: the first classification is ATS Category 1; the degree of confidence of that first classification is high; the second classification is ATS Category 2; and the degree of confidence of that second classification is high.

[0078] As illustrated in Fig. 14, the user checked the triage result 35 on the medical professional's terminal 20, and inputted feedback 36. The feedback 36 indicates that the degree of confidence of Category 1 is very high.

[0079] As illustrated in Fig. 15, the reflection unit 18 (i) generated, based on the feedback 36 from the authenticated user ID and the feedback reflection policy stored in the feedback reflection policy DB 17, a rule 37 obtained by modifying the rule 34 (with a determination that there was a modification to be made to the triage policy), and (ii) made the modification to change the rule 34 to the rule 37 in the triage policy stored in the triage policy DB 15.

[0080] As illustrated in Fig. 16, the triage unit 12 generated a triage result 38 based on the patient information 31 and the triage policy into which the rule 37 had been incorporated and which was stored in the triage policy DB 15. The triage result 38 indicates that: the first classification is ATS Category 1; the degree of confidence of that first classification is very high; the second classification is ATS Category 2; and the degree of confidence of that second classification is high. The user did not provide feedback on the triage result 38. With the above, the triage policy was interactively improved.

[0081] A second example was carried out as follows. The user authentication was the same as in the first example, and the description thereof is not repeated.

[0082] As illustrated in Fig. 17, the triage unit 12 generated a triage result 42 based on a triage policy stored in the triage policy DB 15 and patient information 41 acquired by the acquisition unit 11. The triage result 42 indicates that: the first classification is ATS Category 1; the degree of confidence of that first classification is very high; the second classification is ATS Category 2; and the degree of confidence of that second classification is high.

[0083] As illustrated in Fig. 18, the user checked the triage result 42 on the medical professional's terminal 20, and inputted feedback 43. The feedback 43 indicates that the patient is classified as Category 3.

[0084] As illustrated in Fig. 19, the query generation unit 19 generated a query 44 (with a determination that there was a query to be presented to the user) based on the feedback 43 from the authenticated user ID and a feedback reflection policy stored in the feedback reflection policy DB 17, and presented the query 44 to the user. On the basis of the ATS guidelines, the query 44 indicates that the patient is classified as Category 1 or Category 2, not as Category 3.

[0085] As illustrated in Fig. 20, the user checked the query 44 on the medical professional's terminal 20, and inputted feedback 45. The feedback 45 indicates that the patient is classified as Category 1 or Category 2.

[0086] As illustrated in Fig. 21, the reflection unit 18 determined, based on a history 46 of triage results, queries, and pieces of feedback which were stored in the triage result-query-feedback history DB 16 and the feedback reflection policy stored in the feedback reflection policy DB 17, that there was not a modification to be made to the triage policy. With the above, the triage policy was successfully prevented from being changed due to incorrect feedback for the worse.

[0087] <Software Implementation Example> 　　Some or all of the functions of apparatuses which constitute the triage policy modification systems 1 and 1A and the triage policy modification apparatus 100 (hereinafter, also referred to as "each apparatus above") may be implemented by hardware such as an integrated circuit (IC chip), or may be implemented by software.

[0088] In the latter case, the each apparatus above is provided by, for example, a computer that executes instructions of a program that is software implementing the functions. An example (hereinafter, computer C) of such a computer is illustrated in Fig. 22. Fig. 22 is a block diagram illustrating a hardware configuration of the computer C which functions as the each apparatus above.

[0089] The computer C includes at least one processor C1 and at least one memory C2. The memory C2 has recorded thereon a program P for causing the computer C to operate as the each apparatus above. The processor C1 of the computer C retrieves the program P from the memory C2 and executes the program P, so that the functions of the above systems or each apparatus above are implemented.

[0090] Examples of the processor C1 can include a central processing unit (CPU), a graphic processing unit (GPU), a digital signal processor (DSP), a micro processing unit (MPU), a floating point number processing unit (FPU), a physics processing unit (PPU), a tensor processing unit (TPU), a quantum processor, a microcontroller, and a combination thereof. Examples of the memory C2 can include a flash memory, a hard disk drive (HDD), a solid state drive (SSD), and a combination thereof.

[0091] The computer C may further include a random access memory (RAM) into which the program P is loaded at the time of execution and in which various kinds of data are temporarily stored. The computer C may further include a communication interface via which data is transmitted to and received from another apparatus. The computer C may further include an input-output interface via which inputting-outputting equipment such as a keyboard, a mouse, a display, or a printer is connected.

[0092] The program P can be recorded on a non-transitory tangible recording medium M capable of being read by the computer C. Examples of such a recording medium M can include a tape, a disk, a card, a semiconductor memory, and a programmable logic circuit. The computer C can obtain the program P via such a recording medium M. The program P can be transmitted via a transmission medium. Examples of such a transmission medium can include a communication network and a broadcast wave. The computer C can obtain the program P also via such a transmission medium.

[0093] The above-described functions of the each apparatus above may be implemented by a single processor provided in a single computer, may be implemented by the cooperation among a plurality of processors provided in a single computer, or may be implemented by the cooperation among a plurality of processors provided in a plurality of respective computers. Further, a program for causing the each apparatus above to implement the above-described functions may be stored in a single memory provided in a single computer, may be stored in a distributed manner in a plurality of memories provided in a single computer, or may be stored in a distributed manner in a plurality of memories provided in a plurality of respective computers.

[0094] <Additional remark 1> 　　The present disclosure includes techniques described in supplementary notes below. Note, however, that the present invention is not limited to the techniques described in supplementary notes below, but may be altered in various ways by a skilled person within the scope of the claims.

[0095] (Supplementary note 1) 　　A triage policy modification system, including: an acquisition means for acquiring patient information regarding a patient; a triage means for generating, based on the patient information and a triage policy for performing triage, a triage result for the patient, and presenting the triage result to a user; and a feedback processing means for acquiring feedback from the user, the feedback processing means being configured to: based on a history of information presented to the user and the feedback from the user, determine whether there is a query to be presented to the user and whether there is a modification to be made to the triage policy; in a case where there is the query, present the query to the user and further acquire the feedback; and in a case where there is the modification, modify the triage policy. 　　(Supplementary note 2) 　　The triage policy modification system according to supplementary note 1, in which in response to the triage policy having been modified, the triage means is configured to again generate, based on the triage policy modified and the patient information, a triage result for the patient, and present the triage result to the user. 　　(Supplementary note 3) 　　The triage policy modification system according to supplementary note 1 or 2, further including an authentication means for authenticating the user, the feedback processing means being configured to acquire the feedback from the user authenticated by the authentication means. 　　(Supplementary note 4) 　　The triage policy modification system according to any one of supplementary notes 1 to 3, in which the triage means is configured to generate the triage result by inputting the triage policy and the patient information to a first language model, and the feedback processing means is configured to generate output information which indicates whether there is a query to be presented to the user and whether there is a modification to be made to the triage policy, by inputting to a second language model a feedback reflection polic for judging whether there is a query and whether there is a modification to be made to a triage policy and the history of information presented to the user and the feedback from the user, and determine, based on the output information, whether there is a query to be presented to the user and whether there is a modification to be made to the triage policy. 　　(Supplementary note 5) 　　The triage policy modification system according to supplementary note 4, in which the output information includes information which indicates details of the query in a case where there is the query, and includes information which indicates details of the modification in a case where there is the modification. 　　(Supplementary note 6) 　　A triage policy modification apparatus, including: an acquisition means for acquiring patient information regarding a patient; a triage means for generating, based on the patient information and a triage policy for performing triage, a triage result for the patient, and presenting the triage result to a user; and a feedback processing means for acquiring feedback from the user, the feedback processing means being configured to: based on a history of information presented to the user and the feedback from the user, determine whether there is a query to be presented to the user and whether there is a modification to be made to the triage policy; in a case where there is the query, present the query to the user and further acquire the feedback; and in a case where there is the modification, modify the triage policy. 　　(Supplementary note 7) 　　A triage policy modification method, including: acquiring patient information regarding a patient; generating, based on the patient information and a triage policy for performing triage, a triage result for the patient, and presenting the triage result to a user; acquiring feedback from the user; determining, based on a history of information presented to the user and the feedback from the user, whether there is a query to be presented to the user and whether there is a modification to be made to the triage policy; presenting the query to the user and further acquiring the feedback, in a case where there is the query; and modifying the triage policy in a case where there is the modification. 　　(Supplementary note 8) 　　A triage policy modification program for causing at least one computer to carry out: acquiring patient information regarding a patient; generating, based on the patient information and a triage policy for performing triage, a triage result for the patient, and presenting the triage result to a user; acquiring feedback from the user; determining, based on a history of information presented to the user and the feedback from the user, whether there is a query to be presented to the user and whether there is a modification to be made to the triage policy; presenting the query to the user and further acquiring the feedback, in a case where there is the query; and modifying the triage policy in a case where there is the modification.

[0096] <Additional remark 2> 　　The present disclosure includes techniques described in supplementary notes below. Note, however, that the present invention is not limited to the techniques described in supplementary notes below, but may be altered in various ways by a skilled person within the scope of the claims.

[0097] (Supplementary note 1) 　　A triage policy modification system including at least one processor, the at least one processor carrying out: an acquisition process of acquiring patient information regarding a patient; a triage process of generating, based on the patient information and a triage policy for performing triage, a triage result for the patient, and presenting the triage result to a user; and a feedback process of acquiring feedback from the user, in the feedback process, the at least one processor being configured to: based on a history of information presented to the user and the feedback from the user, determine whether there is a query to be presented to the user and whether there is a modification to be made to the triage policy; in a case where there is the query, present the query to the user and further acquire the feedback; and in a case where there is the modification, modify the triage policy.

[0098] Note that the triage policy modification system may further include a memory. In the memory, a program for causing the at least one processor to carry out the processes may be stored.

[0099] (Supplementary note 2) 　　A triage policy modification apparatus including at least one processor, the at least one processor carrying out: an acquisition process of acquiring patient information regarding a patient; a triage process of generating, based on the patient information and a triage policy for performing triage, a triage result for the patient, and presenting the triage result to a user; and a feedback process of acquiring feedback from the user, in the feedback process, the at least one processor being configured to: based on a history of information presented to the user and the feedback from the user, determine whether there is a query to be presented to the user and whether there is a modification to be made to the triage policy; in a case where there is the query, present the query to the user and further acquire the feedback; and in a case where there is the modification, modify the triage policy.

[0100] Note that the triage policy modification apparatus may further include a memory. In the memory, a program for causing the at least one processor to carry out the processes may be stored.

[0101] This application is based upon and claims the benefit of priority from Singapore Patent Application No. 10202500120R, filed on January 14, 2025, the disclosure of which is incorporated herein in its entirety by reference.

[0102] 1, 1A: Triage policy modification system 　　11: Acquisition unit 　　12: Triage unit 　　13: Feedback processing unit 　　14: Authentication unit 　　15: Triage policy DB 　　16: Triage result-query-feedback history DB 　　17: Feedback reflection policy DB 　　18: Reflection unit 　　19: Query generation unit 　　20: Medical professional's terminal 　　100: Triage policy modification apparatus

Claims

1. A triage policy modification system, comprising: 　　an acquisition means for acquiring patient information regarding a patient; 　　a triage means for generating, based on the patient information and a triage policy for performing triage, a triage result for the patient, and presenting the triage result to a user; and 　　a feedback processing means for acquiring feedback from the user, 　　the feedback processing means being configured to: 　　　　based on a history of information presented to the user and the feedback from the user, determine whether there is a query to be presented to the user and whether there is a modification to be made to the triage policy; 　　　　in a case where there is the query, present the query to the user and further acquire the feedback; and 　　　　in a case where there is the modification, modify the triage policy.

2. The triage policy modification system according to claim 1, wherein 　　in response to the triage policy having been modified, the triage means is configured to again generate, based on the triage policy modified and the patient information, a triage result for the patient, and present the triage result to the user.

3. The triage policy modification system according to claim 1, further comprising 　　an authentication means for authenticating the user, 　　the feedback processing means being configured to acquire the feedback from the user authenticated by the authentication means.

4. The triage policy modification system according to claim 1, wherein 　　the triage means is configured to generate the triage result by inputting the triage policy and the patient information to a first language model, and 　　the feedback processing means is configured to generate output information which indicates whether there is a query to be presented to the user and whether there is a modification to be made to the triage policy, by inputting to a second language model a feedback reflection policy for judging whether there is a query and whether there is a modification to be made to a triage policy and the history of information presented to the user and the feedback from the user, and determine, based on the output information, whether there is a query to be presented to the user and whether there is a modification to be made to the triage policy.

5. The triage policy modification system according to claim 4, wherein 　　the output information 　　　　includes information which indicates details of the query in a case where there is the query, and 　　　　includes information which indicates details of the modification in a case where there is the modification.

6. A triage policy modification apparatus, comprising: 　　an acquisition means for acquiring patient information regarding a patient; 　　a triage means for generating, based on the patient information and a triage policy for performing triage, a triage result for the patient, and presenting the triage result to a user; and 　　a feedback processing means for acquiring feedback from the user, 　　the feedback processing means being configured to: 　　　　based on a history of information presented to the user and the feedback from the user, determine whether there is a query to be presented to the user and whether there is a modification to be made to the triage policy; 　　　　in a case where there is the query, present the query to the user and further acquire the feedback; and 　　　　in a case where there is the modification, modify the triage policy.

7. A triage policy modification method, comprising: 　　acquiring patient information regarding a patient; 　　generating, based on the patient information and a triage policy for performing triage, a triage result for the patient, and presenting the triage result to a user; 　　acquiring feedback from the user; 　　determining, based on a history of information presented to the user and the feedback from the user, whether there is a query to be presented to the user and whether there is a modification to be made to the triage policy; 　　presenting the query to the user and further acquiring the feedback, in a case where there is the query; and 　　modifying the triage policy in a case where there is the modification.

8. A non-transitory computer-readable recording medium storing a program that, when executed by at least one computer, causes the at least one computer to carry out: 　　acquiring patient information regarding a patient; 　　generating, based on the patient information and a triage policy for performing triage, a triage result for the patient, and presenting the triage result to a user; 　　acquiring feedback from the user; 　　determining, based on a history of information presented to the user and the feedback from the user, whether there is a query to be presented to the user and whether there is a modification to be made to the triage policy; 　　presenting the query to the user and further acquiring the feedback, in a case where there is the query; and 　　modifying the triage policy in a case where there is the modification.

Images