Data processing device, communication terminal, data processing method, and program

Abstract

To provide a data processing device, a communication terminal, a data processing method, and a program that can reduce the burden of medical interviews on both doctors and patients.SOLUTION: A data processing device includes an execution unit that executes a medical interview with a patient in an interactive format, a generation unit that generates chief complaint data regarding the patient's chief complaint based on medical interview results obtained by the execution unit executing the medical interview in the interactive format by using a chief complaint generation model, and an output unit that outputs the chief complaint data generated by the generation unit.SELECTED DRAWING: Figure 9

Description

[Technical field]

[0001] The technology disclosed herein relates to a data processing device, a communication terminal, a data processing method, and a program. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including a description and related instruction sentence regarding the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2022-180282 A Summary of the Invention [Problem to be solved by the invention]

[0004] Meanwhile, from when a patient is admitted at the hospital's outpatient reception desk until the doctor administers medical treatment to the patient, the doctor manually inputs the medical questionnaire that the patient filled out in the waiting room into an electronic medical record, and asks the patient about his / her main complaint while referring to the medical questionnaire. If the patient is not good at speaking, or has severe symptoms that make it difficult to have a conversation, the doctor will spend a lot of time asking the patient about his / her main complaint. Entering the medical questionnaire into an electronic medical record and asking the patient about his / her main complaint are some of the reasons why doctors work long hours.

[0005] On the other hand, it is very troublesome for patients to fill out a questionnaire about their symptoms after arriving at the hospital's outpatient reception desk. Filling out a questionnaire is a difficult task for patients, especially when their symptoms are severe. In addition, if patients spend a long time waiting in the waiting room before seeing a doctor, the risk of infection from other patients increases. Furthermore, some patients have difficulty explaining their symptoms face-to-face with a doctor or summarizing and conveying their symptoms well.

[0006] The technology disclosed herein provides a data processing device, a communication terminal, a data processing method, and a program that can reduce the burden of medical interviews on both doctors and patients. [Means for solving the problem]

[0007] A first aspect of the technology disclosed herein is a data processing device comprising an execution unit that executes an interview with a patient in an interactive format, a generation unit that uses a chief complaint generation model to generate chief complaint data related to the patient's chief complaint based on the interview results obtained by the execution unit executing the interview in the interactive format, and an output unit that outputs the chief complaint data generated by the generation unit.

[0008] A second aspect of the technology of the present disclosure is the data processing device according to the first aspect, in which the chief complaint data is summary data indicating a summary of the chief complaint.

[0009] A third aspect of the technology disclosed herein is a data processing device according to the first aspect, wherein the execution unit generates questions for the patient by using a question generation model, and performs the interview using the questions.

[0010] A fourth aspect of the technology disclosed herein is a data processing device according to the third aspect, wherein the execution unit generates the question based on a response from the patient to the medical interview by using the question generation model.

[0011] A fifth aspect of the technology of the present disclosure is the data processing device according to the first aspect, wherein the output unit outputs the chief complaint data to a medical institution.

[0012] A sixth aspect of the technology disclosed herein is a communications terminal capable of communicating with a data processing device relating to any one of the first to sixth aspects, the communications terminal having a user interface, the user interface presenting the contents of the medical interview and accepting responses from the patient to the medical interview executed by the execution unit.

[0013] A seventh aspect of the technology of the present disclosure is a data processing method including: conducting an interview with a patient in an interactive format; using a chief complaint generation model to generate chief complaint data regarding the patient's chief complaint based on interview results obtained by conducting the interview in the interactive format; and outputting the chief complaint data.

[0014] An eighth aspect of the technology of the present disclosure is a program for causing a computer to execute a process including: conducting an interview with a patient in an interactive format; using a chief complaint generation model to generate chief complaint data regarding the patient's chief complaint based on the interview results obtained by conducting the interview in the interactive format; and outputting the chief complaint data. [Brief description of the drawings]

[0015] [Figure 1] FIG. 1 is a conceptual diagram illustrating an example of a configuration of a data processing system. [Diagram 2] FIG. 2 is a conceptual diagram showing an example of main functions of a data processing device and a smart device. [Diagram 3] A conceptual diagram showing an example of the processing contents in a data processing system when a medical interview implementation process is performed by a processor of a data processing device and a reception output process is performed by a processor of a smart device. [Figure 4] FIG. 2 is a conceptual diagram showing an example of a data format (expression form) of medical interview data generated by a data generation model. [Diagram 5] FIG. 13 is a conceptual diagram showing an example of processing contents of a smart device. [Figure 6] FIG. 2 is a conceptual diagram illustrating an example of processing contents of a generating unit and an output unit of the data processing device. [Figure 7] 13 is a flowchart showing an example of the flow of a medical interview implementation process. [Figure 8A] 13 is a flowchart showing an example of the flow of a reception and output process. [Figure 8B] This is a continuation of the flowchart of FIG. 8A. [Figure 9] 11 is a time chart showing an example of the flow of actions of a doctor attending to an outpatient. [Figure 10] 1 is a time chart showing an example of the flow of actions of an outpatient. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0016] Hereinafter, examples of embodiments of a data processing device, a communication terminal, a data processing method, and a program according to the technology of the present disclosure will be described with reference to the attached drawings.

[0017] First, the terms used in the following description will be explained.

[0018] In the following embodiments, a signed processor (hereinafter simply referred to as a "processor") may be one arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be one type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), or a TPU (Tensor Processing Unit).

[0019] In the following embodiments, a signed RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by the processor.

[0020] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0021] In the following embodiments, a communication I / F (Interface) with a code is an interface including a communication processor and an antenna. The communication I / F controls communication between multiple computers. An example of a communication standard applied to the communication I / F is a wireless communication standard including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0022] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. In addition, in this specification, the same idea as "A and / or B" is also applied when three or more things are expressed by connecting them with "and / or."

[0023] FIG. 1 shows an example of the configuration of a data processing system 10 according to an embodiment. As shown in FIG. 1, the data processing system 10 includes a data processing device 12 and a smart device 14. The data processing device 12 is used by a medical interview service company 16, and the smart device 14 is used by a patient 20. An example of the data processing device 12 is a server. An example of the smart device 14 is a smartphone. Here, the smart device 14 is illustrated, but instead of the smart device 14, or together with the smart device 14, a communication terminal other than the smart device 14 (for example, a personal computer and / or a wearable terminal, etc.) may be used. In this embodiment, the data processing device 12 is an example of a "data processing device" according to the technology of the present disclosure, and the smart device 14 is an example of a "communication terminal" according to the technology of the present disclosure.

[0024] The data processing system 10 is a system used by a medical interview agency 16 to conduct a medical interview requested by a hospital 18. The medical interview agency 16 conducts a medical interview with a patient 20 on behalf of a doctor 19 of the hospital 18 by using the data processing device 12. The medical interview is conducted online using the data processing device 12 and a smart device 14.

[0025] The data processing device 12 includes a computer 22 and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network), etc.

[0026] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52. The reception device 38 and the output device 40 are an example of a "user interface" according to the technology of the present disclosure.

[0027] The reception device 38 includes a touch panel 38A and a microphone 38B, and receives instructions from the patient 20. The touch panel 38A detects contact with a pointer (e.g., a pen or a finger) to receive instructions by touch of the pointer. The microphone 38B detects the voice of the patient 20 to receive instructions by voice.

[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the patient 20 by outputting the data in a form of expression (e.g., voice and / or text) that the patient 20 can perceive. The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs voice according to instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, an aperture, and a shutter, and an imaging element such as a Complementary Metal-Oxide-Semiconductor (CMOS) image sensor or a Charge Coupled Device (CCD) image sensor.

[0029] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for transmitting and receiving various types of information between the processor 46 and the processor 28 via the network 54.

[0030] The patient 20 uses the smart device 14 to answer questions posed by the medical interview agency 16 via the data processing device 12 and the smart device 14. The exchange of questions and answers is conducted in a dialogue format. The dialogue format exchange is realized by chat. Text and voice are used for chat. The chat is realized by executing a chat application on the smart device 14.

[0031] Although details will be described later, the questions posed to the patient 20 are questions that correspond to the contents of the interview determined in advance by the hospital 18 or the like, and are generated by a data processing device. The questions are also divided into a number of sub-questions, and the data processing device generates the sub-questions according to the contents of the answers. The interview agency 16 uses the data processing device 12 to generate a summary of the main complaint from the answers obtained from the patient 20, and delivers it to the hospital 18.

[0032] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14. As shown in FIG. 2, in the data processing device 12, the interview implementation process is performed by the processor 28. The interview implementation program 56 is stored in the storage 32. The interview implementation program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the interview implementation program 56 from the storage 32, and executes the read interview implementation program 56 on the RAM 30. The interview implementation process is realized by the processor 28 operating as the execution unit 28A, the generation unit 28B, and the output unit 28C in accordance with the interview implementation program 56 executed on the RAM 30.

[0033] The storage 32 stores a data generation model 58. The data generation model 58 is an example of a "chief complaint generation model" and a "question generation model" according to the technology of the present disclosure. As will be described in detail later, the data generation model 58 is used by the generation unit 28B.

[0034] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 62. The reception output program 62 is an example of the above-mentioned chat application, and is used together with the medical interview implementation program 56 by the data processing system 10. The reception output program 62 is a program created based on an existing chat application (for example, the conventionally known LINE (registered trademark)). The processor 46 reads out the reception output program 62 from the storage 50, and executes the read reception output program 62 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 62 executed on the RAM 48.

[0035] FIG. 3 shows an example of the processing contents in the data processing system 10 when the processor 28 of the data processing device 12 performs the medical interview processing and the processor 46 of the smart device 14 performs the reception output processing.

[0036] As shown in Fig. 3, the execution unit 28A executes an interview with the patient 20 in an interactive format by communicating with the smart device 14 via the network 54 (see Fig. 1). First, the execution unit 28A determines whether or not a condition for starting an interview (hereinafter referred to as an "interview start condition") is satisfied in order to start an interview with the patient 20. One example of the interview start condition is a condition in which an instruction from the patient 20 (for example, an instruction to cause the data processing device 12 to conduct an interview necessary for the patient 20 to be examined at the hospital 18) is accepted by the reception device 38.

[0037] When the investigation start condition is satisfied, the execution unit 28A acquires instruction data 68 indicating an instruction to be given to the data generation model 58. For example, the instruction data 68 is stored in the storage 32, and when the investigation start condition is satisfied, the execution unit 28A acquires the instruction data 68 from the storage 32. Note that the instruction data 68 may be stored in a server or the like on the network 54, and in this case, the execution unit 28A acquires the instruction data 68 from the server or the like on the network 54.

[0038] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT-4 (Internet search<https: / / openai.com / gpt-4> ) or ChatGPT-4-32k. The data generation model 58 is obtained by performing deep learning on a neural network. Instruction data 68 is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is input. The data generation model 58 infers the input inference data according to the instruction indicated by the instruction data 68, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0039] An example of the instruction data 68 is text data indicating the following text.

[0040] "You are an internal medicine doctor at a hospital. There is a patient with a chief complaint. You need to find out the chief complaint from the patient and summarize the chief complaint so that other doctors at the hospital can refer to it when they examine the patient. It is necessary to summarize the chief complaint in a way that is useful from the doctor's perspective so that the doctor who is being reported can quickly understand the chief complaint. Ask the patient questions and find out the chief complaint. Please confirm the points that should be confirmed from the doctor's perspective. The contents of the report to the other doctor should include the "chief complaint", "suspected illness", "contents of necessary treatment or examination", "mental state of the patient", and "points to note". Use diagrams as necessary. Ask the patient questions in a chat format that is easy to answer. Questions should be asked by voice and text. When all questions have been answered or when you receive the signal to "start report", start reporting to the hospital. I am the patient and you are the doctor."

[0041] Note that the instructions specifically exemplified here are merely examples, and any instructions may be used as long as they do not deviate from the spirit of the technology of the present disclosure.

[0042] The generating unit 28B generates medical interview data 70 based on the instruction data 68 by using the data generation model 58. The medical interview data 70 is data indicating a question reflecting a predetermined medical interview content. The medical interview data 70 is roughly divided into medical interview start data 70A, question data 70B, and medical interview end data 70C.

[0043] The medical interview start data 70A is data indicating a question to be asked to the patient 20 at the beginning of a dialogue with the patient 20. The question data 70B is data indicating a question in response to an answer from the patient 20. The question data 70B is broadly divided into medical interview content question data 70B1 and summary-included question data 70B2. The medical interview content question data 70B1 is data indicating a part of a question in accordance with the medical interview content (i.e., at least one of a plurality of sub-questions obtained by subdividing the medical interview content). The summary-included question data 70B2 is data indicating a question including a summary of the patient 20's chief complaint. The patient 20's chief complaint is included in the answer obtained from the patient 20 by asking all the questions according to the medical interview content question data 70B1. The summary-included question data 70B2 includes summary data 70B2a as chief complaint data related to the patient 20's chief complaint. The summary data 70B2a is data indicating a summary of the patient 20's chief complaint. The interview end data 70C is data indicating words to be uttered to the patient 20 when the interview is ended. In this embodiment, the summary data 70B2a is an example of the "chief complaint data" and "summary data" according to the technology of the present disclosure. Note that, although an example in which the summary data 70B2 is generated by the data generation model 58 is given here, this is merely an example, and data indicating the chief complaint itself (i.e., the chief complaint before summary) may be generated by the data generation model 58.

[0044] When the instruction data 68 is input to the data generation model 58, the data generation model 58 generates the medical interview start data 70A. The execution unit 28A acquires the medical interview start data 70A generated by the data generation model 58. Then, the execution unit 28A transmits the medical interview start data 70A to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the medical interview start data 70A. The microphone 38B acquires a voice indicating the answer by the patient 20 to the medical interview start data 70A. The control unit 46A transmits answer voice data 72 (hereinafter also referred to as "first answer voice data") indicating the voice acquired by the microphone 38B in response to the medical interview start data 70A to the data processing device 12. In the data processing device 12, the execution unit 28A acquires the first answer voice data.

[0045] The generating unit 28B inputs the first answer voice data acquired by the executing unit 28A to the data generation model 58. When the first answer voice data is input to the data generation model 58, the data generation model 58 generates medical history content question data 70B1 that matches the first answer voice data. The medical history content question data 70B1 that matches the first answer voice data refers to data indicating a question determined according to the content of the answer identified from the first answer voice data. The executing unit 28A acquires the medical history content question data 70B1 generated by the data generation model 58. Then, the executing unit 28A transmits the medical history content question data 70B1 to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the medical history content question data 70B1. The microphone 38B acquires a voice indicating the answer by the patient 20 to the medical history content question data 70B1. The control unit 46A transmits answer voice data 72 (hereinafter also referred to as "second answer voice data") indicating a voice picked up by the microphone 38B in response to the medical interview content question data 70B1 to the data processing device 12. In the data processing device 12, the execution unit 28A acquires the second answer voice data.

[0046] The generating unit 28B inputs the second answer voice data acquired by the executing unit 28A to the data generation model 58. When the second answer voice data is input to the data generation model 58, the data generation model 58 generates medical interview content question data 70B1 that matches the second answer voice data. Then, the exchange between the medical interview content question data 70B1 and the second answer voice data continues until all questions according to the medical interview content are completed. Note that the medical interview content question data 70B1 that matches the second answer voice data refers to data indicating a question determined according to the content of the answer identified from the second answer voice data.

[0047] When the final second answer voice data obtained by the exchange between the medical history content question data 70B1 and the second answer voice data is input to the data generation model 58, the summary-including question data 70B2 is generated by the data generation model 58. The summary data 70B2a included in the summary-including question data 70B2 is data indicating a summary of the patient's chief complaint. The patient's chief complaint is included in the answers indicated by all the second answer voice data obtained by the exchange between the medical history content question data 70B1 and the second answer voice data until all questions according to the medical history content are completed. The summary-including question data 70B2 also includes data indicating a message asking the patient 20 whether the summary of the chief complaint is appropriate.

[0048] The execution unit 28A acquires the summary-including question data 70B2 generated by the data generation model 58. Then, the execution unit 28A transmits the summary-including question data 70B2 to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the summary-including question data 70B2. The microphone 38B acquires a voice indicating the answer by the patient 20 to the summary-including question data 70B2. The control unit 46A transmits answer voice data 72 indicating the voice acquired by the microphone 38B in response to the summary-including question data 70B2 (hereinafter also referred to as "third answer voice data") to the data processing device 12. In the data processing device 12, the execution unit 28A acquires the third answer voice data.

[0049] Here, if the answer identified from the third answer voice data is a negative answer to the summary indicated by the summary data 70B2a, the question data with summary 70B2 is regenerated, and the exchange between the question data with summary 70B2 and the third answer voice data continues.

[0050] When the answer identified from the third answer voice data is an affirmative answer to the summary indicated by the summary data 70B2a (i.e., when the patient 20 agrees with the contents of the summary), when the third answer voice data is input to the data generation model 58, interview end data 70C is generated by the data generation model 58. The interview end data 70C includes data indicating a message that a summary of the chief complaint will be sent to the hospital 18.

[0051] The execution unit 28A acquires the medical interview end data 70C generated by the data generation model 58. Then, the execution unit 28A transmits the medical interview end data 70C to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the medical interview end data 70C.

[0052] The generating unit 28B uses the data generation model 58 to generate assistance data 71 for assisting the doctor 19 in making a medical examination, etc., based on the interview result obtained by the executing unit 28A executing an interview in an interactive format. The assistance data 71 includes data indicating a disease suspected based on the contents of the patient 20's main complaint, data indicating the contents of necessary treatment or examination, data indicating the mental state of the patient 20, and data indicating points to note. An example of the interview result used to generate the assistance data 71 by the data generation model 58 is all of the second answer voice data. Note that all of the second answer voice data is merely an example, and summary data 70B2a may be used as the interview result used to generate the assistance data 71.

[0053] Fig. 4 shows an example of a data format (expression form) of the medical interview data 70 generated by the data generation model 58. As shown in Fig. 4, the data generation model 58 generates medical interview start voice data 70Aa and medical interview start text data 70Ab as medical interview start data 70A.

[0054] The medical interview start voice data 70Aa is voice data indicating a question to be asked to the patient 20 at the beginning of a conversation with the patient 20. The medical interview start voice data 70Ab is voice data indicating a question to be asked to the patient 20 at the beginning of a conversation with the patient 20. The data generation model 58 also generates question voice data 70Ba and question text data 70Bb as question data 70B. The question voice data 70Ba is voice data indicating a question in response to an answer from the patient 20. The question text data 70Bb is voice data indicating a question in response to an answer from the patient 20. The data generation model 58 also generates medical interview end voice data 70Ca and medical interview end text data 70Cb as medical interview end data 70C. The medical interview end voice data 70Ca is voice data indicating words to be asked to the patient 20 when the medical interview is to be ended. The medical interview end text data 70Cb is text data indicating words to be asked to the patient 20 when the medical interview is to be ended.

[0055] Fig. 5 shows an example of the processing contents of the smart device 14. As shown in Fig. 5, the speaker 40B outputs sounds indicated by the voice data (i.e., the medical interview start voice data 70Aa, the question voice data 70Ba, and the medical interview end voice data 70Ca) indicated by the medical interview data 70 transmitted from the execution unit 28A to the smart device 14 under the control of the control unit 46A.

[0056] In addition, under the control of the control unit 46A, the display 40A displays text indicated by the text data (i.e., medical interview start text data 70Ab, question text data 70Bb, and medical interview end text data 70Cb) indicated by the medical interview data 70 transmitted from the execution unit 28A to the smart device 14.

[0057] In this manner, the patient 20 responds by voice to the voice output from the speaker 40B and the text displayed on the display 40A, thereby completing the medical interview.

[0058] The microphone 38B acquires a voice response from the patient 20. The control unit 46A then performs a conventionally known voice-to-text conversion process on the response acquired by the microphone 38B to convert the voice response into a text response, and displays the text response on the display 40A. On the display 40A, the questions and the like shown in the interview data 70 and the speech of the patient 20 are alternately displayed in a distinguishable manner.

[0059] FIG. 6 shows an example of the processing contents performed by the data processing device 12 when a response is obtained from the patient 20 who is the subject of the medical interview. As shown in FIG. 6, the generating unit 28B generates a data set 74. The data set 74 is data in which summary data 70B2a and assistance data 71 are associated with each other. The output unit 28C acquires the data set 74 generated by the generating unit 28B, and outputs the acquired data set 74 to a default output destination. A first example of the default output destination is the management server 76 of the hospital 18. A second example of the default output destination is the storage 32. The output to the management server 76 of the hospital 18 is realized by transmission via the network 54 (see FIG. 1) using the communication I / F 26 (see FIG. 1).

[0060] The management server 76 acquires the data set 74 output from the output unit 28C, and performs specific processing on the acquired data set 74. For example, the specific processing includes a process of registering the data set 74 in an electronic medical record 78. The electronic medical record 78 is referred to by the doctor 19 when the doctor 19 examines the patient 20.

[0061] Next, the operation of the data processing system 10 will be described with reference to FIGS. 7 to 8B.

[0062] First, an example of the flow of the medical interview implementation process will be described with reference to Fig. 7. Note that the flow of the medical interview implementation process shown in Fig. 7 is an example of a "data processing method" according to the technique of the present disclosure.

[0063] In the medical interview implementation process shown in Fig. 8A, first, in step ST10, the execution unit 28A determines whether or not the medical interview start condition is satisfied. If the medical interview start condition is not satisfied in step ST10, the determination is negative, and the determination of step ST10 is performed again. If the medical interview start condition is satisfied in step ST10, the determination is positive, and the medical interview implementation process proceeds to step ST12.

[0064] In step ST12, the execution unit 28A acquires the instruction data 68. After the process of step ST12 is executed, the interview implementation process proceeds to step ST14.

[0065] In step ST14, the generation unit 28B generates interview start data 70A based on the instruction data 68 acquired in step ST12 by using the data generation model 58. Then, the execution unit 28A transmits the interview start data 70A generated by the generation unit 28B to the smart device 14. After the process of step ST14 is executed, the interview implementation process proceeds to step ST16.

[0066] In response to the medical interview start data 70A being transmitted to the smart device 14 as a result of the processing of step ST14 being executed, answer voice data 72 is transmitted from the smart device 14 (see step ST58 shown in FIG. 8A).

[0067] In step ST16, the execution unit 28A judges whether or not the answer voice data 72 transmitted from the smart device 14 has been received by the communication I / F 26. In step ST16, if the answer voice data 72 transmitted from the smart device 14 has not been received by the communication I / F 26, the judgment is negative, and the judgment of step ST16 is performed again. In step ST16, if the answer voice data 72 transmitted from the smart device 14 has been received by the communication I / F 26, the judgment is positive, and the medical interview implementation process proceeds to step ST18. In addition, the execution unit 28A acquires the answer voice data 72 received by the communication I / F 26.

[0068] In step ST18, the execution unit 28A judges whether or not all scheduled questions have been asked. In step ST18, if all scheduled questions have been asked, the judgment is negative and the medical interview process proceeds to step ST22. In step ST18, if all scheduled questions have not been asked, the judgment is negative and the medical interview process proceeds to step ST20.

[0069] In step ST20, the generation unit 28B generates medical interview content question data 70B1 corresponding to the answer voice data 72 acquired in step ST12 by using the data generation model 58. The execution unit 28A transmits the medical interview content question data 70B1 generated by the generation unit 28B to the smart device 14. After the process of step ST20 is executed, the medical interview implementation process proceeds to step ST16.

[0070] In response to the medical interview content question data 70B1 being transmitted to the smart device 14 by executing the process of step ST20, the answer voice data 72 is transmitted from the smart device 14 (see step ST58 shown in FIG. 8A).

[0071] In step ST22, the generating unit 28B generates summary-including question data 70B2 including summary data 70B2a indicating summaries of the chief complaints included in the answers to all scheduled questions by using the data generation model 58. The executing unit 28A transmits the summary-including question data 70B2 generated by the generating unit 28B to the smart device 14. After the process of step ST22 is executed, the interview implementation process proceeds to step ST24.

[0072] In step ST24, the generation unit 28B generates assistance data 71 based on answers to all planned questions by using the data generation model 58. After the process of step ST24 is executed, the medical interview implementation process proceeds to step ST26.

[0073] In response to the summary-including question data 70B2 being transmitted to the smart device 14 by executing the process of step ST22, the smart device 14 transmits answer voice data 72 (see step ST58 shown in FIG. 8A).

[0074] In step ST26, the execution unit 28A judges whether or not the answer voice data 72 transmitted from the smart device 14 has been received by the communication I / F 26. In step ST26, if the answer voice data 72 transmitted from the smart device 14 has not been received by the communication I / F 26, the judgment is negative, and the judgment of step ST26 is performed again. In step ST26, if the answer voice data 72 transmitted from the smart device 14 has been received by the communication I / F 26, the judgment is positive, and the medical interview implementation process proceeds to step ST28. In addition, the execution unit 28A acquires the answer voice data 72 received by the communication I / F 26.

[0075] In step ST28, the generation unit 28B inputs the answer voice data 72 acquired in step ST34 to the data generation model 58. The data generation model 58 judges whether or not consent has been obtained from the patient 20 for the summary of the chief complaint, based on the answer voice data 72 input from the execution unit 28A. In step ST28, if consent has not been obtained from the patient 20 for the summary of the chief complaint, the judgment is negative, and the interview implementation process proceeds to step ST30. In step ST28, if consent has been obtained from the patient 20 for the summary of the chief complaint, the judgment is positive, and the interview implementation process proceeds to step ST32.

[0076] In step ST30, the generation unit 28B regenerates the summary-including question data 70B2 by performing the same process as the process in step ST22, and the execution unit 28A transmits the regenerated summary-including question data 70B2 to the smart device 14. After the process in step ST22 is performed, the medical interview implementation process proceeds to step ST26.

[0077] In step ST32, the generation unit 28B generates a data set 74 based on the summary data 70B2a included in the summary-included question data 70B2 generated in step ST22 or step ST30, and the support data 71 generated in step ST24. After the process of step ST32 is executed, the medical interview implementation process proceeds to step ST34.

[0078] In step ST34, the output unit 28C transmits the data set 74 generated in step ST32 to the management server 76 of the hospital 18. The management server 76 receives the data set 74 and registers the received data set 74 in the electronic medical record 78. After the processing of step ST34 is executed, the interview implementation processing ends.

[0079] Next, an example of the flow of the reception and output process will be described with reference to FIGS. 8A and 8B.

[0080] In the reception / output process shown in Fig. 8A, first, in step ST50, the control unit 46A determines whether or not the medical interview data 70 has been received by the communication I / F 44. In step ST50, if the medical interview data 70 has not been received by the communication I / F 44, the determination is negative, and the determination of step ST50 is performed again. In step ST50, if the medical interview data 70 has been received by the communication I / F 44, the determination is positive, and the reception / output process proceeds to step ST52.

[0081] In step ST52, the control unit 46A determines whether the medical interview data 70 received by the communication I / F 44 in step ST50 is medical interview start data 70A. In step ST52, if the medical interview data 70 received by the communication I / F 44 in step ST50 is not medical interview start data 70A, the determination is negative, and the reception and output process proceeds to step ST62. In step ST52, if the medical interview data 70 received by the communication I / F 44 in step ST50 is medical interview start data 70A, the determination is positive, and the reception and output process proceeds to step ST54.

[0082] In step ST54, the control unit 46A causes the output device 40 to output the medical interview start data 70A. After the process of step ST54 is executed, the reception and output process proceeds to step ST56.

[0083] In step ST56, the control unit 46A judges whether or not the microphone 38B has acquired a voice indicating the patient 20's answer to the medical interview start data 70A, medical interview content question data 70B1, or summary-included question data 70B2 output from the output device 40. In step ST56, if the microphone 38B has not acquired a voice indicating the patient 20's answer to the medical interview start data 70A, medical interview content question data 70B1, or summary-included question data 70B2 output from the output device 40, the judgment is negative, and the judgment of step ST56 is performed again. In step ST56, if the microphone 38B has acquired a voice indicating the patient 20's answer to the medical interview start data 70A, medical interview content question data 70B1, or summary-included question data 70B2 output from the output device 40, the judgment is positive, and the reception and output process proceeds to step ST58.

[0084] In step ST58, the control section 46A transmits answer voice data 72 indicating the voice picked up by the microphone 38B to the data processing device 12. After the process of step ST58 is executed, the reception and output process proceeds to step ST60.

[0085] In step ST60, the control unit 46A determines whether a condition for terminating the acceptance and output process (hereinafter referred to as the "termination condition") is satisfied. A first example of the termination condition is that an instruction to terminate the acceptance and output process is accepted by the acceptance device 38. A second example of the termination condition is that an instruction to terminate the acceptance and output process is given to the smart device 14 from an external device such as the data processing device 12.

[0086] In step ST60, if the termination condition is not satisfied, the determination is negative, and the reception and output process proceeds to step ST50. In step ST60, if the termination condition is satisfied, the determination is positive, and the reception and output process ends.

[0087] In step ST62, the control unit 46A judges whether the medical interview data 70 received by the communication I / F 44 in step ST50 is medical interview content question data 70B1. In step ST62, if the medical interview data 70 received by the communication I / F 44 in step ST50 is not medical interview content question data 70B1, the judgment is negative, and the reception and output process proceeds to step ST66 shown in Fig. 8B. In step ST62, if the medical interview data 70 received by the communication I / F 44 in step ST50 is medical interview content question data 70B1, the judgment is positive, and the reception and output process proceeds to step ST64.

[0088] In step ST64, the control unit 46A causes the output device 40 to output the medical interview content question data 70B1. After the process of step ST64 is executed, the reception and output process proceeds to step ST56.

[0089] In step ST66 shown in Fig. 8B, the control unit 46A judges whether the medical interview data 70 received by the communication I / F 44 in step ST50 is the question data with summary 70B2. In step ST66, if the medical interview data 70 received by the communication I / F 44 in step ST50 is not the question data with summary 70B2 (i.e., if the medical interview data 70 received by the communication I / F 44 in step ST50 is the medical interview end data 70C), the judgment is negative and the reception output process proceeds to step ST70. In step ST66, if the medical interview data 70 received by the communication I / F 44 in step ST50 is the question data with summary 70B2, the judgment is positive and the reception output process proceeds to step ST68.

[0090] In step ST68, the control section 46A causes the output device 40 to output the summary-included question data 70B2. After the process of step ST68 is executed, the reception and output process proceeds to step ST56 shown in FIG. 8A.

[0091] In step ST70, the control unit 46A outputs medical interview end data 70C to the output device 40. After the process of step ST70 is executed, the reception and output process ends.

[0092] FIG. 9 shows an example of the flow of work performed by a doctor 19 from when a patient 20 is admitted at the outpatient reception of a hospital 18 until the doctor 19 performs a medical procedure on the patient 20.

[0093] In a conventional workflow, when a medical questionnaire is received at the outpatient reception, the doctor 19 checks the contents of the medical questionnaire and then registers the contents entered on the medical questionnaire in an electronic medical record 78 (see FIG. 6). The doctor 19 then interviews the patient 20 about the patient's main complaint while referring to the medical questionnaire. If the patient 20 is not good at speaking or has difficulty in conversation due to severe symptoms, the doctor 19 will spend a lot of time eliciting the patient's main complaint. The doctor 19 performs medical treatment on the patient 20 based on the patient's main complaint.

[0094] In contrast, when the data processing system 10 according to the present embodiment is used, the data set 74 from the data processing device 12 is received by the management server 76 of the hospital 18 or the like. The data set 74 is registered in the electronic medical record 78. Since the data set 74 includes the summary data 70B2a, the doctor 19 can confirm the main complaint of the patient 20 by referring to the summary data 70B2a registered in the electronic medical record 78. This reduces the burden on the doctor 19 to understand the main complaint of the patient 20. Furthermore, since the data set 74 also includes the support data 71, the doctor 19 can refer to the support data 71 when performing medical treatment on the patient 20. This allows the doctor 19 to accurately determine what medical treatment should be performed in a short time.

[0095] FIG. 10 shows an example of the flow of actions of a patient 20 from when the patient 20 is admitted at the outpatient reception desk of a hospital 18 to when the patient 20 receives medical treatment from a doctor 19 .

[0096] Conventionally, when the patient 20 arrives at the outpatient reception of the hospital 18, the hospital 18 requests the patient to fill out a medical questionnaire in the waiting room. Since the medical questionnaire is filled out by hand, it is very time-consuming for the patient 20 to fill out the medical questionnaire with information such as symptoms after arriving at the outpatient reception of the hospital 18, and filling out the medical questionnaire becomes a difficult task when the patient's symptoms are severe. In addition, if the patient 20 waits a long time in the waiting room until being examined by the doctor 19, the risk of infection from other patients increases. In addition, the patient 20 is interviewed by the doctor 19 about the contents of the medical questionnaire. At this time, the patient 20 may orally explain the contents of the medical questionnaire to the doctor 19 from the beginning.

[0097] In contrast, when the data processing system 10 according to the present embodiment is used, the patient 20 can be interviewed in an interactive chat format during his / her free time. This saves the trouble of filling out a medical questionnaire. In addition, the time the patient 20 spends waiting in the waiting room is also shortened, lowering the risk of infection from other patients. Furthermore, when the patient 20 meets the doctor 19 in the examination room, the doctor 19 only checks the symptoms of the patient 20 based on the summary of the main complaint shown in the summary data 70B2a, so the patient 20 rarely has to explain the symptoms orally from scratch, and the time spent listening to the doctor 19 can be shortened.

[0098] In the above embodiment, the patient 20 answers by voice, but the technology of the present disclosure is not limited to this. For example, the patient 20 may answer by inputting characters using the touch panel 38A or the like.

[0099] In the above embodiment, an example was given in which the answer voice data 72 was input as inference data to the data generation model 58, but the technology of the present disclosure is not limited to this. For example, an image obtained by capturing an image of the patient 20 by the camera 42 (see FIG. 1) and / or measurement results by various sensors (e.g., heart rate, blood pressure, and / or body temperature) may be input to the data generation model 58 as inference data.

[0100] In the above embodiment, the hospital 18 is exemplified, but this is merely an example, and the hospital may be a medical institution such as a clinic or a pharmacy. The data processing system 10 may also be used when the patient 20 wishes to consult with a medical professional other than the doctor 19 (for example, a pharmacist).

[0101] In the above embodiment, an example in which the data processing device 12 assuming a server is implemented in the data processing system 10 is given, but the technology of the present disclosure is not limited to this. For example, the technology of the present disclosure may be implemented in a general information processing system. Also, for example, the technology of the present disclosure may be implemented in a software program that runs on a server and / or a personal computer, or an application that runs on a smart device. Also, the technology of the present disclosure may be provided to a user in the form of SaaS (Software as a Service). Also, in the above embodiment, a server is given as an example of the data processing device 12, but this is merely an example, and the technology of the present disclosure may be realized by a device other than a server (for example, a personal computer, etc.).

[0102] In the above embodiment, an example was given in which the medical interview implementation process is performed by a single computer 22, but the technology disclosed herein is not limited to this, and distributed processing of the medical interview implementation process may be performed by multiple computers, including computer 22.

[0103] In the above embodiment, an example has been described in which the interview implementation program 56 is stored in the storage 32, but the technology of the present disclosure is not limited to this. For example, the interview implementation program 56 may be stored in a portable computer-readable non-transitory storage medium such as a Universal Serial Bus (USB) memory. The interview implementation program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the interview implementation process in accordance with the interview implementation program 56.

[0104] Also, the interview implementation program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the interview implementation program 56 may be downloaded in response to a request from the data processing device 12 and installed in the computer 22. It is not necessary to store the entire interview implementation program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entire interview implementation program 56 in the storage 32, and only a part of the interview implementation program 56 may be stored.

[0105] The hardware resources for executing the medical interview process may be various processors, as listed below. An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing the medical interview process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, which is a processor having a circuit configuration designed specifically for executing specific processing, such as a field-programmable gate array (FPGA), a programmable logic device (PLD), or an application specific integrated circuit (ASIC). Each processor has a built-in or connected memory, and each processor uses the memory to execute the medical interview process.

[0106] The hardware resource for executing the interview process may be one of these various processors, or may be a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource for executing the interview process may be a single processor.

[0107] As an example of a configuration using one processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes the medical interview implementation process. Second, there is a configuration in which a processor is used that realizes the functions of the entire system including multiple hardware resources that execute the medical interview implementation process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, the medical interview implementation process is realized using one or more of the above-mentioned various processors as hardware resources.

[0108] Furthermore, more specifically, the hardware structure of these various processors can be an electric circuit that combines circuit elements such as semiconductor elements. Also, the above interview implementation process is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the order of processing may be changed, without departing from the spirit of the invention.

[0109] The above description and illustrations are detailed descriptions of the parts related to the technology of the present disclosure, and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, function, action, and effect is an example of the configuration, function, action, and effect of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above description and illustrations, within the scope of the gist of the technology of the present disclosure. In addition, in order to avoid confusion and to facilitate understanding of the parts related to the technology of the present disclosure, the above description and illustrations omit explanations of technical common sense that do not require explanation in order to enable the implementation of the technology of the present disclosure.

[0110] All publications, patent applications, and standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or standard was specifically and individually indicated to be incorporated by reference.

[0111] <Additional Notes> (1) an execution unit that executes an interview with a patient in an interactive format; A generation unit that generates chief complaint data related to the chief complaint of the patient based on an interview result obtained by executing the interview in the interactive format by the execution unit by using a chief complaint generation model; An output unit that outputs the chief complaint data generated by the generation unit. Data processing device.

[0112] (2) The chief complaint data is summary data indicating a summary of the chief complaint. A data processing device as described in (1).

[0113] (3) The execution unit is generating a question for the patient using a question generation model; Executing the interview using the questions A data processing device according to (1) or (2).

[0114] (4) The execution unit generates the question based on a response to the medical interview from the patient by using the question generation model. A data processing device according to (3).

[0115] (5) The output unit outputs the chief complaint data to a medical institution. A data processing device according to any one of (1) to (4).

[0116] (6) A communication terminal capable of communicating with the data processing device according to any one of (1) to (5), A user interface is provided. The user interface includes: Present the contents of the interview, Accepting a response from the patient to the interview executed by the execution unit Communications terminal.

[0117] (7) Conducting an interview with a patient in an interactive manner; By using a chief complaint generation model, chief complaint data regarding the chief complaint of the patient is generated based on an interview result obtained by executing the interview in the interactive format; and and outputting the chief complaint data. Data processing methods.

[0118] (8) Conducting an interview with a patient in an interactive manner; By using a chief complaint generation model, chief complaint data regarding the chief complaint of the patient is generated based on an interview result obtained by executing the interview in the interactive format; and A program for causing a computer to execute a process including outputting the chief complaint data. [Explanation of symbols]

[0119] 10 Data Processing System 12 Data Processing Device 14 Smart Devices 16 Interview agency company 18 Hospital 19 Doctor 20 patients 22,36 Computer 26,44 Communication I / F 28,46 processor 28A Executive Department 28B Generation part 28C Output section 30,48 RAM 32,50 Storage 34,52 Bus 38 Reception equipment 38A Touch Panel 38B Microphone 40 Output Device 40A Display 40B Speaker 54 Network 56 Interview Program 58 Data Generation Model 60 Reception Output Program 68 Instruction Data 70 Interview data 70A Interview start data 70Aa Interview start audio data 70Ab Interview start text data 70B Question Data 70B1 Medical interview content question data 70B2 Summary of Questions 70B2a Summary Data 70Ba Question audio data 70Bb Question text data 70C Interview completion data 70Ca Interview end audio data 70Cb Interview end text data 71 Support Data 72 Answer audio data 74 Datasets 76 Management Server 78 Electronic Medical Records

Claims

1. an execution unit that executes an interview with a patient in an interactive format; A generation unit that generates chief complaint data related to the chief complaint of the patient based on an interview result obtained by executing the interview in the interactive format by the execution unit by using a chief complaint generation model; An output unit that outputs the chief complaint data generated by the generation unit. Data processing device.

2. The chief complaint data is summary data indicating a summary of the chief complaint.

2. A data processing apparatus according to claim 1.

3. The execution unit is generating a question for the patient using a question generation model; Executing the interview using the questions 2. A data processing apparatus according to claim 1.

4. The execution unit generates the question based on a response to the medical interview from the patient by using the question generation model.

4. A data processing device according to claim 3.

5. The output unit outputs the chief complaint data to a medical institution.

2. A data processing apparatus according to claim 1.

6. A communication terminal capable of communicating with the data processing device according to any one of claims 1 to 5, A user interface is provided. The user interface includes: Present the contents of the interview, Accepting a response from the patient to the interview executed by the execution unit Communications terminal.

7. Conducting an interview with a patient in an interactive manner; By using a chief complaint generation model, chief complaint data regarding the chief complaint of the patient is generated based on an interview result obtained by executing the interview in the interactive format; and and outputting the chief complaint data. Data processing methods.

8. Conducting an interview with a patient in an interactive manner; By using a chief complaint generation model, chief complaint data regarding the chief complaint of the patient is generated based on an interview result obtained by executing the interview in the interactive format; and A program for causing a computer to execute a process including outputting the chief complaint data.

Images