Program, data processing system, data processing method, and data processing terminal

Abstract

To improve accuracy in determining whether or not there is an abnormality in biological sounds obtained with a stethoscope.SOLUTION: A program of this embodiment causes a processor of a data processing terminal 1 to function as a biological sound data acquisition unit 165 that acquires biological sound data based on auscultatory sounds acquired with a stethoscope ST in contact with a subject, a position data acquisition unit 163 that acquires position data indicating an auscultatory position at which the stethoscope ST acquired the auscultatory sounds, and a communication processing unit 167 that transmits auscultatory data in which the auscultatory position indicated by the position data is associated with the biological sound data to an external device 2 in a state in which it is possible to determine whether the auscultatory sounds are normal or abnormal.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to a program, a data processing system, a data processing method, and a data processing terminal for processing body sound data collected by a stethoscope. [Background technology]

[0002] Conventionally, there is known a technique for determining whether or not a body sound acquired by a stethoscope is abnormal. Patent Document 1 discloses a technique for determining that a body sound is abnormal when a degree of similarity determined by comparing data of the body sound acquired by the stethoscope with sample data is equal to or greater than a threshold value. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 5964151 Summary of the Invention [Problem to be solved by the invention]

[0004] The biological sounds acquired by a stethoscope differ depending on the position of the body where the stethoscope comes into contact (hereinafter referred to as the "auscultation position"). In conventional technology, when determining whether or not there is an abnormality in biological sounds, the biological sounds are compared with predetermined sample data regardless of the auscultation position, which creates the problem of prone to erroneous determination.

[0005] The present invention has been made in consideration of these points, and aims to improve the accuracy of determining whether or not there is an abnormality in body sounds acquired with a stethoscope. [Means for solving the problem]

[0006] The program according to the first aspect of the present invention causes a processor of a data processing terminal to function as a biological sound data acquisition unit that acquires biological sound data based on auscultatory sounds acquired by a stethoscope in contact with a subject, a position data acquisition unit that acquires position data indicating the auscultatory position at which the stethoscope acquired the auscultatory sounds, and a communication processing unit that transmits the auscultatory data, in which the auscultatory position indicated by the position data is associated with the biological sound data, to an external device in a state in which it is possible to determine whether the auscultatory sounds are normal or abnormal.

[0007] The communication processing unit may transmit the auscultation data to the external device that creates a machine learning model for determining the presence or absence of an abnormality based on the body sound data acquired at each of the plurality of auscultation positions.

[0008] The program may further cause the processor to function as a diagnostic data acquisition unit that acquires diagnostic data indicating a diagnostic result in association with the auscultation position, and the communication processing unit may transmit the auscultation data in which the auscultation position, the body sound data, and the diagnostic data are associated.

[0009] The program may further cause the processor to function as a display processing unit that displays a body image on a display unit for the user of the stethoscope to set the auscultation position, and an operation receiving unit that receives an operation by the user to set the auscultation position, the position data acquisition unit may acquire the position data based on the operation received by the operation receiving unit, and the communication processing unit may transmit the auscultation data in which label data indicating the auscultation position corresponding to the position data is associated with the body sound data.

[0010] The program may further cause the processor to function as a display processing unit that displays a body image on a display unit for the user of the stethoscope to set the auscultation position, and an operation receiving unit that receives operations by the user to set the auscultation position, and the position data acquisition unit may acquire as the position data data indicating the reference position that is closest to the position on the body image set by the user among multiple reference positions on the body image.

[0011] The program may further cause the processor to function as a display processing unit that displays on a display unit a body image for the user of the stethoscope to set the auscultation position and instruction text to notify the user, and an operation receiving unit that receives operations from the user, and the display processing unit may determine the positional relationship between the body image and the instruction text to be displayed on the display unit in response to the operation receiving unit receiving an operation specifying the hand holding the stethoscope or the hand operating the data processing terminal.

[0012] The program may further cause the processor to function as a display processing unit that displays timing information indicating a first timing at which the subject is to inhale and a second timing at which the subject is to exhale on a display unit, and the communication processing unit may transmit first body sound data acquired by the body sound data acquiring unit during at least a portion of the period from the first timing to the second timing in association with label data indicating that the subject is inhaling, and transmit second body sound data acquired by the body sound data acquiring unit during at least a portion of the period from the second timing to the first timing in association with label data indicating that the subject is exhaling.

[0013] The program may further cause the processor to function as a condition detection unit that detects the physical condition of the subject, and the communication processing unit may transmit the body sound data for a period during which the condition detection unit is detecting the condition, in association with label data indicating the condition detected by the condition detection unit.

[0014] The condition detection unit may detect the physical condition by detecting a voice uttered by a user of the stethoscope.

[0015] The condition detection unit may display one or more candidates for the physical condition on a display unit, and detect a condition corresponding to a candidate selected from the one or more candidates by a user of the stethoscope as the physical condition.

[0016] The program may further cause the processor to function as an operation receiving unit that receives an operation by the stethoscope user to select a diagnostic mode to use from a plurality of diagnostic modes or an attribute of the subject, and the status detection unit may cause the display unit to display the one or more candidates corresponding to the diagnostic mode or the attribute corresponding to the operation received by the operation receiving unit.

[0017] The state detection unit may analyze the body sound data and cause the display unit to display the one or more candidates corresponding to a result of the analysis.

[0018] The program may further cause the processor to function as an operation receiving unit that receives an operation to switch the operation mode of the communication processing unit to either a first mode or a second mode, and the communication processing unit may transmit the auscultation data when the operation receiving unit receives an operation to switch to the first mode, and when the operation receiving unit receives an operation to switch to the second mode, transmit the auscultation data to obtain a judgment result from the external device that judges whether or not there is an abnormality based on the body sound data.

[0019] The program may further cause the processor to function as a display processing unit that, when the communication processing unit transmits the auscultation data in the first mode, displays information on a display unit indicating that a fee has been charged to the user of the stethoscope, and that, when the communication processing unit transmits the auscultation data in the second mode, displays information on the display unit indicating that a fee has been charged to the user.

[0020] A data processing system according to a second aspect of the present invention comprises a data processing device and a data processing terminal. The data processing terminal comprises a biological sound data acquisition unit that acquires biological sound data based on auscultation sounds acquired by a stethoscope in contact with a subject, a position data acquisition unit that acquires position data indicating the auscultation position at which the stethoscope acquired the auscultation sounds, and a communication processing unit that transmits the auscultation data, in which the auscultation position indicated by the position data is associated with the biological sound data, to the data processing device in a state in which it is possible to determine whether the auscultation sounds are normal or abnormal. The data processing device comprises a data receiving unit that receives the auscultation data, and a learning unit that associates the biological sound data with the auscultation position and trains a machine learning model using the biological sound data as teacher data indicating an abnormality or teacher data indicating normality.

[0021] A data processing method according to a third aspect of the present invention includes the steps of: acquiring biological sound data based on auscultatory sounds acquired by a stethoscope in contact with a subject; acquiring position data indicating the auscultation position at which the stethoscope acquired the auscultatory sounds; and transmitting the auscultation data, in which the auscultation position indicated by the position data is associated with the biological sound data, to an external device in a state in which it is possible to determine whether the auscultatory sounds are normal or abnormal.

[0022] A data processing terminal according to a fourth aspect of the present invention comprises a biological sound data acquisition unit that acquires biological sound data based on auscultatory sounds acquired by a stethoscope in contact with a subject, a position data acquisition unit that acquires position data indicating the auscultatory position at which the stethoscope acquired the auscultatory sounds, and a communication processing unit that transmits the auscultatory data, in which the auscultatory position indicated by the position data is associated with the biological sound data, to an external device in a state in which it is possible to determine whether the auscultatory sounds are normal or abnormal. [Effects of the Invention]

[0023] According to the present invention, it is possible to improve the accuracy of determining whether or not there is an abnormality in body sounds acquired by a stethoscope. [Brief explanation of the drawings]

[0024] [Figure 1] FIG. 2 is a diagram illustrating an outline of the operation of the information processing system S. [Figure 2] FIG. 2 is a diagram showing the configuration of a stethoscope ST. [Figure 3] FIG. 2 is a diagram showing a configuration of a data processing terminal 1. [Figure 4] FIG. 10 is a diagram showing an example of auscultation data. [Figure 5] FIG. 10 is a diagram showing another example of auscultation data. [Figure 6] FIG. 10 is a diagram illustrating an example of a mode selection screen. [Figure 7] FIG. 10 is a diagram showing an example of a front auscultation screen. [Figure 8] FIG. 10 is a diagram showing an example of a back auscultation screen. [Figure 9] FIG. 10 is a diagram showing a screen in which the display positions of the body image and instruction text are swapped on the front auscultation screen. [Figure 10] FIG. 10 illustrates multiple reference positions in a body image. [Figure 11] FIG. 10 is a diagram showing an example of an auscultation screen on which one or more candidates for a physical condition are displayed. [Figure 12] FIG. 10 is a diagram showing an example of a risk assessment result screen. [Figure 13] FIG. 2 is a diagram showing the configuration of an external device 2 (data processing device 2). [Figure 14] 10 is a flowchart showing the flow of processing in the data processing terminal 1. DETAILED DESCRIPTION OF THE INVENTION

[0025] [Outline of Information Processing System S] An overview of an information processing system S according to this embodiment will be described using Fig. 1. Fig. 1 is a diagram showing an overview of the operation of the information processing system S. The information processing system S includes a data processing terminal 1 and an external device 2. The information processing system S may also include other devices such as a server and a terminal.

[0026] The information processing system S is a system for learning the relationship between biological sounds (hereinafter sometimes referred to as "biological sounds") based on auscultatory sounds acquired by a stethoscope in contact with a subject, auscultation positions, and diagnostic results. The information processing system S is also a system for determining diagnostic results based on biological sounds and auscultation positions using the learning results.

[0027] The data processing terminal 1 is a terminal used by a user U of the stethoscope. The user U is, for example, a doctor examining a subject, but may also be a family member of the subject or the subject himself / herself. The data processing terminal 1 is preferably a portable terminal such as a smartphone or a tablet personal computer, but may also be a stationary terminal such as a desktop personal computer.

[0028] The external device 2 is a computer such as a server that performs the above-mentioned learning. The data processing terminal 1 and the external device 2 are capable of communicating with each other. The external device 2 is assumed to be installed in a location (e.g., on the cloud) different from the location where the user U uses the data processing terminal 1, but may also be installed in the location where the user U uses the data processing terminal 1.

[0029] In recent years, changes in people's lifestyles (high-calorie diets, lack of exercise, excessive alcohol intake), the aging population, and the spread of the novel coronavirus have led to an increase in diseases such as heart disease and lung disease. It is often possible to determine whether a subject has a disease based on the subject's vital sounds obtained through a stethoscope. However, conventionally, this determination has been limited to specialists in the subject's disease. Furthermore, even if a doctor other than a specialist or a non-doctor (such as a family member of the subject) uses a conventional device to determine whether a subject has a disease based on vital sounds, there is a problem that erroneous determinations are likely to occur.

[0030] Therefore, in a first mode, which is a diagnostic mode used by a specialist as the user U, the information processing system S generates data for creating a machine learning model by learning the relationship between body sounds, auscultation positions, and diagnostic results by the specialist. In a second mode, which is a diagnostic mode used by doctors other than specialists or non-doctors (hereinafter sometimes referred to as "non-specialists"), the information processing system S uses a machine learning model created using the data generated in the first mode to provide a diagnosis result based on body sounds and auscultation positions. By using the above-mentioned machine learning model in the second mode, the information processing system S can accurately determine whether or not a subject has a disease, even if the person is not a specialist. An overview of the first and second modes will be given below.

[0031] First, we will explain the case where the data processing terminal 1 is used by a specialist and the specialist selects the first mode on the data processing terminal 1. The data processing terminal 1 receives input of the auscultation position from the specialist. The data processing terminal 1 acquires biological sound data based on the auscultation sounds picked up by the stethoscope in contact with the input auscultation position. While auscultating, the specialist determines whether or not there is an abnormality in the auscultation sounds, and if there is an abnormality, inputs the name of the disease into the data processing terminal 1 as the diagnosis result.

[0032] Next, the data processing terminal 1 transmits auscultation data in which the auscultation position, the biological sound data, and the diagnosis result are associated to the external device 2, as shown in Fig. 1. Then, upon receiving the auscultation data, the external device 2 uses the biological sound data as training data indicating an abnormality or training data indicating normality to train a machine learning model. Although Fig. 1 shows one specialist, it is preferable to collect auscultation data from more specialists in order to create a more accurate machine learning model, so the external device 2 may collect auscultation data from data processing terminals 1 used by many specialists.

[0033] Incidentally, in order for the external device 2 to collect a large amount of auscultation data, it is necessary for the specialist to perform an operation to transmit the auscultation data. Therefore, in order to motivate the specialist to transmit the auscultation data, the specialist who transmitted the auscultation data may be allowed to receive compensation. Specifically, as shown in Fig. 1, the external device 2 may transmit compensation information indicating that compensation has been received to the data processing terminal 1 of the specialist who transmitted the auscultation data.

[0034] The data processing terminal 1 used by the specialist may transmit auscultation data in which the auscultation position indicated by the position data is associated with the biological sound data to the external device 2. Then, the external device 2 that has received the auscultation data may use the machine learning model created in the first mode to determine whether or not the auscultation sounds are abnormal and, if so, the name of the disease, and transmit the determination result to the data processing terminal 1 used by the specialist. This allows the specialist to use the received determination result as reference information when making a final diagnosis.

[0035] When the data processing terminal 1 used by the specialist receives the diagnosis result from the external device 2, it may also receive billing information indicating that a fee has been charged. As a result, the specialist is simultaneously charged a fee for transmitting the auscultation data in which the auscultation position, the body sound data, and the diagnosis result are associated with each other to the external device 2, and a fee for transmitting the auscultation data in which the auscultation position and the body sound data are associated with each other to the external device 2 and receiving the diagnosis result from the external device 2. As a result, the specialist can use the diagnosis result from the external device 2 for the amount obtained by deducting the fee from the charged amount (or for free if the charged amount and the fee are equal).

[0036] Next, a case will be described in which the data processing terminal 1 is used by a person other than a specialist and the person other than the specialist selects the second mode on the data processing terminal 1. First, the data processing terminal 1 acquires position data indicating the auscultation position and biological sound data in the same manner as in the first mode. Next, the data processing terminal 1 transmits to the external device 2 auscultation data in which the auscultation position indicated by the position data is associated with the biological sound data, as shown in FIG. 1. Then, upon receiving the auscultation data, the external device 2 determines whether or not there is an abnormality in the auscultation sounds and, if there is an abnormality, the name of the disease, using the machine learning model created in the first mode. The external device 2 transmits the determination result to the data processing terminal 1, as shown in FIG. 1. At this time, the external device 2 may transmit billing information indicating that a fee has been charged to the data processing terminal 1 together with the determination result.

[0037] In this way, the information processing system S can create a machine learning model by having a specialist auscultate the subject and learn the relationship between the auscultation position, biological sound data, and diagnosis results. Because the specialist creates training data for training the machine learning model by treating the subject, the machine learning model can be trained in a short period of time.

[0038] Furthermore, the information processing system S can use the created machine learning model to provide a diagnosis of the presence or absence of abnormalities in auscultation sounds and the name of the disease based on the learning results. As a result, even a person other than a specialist can accurately determine the presence or absence of a disease in a subject and the name of the disease by obtaining the auscultation position and vital sound data. The configurations and operations of the stethoscope, the data processing terminal 1, and the external device 2 will be described in detail below.

[0039] [Configuration and operation of stethoscope ST] 2 is a diagram showing the configuration of a stethoscope ST. The stethoscope ST has a data processing terminal 1, a chest piece C, earphones E, and a tube T. The data processing terminal 1 can be connected to the tube T and acquires auscultatory sounds via the tube T. The tube T may be provided with an AD converter that converts the auscultatory sounds into digital data.

[0040] The chest piece C is the part that comes into contact with the subject. Contact includes direct contact with the subject's body by contacting the subject's skin, and indirect contact with the subject's body by contacting the subject's clothing or underwear. The chest piece C picks up auscultatory sounds from the subject's body.

[0041] The earphone E is a device used by a specialist or a non-specialist to listen to auscultatory sounds. The earphone E can be connected to a tube T. The tube T is a device for connecting the data processing terminal 1, the chest piece C, and the earphone E.

[0042] The auscultatory sounds picked up by the chest piece C are transmitted to the data processing terminal 1 and the earphones E through the tube T. The auscultatory sounds, which are analog signals, are converted into biological sound data, which are digital signals, when transmitted to the data processing terminal 1. The biological sound data transmitted to the data processing terminal 1 may be stored in a memory or disk within the data processing terminal 1, or may be stored in a cloud outside the data processing terminal 1.

[0043] [Configuration and operation of data processing terminal 1] 3 is a diagram showing the configuration of the data processing terminal 1. The data processing terminal 1 has an operation unit 11, a terminal communication unit 12, a display 13, a microphone 14, a storage unit 15, and a control unit 16.

[0044] The operation unit 11 is a device, such as a touch panel, that receives operations from a user U of the stethoscope ST. The terminal communication unit 12 is a communication interface for communicating with the external device 2 via a communication network such as the Internet.

[0045] The display 13 is a display unit for displaying information. The microphone 14 is a device for inputting the voice of a user U of the stethoscope ST.

[0046] The storage unit 15 is a storage medium including a ROM (Read Only Memory) and a RAM (Random Access Memory), etc. The storage unit 15 stores a program executed by the control unit 16. For example, the storage unit 15 stores an information processing program that causes the control unit 16 to function as an operation reception unit 161, a display processing unit 162, a position data acquisition unit 163, a state detection unit 164, a body sound data acquisition unit 165, a diagnostic data acquisition unit 166, and a communication processing unit 167. The storage unit 15 stores auscultation data.

[0047] Fig. 4 is a diagram showing an example of auscultation data. In the auscultation data shown in Fig. 4, biological sound data, label data, and diagnosis data are associated with each other. The biological sound data is data obtained by converting analog auscultation sound signals acquired by the stethoscope ST into digital signals.

[0048] The label data includes data indicating at least one of the auscultation position, the state of breath, and the state of the body. As described above, the auscultation position is the position of the body that the stethoscope ST comes into contact with. The state of breath is whether the subject is inhaling or exhaling. The state of the body is the auscultation state, which is the state of the subject at the time of auscultation (e.g., the state of the subject's breath), or the auscultation result, which is the result of auscultating the subject (e.g., the name or characteristics of the auscultatory sounds heard when the subject has an illness).

[0049] The diagnostic data is data indicating the results of a diagnosis made by a specialist on a subject. The diagnostic results include the presence or absence of abnormalities and the name of the disease. In the auscultation data shown in Figure 4, the diagnostic results are recorded for each auscultation position.

[0050] Fig. 5 is a diagram showing another example of auscultation data. In the auscultation data shown in Fig. 5, body sound data, label data, and diagnosis data are also associated with each other, but the diagnosis result includes the presence or absence of abnormality at each auscultation position, the presence or absence of abnormality as an overall judgment, and the name of the disease as an overall judgment. In other words, in the auscultation data shown in Fig. 5, the presence or absence of abnormality and the name of the disease are recorded as a result of a specialist's overall judgment based on the presence or absence of abnormality at each auscultation position.

[0051] The control unit 16 is, for example, a CPU (Central Processing Unit). The control unit 16 executes an information processing program stored in the storage unit 15, thereby functioning as an operation reception unit 161, a display processing unit 162, a position data acquisition unit 163, a state detection unit 164, a body sound data acquisition unit 165, a diagnostic data acquisition unit 166, and a communication processing unit 167.

[0052] The operation accepting unit 161 accepts various operations by the user U. For example, the operation accepting unit 161 accepts an operation for switching the operation mode of the communication processing unit 167 to either the first mode or the second mode. For example, the operation accepting unit 161 accepts an operation for the user U to select a diagnostic mode to be used from a plurality of diagnostic modes.

[0053] FIG. 6 is a diagram showing an example of a mode selection screen. On the mode selection screen, specific modes can be selected as the operation mode and the diagnosis mode. When user U, who is a specialist, performs an operation to select the "specialist mode" as the operation mode, the operation receiving unit 161 receives the operation as an operation to switch the operation mode to the first mode. On the other hand, when user U, who is a non-specialist, performs an operation to select the "non-specialist mode" as the operation mode, the operation receiving unit 161 receives the operation as an operation to switch the operation mode to the second mode. The content displayed when user U performs an operation to select each mode of the diagnosis mode will be described in the description of the display processing unit 162.

[0054] The operation receiving unit 161 may receive an operation by the user U of the stethoscope ST to select attributes of the subject. The operation receiving unit 161 may receive an operation by the user U to input attributes of the subject (gender, age, medical history, smoking history, etc.) from the display 13, for example.

[0055] The operation receiving unit 161 may receive an operation for setting an auscultation position by the user U. For example, the operation receiving unit 161 may receive an operation for the user U to tap on the auscultation position on a body image displayed on an auscultation screen described later.

[0056] Unless otherwise specified, the following description of the processes executed by each unit in the control unit 16 other than the operation acceptance unit 161 is a description of the processes when the first mode is selected. In other words, it is assumed that the user U of the stethoscope ST is a specialist.

[0057] The display processing unit 162 displays various types of information on the display 13, which is a display unit. For example, the display processing unit 162 displays a body image on the display 13 for the user U of the stethoscope ST to set the auscultation position. For example, the display processing unit 162 displays a body image on the display 13, on which the user U can select the auscultation position for each of the front, side, and back of the body.

[0058] The display processing unit 162 may display a body image without showing candidates for auscultation positions when the user U selects the "free diagnosis mode" as the diagnosis mode so that the user U, who is a specialist, can freely select the auscultation position. Furthermore, when the user U selects the "health checkup mode" as the diagnosis mode, the display processing unit 162 may display a body image showing auscultation positions specified as health checkup items. Furthermore, when the user U selects a mode for a specific disease other than these as the diagnosis mode, the display processing unit 162 may display a body image showing auscultation positions corresponding to the selected disease name.

[0059] The display processing unit 162 may display on the display 13 a body image for the user U of the stethoscope ST to set the auscultation position and instruction text notifying the user U. For example, the display processing unit 162 may display on the display 13 any of the following: text instructing the user U to place the stethoscope ST on a specific position on the subject's body; text instructing the user U to check whether the user U can hear the auscultation sounds when the user U places the stethoscope ST on the subject; text instructing the user U to press a record button if the auscultation sounds are heard; and text instructing the user U to continue placing the stethoscope ST on the auscultation position until the recording ends when the user U starts recording. This allows the user U to clearly understand the operations that he or she should perform on the data processing terminal 1.

[0060] 7 is a diagram showing an example of a front auscultation screen displayed when auscultating the front of the subject's body. The display 13 displays "anterior chest" as a possible auscultation location in the body image on the left side of the screen. The display 13 also displays instruction text on the right side of the screen instructing the user U to place the stethoscope ST on the anterior chest and to press the record button when auscultatory sounds are heard.

[0061] 8 is a diagram showing an example of a back auscultation screen that is displayed when auscultating the back of a subject's body. In the body image on the left side of the screen, the display 13 displays "center of back chest" as a possible auscultation location. The display 13 also displays instruction text on the right side of the screen, instructing the user U to wait with the stethoscope ST held down until the auscultation sounds at the center of the back chest are finished being recorded.

[0062] Incidentally, for example, when the user U holds the data processing terminal 1 in his / her right hand and operates the data processing terminal 1 with the thumb of his / her right hand, if the body image is displayed on the left side as in the auscultation screens shown in Figures 7 and 8, the user U may not be able to tap the body image with the thumb of his / her right hand. Therefore, the display processing unit 162 determines the positional relationship between the body image and instruction text to be displayed on the display unit 13 (display 13) in response to the operation accepting unit 161 accepting an operation specifying the hand holding the stethoscope ST or the hand operating the data processing terminal 1.

[0063] For example, if the operation receiving unit 161 receives an operation to specify the hand holding the chest piece C of the stethoscope ST, the display processing unit 162 displays a body image on the auscultation screen in a position opposite the hand holding the chest piece C, and displays instruction text in a position on the same side as the hand holding the chest piece C. Furthermore, if the operation receiving unit 161 receives an operation to specify the hand operating the data processing terminal 1, the display processing unit 162 displays a body image on the auscultation screen in a position on the same side as the hand operating the data processing terminal 1, and displays instruction text in a position opposite the hand operating the data processing terminal 1.

[0064] Specifically, if the user U is right-handed and therefore the right hand is designated as the hand holding the chest piece C of the stethoscope ST and the left hand is designated as the hand operating the data processing terminal 1, the display processing unit 162 displays the body image on the left side and the instruction text on the right side, as shown on the auscultation screens in Figures 7 and 8. By displaying in this manner, the right-handed user U can select the body image displayed on the left side with the thumb of his left hand while holding the stethoscope ST in his right hand, which is his dominant hand, and the data processing terminal 1 in his left hand.

[0065] On the other hand, if the user U is left-handed and therefore the left hand is designated as the hand holding the chest piece C of the stethoscope ST and the right hand is designated as the hand operating the data processing terminal 1, the display processing unit 162 displays the body image on the right side and the instruction text on the left side, as shown on the auscultation screen in Fig. 9. Fig. 9 is a diagram showing a screen in which the display positions of the body image and instruction text are swapped on the front auscultation screen in Fig. 7.

[0066] In this way, the display processing unit 162 changes the display positions of the body image and instruction text on the auscultation screen depending on the hand with which the user U holds the chest piece C of the stethoscope ST or the hand with which the user U operates the data processing terminal 1, making the auscultation screen easier for the user U to operate. As a result, the user U can perform auscultation more accurately and quickly.

[0067] The position data acquisition unit 163 acquires position data indicating the auscultation position where the stethoscope ST acquired auscultation sounds. The position data acquisition unit 163 acquires the position data based on, for example, an operation accepted by the operation acceptance unit 161. Specifically, the position data acquisition unit 163 acquires position data indicating, as the auscultation position, a position set by the user U on the body image displayed on the auscultation screen. The user U can set the position by, for example, tapping on the body image displayed on the auscultation screen. The user U performs this tap, for example, before placing the stethoscope ST on the subject and recording the auscultation sounds.

[0068] Incidentally, the position tapped by the user U on the body image displayed on the auscultation screen may deviate from the reference position for auscultation due to shaking of the user U's hand or the like. In this case, it is preferable to acquire the position where the tap position is corrected to the reference position as the auscultation position. Therefore, the position data acquisition unit 163 acquires, as position data, data indicating the reference position that is closest to the position on the body image set by the user U, among multiple reference positions on the body image.

[0069] FIG. 10 is a diagram showing multiple reference positions in a body image. In FIG. 10, eight points labeled A to H are reference positions. Reference ranges indicated by dotted lines are set around the reference positions. The reference ranges surrounding A and B are the apical lung field, the reference ranges surrounding C and D are the upper lung field, the reference ranges surrounding E and F are the middle lung field, and the reference ranges surrounding G and H are the lower lung field. If the position indicated by a star is the position tapped by user U, the position data acquisition unit 163 acquires position data indicating position C, which is a reference position corresponding to the reference range that includes the position tapped by user U, as the auscultation position.

[0070] In this way, by the position data acquisition unit 163 acquiring data indicating the reference position as position data, even if the user U accidentally taps a position that is different from the position where auscultation should be performed, the position data acquisition unit 163 can acquire position data indicating the correct auscultation position.

[0071] Note that if the user U taps on a position that is too far from the reference position, there is a possibility that the user U has selected the wrong auscultation position in the first place. To enable the user U to recognize this mistake, the position data acquisition unit 163 may display an error on the auscultation screen if the position tapped by the user U is away from the reference position by a predetermined distance or more. For example, in FIG. 10, if the position tapped by the user U is not included in any of the reference ranges that include the reference positions A to H, the position data acquisition unit 163 may display an error on the auscultation screen.

[0072] The condition detection unit 164 detects the physical condition of the subject. For example, the condition detection unit 164 detects the auscultation condition, which is the condition of the subject at the time of auscultation, as the physical condition of the subject.

[0073] The condition detection unit 164 detects the physical condition of the subject by, for example, detecting the voice uttered by the user U of the stethoscope ST. The condition detection unit 164 detects the physical condition of the subject by, for example, detecting the voice uttered by the specialist who is the user U of the stethoscope ST about the auscultation condition (for example, the breathing condition of the subject) through the microphone 14.

[0074] Specifically, when the state detection unit 164 detects a voice of the specialist who is the user U instructing the subject to inhale (voice such as "inhale"), the state detection unit 164 detects a physical state of inhaling. On the other hand, when the state detection unit 164 detects a voice of the specialist who is the user U instructing the subject to exhale (voice such as "exhale"), the state detection unit 164 detects a physical state of exhaling.

[0075] The condition detection unit 164 may display one or more candidates for the physical condition on the display 13, and detect a condition corresponding to a candidate selected from the one or more candidates by the user of the stethoscope ST as the physical condition. For example, the condition detection unit 164 displays, as one or more candidates for the physical condition, names or characteristics of auscultatory sounds that can be heard when the subject has an illness on the display 13 via the display processing unit 162, and detects the condition corresponding to the name or characteristic of the auscultatory sound selected by the user U of the stethoscope ST as the physical condition of the subject.

[0076] Specific examples of auscultatory sounds that can be heard when a subject has an illness are described below. Heart sounds include heart murmurs (when blood is flowing backward into the heart), atrial fibrillation (when arrhythmia occurs), and gallop sounds (when excessive heart sounds occur). Respiratory sounds include abnormalities in the volume of auscultatory sounds, asymmetry between the left and right sides of auscultatory sounds, and abnormalities in the location where auscultatory sounds are heard (e.g., auscultatory sounds that should come from the bronchi are heard from the lungs). Complex respiratory sounds include discontinuous rales, continuous rales, and differences due to body position or coughing. Furthermore, auscultatory sounds that can be heard when a subject has interstitial pneumonia include crepitus sounds and squawks.

[0077] In this way, by having the condition detection unit 164 display one or more candidates for the subject's physical condition on the display 13, the user U of the stethoscope ST only needs to select a displayed candidate, eliminating the need to input the subject's physical condition point by point. As a result, the user U can easily record the subject's physical condition at the point when he or she senses something abnormal while listening to the auscultatory sounds.

[0078] However, when one or more candidates for a physical condition are displayed on the display 13, it may take a long time for the user U to find a candidate, or the user U may select the wrong candidate. Therefore, the condition detection unit 164 causes the display 13 to display one or more candidates corresponding to the diagnostic mode or attribute corresponding to the operation received by the operation receiving unit 161.

[0079] The condition detection unit 164, for example, refers to data in which one or more candidates for the physical condition are associated with each diagnostic mode or attribute, identifies one or more candidates for the physical condition associated with the diagnostic mode or attribute accepted by the operation acceptance unit 161, and displays the identified candidates on the auscultation screen via the display processing unit 162. The condition detection unit 164 may display, on the auscultation screen, one or more candidates for the physical condition identified based on the attribute accepted by the operation acceptance unit 161, out of the one or more candidates for the physical condition identified based on the diagnostic mode accepted by the operation acceptance unit 161. This allows the condition detection unit 164 to further narrow down the candidates to be displayed on the auscultation screen.

[0080] FIG. 11 is a diagram showing an example of an auscultation screen displaying one or more candidates for a physical condition. For example, suppose that the operation receiving unit 161 receives an operation by the user U to select "interstitial pneumonia mode" from among multiple diagnostic modes displayed on the mode selection screen (FIG. 6). In this case, the state detection unit 164 displays, on the auscultation screen, crepitus, bubbling, whistling, snoring, strider, and squawk as names of auscultation sounds corresponding to interstitial pneumonia, as shown by dotted-line frames on the auscultation screen in FIG. 11. When the user U presses a button corresponding to the auscultation sound being heard while hearing the auscultation sound, the state detection unit 164 stores biological sound data in the storage unit 15 in association with the type of sound corresponding to the pressed button.

[0081] In this way, the condition detection unit 164 displays one or more candidates of the physical condition according to the diagnosis mode or the attributes of the subject on the auscultation screen, so that the user U can select a candidate that corresponds to the auscultation sound of the subject from a narrowed-down number of candidates, rather than from a large number of candidates. As a result, the user U can quickly find a corresponding candidate, and the probability of selecting an incorrect candidate is reduced.

[0082] However, one or more candidates of the physical condition according to the above-mentioned diagnostic mode or the attributes of the subject may differ from the current condition of the subject. Therefore, the condition detection unit 164 may analyze the body sound data and display one or more candidates corresponding to the analysis result on the display 13.

[0083] The condition detection unit 164, for example, analyzes the body sound data to identify the features of the body sound data. For example, the condition detection unit 164 refers to data in which the features of the body sound data are associated with one or more candidates for the body state, identifies one or more candidates for the body state associated with the features of the acquired body sound data, and causes the display 13 to display the identified candidates via the display processing unit 162.

[0084] In this way, by displaying one or more candidates for the physical condition of the subject on the auscultation screen according to the results of the condition detection unit 164 analyzing the subject's biological sound data, the user U can select the physical condition of the subject from appropriate options according to the current condition of each individual subject.

[0085] When the user U selects the record button, the state detection unit 164 may determine whether auscultation sounds (e.g., heartbeats) have actually been acquired from the stethoscope ST by comparing the auscultation sound model stored in advance in the storage unit 15 with the biological sound data. If the state detection unit 164 determines that auscultation sounds have not been acquired, it may display an error on the display 13 via the display processing unit 162 to prevent the user U from pressing the record button. This prevents data based on sounds other than auscultation sounds or silence from being recorded as biological sound data. Furthermore, when the state detection unit 164 detects that the user U is placing the stethoscope ST at a position other than the instructed position by comparing the auscultation sound model stored in the storage unit 15 in association with the auscultation position with the biological sound data, it may display an error on the display 13 to prevent the user U from pressing the record button. This prevents biological sound data based on auscultation sounds from being acquired at an incorrect position.

[0086] The biological sound data acquiring unit 165 acquires biological sound data based on auscultatory sounds acquired by a stethoscope ST in contact with the body of the subject. The biological sound data acquiring unit 165 acquires data obtained by converting analog auscultatory sounds, which are transmitted from a chest piece C of the stethoscope ST in contact with the body of the subject through a tube T, into digital signals as biological sound data.

[0087] The body sound data acquisition unit 165 associates the body sound data with, for example, at least one of the auscultation position indicated by the position data acquired by the position data acquisition unit 163 and the body condition detected by the condition detection unit 164, and stores the body sound data in the memory unit 15 as auscultation data.

[0088] It should be noted that either the process of acquiring the position data by the position data acquiring unit 163 or the process of acquiring the body sound data by the body sound data acquiring unit 165 may be performed first, or both may be performed simultaneously.

[0089] The diagnostic data acquiring unit 166 acquires diagnostic data indicating a diagnostic result in association with the auscultation position. For example, after the acquisition of body sounds by the body sound data acquiring unit 165 and the acquisition of position data by the position data acquiring unit 163 are completed, the diagnostic data acquiring unit 166 displays a diagnostic result input screen for allowing the user U to input the diagnostic result. For example, when the operation accepting unit 161 accepts an operation by the user U to input a diagnostic result on the diagnostic result input screen, the diagnostic data acquiring unit 166 acquires diagnostic data indicating the accepted diagnostic result.

[0090] The user U may input the presence or absence of abnormality and the name of the disease for each auscultation position as the diagnostic result from the diagnostic result input screen. In this case, the format of the diagnostic data will be as included in the auscultation data shown in Fig. 4. Alternatively, the user U may input the presence or absence of abnormality for each auscultation position and the presence or absence of abnormality and the name of the disease as the diagnostic result based on the presence or absence of abnormality at each auscultation position. In this case, the format of the diagnostic data will be as included in the auscultation data shown in Fig. 5.

[0091] The communication processing unit 167 transmits the auscultation data, in which the auscultation position indicated by the position data is associated with the body sound data, to the external device 2 in a state in which it is possible to determine whether the auscultation sound is normal or abnormal. The external device 2 is, for example, a computer that creates a machine learning model that determines the presence or absence of an abnormality based on body sound data acquired at each of a plurality of auscultation positions. The communication processing unit 167 transmits, for example, the auscultation data, in which the body sound data is associated with label data indicating the auscultation position corresponding to the position data, to the external device 2. The label data may be any data that can identify the auscultation position, such as a name, code, or symbol indicating the auscultation position. For example, as shown in the auscultation data in FIGS. 4 and 5, the communication processing unit 167 transmits the auscultation data, in which the label data indicating the auscultation position is associated with the body sound data, to the external device 2.

[0092] For example, the communication processing unit 167 may transmit auscultation data that does not include information indicating the presence or absence of an abnormality to the external device 2 only when the diagnostic data indicates that the data is normal, thereby enabling the external device 2 to recognize that the received auscultation data indicates normal auscultation sounds. The communication processing unit 167 may transmit auscultation data that does not include information indicating the presence or absence of an abnormality to the external device 2 only when the diagnostic data indicates that the data is abnormal, thereby enabling the external device 2 to recognize that the received auscultation data indicates abnormal auscultation sounds.

[0093] The communication processing unit 167 may transmit auscultation data in which the auscultation position, the body sound data, and the diagnostic data are associated with each other to the external device 2. The communication processing unit 167 may generate auscultation data by associating, for example, the auscultation position indicated by the position data acquired by the position data acquiring unit 163, the body sound data acquired by the body sound data acquiring unit 165 corresponding to the auscultation position, and the diagnostic data indicating the presence or absence of an abnormality in the auscultation sound corresponding to the combination of the auscultation position and the body sound data, and transmit the generated auscultation data to the external device 2 via the terminal communication unit 12. Note that the communication processing unit 167 may transmit the auscultation data to the external device 2 when the operation accepting unit 161 accepts an operation to switch to the first mode.

[0094] In this way, the communication processing unit 167 transmits the auscultation data in which the auscultation position and the biological sound data are associated to the external device 2 in a state in which it is possible to determine whether the auscultation sound is normal or abnormal, thereby enabling the external device 2 to learn the relationship between the auscultation position, the biological sound data, and the presence or absence of abnormality in the auscultation sound. As a result, even a person other than a specialist can accurately determine the presence or absence of a disease in a subject by obtaining the auscultation position and the biological sound data.

[0095] The communication processing unit 167 may transmit the first body sound data acquired by the body sound data acquiring unit 165 during at least a part of the period from the first timing to the second timing in association with label data indicating that the subject is inhaling. Furthermore, the communication processing unit 167 may transmit the second body sound data acquired by the body sound data acquiring unit 165 during at least a part of the period from the second timing to the first timing in association with label data indicating that the subject is exhaling. The label data may be any data that can identify the breathing state of the subject, and may be, for example, a name, code, symbol, or the like indicating the breathing state.

[0096] To enable the communication processing unit 167 to transmit the body sound data in association with such label data, the display processing unit 162 displays timing information indicating a first timing at which the subject is to inhale and a second timing at which the subject is to exhale on the display unit 13. For example, the display processing unit 162 displays text on the auscultation screen instructing the user U to instruct the subject to inhale at the first timing at which the subject is to inhale, and displays text on the auscultation screen instructing the user U to instruct the subject to exhale at the second timing at which the subject is to exhale.

[0097] The communication processing unit 167 transmits, for example, first body sound data acquired by the body sound data acquiring unit 165 during at least a part of the period from when the display processing unit 162 displays on the auscultation screen text instructing the user U to instruct the subject to inhale until when the display processing unit 162 displays on the auscultation screen text instructing the user U to instruct the subject to exhale, in association with label data indicating a state of inhaling. Also, the communication processing unit 167 transmits, for example, second body sound data acquired by the body sound data acquiring unit 165 during at least a part of the period from when the display processing unit 162 displays on the auscultation screen text instructing the user U to instruct the subject to exhale until when the display processing unit 162 displays on the auscultation screen text instructing the user U to instruct the subject to inhale, in association with label data indicating a state of exhaling.

[0098] The communication processing unit 167 may transmit the body sound data for the period during which the condition detection unit 164 detects the condition, in association with label data indicating the condition detected by the condition detection unit 164. The label data may be any data that can identify the subject's physical condition, such as a name, code, or symbol indicating the physical condition. As described above, the subject's physical condition is the auscultation state (e.g., the state of the subject's breath) or the auscultation result (e.g., the name or characteristics of the auscultation sound heard when the subject has an illness). For example, as shown in the auscultation data in FIGS. 4 and 5, the communication processing unit 167 transmits to the external device 2 auscultation data in which the body sound data, auscultation position, breath state, physical condition, and diagnostic data are associated with each other.

[0099] In this way, the communication processing unit 167 transmits the biological sound data to the external device 2 in association with label data indicating at least one of the auscultation position, the breathing state of the subject, and the physical state, so that the external device 2 can create a machine learning model that can determine abnormalities in the auscultation sound for at least one of the auscultation position, the breathing state, and the physical state.

[0100] Up to this point, we have explained the processing that occurs when the first mode, which is used by specialists, is selected. Here, we will explain the processing that occurs when the second mode, which is used by people other than specialists, is selected.

[0101] The position data acquiring unit 163 and the body sound data acquiring unit 165 acquire the position data and the body sound data, respectively, in the same manner as in the process when the first mode is selected.

[0102] When the operation receiving unit 161 receives an operation to switch to the second mode, the communication processing unit 167 transmits auscultation data in which the auscultation position indicated by the position data is associated with the body sound data to the external device 2 in order to obtain a determination result from the external device 2 that determines the presence or absence of an abnormality based on the body sound data. The communication processing unit 167 generates auscultation data by, for example, associating the auscultation position indicated by the position data acquired by the position data acquiring unit 163 with the body sound data acquired by the body sound data acquiring unit 165 that corresponds to the auscultation position, and transmits the generated auscultation data to the external device 2 via the terminal communication unit 12.

[0103] In this way, the communication processing unit 167 transmits the auscultation data in which the auscultation position and the body sound data are associated to the external device 2, and the external device 2 inputs the auscultation position and the body sound data into the machine learning model created in the first mode, thereby being able to determine whether or not there is an abnormality in the auscultation sound. The external device 2 transmits the determination result to the data processing terminal 1, and the terminal communication unit 12 receives the determination result.

[0104] Fig. 12 is a diagram showing an example of a risk assessment result screen showing the assessment result of the risk of each disease. As shown in Fig. 12, the display processing unit 162 displays a bar indicating the degree of risk for each disease and characters (high, medium, low) indicating the degree of risk for each disease on the risk assessment result screen. By displaying such assessment results on the display 13, even a person other than a specialist can accurately determine whether or not a subject has a disease.

[0105] However, in order to create a more accurate machine learning model, it is necessary to collect auscultation data from more specialists. In order to motivate specialists to transmit auscultation data, it is preferable to provide compensation to the specialist when the specialist selects the first mode and transmits the auscultation data to the external device 2. On the other hand, when a person other than the specialist transmits the auscultation data to the external device 2 using the second mode, it is preferable to charge the person other than the specialist, because the person other than the specialist will be using the specialist's knowledge.

[0106] Therefore, when the communication processing unit 167 transmits the auscultation data in the first mode, the display processing unit 162 displays information on the display 13 indicating that the user U of the stethoscope ST has been charged. On the other hand, when the communication processing unit 167 transmits the auscultation data in the second mode, the display processing unit 162 displays information on the display 13 indicating that the user U has been charged.

[0107] For example, after the communication processing unit 167 transmits the auscultation data to the external device 2, the terminal communication unit 12 receives a notice indicating that a fee or charge has been incurred and the amount of the fee or charge. The display processing unit 162 displays the notice indicating that a fee or charge has been incurred and the amount of the fee or charge received by the terminal communication unit 12 on the display 13. Note that the external device 2 may determine the amount of the fee or charge to be an amount according to the amount of auscultation data transmitted by the communication processing unit 167.

[0108] In this way, by charging a fee when the communication processing unit 167 transmits auscultation data to the external device 2 in the first mode, it is possible to collect auscultation data from more specialists, thereby creating a more accurate machine learning model. On the other hand, by charging a fee when the communication processing unit 167 transmits auscultation data to the external device 2 in the second mode, the business operator providing the information processing system S can receive remuneration from persons other than specialists and can also collect the amount necessary to pay the specialists' fees.

[0109] [Configuration and Operation of External Device 2] 13 is a diagram showing the configuration of the external device 2 (data processing device 2). The external device 2 has a device communication unit 21, a storage unit 22, and a control unit .

[0110] The device communication unit 21 is a communication interface for communicating with the data processing terminal 1 via a communication network such as the Internet.

[0111] The storage unit 22 is a storage medium including a ROM, a RAM, etc. The storage unit 22 stores an information processing program that causes the control unit 23 to function as a data receiving unit 231 and a learning unit 232. The storage unit 22 stores a learned machine learning model.

[0112] The control unit 23 is, for example, a CPU. The control unit 23 executes an information processing program stored in the storage unit 22, thereby functioning as a data receiving unit 231 and a learning unit 232.

[0113] The data receiving unit 231 receives the auscultation data. For example, the data receiving unit 231 receives the auscultation data, which is transmitted from the data processing terminal 1 and in which the auscultation position, body sound data, and diagnostic data are associated with each other, via the device communication unit 21.

[0114] The learning unit 232 trains a machine learning model using the body sound data associated with the auscultation position as training data indicating an abnormality or training data indicating normality. For example, if the diagnostic data in the auscultation data indicates that the auscultation sounds are abnormal, the learning unit 232 trains the machine learning model using the body sound data as training data indicating an abnormality. On the other hand, for example, if the diagnostic data in the auscultation data indicates that the auscultation sounds are normal, the learning unit 232 trains the machine learning model using the body sound data as training data indicating normality.

[0115] For example, when the biological sound data in the auscultation data is associated with label data (label data indicating the auscultation position, the subject's breathing state, the auscultation state, or the auscultation result), the learning unit 232 may perform learning for each content of the label data or may perform learning using the label data as features. As a result, the external device 2 can create a machine learning model with higher accuracy.

[0116] The machine learning performed by the learning unit 232 may be either classification or regression. In the case of classification, the learning unit 232 learns a machine learning model for determining whether or not an auscultatory sound is abnormal or whether or not the subject has a disease. In the case of regression, the learning unit 232 learns a machine learning model for determining the degree of abnormality of the auscultatory sound or the probability that the subject has a disease.

[0117] The learning unit 232 can perform machine learning using a known method, such as logistic regression, support vector machine (SVM), decision tree, random forest, and neural network.

[0118] [Processing flow in data processing terminal 1] 14 is a flowchart showing the flow of processing in data processing terminal 1. The flow of processing in data processing terminal 1 will be described below with reference to FIG.

[0119] The operation receiving unit 161 determines whether the operation mode selected by the user U on the mode selection screen (FIG. 6) is the first mode used by specialists (S1).

[0120] When the operation receiving unit 161 determines that the operation mode selected by the user U is the first mode used by specialists (S1: YES), the data processing terminal 1 executes the following processes of S2 to S5. The biological sound data acquiring unit 165 acquires biological sound data based on auscultatory sounds acquired by the stethoscope ST in contact with the subject (S2). Furthermore, the position data acquiring unit 163 acquires position data indicating the auscultatory position where the stethoscope ST acquired the auscultatory sounds (S3). Furthermore, the diagnostic data acquiring unit 166 acquires diagnostic data indicating the diagnosis result in association with the auscultatory position (S4).

[0121] Then, the communication processing unit 167 transmits auscultation data in which the body sound data acquired in S2, the auscultation position acquired in S3, and the diagnosis data acquired in S4 are associated with each other to the external device 2 (S5). This allows the external device 2 to use the body sound data associated with the auscultation position as training data to learn a machine learning model for diagnosing whether or not the auscultation sound is abnormal.

[0122] If the operation receiving unit 161 determines that the operation mode selected by the user U is not the first mode used by specialists (S1: NO), it determines that the operation mode is the second mode used by non-specialists. In this case, the data processing terminal 1 executes the following processes of S6 to S9. The body sound data acquiring unit 165 acquires body sound data based on auscultatory sounds acquired by the stethoscope ST in contact with the subject (S6). Furthermore, the position data acquiring unit 163 acquires position data indicating the auscultatory position where the stethoscope ST acquired the auscultatory sounds (S7).

[0123] Then, the communication processing unit 167 transmits auscultation data in which the body sound data acquired in S6 and the auscultation position acquired in S7 are associated with each other to the external device 2 (S8). This allows the external device 2 to determine whether the auscultation sound is abnormal using the trained machine learning model. The terminal communication unit 12 receives the determination result from the external device 2, thereby acquiring the determination result (S9).

[0124] [Variations] In the above description, the case has been exemplified where the external device 2 to which the data processing terminal 1 transmits biological sound data in the first mode and the external device 2 to which the data processing terminal 1 transmits biological sound data in the second mode are the same device, but the external device 2 to which the data processing terminal 1 transmits biological sound data may be different between the first mode and the second mode. Specifically, in the first mode, the data processing terminal 1 transmits biological sound data to a first external device having a function of creating a machine learning model. In the second mode, the data processing terminal 1 transmits biological sound data to a second external device having a function of determining a disease name using the created machine learning model. By operating the data processing terminal 1 in this manner, it becomes possible for a large number of second external devices to use the machine learning model created by the first external device to determine a disease name based on the biological sound data.

[0125] [Effects of Data Processing Terminal 1] As described above, the data processing terminal 1 according to this embodiment transmits position data indicating the auscultation position acquired when a specialist auscultates a subject and biological sound data to the external device 2 in a state in which it is possible to determine whether the auscultation sounds are normal or abnormal. In this way, the data processing terminal 1 transmits training data to the external device 2 for training a machine learning model by a specialist examining a subject, so that the external device 2 can train the machine learning model in a short period of time.

[0126] Furthermore, the information processing system S can use the created machine learning model to provide a diagnosis of the presence or absence of abnormalities in auscultatory sounds and the name of the disease based on the learning results. As a result, even a person other than a specialist can accurately determine the presence or absence of a disease in a subject and the name of the disease by auscultating using the data processing terminal 1.

[0127] The present invention has been described above using embodiments, but the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. For example, all or part of the device can be configured by functionally or physically distributing or integrating any unit. Furthermore, new embodiments resulting from any combination of multiple embodiments are also included in the embodiments of the present invention. The effects of the new embodiments resulting from the combination also have the effects of the original embodiments. [Explanation of symbols]

[0128] 1 data processing terminal 11 Control section 12 Terminal communication unit 13. Display 14 microphones 15 Storage section 16 Control Unit 161 Operation reception unit 162 Display processing section 163 Location data acquisition unit 164 Status detection unit 165 Body sound data acquisition unit 166 Diagnostic data acquisition unit 167 Communication processing unit 2. External device (data processing device) 21 Device communication unit 22 Memory section 23 Control Unit 231 Data receiving unit 232 Learning Department S Information Processing System ST stethoscope C Chestpiece E-earphones T-tube

Claims

1. A processor included in the data processing terminal, a body sound data acquisition unit that acquires body sound data based on auscultatory sounds acquired by a stethoscope in contact with the subject; a position data acquisition unit that acquires position data indicating the auscultation position at which the stethoscope acquired the auscultation sound; a communication processing unit that transmits auscultation data in which the auscultation position indicated by the position data is associated with the body sound data to an external device in a state in which it is possible to determine whether the auscultation sound is normal or abnormal; A program to function as a

2. the communication processing unit transmits the auscultation data to the external device that creates a machine learning model for determining the presence or absence of an abnormality based on the body sound data acquired at each of the plurality of auscultation positions. The program according to claim 1.

3. causing the processor to further function as a diagnostic data acquisition unit that acquires diagnostic data indicative of a diagnosis result in association with the auscultation position; the communication processing unit transmits the auscultation data in which the auscultation position, the body sound data, and the diagnostic data are associated with each other. The program according to claim 1.

4. The processor, a display processing unit that displays on a display unit a body image for a user of the stethoscope to set the auscultation position; an operation receiving unit that receives an operation by the user to set the auscultation position; It further functions as the position data acquisition unit acquires the position data based on the operation accepted by the operation acceptance unit; the communication processing unit transmits the auscultation data in which label data indicating the auscultation position corresponding to the position data and the body sound data are associated with each other. The program according to claim 1.

5. The processor, a display processing unit that displays on a display unit a body image for a user of the stethoscope to set the auscultation position; an operation receiving unit that receives an operation by the user to set the auscultation position; It further functions as the position data acquisition unit acquires, as the position data, data indicating a reference position that is closest to a position on the body image set by the user, from among a plurality of reference positions on the body image; The program according to claim 1.

6. a display processing unit that causes the processor to display on a display unit a body image for a user of the stethoscope to set the auscultation position and instruction text for notifying the user; an operation receiving unit that receives an operation by the user; It further functions as the display processing unit determines a positional relationship between the body image and the instruction text to be displayed on the display unit in response to the operation accepting unit accepting an operation to designate the hand holding the stethoscope or the hand operating the data processing terminal. The program according to claim 1.

7. causing the processor to further function as a display processing unit that displays timing information indicating a first timing at which the subject is to inhale and a second timing at which the subject is to exhale on a display unit; the communication processing unit transmits first body sound data acquired by the body sound data acquiring unit during at least a part of a period from the first timing to the second timing in association with label data indicating that the body sound data is in an inhalation state, and transmits second body sound data acquired by the body sound data acquiring unit during at least a part of a period from the second timing to the first timing in association with label data indicating that the body sound data is in an exhalation state. The program according to claim 1.

8. causing the processor to further function as a condition detection unit that detects a physical condition of the subject; the communication processing unit transmits the body sound data during a period in which the condition detection unit detects the state in association with label data indicating the state detected by the condition detection unit. The program according to claim 1.

9. the condition detection unit detects the physical condition by detecting a voice uttered by the user of the stethoscope; The program according to claim 8.

10. the condition detection unit causes one or more candidates for the physical condition to be displayed on a display unit, and detects, as the physical condition, a condition corresponding to a candidate selected from the one or more candidates by a user of the stethoscope; The program according to claim 8.

11. The processor is further configured to function as an operation receiving unit that receives an operation by a user of the stethoscope to select a diagnostic mode to be used from a plurality of diagnostic modes or an attribute of the subject; the state detection unit causes the display unit to display the one or more candidates corresponding to the diagnostic mode or the attribute corresponding to the operation accepted by the operation acceptance unit. The program according to claim 10.

12. the state detection unit analyzes the body sound data and causes the display unit to display the one or more candidates corresponding to the analysis result. The program according to claim 10.

13. causing the processor to further function as an operation receiving unit that receives an operation for switching the operation mode of the communication processing unit to either a first mode or a second mode; the communication processing unit transmits the auscultation data when the operation receiving unit receives an operation to switch to the first mode, and transmits the auscultation data to obtain a determination result from the external device that determines the presence or absence of an abnormality based on the body sound data when the operation receiving unit receives an operation to switch to the second mode. The program according to claim 1.

14. The processor is further caused to function as a display processing unit that, when the communication processing unit transmits the auscultation data in the first mode, displays on a display unit information indicating that a fee has been charged to the user of the stethoscope, and, when the communication processing unit transmits the auscultation data in the second mode, displays on the display unit information indicating that a fee has been charged to the user. The program according to claim 13.

15. A data processing device and a data processing terminal are provided, The data processing terminal a body sound data acquisition unit that acquires body sound data based on auscultatory sounds acquired by a stethoscope in contact with the subject; a position data acquisition unit that acquires position data indicating the auscultation position at which the stethoscope acquired the auscultation sound; a communication processing unit that transmits auscultation data in which the auscultation position indicated by the position data is associated with the body sound data to the data processing device in a state in which it is possible to determine whether the auscultation sound is normal or abnormal; and The data processing device includes: a data receiving unit that receives the auscultation data; a learning unit that trains a machine learning model by using the body sound data as training data indicating an abnormality or training data indicating normality in association with the auscultation position; A data processing system having:

16. The computer executes acquiring biological sound data based on auscultatory sounds acquired by a stethoscope in contact with the subject; acquiring position data indicating the auscultation position at which the stethoscope acquired the auscultation sounds; a step of transmitting auscultation data in which the auscultation position indicated by the position data is associated with the body sound data to an external device in a state in which it is possible to determine whether the auscultation sound is normal or abnormal; A data processing method comprising:

17. a body sound data acquisition unit that acquires body sound data based on auscultatory sounds acquired by a stethoscope in contact with the subject; a position data acquisition unit that acquires position data indicating the auscultation position at which the stethoscope acquired the auscultation sound; a communication processing unit that transmits auscultation data in which the auscultation position indicated by the position data is associated with the body sound data to an external device in a state in which it is possible to determine whether the auscultation sound is normal or abnormal; A data processing terminal having:

Images