Biological information processing device, information processing device, trained model generation device, and program

Abstract

To provide a biological information processing device capable of more easily acquiring learning data for a proper medical application, an information processing device, a learned model generation device and a program.SOLUTION: A terminal device (20) as a biological information processing device includes a control part (21). The control part (21) acquires at least either information of a waveform type shown by waveform data related to a time variation of a measurement value of a measured person acquired from a biological information measurement instrument or necessity information of emergency setting to a state of the measured person shown by the waveform data as selection data (223) from the outside to set the selection data as setting means, and stores the selection data (223) in association with the waveform data as storage control means.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to a biological information processing device, an information processing device, a trained model generating device, and a program. [Background technology]

[0002] Patient temperature, pulse, respiration and oxygen saturation (SpO 2 ) continuously or at appropriate intervals to monitor the condition of a patient. Patent Document 1 discloses a technology that displays these measured values ​​on a display screen and performs a predetermined notification operation when an abnormality exceeding a set standard is detected.

[0003] Among these biological information, in biological data involving time-dependent and periodic changes such as respiration, what is important is not the measured value at each moment, but the respiration rate and its pattern over a given time span. For pattern recognition, for example, a discrimination program including a trained model trained using a machine learning model using a neural network or the like can be used. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2017-192770 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, for safety reasons, it is not possible to use a medical device while further training the machine learning model on diagnostic information during clinical use of the medical device. Meanwhile, clinical staff are often busy, and there is a problem that it is difficult to obtain appropriate training data related to biomeasurements separately.

[0006] An object of the present invention is to provide a bioinformation processing device, an information processing device, a trained model generation device, and a program that enable appropriate learning data for medical applications to be obtained more easily. [Means for solving the problem]

[0007] In order to achieve the above object, the invention described in claim 1 comprises: a setting means for externally acquiring and setting at least one of information on a waveform type indicated by waveform data relating to a measurement value accompanied by periodic time fluctuation of a subject, the measurement value being acquired from a bio-information measuring device which is a medical device in clinical use, and information on whether an emergency setting is required for the condition of the subject indicated by the waveform data, as corresponding data; and a storage control means for storing the correspondence data and the waveform data in association with each other; a switching means for switching between a first mode in which the storage control means stores the corresponding data and a second mode in which the storage control means does not store the corresponding data; The present invention relates to a biometric information processing device. The invention described in claim 2 provides the biometric information processing device described in claim 1, The waveform data includes a measurement result that deviates from a predetermined normal range of the subject. It is characterized by:

[0008] Also, claims 3 The invention described is Claim 1 or 2 In the biometric information processing device described, a calculation means for calculating a predetermined feature amount from the waveform data, The storage control means stores the feature amount in association with the corresponding data. It is characterized by:

[0009] Also, claims 4 The invention described is as follows: 3 In the biometric information processing device described, The apparatus further comprises an estimation means for estimating at least a part of the corresponding data corresponding to the newly acquired waveform data based on the relationship between the stored feature amount and the corresponding data.

[0010] In addition, claims 5 The invention described is as follows: 4 In the biometric information processing device described, The relationship is characterized in that it is obtained by learning a machine learning model.

[0012] In addition, claims 6 The invention described is Claim 1~ 5 The present invention relates to a bio-information processing device, comprising: a database generation means for generating a database that associates first data stored by the memory control means with second data including information of the subject acquired by a device other than the bio-information measuring device.

[0013] In addition, claims 7 The invention described is as follows: 6 In the information processing device described, The database generating means generates the database by deleting personal information that identifies the subject.

[0014] In addition, claims 8 The invention described is Claim 6 or 7 The trained model generation device is characterized by comprising a generation means for generating a trained model that includes, as an input, a predetermined feature related to the waveform data contained in the database generated by the information processing device described in the above, uses at least a portion of the corresponding data as training data, and outputs the at least a portion of the corresponding data.

[0015] In addition, claims 9 The invention described is Computer, a setting means for externally acquiring and setting at least one of information on a waveform type indicated by waveform data relating to a measurement value accompanied by periodic time fluctuation of a subject, the measurement value being acquired from a bio-information measuring device which is a medical device in clinical use, and information on whether an emergency setting is required for the condition of the subject, the information being indicated by the waveform data; a storage control means for storing the correspondence data and the waveform data in association with each other; a switching means for switching between a first mode in which the storage control means stores the corresponding data and a second mode in which the storage control means does not store the corresponding data; The program is characterized in that it functions as Effect of the Invention

[0016] According to the present invention, there is an advantage that appropriate learning data for medical applications can be obtained more easily. [Brief description of the drawings]

[0017] [Figure 1] 1 is a diagram showing a configuration of a medical information system according to a first embodiment. [Diagram 2] FIG. 2 is a block diagram showing the functional configuration of a terminal device and a server device according to the first embodiment. [Diagram 3] FIG. 13 is a diagram showing the contents of measurement data in a clinical trial mode. [Figure 4] FIG. 13 is a diagram showing a display example on a display screen of a terminal device. [Diagram 5] 10 is a flowchart showing a control procedure of a measurement display control process executed by the terminal device. [Figure 6] 10 is a flowchart showing a control procedure for processing related to learning of a machine learning model executed by a server device. [Figure 7] FIG. 11 is a block diagram showing the functional configuration of a terminal device and a server device according to a second embodiment. [Figure 8] FIG. 11 is a diagram illustrating a display by a terminal device according to a second embodiment. [Figure 9] 13 is a flowchart showing a control procedure of a measurement display control process executed in a terminal device of the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0018] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. [First embodiment] First, a biological information processing device, an information processing device, and a trained model generation device according to the first embodiment will be described. 1 is a diagram showing a configuration of a medical information system 1 including a biological information processing device and an information processing device according to the present embodiment. In the present embodiment, the information processing device also serves as a trained model generating device.

[0019] The medical information system 1 includes a biosensor 10 (biometric information measuring device), a terminal device 20 (biometric information processing device, computer), a server device 30 (information processing device, trained model generating device), a database device 40, a network device 50, and the like.

[0020] The biosensor 10 continuously measures predetermined biometric data of a patient P (subject) and transmits the measurement data to the terminal device 20. The biometric data here may be, for example, SpO 2 (SpO 2 The data includes measurement values ​​for calculating the respiratory rate (e.g., the intensity of received infrared light), pulse, and data that periodically varies over time according to the respiratory state (variation data, waveform data). The variation data includes, for example, a flow sensor that directly measures the inhalation and exhalation flow through a mask, an acceleration sensor, an expansion / contraction sensor, a microwave sensor, etc. that measure chest movement, and a sensor that measures the blood flow state (hemoglobin state, etc.). The "periodic" here includes cases where the length, amplitude, and waveform of each cycle change depending on the condition of the patient P.

[0021] The terminal device 20 receives and processes the measurement data from the biosensor 10, displays the measurement results on a display screen, and also transmits the measurement results to the server device 30. The measurement results include SpO 2In addition, the respiratory rate per predetermined time (e.g., one minute) is included. The terminal device 20 includes, for example, a mobile terminal placed beside the patient's bed, a portable terminal, and the like. Note that, although it is illustrated here that data is directly transmitted and received between the biosensor 10 and the terminal device 20 via wireless communication (e.g., Bluetooth (registered trademark)), the measurement data may be acquired via a wired connection, or may be transmitted and received via a LAN (Local Area Network) via a network device 50. Also, communication with the server device 30 may be performed by connecting a cable to the network device 50.

[0022] The server device 30 can receive the measurement results of each patient from the terminal device 20 and display them as a list. The server device 30 can also collect, store and analyze the measurement results. Note that there may be multiple server devices 30 (for example, on each floor of a hospital ward) for one database device 40.

[0023] The database device 40 has a patient information database 41 (see FIG. 2) and stores and holds patient information. The patient information includes personal information of the patient (such as name, age, and sex) associated with the patient's identification information, various test results, and diagnostic information. The patient information also includes the measurement results obtained from the terminal device 20.

[0024] The network device 50 controls communication between electronic devices. The network device 50 is, for example, a hub or a router, and multiple devices may be provided as necessary (for example, a hub in each hospital room). Here, the network device 50 controls communication with the terminal device 20 via wireless LAN and communication with the server device 30 and the database device 40 via LAN using cables, but is not limited to this. Also, the router may be connected to an external network (Internet).

[0025] 2 is a block diagram showing the functional configuration of the terminal device 20 and the server device 30. Note that, in this figure, the network device 50 between the terminal device 20 and the server device 30 is omitted.

[0026] The terminal device 20 includes a control unit 21, a storage unit 22, a communication unit 23, a display unit 24, an operation reception unit 25, an announcing operation unit 26, and the like.

[0027] The control unit 21 is a processor having a CPU (Central Processing Unit) and the like, and generally controls the operation of each part of the terminal device 20. The control unit 21 processes the measurement data acquired from the biosensor 10 to obtain a measurement result, and also performs pre-processing thereof, such as removing noise and making adjustments when no data is acquired.

[0028] The storage unit 22 includes a RAM (Random Access Memory) and a non-volatile storage medium, such as a HDD (Hard Disk Drive) or a flash memory. The RAM provides a working memory space for the CPU and stores temporary data. The non-volatile storage medium stores a program 221 and various setting data. The storage unit 22 also stores measurement / processing data 222 and selection data 223 accepted by the operation acceptance unit 25. The measurement / processing data 222 and selection data 223 may be stored in the RAM or in the non-volatile storage medium depending on the period for which they are to be stored. The details of these will be described later.

[0029] The communication unit 23 controls communication with other electronic devices and includes, for example, a driver for directly communicating with the biosensor 10 via Bluetooth or the like, and a network card for LAN communication.

[0030] The display unit 24 has a display screen and performs various displays based on the control of the control unit 21. The display contents include the measurement results based on the measurement data by the biosensor 10 as described above. The display screen is not particularly limited, but is, for example, a liquid crystal display screen (LCD).

[0031] The operation reception unit 25 receives an input operation from the outside and outputs it as an input signal to the control unit 21. The operation reception unit 25 has, for example, a touch panel located over the display screen, and identifies information on the position where a touch operation has been detected and / or performed, and outputs it to the control unit 21. The operation reception unit 25 may additionally have a keyboard, a pointing device such as a mouse, a push button switch, a rotary switch, and the like. In addition, in the case where the terminal device 20 is a terminal installed beside a bed, the operation reception device may be located on a remote controller, and an operation input signal may be transmitted to the main body of the terminal device 20 by infrared rays or the like.

[0032] The annunciation operation unit 26 performs a predetermined annunciation operation based on the control of the control unit 21. The annunciation operation unit 26 may have, for example, an LED (Light Emitting Diode) lamp and may be capable of lighting or blinking. The annunciation operation unit 26 may also have LED lamps of multiple colors. Alternatively, the annunciation operation unit 26 may have a configuration for outputting a predetermined beep sound. The beep sound may be emitted by various well-known configurations, and may be, for example, a sound generated directly by the operation of a semiconductor element, or an electric signal may be converted into sound and output from a speaker or the like.

[0033] The server device 30 includes a control unit 31, a storage unit 32, a communication unit 33, a display unit 34, an operation reception unit 35, an announcing operation unit 36, and the like.

[0034] The control unit 31 is a processor having a CPU (Central Processing Unit) and the like, and controls the overall operation of each unit of the server device 30. The control unit 31 may be capable of accessing the database device 40 to acquire and display patient information, in addition to displaying a list of measurement results acquired from the terminal device 20 and performing a notification operation based on the displayed content. The control unit 31 also integrates the measurement results and the patient information to generate learning data 321. The control unit 31 also performs a process of training a machine learning model 322 using the learning data 321.

[0035] The storage unit 32 stores and holds various data. The storage unit 32 has a RAM and a non-volatile storage medium (such as a HDD or flash memory). The RAM provides a working memory space for the CPU of the control unit 31 and stores temporary data. The non-volatile storage medium stores and holds learning data 321, a machine learning model 322 (including various parameters), and a program 323.

[0036] The learning data 321 includes measurement / analysis data 3211, selection data 3212, and diagnosis data 3213. These will be described later.

[0037] The machine learning model 322 has an algorithm and data structure already defined, and various parameters may be authenticated setting values, or may be some initial values ​​or values ​​in the middle of learning.

[0038] The program 323 performs various control processes by being called and executed by the control unit 31. The control processes include a learning data generation process and a learning control process, which will be described later.

[0039] The communication unit 33 controls communication with other electronic devices and includes, for example, a network card for performing LAN communication with other electronic devices.

[0040] The display unit 34 has a display screen and performs various displays based on the control of the control unit 31. Contents that can be displayed include a list display of the measurement results acquired from each terminal device 20 as described above. The display screen is not particularly limited, but is, for example, a liquid crystal display screen (LCD).

[0041] The operation reception unit 35 receives an input operation from the outside and outputs it as an input signal to the control unit 31. The operation reception unit 35 has, for example, a pointing device such as a keyboard and a mouse. The operation reception unit 35 may also have a touch panel positioned over the display screen, and identify information on the position where a touch operation has been detected and / or performed and output the information to the control unit 31. Alternatively, the operation reception unit 35 may further have a push button switch, a rotary switch, or the like.

[0042] The annunciation operation unit 36 ​​performs a predetermined annunciation operation based on the control of the control unit 31. The annunciation operation unit 36 ​​may have, for example, an LED (Light Emitting Diode) lamp and may be capable of lighting or blinking. The annunciation operation unit 36 ​​may also have LED lamps of multiple colors. Alternatively, the annunciation operation unit 36 ​​may have a configuration for outputting a predetermined beep sound. The beep sound may be emitted by various well-known configurations, and may be, for example, a sound generated directly by the operation of a semiconductor element, or an electric signal may be converted into sound and output from a speaker or the like.

[0043] Next, the operation of acquiring measurement data in the medical information system 1 of this embodiment will be described. In this embodiment, as described above, the biodata accompanied by time-based changes measured by the biosensor 10, particularly the fluctuation data indicating changes in the respiratory state (for example, the position of the thorax / amount of expansion / contraction of the chest), is processed, and the processing result is output as the measurement result. The measurement result includes the respiratory rate per predetermined time (1 minute) (i.e., the number of occurrence cycles of changes according to breathing). Note that the respiratory rate may be calculated by weighting with an appropriate weighting function so that the most recent respiratory cycle is more significantly reflected, instead of simply counting the respiratory rate for the most recent 1 minute. In addition, since the period of 1 minute is usually longer than the update interval of the display screen of the display unit 24, the counting period of the displayed respiratory rate is set to move with some overlapping portions.

[0044] In addition to regular normal breathing, breathing may be more frequent or more frequent (tachypnea, hyperpnea, tachypnea, Kussmaul) or less frequent (bradypnea, hypopnea, hypopnea) than normal, or the amplitude of breathing may change irregularly (Cheyne-Stokes, Biot), depending on the type of disease of the patient. These breathing patterns (waveform types) may vary depending on the patient and his / her condition, but can be identified by analyzing the pattern of the fluctuating waveform. Here, the type is identified using a trained machine learning model, but in the current situation, there may be cases where the type cannot be accurately identified depending on the waveform.

[0045] In addition, continuous acquisition of biological data is also for quickly detecting changes in a state requiring an emergency and for the person in charge to become aware of them. When a measurement result deviates from a predetermined normal range, an emergency notification operation is performed, so that the person in charge, such as a nurse or a doctor, can be informed quickly even if they are away from the patient due to other work. However, whether the occurrence of abnormal breathing requires an emergency, that is, whether a setting for performing an emergency notification operation (emergency setting) is necessary, differs depending on a combination of many aspects, such as not only the respiratory rate but also the respiratory pattern (waveform type), other measurement results, and the patient's disease. Although machine learning models are also effective for such judgments (estimations) with many variables, currently, the correct answer is not always output, and the final decision is left to the person in charge.

[0046] The output of the machine learning model can be improved by repeating appropriate learning. However, due to various factors such as overlearning and inaccurate teacher data, the accuracy may rather decrease depending on the added learning data. For this reason, there is a risk in continuing learning of a machine learning model for medical use after it has been officially approved as a medical device. On the other hand, in order to generate an improved machine learning model, it is essential to additionally acquire new learning data, that is, correct answers (teaching data) for biomeasurement data and waveform types. In the medical information system 1 of this embodiment, while enabling normal data acquisition, judgment, and display as a normal mode (second mode), it is possible to switch to a clinical trial mode (first mode) in which learning data (corresponding data) is easily acquired when a person in charge such as a nurse can input correct answer data.

[0047] FIG. 3 is a diagram showing the contents of the measurement data in the clinical trial mode. 3(a) shows data of the measurement results stored in the terminal device 20. The measurement results are stored as measurement / processing data 222 in association with the set patient identification information and measurement date and time. Here, the measurement / processing data 222 includes respiratory rate and SpO 2 In addition to these, in the clinical trial mode, the results of a real-time judgment made by a person in charge, such as by visually observing a patient, are acquired as input data from the outside via the operation reception unit 25, etc., and the selection results of the breathing pattern (waveform type) and the necessity of emergency notification (emergency setting) are set and stored as selection data 223 (corresponding data) corresponding to the waveform data, further corresponding to the patient identification information and the measurement date and time. In addition, the measurement data for the period corresponding to the selection data 223 is preprocessed as necessary, and similarly corresponding to the patient identification information and the measurement date and time.

[0048] Note that the respiration waveform data itself may be stored separately as long as it is associated with patient identification information and the period corresponding to each selection data 223 can be specified, and the data may be analyzed again for each corresponding period later. In the normal mode, it is not necessary to store the waveform data, and the measurement result data sequentially transmitted to the server device 30 may be deleted after an appropriate time has passed. Data such as body temperature and blood pressure measured by a nurse or other staff member at an appropriate time may also be inputted directly into the terminal device 20 or through an input operation by the staff member.

[0049] FIG. 3(b) shows medical information data of the patient stored in the patient information database 41 of the database device 40. In addition to the measurement results of each patient, the database device 40 records various test results, and diagnosis information and findings by doctors and the like in association with the identification information of each patient. The patient identification information may include personal information such as age (date of birth), sex, outpatient / hospitalization history (e.g., medical department, attending physician, period, hospital room), and other information declared by the patient (e.g., smoking and drinking information). Measurement data such as body temperature and blood pressure may be acquired by inputting it to the terminal device 20 as described above, or may be directly input to the server device 30 by the person in charge. Respiratory rate and SpO 2The measurement results based on the measurement data by the biosensor 10 may be obtained at the timing when the body temperature, blood pressure, etc. are measured, or data for a predetermined time before and after may be averaged. Alternatively, the measurement results by the biosensor 10 are obtained periodically (the interval may be changed depending on whether or not an abnormality is detected) and / or in response to an explicit acquisition operation, and if other measurements are performed within the acquired period, these results may be integrated, and if no other measurements are performed, they may be stored as no other measurements. The medical examination record is the diagnosis by the doctor, and if there is no change, the most recent diagnosis may be acquired continuously. Note that in the original data, it is not necessary to store data of all items by date and time in a matrix form, and it is sufficient that each data obtained at different frequencies is stored separately so that it can be associated with the patient and date and time. In addition, the data stored in the database device 40 is the same in the clinical trial mode and the normal mode. In other words, data used only in clinical trials is not stored in the database device 40.

[0050] FIG. 3(c) is an example of the learning data 321 stored in the storage unit 32 of the server device 30. In the learning data, the data acquired in the clinical trial mode by the terminal device 20 (a part of the measurement / analysis data 3211 corresponding to the measurement / processing data 222 and the selection data 223, and the selection data 3212) and the medical information data stored in the patient information database 41 of the database device 40 (a part of the measurement / analysis data 3211 and the diagnosis data 3213) are integrated and stored. The waveform data in the data acquired from the terminal device 20 is analyzed to calculate one or more feature amounts to be inputted to the machine learning model and used, and the feature amounts are included in the measurement / analysis data 3211 and stored. Examples of the feature amount include, but are not limited to, a simple amplitude, its rate of change, and change period, a frequency, its rate of change, and change period, and a total inhalation volume / exhalation volume for a predetermined time. Various other feature amounts may be used. Note that the feature amount may be calculated by the terminal device 20, and may be simply acquired from the terminal device 20 and stored. Furthermore, information that can identify or specify an individual (personal information) may be deleted from this learning data 321. Furthermore, data on multiple patients may be integrated and stored.

[0051] Fig. 4 is a diagram showing an example of display on the display screen of the terminal device 20. Fig. 4(a) is a diagram showing an example of display in normal mode, and Fig. 4(b) is a diagram showing an example of display in clinical trial mode.

[0052] In Fig. 4(a), the patient's identification information and the current date and time are displayed together with the most recent measurement results, such as respiratory rate, pulse rate, and SpO 2 The reference range Dr(SpO 2If a measurement result deviates from the upper limit (wherein the lower limit is the upper limit), a predetermined notification operation is performed to notify of the abnormality. Here, an example of the display when all measurement values ​​are within the reference range Dr is shown. A switch indicator Df1 to clinical trial mode is displayed in the lower right, and it is possible to switch to clinical trial mode with one touch by touch operation or the like. Note that, since informed consent and predetermined approval from the patient or the patient's family are required when conducting a clinical trial, a dialogue to call attention (for example, an operation button to confirm that consent and approval have been obtained) may be displayed on the display screen when switching to clinical trial mode.

[0053] In the display of the clinical trial mode shown in Fig. 4(b), the display is switched to something different from the normal mode so that a user such as a person in charge can clearly see that the display is different from the normal mode. Although not shown here, the words "clinical trial mode" or the like may be displayed. In addition to the numerical values ​​of the measurement results, the clinical trial mode also displays a waveform Dw indicating the time variation of the measured respiratory state.

[0054] Here, an example of a display in which the respiratory rate exceeds the upper limit of the reference range Dr is shown, in which the respiratory rate Dma is highlighted and a warning sign Ds is displayed. In addition to or instead of the warning sign Ds, an emergency alert may be given by audio output or lighting / flashing an LED lamp of a predetermined color.

[0055] The display in this clinical trial mode also includes a display for accepting input operations from the user. Here, a selection screen Dc1 for selecting whether or not an emergency notification (alarm) is required, and a selection screen Dc2 for selecting a breathing pattern (waveform type) are displayed, and options are displayed in a list. When a selection made by a person in charge directly observing the patient's condition is input by a touch operation, the selection data 223 is stored in the terminal device 20 in association with the patient identification information and the current date and time. A switch indicator Df2 for normal mode is displayed in the lower right, and the display can be returned to the normal mode with a single touch operation.

[0056] 5 is a flowchart showing a control procedure by the control unit 21 of the measurement display control process executed by the terminal device 20. For example, in the case of a dedicated device, the measurement display control process is started by automatically starting the program 221 when the power supply starts, and in the case of a general-purpose terminal, the measurement display control process is started by the user starting the program 221, and is continuously executed until the power supply is turned off or the program 221 is terminated.

[0057] When the measurement display control process is started, the control unit 21 (CPU) performs various initial settings, such as acquiring patient information, starting the display screen, and establishing a communication connection with the biosensor 10, and starts processing data acquired from the biosensor 10 (step S101). The control unit 21 is initially set to a normal mode and performs data acquisition and display control (step S102).

[0058] The control unit 21 determines whether or not the clinical trial mode is in effect (step S103). If it is determined that the clinical trial mode is not in effect ("YES" in step S103), the control unit 21 acquires the latest results for each unit time and causes the display unit 24 to display the results in the normal mode described above (step S121). The control unit 21 also transmits the measurement results to the server device 30. Then, the process of the control unit 21 proceeds to step S112.

[0059] If it is determined that the mode is the clinical trial mode ("YES" in step S103), the control unit 21 acquires the latest results for each unit time and causes the display unit 24 to display the results in the clinical trial mode described above (step S104). The control unit 21 also transmits the measurement results to the server device 30. The control unit 21 determines whether or not an input has been made by a selection operation relating to the necessity of an emergency notification (presence or absence of urgency) (step S105). If it is determined that an input has been made ("YES" in step S105), the control unit 21 sets the input data of necessity as selection data 223 and stores it in association with the current date and time (and patient identification information) (step S106). Then, the process of the control unit 21 proceeds to step S107. If it is determined that no selection operation has been made ("NO" in step S105), the process of the control unit 21 proceeds to step S107.

[0060] When the process proceeds to step S107, the control unit 21 determines whether or not a breathing pattern has been input by a selection operation (step S107). If it is determined that a breathing pattern has been input ("YES" in step S107), the control unit 21 sets the input data of the breathing pattern as the selected data 223 and stores it in association with the current date and time (and patient identification information) (step S108). Then, the process of the control unit 21 proceeds to step S109. If it is determined that a breathing pattern has not been input ("NO" in step S107), the process of the control unit 21 proceeds to step S109. The processing in steps S105 to S108 constitutes the setting means and storage control means of this embodiment.

[0061] When the process proceeds to step S109, the control unit 21 determines whether or not biometric data for a predetermined time or more is stored in the storage unit 22 (step S109). The biometric data here includes the measurement result after processing and the selection data 223. The determination criterion may not be the time unit, but the amount of data. If it is determined that biometric data for a predetermined time or more is not stored ("NO" in step S109), the process of the control unit 21 proceeds to step S112. If it is determined that biometric data for a predetermined time or more is stored ("YES" in step S109), the control unit 21 determines whether or not the current communication volume is equal to or less than a predetermined standard (step S110). If it is determined that the current communication volume is not equal to or less than the predetermined standard (exceeds the standard) ("NO" in step S110), the process of the control unit 21 proceeds to step S112. That is, if there is a lot of normal communication, the transmission of biometric data for learning is suspended.

[0062] When it is determined that the communication volume is equal to or less than a predetermined standard ("YES" in step S110), the control unit 21 transmits the biometric data for learning stored in the memory unit 22 to the server device 30 (step S111). The control unit 21 may delete the transmitted biometric data from the memory unit 22. Then, the process of the control unit 21 proceeds to step S112.

[0063] When the process proceeds to step S112, the control unit 21 determines whether or not there has been an input related to switching the mode setting (step S112). If it is determined that there has been an input ("YES" in step S112), the control unit 21 switches and sets the mode between the normal mode and the clinical trial mode in accordance with the input (step S113; switching means). Then, the process of the control unit 21 returns to step S103. If it is determined that there has been no input ("NO" in step S112), the process of the control unit 21 returns to step S103.

[0064] FIG. 6 is a flowchart showing a control procedure by the control unit 31 of the process related to the learning of the machine learning model executed in the server device 30.

[0065] FIG. 6(a) shows a control procedure for the learning data generation process. This process may be started periodically at a predetermined time (eg, at night) or may be started based on a predetermined input operation by the user, for example.

[0066] When the learning data generation process is started, the control unit 31 (CPU) acquires one piece of biomeasurement data (first data) acquired from the terminal device 20 (step S201). The control unit 31 acquires waveform data for a period corresponding to the biomeasurement data (step S202). The control unit 31 analyzes the acquired waveform data and calculates features to be input for machine learning (step S203).

[0067] Based on the patient identification information and date and time information of the biometric data, the control unit 31 acquires patient information (information of the subject, second data) of the patient from the database device 40 for the corresponding date and time (step S204). The control unit 31 associates the acquired biometric data, features, other measurement results, and diagnostic information with the patient information, and outputs the result as a set of learning data (step S205; database generation means). The control unit 31 determines whether all biometric data has been acquired (step S206). If it is determined that some biometric data has not been acquired ("NO" in step S206), the process of the control unit 31 returns to step S201. If it is determined that all biometric data has been acquired ("YES" in step S206), the control unit 31 ends the database generation of the learning data, and ends the learning data generation process.

[0068] FIG. 6(b) shows the control procedure for learning control of the machine learning model. The learning control process may be automatically started immediately after the learning data generation process is completed, or may be started when a start-up operation is input by the user.

[0069] The control unit 31 (CPU) inputs the learning data 321 set by set to the machine learning model 322 and obtains the output (step S251). The control unit 31 compares the output result with the correct answer data (teacher data) (step S252).

[0070] The control unit 31 causes feedback based on the comparison result to be performed for each parameter of the machine learning model 322 (step S253). The feedback may be performed by a conventionally known method according to the algorithm of the machine learning model. The control unit 31 determines whether or not all data pairs of the learning data 321 have been input (step S254). If it is determined that there is a data pair that has not been input ("NO" in step S254), the processing of the control unit 31 returns to step S251. If it is determined that all data pairs have been input ("YES" in step S254), the control unit 31 ends the learning control processing.

[0071] [Second embodiment] Next, a biological information processing device and an information processing device according to a second embodiment will be described. FIG. 7 is a block diagram showing the functional configuration of a terminal device 20 which is a biometric information processing device and a server device 30 which is an information processing device according to the second embodiment.

[0072] In the second embodiment, the terminal device 20 and the server device 30 have the same configuration, except that a trained model 224 is stored in the storage unit 22 of the terminal device 20. The same components are denoted by the same reference numerals and the description thereof will be omitted.

[0073] The trained model 224 is trained by the machine learning model 322 of the server device 30. That is, by inputting data such as a measurement result, a breathing pattern and an emergency alert level are output. Note that the latest parameters related to the operation of the trained model 224 may be appropriately acquired from the server device 30 and updated.

[0074] FIG. 8 is a diagram for explaining a display by the terminal device 20 of this embodiment.

[0075] As shown in FIG. 8(a), in the terminal device 20 of this embodiment, the reference range Dr for the respiratory rate is variable, and the setting can be changed according to the input of other parameters to the trained model 224. The setting may be changed only once at the start of the clinical trial mode, or may be changeable in real time. Also, a display Dp of the estimated result of the respiratory pattern is shown. The other displays are the same as those in the clinical trial mode in the terminal device 20 of the first embodiment. The request for input operation to the selection screens Dc1 and Dc2 is also performed in the same manner regardless of the display contents of the estimated result. Information related to the difference between the estimation result based on the trained model 224 and the judgment result input by the person in charge may be transmitted to the server device 30 in the same manner as the training data, and used for performance evaluation of the trained model 224. In this case, the server device 30 may generate and store performance evaluation data separately from the training data 321. The performance evaluation data may be quantitatively evaluated based on another analysis program.

[0076] That is, in the terminal device 20 of this embodiment, the display in the clinical trial mode can be executed by a person in charge who can appropriately judge the condition of the patient, regardless of the display contents. Note that the highlight display of the respiratory rate Dma and the display of the warning sign Ds may be performed based on the standard range Dr in the normal mode based on the standard in the normal mode, and the variable standard may simply be displayed together, or the warning sign based on the variable standard may be determined and displayed separately.

[0077] The estimation of whether or not an emergency notification is necessary may be determined based on the percentage of times that the alarm necessity input by the person in charge was "necessary," depending on the conditions of various other parameters.

[0078] As shown in Fig. 8(b), the need for emergency notification increases when the respiratory rate is too low or too high. However, the reference range Dr changes depending on the combination with the respiratory pattern, other measurement results, and the patient's disease, so the trained model sets the reference range Dr according to each combination. Note that the machine learning model 322 that performs this level of learning does not necessarily have to use a neural network or the like.

[0079] 9 is a flowchart showing a control procedure by the control unit 21 of the measurement display control process executed by the terminal device 20 of this embodiment. This measurement display control process is different from the measurement control process executed by the terminal device 20 of the first embodiment only in that the processes of steps S131 to S133 are added and the processes of steps S106 and S108 are replaced by steps S106a and S108a, but the other processes are the same. The same process contents are assigned the same reference numerals and detailed explanations are omitted.

[0080] After the process of step S101, the control unit 21 (CPU) acquires the latest data of each parameter of the trained model 224 from the server device 30 as the latest data for estimation (step S131). Then, the process of the control unit 21 proceeds to step S102.

[0081] When it is determined in the determination process of step S103 that the clinical trial mode is selected ("YES" in step S103), the control unit 21 analyzes the waveform data of the breathing acquired from the biosensor 10 to calculate the feature amount (step S132; calculation means). The control unit 21 inputs a predetermined set of data including the feature amount to the trained model 224, and estimates the breathing pattern according to the relationship based on the learning of the machine learning model (step S133; estimation means). When data such as body temperature and blood pressure are required for the estimation, the most recent measured value may be used. In this case, the most recent measured value of body temperature and blood pressure may be input to the terminal device 20 and held until the next measurement. Then, the process of the control unit 21 proceeds to step S104.

[0082] When the process of step S105 branches to "YES", the control unit 21 associates and stores the biomeasurement data, the date and time information, and the estimation result of whether or not emergency setting is required by the trained model 224 at this date and time (according to the relationship by learning the machine learning model) (step S106a). Then, the process of the control unit 21 proceeds to step S107. Also, when the judgment process of step S107 branches to "YES", the control unit 21 associates and stores the biomeasurement data, the date and time information, and the estimation result of the breathing pattern by the trained model 224 at this date and time (step S108a). Then, the process of the control unit 21 proceeds to step S109.

[0083] As described above, the terminal device 20, which is the bioinformation processing device of this embodiment, includes the control unit 21. The control unit 21, as a setting means, acquires and sets at least one of the breathing pattern (information on waveform type) indicated by waveform data relating to time fluctuations in the measured value of the patient (subject) acquired from the biosensor 10 and information on whether emergency setting is required for the patient's condition indicated by the waveform data, as selection data 223 from the outside, here, from the operation acceptance unit 25. In addition, the control unit 21, as a storage control means, stores the selection data 223 in the storage unit 22 in association with the waveform data. In this way, in a medical setting where it is difficult to perform measurements solely for clinical trials, information such as breathing patterns and the need for emergency notification input by a medical professional when possible can be acquired and stored in combination with biometric data while easily checking normal data. Therefore, the terminal device 20 can more easily acquire appropriate medical learning data.

[0084] Moreover, the control unit 21 serves as a calculation means for calculating a predetermined feature amount that characterizes the waveform pattern from the waveform data, and serves as a storage control means for storing the feature amount in association with the corresponding data. By calculating the feature amounts in advance in the terminal device 20, data correspondence can be easily established, and the processing load of the server device 30 can be reduced.

[0085] Furthermore, the control unit 21, as an estimation means, estimates at least a part of the breathing pattern and the necessity of emergency notification according to the waveform data newly acquired from the biosensor 10 based on the relationship between the stored feature amount and the selection data 223. In this way, when the person in charge, who is the user of the terminal device 20, can judge the breathing pattern and urgency by himself / herself and there is no problem in switching to the clinical trial mode, the estimation result by the machine learning model being trained may be displayed together. By acquiring this result together with the judgment result of the person in charge, evaluation data of the machine learning model can also be easily obtained.

[0086] In addition, the above relationship is obtained by learning the machine learning model. In other words, by acquiring this result together with the judgment result of the person in charge as described above, evaluation data of the machine learning model can be easily obtained.

[0087] Furthermore, the control unit 21, as a switching means, switches between a clinical trial mode in which the selection data 223 is stored as storage control means, and a normal mode in which the selection data 223 is not stored. Since the control unit 21 can easily switch between a state in which a clinical trial is performed and a state in which a clinical trial is not performed in the terminal device 20 in this manner, it is possible to easily switch to the clinical trial mode only when there is a skilled person in charge of providing learning data available or when it is necessary, without significantly affecting normal operations.

[0088] Moreover, the server device 30, which is the information processing device of this embodiment, includes a control unit 31. The control unit 31, as a database generating means, generates a database in which the bioinformation data stored in the terminal device 20 is associated with patient information data including measurement data of the patient acquired by a device other than the biosensor 10. In this way, the server device 30 can obtain a large amount of learning data by generating a list by further associating the biological information data generated by each terminal device 20 with various patient data. If the server device 30 can properly access the necessary data, it can easily integrate the data, so that it can generate a large amount of necessary learning data without imposing a burden on medical personnel or with a small burden.

[0089] Moreover, the control unit 31, as a database generating means, generates a database by deleting personal information that identifies a patient. Since the personal information itself is not necessary for the learning data, the amount of data can be reduced by deleting unnecessary data. Furthermore, since deleting personal information makes it possible to take the learning data outside the hospital, it is also possible to entrust the learning process to a third party. Furthermore, since it is possible to integrate with data from other hospitals, it is possible to obtain a large amount of learning data more efficiently and to perform learning of the machine learning model 322.

[0090] In addition, the server device 30 as a trained model generation device of this embodiment generates a trained model in which the control unit 31 serves as a generation means, includes as input predetermined features related to waveform data contained in the database generated as the above-mentioned information processing device, and uses at least a portion of the selected data 223 as teacher data and outputs the at least a portion of the selected data 223. In this way, a trained model is generated from a database that consolidates biometric data easily obtained during normal work hours and the correct answer data for the measurement results. This makes it possible to efficiently and appropriately improve and develop machine learning models using a variety of useful training data.

[0091] In addition, the program 221 of this embodiment causes the terminal device 20 (computer) to function as a setting means for externally acquiring and setting at least one of information on waveform type (breathing pattern) indicated by waveform data relating to time fluctuations of the patient's measurement values ​​acquired from the biosensor 10 and information on the need for emergency settings for the patient's condition (status) indicated by the waveform data as selection data 223. By installing and running such a program 221 on the terminal device 20, conventional medical operations can be continued without hindrance, and learning data can be easily collected without the need for separate hardware devices, thereby reducing the time and financial burden on medical personnel and medical corporations.

[0092] The present invention is not limited to the above-described embodiment, but may be modified in various ways. For example, in the above embodiment, both the input of the waveform type and the emergency setting are acquired and learned, but only one of them (part) may be acquired. Also, even if both input data are collected, it is not necessary to learn both of them, and only one of them may be used for machine learning.

[0093] In addition, in the above embodiment, a single program 221 is used to switch between the normal mode and the clinical trial mode, but it is also possible to have a program that operates in the normal mode and a separate program that operates in the clinical trial mode, and have the management program start either one of them to control the switching.

[0094] Furthermore, input of judgment data such as breathing patterns to the terminal device 20 is not limited to being performed via the operation reception unit 25. Input data to another terminal device may be acquired by being sent to the terminal device 20 via the communication unit 23. For example, the contents of an operation input to a tablet terminal at hand may be transmitted to the terminal device 20 installed at the bedside. In this case, a program for displaying an input screen on the tablet terminal may be separately prepared, or the contents displayed by the display unit 24 of the terminal device 20 may simply be transferred to the tablet terminal as well.

[0095] In the above embodiment, the terminal device 20 is configured to display the output of the trained model in the clinical trial mode, but the terminal device 20 does not need to have such a function. In other words, the terminal device 20 only needs to be able to easily collect training data in the clinical trial mode. In this case, the terminal device 20 does not need to calculate the feature amount.

[0096] In addition, in the above embodiment, the trained model is generated by the server device 30, but the training data may be copied to another electronic device (which may be a computer, or the terminal device 20) and the trained model may be generated by the other electronic device. On the other hand, when processing is limited to an authorized person on a computer in a hospital, such as the server device 30, personal information does not necessarily have to be deleted from the training data.

[0097] Further, although the machine learning model 322 has been described as learning based on the feature amount of the waveform data, learning may be performed based on image data of the waveform.

[0098] In addition, in the above embodiment, respiration measurement has been used as an example of periodic fluctuation data from which waveform data is obtained, but other fluctuation data, such as measurement data such as pulse waves and brain waves, may also be obtained and processed.

[0099] In the above embodiment, the medical staff obtains the measurement results of the patient's biological information data, but the biological information data of the care recipient may be measured in a care facility or at home and the care staff may check it on the spot. The staff's judgment is not limited to being made directly on the spot, but may be made from outside the hospital room via real-time video from a surveillance camera (a slight time lag in communication may occur).

[0100] In the above description, the storage unit 22 made of a non-volatile memory including a HDD is taken as an example of a computer-readable medium for the program 221 related to the processing operation of the control unit 21 according to the present invention, but the present invention is not limited to this. Portable recording media such as CD-ROMs and DVD disks can be applied as other computer-readable media. In addition, a carrier wave is also applied to the present invention as a medium for providing data of the program according to the present invention via a communication line. In addition, the specific configurations, contents and procedures of the processing operations, etc. shown in the above embodiments can be modified as appropriate without departing from the spirit of the present invention. The scope of the present invention includes the scope of the invention described in the claims and its equivalents. [Explanation of symbols]

[0101] 1 Medical Information System 10 Biometric Sensors 20 Terminal Equipment 21 Control section 22 Memory section 221 Program 222 Measurement / processing data 223 Selected Data 224 trained models 23 Communications Department 24 Display section 25 Operation reception section 26 Notification section 30 Server equipment 31 Control Unit 32 Storage section 321 Training Data 3211 Measurement / Analysis Data 3212 Selected Data 3213 Diagnostic Data 322 Machine Learning Models 323 Program 33 Communications Department 34 Display section 35 Operation reception section 36 Notification section 40 Database Equipment 41 Patient Information Database 50 Network Equipment Dc1, Dc2 selection screen Df1, Df2 Switching Indicator Dma respiratory rate Dp estimation result display Dr. Reference Range Ds warning sign Dw waveform

Claims

1. a setting means for externally acquiring and setting at least one of information on a waveform type indicated by waveform data relating to a measurement value accompanied by periodic time fluctuation of a subject, the measurement value being acquired from a bio-information measuring device which is a medical device in clinical use, and information on whether an emergency setting is required for the condition of the subject indicated by the waveform data, as corresponding data; and a storage control means for storing the correspondence data and the waveform data in association with each other; a switching means for switching between a first mode in which the storage control means stores the corresponding data and a second mode in which the storage control means does not store the corresponding data; A biological information processing device comprising:

2. The waveform data includes a measurement result that deviates from a predetermined normal range of the subject.

2. The biological information processing apparatus according to claim 1.

3. a calculation means for calculating a predetermined feature amount from the waveform data, The storage control means stores the feature amount in association with the corresponding data.

3. The biometric information processing apparatus according to claim 1, wherein the biometric information processing apparatus is a processor.

4. 4. The biometric information processing apparatus according to claim 3, further comprising an estimation unit that estimates at least a part of the corresponding data corresponding to the newly acquired waveform data based on the stored relationship between the feature amount and the corresponding data.

5. The biometric information processing apparatus according to claim 4 , wherein the relationship is obtained by learning a machine learning model.

6. An information processing device characterized in that it comprises a database generation means for generating a database in which first data stored by the memory control means in the bio-information processing device described in any one of claims 1 to 5 corresponds to second data including information of the subject obtained by a device other than the bio-information measuring device.

7. 7. The information processing apparatus according to claim 6, wherein said database generating means generates said database by deleting personal information that identifies said subject.

8. 8. A trained model generation device comprising a generation means for generating a trained model that includes, as an input, a predetermined feature related to the waveform data contained in the database generated by the information processing device according to claim 6 or 7, and that uses at least a portion of the corresponding data as teacher data and outputs the at least a portion of the corresponding data.

9. Computer, a setting means for externally acquiring and setting at least one of information on a waveform type indicated by waveform data relating to a measurement value accompanied by periodic time fluctuation of a subject, the measurement value being acquired from a bio-information measuring device which is a medical device in clinical use, and information on whether an emergency setting is required for the condition of the subject, the information being indicated by the waveform data; a storage control means for storing the correspondence data and the waveform data in association with each other; a switching means for switching between a first mode in which the storage control means stores the corresponding data and a second mode in which the storage control means does not store the corresponding data; A program characterized by causing the program to function as a

Images