Medical system and medical information processing device

Abstract

To provide a new technique for detecting a symptom accompanying an infectious disease and a sign of increase in severity with high accuracy.SOLUTION: A medical system 1 includes a data acquisition section 10 and a data processing section 20. The data acquisition section 10 is configured to acquire at least two types of pieces of data among blood oxygen data, auscultatory sound data, ocular image data, and ocular blood flow data from a patient. The data processing section 20 is configured to process at least two types of pieces of data acquired by the data acquisition section 10 in order to detect change in a condition of a circulatory system that accompanies an infectious disease.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a medical system and a medical information processing device. [Background technology]

[0002] Symptoms of diseases and signs of aggravation are complex, and various technologies have been developed to detect them. For example, Patent Document 1 discloses a technology for determining the risk of infectious diseases from the presence or absence of abnormalities in arterial blood oxygen saturation, body temperature, and heart rate, as a technology for determining the risk of infectious diseases without using advanced medical knowledge. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2016-123605 A Summary of the Invention [Problem to be solved by the invention]

[0004] One object of the present invention is to provide a new technology for detecting symptoms associated with infectious diseases and signs of aggravation with high accuracy. [Means for solving the problem]

[0005] According to some exemplary embodiments, the medical system includes a data acquisition unit that acquires at least two of the following data from a patient: blood oxygen data, auscultatory sound data, eye image data, and eye blood flow data; and a data processing unit that processes the at least two of the data acquired by the data acquisition unit to detect changes in the condition of the circulatory system associated with an infection.

[0006] In some exemplary embodiments of the medical system, the change in the condition of the circulatory system may include at least one of the following: onset of pneumonia, a change in pneumonia condition, onset of hypoxemia, a change in hypoxemia condition, and a change in cerebral blood flow condition.

[0007] In some exemplary aspects of the medical system, the eye image data may include fundus image data depicting a fundus of the patient.

[0008] In some exemplary aspects of the medical system, the data processing unit may be configured to detect a change in the condition of the circulatory system based on the course pattern of blood vessels depicted in the fundus image data.

[0009] In some exemplary aspects of the medical system, the fundus image data may include at least one of fundus camera image data, slit lamp image data, optical coherence tomography image data, and scanning laser image data.

[0010] In some exemplary aspects of the medical system, the eye image data may include color fundus image data depicting a fundus of the patient's eye.

[0011] In the medical system according to some exemplary aspects, the data processing unit may be configured to detect a change in the state of the circulatory system based on color information in the color fundus image data.

[0012] In some exemplary embodiments of the medical system, the color fundus image data may include at least one of fundus camera image data, slit lamp image data, and scanned laser image data.

[0013] In some exemplary aspects of the medical system, the data processing unit may include an inference processing unit that performs inference processing to derive information regarding changes in the condition of the circulatory system from the eye image data acquired by the data acquisition unit, using a learned model constructed by machine learning using training data including eye image data and diagnosis result data.

[0014] In a medical system according to some exemplary aspects, the ocular blood flow data may include fundus blood flow data representing hemodynamics in the fundus blood vessels of the patient.

[0015] In some exemplary aspects of the medical system, the fundus blood flow data may include waveform data representing time-series changes in blood flow velocity in the patient's fundus artery, and the data processing unit may be configured to detect changes in the condition of the circulatory system based on the waveform data.

[0016] In some exemplary embodiments of the medical system, the fundus blood flow data may include two or more waveform data obtained from the patient at two or more different time periods, and the data processing unit may be configured to detect changes in the condition of the circulatory system by comparing the two or more waveform data.

[0017] In some exemplary aspects of the medical system, the fundus blood flow data may include either or both of blood flow velocity data and blood flow rate data in the patient's fundus artery, and the data processing unit may be configured to detect changes in the condition of the circulatory system based on either or both of the blood flow velocity data and the blood flow rate data.

[0018] In some exemplary aspects of the medical system, the data acquisition unit may include an optical coherence tomography device that scans the fundus of the patient to acquire the fundus blood flow data.

[0019] In some exemplary aspects of the medical system, the auscultatory sound data may include lung sound data obtained from the patient by an electronic stethoscope.

[0020] In some exemplary aspects of the medical system, the data acquisition unit may be further configured to acquire either or both of body temperature data and heart rate data from the patient.

[0021] The medical system according to some exemplary embodiments may further include a transmission unit that transmits information output from the data processing unit to a doctor's terminal located remotely from the data acquisition unit.

[0022] The medical system according to some exemplary embodiments may further include an operation unit for remotely operating the data acquisition unit.

[0023] A medical information processing device according to some exemplary embodiments includes a data receiving unit that receives at least two of blood oxygen data, auscultatory sound data, eye image data, and eye blood flow data obtained from a patient, and a data processing unit that processes the at least two pieces of data received by the data receiving unit in order to detect changes in the condition of the circulatory system associated with an infection.

[0024] In some exemplary embodiments of a medical information processing device, the change in the circulatory system condition may include at least one of the onset of pneumonia, a change in pneumonia condition, the onset of hypoxemia, a change in hypoxemia condition, and a change in cerebral blood flow condition.

[0025] In the medical information processing device according to some exemplary aspects, the eye image data may include fundus image data depicting the fundus of the patient.

[0026] In some exemplary aspects of the medical information processing device, the data processing unit may be configured to detect a change in the condition of the circulatory system based on the course pattern of blood vessels depicted in the fundus image data.

[0027] In some exemplary aspects of the medical information processing device, the eye image data may include color fundus image data depicting the fundus of the patient.

[0028] In some exemplary aspects of the medical information processing device, the data processing unit may be configured to detect a change in the state of the circulatory system based on color information in the color fundus image data.

[0029] In some exemplary aspects of the medical information processing device, the data processing unit may include an inference processing unit that performs inference processing to derive information regarding changes in the condition of the circulatory system from the eye image data accepted by the data accepting unit, using a learned model constructed by machine learning using training data including eye image data and diagnosis result data.

[0030] In a medical information processing device according to some exemplary aspects, the ocular blood flow data may include fundus blood flow data representing blood flow dynamics in the fundus blood vessels of the patient.

[0031] In some exemplary aspects of the medical information processing device, the fundus blood flow data may include waveform data representing time-series changes in blood flow velocity in the patient's fundus artery, and the data processing unit may be configured to detect changes in the condition of the circulatory system based on the waveform data.

[0032] In some exemplary aspects of the medical information processing device, the fundus blood flow data may include two or more waveform data obtained from the patient during two or more different periods, and the data processing unit may be configured to detect changes in the condition of the circulatory system by comparing the two or more waveform data.

[0033] In some exemplary aspects of the medical information processing device, the fundus blood flow data may include either or both of blood flow velocity data and blood flow rate data in the patient's fundus artery, and the data processing unit may be configured to detect changes in the condition of the circulatory system based on either or both of the blood flow velocity data and the blood flow rate data.

[0034] In some exemplary aspects of the medical information processing device, the auscultation sound data may include lung sound data.

[0035] In some exemplary aspects of the medical information processing device, the data receiving unit may be further configured to receive either or both of body temperature data and heart rate data acquired from the patient.

[0036] In some exemplary embodiments, the medical information processing device may further include a transmitting unit that transmits information generated by the data processing unit to a doctor's terminal located remotely from at least one device used to acquire the at least two pieces of data from the patient. Effect of the Invention

[0037] According to an exemplary embodiment, it is possible to improve the accuracy of the process of detecting symptoms associated with an infectious disease or signs of aggravation. [Brief description of the drawings]

[0038] [Figure 1] FIG. 1 is a schematic diagram illustrating an example of a configuration of a medical system according to an exemplary embodiment. [Diagram 2] FIG. 2 is a schematic diagram illustrating an example of a structure of data processed by a medical system according to an exemplary embodiment. [Diagram 3] FIG. 1 is a schematic diagram illustrating an example of a configuration of a medical system according to an exemplary embodiment. [Figure 4] FIG. 1 is a schematic diagram illustrating an example of a configuration of a medical system according to an exemplary embodiment. [Diagram 5] FIG. 1 is a schematic diagram illustrating an example of a configuration of a medical system according to an exemplary embodiment. [Figure 6] 1 is a flowchart illustrating an example of the operation of a medical system according to an exemplary embodiment. [Figure 7] 1 is a schematic diagram illustrating an example of a configuration of a medical information processing device according to an exemplary embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0039] In the present disclosure, some exemplary aspects of a medical system and a medical information processing device are described. Some exemplary aspects detect changes in the state of the circulatory system associated with an infection by processing at least two data of blood oxygen data, auscultatory sound data, eye image data, and eye blood flow data by a computer. This computer processing may include diagnostic inference. This diagnostic inference is performed, for example, by one of an algorithm using a trained model (inference model) constructed by machine learning and an algorithm not using a trained model, or by a combination of these.

[0040] The types of data subjected to computer processing are not limited to blood oxygen data, auscultatory sound data, eye image data, and eye blood flow data, but may include, for example, biological data (body temperature data, heart rate data, etc.) acquired from a patient by an examination device, and data (electronic medical record data, interview data, patient background information, etc.) stored in a storage device (database, etc.). Examples of patient background information include age, medical history, medical history, medication history, and surgical history.

[0041] The exemplary aspects enable highly accurate detection of complex physiological events such as symptoms of infectious diseases and signs of aggravation by comprehensively processing data such as blood oxygen data, auscultatory sound data, eye image data, and eye blood flow data. In particular, the exemplary aspects enable highly accurate detection of changes in the state of the circulatory system associated with an infectious disease. In addition, some exemplary aspects have been devised in consideration of the background described below, and can provide corresponding effects.

[0042] Medical workers, such as doctors and nurses, are at risk of infection within hospitals. For example, during the 2020 Coronavirus Desease 2019 (COVID-19) pandemic, the risk of infection for medical workers became a major issue, with cluster infections occurring in medical institutions that were inundated with many patients. The increased risk of infection for medical workers can occur not only during infectious disease epidemics, but also in the event of disasters or major accidents.

[0043] In general, social distancing, or maintaining a sufficient distance between people, is considered important to reduce the risk of infection, but this is not easy to achieve in standard medical care. For example, when using a stethoscope to listen to sounds generated by the heart, lungs, blood vessels, etc., or when using a slit lamp microscope to observe the eyes, doctors and other medical professionals need to be close to the patient to perform the treatment.

[0044] Some exemplary embodiments may be configured to provide the results of processing based on at least two of the above-mentioned data to a doctor's terminal located at a remote location from the device (data processing unit, examination device) that acquired the data from the patient. Also, some exemplary embodiments may be configured to allow the data processing unit (examination device) to be operated from a remote location. According to these configurations, it becomes possible to use data acquired in examinations (auscultation, slit lamp examination, etc.) that could not be performed unless the doctor was close to the patient in the past for diagnosis. That is, according to some exemplary embodiments, it becomes possible to optimize social distancing between the patient and the medical staff, and to detect complex physiological events such as symptoms and signs of aggravation with high accuracy.

[0045] Here, the "remote location" may be any location that allows social distancing between the patient and the medical staff. For example, the doctor's terminal may be installed in a room separate from the testing device, or in a facility separate from the testing device. Also, a device for remotely operating the testing device (operating device, operating unit) may be installed in a room separate from the testing device, or in a facility separate from the testing device.

[0046] In addition, when the test is performed under a sufficient infection protection system, such as wearing full protective clothing, social distancing does not need to be ensured. In cases where only some tests (specific tests) are performed under a sufficient infection protection system, some exemplary embodiments may be configured to provide information to a doctor's terminal located in a remote location for each of the test devices used for tests other than the specific tests.

[0047] Modifications to the exemplary embodiments may be made by the matters described in the documents cited in this specification or any other known techniques, and may be, for example, additions, combinations, substitutions, deletions, omissions, and other modifications.

[0048] At least a portion of the functionality of the elements described in this disclosure may be implemented using circuitry or processing circuitry. The circuitry or processing circuitry may be a general-purpose processor, a special-purpose processor, an integrated circuit, a central processing unit (CPU), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), a programmable logic device (e.g., a simple programmable logic device (SPLD), a complex programmable logic device (CPLD), a field programmable gate array (FPGA), or a combination of a programmable logic device (PLC) and a programmable logic device (PLC)) configured and / or programmed to perform at least a portion of the disclosed functionality. The term may include any of a conventional circuit arrangement, a memory array ...

[0049] The exemplary aspects described below may be combined in any manner, for example, two or more exemplary aspects may be at least partially combined.

[0050] <Medical system configuration> Several examples of the configuration of the medical system according to the exemplary embodiment will be described. The exemplary medical system 1 shown in Fig. 1 includes a data acquisition unit 10, a data processing unit 20, and an output unit 30. The medical system 1 may further include an operation device 2.

[0051] In a typical example, the data acquisition unit 10 and the data processing unit 20 are connected via a communication line. For example, this communication line may form a network within a medical institution, or may form a network across multiple facilities. Any communication technology may be applied to this communication line, and may be any of various known communication technologies such as wired communication, wireless communication, and short-distance communication. The connection between the data processing unit 20 and the output unit 30 may be the same. Alternatively, the data processing unit 20 and the output unit 30 may be functional units mounted on the same computer.

[0052] The operation device 2 is used by a medical professional to remotely operate the data acquisition unit 10 (examination device). The operation device 2 is also used by a medical professional (examiner) to provide instructions to a patient (subject) undergoing an examination using the data acquisition unit 10 (examination device). The operation device 2 includes, for example, a computer, an operation panel, and the like.

[0053] The data acquisition unit 10 is configured to acquire ophthalmological data from a patient, and in particular, is configured to acquire at least two of the following data from the patient: blood oxygen data, auscultatory sound data, eye image data, and eye blood flow data.

[0054] The device for acquiring blood oxygen data from a patient (blood oxygen measuring device) may be, for example, a pulse oximeter described in JP 2019-111010 A. The type of blood oxygen data detected by the blood oxygen measuring device is arbitrary, and may be, for example, at least one of oxygen saturation data, oxygen content data, and oxygen supply data.

[0055] The device for acquiring auscultatory sound data from a patient (auscultatory sound measurement device) may be, for example, an electronic stethoscope as described in JP 2017-198 A, etc. The type of auscultatory sound detected by the auscultatory sound measurement device is arbitrary, and may be, for example, at least one of tracheal respiratory sound data, bronchial respiratory sound data, alveolar respiratory sound data (lung sound data), cardiac sound data, and blood flow sound data.

[0056] The device (ophthalmic imaging device) for acquiring eye image data from a patient may be any ophthalmic modality device. Applicable ophthalmic modalities may be, for example, a photography type modality or a scan type modality. Types of ophthalmic imaging devices include an optical coherence tomography device, a fundus camera, a slit lamp microscope, a scanning laser ophthalmoscope, a surgical microscope, and the like. The ophthalmic imaging device may also be a fundus imaging device capable of acquiring fundus image data. The fundus image data is, for example, image data depicting fundus blood vessels, and is used for analyzing blood vessel running patterns, and the like.

[0057] The optical coherence tomography device and / or fundus camera may be, for example, a device in which various photographing preparation operations are automated, as described in JP 2020-44027 A. The photographing preparation operation is an operation performed to prepare photographing conditions, and examples thereof include alignment adjustment, focus adjustment, optical path length adjustment, polarization adjustment, and light amount adjustment. In addition, an operation for maintaining good photographing conditions achieved by the photographing preparation operation may be automatically executed. Such operations include automatic alignment adjustment (tracking) in accordance with eye movement and automatic optical path length adjustment (Z lock) in accordance with eye movement. These automatic operations are effective, for example, in an examination performed without the presence of an examiner.

[0058] The eye image data (optical coherence tomography image data) acquired by the optical coherence tomography device may be, for example, at least one of three-dimensional image data obtained by applying a three-dimensional scan to the fundus, projection image data of the three-dimensional image data, and optical coherence tomography angiography (OCTA) image data.

[0059] The eye image data (fundus camera image data) acquired by the fundus camera may be, for example, at least one of color fundus image data, infrared fundus image data, and fluorescent contrast fundus image data (fluorescein angiography image data, indocyanine green angiography image data, etc.).

[0060] The scanning laser ophthalmoscope may be, for example, a device described in JP 2014-226156 A. Eye image data (scanning laser image data) acquired by the scanning laser ophthalmoscope may be, for example, at least one of color fundus image data, monochromatic fundus image data, and fluorescent angiographic fundus image data.

[0061] The slit lamp microscope may be, for example, a device effective for remote photography as described in JP 2019-213734 A. The eye image data acquired by the slit lamp microscope may be, for example, at least one of color fundus image data, anterior segment cross-sectional image data, and anterior segment three-dimensional image data.

[0062] As for the other types of ophthalmic imaging devices, any known device can be adopted. For example, a surgical microscope effective for remote surgery, as described in Japanese Patent Laid-Open Publication No. 2002-153487, can be used as the ophthalmic imaging device.

[0063] The device for acquiring ocular blood flow data from a patient (ocular blood flow measuring device) may be a device of any measurement method. The ocular blood flow data includes, for example, data (ocular blood flow data) representing the blood flow dynamics in the fundus blood vessels of the patient. The ocular blood flow measuring device may be, for example, an optical coherence tomography device described in JP 2019-54994 A, JP 2020-48730 A, etc. By utilizing these known techniques, some exemplary aspects of the ocular blood flow measuring device can acquire waveform data representing a time series change in the blood flow velocity in the fundus artery of the patient, blood flow velocity data and / or blood flow rate data in the fundus artery of the patient. The waveform data is typically a time series change graph of the blood flow velocity expressed in a two-dimensional coordinate system with time on the horizontal axis and blood flow velocity on the vertical axis. In addition, a device that can be used as an ocular blood flow measuring device is not limited to an optical coherence tomography device, and may be, for example, a laser speckle flowgraphy (LSFG) device described in JP-A-2017-504836.

[0064] As described above, the types of data that the data acquisition unit 10 of the exemplary embodiment can acquire are not limited to blood oxygen data, auscultatory sound data, eye image data, and eye blood flow data. In some exemplary embodiments, the data acquisition unit 10 may be capable of acquiring body temperature data and / or heart rate data. The body temperature data of the patient is acquired, for example, using a thermometer in the system described in JP 2018-29964 A. The heart rate data of the patient (heart rate, electrocardiogram waveform, etc.) is acquired, for example, using a heart rate / electrocardiogram meter described in JP 2017-148577 A.

[0065] Some exemplary embodiments may be capable of acquiring any type of data, such as blood flow data, pulse data, respiratory function data, blood pressure data, etc. For example, it is possible to acquire blood flow data (blood flow velocity data, blood flow rate data, blood flow velocity distribution data, etc.) and pulse data (pulse rate, etc.) using any of the ultrasonic blood flow meter described in JP 2008-36095 A, the laser blood flow meter described in JP 2008-154804 A, and the electromagnetic blood flow meter described in JP 10-328152 A. In addition, it is possible to acquire respiratory function data (respiratory rate data, tidal volume data, minute ventilation data, tracheal pressure data, air velocity and air flow rate data, ventilation work data, inhaled gas concentration data, inhaled water vapor data, etc.) using a respiratory monitoring system described in, for example, JP 2019-527117 A. In addition, it is possible to obtain blood pressure data (such as blood pressure values) and pulse data (such as pulse rate) using a blood pressure monitor in the system described in, for example, JP 2018-29964 A.

[0066] Some exemplary aspects may be configured to process eye characteristic data acquired by an ophthalmic measuring device. The eye characteristic data is data indicating the state of the eye (characteristic data such as numerical data and evaluation data). In addition to the above-mentioned eye blood flow measuring device, the types of ophthalmic measuring devices include an eye refraction measuring device, a tonometer, a corneal endothelial cell testing device (specular microscope), a higher-order aberration measuring device (wavefront analyzer), a visual acuity testing device, a perimeter, a microperimeter, an axial length measuring device, an electroretinogram testing device, a binocular visual function testing device, and a color vision testing device. Examples of the eye refraction measuring device (refractometer, keratometer), the tonometer (non-contact tonometer), the specular microscope, and the wavefront analyzer are described in JP 2018-38518 A. The visual acuity testing device may be, for example, a device capable of remote visual acuity testing, as described in JP 2018-110687 A. As for other types of ophthalmic measuring devices, any known device may be adopted.

[0067] In this embodiment, at least one of the examination devices (eg, electronic stethoscope, ophthalmic imaging device, ophthalmic measuring device, etc.) included in the data acquisition unit 10 may be capable of being remotely operated or remotely controlled.

[0068] As an example, in consideration of the risk of infection to medical personnel, a separate examination room can be set up where examinations using examination equipment are performed and where the examination equipment is operated. In addition to the examination equipment, the examination room is equipped with speakers and displays for outputting instructions (audio, images, videos, etc.) from the operator in the operation room, a video camera for photographing subjects (patients) in the examination room, a microphone for inputting the subject's voice, a computer connected to the examination equipment, etc.

[0069] Meanwhile, the operation room is provided with an operation device 2 for remotely operating the examination device. The operation device 2 is provided with a computer, an operation panel, a display, a video camera, a microphone, etc. The computer executes processing for remote operation. The computer is connected to the examination device in the examination room. The operation panel, the video camera, and the microphone are used to input instructions to the subject. The display shows data acquired by the examination device and information for remote operation (screen, information from the examination room, etc.).

[0070] With this configuration, an operator (medical worker) in the control room can remotely operate the testing equipment in the testing room using, for example, an application programming interface (API), and can also send instructions to the subject using a videophone, etc. This allows the subject to undergo testing alone, following the instructions of the operator in a remote location, which makes it possible to significantly reduce the risk of infection from the subject to the operator.

[0071] In order to more suitably perform the examination by the patient (subject) alone, an examination device (mentioned above) with automated preparatory operations can be used. In this case, it is considered possible to perform the examination without instructions from an operator. In some cases, it is not necessary to assign an assistant (such as an operator). However, since it is expected that some patients will have difficulty performing the examination alone, for example, an assistant may be placed on standby at a remote location, or the assistant may monitor the examination status from a remote location. Note that the assistant (such as an operator) who sends instructions to the patient may be a personified computer system (typically an automatic response system using artificial intelligence technology).

[0072] 2 shows an example of a data structure for processing (recording, transmitting, etc.) various data acquired by the data acquisition unit 10. The data structure 100 in this example includes a blood oxygen data section 110, an auscultatory sound data section 120, an eye image data section 130, an eye blood flow data section 140, a body temperature data section 150, a heart rate data section 160, and an arbitrary data section 170.

[0073] The blood oxygen data section 110 is an area (such as a folder) in which blood oxygen data acquired by a blood oxygen measuring device in the data acquisition section 10 is recorded.

[0074] The auscultatory sound data section 120 is an area in which the auscultatory sound data acquired by the auscultatory sound measuring device in the data acquisition section 10 is recorded.

[0075] The auscultatory sound data section 120 includes a lung sound data section 121. The lung sound data section 121 is an area in which lung sound data acquired by an auscultatory sound measuring device is recorded. Note that the sub-areas provided in the auscultatory sound data section 120 are not limited to the lung sound data section 121, and may be areas in which any type of auscultatory sound data is recorded.

[0076] The eye image data section 130 is an area in which eye image data acquired by the ophthalmologic imaging device in the data acquisition section 10 is recorded. The eye image data section 130 includes a fundus image data section 131 and a color fundus image data section 132.

[0077] Image data used for, for example, analysis of the running pattern of fundus blood vessels is recorded in the fundus image data unit 131. Examples of fundus image data recorded in the fundus image data unit 131 include optical coherence tomography image data (three-dimensional image data, projection image data, optical coherence tomography angiography image data, etc.), fundus camera image data (color fundus image data, infrared fundus image data, fluorescent angiography fundus image data, etc.), scanning laser image data (color fundus image data, monochromatic fundus image data, fluorescent angiography fundus image data, etc.), and color fundus image data acquired by a slit lamp microscope.

[0078] Image data used for, for example, analysis of the color tone of the fundus is recorded in the color fundus image data unit 132. Examples of fundus image data recorded in the color fundus image data unit 132 include fundus camera image data (color fundus image data), scanning laser image data (color fundus image data), and color fundus image data acquired by a slit lamp microscope.

[0079] When the same image data is used for both the blood vessel pattern analysis and the color tone analysis, it is not necessary to record the image data in both the fundus image data section 131 and the color fundus image data section 132. For example, by recording the image data in either the fundus image data section 131 or the color fundus image data section 132 and attaching information (such as a tag) to the image data indicating that it can also be used for the purpose corresponding to the other, it becomes possible to provide a single image data for both purposes.

[0080] The ocular blood flow data section 140 is an area in which ocular blood flow data acquired by the ocular blood flow measuring device in the data acquisition section 10 is recorded. The ocular blood flow data section 140 is provided with a fundus blood flow data section 141. The fundus blood flow data section 141 records data (fundus blood flow data) that represents the blood flow dynamics in the fundus blood vessels.

[0081] The fundus blood flow data section 141 includes a waveform data section 142, a blood flow velocity data section 143, and a blood flow amount data section 144. The waveform data section 142 records waveform data that indicates a time series change in blood flow velocity acquired by blood flow measurement of the fundus artery. The blood flow velocity data section 143 records blood flow velocity data acquired by blood flow measurement of the fundus artery. The blood flow amount data section 144 records blood flow amount data acquired by blood flow measurement of the fundus artery.

[0082] Considering that waveform data is generated from blood flow velocity data at different times, blood flow velocity data at a specific time can be obtained from waveform data, and blood flow rate data is calculated from waveform data and blood flow velocity data, it is not necessary to provide all of the waveform data section 142, blood flow velocity data section 143, and blood flow rate data section 144. Typically, it is possible to configure the ocular blood flow data section 140 to record only data of a type provided to the process executed by the data processing section 20. Alternatively, for example, it may be configured to record only waveform data in the ocular blood flow data section 140, and the data processing section 20 to obtain blood flow velocity data and blood flow rate data from this waveform data.

[0083] The body temperature data section 150 is an area in which body temperature data acquired by a thermometer in the data acquisition section 10 is recorded. The heartbeat data section 160 is an area in which heartbeat data acquired by a heartbeat meter (electrocardiograph) in the data acquisition section 10 is recorded.

[0084] The arbitrary data section 170 is an area in which any type of data is recorded. For example, data acquired by an examination device other than the above-mentioned in the data acquisition section 10 may be recorded in the arbitrary data section 170. Furthermore, electronic medical record data, interview data, and the like may be recorded in the arbitrary data section 170. Furthermore, information on a patient (subject) may be recorded in the arbitrary data section 170. The patient information may include an identifier, patient background information, and the like.

[0085] The data processing unit 20 executes various data processing operations. The data processing unit 20 of this embodiment is configured to process the data acquired by the data acquisition unit 10 in order to detect a change in the state of the circulatory system associated with an infection.

[0086] Examples of circulatory system conditions (diseases, symptoms, physiological events, etc.) associated with infectious diseases include pneumonia, hypoxemia, circulatory dysfunction (cerebral blood flow abnormalities, etc.) associated with novel coronavirus disease (COVID-19), etc. This embodiment is configured to be able to detect changes in at least one of these conditions.

[0087] According to the Journal of the Japanese Society of Internal Medicine, Vol. 109, pp. 392-395 (2020), the severity distribution of COVID-19 was 80.9% mild (no pneumonia to mild pneumonia), 13.8% moderate (dyspnea, respiratory rate ≧30 breaths / min, oxygen saturation (SpO2) ≦93%, or rapid deterioration of lung shadows), 4.7% severe (respiratory failure, shock, or multiple organ failure), and 0.6% unknown. With reference to this, it is considered that oxygen saturation decreases as hypoxemia (hypoxemia associated with pneumonia) accompanying COVID-19 progresses. In this context, in this embodiment, blood oxygen data acquired by the blood oxygen measuring device in the data acquisition unit 10 can be used as an evaluation index of hypoxemia accompanying COVID-19. The same may be true for other infectious diseases.

[0088] In the case report of the Japanese Association of Infectious Diseases, "One case in which COVID-19 infection was not recognized at the time of hospitalization: "The novel coronavirus's greatest weapon is a stealth attack" - A warning to general hospitals" (Japanese Association of Infectious Diseases website: http: / / www.kansensho.or.jp / uploads / files / topics / 2019ncov / covid19_casereport_200403_2.pdf), a case is reported in which, despite being infected with the novel coronavirus disease (COVID-19), there was no significant decrease in oxygen saturation or increase in body temperature during hospitalization for observation of other diseases. The occurrence of pneumonia associated with the novel coronavirus disease (COVID-19) was confirmed by a plain chest CT scan. Meanwhile, fever and palpitations are cited as major symptoms of the novel coronavirus disease (COVID-19). In consideration of this background, in this embodiment, data other than blood oxygen data (for example, body temperature data, heart rate data, etc.) can be used as an evaluation index for pneumonia associated with the novel coronavirus disease (COVID-19). The same may be true for other infectious diseases. As noted in the case report above, data that is affected by other factors, such as body temperature data while taking antipyretics and analgesics, must be handled with care.

[0089] According to Irena Tsui et al. "Retinal Vascular Patterns in Adults with Cyanotic Congenital Heart Disease", Journal Seminars in Ophthalmology, Volume 24, 2009, Issue 6, it is known that the tortuosity of the fundus blood vessels increases with the continuation of hypoxemia. Therefore, it is expected that the vascular pattern grasped from the fundus image data will change as hypoxemia progresses. In consideration of this background, in this embodiment, the fundus image data acquired by the ophthalmologic imaging device in the data acquisition unit 10 can be used as an evaluation index for hypoxemia accompanying the novel coronavirus disease (COVID-19). The same may be true for other infectious diseases.

[0090] According to Adrian Spiteri, "The blue patient" (http: / / dx.doi.org / 10.1136 / emerged-2016-205729), it is known that hypoxemia causes changes in the color of biological tissues. This phenomenon occurs when the oxygen concentration in blood decreases, resulting in a decrease in oxyhemoglobin in arterial blood, resulting in a color similar to that of venous blood. Considering that the color change is significant in areas where capillaries are visible, such as the tongue and lips, it is expected that the color of the fundus will also change significantly. In consideration of this background, in this embodiment, the color fundus image data acquired by the ophthalmologic imaging device in the data acquisition unit 10 can be used as an evaluation index for hypoxemia associated with the novel coronavirus disease (COVID-19). The same may be true for other infectious diseases.

[0091] In the early (mild) stages of COVID-19, fever, dehydration, and hypoxemia cause the sympathetic nervous system to become dominant, resulting in increased heart rate and cardiac output, louder heart sounds, and higher blood pressure. According to Kui Liu et al., "Clinical characteristics of novel cononavirus cases in tertiary hospitals in Hubei Province," Chinese Medical Journal, 2020; Vol (No), (DOI: 10.1097 / CM9.0000000000000744), in a study of 137 patients with COVID-19, the initial symptom (early symptom) of 7.3% of patients was palpitations.

[0092] When an increase in arterial blood flow is observed in this way, it is believed that the wave form of the arterial blood flow tends to become the "Large & bounding" type of the five pulse types described in the following literature: Zhaopeng Fan et al., "Pulse Wave Analysis," Advanced Biomedical Engineering, Dr. Gaetano Gargiulo (Ed), 2011 (ISBN: 978-953-307-555-6).

[0093] On the other hand, according to Yasemin Saplakoglu, "The mysterious connection between the coronavirus and the heart," LIVE SCIENCE (https: / / www.livescience.com / how-coronavirus-affects-heart.html), as the severity of COVID-19 progresses, blood vessels expand due to inflammation throughout the body, causing a drop in blood pressure, while inflammation and hypoxia damage myocardial cells, causing a decline in cardiac function. The contractile ability of the myocardium decreases, making it impossible to pump sufficiently, causing weaker heart sounds, and a decrease in stroke volume. In this case, it is believed that the arterial blood flow waveform shape tends to be "small & weak," one of the five waveform types mentioned above. At this time, it is believed that the oxygen saturation (SpO2) further decreases.

[0094] Considering this background, in this embodiment, the ocular blood flow data acquired by the ocular blood flow measurement device in the data acquisition unit 10 and the blood oxygen data acquired by the blood oxygen measurement device can be used as evaluation indicators for symptoms accompanying the novel coronavirus disease (COVID-19). The same can be applied to other infectious diseases.

[0095] According to the following literature, it is known that abnormalities in cardiac function are reflected in the shape of the waveform representing the time series change in blood flow velocity of the retinal artery acquired by an optical coherence tomography blood flowmeter: Natsuna Minamide et al., "What we can learn from fundus blood flow measurement using optical coherence tomography (OCT)," Frontiers of Computational Science Connected by 23 Cutting-Edge Cases: Understanding and Predicting Things with Calculations (Kindai Kagakusha), Chapter 21, 2020. For example, Figure 21.6 (page 255) of the same literature shows a comparison of the retinal artery waveform of a patient with aortic stenosis (before and after treatment) with that of a normal person. In this way, the shape of the retinal artery waveform changes in diseases that cause abnormalities in cardiac output. Similarly, changes in cardiac function due to worsening infections are thought to appear in the shape of the waveform for one heartbeat acquired by an optical coherence tomography blood flowmeter. For example, a delay in the time from the start of the heartbeat to reaching its peak indicates a decrease in the contractile function of the heart. Additionally, a decrease in the area under the waveform for one heart beat indicates a decrease in cardiac output.

[0096] Considering this background, in this embodiment, the ocular blood flow data acquired by the ocular blood flow measurement device (optical coherence tomography blood flow meter) in the data acquisition unit 10 can be used as an evaluation index for cardiac dysfunction (circulatory dysfunction) associated with the novel coronavirus disease (COVID-19). The same can be said for other infectious diseases.

[0097] According to the following literature, it is known that infections change the blood flow state of intracerebral arteries (middle cerebral arteries): Haring HP et al. "Time course of cerebral blood flow velocity in central nervous system infections. A transcranial Doppler sonography study." Arch Neurol. 1993 Jan;50(1):98-101. COVID-19 can present with central nervous symptoms, resulting in a pathology similar to encephalitis (viral meningitis). In this case, systemic inflammation increases blood flow throughout the body, which is thought to increase cerebral blood flow. Considering that the ophthalmic artery branches off from the same blood vessel as the middle cerebral artery, it is highly likely that blood flow changes also occur in the ophthalmic artery and the retinal artery beyond it. Therefore, it may be possible to detect changes in cerebral blood flow associated with the worsening of infection from the blood flow velocity and blood flow volume values ​​of an optical coherence tomography blood flowmeter.

[0098] Considering this background, in this embodiment, the ocular blood flow data acquired by the ocular blood flow measurement device (optical coherence tomography blood flow meter) in the data acquisition unit 10 can be used as an evaluation index for cerebral blood flow abnormality accompanying the novel coronavirus disease (COVID-19). The same can be said for other infectious diseases.

[0099] The auscultatory sound data can be used as an evaluation index for pneumonia associated with the novel coronavirus disease (COVID-19) by applying the technology disclosed in, for example, JP2018-516616A (International Publication No. 2016 / 166318). The same can be applied to other infectious diseases.

[0100] The data processing unit 20 is configured to execute data processing based on the above findings, for example, in order to detect changes in the state of the circulatory system accompanying an infection. An example of the configuration of the data processing unit 20 of this embodiment is shown in FIG. 3. The data processing unit 20 of this embodiment includes a blood oxygen data processing unit 21, an auscultatory sound data processing unit 22, an eye image data processing unit 23, and an eye blood flow data processing unit 24. The data processing unit 20 may be configured to generate a final output based on outputs from at least two of these processing units 21 to 24.

[0101] The blood oxygen data processing unit 21 may be configured to perform inferential diagnosis regarding the state (change) of the circulatory system accompanying an infectious disease, for example, by processing the blood oxygen data recorded in the blood oxygen data unit 110 of the data structure 100 in Fig. 2 using a processor operating according to a program created at least based on the above findings regarding blood oxygen. For example, the blood oxygen data processing unit 21 can perform inferential diagnosis by comparing the oxygen saturation value indicated by the blood oxygen data with a preset threshold value.

[0102] The blood oxygen data processing unit 21 may be configured to perform an inferential diagnosis of the state (change) of the circulatory system accompanying an infectious disease by processing the blood oxygen data recorded in the blood oxygen data unit 110 using a trained model constructed by machine learning based at least on the above findings on blood oxygen, for example. This machine learning is performed using training data including clinically collected blood oxygen data and corresponding diagnostic result data. This diagnostic result data is obtained by a doctor or another inference model (trained model) based on the related blood oxygen data, for example. The constructed trained model receives the blood oxygen data recorded in the blood oxygen data unit 110 as an input and outputs estimated diagnostic data on the state (change) of the circulatory system accompanying an infectious disease.

[0103] The auscultatory sound data processing unit 22 may be configured to perform inferential diagnosis regarding the state (change) of the circulatory system accompanying an infectious disease, for example, by processing auscultatory sound data (for example, lung sound data recorded in the lung sound data unit 121) recorded in the auscultatory sound data unit 120 of the data structure 100 in Fig. 2 using a processor operating according to a program created based at least on the above-mentioned findings regarding auscultatory sounds (breath sounds, heart sounds, etc.). For example, the auscultatory sound data processing unit 22 can perform inferential diagnosis based on the waveform characteristics (sound profile) indicated by the auscultatory sound data.

[0104] The auscultatory sound data processing unit 22 may be configured to perform an inferential diagnosis of the state (change) of the circulatory system accompanying an infectious disease by processing the auscultatory sound data recorded in the auscultatory sound data unit 120 (e.g., lung sound data recorded in the lung sound data unit 121) using a trained model constructed by machine learning based at least on the above-mentioned knowledge of auscultatory sounds (breath sounds, heart sounds, etc.). This machine learning is performed using training data including clinically collected auscultatory sound data and corresponding diagnostic result data. This diagnostic result data is obtained by a doctor or another inference model (trained model) based on the related auscultatory sound data. The constructed trained model receives the auscultatory sound data recorded in the auscultatory sound data unit 120 (e.g., lung sound data recorded in the lung sound data unit 121) as input and outputs estimated diagnostic data of the state (change) of the circulatory system accompanying an infectious disease.

[0105] The eye image data processing unit 23 may be configured to perform inferential diagnosis regarding a state (change) of the circulatory system accompanying an infectious disease, for example, by processing the eye image data recorded in the eye image data unit 130 of the data structure 100 in Fig. 2 (for example, the fundus image data recorded in the fundus image data unit 131 and / or the color fundus image data recorded in the color fundus image data unit 132) by a processor operating according to a program created at least based on the above findings regarding eye images (such as fundus images). For example, the eye image data processing unit 23 can perform inferential diagnosis based on the characteristics of the eye image data (for example, the degree of vascular curvature, color information, etc.).

[0106] The eye image data processing unit 23 may be configured to perform an inferential diagnosis of a state (change) of the circulatory system accompanying an infectious disease by processing the eye image data recorded in the eye image data unit 130 (e.g., the fundus image data recorded in the fundus image data unit 131 and / or the color fundus image data recorded in the color fundus image data unit 132) using a trained model constructed by machine learning based at least on the above knowledge of eye images (such as fundus images). This machine learning is performed using training data including, for example, clinically collected eye image data and diagnostic result data corresponding thereto. This diagnostic result data is obtained, for example, by a doctor or another inference model (trained model) based on the related eye image data. The constructed trained model receives the eye image data recorded in the eye image data unit 130 (e.g., the fundus image data recorded in the fundus image data unit 131 and / or the color fundus image data recorded in the color fundus image data unit 132) as input, and outputs estimated diagnostic data of a state (change) of the circulatory system accompanying an infectious disease.

[0107] An example of the eye image data processing unit 23 configured using machine learning is shown in Fig. 4. The eye image data processing unit 23 in this example includes an inference processing unit 230. As described above, the inference processing unit 230 is configured to execute an inference process for deriving information on changes in the state of the circulatory system from the eye image data acquired from the patient by the data acquisition unit 10, using a learned model constructed by machine learning using training data including clinical data (eye image data and diagnosis result data).

[0108] By machine learning (supervised learning) based on such training data, a trained model (inference model) is created that takes eye image data acquired from the patient by the data acquisition unit 10 as input and outputs estimated diagnostic data regarding changes in the condition of the circulatory system.

[0109] The inference processing unit 230 includes the trained model obtained in this manner, inputs the eye image data acquired from the patient by the data acquisition unit 10 into the trained model, and sends the estimated diagnostic data output from the trained model to the output unit 30.

[0110] Machine learning algorithms that can be used in the exemplary embodiments are not limited to supervised learning, but may be any algorithm, such as unsupervised learning, semi-supervised learning, reinforcement learning, transduction, multi-task learning, etc., or may be a combination of any two or more algorithms.

[0111] Any machine learning technique may be used in the exemplary embodiments, such as, for example, any technique such as neural networks, support vector machines, decision tree learning, association rule learning, genetic programming, clustering, Bayesian networks, representation learning, extreme learning machines, or a combination of any two or more techniques.

[0112] 5 shows an example of the configuration of the inference processing unit 230. The inference processing unit 230 of this example includes a first trained model 231 and a second trained model 232.

[0113] The first trained model 231 is constructed by machine learning using training data including fundus image data and diagnosis result data. For example, the first trained model 231 includes a convolutional neural network. This convolutional neural network includes, for example, an input layer to which fundus image data is input, a convolutional layer that applies filtering (convolution) to the input fundus image data to create a feature map related to the curvature of blood vessels, a pooling layer that compresses data while retaining the features obtained in the convolutional layer, a fully connected layer that extracts and judges characteristic findings from all data obtained in the pooling layer, and an output layer that outputs data obtained in the fully connected layer. By inputting fundus image data acquired from a patient by the data acquisition unit 10 into the first trained model 231, information on changes in the state of the circulatory system taking into account the curvature of blood vessels is generated. By using such a first trained model 231, the data processing unit 20 can detect changes in the state of the circulatory system based on the running pattern of blood vessels depicted in the fundus image data of the patient.

[0114] In addition, the blood vessel features are not limited to the running pattern. For example, in order to obtain information on the change in the state of the circulatory system, the change in blood vessel diameter (expansion / contraction) can be taken into consideration. The blood vessel diameter can be obtained, for example, by analyzing fundus image data or optical coherence tomography image data. For blood vessel diameter measurement, for example, the technology described in JP 2016-43155 A, JP 2020-48730 A, etc. can be used.

[0115] The second trained model 232 is constructed by machine learning using training data including color fundus image data and diagnosis result data. For example, the second trained model 232 includes a convolutional neural network. This convolutional neural network includes, for example, an input layer to which color fundus image data is input, a convolutional layer that applies filtering (convolution) to the input color fundus image data to create a feature map related to color information (e.g., R value, G value, B value), a pooling layer that compresses data while retaining features obtained in the convolutional layer, a fully connected layer that extracts and judges characteristic findings from all data obtained in the pooling layer, and an output layer that outputs data obtained in the fully connected layer. By inputting color fundus image data acquired from a patient by the data acquisition unit 10 into the second trained model 232, information on changes in the state of the circulatory system taking into account the color tone of the fundus is generated. By using such a second trained model 232, the data processing unit 20 can detect changes in the state of the circulatory system based on color information in the color fundus image data of the patient.

[0116] A trained model for processing types of data other than eye image data may have a similar configuration. When processing time-series data such as waveform data, follow-up observation data, video data, and audio data, the trained model may include a recurrent neural network. In addition, the training data used in the machine learning may include computer-generated data based on clinical data. In addition, the machine learning may include transfer learning.

[0117] The ocular blood flow data processing unit 24 may be configured to perform inferential diagnosis regarding the state (change) of the circulatory system accompanying an infection by processing the ocular blood flow data (e.g., at least one of the waveform data recorded in the waveform data unit 142, the blood flow velocity data recorded in the blood flow velocity data unit 143, and the blood flow rate data recorded in the blood flow rate data unit 144) recorded in the ocular blood flow data unit 140 of the data structure 100 in Fig. 2 by a processor operating according to a program created at least based on the above-mentioned findings regarding ocular blood flow (such as fundus blood flow). For example, the ocular blood flow data processing unit 24 can perform inferential diagnosis based on the characteristics of the ocular blood flow data (e.g., parameters indicating the characteristics of the waveform).

[0118] The ocular blood flow data processing unit 24 may be configured to perform an inference diagnosis regarding a state (change) of the circulatory system accompanying an infection by processing the ocular blood flow data recorded in the ocular blood flow data unit 140 (e.g., at least one of the waveform data recorded in the waveform data unit 142, the blood flow velocity data recorded in the blood flow velocity data unit 143, and the blood flow rate data recorded in the blood flow rate data unit 144) using a trained model constructed by machine learning based at least on the above-mentioned knowledge regarding ocular blood flow (such as fundus blood flow). This machine learning is performed using training data including, for example, clinically collected ocular blood flow data and corresponding diagnosis result data. This diagnosis result data is obtained, for example, by a doctor or another inference model (trained model) based on the related ocular blood flow data. The constructed trained model takes as input the ocular blood flow data recorded in the ocular blood flow data section 140 (e.g., at least one of the waveform data recorded in the waveform data section 142, the blood flow velocity data recorded in the blood flow velocity data section 143, and the blood flow rate data recorded in the blood flow rate data section 144), and outputs estimated diagnostic data regarding the state (changes) of the circulatory system accompanying an infectious disease.

[0119] When the fundus blood flow data includes waveform data, the data processor 20 can detect a change in the state of the circulatory system based on the waveform data. In this process, typically, parameters indicating the characteristics of the waveform are taken into consideration.

[0120] When two or more waveform data obtained from a patient during two or more different periods are included in the fundus blood flow data (for example, two or more waveform data are obtained by follow-up observation), the data processor 20 can detect changes in the state of the circulatory system by comparing these waveform data. This process typically takes into account changes in parameters that indicate the characteristics of the waveform.

[0121] When the fundus blood flow data includes either or both of blood flow velocity data and blood flow volume data in the fundus artery of the patient, the data processing unit 20 can detect a change in the state of the circulatory system based on either or both of the blood flow velocity data and blood flow volume data. In this process, the magnitude of the value is typically taken into consideration.

[0122] When the fundus blood flow data includes two or more blood flow velocity data obtained from a patient during two or more different periods (for example, when two or more blood flow velocity data are obtained by follow-up observation), the data processing unit 20 can detect a change in the state of the circulatory system by comparing these blood flow velocity data. In this process, typically, a change in the value of the blood flow velocity is taken into consideration.

[0123] When two or more blood flow data obtained from a patient during two or more different periods are included in the fundus blood flow data (for example, two or more blood flow data are obtained by follow-up observation), the data processing unit 20 can detect a change in the state of the circulatory system by comparing these blood flow data. In this process, typically, a change in the value of the blood flow is taken into consideration.

[0124] Similarly, other types of data (body temperature data, heart rate data, blood pressure data, etc.) can be processed using a processor operating according to a program created at least based on the corresponding knowledge and / or a trained model constructed by machine learning based at least on the corresponding knowledge.

[0125] According to the data processing unit 20 of this embodiment having such a configuration, it is possible to detect, as changes in the state of the circulatory system accompanying an infectious disease, the onset of pneumonia, changes in the state of pneumonia (becoming severe, mild, or asymptomatic), the onset of hypoxemia, changes in the state of hypoxemia (becoming severe, mild, or asymptomatic), and changes in the state of cerebral blood flow (becoming severe, mild, or asymptomatic). Note that the data processing unit 20 may be configured to be capable of detecting other changes in state accompanying an infectious disease, or may be configured to be capable of detecting any change in state (regardless of whether it is related to an infectious disease).

[0126] Furthermore, the target (disease, symptom, etc.) of the inference diagnosis performed by the data processing unit 20 may be any. For example, the data processing unit 20 may be configured to perform inference processing related to pneumonia. More specifically, the data processing unit 20 may be configured to perform inference processing for determining the probability that the target patient has pneumonia (pneumonia probability), the probability that the target patient has an infectious disease accompanied by pneumonia (infectious disease probability), the inference processing for determining the severity of pneumonia in the target patient (pneumonia severity), the inference processing for determining the severity of an infectious disease accompanied by pneumonia in the target patient (infectious disease severity), and the like.

[0127] The infectious disease accompanied by pneumonia may be, for example, COVID-19. The severity of the infectious disease accompanied by pneumonia may be, for example, related to any symptom (cytokine storm, fever, conjunctival congestion, nasal congestion, headache, cough, sore throat, phlegm, bloody phlegm, fatigue, shortness of breath, nausea, vomiting, diarrhea, muscle pain, joint pain, chills, etc.), or related to any underlying disease (diabetes, heart failure, respiratory disease (chronic obstructive pulmonary disease (COPD) etc.), application of artificial dialysis, administration of specific drugs (immunosuppressants, anticancer drugs, etc.), etc.).

[0128] The output unit 30 outputs the results of the processing executed by the data processing unit 20. The mode of the output processing is arbitrary, and may be, for example, any of transmission, display, recording, and printing. The information output by the output unit 30 may be the result itself of the processing executed by the data processing unit 20 (detection result of a change in the state of the circulatory system accompanying an infection), information including the processing result, or information obtained by processing the processing result. For example, the medical system 1 may further include a report creation unit (not shown) that creates a report based on the detection result of the change in the state of the circulatory system obtained by the data processing unit 20. In this case, the output unit 30 can output the created report.

[0129] 1 shows a configuration example of the output unit 30. The output unit 30 in this example includes a transmission unit 31. The transmission unit 31 transmits the results of the processing executed by the data processing unit 20 to the doctor terminal 3 located remotely from the data acquisition unit 10.

[0130] Here, the transmission from the output unit 30 to the doctor terminal 3 may be direct transmission or indirect transmission. Direct transmission is a mode in which the processing results (detection results, reports, etc.) are transmitted from the output unit 30 to the doctor terminal 3. Indirect transmission is a mode in which the processing results are transmitted to a device (server, database, etc.) other than the doctor terminal 3 and the processing results are provided to the doctor terminal 3 via that device.

[0131] In this way, by placing the doctor terminal 3 in a remote location relative to the data acquisition unit 10 and configuring the data processing unit 20 to provide the doctor terminal 3 with the processing results (or information based thereon) acquired based on the data acquired from the patient by the data acquisition unit 10, social distance can be ensured between the doctor (medical worker) and the patient, thereby making it possible to reduce the risk of infection for the doctor (medical worker).

[0132] <Medical system usage patterns> An example of a usage pattern of the medical system 1 according to the exemplary embodiment will be described with reference to the flowchart of FIG.

[0133] (S1: Build a trained model) In preparation for operation of the medical system 1, a trained model to be used in the data processing unit 20 is constructed. Note that the processing performed at this stage may be updating (adjusting and updating parameters) of a trained model that has already been in operation.

[0134] (S2: Load the trained model into the data processing unit) As a further preparation for the operation of the medical system 1, the trained model constructed in step S1 is loaded into the data processing unit 20. In this process, for example, the trained model constructed in step S1 is transmitted to the medical system 1 through a communication line.

[0135] (S3: Acquire data from the patient) The subject may be, for example, a patient who has been definitively diagnosed with COVID-19 or a patient who is suspected of COVID-19. The data acquisition unit 10 of the medical system 1 acquires predetermined items of data from the patient. In this embodiment, the data acquisition unit 10 acquires at least two of blood oxygen data, auscultatory sound data, eye image data, and eye blood flow data from the patient. In addition to these types of data, any type of data, such as body temperature data, heart rate data, blood pressure data, and eye characteristic data, can be acquired from the patient.

[0136] At least a part of the inspection carried out in this step may be a remote inspection using the operation device 2.

[0137] The acquired data is recorded, for example, according to the data structure 100 of Figure 2. This results in a data package for the patient.

[0138] In this manner, in this embodiment, two or more types of data are acquired from the patient, but the timing of acquiring these data is arbitrary. For example, the second data may be acquired after the first data is acquired, the first data may be acquired after the second data is acquired, or the first data may be acquired in parallel with the acquisition of the second data.

[0139] The difference (time difference) in the timing of acquiring two or more types of data is also arbitrary. For example, when acquiring at least fundus blood flow data and heart rate data, since there is originally a time lag between the state of fundus blood flow and the state of heart rate, it is not necessary to acquire both at the same time, and a time difference of, for example, about 10 minutes may be acceptable. However, it is considered desirable that the conditions (posture, etc.) that affect the state of blood circulation are the same when acquiring both types of data. The same applies to conditions (meals, time of day, drug administration, etc.) that affect other examination parameters.

[0140] (S4: Input data into the data processing unit) The data acquired in step S3 is sent to the data processing unit 20. At least a part of the data input to the data processing unit 20 is input to the trained model constructed in step S1.

[0141] (S5: Generate detection data of changes in the circulatory system status) The data processing unit 20 detects changes in the state of the circulatory system accompanying an infectious disease by processing the data input in step S4. As a result, the data processing unit 20 generates, for example, data indicating the onset of pneumonia, data indicating a change in the state of pneumonia, data indicating the onset of hypoxemia, data indicating a change in the state of hypoxemia, data indicating a change in the state of cerebral blood flow, etc. The data generated in this step is called detection data.

[0142] (S6: Create a report) The medical system 1 (the aforementioned report creation unit, not shown) creates a report based on the detection data created in step S5.

[0143] (S7: Send report) The transmission unit 31 of the output unit 30 transmits the report created in step S6 to the doctor terminal 3 located remotely from the data acquisition unit 10, or to a computer capable of providing information to the medical terminal 3. The doctor terminal 3 is not limited to a computer used by a doctor, and may be a computer (medical worker terminal) used by a medical worker other than a doctor.

[0144] Such a medical system 1 can ensure social distancing between medical staff and patients, and reduce the risk of infection from patients to medical staff. Furthermore, the medical system 1 is configured to automatically perform diagnostic inference based on at least two of the blood oxygen data, auscultatory sound data, eye image data, and eye blood flow data, making it possible to detect symptoms associated with infectious diseases and signs of aggravation with higher accuracy than conventional techniques.

[0145] In addition, the examinations performed in the medical system of some exemplary embodiments are non-invasive. For example, the following devices exemplified as examination devices that can be used in the medical system 1 are all devices that acquire data from a patient non-invasively: a pulse oximeter, an electronic stethoscope, an optical coherence tomography device, a fundus camera (in the case of a non-mydriatic type), a slit lamp microscope, a scanning laser ophthalmoscope, a laser speckle flowgraphy, a thermometer, a heart rate / electrocardiogram, a blood flow meter, a respiratory monitoring system, a blood pressure monitor, an eye refraction measuring device, a tonometer, a specular microscope, a wavefront analyzer, a visual acuity testing device, a perimeter, a microperimeter, an axial length measuring device, an electroretinogram testing device, a binocular vision function testing device, and a color vision testing device. Non-invasive examination devices that can be used in the medical system of exemplary embodiments are not limited to these. Note that at least some of the examination devices (for example, a mydriatic type fundus camera) may be invasive.

[0146] <Medical information processing device> An example of a medical information processing device according to an exemplary embodiment will be described below. An exemplary medical information processing device 5 shown in FIG.

[0147] A data acquisition system 6, an operation device 7, and a doctor terminal 8 are provided outside the medical information processing device 5 of this embodiment.

[0148] The data acquisition system 6 is configured to acquire at least two of blood oxygen data, auscultatory sound data, eye image data, and eye blood flow data from the patient. The data acquisition system 6 may be further configured to acquire either one or both of body temperature data and heart rate data from the patient.

[0149] At least a part of the configuration of the data acquisition system 6 may be the same as at least a part of the data acquisition unit 10 of the above-described medical system 1. Any of the items described for the data acquisition unit 10 may be combined with the data acquisition system 6. The data acquired by the data acquisition system 6 may be recorded according to, for example, a data structure 100 shown in FIG. 2.

[0150] The operation device 7 is used by a medical professional to remotely operate the data acquisition system 6 (examination device). The operation device 7 includes, for example, a computer, an operation panel, and the like. At least a part of the configuration of the operation device 7 may be the same as at least a part of the operation device 2 described above. Any of the items described for the operation device 2 can be combined with the operation device 7.

[0151] The doctor terminal 8 is located at a remote location relative to the data acquisition system 6. At least a part of the configuration of the doctor terminal 8 may be the same as at least a part of the doctor terminal 3 described above. Any of the items described for the doctor terminal 3 can be combined with the doctor terminal 8.

[0152] The data receiving unit 51 is configured to receive at least two of the blood oxygen data, auscultatory sound data, eye image data, and eye blood flow data obtained from a patient. In the example of Fig. 7, data is input from the data acquisition system 6 to the data receiving unit 51, but this is not limiting. For example, the data acquired by the data acquisition system 6 may be stored in a database or the like, and the data may be input from the database to the data receiving unit 51. The data receiving unit 51 may include, for example, a communication device for connecting to a communication line, a drive device for reading out data recorded on a recording medium, and the like.

[0153] The data processing unit 52 is configured to process at least two pieces of data accepted by the data accepting unit 51 in order to detect changes in the state of the circulatory system accompanying an infection. At least a part of the configuration of the data processing unit 52 may be the same as at least a part of the data processing unit 20 of the medical system 1 described above. Any of the items described for the data processing unit 20 can be combined with the data processing unit 52.

[0154] The output unit 53 outputs the result of the processing executed by the data processing unit 52. The output unit 53 in this example includes a transmission unit 54. The transmission unit 54 transmits the result of the processing executed by the data processing unit 52 to the doctor terminal 8 located remotely from the data acquisition system 6. At least a part of the configuration of the output unit 53 may be the same as at least a part of the output unit 30 of the medical system 1 described above. Any of the items described for the output unit 30 can be combined with the output unit 53. Similarly, at least a part of the configuration of the transmission unit 54 may be the same as at least a part of the transmission unit 41 of the medical system 1 described above, and any of the items described for the transmission unit 41 can be combined with the transmission unit 54.

[0155] Any of the items described above regarding the medical system 1 can be combined with the medical information processing device 5.

[0156] Such a medical information processing device 5 can ensure social distance between medical staff and patients and reduce the risk of infection from patients to medical staff. Furthermore, the medical information processing device 5 is configured to automatically perform diagnostic inference based on at least two of the blood oxygen data, auscultatory sound data, eye image data, and eye blood flow data, making it possible to detect symptoms associated with infectious diseases and signs of aggravation with higher accuracy than conventional techniques. [Explanation of symbols]

[0157] 1. Healthcare system 2 Control device 3. Doctor's terminal 10 Data Acquisition Section 20 Data Processing Section 21 Blood oxygen data processing unit 22 Auscultatory sound data processing unit 23 Eye image data processing unit 230 Inference processing unit 231 First trained model 232 Second trained model 24 Ocular blood flow data processing unit 30 Output section 31 Transmitter 100 Data Structures 110 Blood Oxygen Data Section 120 Auscultatory Sound Data Section 130 Eye image data unit 140 Eye Blood Flow Data Section

Claims

1. A data acquisition unit that acquires at least two pieces of data from a patient, the data including at least one of blood oxygen data, auscultatory sound data, and ocular blood flow data, and eye image data; a data processing unit that processes the at least two pieces of data acquired by the data acquisition unit in order to detect a change in the state of the circulatory system associated with an infection; Including, The eye image data includes fundus image data depicting a fundus of the patient, the data processing unit detects a change in a state of the circulatory system based on a running pattern of blood vessels depicted in the fundus image data; Furthermore, the data processing unit includes an inference processing unit that executes an inference process to derive information regarding a change in a state of the circulatory system from the fundus image data acquired by the data acquisition unit, using a trained model constructed by machine learning using training data including fundus image data and diagnosis result data based on the fundus image data, and detects a change in a state of the circulatory system based on the information derived by the inference processing unit. Healthcare system.

2. The fundus image data includes at least one of fundus camera image data, slit lamp image data, optical coherence tomography image data, and scanning laser image data. The medical system of claim 1.

3. A data receiving unit that receives at least two pieces of data including at least one of blood oxygen data, auscultatory sound data, and ocular blood flow data acquired from a patient, and eye image data; a data processing unit that processes the at least two pieces of data received by the data receiving unit in order to detect a change in a state of the circulatory system associated with an infection; Including, The eye image data includes fundus image data depicting a fundus of the patient, the data processing unit detects a change in a state of the circulatory system based on a running pattern of blood vessels depicted in the fundus image data; Furthermore, the data processing unit includes an inference processing unit that executes an inference process to derive information regarding a change in a state of the circulatory system from the fundus image data accepted by the data accepting unit, using a trained model constructed by machine learning using training data including fundus image data and diagnosis result data based on the fundus image data, and detects a change in a state of the circulatory system based on the information derived by the inference processing unit. Medical information processing device.

Images