Medical information processing device, medical information processing system and medical information processing method

Abstract

To enable a risk level indicated by an inspection result of a biological inspection to be easily grasped.SOLUTION: A medical information processing device according to an embodiment includes: an acquisition part for acquiring inspection data including an inspection value of a biological inspection performed on the same object person at a plurality of time points; a map creation part for creating a map on the basis of the inspection data, and in the map part, the map includes a time series element group in which a plurality of elements corresponding to the biological inspection performed at the plurality of time points and having a display mode corresponding to a degree of a risk are arranged in a time-series order along a first direction; and a display control part for controlling a display part so as to display the map.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The embodiments disclosed in this specification and the drawings relate to a medical information processing apparatus, a medical information processing system, and a medical information processing method. [Background technology]

[0002] Tests (biological tests) using biomarkers are being conducted as indicators of changes in disease condition and the effectiveness of treatment. Biomarkers are substances such as proteins that are measured in bodily fluids such as blood, and the presence and progression of a disease are reflected in their concentration. For example, biomarkers are proteins or genes whose blood concentration changes to reflect the presence and progression of various types of cancer, such as breast cancer and colon cancer.

[0003] In recent years, liquid biopsy (LB) has become known, which uses bodily fluids such as blood and urine to diagnose lesions and predict the effectiveness of treatment. Liquid biopsy is a technology that detects specific proteins from blood and uses them as biomarkers to detect cancer and other diseases early and measure the effectiveness of treatment with drugs. Compared to conventional tissue biopsies, liquid biopsy has the advantage of being able to be performed repeatedly without putting a strain on the body.

[0004] However, the relationship between the test value and the risk level varies depending on the type of biomarker. That is, for some biomarkers, the higher the test value, the higher the risk, and for other biomarkers, the lower the test value, the higher the risk. For this reason, it is not easy to understand the risk level just by looking at the test value of the biomarker. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2021-176424 A Summary of the Invention [Problem to be solved by the invention]

[0006] One of the problems to be solved by the embodiments disclosed in this specification and the drawings is to make it possible to easily understand the risk level indicated by the test results of a biological test. However, the problems to be solved by the embodiments disclosed in this specification and the drawings are not limited to the above problem. Problems corresponding to the effects of each configuration shown in the embodiments described later can also be positioned as other problems. [Means for solving the problem]

[0007] A medical information processing device according to an embodiment includes an acquisition unit that acquires test data including test values ​​from biological tests performed on the same subject at multiple time points, a map creation unit that creates a map based on the test data, the map including a group of time series elements in which a plurality of elements corresponding to the biological tests performed at the multiple time points and having display modes according to the degree of risk are arranged in chronological order along a first direction, and a display control unit that controls a display unit to display the map. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing an example of the configuration of a medical information processing system according to an embodiment. [Diagram 2] FIG. 1 is a block diagram showing an example of the configuration of a medical image processing apparatus according to a first embodiment. [Diagram 3] FIG. 1 is a block diagram showing an example of the configuration of a medical information storage device according to a first embodiment. [Figure 4] FIG. 4 is a diagram showing an example of a patient information DB according to the embodiment. [Diagram 5] FIG. 2 is a diagram showing an example of a biomarker DB according to the embodiment. [Figure 6] FIG. 2 is a view showing an example of a medical image DB according to the embodiment. [Figure 7] FIG. 1 is a diagram showing an example of the order of biomarker testing and imaging (mammography). [Figure 8]FIG. 11 is a flowchart illustrating an example of a method for creating a heat map. [Figure 9] A diagram to explain the risk levels of test values ​​for each biomarker. [Figure 10] FIG. 13 is a diagram showing an example of a heat map according to the embodiment. [Figure 11] FIG. 2 is a view showing an example of an output screen of the medical image processing apparatus according to the first embodiment. [Figure 12] FIG. 2 is a view showing an example of an output screen of the medical image processing apparatus according to the first embodiment. [Figure 13] FIG. 2 is a view showing an example of an output screen of the medical image processing apparatus according to the first embodiment. [Figure 14] FIG. 2 is a view showing an example of an output screen of the medical image processing apparatus according to the first embodiment. [Figure 15] FIG. 2 is a view showing an example of an output screen of the medical image processing apparatus according to the first embodiment. [Figure 16] FIG. 2 is a view showing an example of an output screen of the medical image processing apparatus according to the first embodiment. [Figure 17] FIG. 2 is a view showing an example of an output screen of the medical image processing apparatus according to the first embodiment. [Figure 18] FIG. 2 is a view showing an example of an output screen of the medical image processing apparatus according to the first embodiment. [Figure 19] FIG. 2 is a view showing an example of an output screen of the medical image processing apparatus according to the first embodiment. [Figure 20] FIG. 2 is a view showing an example of an output screen of the medical image processing apparatus according to the first embodiment. [Figure 21] FIG. 2 is a view showing an example of an output screen of the medical image processing apparatus according to the first embodiment. [Figure 22] FIG. 11 is a block diagram showing an example of the configuration of a medical image processing apparatus according to a second embodiment. [Diagram 23] FIG. 11 is a view showing an example of an output screen of the medical image processing apparatus according to the second embodiment. [Figure 24] FIG. 11 is a view showing an example of an output screen of the medical image processing apparatus according to the second embodiment. [Diagram 25] FIG. 11 is a view showing an example of an output screen of the medical image processing apparatus according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, embodiments of a medical information processing device, a medical information processing system, and a medical information processing method will be described with reference to the drawings. In the following description, components having substantially the same functions and configurations are denoted by the same reference numerals, and duplicated descriptions will be given only when necessary.

[0010] <Medical information processing system> A medical information processing system 1 common to each embodiment will be described with reference to Fig. 1. The medical information processing system 1 includes a medical information processing device 10 (10A), a medical information storage device 20, and a medical imaging device 30. Each device is communicatively connected via a communication network N. The configuration and protocol of the communication network N are not particularly limited. The communication network N may be an in-hospital network, or may include a public network such as the Internet.

[0011] The medical information processing device 10 is configured to display the results of a plurality of tests performed on a subject of examination such as a patient (hereinafter, simply referred to as a "subject"). Details of the medical information processing device 10 will be described later with reference to FIG.

[0012] The medical information storage device 20 stores test data including test values ​​of biological tests performed on the same subject at multiple points in time. As will be described in detail later with reference to Fig. 3, the medical information storage device 20 is configured to store information on the subject (patient information), medical images captured by the medical imaging device 30, and test values ​​of biomarker tests (liquid biopsy tests, etc.). The medical images are, for example, image data obtained from a mammography device, an X-ray CT (Computed Tomography) device, an MRI (Magnetic Resonance Imaging) device, etc.

[0013] When the medical information storage device 20 receives a request from the medical information processing device 10, it provides the stored information to the medical information processing device 10.

[0014] The medical imaging device 30 is a device that performs an examination by photographing a subject, such as a mammography device, but may also be another imaging device such as an X-ray CT device, an MRI device, or an ultrasound diagnostic device.

[0015] <Medical information processing device (first embodiment)> The medical image processing apparatus 10 according to the first embodiment will be described in detail with reference to FIG.

[0016] 2, the medical information processing device 10 includes a memory 11, an input interface 12, an output interface 13, a communication interface 14, and a processing circuit 15. Each component will be described in detail below.

[0017] The memory 11 is connected to the processing circuit 15 and stores various types of information used by the processing circuit 15. The memory 11 is realized by, for example, a semiconductor memory element such as a random access memory (RAM) or a flash memory, a hard disk, an optical disk, or the like. The memory 11 stores various programs required for the processing circuit 15 to execute each function, various types of data processed by the programs, and the like. Note that the various types of data handled in this specification are typically digital data.

[0018] The input interface 12 accepts various operations by a user such as a doctor, converts the accepted operations into electrical signals, and outputs the electrical signals to the processing circuitry 15. This input interface 12 is realized by, for example, a mouse, a keyboard, a touch panel, a trackball, a manual switch, a foot switch, a button, a joystick, or the like.

[0019] The output interface 13 presents medical information such as various test results to a user of the medical information processing device 10. The output interface 13 includes a display unit such as a liquid crystal display, and displays information such as images. In detail, the output interface 13 displays test values ​​of a liquid biopsy test (LB test), medical images such as mammograms, and a GUI (Graphical User Interface) that accepts user operations. The output interface 13 may have an audio output means (speaker) and output the information presented to the user as audio.

[0020] The communication interface 14 communicates with other devices (such as the medical information storage device 20) via a communication network in accordance with various communication protocols.

[0021] The processing circuit 15 is an arithmetic circuit that performs various calculations and controls the operation of the medical information processing device 10. The processing circuit 15 has an operation reception function 151, a data acquisition function 152, a heat map creation function 153, a display control function 154, and a related BM extraction function 155. The operation reception function 151 is an example of an operation reception unit, the data acquisition function 152 is an example of an acquisition unit, the heat map creation function 153 is an example of a map creation unit, the display control function 154 is an example of a display control unit, and the related BM extraction function 155 is an example of an extraction unit.

[0022] In this embodiment, each processing function executed by the operation reception function 151, the data acquisition function 152, the heat map creation function 153, the display control function 154, and the related BM extraction function 155 is stored in the memory 11 in the form of a program executable by a computer. The processing circuit 15 is configured with a processor, and realizes the function corresponding to each program by reading and executing the program from the memory 11. In other words, the processing circuit 15 in a state in which each program has been read has each function shown in the processing circuit 15 of FIG.

[0023] 2 shows a case where each of the processing functions of the operation reception function 151, the data acquisition function 152, the heat map creation function 153, the display control function 154, and the related BM extraction function 155 is realized by a single processing circuit 15, but the embodiment is not limited to this. For example, the processing circuit 15 may be configured as a combination of multiple independent processors, and each processor may execute each program to realize each processing function. Each processing function of the processing circuit 15 may be appropriately distributed or integrated and realized in a single or multiple processing circuits.

[0024] Next, each processing function of the processing circuit 15 will be described in detail.

[0025] The operation reception function 151 receives operations input by a user (such as a doctor) of the medical information processing device 10 via the input interface 12. Specifically, it receives operations on the GUI (such as buttons, pull-down menus, tabs, etc.) displayed on the display unit of the output interface 13. For example, the operation reception function 151 receives a selection operation on one or more elements of a heat map displayed on the output interface 13.

[0026] The data acquisition function 152 acquires the test results (test values) of biological tests such as LB tests. The data acquisition function 152 acquires the test values ​​of a patient designated by a user from the medical information storage device 20. Here, the "biological test" refers to a test using a biomarker (biomarker test). The biomarker test may be a test using liquid biopsy (LB test).

[0027] The test values ​​acquired by the data acquisition function 152 may be the test results of biological tests performed at multiple time points. Here, "time point" does not mean the strict time at which the test was performed, but may be, for example, the test date. Furthermore, the data acquisition function 152 may acquire test values ​​of not only one type of biological test, but also multiple types of biological tests. In this case, the biological tests were performed at the same multiple time points, but do not have to be performed on the strictly same test date.

[0028] In this manner, the data acquisition function 152 acquires test data (time-series data) including test values ​​of one or more types of biological tests performed on the same subject at multiple time points.

[0029] The heat map creation function 153 creates a heat map for grasping the degree of risk (disease risk) for each biomarker based on the test data. A method for creating a heat map will be described later with reference to Figs. 7 to 10. The heat map is also simply called a map.

[0030] The display control function 154 controls the output interface 13 to display a GUI, etc. For example, the display control function 154 displays a heat map, etc. created by the heat map creation function 153, on the output interface 13. The display control function 154 may control another information processing device (not shown) connected to the medical information processing device 10 via the communication network N to display a heat map, etc.

[0031] The display control function 154 obtains information regarding which element of the multiple elements constituting the heat map has been selected by the user from the operation reception function 151. Then, the display control function 154 controls the output interface 13 to display medical-related information related to the selected element or elements.

[0032] The medically relevant information may be, for example, a graph (time course) of test values ​​of a biological test corresponding to the selected one or more elements. The medically relevant information may also be a fluorescent microscopy image or a Venn diagram of co-localization of a biological test corresponding to the selected one or more elements.

[0033] The medical-related information may be a medical image (such as a mammography image, an ultrasound image, a CT image, or an MRI image) captured at the same time as the biological test of the selected element. In this case, the display control function 154 may cause the output interface 13 to display an enlarged image of a suspected area (such as an area suspected of cancer) in the medical image and / or image findings based on the medical image.

[0034] The related BM extraction function 155 extracts types of biological tests (biomarkers) that are highly related to subtypes or drugs (treatment effects) specified by the user. The extraction process may use a database that associates and stores highly related biomarkers for each subtype (or drug), or may use a trained model obtained by machine learning the relationship between them. The related BM extraction function 155 can also extract highly related subtypes or drugs from the type of biomarker by using the above database or trained model with input and output interchanged.

[0035] In addition, the associated BM extraction function 155 may extract one or more biomarkers that are highly associated with the disease subgroup to which the patient belongs from among multiple types of biological tests that the patient has undergone, based on medical images and / or patient information.

[0036] When the types of highly related biological tests are extracted as described above, the heat map creation function 153 rearranges the multiple time series element groups so that the time series element groups corresponding to the extracted biological tests are grouped. This makes it possible to display a heat map bundling the test results of highly related biological tests. The display control function 154 may control the output interface 13 to display the time series element groups corresponding to the extracted biological tests at the top of the heat map, or to display only the time series element groups corresponding to the extracted biological tests.

[0037] The subtype is, for example, a subtype of breast cancer, which is a classification of breast cancer according to the genetic characteristics of breast cancer cells. Subtypes of breast cancer include papillary ductal carcinoma, solid ductal carcinoma, scirrhous carcinoma, luminal A, HER2 positive, etc. The drug is, for example, an anticancer drug.

[0038] <Medical information storage device> The medical information storage device 20 according to the first embodiment will be described in detail with reference to FIG.

[0039] 3, the medical information storage device 20 includes a memory 21, a processing circuit 22, and a communication interface 23. Each component will be described in detail below.

[0040] The memory 21 is connected to the processing circuitry 22, and stores various types of information used by the processing circuitry 22. The memory 21 also stores a patient information DB211, a biomarker DB212, a medical image DB213, and a findings information DB214.

[0041] The patient information DB 211 is a database that stores information about patients. Fig. 4 shows an example of the patient information DB 211. In this example, each patient's record stores information such as a patient ID, name, age, date of first consultation, age at menopause, breast density, and family history (history of illnesses in relatives).

[0042] The biomarker DB 212 is a database in which test values ​​of biomarker tests are stored. FIG. 5 shows an example of the biomarker DB 212. In this example, test values ​​at each test time point are stored for each patient. In the case of patient A, the test values ​​at time point T a1 ,T a2 ,T a3 ,T a4 Similarly, for patient B, the test values ​​for the three biomarkers BM2, BM4, and BM5 at time T b1 ,T b2 ,T b3,T b4 , ··· are stored. Note that the examination times of patient A and patient B may be different from each other.

[0043] The medical image DB 213 is a database that stores medical images captured by a medical imaging device 30 such as a mammograph. Fig. 6 shows an example of the medical image DB 213. In this example, medical images (mammography images) at the time of each examination (imaging) are stored for each patient.

[0044] The patient information DB 211, the biomarker DB 212, and the medical image DB 213 are not limited to being stored in one medical information storage device 20, and may be stored in separate devices. For example, the patient information DB 211 may be stored in a storage device of an electronic medical record system connected to the medical information processing device 10 via a communication network N. The medical image DB 213 may be stored in a device in a PACS (Picture Archiving and Communication System) connected to the medical information processing device 10 via the communication network N.

[0045] As can be seen from Figures 5 and 6, the biological tests and medical images are taken at the same time for each patient. However, as described above, the "time" does not mean the strict time when the test or image was taken, but rather, for example, the day when the test or image was taken. Note that tests and images taken during the same period (week, month, etc.) may be treated as having been taken at the same time.

[0046] FIG. 7 shows an example of the sequence of biological tests (biomarker tests) and imaging (mammograms). In this example, at time T 1 ,T 2 ,T 3 ,T 4At time points T, tests for biomarkers BM1 to BM6 and mammography are performed. Test values ​​of the biomarker tests performed at each time point are stored in a biomarker DB 212. Furthermore, mammography images captured at each time point are stored in a medical image DB 213. Test values ​​of the biomarker tests and mammography images can be associated with each other via the time points of the tests. 1 ,T 2 ,T 3 ,T 4 may be equally spaced or may be unevenly spaced.

[0047] The finding information DB214 is a database that stores information on suspected areas (for example, areas suspected of cancer), image findings, etc., obtained by inputting a medical image into a trained model obtained by machine learning. The trained model for obtaining the information is disposed in a medical learning device (not shown) connected to the medical information processing device 10 via a communication network N. For example, when a new medical image is stored in the medical image DB213, the medical image is transmitted to the medical learning device, and then the medical information processing device 10 receives the output result of the trained model and stores it in the finding information DB214. Note that the medical information processing device 10 may have a trained model and obtain suspected areas, image findings, etc., by itself.

[0048] <How to create a heat map> Here, a method for creating and displaying a heat map according to an embodiment will be described with reference to Fig. 8 to Fig. 10. Note that the vertical axis of each graph in Fig. 9 represents the test value, and the horizontal axis represents the time point.

[0049] Step S11: The data acquisition function 152 acquires test data (time-series data of test values ​​of a biological test). In detail, the data acquisition function 152 acquires test data of a patient designated by a user of the medical information processing device 10 from the medical information storage device 20 (biomarker DB 212).

[0050] Step S12: The heat map creation function 153 creates a heat map based on the test data acquired in step S11. First, the heat map creation function 153 converts the test values ​​of the biological test into colors according to the degree of risk (risk level). For example, as the risk level increases, the test values ​​at each time point are converted to form a gradation from black to white. The colors are not particularly limited, and for example, the conversion may be performed to form a gradation from red to green. Conversion from test values ​​to colors may be performed, for example, by standardizing the test values ​​to a risk level (0 to 1, etc.) common to a plurality of biological tests, and then converting them into a predetermined color corresponding to the standardized risk level.

[0051] In addition, when a monochrome display is used, the heat map creation function 153 may convert the test values ​​so that, for example, the test values ​​have a gradation from black to white as the risk level decreases. The relationship between the magnitude of the test value and the high and low risk level differs depending on the type of biomarker. For example, as shown in FIG. 9, the higher the test value of biomarker BM3, the higher the risk, and the lower the test value of biomarker BM4, the higher the risk.

[0052] Next, the heat map creation function 153 creates a time series element group by arranging the elements having the converted colors in the horizontal direction (first direction) in the order of the inspection time. In this embodiment, the elements are displayed as square dots. Note that the shape of the elements is not limited to a square.

[0053] When multiple types of biomarker tests are performed, a time series element group is created for each type of biomarker. Then, the heat map creation function 153 arranges the time series element groups of each biomarker test along the vertical direction (second direction). In this way, a heat map is created.

[0054] Step S13: The display control function 154 controls the output interface 13 to display the heat map created in step S12. Fig. 10 shows an example of the displayed heat map. In this heat map, each element of the heat map has a color corresponding to the risk level indicated by the biomarker. Therefore, a user such as a doctor does not need to consider the characteristics of each biomarker, and can intuitively grasp the risk level indicated by each biomarker.

[0055] When one type of biomarker test is performed, the heat map will have one row. When multiple types of biomarker tests are performed, but only one test time point is performed, the heat map will have one column. Note that the rows and columns may be interchanged when displaying the heat map. That is, the elements having the converted colors may be arranged vertically to form a time series element group, and multiple time series element groups corresponding to multiple biomarker tests may be arranged horizontally to form a heat map.

[0056] Furthermore, the heat map creation function 153 may rearrange a plurality of time series element groups based on a sort index. The sort index can be specified by the user. For example, when "by risk" is specified as the sort index, the heat map creation function 153 creates a heat map in which the time series element groups are rearranged in order of risk based on the test value at the most recent test time point (for example, in order of biomarkers with high risk levels on the most recent test date). The heat map creation function 153 may rearrange a plurality of time series element groups in order of risk based on the test value at the time point specified by the user.

[0057] In the above description, the heat map creation function 153 converts the test values ​​of the biological test into colors according to the risk level, but the test values ​​may be converted into a display form other than colors. For example, the heat map creation function 153 may convert the test values ​​into marks, letters such as alphabets, or patterns according to the risk level. When converting the test values ​​into marks, the heat map creation function 153 may convert the test values ​​into ◯, △, × as the risk level increases. When converting the test values ​​into letters, the heat map creation function 153 may convert the test values ​​into A, B, C, etc. as the risk level increases.

[0058] <Screen example> 11 to 14, examples of screens displayed on the display unit of the output interface 13 of the medical information processing device 10 will be described.

[0059] 11 shows an example of a screen S1 when a user of the medical information processing device 10 selects a patient to be diagnosed from a patient list (not shown) and selects an examination date for the selected patient (here, July 21, 2023). In the upper left corner of the screen, patient information (patient name, age, etc.) of the selected patient is displayed.

[0060] On screen S1, the user can select the examination date of the biological test from the selection band SB using the pointer P. As shown in Fig. 11, medical images and types of biological tests may be displayed in reduced size in the selection band SB. Also, the intervals at which dates are displayed in the selection band SB may be changed according to the intervals between the examination dates.

[0061] A heat map including the test values ​​for the selected examination date is displayed in the heat map display area HM. In this embodiment, a pull-down menu PD for selecting a sorting index is arranged in the heat map display area HM. Furthermore, examination dates are displayed in association with the elements of the heat map. Among these, the examination date selected in the selection band SB is underlined. In this way, the examination date selected in the selection band SB may be displayed in a different display mode (different color, font, etc.) from the other examination dates.

[0062] In the medical image display area MI, medical images captured on the examination date selected in the selection band SB are displayed. In the screen example of FIG. 11, a mammography image of the patient's right breast is displayed in the left medical image display area MI, and a mammography image of the patient's left breast is displayed in the right medical image display area MI. Note that patient information, imaging conditions, etc. may be displayed in the medical image display area MI. In the toolbar TB, various tools of an image viewer for viewing medical images are displayed.

[0063] 11, in the medical image in the medical image display area MI, a portion suspected of being cancer is displayed as an attention area R1 based on the findings information DB 214, and further, an enlarged image EI of the attention area R1 is displayed. Note that the enlarged image EI may be displayed by the user selecting the attention area R1 with the pointer P or the like.

[0064] When displaying medical images, first, the data acquisition function 152 acquires medical images captured on the examination date selected by the selection band SB from the medical image DB 213 of the medical information storage device 20. Then, the display control function 154 controls the output interface 13 so that the acquired medical images are displayed in the medical image display area MI. Note that the data acquisition function 152 may acquire all medical images of a patient at the timing when the patient is selected, before the examination date is selected.

[0065] In addition, when the user selects an element of the heat map on the screen S1, the medical image displayed in the medical image display area MI may be changed accordingly. That is, the medical image of the examination date corresponding to the element selected in the heat map may be displayed in the medical image display area MI. In this case, the data acquisition function 152 acquires the medical image captured on the examination date corresponding to the element selected in the heat map from the medical image DB 213 of the medical information storage device 20, and the display control function 154 controls the output interface 13 so that the acquired medical image is displayed in the medical image display area MI. In addition, when multiple elements are selected, the medical image may be displayed based on a predetermined rule. For example, the medical image corresponding to the element with the closest examination date among the multiple selected elements may be displayed.

[0066] In the screen S1 of FIG. 11, the user can select an element of the heat map with the pointer P. FIG. 12 shows the screen S2 when BM1 to BM6 on July 21, 2023 are selected. As shown in FIG. 12, the tab T1 displays a risk score (LB risk score) calculated based on the liquid biopsy test results on the selected test date. This risk score is, for example, a value between 0 and 100, and the higher the risk, the higher the value. In addition, the tab T1 displays the test value V for each biomarker together with the distribution range (normal range) DR for healthy people. This makes it easy to understand whether the test value for each biomarker is within the normal range.

[0067] As shown in Fig. 12, the time course display area TC displays graphs of the test results of the biomarkers (BM1 to BM6 in this example) corresponding to the element selected in the heat map. In Fig. 13, only two biomarkers BM3 and BM4 are selected, and therefore graphs of the test results of BM3 and BM4 are displayed in the time course display area TC. In this embodiment, the test value of the test date corresponding to the element selected in the heat map is surrounded by a frame F. However, without being limited to this, the test value may be displayed in a display mode, such as a color different from the test values ​​of the other test dates, so that the test value can be distinguished.

[0068] As shown in screen S3 of FIG. 13, the tab T2 displays test results (raw data) such as a fluorescent microscope image FMI. In the fluorescent microscope image FMI, the test results of a biological test (biomarker) corresponding to an element selected in the heat map may be displayed. In the example of FIG. 13, BM3 and BM4 on July 21, 2023 are selected, so the fluorescent microscope images of BM3 and BM4 on the test date are superimposed. In addition, a Venn diagram VD of colocalization between the biomarkers selected in the heat map may be displayed.

[0069] As shown in the screen S4 of FIG. 14, a display may be made in the selection band SB that allows the user to grasp whether or not a medical image corresponding to the examination date of the biological examination exists. In the screen S4, for an examination date for which no medical image exists, "No image" is displayed. This allows the user to easily select an examination date for which both the examination result of the biological examination and a medical image exist. The above display mode is not limited to this, and for example, in the selection band SB of the screen S1 shown in FIG. 11, for an examination date for which no medical image exists, a reduced image or icon indicating a medical image may not be displayed. The above display may also be made in a heat map. For example, the display mode of the examination date displayed in the heat map may be changed depending on the presence or absence of a medical image. For example, an examination date for which a medical image exists may be displayed in a different color or font from the others, or may be displayed underlined.

[0070] Next, a case where a sorting index is selected from the pull-down menu PD will be described. In this embodiment, the user can select "by risk", "by subtype" or "by drug" as the sorting index.

[0071] FIG. 15 shows a screen S5 when "Risk Order" is selected from the pull-down menu PD. In the heat map display area HM, a heat map is displayed in which the time series element groups of biomarkers BM1 to BM6 are arranged from top to bottom in order of decreasing risk level on the latest examination date (here, February 1, 2024). That is, in this example, biomarker BM4 indicates the highest risk level and biomarker BM5 indicates the lowest risk level on the latest examination date. Note that the time series element groups may be arranged from top to bottom in order of decreasing risk level.

[0072] The pull-down menu PDD is for specifying the examination date that is the basis for sorting. In this embodiment, if no specification is made, the time series element groups are sorted in order of risk on the latest examination date as described above. On the other hand, if the user inputs an examination date from the pull-down menu PDD, a heat map in which the time series element groups are sorted in order of risk on the examination date is displayed.

[0073] 16 shows the screen S6 when "By subtype" is selected from the pull-down menu PD. In the heat map display area HM, a heat map consisting of time series element groups of biomarkers BM1 to BM6 sorted by subtype (here, ST1, ST2, ST3) is displayed. That is, a heat map sorted by a group of biomarkers BM2 and BM4 related to subtype ST1, a group of biomarker BM5 related to subtype ST2, and a group of biomarkers BM3, BM1, and BM6 related to subtype ST3 is displayed.

[0074] FIG. 17 shows the screen S7 when "By Drug" is selected from the pull-down menu PD. In the heat map display area HM, a heat map consisting of time series element groups of biomarkers BM1 to BM6 sorted by drug (here, D1, D2, others) is displayed. That is, a heat map sorted by group of biomarkers BM1 and BM6 related to drug D1, group of biomarkers BM3 and BM2 related to drug D2, and group of biomarkers BM4 and BM5 related to other drugs (drugs that were not specified) is displayed. Note that in FIG. 17, the time series element groups of biomarkers related to drugs that were not specified are also displayed, but this is not limiting, and only the time series element groups of biomarkers of the specified drug may be displayed.

[0075] The process contents in the medical image processing device 10 when a sorting index is selected will be described. The operation reception function 151 receives the user's operation on the pull-down menu PD and grasps the selected sorting index. After that, the heat map creation function 153 rearranges the time series element groups of BM1 to BM6 based on the specified sorting index. When the sorting index is "by risk", the heat map creation function 153 creates a heat map sorted by risk by rearranging the time series element groups of BM1 to BM6 in order from biomarkers with low risk levels on the latest examination date (or a specified examination date) to biomarkers with high risk levels (or in reverse order). After that, the display control function 154 controls the output interface 13 to display the sorted heat map.

[0076] When the sorting index is "by subtype", the associated BM extraction function 155 is used to extract subtypes highly associated with each biomarker, and the biomarkers are grouped by the extracted subtypes. The heat map creation function 153 rearranges the time series element group for each grouped biomarker. When the sorting index is "by drug", the associated BM extraction function 155 is used to extract drugs highly associated with each biomarker, and the biomarkers are grouped by the extracted drugs. The heat map creation function 153 rearranges the time series element group for each grouped biomarker.

[0077] As described above, according to this embodiment, a heat map including a time series element group in which a plurality of elements corresponding to biological tests performed at a plurality of time points and having colors according to the degree of risk are arranged in chronological order along a first direction is created and displayed. This allows a user such as a doctor to easily visually grasp the risk levels indicated by the test results of the biological tests at a plurality of time points.

[0078] Furthermore, according to this embodiment, when the test data includes multiple types of biological tests, a heat map is created and displayed in which multiple time series element groups corresponding to the multiple types of biological tests are arranged along a second direction different from the first direction. This allows users such as doctors to easily understand and compare the risk levels indicated by the test results of the multiple types of biological tests. Furthermore, the heat map display allows the test data to be displayed in a small space on the screen.

[0079] Furthermore, in this embodiment, medical-related information (medical images, etc.) related to one or more elements selected by a user such as a doctor among the multiple elements constituting the heat map is displayed together with the heat map. This allows the selected element (type of biological test, time point of test) and related information to be simultaneously referenced, making it possible to support comprehensive diagnosis. As a result, diagnostic accuracy can be improved. That is, even if a biomarker test such as a kid biopsy reveals that there is a possibility of a disease such as cancer, the site of the disease cannot be identified. In contrast, according to this embodiment, a heat map that clearly displays the results of the biomarker test and a medical image captured at the same time as the biomarker test are presented to a user such as a doctor, thereby supporting comprehensive diagnosis. Furthermore, the support effect can be enhanced by presenting the suspected area and image findings.

[0080] Furthermore, in this embodiment, a heat map is created and displayed in which the time series element groups corresponding to each biological test are rearranged based on a sorting index such as risk order, subtype, or drug. Also, a heat map is created and displayed in which biological tests highly related to a specified subtype or drug are extracted and the time series element groups corresponding to the extracted biological tests are rearranged to form a group. By referring to the heat map in which the time series element groups are rearranged in this manner, users such as doctors can improve the accuracy of diagnosis.

[0081] (Modification of the first embodiment) A modification of the first embodiment will be described with reference to FIGS.

[0082] In this modified example, a new tab T3 ("Subtype, Findings, Drug") is placed on the screen, and the user selects a subtype, drug, etc. from a pull-down menu. A heat map is displayed in which biomarkers highly related to the selected subtype or drug are grouped.

[0083] On screen S8 shown in FIG. 18, a subtype (ST1, ST2, ST3, etc.) can be selected from pull-down menu PD1, and patient information can be selected from pull-down menu PD2. Patient information is, for example, family history, and is selected from hypertension, diabetes, heart disease, etc. In this example screen, ST1 is selected as the subtype from pull-down menu PD1, and P1 (for example, diabetes) is selected as the patient information from pull-down menu PD2. The message window W1 displays the image findings ("Tumor with unclear margins + faint calcification") read out from the findings information DB214.

[0084] When the subtype and patient information are selected as described above, BM2, BM4, and BM5 are displayed in the message window W2 as biomarkers highly associated with subtype ST1. When the user presses the button B1 here, BM2, BM4, and BM5 are grouped and displayed at the top of the heat map, as shown in screen S9 in Fig. 19. In addition, the test values ​​and distribution ranges of BM2, BM4, and BM5 are displayed in the tab T1, and graphs of BM2, BM4, and BM5 are displayed in the time course display area TC.

[0085] In addition, in order to easily distinguish highly associated biomarkers from other biomarker elements on screen S9, the color tone of the highly associated biomarker elements may be changed. For example, the elements of the time series element group corresponding to the highly associated biomarkers may be displayed in a gradation from yellow to blue as the risk level goes from high risk to low risk.

[0086] In the screen S10 shown in FIG. 20, up to three types of drugs can be selected from the pull-down menus PD3 to PD5. One of drugs 1 to 3 can be selected from the pull-down menu PD6. Here, "D1" is selected as drug 1, "D2" is selected as drug 2, and drug 1 is selected from the pull-down menu PD6. When selected in this way, BM1 and BM6 are displayed in the message window W3 as biomarkers highly related to drug D1. Here, when the user presses the button B2, BM1 and BM6 are grouped and displayed at the top of the heat map, as in the screen S11 shown in FIG. 21. In addition, the test values ​​and distribution ranges of BM1 and BM6 are displayed in the tab T1, and the graphs of BM1 and BM6 are displayed in the time course display area TC. In addition, the fluorescent microscope images of BM1 and BM6 and the Venn diagram of the co-localization of BM1 and BM6 tubes are displayed in the tab T2.

[0087] In addition, only the time series element groups corresponding to highly related biomarkers may be displayed on the screens S9 and S11. Also, the highly related biomarkers may be automatically selected, and medical-related information such as test values ​​may be displayed on the tabs T1, T2, and the time course display area TC.

[0088] <Medical information processing device (second embodiment)> A medical information processing device 10A according to the second embodiment will be described in detail. One of the differences between the second embodiment and the first embodiment is that the second embodiment displays a score calculated based on the test value of a biomarker. The second embodiment will be described below, focusing on the difference.

[0089] 22, the medical information processing device 10A includes a memory 11, an input interface 12, an output interface 13, a communication interface 14, and a processing circuit 15. The configuration other than the processing circuit 15 is the same as that of the first embodiment, so detailed description will be omitted.

[0090] The processing circuit 15 has an operation reception function 151, a data acquisition function 152, a heat map creation function 153, a display control function 154, a related BM extraction function 155, and a score calculation function 156. The configuration other than the score calculation function 156 is the same as that of the first embodiment, so detailed description will be omitted.

[0091] The score calculation function 156 calculates a score based on the test data of a biological test corresponding to one or more elements selected by the user from among the elements of the heat map. The method of calculating the score is not particularly limited, and for example, the risk level based on the test value of the biological test is multiplied by the same or different weighting coefficient and the sum is calculated. Alternatively, a trained model obtained by machine learning the relationship between the test result of the biological test and the score may be used. Note that the score calculation function 156 may calculate a score based on the test values ​​of all biological tests performed, regardless of the selection of an element of the heat map by the user.

[0092] In this embodiment, the score calculation function 156 calculates a score (integrated score) by considering not only the test values ​​of the biological test but also medical images captured at the same time as the biological test. That is, the score calculation function 156 calculates an integrated score based on the biological test and the medical images. The test values ​​used to calculate the integrated score may be the test values ​​of the biological test corresponding to one or more elements selected by the user, or may be the test values ​​of all biological tests on the selected test date.

[0093] The integrated score may be calculated taking into consideration information in the findings information DB 214 (suspected location, image findings, etc.) and / or patient information such as family history. The method of calculating the integrated score is not particularly limited, and for example, the integrated score may be calculated by multiplying each risk level based on the test value of a biological test and a medical image by the same or different weighting coefficients and taking the sum of the weighting coefficients. Alternatively, the integrated score may be calculated using a trained model obtained in advance by machine learning.

[0094] 11, when an attention area R1 indicating a suspected area is displayed in the medical image display area MI, the user may select the attention area R1 by clicking the pointer P or the like, so that the attention area R1 is reflected in the integrated score. For example, the score calculation function 156 may calculate the integrated score taking into account the finding information in the finding information DB 214.

[0095] In the screen S12 shown in FIG. 23, a tab T4 ("Integrated Analysis") is arranged in the lower right of the screen. The tab T4 is provided with an "Integrated Analysis" button B3 and a "Save" button B4. As shown in the figure, an element corresponding to the examination of the biomarkers BM1 to BM6 on the examination date (July 21, 2023) is selected in the heat map. In this state, when the user presses the button B3 with the pointer P, the score calculation function 156 calculates an integrated score based on the examination values ​​of the biomarkers BM1 to BM6 on the examination date and the medical image on the examination date. The display control function 154 controls the output interface 13 to display the calculated integrated score.

[0096] 24, the integrated score (here, "72") is displayed in the center of the radar chart RC1 in the tab T4. In this example screen, the radar chart RC1 also displays the scores based on the test values ​​of each biological test (BM1 to BM6) and the LB risk score (LBRS). By pressing the button B4 on the screen S13, the data of the integrated analysis results such as the radar chart RC1 is saved.

[0097] In addition, the displayed radar chart may be changed according to the element selected in the heat map of the screen S12. In the screen S14 shown in FIG. 25, an element corresponding to the examination of the biomarkers BM1 to BM6 on the latest examination date (February 1, 2024) is selected. When the user presses the button B3 in this state, the score calculation function 156 calculates an integrated score based on the examination values ​​of the biomarkers BM1 to BM6 on the examination date and the medical image on the examination date. The display control function 154 controls the output interface 13 to display the calculated integrated score. In the screen S14, the radar chart RC2 corresponding to the latest examination date is overlaid on the radar chart RC1. In addition, only the radar chart RC2 may be displayed.

[0098] When displaying radar chart RC2, radar chart RC1 and radar chart RC2 may be displayed in different manners. That is, radar charts with different examination dates may be displayed in different manners. For example, as shown in FIG. 25, radar charts with older examination dates are displayed in lighter colors. Alternatively, the line type and color of each radar chart RC1 may be changed. In this embodiment, by pressing the "Chronological playback" button B5, the radar charts are displayed in chronological order starting from the radar chart with the oldest examination date.

[0099] As described above, according to the present embodiment, a score calculated based on the test data of a biological test corresponding to one or more elements selected by a user from among the multiple elements constituting a heat map is displayed, thereby enabling users such as doctors to improve the accuracy of diagnosis.

[0100] Furthermore, according to this embodiment, the radar charts created for each specified time point can be displayed in different display formats in a superimposed manner, or displayed sequentially in chronological order, which allows the risk level and integrated score to be easily understood along the timeline, and supports comprehensive diagnosis.

[0101] The term "processor" used in the above description means a circuit such as a central processing unit (CPU), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), a programmable logic device (e.g., a simple programmable logic device (SPLD), a complex programmable logic device (CPLD), and a field programmable gate array (FPGA)). The processor realizes its function by reading and executing a program stored in the memory 11. Instead of storing a program in the memory 11, the processor may be configured to directly incorporate the program in its circuit. In this case, the processor realizes its function by reading and executing the program incorporated in its circuit. The processor is not limited to being configured as a single processor circuit, and may be configured as a single processor by combining multiple independent circuits to realize its function. Furthermore, the multiple components in FIG. 2 may be integrated into a single processor to realize its function.

[0102] The medical information processing method described in Fig. 8 can be realized by executing a prepared medical information processing program on a computer such as a personal computer or a workstation. This medical information processing program can be distributed via a network such as the Internet. This medical information processing program can also be recorded on a non-transitory recording medium readable by a computer such as a hard disk, a flexible disk (FD), a CD-ROM, an MO, or a DVD, and executed by being read from the recording medium by a computer.

[0103] According to at least one of the embodiments described above, the risk level indicated by the test result of the biological test can be easily understood.

[0104] Although several embodiments have been described above, these embodiments are presented only as examples and are not intended to limit the scope of the invention. The novel device and method described in this specification can be implemented in various other forms. In addition, various omissions, substitutions, and modifications can be made to the forms of the device and method described in this specification without departing from the spirit of the invention. The appended claims and their equivalents are intended to include such forms and modifications that fall within the scope and spirit of the invention. [Explanation of symbols]

[0105] 1 Medical information processing system 10, 10A Medical information processing device 11. Memory 12 Input Interface 13 Output Interface 14 Communication Interface 15 Processing circuit 151 Operation reception function 152 Data Acquisition Function 153 Heat map creation function 154 Display control function 155 Related BM extraction function 156 Score calculation function 20 Medical information storage device 21 Memory 211 Patient information DB 212 Biomarker DB 213 Medical Image DB 214 Findings information DB 22 Processing circuit 23 Communication Interface 30 Medical Imaging Equipment B1, B2, B3, B4, B5 buttons EI Enlarged Image F frame FMI Fluorescence Microscope Images HM Heatmap display area MI medical image display area N Communication Network P Pointer R1 Region of interest DR (in healthy individuals) Distribution range S1~S14 screen SB (Patient Data) Selection Band PD Pull-down menu (for selecting sorting index) PD1~PD6 pull-down menu PDD Pull-down menu (for entering the date by which to sort) RC1,RC2 Radar Chart T1, T2, T3, T4 tabs TB (Image Viewer) Toolbar TC Time Course Display Area V Test Value VD Venn diagram W1~W3 Message Window

Claims

1. An acquisition unit that acquires test data including test values ​​of biological tests performed on the same subject at multiple time points; a map creation unit that creates a map based on the test data, the map including a time series element group in which a plurality of elements corresponding to the biological tests performed at the plurality of time points and having a display mode according to a degree of risk are arranged in chronological order along a first direction; A display control unit that controls a display unit to display the map; A medical information processing device comprising:

2. The test data includes test values ​​of a plurality of types of biological tests performed at the plurality of time points; The medical image processing apparatus according to claim 1 , wherein the map creator creates a map in which the plurality of time series element groups corresponding to the plurality of types of biological tests are arranged along a second direction different from the first direction.

3. the map creation unit rearranges the plurality of time series element groups based on a sort index; The medical image processing apparatus according to claim 2 , wherein the display control unit controls the display unit to display a map including the rearranged groups of time series elements.

4. The medical information processing device according to claim 3 , wherein the sorting index is sorting by risk, by subtype, or by drug.

5. 5. The medical image processing device according to claim 4, wherein when the sorting index is the order of risk, the map creating unit rearranges the plurality of time series element groups in order of risk based on a test value at a latest test time point, or in order of risk based on a test value at a specified time point.

6. An extraction unit for extracting types of biological tests highly related to the specified subtype or drug, The medical information processing apparatus according to claim 2 , wherein the display control unit controls the display unit to display the extracted types of biological tests.

7. the map creation unit rearranges the plurality of time series element groups so that the time series element groups corresponding to the extracted biological tests are grouped together; The medical image processing apparatus according to claim 6 , wherein the display control unit controls the display unit to display a map including the rearranged groups of time series elements.

8. The medical information processing apparatus according to claim 1 , wherein the display control unit controls the display unit to display medical-related information related to one or more elements selected from among a plurality of elements constituting the map.

9. The medical image processing apparatus according to claim 8 , wherein the medically related information is a medical image taken at the same time as a biological examination of the selected element.

10. The medical information processing apparatus according to claim 9 , wherein the display control unit causes the display unit to display an enlarged image of a suspected area in the medical image and / or an image finding based on the medical image.

11. The medical image processing apparatus according to claim 9 , wherein the display control unit controls the display unit to perform a display that enables a user to know whether the medical image exists or not.

12. The medical information processing apparatus according to claim 8 , wherein the medical-related information is a graph of test values ​​of a biological test corresponding to the selected one or more elements.

13. The medical information processing apparatus according to claim 8 , wherein the medically relevant information is a fluorescent microscopic image or a co-localization Venn diagram of a biological test corresponding to the selected one or more elements.

14. The medical information processing apparatus according to claim 8 , wherein the medical-related information is a score calculated based on test data of a biological test corresponding to the selected one or more elements.

15. The medical information processing device according to claim 8 , wherein the medical-related information is an integrated score calculated based on test data of a biological test corresponding to the selected one or more elements and a medical image taken at the same time as the biological test.

16. The medical image processing apparatus according to claim 1 , wherein the display control unit controls the display unit to display a medical image captured at a time point selected from the plurality of time points.

17. The medical information processing device according to claim 16 , wherein the medical image is a mammography image, an ultrasound image, a CT image, or an MRI image.

18. The medical information processing apparatus according to claim 16 , wherein the display control unit controls the display unit to display an enlarged image of a suspected area in the medical image and / or an image finding based on the medical image.

19. The medical image processing device according to claim 1 , wherein the display mode is a color, a mark, a character, or a pattern.

20. A medical information storage device that stores test data including test values ​​of biological tests performed on the same subject at multiple time points; a medical information processing device communicably connected to the medical information storage device, The medical information processing device includes: an acquisition unit that acquires the examination data from the medical information storage device; a map creation unit that creates a map based on the test data, the map including a time series element group in which a plurality of elements corresponding to the biological tests performed at the plurality of time points and having a display mode according to a degree of risk are arranged in chronological order along a first direction; A display control unit that controls a display unit to display the map; A medical information processing system comprising:

21. Obtaining test data including test values ​​from biological tests performed on the same subject at multiple time points; creating a map based on the test data, the map including a time series element group in which a plurality of elements, each corresponding to a biological test performed at a plurality of time points and having a display mode according to a level of risk, are arranged in chronological order along a first direction; controlling a display unit to display the map; A medical information processing method comprising:

Images