Method for navigating medical data

Abstract

To provide a method, a processing device, a program, and a storage medium that promote efficient searching and evaluation of data in large medical data sets.SOLUTION: A method includes the steps of: providing a medical dataset including data of a plurality of patients and data related to diseases; associating the data of the dataset with corresponding parts of a human body; displaying on a display device a graphical representation 1 of the human body or of a part of the human body; displaying on the display device a plurality of activatable buttons 2 associated with different parts of the graphical representation; receiving a user input that activates one of the plurality of activatable buttons; and based on the activation, displaying on the display device a graphical representation of data associated with that part of the human body with which the activatable button activated by the user input is associated.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to medical data, particularly large medical data sets involving data for multiple patients. A computer-implemented method for navigating a website Regarding the filtered method. [Background technology]

[0002] In particular, the pharmaceutical industry is conducting large-scale medical studies involving large numbers of patients. Clinical trials involving thousands of patients are conducted for the approval process. History, baseline disease characteristics, composite measures of disease activity assessment, and patient-reported outcomes Clinical data in the form of PROs are collected at different times and over time. (which may be extended to 5 years of follow-up). For example, People with psoriatic or psoriatic arthritis Patients with rheumatoid arthritis report how their joints and / or their skin conditions have improved since starting the drug. Progress can be periodically checked.

[0003] The resulting time-dependent data is typically stored in large tables (so-called patient-level It is available in the form of a data sheet.

[0004] This huge amount of data is usually analyzed according to a statistical analysis plan and published in a clinical trial report. It was used to create the Corporate Social Responsibility (CSR), which was 10,000 pages long including appendices. Only a very small proportion of these outputs are published in peer-reviewed journals. These are mainly summary tables or statistical tests.

[0005] However, such summaries may not be fully understood in their anatomical and / or physiological completeness. For example, in the case of psoriatic arthritis, the location of swollen or tender joints The question may arise as to whether the location of the Such questions obviously cannot be answered using the published abstract. Given the number of locations for possible joint pain (78 joints), we used conventional patient Using participant-level data is cumbersome, even if practical. Summary of the Invention [Problem to be solved by the invention]

[0006] It is therefore an object of the present invention to provide an efficient method for searching and searching data in large medical datasets. Computer-implemented methods to facilitate evaluation and evaluation d method, also referred to herein as a computer-implemented method That is the thing. [Means for solving the problem]

[0007] This object is achieved by a method according to claim 1. Preferred embodiments are defined in the dependent claims has been identified as

[0008] The methods include, but are not limited to, the identification of specific It allows efficient searching of data. Moreover, it is Provides a framework for interactive exploration.

[0009] The medical data set is for multiple patients, especially for more than 500 patients. In particular, it is possible to include patient-level data for more than 1,000 patients. For each patient, one or more medical data items are stored in a medical dataset. The information may be stored in

[0010] The medical dataset may be, inter alia, a clinical dataset, in particular , containing data from one or more clinical trials.

[0011] Graphic representation of the human body or part of the human body The presentation can be schematic or realistic. The graphic representation may be one or more anatomically correct representations of parts of the human body, or It may include an anatomically correct representation of the human body as a whole. The graphical representation can be a two-dimensional (2D) or a three-dimensional (3D) representation. It is.

[0012] Also, the graphical representation of the human body or parts of the human body may be animated. In particular, the graphic representation of the human body or parts of the human body may be used to illustrate disease progression and / or manifestations. Depending on the graphical representation of the data shown it may vary.

[0013] An activatable button is a button that is activated on a display device. The form of the activatable button is not particularly limited. According to an embodiment of the present invention, the color and / or shape of the activatable button changes when activated. In this way, the user can easily change the activated button. It is possible to easily identify.

[0014] The activatable buttons are arranged to correspond to the graphs that represent the particular parts of the human body to which the activatable buttons relate. Each of the elements may be positioned adjacent to or overlapping a portion of the graphic representation. The activatable buttons may be associated with particular elements of the human body via a graphical representation. For example, the activatable buttons may be associated with the hands or feet of a human body, while Another activatable button relates to the head or shoulders. Graphical representations provide further details. When the activatable button provides a visual or representation of a part of the human body, the activatable button may also It can relate to smaller elements of the body (such as joints, organs, or blood vessels). be.

[0015] The activatable buttons may be fixed, inter alia, to respective portions of said graphical representation. Activatable buttons are those that are activated when the respective part of the graphical representation is visible. The activatable button may be displayed visibly on the display. (for example, zooming or rearranging different windows that overlap with each other) after the button is no longer visible in its previous location. If so, it may be redisplayed in an appropriate location.

[0016] The user may interact with the device in any suitable manner, for example, by using a touch-sensitive display or a The mouse can be used to activate the activatable buttons.

[0017] The method includes: displaying a context menu in response to activation of the activatable button. tmenu), and to determine a graphical representation of the data and / or the respective parts of the human body. It provides a set of options for selecting a subset of data associated with a minute. As such, data used for the graphical representation of data or said graphics The details of the query representation can be further refined. For example, a medical dataset might represent a particular symptom. It is possible to include various measurements to quantify. One of the measurements may be selected using the measurement and a respective one of the measurements of the human body. Only data in the medical dataset that are relevant to the part are considered for the graphical representation of the data. It is planned to put it in the "

[0018] The graphical representation of the data may include one or more charts or graphs. For example, graphical representations can include pie charts, bar graphs, box plots, and scatter plots. Graphical representation of data can include cloth plots, or dot plots. Alternatively or additionally, one or more images of one or more patients, and and / or contain one or more realistic representations of a single or average patient. For example, the image may show a portion of the patient's skin and / or Alternatively, a realistic representation of the lesion may be shown.

[0019] The graphical representation of the data may, inter alia, be one or more graphs showing, for example, a disease progression over time. Showing disease progression over time via multiple charts, graphs, and / or tables is possible.

[0020] The term "realistic representation" refers to image data obtained from one or more patient photographs. The term "image" refers to a piece of data, but is distinct from the photograph itself. Also, one or more images may refer to one or more is based on multiple anatomical images (e.g., x-rays, MRIs, CT scans, and / or It is possible to include images, such as angiograms.

[0021] Via the above mentioned context menu, the user can select It is possible to select the particular chart or graph to be used.

[0022] The medical data set may include time-dependent data, and the graphics of the data may be The representations are different temporal snapshots of that data. ot). Thus, the time evolution of at least one disease symptom and / or Or the response of one or more patients to a particular drug may be evaluated. The charts or graphs may be used as representations of different snapshots in time.

[0023] The method involves selecting the time points at which data for the graphical representation of the data should pertain. To this end, a temporal control element (e.g. The method may further include displaying a timeline or the like. receiving user input via an interactive control element; and selecting a data item associated with the selected point in time. and displaying a graphical representation of the data. A slider element may be provided that can be shifted along the timeline to select a point in time. In this way, the temporal progression of the disease can be efficiently explored by the user. It is possible.

[0024] Graphic representations of the human body or parts of the human body must be interactive. possible, among other things, to have a scalable and / or rotatable representation In this way, it is possible to explore medical datasets for different parts of the human body. The graphical representation of the human body or parts of the human body may appear differently depending on the zoom level. For example, at a first zoom level, Graphical representations of the body may only show schematic illustrations of body elements (e.g., hands, etc.). When zoomed in, the graphical representation shows more details about the body elements. It is possible to change to a detailed representation (e.g., an anatomically correct representation) , a hand with representations of individual fingers and joints). Additional activatable buttons are Additional elements of the visual representation may be displayed and viewed after zooming and / or rotation. It also makes it possible to display the graphic display after, for example, zooming or rotating. Activatable buttons are displayed when their current counterparts are no longer visible. can be removed from the

[0025] The medical dataset can relate to more than one disease, and the method includes: providing an interface that allows a user to select a disease; A part of the human body that involves an activatable button that is activated by user input Restrict the graphical representation of associated data to data related to the selected disease. Steps to be taken In this way, the medical data set can be searched for different diseases. In this case, the method may further include: The method may further include the step of linking.

[0026] Alternatively or additionally, the medical data set comprises a medical data set for treating at least one disease. The method may involve two or more agents used in providing an interface that allows a user to select a medication; A part of the human body that involves an activatable button that is activated by user input Restrict the graphical representation of associated data to data related to the selected drug. Steps to be taken In this way, the medical data set can be searched for different drugs. This can assist the user in selecting the most appropriate medication. The method includes: associating data in the dataset with a corresponding drug to which the data relates. The method may further include the step of:

[0027] Graphic representations of the human body or parts of the human body, when animated, Depending on the disease and / or drug selected, the or the graphic representation of a part of the human body may be used to illustrate a disease or its progression over time, and / or can reflect the effect of a selected drug on the disease or its progression over time. be.

[0028] A step to associate data in a dataset with the corresponding parts of the human body to which the data pertains. The step of providing at least one matrix for each patient's data includes: The elements of the matrix are each associated with a given part of the human body. Entering at least a portion or quantities derived from said data into at least one matrix. and b. determining whether the matrix is ​​a nx1 matrix. There are two or more matrices for each patient, which are referred to herein as "vectors." It is possible to have multiple matrices, each relating to a different region of the body. For example, One matrix can refer to the joints of the human body, while the second matrix can refer to a different Each matrix can be associated with a given time point. The time evolution of the level data is transformed into a series of matrices, each corresponding to a different time point. is possible.

[0029] A step to associate data in a dataset with the corresponding parts of the human body to which the data pertains. The method further comprises the steps of receiving and / or determining an anatomical score for each patient. and storing them as elements in at least one matrix. Therefore, the anatomical score can be applied to the data in the medical dataset. Or it may correspond to a quantity derived from said data.

[0030] Anatomical scores are based on clinical assessments or measurements performed on specific anatomical locations. The joint score (swelling, tenderness) is a measure of the anatomical score. For example, 78 joints were monitored in psoriatic arthritis, resulting in The resulting matrix can be a 78x1 matrix, i.e., with 78 entries It is possible for the vector to be accompanied by

[0031] Other anatomical scores are possible as well, such as the insertion site (where the tendon ligament is attached to the bone). Enthesitis score for areas where the skin is worn, psoriasis skin score (erythema on the head, torso, etc.) dactylitis score (for fingers, toes), and / or bone erosion and joint space narrowing score. a (e.g., extracted from X-rays).

[0032] In other diseases, anatomical scores are used in age-related macular degeneration (ADM) or diabetic retina. Edema (excess fluid) on the retina in patients with glaucoma, blood in various heart valves (locations) velocity (e.g., as measured by Doppler echocardiography), and / or heart failure The anatomical score may be related to wall thickness in patients with cardiomyopathy. , which may be related to T2 lesions in the brains of patients with multiple sclerosis (MS).

[0033] A step to associate data in a dataset with the corresponding parts of the human body to which the data pertains. The team will use machine learning techniques and / or artificial neural networks, in particular deep learning. Using neural networks to dissect from patient-level data of at least one patient The method may further include determining an anatomical score. In particular, medical images (e.g., X-ray images, computed tomography (CT) scans, and and / or magnetic resonance imaging (MRI), etc.

[0034] A step to associate data in a dataset with the corresponding parts of the human body to which the data pertains. The cluster performs statistical analysis of medical data based on at least one matrix for each patient. The method may further include determining the amount of the inflammatory bowel disease from all patients in the dataset. Statistical quantities (e.g., For example, means, correlations, quantiles, and / or clustering may be determined. Thus, statistics can be derived from the complete patient-level data.

[0035] For example, for two patients with joint scores x1 and x2, the sum x1 + x2, or Or the difference x1-x2 is computed by the corresponding matrix or vector operation. The result is again a matrix or a vector.

[0036] The statistical quantities are used to determine a graphical representation of data associated with a part of the human body. For example, the joint scores of the corresponding mean vectors can be used to approximate a schematic representation of the human body. The joints are displayed in color-coded form overlaid on each other. obtain.

[0037] The present invention relates to a process adapted to carry out the steps of the method described above. The present invention further provides a data processing apparatus including a processor.

[0038] The present invention further provides a computer program product comprising instructions: The instructions are executed by the computer as described above. causing a computer to perform the steps of the methods described.

[0039] The present invention further provides a computer readable storage medium containing instructions. The instructions, when executed by a computer, causing a computer to perform the steps of the method described.

[0040] The process of associating data in a dataset with the corresponding parts of the human body to which the data pertains. The step of structuring the medical data set, as described above with respect to the database, may include: Also, the method of claim 1 may be embodied without other steps.

[0041] In other words, the present invention also provides a method for determining whether a patient is at least one disease-related disorder, comprising: The present invention provides a computer-implemented method for structuring a medical data set, the method comprising: The method includes providing at least one matrix for each patient's data, The elements of the sequence are steps and small amounts of data, each associated with a given part of the human body. Entering at least a portion of or quantities derived from said data into at least one matrix. The method includes the steps of:

[0042] As stated above, the matrix can be an nx1 matrix, which is These are referred to herein as "vectors." There can be more than one matrix per patient. Each matrix relates to a different region of the body. For example, one matrix might be: One matrix can refer to the joints of the human body, while the second matrix can refer to the different internal organs. Each matrix can be associated with a given time point. Thus, patient-level data The time evolution of can be transformed into a series of matrices, each corresponding to a different time point. .

[0043] The step of structuring the medical dataset includes generating an anatomical score for each patient. receiving and / or determining the at least one matrix element; and storing the anatomical score. Responding to data in a medical dataset or to quantities derived from said data is possible.

[0044] Anatomical scores are based on clinical assessments or measurements performed on specific anatomical locations. The joint score (swelling, tenderness) is a measure of the anatomical score. As there are 78 joints in the human body, the resulting matrix is ​​78x It can be a matrix, i.e. a vector with 78 entries. It is possible.

[0045] Other anatomical scores are possible as well, such as the insertion site (where the tendon ligament is attached to the bone). Enthesitis score for areas where the skin is worn, psoriasis skin score (erythema on the head, torso, etc.) dactylitis score (for fingers, toes), and / or bone erosion and joint space narrowing score. a (e.g., extracted from X-rays).

[0046] In other diseases, anatomical scores are used in age-related macular degeneration (ADM) or diabetic retina. Edema (excess fluid) on the retina in patients with glaucoma, blood in various heart valves (locations) velocity (e.g., as measured by Doppler echocardiography), and / or heart failure The anatomical score may be related to wall thickness in patients with cardiomyopathy. , which may be related to T2 lesions in the brains of patients with multiple sclerosis (MS).

[0047] The step of structuring the medical dataset may be performed using machine learning techniques and / or artificial neural networks. In particular, deep neural networks are used to determining an anatomical score from the patient-level data for the patient. Anatomical scores can be derived, inter alia, from medical images (e.g., X-ray images, computer Computed tomography (CT) scan, and / or magnetic resonance imaging (MRI) ) may be determined based on the

[0048] The step of structuring the medical dataset includes at least one The method may further include determining a statistical quantity of the medical data based on the matrix. Based on a subset of patients that is less than all patients in the data set, or Statistical quantities (e.g., means, correlations, quantiles, and / or clusters) based on all patients Thus, statistical quantities can be determined from complete patient-level data. It can be derived from

[0049] For example, for two patients with joint scores x1 and x2, the sum x1 + x2, or Or the difference x1-x2 is computed by the corresponding matrix or vector operation. The result is again a matrix or a vector.

[0050] The present invention relates to a process adapted to carry out the steps of the method described above. The present invention further provides a data processing apparatus including a processor.

[0051] The present invention further provides a computer program product comprising instructions: The instructions are executed by the computer as described above. causing a computer to perform the steps of the methods described.

[0052] The present invention further provides a computer readable storage medium containing instructions. The instructions, when executed by a computer, causing a computer to perform the steps of the method described.

[0053] The present invention relates to a medical data processing system comprising data of a plurality of patients and relating to at least one disease. Further provided is a computer-implemented method for identifying patient phenotypes in a set. A phenotype is defined as a combination of observed clinical features. The method may include a step of identifying a cluster of symptoms, wherein the probability of the symptoms is determined based on the cluster of symptoms. In other words, each cluster is homogenous within a given phenotype. The clusters may include patients who are These can be identified using neural networks, particularly deep neural networks. do.

[0054] The step of identifying clusters of patients may include, among other things, using a hierarchical clustering algorithm. Applying a method (e.g. Ward's method) to a portion of a medical dataset or to the complete dataset The method may include the step of using the

[0055] The method includes the steps of applying a mixture model to clinical endpoints in a medical dataset. The method may further include a step.

[0056] The method may be used in combination with any of the methods described above. For example, The identified clusters may be used to determine a graphical representation of the data. The above matrix can be used to identify clusters of patients. It is possible for one or more of the above identified features to be included.

[0057] The methods may be used in therapeutics, prognosis, and clinical decision making, and may be used to personalize medicine. In particular, clustering can be used to find if two patients have similar scores across all clinical variables. The assumption is that clusters are shared only if the individuals have a similar probability of the presence of a symptom across the As a result, if a patient can be assigned to a given cluster, Individualized treatment based on a predefined optimized treatment for the target is possible.

[0058] The advantageous embodiments will now be described in conjunction with the enclosed figures. [Brief description of the drawings]

[0059] [Figure 1] FIG. 1 illustrates an exemplary graphical representation of the human body. [Diagram 2] FIG. 1 is an exemplary diagram for navigating medical data. [Diagram 3] FIG. 1 illustrates an exemplary graphical representation of data. [Figure 4] FIG. 1 illustrates an exemplary client-server system that can be used to implement the present invention. [Diagram 5] FIG. 1 illustrates an exemplary interface that allows a user to select a disease. [Figure 6] FIG. 13 is a further exemplary diagram for navigating medical data. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0060] In FIG. 1, an exemplary graphical representation 1 of a human body is shown. Representation 1 is a 3D table. It is live and can be viewed from any direction with corresponding user input. The user can zoom in on a desired area of ​​the representation 1. In other words, the graphic Block representation 1 is an interactive representation, in particular a rotatable and scalable representation. The graphical representation 1 may also be referred to as a "virtual patient."

[0061] Associated with a particular element of the graphic representation 1 is an activatable button 2. For example, activatable button 2 may be associated with the head and another with the hand. The third one is attached to the foot. The activatable button 2 represents 1 and, in turn, are fixed to respective parts of the human body. when the graphical representation 1 is changed, e.g. rotated, and / or When scaled, the activatable buttons 2 ensure that these parts are still identifiable. remain displayed overlapping or adjacent to each part of Representation 1 so long as be.

[0062] When one of the activatable buttons 2 is activated, the button 2 changes color and / or In this way, the user can change the appearance of the activated button. , and thus it is possible to easily recognize the relevant part of the human body.

[0063] As further explained below, the context menu of the activatable button 2 The availability of a context menu depends on the respective activity. This is indicated by the symbol "+" adjacent to the enable button 2.

[0064] FIG. 2 illustrates an example of the foot and toe after activation of the activatable buttons 2 associated with the foot and toe. A context menu 3 appears, with a set of options (in this example, Three options are offered.

[0065] Below this figure is a medical dataset, which is a set of data from multiple patients. and for at least one disease, particularly psoriatic arthritis. The data in the set are associated with the corresponding part of the human body to which the data pertains. an activatable button that is activated by user input in response to activation of the activatable button 2; The function button 2 displays a graphical representation of the data 4 associated with that part of the human body involved. The context menu 3 allows the user to select and / or to select subsets of data associated with each part of the human body. In the illustrated example, the context menu 3 can be used to Symptoms such as dactylitis (a sore on the toe that may be present with slight redness and deformation) This allows the user to select a subset of data that is relevant to the area of ​​interest (referring to a sage-like swelling).

[0066] The data in the dataset may be structured in the form of at least one matrix. Among them may be included the dactylitis scores of the fingers / toes. Each element of the matrix represents a different finger / toe. The matrix may relate to a single patient or to the average patient. In other words, the matrix may contain average scores.

[0067] Further, a context menu (not shown) may be provided for selecting one or more diseases, one or more and / or one or more data sources may be provided to select a treatment for the non- A time control element as shown may be provided, for example in the form of a timeline, to display a graph of the data 4. It is possible to select one or more time points to which the visual representation should be relevant.

[0068] In the example illustrated in Figure 2, the graphical representation of Data 4 is a three-doughnut chart. one for treatment with a 300 mg dose of a given substance; , one regarding treatment with a 150 mg dose of the same substance, and one regarding The percentages are for placebo treatments. This shows the DACTYLITIS RESOLUTION. The graphical representation allows the physician to easily and efficiently select the appropriate treatment, Or it allows the patient to estimate their prospects for recovery.

[0069] Other charts are possible as well. In particular, the graphic representation of the data4 is based It is possible to plot different time snapshots of the evolution of different data features over time. be.

[0070] The graphical representation of the data 4 may also include one or more graphs of the human body or parts thereof. For example, color coding can be used to represent symptoms (e.g. The data can be used to indicate the severity of joint pain (arthritis, joint pain) for various joints. Such a graphical representation is illustrated in Figure 3. The three time snapshots are The graph illustrates the time evolution of stiff or tender joints.

[0071] The dataset may also include one or more photographs (e.g., of the patient's skin). Graphical representation of the data4 is possible (e.g., for specific time points during treatment). data for two or more patients, or for one patient at two or more time points during treatment It is possible to display low-resolution versions of the high-resolution photos of the data sets. When a photo is selected through the force, the high resolution photo can be retrieved and displayed. , efficient searching and retrieval of medical images is possible.

[0072] Instead of raw medical images, realistic representations may also be provided and / or one or more is based on multiple anatomical images (e.g., x-rays, MRIs, CT scans, and / or Angiograms, etc. may also be provided.

[0073] As mentioned above, the context menu 3 is the one that should be related to the data. FIG. 5 shows a selection of one or more such diseases. 1 illustrates an alternative interface for selecting a patient. In particular, the selection screen and associated with different diseases (in this example, psoriatic arthritis and psoriasis, respectively). It is possible for the display to include two or more selectable icons 5 (each associated with the other). By selecting one of the available icons5, the graphical representation will change to show the In addition, the available activatable buttons 2 may be limited to the data available for the selected disease. It is possible to depend on it.

[0074] FIG. 6 shows another exemplary diagram for navigating medical data. As shown in the figure, a graphic representation of the human body 1 is shown next to a graphic representation of data 4. Additionally, an interface that allows the user to select a medication is shown. Interface 6 is provided. Interface 6 is a virtual switch in this example, which is , respectively, allowing switching between drug A and drug B. The virtual switch states Accordingly, the graphical representation of data 4 may be limited to data related to the selected drug. do.

[0075] Moreover, a temporal control element is provided, in particular in the form of a timeline 7 in the example of FIG. The slider is used to select the point in time for which the graphical representation of data 4 should be relevant. A time element 8 is provided, which can be shifted along the timeline 7 and can be selected as a point in time. It is possible.

[0076] The graphical representation of the human body 1 may be animated. For example, it may It is possible to perform a simulation to generate a realistic impression of a human being. The graph representation 1 varies depending on the disease progression and / or the displayed graphic representation of the data. For skin diseases, for example, a graphic representation of the human body1 can be used. The skin of the image can represent the skin condition at a given snapshot in time. .

[0077] The described method can be used, for example, to analyze large-scale medical data in a highly efficient and exemplary manner. Allows users to navigate through data sets (e.g., those derived from clinical trials) Then, for example, different drugs or different application rates may be applied to specific parts of the body. It is possible, for example, to see pathologies and their progression. This allows for the appropriate treatment. It can help the physician in choosing the best treatment for the patient or in estimating the further course of the disease. It is possible to help the patient.

[0078] The present invention may be embodied in a client-server architecture. The invention is implemented on a single computing device, i.e. as a stand-alone solution. In the latter case, the system may be fully embodied as a single computing device. The device includes one or more of the features described below for the client. It is possible to do so.

[0079] A typical client-server architecture for remote services is shown in Figure 4. The configuration is shown diagrammatically in FIG. 1. The configuration includes a 1 The client 100 includes a plurality of clients 100, each of which may be configured to perform a single process, as described below. The server may be implemented in a computing device or a client device. The servers are provided by the service provider and / or cloud provider. The present disclosure may be implemented in a server device, but is not limited to these specific implementations. Instead of being assigned a unique IP address, the local client (device) is assigned a unique IP address by the server. Any configuration that requests a service from a remote server (device) provided to the client. Alternatively, as mentioned above, the present invention can be applied only in the local client. It can be implemented.

[0080] A service may be provided by one or more servers or server devices. This in itself means that it is possible to rely on a distributed system architecture. It is understood that the server may be, for example, a web server as a front end, For simplicity, the following may be included: For this reason, the remote entity providing the service may be a single server or It may be a device, or it may be a distributed or microservices-based system. Regardless of whether the service provider is a third party or not, they will be referred to below as the service provider. A client is not limited to a single client or client device. The client may also be a distributed system. further acting in the environment, for example as an intermediate server or as a server itself; The term client is intended to include any of the above architectures. As used herein, the term refers to an entity 100 (e.g., a client device). The remote entity 200 (e.g., a server device) receives a service from the remote entity 200. It simply indicates that the remote service is provided or received. With respect to It is.

[0081] The client 100 and the service provider 200 each include one or more operatively connected to a client data store and a server data store (not shown) of It can be implemented by storing local information on each client 100 and server 200. It can be used to store information (e.g., application code, application (e.g., input data, input data, output data, and authentication data). For example, it may be stored in a client data store or a server data store.

[0082] The client 100 and the service provider 200 are indicated by arrows. Thus, it is possible to communicate information between each other using the communication framework. The information may include authentication information such as keys and / or signatures to establish a secure communication channel. information, one or more applications (e.g., as code or binaries), Input data and / or configuration data for the execution of remote applications, and The information may include the output data of remote applications. may further include keys and / or signatures for software authentication, as described in Moreover, applications can be executed by an interpreter. The code may be provided as interpreted code.

[0083] IaaS (Infrastructure as a Service) Architecture In the example, a remote application may be provided by a client 100. , and before it is executed by the service provider, the service provider must provide the service via a communication channel. In this case, the remote service may be communicated to the client service provider 200. Installing application code received by a client (for example , compiling) or interpreting, remote access at the service provider's side and executing the received application as an application and The result of the SaaS service may be communicated back to the client 100. In a software as a service (WS-AS) architecture, The remote service is provided by the service provider itself, and in some cases Depending on the input data and / or configuration data received from the client 100, and executing a remote application and communicating the results to the client. This includes:

[0084] A communication protocol used for communication between the client 100 and the service provider 200. The communication framework can implement any well-known communication technique and protocol. The communication framework is based on packet-switched networks (e.g., the Internet). public networks, such as a public network, and private networks, such as a corporate intranet. switched networks (for example, the public switched telephone network) , or a combination of packet-switched and circuit-switched networks (as appropriate) The client-side translator may be implemented as a The server architecture consists of a transmitter, receiver, transceiver, radio, Network interface, baseband processor, antenna, amplifier, filter It is possible to include various common communication elements such as a power supply, a power supply, and a power source. However, embodiments are not limited to these implementations.

[0085] The communications framework accepts, communicates with, and connects to a communications network. It is possible to implement various network interfaces arranged to connect A network interface is a specialization of an input / output interface. The network interface may be, but is not limited to, , Direct Connect, Ethernet (for example, Thick Ethernet, Thin Ethernet, and and twisted pair 10 / 100 / 1000 Base T Ethernet), Token Ring, Wireless Network Interface, Cellular Network Interface IEEE 802.1 1a-x network interface, IEEE 80 2.16 network interface, and IEEE 802.20 network interface It is possible to use connection protocols including a IEEE 802.11a interface. The network interface is used to interact with various communication network types. For example, multiple network interfaces may be used to Communication over multicast, multicast, and unicast networks When processing requirements dictate greater speed and capacity, In this case, a distributed network controller architecture is also used to The communication bandwidth required by the client 100 and the server 200 is pooled and It is possible to balance and otherwise increase the communication network. Networks include, but are not limited to, direct interconnections, secure custom connections, private Networks (e.g., corporate intranets), public networks (e.g., Internet), Personal Area Network (PAN), Local Area Network LAN, Metropolitan Area Network (MAN), Operating Missions as Nodes on the Internet (OMNI) Wide Area Networks (WAN), Wireless Networks, Cellular Networks , and other communication networks, including wired and / or wireless networks The combination of any one of the above is possible.

[0086] As described above, the client 100 and the server 200 (e.g., the communication component Any electronic device that can receive, process, and transmit information (through an Each of the computing devices may include a device that is a Examples of electronic devices include, but are not limited to, client devices, personal computers, Digital assistants (PDAs), mobile computing devices, smartphones mobile phones, e-readers, messaging devices, computers, PC, desktop computer, laptop computer notebook computers, netbook computers, handheld computers computer, tablet computer, server, server array or server farm , Web Server, Network Server, Internet Server, Workstation Network appliances, web appliances, distributed computing systems Systems, Multiprocessor Systems, Processor-Based Systems, Consumer Electronics , programmable consumer electronics, gaming devices, televisions, set-top boxes boxes, wireless access points, base stations, subscriber stations, mobile Subscriber Centers, Radio Network Controllers, Routers, Hubs, Gateways, It may include a bridge, a switch, a machine, or a combination thereof. The form is not limiting in this context.

[0087] The device includes an exemplary client application 110 and a remote application For one or several applications, such as the communication control components, operating systems, in particular the kernel of the operating system and using one or more processing components (i.e., processing circuitry) It is capable of performing processing operations or logic for other software elements that it uses. A processing component or processing circuit is a device, logic device, component, or processor, microprocessor, circuit, processor circuit, circuit element (e.g. (e.g., transistors, resistors, capacitors, and inductors), integrated circuits, Application Specific Integrated Circuits (ASICs), Programmable Logic Devices (PLDs), Digital Digital signal processor (DSP), field programmable gate array (FPGA) , memory unit, logic gate, register, semiconductor device, chip, microchip It can include various hardware elements such as processors, chipsets, etc. Examples of software elements are software components, programs, applications, etc. applications, computer programs, application programs, system programs, Software development programs, machine programs, operating system software A, middleware, firmware, software modules, routines, subroutines , functions, methods, procedures, software interfaces, application program interfaces Interface (API), instruction set, computing code, pewter code, code segment, computer code segment, word, value, symbols, or any combination thereof.

[0088] A device may use one or more communication components to communicate with other devices. The communication component is capable of performing a communication operation or logic for , packet-switched networks (e.g., public networks such as the Internet) networks, and private networks such as corporate intranets), A line-switched network (for example, the Public Switched Telephone Network) or a packet-switched network A combination of switched and circuit-switched networks (with appropriate gateways and Any known communication technique, such as techniques suitable for use with a cellular telephone (such as those provided with a Slater), and A communication component can implement one or more communication protocols. Interface, network interface, network interface card Cards (NICs), radios, wireless transmitters / receivers (transceivers), Such as wired and / or wireless communication media, and physical connectors. The communication elements may include various types of standard communication elements. Without being limited thereto, communication media includes wired and wireless communication media. Examples of hardwire communication media are wires, cables, metal leads, printed circuit boards (PCBs), Backplanes, switch fabrics, semiconductor materials, twisted pair wires, coaxial cables The wireless communication medium may include, for example, a cable, optical fiber, and a propagated signal. Examples of wireless communication include acoustic, radio frequency (RF) spectrum, infrared, and other wireless media. It is possible to include

[0089] The devices communicate with each other through one or more communication components as shown in Figure 1. Such communication signals may be used to communicate with other devices over a communication medium. The device may be internal or external to the device, as desired for a given implementation. It is possible.

[0090] The device may be configured to perform the above-described functions across multiple computing entities. A form of distributed system in which parts of the structure and / or operations can be distributed Examples of distributed systems include, but are not limited to, client-server systems. Bar architecture, 3-tier architecture, N-tier architecture, tightly coupled or clustered architecture, peer-to-peer architecture, master server architecture, Replica architectures, shared database architectures, and other types of distribution The present invention may include a distributed system, although embodiments are not limited in this context.

[0091] The client 100 and / or the server 200 may include a computer as described below. In one embodiment, the computing architecture may include The computing architecture may include portions of an electronic device, and may be implemented as part of an electronic device, examples of which are described above. The embodiments are not limited in this context.

[0092] As used in this application, "device," "component," "client" "Server", "Service Provider" and "Software Provider" The term includes hardware, a combination of hardware and software, software, or running software. These examples are intended to refer to the exemplary computing device described below. For example, a component can be It does not include the processes running on the processor, the processor, the hard disk drive, Multiple storage drives (optical and / or magnetic storage media) , objects, executables, threads of execution, programs, and / or For example, the application running on the server and Both the server and the server can be components. A component can exist within a process and / or thread of execution, A component may be localized on one computer or may be localized on two or more The components may be distributed among multiple computers. For this purpose, the devices may be communicatively coupled to each other by various types of communication media. , which may require one-way or two-way information exchange as appropriate. For example: Components are capable of communicating information in the form of signals communicated over a communications medium. The information can be implemented as signals assigned to various signal lines. In such an allocation, each message is a signal. An embodiment may alternatively use a data message. Messages may be sent across a variety of connections. An exemplary connection is a parallel interface. The interface includes a serial interface, a bus interface, and a digital interface.

[0093] A computing architecture is one or more processors, multi-core Processors, coprocessors, memory units, chipsets, controllers, peripherals Peripherals, interfaces, oscillators, timing devices, video cards, audio such as audio cards, multimedia input / output (I / O) components, and power supplies. However, in practice, The embodiment is not limited to implementation by this computing architecture.

[0094] A computing architecture consists of a processing unit, system memory, and The processing unit may include, but is not limited to, AMD ( Athlon®, Duron® and Opteron® ARM® Application, Embedded and Security processors; IBM® and Motorola® Drag onBall® and PowerPC® processors; IBM and and Sony® Cell processors; Intel® Cell on(R), Core(2) Duo(R), Itanium(R) , Pentium®, Xeon®, and XScale® ) processor; and a variety of commercially available processors, including similar processors. It can be either a dual microprocessor, multi-core processor, The processor and other multi-processor architectures are also used as processing units. obtain.

[0095] The system bus includes, but is not limited to, a bus that transmits data from the system memory to the processing unit. Provides an interface for system components. The system bus is The memory bus (memory controller) can be implemented using one of several commercially available bus architectures. further interconnected to a peripheral bus, and a local bus, The bus structure may be any of several types of bus structures that may be used. The interface adapter connects to the system bus via a slot architecture. An example slot architecture may include, but is not limited to: Accelerated Graphics Port (AGP), Card Bus, (Extended)Industry Standard Architecture ((E)ISA), Micro Channel Architecture(MCA) , NuBus, Peripheral Component Interconnect (Extended)(PCI(X)), PCI Express, and Person al Computer Memory Card International As societies (PCMCIA), etc.

[0096] The computing architecture includes a computer-readable storage medium. A computer readable storage medium may store logic that implements or implements the computer readable storage medium. Examples of storage media include volatile or non-volatile memory, removable or or non-removable memory, erasable or non-erasable memory, and A computer that stores electronic data, including a writable or rewritable memory. Examples of logic include source code and any tangible medium capable of storing the logic. Code, compiled code, interpreted code, executable code, static code Code, dynamic code, object-oriented code, and visual code Any executable computer implemented using any suitable type of code. Also, embodiments may include non-transitory program instructions. At least one embodiment of the present invention includes instructions contained in or on a computer readable medium. It may also be partially implemented as a The present invention may be implemented in a variety of ways to enable performance of the operations described herein.

[0097] System memory can be read-only memory (ROM), random-access memory (RAM), or - (RAM), Dynamic RAM (DRAM), Double-Data-Rate DRAM (DDRAM), Synchronous DRAM (SDRAM), Static RAM (SRAM ), programmable ROM (PROM), erasable programmable ROM (EPROM ), Electrically Erasable Programmable Read-Only Memory (EEPROM), Flash Memory, Polymer memories, such as ferroelectric polymer memories, Ovonic memories, phase Change or ferroelectric memory, silicon-oxide-nitride-oxide e-silicon (SONOS) memory, magnetic or optical cards, devices Arrays, e.g. Redundant Array of Independent Solid-state memory devices, such as RAID drives (for example, USB memory, solid-state drive (SSD), and other devices used to store information One or more faster media, such as any other type of storage medium suitable Various types of computer readable storage media in the form of memory units The system memory may be non-volatile and / or volatile. The Basic Input / Output System (BIOS) may include a non-volatile memory. The information may be stored in

[0098] Computing architectures use internal (or external) hard disk drives. hard disk (HDD), a magnetic disk drive for reading from or writing to a removable magnetic disk Floppy disk drives (FDDs) and removable optical disks (e.g. , CD-ROM, DVD, or Blu-ray) one or more forms of slower memory units, including optical disk drives for The present invention may include various types of computer readable storage media. DD, FDD, and optical disk drive are HDD interfaces, FD interfaces, and The PCI Express interface and the optical drive interface connect to the system bus. The HDD interface for external drive implementations is a universal system. At least one of Real Bus (USB) and IEEE 1394 interface technologies Or it may include both.

[0099] The drives and associated computer-readable media store volatile and / or Non-volatile storage, data structures, and computer-executable instructions For example, multiple program modules provide drive and memory units. The operating system, among other things, may be stored in the unit. The operating system kernel, one or more application programs (referred to herein as , an exemplary client application 1 10 and other program modules, such as an exemplary remote application 210; and program data. In one embodiment, one or more applications The program, other program modules, and program data are disclosed herein. To implement the embodiments, for example, various applications and / or components may be used. It is possible for the system to include a number of components.

[0100] The user can use one or more wired / wireless input devices, e.g. through a keyboard and pointing device (such as a mouse) Other input devices allow users to enter commands and information into the input device. The IR remote control is equipped with a microphone, an infrared (IR) remote control, and a radio frequency (RF) remote control. controller, gamepad, stylus pen, card reader, dongle, fingerprint reader glove, graphic tablet, joystick, keyboard, retina reader touch screen (e.g. capacitive, resistive, etc.), trackball, trackpad These and other inputs may include heads, sensors, and styluses. The input device is connected to the system bus through an input device interface. Often connected to a processing unit, parallel port, IEEE 1394 serial Others, such as ports, game ports, USB ports, and IR interfaces, etc. They may also be connected by an interface.

[0101] Display devices also require an interface (such as a video adapter) ) connected to the system bus. It can be internal or external to the device. In addition to the display device, Computing devices typically have other peripheral output devices (e.g., speakers and printers).

[0102] The computing devices communicate with one another via wired and / or wireless communication. or a logical connection to multiple remote computers (e.g. remote devices) The remote device is capable of operating in a network environment using workstations, server computers, routers, personal computers, Microprocessor-Based Entertainment Appliances The network may be an instance, a peer device or other common network node, typically Generally, many or all of the elements described for computing architecture A logical connection may include a local area network (LAN) and / or a larger Networks, for example, wire / wireless to wide area networks (WANs) Such LAN and WAN networking environments may include is common in offices and companies and is used in enterprise-wide computer networks ( For example, intranets), all of which are part of a global communications network. It is possible to connect to a network (e.g., the Internet).

[0103] When used in a LAN networking environment, the device and / or through a wireless communication network interface or adapter. The adapter provides wired and / or wireless communication to the LAN. It is possible to facilitate communication between the adapter and the wireless functionality. It may also include a wireless access point disposed thereon for communicating with the network.

[0104] When used in a WAN networking environment, the device may include a modem It is possible to connect to a communication server over a WAN, or Other means for establishing communication over N (e.g., via the Internet) A modem can be a wired and / or wireless device, either internal or external. and the modem is connected to the system bus via an input device interface. In a network environment, program modules or portions thereof may The network connection may be stored in a remote memory / storage device. and other means for establishing a communication link between the devices may be used. It will be recognized that:

[0105] Client / server devices are wireless devices that use the IEEE 802 family of standards. ear and wireless devices or entities (e.g., wireless communications For example, a wireless device that is configured to operate with IEEE 802.11 wireless modulation techniques. This may be operable to communicate with at least one Wi-Fi device, among others. i (or Wireless Fidelity), WiMax, and Bluetooth oth™ wireless technology. Therefore, communication is similar to that of a conventional network. It can be a predefined structure of at least two devices. Wi-Fi networks are based on the IEEE 802.11a standard. E 802.11x (a, b, g, n, etc.) is a radio technology that provides secure and reliable Wi-Fi networks provide high-speed wireless connectivity with high reliability. In the past, the Internet and wired networks (which are based on IEEE 802.3 The present invention may be used to connect to a network (using related media and functions).

[0106] The previously discussed embodiments and examples of the present invention have been described separately, but may be modified as described above. Please note that some or all of the features described may be combined in different ways. It should be understood that the embodiments discussed above are not intended to be limiting. They are not intended to be limiting, but rather serve as examples illustrating features and advantages of the present invention. [Explanation of symbols]

[0107] 1. Graphic representation 2 Activatable Buttons 3 Context Menu 4. Data 5 Icons 6. Interface 7. Timeline 8. Slider Element 100 clients 110 Client Applications 200 Servers 210 Remote Applications

Claims

1. Providing a medical data set, the medical data set comprising: and relating to at least one disease; The data in the data set are associated with corresponding portions of the human body to which the data relates. and A graphical representation (1) of the human body or of a part of the human body is displayed on a display device. and displaying the A plurality of activatable buttons ( 2) on the display device; receiving a user input to activate one of the plurality of activatable buttons (2); and the activatable button being activated by the user input upon activation; A graphic of said data (4) associated with that part of the human body to which (2) pertains. displaying the representation on said display device; A computer-implemented method comprising:

2. The computer-implemented method includes, in response to the activation of the activatable button (2), The method further includes the step of displaying a context menu (3), (3) for determining said graphical representation of said data (4); and / or to select a subset of the data associated with each of the portions of the human body. The computer-implemented method of claim 1 , further comprising providing a set of options to the user.

3. The graphical representation of the data (4) includes one or more charts.

3. The computer-implemented method of claim 1 or 2.

4. The medical data set includes time-dependent data, and the graphical representation of the data (4) The data representations include, among other things, representations of different time snapshots of the data. one or more snapshots of time to which said graphical representation of data (4) is to relate; To select a shot, a temporal control element is provided, inter alia, in the form of a timeline; 4. A computer-implemented method according to any one of claims 1 to 3.

5. The graphical representation of the human body (1) or of a part of the human body is interactive. representation, in particular a scalable and / or rotatable representation.

5. The computer-implemented method of any one of claims 1 to 4.

6. The medical dataset relates to two or more diseases, and the method comprises: providing an interface that allows the user to select a disease. and; The activatable button (2) is activated by the user input, Selecting the graphical representation of the data (4) associated with the part of the human body and limiting the data to data related to the disease. The computer-implemented method of claim 1 , further comprising:

7. The medical data set includes two medical data sets used to treat the at least one disease. The method relates to the above-mentioned drug, providing an interface that allows the user to select a medication. and; The activatable button (2) is activated by the user input, Selecting the graphical representation of the data (4) associated with the part of the human body and limiting the data to data related to said drug. The computer-implemented method of claim 1 , further comprising:

8. The data in the data set is compared to a corresponding portion of the human body to which the data relates. The step of associating includes providing at least one matrix for said data for each patient. the elements of the matrix being respectively associated with predetermined portions of the human body. and determining a quantity derived from at least a portion of said data or said data. and inputting into said at least one matrix.

13. The computer-implemented method of claim 1.

9. The data in the data set is compared to a corresponding portion of the human body to which the data relates. The step of associating may include receiving an anatomical score for each patient and / or determining the number of elements of the at least one matrix; and storing them as elements in the at least one matrix. The computer-implemented method of claim 8 , further comprising:

10. The computer-implemented method may include using machine learning techniques and / or artificial neural networks. using a deep neural network, among other things, to identify the 10. The method of claim 9, further comprising determining an anatomical score from the patient-level data. A computer-implemented method for.

11. 11. A method for performing the steps of the method according to any one of claims 1 to 10. A data processing device comprising a processor having a

12. A computer program product comprising instructions, said instructions The present invention relates to a method for implementing the present invention, comprising: causing the computer to carry out the steps of the method according to any one of claims 1 to 4; , computer program products.

13. A computer readable storage medium containing instructions, the instructions The traction is carried out by a computer in accordance with any one of claims 1 to 10. A computer that causes the computer to perform the steps of the method according to any one of claims 1 to 4. A computer-readable storage medium.

Images