Information processing device and program
Patent Information
- Application Number
- JP2020050120
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2020-03-19
- Publication Date
- 2025-03-04
- Estimated Expiration
- 2040-03-19
Smart Images

Figure 0007638626000001 
Figure 0007638626000002 
Figure 0007638626000003
Abstract
Description
[Technical field]
[0001] The embodiments disclosed in the present specification and the drawings include an information processing device, a learning method, and a program. Regarding. [Background technology]
[0002] In recent years, research into technologies using AI (Artificial Intelligence) has been progressing in the field of medical image diagnosis. For example, research is being conducted into automating a series of processes from image generation to image diagnosis using AI functions.
[0003] In processing using the AI functions described above, it is assumed that the network used for image generation is optimized according to the purpose of image diagnosis. For example, it is believed that an optimal network exists depending on the purpose of diagnosis, such as image generation network A being optimal when wanting to see a small tumor, and image generation network B being optimal when metal artifacts are a concern. In this case, it is believed that the workflow will be one in which images are generated using multiple image generation networks optimized according to the purpose. However, when generating images using multiple image generation networks, processing is required for each image generation network, which takes time. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Special Publication No. 2019-520655 Summary of the Invention [Problem to be solved by the invention]
[0005] The problem to be solved by the embodiments disclosed in this specification and the drawings is to shorten the time required to generate information according to a purpose. However, the problem to be solved by the embodiments disclosed in this specification and the drawings is not limited to the above problem. Problems corresponding to the effects of each configuration shown in the embodiments described later can also be positioned as other problems. [Means for solving the problem]
[0006] According to an embodiment, an information processing apparatus includes an acquisition unit and a processing unit. The acquisition unit acquires input data. The processing unit generates a plurality of output data by inputting the input data acquired by the acquisition unit to a model including a common network based on learning using a plurality of teacher data, and a plurality of individual networks located in a subsequent stage of the common network and based on individual learning using each of the plurality of teacher data. [Brief description of the drawings]
[0007] [Figure 1] FIG. 1 is a block diagram showing an example of the configuration of a medical image processing apparatus 1 according to a first embodiment. [Diagram 2] FIG. 1 is a diagram for explaining the configuration of a trained model in the prior art. [Diagram 3] FIG. 1 is a diagram illustrating an example of the configuration of a trained model M according to the first embodiment. [Figure 4] 4 is a flowchart showing an example of processing during operation of the medical image processing apparatus 1 according to the first embodiment. [Diagram 5] 4 is a flowchart showing an example of processing during learning of the medical information processing apparatus 1 according to the first embodiment. [Figure 6] FIG. 4 is a diagram for explaining a first learning of the learning function 43 according to the first embodiment. [Figure 7] FIG. 4 is a diagram for explaining a second learning of the learning function 43 according to the first embodiment. [Figure 8] FIG. 13 is a diagram for explaining a trained model M1 according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0008] Hereinafter, an information processing device, a learning method, and a program according to embodiments will be described with reference to the drawings.
[0009] (First embodiment) [Example of configuration of medical information processing device] FIG. 1 is a block diagram showing an example of a configuration of a medical information processing device 1 according to a first embodiment. The medical information processing device 1 is connected to external devices, such as one or more medical imaging devices 3 and one or more medical databases 5, via a communication network NW so as to be able to transmit and receive data. The medical imaging device 3 is a device that captures medical images of a subject, such as an X-ray diagnostic device or an MRI (Magnetic Resonance Imaging) device. The medical database 5 is a storage device that stores medical information such as electronic medical records. The medical information processing device 1 is an example of an "information processing device".
[0010] The communication network NW refers to any information and communication network that uses electrical communication technology. The communication network NW includes wireless / wired LANs such as hospital backbone LANs (Local Area Networks) and the Internet, as well as telephone communication line networks, optical fiber communication networks, cable communication networks, and satellite communication networks.
[0011] The medical information processing device 1 includes, for example, a communication interface 10, an input interface 20, a display 30, a processing circuit 40, and a memory 50. The communication interface 10 includes, for example, a communication interface such as a NIC (Network Interface Card). The communication interface 10 communicates with external devices such as a medical image capturing device 3 and a medical database 5 via a communication network NW. The communication interface 10 receives medical data such as images captured by the medical image capturing device 3 and raw data of the images from the medical image capturing device 3. The communication interface 10 receives medical data such as electronic medical records from the medical database 5. The communication interface 10 outputs the received medical data to the processing circuit 40. The communication interface 10 may communicate with other external devices connected via the communication network NW under the control of the processing circuit 40.
[0012] The input interface 20 accepts various input operations from an operator, converts the accepted input operations into electrical signals, and outputs the electrical signals to the processing circuit 40. For example, the input interface 20 includes a mouse, a keyboard, a trackball, a switch, a button, a joystick, a touch panel, etc. The input interface 20 may be, for example, a user interface that accepts voice input from a microphone or the like. When the input interface 20 is a touch panel, the input interface 20 may also have a display function of the display 30 described later.
[0013] In this specification, the input interface is not limited to an interface having physical operation parts such as a mouse, a keyboard, etc. For example, an example of the input interface also includes an electrical signal processing circuit that receives an electrical signal corresponding to an input operation from an external input device provided separately from the device and outputs the electrical signal to a control circuit.
[0014] The display 30 displays various types of information. For example, the display 30 displays an image generated by the processing circuit 40, a GUI (Graphical User Interface) for receiving various input operations from an operator, and the like. For example, the display 30 is an LCD (Liquid Crystal Display), a CRT (Cathode Ray Tube) display, an organic EL (Electro Luminescence) display, or the like.
[0015] The processing circuit 40 includes, for example, an acquisition function 41, a learning function 43, a processing function 45, and an output control function 47. The processing circuit 40 realizes these functions by, for example, a hardware processor (computer) executing a program stored in a memory 50 (storage circuit). The acquisition function 41 is an example of an "acquisition unit". The learning function 43 is an example of a "learning unit". The processing function 45 is an example of a "processing unit". Details of each function realized in the processing circuit 40 will be described later.
[0016] The hardware processor means a circuit such as a central processing unit (CPU), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), a programmable logic device (e.g., a simple programmable logic device (SPLD) or a complex programmable logic device (CPLD), or a field programmable gate array (FPGA)). Instead of storing the program in the memory 50, the program may be directly built into the circuit of the hardware processor. In this case, the hardware processor realizes the function by reading and executing the program built into the circuit. The above program may be stored in the memory 50 in advance, or may be stored in a non-transient storage medium such as a DVD or a CD-ROM, and may be installed from the non-transient storage medium to the memory 50 by mounting the non-transient storage medium in a drive device (not shown) of the medical information processing device 1. The hardware processor is not limited to being configured as a single circuit, and may be configured as one hardware processor by combining multiple independent circuits to realize each function. Furthermore, multiple components may be integrated into one hardware processor to realize each function.
[0017] The memory 50 is realized by, for example, a semiconductor memory element such as a random access memory (RAM) or a flash memory, a hard disk, or an optical disk. These non-transient storage media may be realized by other storage devices connected via a communication network NW, such as a network attached storage (NAS) or an external storage server device. The memory 50 may also include a non-transient storage medium such as a read only memory (ROM) or a register. The memory 50 stores, for example, a trained model M generated by the learning function 43 of the processing circuit 40. In addition, the memory 50 stores programs, parameter data, and other data used by the processing circuit 40.
[0018] [Example of processing circuit configuration] Next, a configuration example of the processing circuit 40 will be described. The acquisition function 41 acquires medical data from an external device such as the medical imaging device 3 via the communication interface 10. The medical data includes, for example, an image captured by the medical imaging device 3, raw data of the image, character string information of an electronic medical record, and other information. The acquisition function 41 may store the acquired medical data in the memory 50. The medical data is an example of "input data".
[0019] The learning function 43 performs deep learning based on the training data to generate a trained model M. For example, when medical data is input, the trained model M outputs medical information according to a predetermined purpose. The training data includes a plurality of pairs of input data and output data. For example, the input data may be information such as an image captured by the medical image capturing device 3, raw data of the image, and character string information in an electronic medical record. For example, the output data may be information according to a predetermined purpose.
[0020] The predetermined purpose means, for example, a diagnostic purpose. The diagnostic purpose includes, for example, diagnosing a relatively small tumor using a captured image, diagnosing using an image with few artifacts, diagnosing using an image with few noise, diagnosing using an image with high contrast, diagnosing using an image with high resolution, diagnosing a specific disease such as cancer or cirrhosis, diagnosing a specific body part such as the head or chest, etc. The artifacts include metal artifacts, ring artifacts, and other artifacts caused by the X-ray device.
[0021] The information according to the predetermined purpose output by the trained model M is, for example, an image obtained by correcting an image captured by the medical image capturing device 3 so that specific information is easily visible, information indicating a disease or a lesion location estimated based on character string information in an electronic medical record, etc. For example, if the purpose of diagnosis is "to perform a diagnosis using an image with few artifacts," the information according to the predetermined purpose obtained as a result of inputting an image into the trained model M is an image with reduced artifacts. Also, for example, if the purpose of diagnosis is "to diagnose a specific disease such as cancer or cirrhosis," the information according to the predetermined purpose obtained as a result of inputting an electronic medical record or an image into the trained model M is information indicating the name of the disease, such as "cancer" or "cirrhosis."
[0022] Here, when there are multiple diagnostic purposes, it is necessary to prepare a trained model for each diagnostic purpose. FIG. 2 is a diagram for explaining the configuration of a trained model in the conventional technology. As shown in FIG. 2, for example, when obtaining two patterns of images from medical data D, a first image D1 corresponding to a first diagnostic purpose (e.g., diagnosis using an image with reduced noise) and a second image D2 corresponding to a second diagnostic purpose (e.g., diagnosis using an image with reduced artifacts), it is necessary to prepare a trained model m1 corresponding to the first diagnostic purpose and a trained model m2 corresponding to the second diagnostic purpose, respectively. Here, for example, assuming that the trained model m1 and the trained model m2 each have an eight-layer network structure, in order to obtain the first image D1 and the second image D2, it is necessary to input the medical data D into the trained model m1 and perform arithmetic processing for eight layers, and further input the medical data D into the trained model m2 and perform arithmetic processing for eight layers. That is, arithmetic processing for a total of 16 layers is required. In this way, when multiple trained models are used, calculations are performed for each trained model, which takes time.
[0023] On the other hand, the learning function 43 of this embodiment separates the trained model into a front stage and a rear stage, and generates a trained model M in which the front stage is a network corresponding to processing common to multiple diagnostic purposes (hereinafter referred to as a "common network") and the rear stage is a network corresponding to processing according to each diagnostic purpose (hereinafter referred to as an "individual network"). The common network corresponds to, for example, processing for creating a rough image, and the individual networks correspond to, for example, processing for creating an image subdivided according to the diagnostic purpose. The common network is located on the input layer side of the trained model, and the multiple individual networks are located on the output layer side of the trained model.
[0024] FIG. 3 is a diagram for explaining an example of the configuration of a trained model M according to the first embodiment. As shown in FIG. 3, the trained model M includes a common network CN and a plurality of individual networks UN. The plurality of individual networks UN include, for example, a first individual network UN1 including one or more layers corresponding to a process according to a first diagnostic purpose, and a second individual network UN2 including one or more layers corresponding to a process according to a second diagnostic purpose. The common network CN has, for example, a four-layer network structure, and each of the plurality of individual networks UN has, for example, a four-layer network structure.
[0025] When the trained model M of the present embodiment is used as described above, medical data D is input to the trained model M, and arithmetic processing for four layers is performed using the common network CN, and further, arithmetic processing for four layers is performed using the first individual network UN1 to obtain a first image D1 (first output data), and arithmetic processing for four layers is performed using the second individual network UN2 to obtain a second image D2 (second output data). In this case, arithmetic processing for a total of 12 layers is performed. Therefore, compared with the case where each of the multiple trained models m1 and m2 in the conventional technology shown in FIG. 2 is used, when the trained model M of the present embodiment is used, it is possible to shorten the time required for calculation. The number of layers of the common network CN and the individual network UN is arbitrary.
[0026] The learning function 43 performs learning by updating parameter data of a network included in the model each time teacher data is input so that the result of processing the input data by the model approaches the output data. The parameter data of the network is adjusted and updated by a method such as backpropagation of a convolution neural network (CNN). The learning function 43 may determine that learning is completed when the rate of change of the parameter data converges within a threshold value. The learning function 43 generates a learned model M, for example, in the form of a deep neural network (DNN), based on the learned parameter data.
[0027] The trained model M is stored in the memory 50 and is read out from the memory 50 during operation. The trained model M may be constructed by an integrated circuit such as an Application Specific Integrated Circuit (ASIC) or a Field Programmable Gate Array (FPGA).
[0028] The processing function 45 generates information according to a predetermined purpose by inputting the medical data of the subject acquired by the acquisition function 41 into the trained model M. That is, the processing function 45 generates a plurality of pieces of medical information by inputting the medical data acquired by the acquisition function 41 into the trained model M including a common network CN based on learning using a plurality of pieces of teacher data and a plurality of individual networks UN located after the common network CN and based on individual learning using each of the plurality of pieces of teacher data.
[0029] The processing function 45 performs control to switch the network to be used in the trained model M in accordance with, for example, an instruction of a diagnostic purpose input by an operator via the input interface 20. For example, when an instruction to acquire an image according to a first diagnostic purpose is received, the processing function 45 performs control to use the common network CN and the first individual network UN1 in the trained model M. On the other hand, when an instruction to acquire an image according to a second diagnostic purpose is received, the processing function 45 performs control to use the common network CN and the second individual network UN2 in the trained model M.
[0030] The output control function 47 causes the information corresponding to the predetermined purpose generated by the processing function 45 to be displayed on the display 30. The operator of the medical information processing device 1 can check the information corresponding to the predetermined purpose displayed on the display 30 and perform a desired diagnosis.
[0031] [Operational processing] The processing during operation of the medical information processing device 1 configured as above will be described below. Fig. 4 is a flowchart showing an example of processing during operation of the medical information processing device 1 according to the first embodiment. In the following, a case will be described as an example in which the medical information processing device 1 acquires and processes an image captured by the medical image capturing device 3 as medical data, and outputs an image according to the purpose of diagnosis. In addition, in the following, a case will be described as an example in which the purpose of the first diagnosis is to perform a diagnosis using an image with reduced noise.
[0032] The acquisition function 41 in the processing circuit 40 acquires medical data D, which is an image of a subject, from the medical imaging device 3 via the communication interface 10 (step S100).
[0033] Next, the processing function 45 sets a diagnostic purpose (step S102) based on an instruction from the operator inputted via the input interface 20. For example, when the operator operates the input interface 20 to input a first diagnostic purpose (diagnosis using an image with reduced noise), the processing function 45 sets the first diagnosis as the diagnostic purpose.
[0034] Next, the processing function 45 generates an image according to the diagnostic purpose by inputting the medical data D acquired by the acquisition function 41 into the trained model M (step S104). When the first diagnosis is set as the diagnostic purpose, the processing function 45 performs control so as to use the common network CN and the first individual network UN1 in the trained model M.
[0035] Next, the output control function 47 outputs the image according to the diagnostic purpose generated by the processing function 45 (step S106). For example, the output control function 47 causes the image according to the diagnostic purpose generated by the processing function 45 to be displayed on the display 30. The operator can check the image according to the diagnostic purpose (image with reduced noise) displayed on the display 30 and perform the desired diagnosis. With the above, the processing of this flowchart is completed.
[0036] [Learning process] The process during learning of the medical information processing device 1 configured as above will be described below. Fig. 5 is a flowchart showing an example of the process during learning of the medical information processing device 1 according to the first embodiment. In the following, an example will be described in which teacher data is learned using an image captured by the medical image capturing device 3 as input data and an image modified according to the purpose of diagnosis as output data. In addition, in the following, an example will be described in which the purpose of the first diagnosis is to perform a diagnosis using an image with reduced noise, and the purpose of the second diagnosis is to perform a diagnosis using an image with reduced artifacts.
[0037] As the teacher data, both the first teacher data related to the first diagnostic purpose and the second teacher data related to the second diagnostic purpose are used. The first teacher data includes, for example, a set (k sets) of medical data Dk, which is an image including noise and artifacts as input data, and an image Atk (k is an integer equal to or greater than 1) obtained by removing noise from the medical data Dk as output data. The second teacher data includes, for example, a set (k sets) of medical data Dk, which is an image including noise and artifacts as input data, and an image Btk (k is an integer equal to or greater than 1) obtained by removing artifacts from the medical data Dk as output data. The teacher data may be provided from an external device, or may be provided via the input interface 20 based on the operation of the operator.
[0038] First, the learning function 43 in the processing circuit 40 extracts one pair (k=1, i.e., medical data D1 and image At1) from among the k pairs included in the first teacher data, and performs first learning using teacher data with the medical data D1 as input and the image At1 as output (step S200). FIG. 6 is a diagram for explaining the first learning of the learning function 43 according to the first embodiment. For example, the learning function 43 updates parameter data of a network included in the model so that a result of processing the medical data D1 with the model approaches the image At1. Here, the learning function 43 updates parameter data for the layer P1 including the common network CN and the first individual network UN1. Note that the learning function 43 may extract two or more pairs (for example, two pairs of k=1 and k=2) from among the k pairs included in the first teacher data, and perform the first learning for two or more pairs at once. That is, in the first learning, learning may be performed using at least one data included in the first teacher data.
[0039] Next, the learning function 43 extracts one pair (k=1, i.e., medical data D1 and image Bt1) from among the k pairs included in the second teacher data, and performs second learning using teacher data with the medical data D1 as input and the image Bt1 as output (step S202). FIG. 7 is a diagram for explaining the second learning of the learning function 43 according to the first embodiment. For example, the learning function 43 updates parameter data of the network included in the model so that the result of processing the medical data D1 with the model approaches the image Bt1. Here, the learning function 43 updates parameter data for the layer P2 including the common network CN and the second individual network UN2. Note that the learning function 43 may extract two or more pairs (for example, two pairs of k=1 and k=2) from among the k pairs included in the second teacher data, and perform second learning for two or more pairs at once. In the second learning, learning may be performed using at least one data included in the second teacher data.
[0040] Next, the learning function 43 determines whether or not k has reached N (step S204). If the learning function 43 determines that k has not reached N, it increments the value of k by one (step S206) and repeats the above steps S200, S202, and S204.
[0041] On the other hand, the learning function 43 ends the learning process when it determines that k has reached N. This completes the process of this flowchart.
[0042] In the above learning method, the learning function 43 alternately performs a first learning corresponding to the purpose of the first diagnosis and a second learning corresponding to the purpose of the second diagnosis. That is, the trained model M is generated by alternately performing the first learning using at least one data included in the first teacher data and the second learning using at least one data included in the second teacher data. The trained model M thus generated includes a common network CN based on the first learning and the second learning, a first individual network UN1 based on the first learning, and a second individual network UN2 based on the second learning.
[0043] In the conventional technology, the first learning and the second learning are not alternately repeated as described above, but the first learning using the first teacher data is completed, and then the second learning using the second teacher data is performed. However, in such a conventional learning method, the common network CN is greatly influenced by the second learning performed later, that is, the effect of reducing artifacts, which is the second purpose, becomes large, and the common network CN becomes unsuitable for the processing of noise reduction, which is the first purpose. On the other hand, the learning function 43 of the present embodiment alternates between the first learning and the second learning, so that the common network CN becomes suitable for both purposes.
[0044] In the above example, the same medical data Dk is used as input data for the first learning and the second learning, but different input data may be used. In the above example, the number of data included in the first training data and the number of data included in the second training data are the same, but the number of data may be different. In addition, images are used as training data, but data in other data formats such as raw data may be used.
[0045] As described above, according to the first embodiment, the processing circuit 40 is provided with a model including an acquisition function 41 that acquires medical data, a common network based on learning using a plurality of teacher data, and a plurality of individual networks located after the common network and based on individual learning using each of the plurality of teacher data, and is provided with a processing function 45 that generates a plurality of medical information by inputting the medical data acquired by the acquisition function 41, thereby making it possible to shorten the time required to generate information according to the purpose.
[0046] Second Embodiment The second embodiment will be described below. The medical information processing device 1 of the second embodiment uses a trained model M1 having a different configuration from the trained model M of the first embodiment. The trained model M1 in the first embodiment includes a common network CN and an individual network UN. In contrast, the trained model M1 in the second embodiment has a further hierarchical network structure. Below, the differences from the first embodiment will be mainly described, and the points in common with the first embodiment will be omitted. In the description of the second embodiment, the same parts as those in the first embodiment will be described with the same reference numerals.
[0047] Fig. 8 is a diagram illustrating a trained model M1 according to the second embodiment. As shown in Fig. 8, the trained model M1 has one or more sub-networks SN in addition to a common network CN and an individual network UN. The sub-networks SN are arranged, for example, between the common network CN and the individual network UN.
[0048] In the example shown in Fig. 8, three first individual networks UN1-1 to UN1-3 and two second individual networks UN2-1 and UN2-2 are provided according to the purpose of diagnosis. A first sub-network SN1 is disposed between the common network CN and the first individual networks UN1-1 to UN1-3. A second sub-network SN2 is disposed between the common network CN and the second individual networks UN2-1 to UN2-2.
[0049] For example, when the similarity between the eleventh image D1-1 to the first image D1-3 corresponding to the output data of the first individual networks UN1-1 to UN1-3 and the second images D2-1 and D2-2 corresponding to the output data of the second individual networks UN2-1 and UN2-2 is low, the first sub-network SN1 is arranged between the common network CN and the first individual networks UN1 group, and the second sub-network SN2 is arranged between the common network CN and the second individual networks UN2 group. That is, based on the similarity between images generated according to the purpose of diagnosis, individual networks that output images with high similarity are grouped together as a predetermined individual network group, and a sub-network is provided that connects the individual network group to the common network.
[0050] In the learning process, the learning function 43 generates a trained model M1 having the above-mentioned network structure. Then, the processing function 45 inputs medical data such as images captured by the medical imaging device 3 to the trained model M1 having the above-mentioned network structure, thereby obtaining highly accurate information according to the purpose.
[0051] As described above, according to the second embodiment, the processing circuit 40 is provided with a processing function 45 that generates a plurality of pieces of medical information by inputting the medical data acquired by the acquisition function 41 into a model that includes an acquisition function 41 that acquires medical data, a common network based on learning using a plurality of pieces of teacher data, and a plurality of individual networks that are located after the common network and based on individual learning using each of the plurality of teacher data, thereby making it possible to reduce the time required to generate information according to a purpose. Furthermore, by further hierarchizing the configuration of the trained model, it is possible to obtain information with high accuracy according to a purpose.
[0052] The above-described embodiment can be expressed as follows. A storage device storing a program; a hardware processor; The hardware processor executes the program to acquire input data, and generates a plurality of output data by inputting the acquired input data to a model including a common network based on learning using a plurality of teacher data, and a plurality of individual networks located in a subsequent stage of the common network and based on individual learning using each of the plurality of teacher data. Medical information processing equipment.
[0053] According to at least one of the embodiments described above, the processing circuit 40 is equipped with a processing function 45 that generates multiple pieces of medical information by inputting the medical data acquired by the acquisition function 41 into a model that includes an acquisition function 41 that acquires medical data, a common network based on learning using multiple teacher data, and multiple individual networks that are located after the common network and are based on individual learning using each of the multiple teacher data, thereby making it possible to shorten the time required to generate information according to the purpose.
[0054] Although some embodiments have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope of the invention and its equivalents as described in the claims, as well as in the scope and spirit of the invention. [Explanation of symbols]
[0055] 1 Medical information processing device 3 Medical imaging equipment 5 Medical Database 10 Communication Interface 20 Input Interface 30 Display 40 Processing circuit 50 Memory 41 Acquisition Function 43 Learning Function 45 Processing Functions 47 Output control function M,M1 Trained model
Claims
1. an acquisition unit for acquiring input data which is a medical image; a processing unit that generates a plurality of output data, which are medical images, by inputting the input data acquired by the acquisition unit into a model including a common network based on learning using a plurality of teacher data, and a plurality of individual networks located in a subsequent stage of the common network and based on individual learning using each of the plurality of teacher data; Equipped with the plurality of individual networks are provided in accordance with a plurality of diagnostic purposes, the model further comprising a sub-network located between the common network and the plurality of individual networks; the plurality of individual networks are grouped together into a predetermined individual network group based on a similarity between images generated by each of the plurality of individual networks, and the sub-network is disposed between the common network and the plurality of individual networks so as to connect the individual network group and the common network; Information processing device.
2. The plurality of teacher data include first teacher data and second teacher data, The model is generated by alternately performing a first learning process using at least one data included in the first teacher data and a second learning process using at least one data included in the second teacher data. The information processing device according to claim 1 .
3. the model includes the common network based on the first learning and the second learning, a first individual network based on the first learning, and a second individual network based on the second learning; the processing unit inputs the input data acquired by the acquisition unit to the model, thereby generating first output data output from the first individual network and second output data output from the second individual network. The information processing device according to claim 2 .
4. The common network is located on the input layer side of the model, The plurality of individual networks are located on the output layer side of the model. The information processing device according to claim 1 .
5. A learning unit that learns the plurality of teacher data and generates the model, The information processing device according to claim 1 .
6. On the computer, Obtaining input data which is a medical image; a model including a common network based on learning using a plurality of pieces of teacher data, and a plurality of individual networks located in a subsequent stage of the common network and based on individual learning using each of the plurality of pieces of teacher data, and inputting the acquired input data into the model to generate a plurality of pieces of output data which are medical images; A program, the plurality of individual networks are provided in accordance with a plurality of diagnostic purposes, the model further comprising a sub-network located between the common network and the plurality of individual networks; the plurality of individual networks are grouped together into a predetermined individual network group based on a similarity between images generated by each of the plurality of individual networks, and the sub-network is disposed between the common network and the plurality of individual networks so as to connect the individual network group and the common network; program.
Citation Information
Patent Citations
Neural network and its production
JP1993298274A
Learning method of deep neural network, storage medium storing parameter of subnetwork of deep neural network, and computer program
JP2014229124A
Systems and methods for generating data interpretations in neural networks and related systems
JP2019520655A
Hierarchical Learning of Weights of a Neural Network for Performing Multiple Analyses
US20180225822A1
Neural network learning method, learning device, learned model, and program
WO2019102797A1