Information processing device, information processing method, and program

Abstract

The present invention generates a data generating model capable of generating more diversified data even in a condition where it is difficult to acquire training data retained by another information processing device. An information processing device (10) is provided with: a training data acquisition unit (101) that acquires training data; a generated model information acquisition unit (102) for acquiring first generated model information which is relating to a first data generating model and in which second generated model information relating to a second data generating model different from the first data generating model is reflected; and a data generating model training unit (103) that trains, by using the training data, the first data generating model defined with reference to the first generated model information.

Description

[Technical field]

[0001] The present invention relates to an information processing device. , love The present invention relates to an information processing method and a program. [Background technology]

[0002] There is known a technique for generating a data generation model that generates data by machine learning. For example, Non-Patent Document 1 describes a technique for generating a data generation model that generates data by adversarially learning both a prediction model that predicts the class of data and a discrimination model that discriminates the truth or falsehood of data. Data generated by such a data generation model is used, for example, as learning data for an inference model. [Prior art documents] [Non-patent literature]

[0003] [Non-Patent Document 1] Mullick, Sankha Subhra, Shounak Datta, and Swagatam Das. "Generative Adversarial Minority Oversampling." Proceedings of the IEEE International Conference on Computer Vision. 2019. Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the technology described in the above-mentioned Non-Patent Document 1, there is room for improvement in the diversity of data generated by the data generation model. For example, if learning data can be acquired from other information processing devices when there is a shortage of learning data, the learning efficiency of the data generation model may be improved. However, even in such a case, it may be difficult to actually acquire learning data held by other information processing devices, for example, due to consideration of privacy.

[0005] One aspect of the present invention has been made in consideration of the above problems, and one example of a purpose of the present invention is to provide a technology for generating a data generation model capable of generating more diverse data even in a situation where it is difficult to obtain learning data held by other information processing devices. [Means for solving the problem]

[0006] An information processing device according to one aspect of the present invention includes: learning data acquisition means for acquiring learning data; generation model information acquisition means for acquiring first generation model information relating to a first data generation model, the first generation model information reflecting second generation model information relating to a second data generation model different from the first data generation model; and data generation model learning means for training the first data generation model, which is defined by referring to the first generation model information, using the learning data. 。

[0007] Books An information processing method according to one aspect of the invention includes acquiring training data, acquiring first generation model information relating to a first data generation model, the first generation model information reflecting second generation model information relating to a second data generation model different from the first data generation model, and training the first data generation model, defined with reference to the first generation model information, using the training data. 。

[0008] BooksA program according to one aspect of the invention is a program for causing a computer to function as an information processing device, and causes the computer to function as: learning data acquisition means for acquiring learning data; generation model information acquisition means for acquiring first generation model information relating to a first data generation model, the first generation model information reflecting second generation model information relating to a second data generation model different from the first data generation model; and data generation model learning means for learning the first data generation model, which is defined with reference to the first generation model information, using the learning data. 。 Effect of the Invention

[0009] According to one aspect of the present invention, even in a situation where it is difficult to acquire learning data held by other information processing devices, it is possible to efficiently train a data generation model. [Brief description of the drawings]

[0010] [Figure 1] 1 is a block diagram showing a configuration of an information processing device according to a first exemplary embodiment. [Diagram 2] 1 is a flow chart showing the flow of an information processing method according to the first exemplary embodiment. [Diagram 3] FIG. 11 is a block diagram showing a configuration of an information processing device according to a second exemplary embodiment. [Figure 4] 11 is a flow chart showing the flow of an information processing method according to the second exemplary embodiment. FIG. [Diagram 5] FIG. 11 is a block diagram showing a configuration of an information processing device according to an exemplary embodiment 3. [Figure 6] FIG. 11 is a flow chart showing the flow of an information processing method according to the third exemplary embodiment. [Figure 7] FIG. 11 is a block diagram showing a configuration of an information processing system according to an exemplary embodiment 4. [Figure 8] FIG. 11 is a flow chart showing the flow of an information processing method according to the fourth exemplary embodiment. [Figure 9]FIG. 13 is a block diagram showing a configuration of an information processing system according to an exemplary embodiment 5. [Figure 10] FIG. 13 is a flow diagram illustrating the flow of an information processing method according to the fifth exemplary embodiment. [Figure 11] FIG. 13 is a flow chart illustrating the flow of another information processing method according to the fifth exemplary embodiment. [Figure 12] FIG. 13 is a schematic diagram illustrating a specific example of a data generation model in exemplary embodiment 5. [Figure 13] FIG. 13 is a schematic diagram illustrating another specific example of a data generation model in the fifth exemplary embodiment. [Figure 14] FIG. 13 is a schematic diagram illustrating yet another specific example of a data generation model in the fifth exemplary embodiment. [Figure 15] FIG. 13 is a block diagram showing a configuration of an information processing system according to a sixth exemplary embodiment. [Figure 16] FIG. 13 is a flow diagram illustrating the flow of an information processing method according to the sixth exemplary embodiment. [Figure 17] FIG. 13 is a block diagram showing a configuration of an information processing system according to an exemplary embodiment 7. [Figure 18] FIG. 13 is a block diagram showing a configuration of an information processing system according to an eighth exemplary embodiment. [Figure 19] FIG. 13 is a block diagram showing a configuration of an information processing system according to an exemplary embodiment 9. [Figure 20] FIG. 2 is a diagram illustrating a configuration of a learning data acquisition unit in exemplary embodiment 10. [Figure 21] FIG. 2 is a block diagram showing an example of a hardware configuration of an information processing device and a server in each exemplary embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Example 1 A first exemplary embodiment of the present invention will be described in detail with reference to the drawings. This exemplary embodiment is a basic form of the exemplary embodiments described later.

[0012] The information processing device 10 according to the present exemplary embodiment uses learning data (hereinafter also referred to as data for learning a generation model) to train a data generation model, and can also be called a data generation model training device. Here, how the data generated by the data generation model according to the present exemplary embodiment is used after generation is not limited to the present exemplary embodiment, but as an example, the data can be used to train an inference model.

[0013] For example, a situation may arise in which it is difficult to obtain sufficient inference model training data for training an inference model due to privacy considerations, etc. In such a situation, the information processing device 10 according to the present exemplary embodiment can be used as a device for generating inference model training data for training the inference model.

[0014] On the other hand, even when acquiring data for training a generative model, a situation may arise in which it is difficult to acquire sufficient data for training a generative model due to consideration of privacy, etc. For example, consider a situation in which there are a plurality of information processing devices having the same configuration as the information processing device 10. Even if the data generation model can be trained by directly using data for training a generative model acquired by these plurality of information processing devices, and the learning efficiency of the data generation model can be improved, a situation may arise in which, due to consideration of privacy, the information processing device 10 should avoid acquiring data for training a generative model acquired by another information processing device.

[0015] The information processing device 10 according to this exemplary embodiment is configured to be able to efficiently train a data generation model while maintaining consideration for privacy even in such a situation.

[0016] The information processing device 10 according to this exemplary embodiment will be described in more detail below.

[0017] <Configuration of information processing device> The configuration of an information processing device 10 according to this exemplary embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the configuration of the information processing device 10. As shown in Fig. 1, the information processing device 10 includes a learning data acquisition unit 101, a generation model information acquisition unit 102, and a data generation model learning unit 103.

[0018] Here, the learning data acquisition unit 101 is an example of a learning data acquisition means according to this exemplary embodiment. Also, the generation model information acquisition unit 102 is an example of a generation model information acquisition means according to this exemplary embodiment. Also, the data generation model learning unit 103 is an example of a data generation model learning means according to this exemplary embodiment.

[0019] (Learning data acquisition section) The learning data acquisition unit 101 acquires learning data (data for generative model learning). The generative model learning data is data for learning a first data generation model, which will be described later.

[0020] (Generative model information acquisition unit) The generative model information acquisition unit 102 acquires first generative model information relating to a first data generation model, which will be described later.

[0021] (First data generation model) The first data generation model is a model that generates data. For example, the first data generation model inputs seed data and outputs data. The data generated by the first data generation model is used, for example, as the above-mentioned inference model learning data. However, the use of the data generated by the first data generation model is not limited to this.

[0022] (First generation model information) As an example, the first generation model information includes various parameters that define the first data generation model. In this exemplary embodiment, the first generation model information reflects second generation model information related to a second data generation model different from the first data generation model. This makes it possible to indirectly refer to other generation model learning data without directly acquiring generation model learning data held by another information processing device described later. As an example, when the data generation model learning unit 103 described later is configured to sequentially learn the first data generation model, the first generation model information acquired by the generation model information acquisition unit 102 at a certain time point includes information obtained by referring to the first generation model information that defined the first generation model information before the certain time point and the second generation model information that defined the second generation model information before the certain time point.

[0023] (Second Data Generation Model) The second data generation model is a model different from the first data generation model, and is a model that generates data according to input data. For example, the second generation model is trained using other generation model training data in another information processing device different from the information processing device 10 that generates the first generation model. The other information processing device may be, for example, a device configured similarly to the information processing device 10. The second data generation model may also be configured to be trained sequentially.

[0024] (Second generation model information) The second generative model information includes, for example, various parameters that define the first data generative model.

[0025] In addition, the above-mentioned first generative model information may be configured to reflect other generative model information relating to another data generation model different from both the first data generation model and the second data generation model, or may be configured to reflect further other generative model information.

[0026] (Data generation model learning part) The data generation model learning unit 103 learns a first data generation model defined by referring to the first model information acquired by the generation model information acquisition unit 102, using the generation model learning data as teacher data.

[0027] Here, as an example, the first generative model may be a generative model constructed using a neural network, such as an autoencoder or a generative adversarial network, but this does not limit this exemplary embodiment, and generative models having other configurations may also be used.

[0028] The first model information that specifies the first data generation model after learning by the data generation model learning unit 103 is, as an example, used to generate updated model information by being combined with second model information that specifies a second data generation model different from the first data generation model.

[0029] <Information processing method flow> The information processing method S10 executed by the information processing device 10 configured as above will be described with reference to Fig. 2. Fig. 2 is a flow diagram showing the flow of the information processing method S10. As shown in Fig. 2, the information processing method S10 includes steps S101 to S103.

[0030] (Step S101) In step S101, the learning data acquisition unit 101 acquires generative model learning data.

[0031] (Step S102) In step S102, the generative model information acquisition unit 102 acquires first generative model information.

[0032] (Step S103) In step S103, the data generation model learning unit 103 learns a first data generation model defined by referring to the first model information acquired by the generation model information acquisition unit 102, using the generation model learning data as teacher data.

[0033] The information processing device 10 may sequentially learn the first generative model by sequentially executing the above-mentioned information processing method S10. As an example, the first generative model information acquired by the generative model information acquisition unit 102 in step S102 of the information processing method S10 executed for the nth time (n is a natural number) includes information obtained by taking a weighted average of (i) the first generative model information that defined the first generative model information learned in step S103 before the n-1th time, and (ii) the second generative model information that defined the second generative model information at the time point before the n-1th time.

[0034] <Advantages of this exemplary embodiment> As described above, in the information processing device 10 according to this exemplary embodiment, Acquire training data for a first data generation model (training data for a generative model); Acquiring first generative model information regarding a first data generation model, the first generative model information reflecting second generative model information regarding a second data generation model different from the first data generation model; A first data generation model defined by referring to the acquired first generation model information is trained using training data (generative model training data); The following configuration has been adopted.

[0035] According to the above configuration, it is possible to generate the first data generation model by indirectly using the other generation model training data used by the other information processing device that generated the second generation model, without directly acquiring the other generation model training data. In other words, it is possible to generate the first data generation model that can generate diverse data in the same way as when learning by directly using both the generation model training data acquired by the device itself and the generation model training data acquired by the other information processing device.

[0036] As a result, even in a situation where the information processing device 10 should avoid acquiring other generation model learning data used in other information processing devices, it is possible to generate a first data generation model capable of generating more diverse data. Also, as an example, when data generated by such a first data generation model is used for learning an inference model, it is possible to increase the diversity of inference model learning data, and to obtain an inference model that is more accurate and can handle more diverse data.

[0037] The learning performed by the information processing device 10 according to this exemplary embodiment is also called associative learning, for example, but this term does not limit the exemplary embodiment.

[0038] Exemplary embodiment 2 A second exemplary embodiment of the present invention will be described in detail with reference to the drawings. The information processing device 20 according to this exemplary embodiment is a device that generates data using the first data generation model generated by the information processing device 10 according to the first exemplary embodiment. As an example, the data generated by the information processing device 20 may be data to be used as teacher data in learning an inference model. However, the use of the data generated by the information processing device 20 is not limited to this.

[0039] The information processing device 20 according to this exemplary embodiment will be described in more detail below.

[0040] <Configuration of information processing device> The configuration of the information processing device 20 according to this exemplary embodiment will be described with reference to Fig. 3. Fig. 3 is a block diagram showing the configuration of the information processing device 20. As shown in Fig. 3, the information processing device 20 includes a seed data acquisition unit 201 and a data generation unit 202.

[0041] Here, the seed data acquisition unit 201 is an example of a seed data acquisition means according to this exemplary embodiment, and the data generation unit 202 is an example of a data generation means according to this exemplary embodiment.

[0042] (Seed Data Acquisition Department) The seed data acquisition unit 201 acquires seed data. The seed data is data to be input to the first data generation model. For example, the seed data acquisition unit 201 may acquire the seed data by generating the seed data, or may acquire seed data generated by another functional block (not shown) included in the device or another device (not shown). A specific example of the seed data is not intended to limit the present exemplary embodiment, but may include random noise data as an example. Furthermore, the name "seed data" does not limit the present exemplary embodiment in any way.

[0043] (Data Generation Division) The data generation unit 202 generates data using seed data and a first data generation model. Specifically, the data generation unit 202 generates data by inputting seed data into the first data generation model. The first data generation model is defined with reference to first generation model information. The first generation model information reflects second generation model information related to a second data generation model different from the first data generation model. Details of the first data generation model, the first generation model information, the second data generation model, and the second generation model information are as described in the first exemplary embodiment.

[0044] <Information processing method flow> The information processing method S20 executed by the information processing device 20 configured as above will be described with reference to Fig. 4. Fig. 4 is a flow diagram showing the flow of the information processing method S20. As shown in Fig. 4, the information processing method S20 includes steps S201 to S203.

[0045] (Step S201) In step S201, the seed data acquisition unit 201 acquires seed data. For example, the seed data acquisition unit 201 may acquire randomly generated data as the seed data.

[0046] (Step S202) In step S202, the data generation unit 202 generates data by inputting seed data into a first data generation model. For example, first generation model information regarding the first data generation model generated by the information processing device 10 according to the exemplary embodiment 1 is stored in a memory (not shown) of the information processing device 20. The data generation unit 202 generates data using the first data generation model defined with reference to the first generation model information.

[0047] <Advantages of this exemplary embodiment> As described above, in the information processing device 20 according to this exemplary embodiment, Obtain seed data, Data generation is performed using the acquired seed data and the first data generation model. The first data generation model is defined by first generative model information; The following configuration is adopted: The first generation model information is information about a first data generation model, and is information that reflects a second data generation model that is different from the first data generation model.

[0048] According to the above configuration, by using the first data generation model in which the second generation model information on the second generation model is reflected, it is possible to generate diverse data equivalent to both the first generation model and the generation model training data used to train the second generation model without directly referring to other generation model training data used to train the second generation model. Also, as an example, when the data generated in this exemplary embodiment is used to train an inference model, the diversity of the inference model training data can be increased, and an inference model that is more accurate and can handle a variety of data can be obtained.

[0049] Exemplary embodiment 3 A third exemplary embodiment of the present invention will be described in detail with reference to the drawings. An information processing device 30 according to this exemplary embodiment is a device that generates updated generative model information by referring to generative model information that defines a plurality of data generation models.

[0050] The information processing device 30 according to this exemplary embodiment will be described in more detail below.

[0051] <Configuration of information processing device> The configuration of an information processing device 30 according to this exemplary embodiment will be described with reference to Fig. 5. Fig. 5 is a block diagram showing the configuration of the information processing device 30. As shown in Fig. 5, the information processing device 30 includes a generation model information acquisition unit 301 and a generation model information update unit 302.

[0052] Here, the generative model information acquisition unit 301 is an example of generative model information acquisition means according to this exemplary embodiment, and the generative model information update unit 302 is an example of generative model information update means according to this exemplary embodiment.

[0053] (Generative model information acquisition unit) The generation model information acquisition unit 301 acquires first generation model information on a first data generation model, and second generation model information on a second data generation model different from the first data generation model.

[0054] (First data generation model and second data generation model) The first data generation model is a model that generates data according to input data. The first data generation model is trained using generative model training data in an information processing device different from the information processing device 30. The second data generation model is a model different from the first data generation model, and is a model that generates data according to input data. The second data generation model is trained using generative model training data in an information processing device different from both the information processing device 30 and the information processing device that trains the first data generation model. The generative model training data used to train the first data generation model and the generative model training data used to train the second data generation model are, for example, data acquired independently by each information processing device, and may be different from each other.

[0055] (First generation model information and second generation model information) The first generative model information is information about the first data generation model, and includes, for example, various parameters that define the first data generation model. The second generative model information is information about the first data generation model, and includes, for example, various parameters that define the second data generation model.

[0056] Note that the first generative model information in this exemplary embodiment differs from the first generative model information in the first and second exemplary embodiments, and does not necessarily need to reflect the second generative model information.

[0057] (Generative model information update unit) The generative model information update unit 302 references the first generative model information and the second generative model information to generate updated generative model information.

[0058] (Updated generative model information) The updated generative model information reflects the first generative model information and the second generative model information. For example, the first data generation model and the second data generation model may be newly defined by referring to the updated generative model information.

[0059] <Information processing method flow> An information processing method S30 executed by the information processing device 30 configured as above will be described with reference to Fig. 6. Fig. 6 is a flow diagram showing the flow of the information processing method S30. As shown in Fig. 6, the information processing method S30 includes steps S301 to S203.

[0060] (Step S301) In step S301, the generation model information acquisition unit 301 acquires first generation model information and second generation model information. For example, the generation model information acquisition unit 301 acquires the first generation model information from an information processing device that has trained a first data generation model. Also, for example, the generation model information acquisition unit 301 acquires the second generation model information from an information processing device that has trained a second data generation model.

[0061] (Step S302) In step S302, the generative model information update unit 302 generates updated generative model information by referring to the first generative model information and the second generative model information. As an example, the generative model information update unit 302 may include information obtained by taking a weighted average of the first generative model information and the second generative model information in the updated generative model information.

[0062] <Advantages of this exemplary embodiment> As described above, in the information processing device 30 according to this exemplary embodiment, obtaining first generative model information relating to a first data generation model and second generative model information relating to a second data generation model different from the first data generation model; generating updated generative model information by referring to the first generative model information and the second generative model information; The following configuration has been adopted.

[0063] According to the above configuration, the data generation model defined by referring to the updated generative model information functions as a data generation model trained indirectly using (i) the generative model training data used to train the first data generation model and (ii) the generative model training data used to train the second data generation model.

[0064] As a result, even in a situation where it is necessary to avoid obtaining at least one of the above (i) and (ii) generation model training data, it is possible to generate a data generation model capable of generating more diverse data by indirectly using both. In other words, it is possible to generate a data generation model capable of generating diverse data similar to the case where both (i) and (ii) are directly used for training. In addition, as an example, when data generated using such a data generation model is used for training an inference model, it is possible to increase the diversity of the inference model training data, and to obtain an inference model that is more accurate and can handle more diverse data.

[0065] It should be noted that the information processing device 30 according to this exemplary embodiment functions as a server in federated learning, for example, but this terminology does not limit the exemplary embodiment.

[0066] Exemplary embodiment 4 A fourth exemplary embodiment of the present invention will be described in detail with reference to the drawings. Note that components having the same functions as those described in the first to third exemplary embodiments are denoted by the same reference numerals, and the description thereof will not be repeated.

[0067] <Configuration of information processing system> The configuration of the information processing system 1a according to this exemplary embodiment will be described with reference to FIG. 7. FIG. 7 is a block diagram showing the configuration of the information processing system 1a. As shown in FIG. 7, the information processing system 1a includes a first information processing device 10a and a server 30a. The first information processing device 10a and the server 30a are connected via a network N. Specific examples of the network N include a wireless LAN (Local Area Network), a wired LAN, a WAN, a public line network, a mobile data communication network, or a combination of these networks. However, the configuration of the network N is not limited to this.

[0068] (Configuration of the first information processing device) The first information processing device 10 a includes a learning data acquisition unit 101 , a generation model information acquisition unit 102 , a data generation model learning unit 103 , and a transmission unit 110 .

[0069] The learning data acquisition unit 101 and the data generation model learning unit 103 are configured in the same manner as in the first exemplary embodiment.

[0070] The generative model information acquisition unit 102 is configured in a manner similar to that of the exemplary embodiment 1. However, in this exemplary embodiment, the first generative model information is acquired by receiving it from the server 30a.

[0071] The transmission unit 110 transmits third generative model information regarding the first data generation model after being learned by the data generation model learning unit 103 to the server 30a.

[0072] (Third generation model information) The third generative model information is information about the first data generation model after training, and includes, for example, parameters that define the first data generation model after training.

[0073] (Fourth generation model information) The fourth generative model information is information about the second data generation model after training, and includes, for example, parameters that define the second data generation model after training.

[0074] (Server configuration) The server 30 a includes a generative model information acquisition unit 301 , a generative model information update unit 302 , and a transmission unit 310 .

[0075] (Generative model information acquisition unit) The generative model information acquisition unit 301 is configured in a manner similar to that of the exemplary embodiment 3. However, this exemplary embodiment differs in that third generative model information and fourth generative model information are acquired instead of the first generative model information and second generative model information.

[0076] (Generative model information update unit) The generative model information update unit 302 is configured in a manner similar to that of the exemplary embodiment 3. However, in this exemplary embodiment, the generative model information update unit 302 generates updated generative model information by referring to the third generative model information and the fourth generative model information, instead of referring to the first generative model information and the second generative model information.

[0077] The transmission unit 310 transmits the updated generative model information to the first information processing device 10a.

[0078] <Information processing method flow> The information processing method S1a executed by the information processing system 1a configured as above will be described with reference to FIG. 8. FIG. 8 is a flow diagram showing the flow of the information processing method S1a. As shown in FIG. 8, the information processing method S1a includes S101a to S104a executed by the first information processing device 10a and S301a to S303a executed by the server 30a. The information processing system 1a executes the information processing method S1a sequentially. The information processing method S1a executed for the nth time will be described below. (n=1, 2, ...) (Step S101a) In step S101a, the learning data acquisition unit 101 acquires generative model learning data.

[0079] (Step S102a) In step S102a, the generation model information acquisition unit 102 acquires the first generation model information by receiving it from the server 30a. Note that, when the information processing method S1a is executed for the first time (n=1), the first generation model information received from the server 30a does not necessarily need to be information reflecting the second generation model information. Also, when the information processing method S1a is executed for the second or subsequent time (n≧2), the generation model information acquisition unit 102 acquires, as the first generation model information, the "updated generation model information" transmitted by the server 30a in the previous (n-1th) time step S303a (details will be described later). In this case, the acquired first generation model information (i.e., the previous updated generation model information) is information reflecting the second generation model information (i.e., the previous fourth generation model information).

[0080] (Step S103a) In step S103a, the data generation model learning unit 103 uses the generative model learning data as teacher data to learn a first data generation model defined by referring to the first generation model information acquired by the generation model information acquisition unit 102. For example, the data generation model learning unit 103 executes an update process to update a parameter group defining the first data generation model using the generative model learning data. The data generation model learning unit 103 repeats the update process until the learning converges or a specified number of times is reached. As a result, the first data generation model is learned.

[0081] (Step S104a) In step S104a, the transmission unit 110 transmits third generation model information regarding the first data generation model after learning to the server 30a.

[0082] (Step S301a) In step S301a, the generation model information acquisition unit 301 of the server 30a acquires the third generation model information by receiving it from the first information processing device 10a. Also, the generation model information acquisition unit 301 acquires the fourth generation model information by receiving it from another information processing device that sequentially learns the second data generation model. The other information processing device is a device different from the first information processing device 10a and the server 30a.

[0083] (Step S302a) In step S302a, the generative model information update unit 302 generates updated generative model information by referring to the third generative model information and the fourth generative model information. As an example, the generative model information update unit 302 may include information obtained by taking a weighted average of the third generative model information and the fourth generative model information in the updated generative model information.

[0084] (Step S303a) In step S303a, the transmission unit 310 transmits the updated generative model information to the first information processing device 10a. The “updated generative model information” transmitted in this step is received by the first information processing device 10a as “first generative model information” in step S102a in the next (n+1) information processing method S1a.

[0085] <Advantages of this exemplary embodiment> As described above, in the information processing system 1a according to this exemplary embodiment, The first information processing device 10a Acquire training data for a first data generation model (training data for a generative model); Acquire, as first generative model information relating to the first data generation model, the first generative model information received from the server 30a, which reflects second generative model information relating to a second data generation model different from the first data generation model; A first data generation model defined by referring to the acquired first generation model information is trained using training data (generative model training data); Sending third generative model information regarding the first data generation model after training to the server 30a; The following configuration has been adopted.

[0086] In addition, the server 30a Obtaining third generative model information and fourth generative model information regarding the second data generative model after training; Generate updated generative model information by referring to the third generative model information and the fourth generative model information; Transmitting the updated generative model information to the first information processing device 10a; The following configuration has been adopted.

[0087] According to the above configuration, the first information processing device 10a can acquire the first data generation model, which is defined by referring to the updated generation model information received from the server 30a, as a learning target. As a result, the first information processing device 10a can generate a first data generation model capable of generating more diverse data by indirectly using the other generation model learning data used by the other information processing device that generated the second generation model, without directly acquiring the other generation model learning data used by the other information processing device that generated the second generation model. In other words, the first information processing device 10a can generate a first data generation model capable of generating diverse data in the same manner as when learning is performed by directly using both the generation model learning data acquired by the first information processing device and the generation model learning data acquired by the other information processing device. In addition, as an example, when data generated by such a first data generation model is used for learning an inference model, the diversity of the inference model learning data can be increased, and an inference model that can handle more diverse data with higher accuracy can be obtained.

[0088] Exemplary embodiment 5 The fifth exemplary embodiment of the present invention will be described in detail with reference to the drawings. Note that components having the same functions as those described in the first to fourth exemplary embodiments are denoted by the same reference numerals, and the description thereof will not be repeated.

[0089] <Configuration of information processing system> The configuration of an information processing system 1b according to this exemplary embodiment will be described with reference to Fig. 9. Fig. 9 is a block diagram showing the configuration of the information processing system 1b. The information processing system 1b is a system that eliminates imbalances in a data group for learning an inference model, and learns an inference model using the eliminated data group. In order to eliminate the imbalances, the information processing system 1b generates a data generation model by federated learning, which generates data to be added to the data group.

[0090] 9, the information processing system 1b includes a first information processing device 10b-1, a second information processing device 10b-2, and a server 30b. The first information processing device 10b-1, the second information processing device 10b-2, and the server 30b are connected via a network N.

[0091] (Inference model) In this exemplary embodiment, the inference model is a model that infers the label type of data. When data is input, the inference model outputs information indicating one of a plurality of label types. The first information processing device 10b-1 trains the first inference model using the learning data acquired by the device. The second information processing device 10b-2 trains the second inference model using the learning data acquired by the device. The first inference model and the second inference model are different from each other. Note that the configurations of the plurality of label types that can be indicated by the data output by the first inference model and the second inference model do not necessarily have to be the same. For example, the first inference model may output data indicating one of the labels L1, L3, L4, ..., Ln, and the second inference model may output data indicating one of the labels L2, L3, L4, ..., Ln. Hereinafter, when there is no need to particularly distinguish between the first inference model and the second inference model, they will simply be referred to as "inference models".

[0092] (Learning data, imbalanced data set) The training data is a piece of data acquired for use in training an inference model, and is any one of a plurality of pieces of data included in a data group. Each piece of data included in the data group is labeled with any one of a plurality of label types, and the proportion of data pieces with a certain label type is equal to or less than a predetermined proportion. Hereinafter, such a data group is also referred to as an "imbalanced data group," and the "certain label type" is also referred to as a "minority label type."

[0093] In other words, the imbalanced data group includes a plurality of learning data (data fragments) each having one of a plurality of label types, and at least one of the plurality of label types satisfies the condition of a minority label type. For example, as described above, the condition of a minority label type may be that the proportion of data fragments having the label type is equal to or less than a predetermined proportion, or that the number of data fragments having the label type is smaller than the number of other label types. However, the condition of a minority label type is not limited to the above.

[0094] The first imbalanced data group acquired by the first information processing device 10b-1 and the second imbalanced data group used by the second information processing device 10b-2 are at least partially different from each other. Here, the minority label type in the first imbalanced data group and the minority label type in the second imbalanced data group may or may not be the same. Note that when there is no need to particularly distinguish between the first imbalanced data group and the second imbalanced data group, they will continue to be referred to simply as "imbalanced data groups."

[0095] A specific example of a case where the minority label type in the first imbalanced data group and the second imbalanced data group is not the same will be described. A product image can be given as a specific example of a data piece included in such an imbalanced data group. In this case, the first imbalanced data group and the second imbalanced data group are sets of product images obtained in different production factories. Each product image is labeled with one of "normal product", "defective product pattern A", and "defective product pattern B". In the first imbalanced data group, the ratio of product images labeled with "defective product pattern A" is equal to or less than a predetermined ratio. Or, the number of product images labeled with "defective product pattern A" is less than the number of product images labeled with "normal product" and is less than the number of product images labeled with "defective product pattern B". In this case, the minority label type in the first imbalanced data group is "defective product pattern A". On the other hand, in the second imbalanced data group, the ratio of product images labeled with "defective product pattern B" is equal to or less than a predetermined ratio. Or, the number of product images labeled with "defective product pattern B" is less than the number of product images labeled with "normal products" and is less than the number of product images labeled with "defective product pattern A." In this case, the minority label type in the second imbalanced data group is "defective product pattern B."

[0096] A specific example of a case where the minority label type in the first imbalanced data group and the second imbalanced data group is the same will be described. A specific example of data pieces included in such an imbalanced data group is a communication data piece in a financial system or a communication system. In this case, the first imbalanced data group and the second imbalanced data group are sets of communication data pieces obtained in different systems. There is an example where each communication data piece is labeled with "normal" or "abnormal", and "abnormal" is the minority label type. Another specific example of data pieces is a medical image. In this case, the first imbalanced data group and the second imbalanced data group are sets of medical images obtained in different medical institutions. There is an example where each medical image is labeled with "no lesion" or "lesion", and "lesion" is the minority label type. However, the specific examples of data pieces and minority label types are not limited to those described above.

[0097] (Balanced Data Set) A balanced data group includes multiple learning data (data pieces) each having one of multiple label types, and none of the label types meets the condition of a minority label type. For example, in a balanced data group, the proportion of learning data having each label type is equal to or greater than the proportion of processing, or the number of learning data having each label type is equal.

[0098] The first balanced data group generated by the first information processing device 10b-1 and the second balanced data group generated by the second information processing device 10b-2 are at least partially different from each other. However, when there is no need to particularly distinguish between the first balanced data group and the second balanced data group, they will continue to be referred to simply as "balanced data groups."

[0099] (Data generation model) The data generation model generates data to be used as inference model learning data. The first information processing device 10b-1 generates a first data generation model, and the second information processing device 10b-2 generates a second data generation model. However, when there is no need to distinguish between them, they will be referred to simply as "data generation models." The data generation model is trained to generate learning data that can be teacher data of at least a small number of label types.

[0100] (Data for training generative models) The generative model training data is data for training a data generation model. A part or the whole of the imbalanced data group is used as the generative model training data.

[0101] (Data for inference model training) The inference model training data is data for training an inference model. In this exemplary embodiment, a balanced data group in which imbalance in an imbalanced data group is eliminated is used as the inference model training data.

[0102] (Configuration of the first information processing device) The first information processing device 10b-1 includes a control unit 150-1 and a communication unit 160-1. The control unit 150-1 includes a learning data acquisition unit 101-1, a generation model information acquisition unit 102-1, a data generation model learning unit 103-1, a seed data acquisition unit 201-1, a data generation unit 202-1, an inference model learning unit 203-1, an inference unit 204-1, and a communication unit 160-1.

[0103] (Learning data acquisition section) The learning data acquisition unit 101-1 acquires a first imbalanced data group. The details of the first imbalanced data group are as described above.

[0104] (Generative model information acquisition unit) The generative model information acquisition unit 102-1 is configured in the same manner as the generative model information acquisition unit 102 in the first exemplary embodiment.

[0105] (Data generation model learning part) The data generation model training unit 103-1 trains the first data generation model using at least a part of the first imbalanced data group. For example, the data generation model training unit 103-1 may train at least one of an autoencoder including the first data generation model and a generative adversarial network including the first data generation model. Details of the first data generation model will be described later.

[0106] (Seed Data Acquisition Department) The seed data acquisition unit 201-1 acquires seed data to be input to the first data generation model. For example, the seed data acquisition unit 201-1 may acquire the seed data by generating the seed data, or may acquire seed data generated by another functional block (not shown) included in the device or another device (not shown).

[0107] (Data Generation Division) The data generating unit 202-1 generates data using seed data. Specifically, the data generating unit 202-1 generates learning data that can be teacher data of a minority label type by inputting the seed data to a first data generation model. For example, the data generating unit 202-1 may generate learning data that can be teacher data of a minority label type by inputting the seed data and a condition for identifying a minority label type to the first data generation model. In addition, the data generating unit 202-1 adds the generated learning data to a first imbalanced data group to generate a first balanced data group.

[0108] (Inference model learning part) The inference model training unit 203-1 trains a first inference model by referring to the data generated by the data generation unit 202-1. Specifically, the inference model training unit 203-1 uses the first balanced data group as data for inference model training.

[0109] (Inference part) The inference unit 204-1 performs inference using the inference model generated by the inference unit 204-1.

[0110] (Communications Department) The communication unit 160-1 transmits to the server 30b third generative model information regarding the first data generation model after being learned by the data generation model learning unit 103-1.

[0111] (Configuration of the second information processing device) The second information processing device 10b-2 includes a control unit 150-2 and a communication unit 160-2. The control unit 150-2 includes a learning data acquisition unit 101-2, a generation model information acquisition unit 102-2, a data generation model learning unit 103-2, a seed data acquisition unit 201-2, a data generation unit 202-2, an inference model learning unit 203-2, and an inference unit 204-2.

[0112] The details of the configuration of the second information-processing device 10b-2 can be explained in the same manner as in the description of the configuration of the first information-processing device 10b-1, except that the suffixes "1" and "2" of each reference symbol are interchangeable, "first" and "second" are interchangeable, and "third" and "fourth" are interchangeable.

[0113] (Server configuration) The server 30b includes a control unit 350 and a communication unit 360. The control unit 350 includes a generative model information acquisition unit 301, a generative model information update unit 302, and the communication unit 360.

[0114] (Generative model information acquisition unit) The generative model information acquisition unit 301 is configured in the same manner as the generative model information acquisition unit 301 in the fourth exemplary embodiment.

[0115] (Generative model information update unit) The generative model information updating unit 302 is configured similarly to the generative model information updating unit 302 in exemplary embodiment 4. In particular, in this exemplary embodiment, the generative model information updating unit 302 generates updated generative model information by taking the average of the third generative model information and the fourth generative model information.

[0116] (Communications Department) The communication unit 360 distributes the updated generative model information to the first information processing device 10b-1 and the second information processing device 10b-2.

[0117] <Flow of information processing method for generating data generation models> The information processing method S1b executed by the information processing system 1b configured as above will be described with reference to Fig. 10. Fig. 10 is a flow diagram illustrating the flow of the information processing method S1b. The information processing system 1b generates a data generation model by sequentially executing the information processing method S1b. In Fig. 10, reference characters including (n) at the end indicate each step of the information processing method S1b executed for the nth time, and reference characters including (n+1) at the end indicate each step of the information processing method S1b executed for the n+1th time.

[0118] (Step S101-1) In the n-th step S101-1, the learning data acquisition unit 101-1 of the first information processing device 10b-1 acquires a first imbalanced data set.

[0119] (Step S360) In step S360 for the nth time, the communication unit 360 of the server 30b distributes the generative model information to the first information processing device 10b-1 and the second information processing device 10b-2. If n=1, predetermined information is applied as the generative model information to be distributed. If n≧2, the "updated generative model information" updated in step S302 for the n-1th time is applied as the generative model information to be distributed. Step S302 will be described later.

[0120] (Step S102-1) In step S102-1 of the nth time, the generative model information acquisition unit 102-1 of the first information processing device 10b-1 acquires the generative model information distributed from the server 30b as first generative model information.

[0121] (Step S103-1) In the n-th step S103-1, the data generation model learning unit 103-1 of the first information processing device 10b-1 learns a first data generation model defined by referring to the first generation model information acquired by the generation model information acquisition unit 102-1. In the learning, a part or all of the learning data included in the first imbalanced data group is used as teacher data. Specifically, the data generation model learning unit 103-1 repeats an update process of updating a parameter group using the learning data included in the first imbalanced data group so that the first data generation model outputs learning data that can be teacher data of at least a minority label type, until the learning converges or a specified number of times is reached.

[0122] (Step S160-1) In the n-th step S160-1, the communication unit 160-1 of the first information processing device 10b-1 transmits third generation model information on the first data generation model after learning to the server 30b.

[0123] (Steps S101-2 to S160-2) The second information processing device 10b-2 executes steps S101-2, S102-2, S103-2, and S160-2 for the nth time. Details of these steps can be similarly explained by replacing the "1" and "2" at the end of each reference symbol, replacing "first" and "second", replacing "third" and "fourth" with each other in the explanation of steps S101-1, S102-1, S103-1, and S160-1 executed by the first information processing device 10b-1.

[0124] (Step S301) In step S301 of the (n+1)th iteration, the generative model information acquisition unit 301 of the server 30b acquires the third generative model information by receiving it from the first information processing device 10b-1, and the generative model information acquisition unit 301 acquires the fourth generative model information by receiving it from the second information processing device 10b-2.

[0125] (Step S302) In step S302 for the (n+1)th time, the generative model information update unit 302 generates updated generative model information by referring to the third generative model information and the fourth generative model information. Specifically, the generative model information update unit 302 includes information obtained by taking a weighted average of the third generative model information and the fourth generative model information in the updated generative model information.

[0126] (Step S360) In step S360 of the (n+1)th time, the communication unit 360 distributes the updated generative model information to the first information processing device 10b-1 and the second information processing device 10b-2.

[0127] The first information processing device 10b-1 executes steps S101-1, S102-1, S103-1, and S160-1 for the n+1th time. The second information processing device 10b-2 executes steps S101-2, S102-2, S103-2, and S160-2 for the n+1th time. The details are as described for each step of the nth time.

[0128] In this way, by sequentially executing the information processing method S1b, the first information processing device 10b-1 can indirectly use the learning data acquired by the second information processing device 10b-2 without directly acquiring it. As a result, the first information processing device 10b-1 can generate a first data generation model capable of generating more diverse data. Also, the second information processing device 10b-2 can indirectly use the learning data acquired by the first information processing device 10b-1 without directly acquiring it. As a result, the second information processing device 10b-2 can generate a second data generation model capable of generating more diverse data.

[0129] <Flow of information processing method for generating inference models> The information processing method S20b executed by the first information processing device 10b-1 and the second information processing device 10b-2 will be described with reference to FIG. 11. FIG. 11 is a flow diagram illustrating the flow of the information processing method S20b. The first information processing device 10b-1 executes the information processing method S20b to generate a first inference model. The second information processing device 10b-2 executes the information processing method S20b to generate a second inference model. In the following, an example in which the first information processing device 10b-1 executes the information processing method S20b will be described. An example in which the second information processing device 10b-2 executes the information processing method S20b will be similarly described by replacing the "1" and "2" at the end of each reference symbol with each other and replacing "first" and "second" with each other in the following description. As shown in FIG. 11, the information processing method S20b includes steps S201 to S203.

[0130] (Step S201) In step S201, the seed data acquisition unit 201-1 acquires seed data. Specifically, the seed data acquisition unit 201-1 acquires at least as many seed data as are capable of eliminating the imbalance in the first imbalanced data group. When acquiring a plurality of seed data, it is desirable that these seed data are different from each other. The number capable of eliminating the imbalance is, for example, the difference between the number of learning data to which a minority label type is assigned in the first imbalanced data group and the number that is a predetermined ratio in the first balanced data group after the imbalance is eliminated. For example, it is assumed that the number of learning data to which a minority label type is assigned in the first imbalanced data group is 20, the number of learning data included in the first imbalanced data group is 100, and the predetermined ratio is 0.3. In this case, the number capable of eliminating the imbalance is 15. In addition, the number capable of eliminating the imbalance is, for example, the difference between the number of learning data to which a minority label type is assigned and the number of learning data to which another label type is assigned in the first imbalanced data group. For example, assume that there are two label types, the number of learning data to which the minority label type is assigned is 20, and the number of learning data to which the other label type is assigned is 40. In this case, the number that can eliminate the imbalance is 20. Note that the number that can eliminate the imbalance is not limited to the above example.

[0131] (Step S202) In step S202, the data generation unit 202-1 generates learning data that can be teacher data of minority label types by inputting each seed data generated in step S201 into a first data generation model. The data generation unit 202-1 also adds the generated learning data to a first imbalanced data group. This generates a first balanced data group in which the imbalance in the first imbalanced data group is eliminated.

[0132] (Step S203) In step S203, the inference model training unit 203-1 trains a first inference model. For the training, each piece of training data included in the first balanced data group is used as inference model training data.

[0133] <Examples of data generation models> Here, specific examples of the first data generation model and the second data generation model will be described. In the following, when there is no need to particularly distinguish between the first data generation model and the second data generation model, they will be simply referred to as "data generation models." Furthermore, when there is no need to particularly distinguish between which information processing device each functional block included in the first information processing device 10b-1 and the second information processing device 10b-2 is included in, the "-1" or "-2" at the end of the reference numeral will be omitted.

[0134] (Example 1) A specific example 1 in which the data generation model is realized as a decoder included in a variational autoencoder will be described with reference to FIG. 12. FIG. 12 is a schematic diagram for explaining the specific example 1 of the data generation model. As shown in FIG. 12, the variational autoencoder trained by the data generation model training unit 103 includes an encoder EN1 and a decoder DE1. When data X is input, the encoder EN1 outputs a latent variable Z. When latent variable Z is input, the decoder DE1 outputs data X'. The data generation model training unit 103 inputs data X to which a minority label type is assigned among the training data X acquired by the training data acquisition unit 101 to the encoder EN1, and performs training so that the difference between data X' output by the decoder DE1 and data X becomes smaller. In detail, the data generation model training unit 103 uses the training data X to which a minority label type is assigned to perform an update process for updating a parameter group that defines the encoder EN1 and the decoder DE1 so that the difference between X and X' becomes smaller. Moreover, the data generation model learning unit 103 repeats the update process until the learning converges or a specified number of times is reached. After learning, the decoder DE1 becomes a data generation model that generates learning data that can become teacher data of a minority label type.

[0135] The seed data acquisition unit 201 generates seed data S to be input to the decoder DE1 after learning. Specifically, the seed data acquisition unit 201 inputs learning data X with a minority label type to an encoder EN and generates data within a range indicated by a latent variable Z output as the seed data S. For example, the seed data acquisition unit 201 may generate data randomly sampled within the range indicated by the latent variable Z as the seed data S.

[0136] The data generation unit 202 generates learning data that can be teacher data of a minority label type by inputting the seed data S to the decoder DE2.

[0137] (Example 2) A specific example 2 in which the data generation model is realized as a decoder included in a conditional variational autoencoder will be described with reference to FIG. 13. FIG. 13 is a schematic diagram for explaining the specific example 2 of the data generation model. As shown in FIG. 13, the conditional variational autoencoder trained by the data generation model training unit 103 includes an encoder EN2 and a decoder DE2. When data X and a condition Y are input, the encoder EN2 outputs a latent variable Z. When latent variable Z and a condition Y are input, the decoder DE1 outputs data X'. Here, information specifying a label type is used as the condition Y.

[0138] The data generation model learning unit 103 inputs the learning data X acquired by the learning data acquisition unit 101 to the encoder EN2, and inputs a condition Y that specifies the label type attached to the learning data to the encoder EN2 and the decoder DE2. The data generation model learning unit 103 also performs learning so that the difference between the data X' output by the decoder DE2 and the data X becomes smaller. In detail, the data generation model learning unit 103 uses the learning data X acquired by the learning data acquisition unit 101 to execute an update process for updating a parameter group that defines the encoder EN2 and the decoder DE2 so that the difference between X and X' becomes smaller. The data generation model learning unit 103 also repeats the update process until the learning converges or until a specified number of times is reached. The decoder DE2 after learning becomes a data generation model that generates learning data that can be teacher data of the label type specified by the condition Y.

[0139] The seed data acquisition unit 201 generates seed data S to be input to the decoder DE2 after learning. Specifically, the seed data acquisition unit 201 inputs learning data and a condition Y that specifies a minority label type to the encoder EN, and refers to a latent variable Z outputted, to generate data within a range indicated by the latent variable Z as the seed data S. For example, the seed data acquisition unit 201 may generate data randomly sampled within a range indicated by the latent variable Z as the seed data S.

[0140] The data generation unit 202 generates learning data that can be teacher data for the minority label type by inputting the seed data S and the condition Y for identifying the minority label type to the decoder DE2.

[0141] (Example 3) A specific example 3 in which the data generation model is realized as a generator included in a generative adversarial network will be described with reference to Fig. 14. Fig. 14 is a schematic diagram for explaining the specific example 3 of the data generation model. As shown in Fig. 14, the generative adversarial network trained by the data generation model training unit 103 includes a generator GEN and a discriminator DIS. When noise ND is input, the generator GEN outputs data GD. When data GD and true data X are input, the discriminator DIS judges whether or not the data GD is the true data X.

[0142] The data generation model learning unit 103 inputs noise ND to the generator GEN, and inputs data X with a minority label type from among the learning data X acquired by the learning data acquisition unit 101 to the discriminator DIS. The data generation model learning unit 103 also performs learning so that data GD generated by the generator GEN is determined to be true. In detail, the data generation model learning unit 103 uses the learning data X with a minority label type to execute an update process for updating a group of parameters that define the generator GEN and the discriminator DIS so that data GD is determined to be true. The data generation model learning unit 103 also repeats the update process until the learning converges or until a specified number of times is reached. The generator GEN after learning becomes a data generation model that generates learning data that can be teacher data of a minority label type.

[0143] The seed data acquisition unit 201 generates seed data S to be input to the generator GEN after learning. Specifically, the seed data acquisition unit 201 may generate randomly generated noise as the seed data S.

[0144] The data generation unit 202 generates learning data that can be training data of a minority label type by inputting the seed data S to a trained generator GEN.

[0145] (Other concrete examples) As another specific example, the data generation model is realized as a generator included in a conditional generative adversarial network. In such a specific example, a condition Y is further input to the generator GEN and the discriminator DIS shown in FIG. 14. When the condition Y and the noise ND are input, the generator GEN outputs the data GD. When the condition Y, the data GD, and the true data X are input, the discriminator DIS judges whether the data GD is the true data X or not.

[0146] In this case, the data generation model learning unit 103 inputs any one of the learning data X acquired by the learning data acquisition unit 101 and a condition Y that specifies the label type attached to the data X to the discriminator DIS. The data generation model learning unit 103 also inputs the condition Y that specifies the label type and noise ND to the generator GEN. The data generation model learning unit 103 also performs learning so that the data GD generated by the generator GEN is determined to be true. In detail, the data generation model learning unit 103 uses the learning data X acquired by the learning data acquisition unit 101 to execute an update process that updates a parameter group that defines the generator GEN and the discriminator DIS so that the data GD is determined to be true. The data generation model learning unit 103 also repeats the update process until the learning converges or until a specified number of times is reached. The generator GEN after learning becomes a data generation model that generates learning data that can be teacher data of the label type specified by the condition Y.

[0147] The seed data acquisition unit 201 generates seed data S to be input to the generator GEN after learning. The data generation unit 202 generates learning data that can be teacher data for the minority label type by inputting the seed data S and a condition Y for identifying the minority label type to the decoder DE2.

[0148] <Advantages of this exemplary embodiment> As described above, in this exemplary embodiment, Each of the first information processing device 10b-1 and the second information processing device 10b-2 acquires an imbalanced data set, and generates a data generation model for generating learning data that can be teacher data of a minority label type by associative learning using the acquired imbalanced data set. The following configuration has been adopted.

[0149] According to the above configuration, even if the number of learning data with a minority label type is insufficient, it is possible to indirectly use learning data with a minority label type acquired by another information processing device. As a result, it is possible to generate a data generation model capable of generating more diverse data as learning data that can become teacher data of a minority label type.

[0150] In addition, according to the above configuration, by adding training data that can be teacher data of a minority label type generated using a data generation model, it is possible to generate a balanced data group that eliminates the imbalance in the imbalanced data group. As a result, by using such a balanced data group as data for training an inference model, it is possible to train the inference model with higher accuracy.

[0151] Exemplary embodiment 6 A sixth exemplary embodiment of the present invention will be described in detail with reference to the drawings. Note that components having the same functions as those described in the first to fifth exemplary embodiments are denoted by the same reference numerals, and the description thereof will not be repeated.

[0152] <Configuration of information processing system> The configuration of an information processing system 1c according to this exemplary embodiment will be described with reference to Fig. 15. Fig. 15 is a block diagram showing the configuration of the information processing system 1c. The information processing system 1c is a modified version of the information processing system 1c according to the exemplary embodiment 5, in which an inference model is generated by federated learning. That is, the information processing system 1c generates a data generation model for eliminating imbalance in an imbalanced data group used for learning the inference model by federated learning, and also generates the inference model itself by federated learning.

[0153] 15, the information processing system 1c includes a first information processing device 10c-1, a second information processing device 10c-2, and a server 30c. The first information processing device 10c-1, the second information processing device 10c-2, and the server 30c are connected via a network N.

[0154] (Configuration of the first information processing device) The first information processing device 10c-1 includes an inference model information acquisition unit 205-1 in addition to the same configuration as the first information processing device 10b-1 according to exemplary embodiment 5. In this exemplary embodiment, the configurations of the inference model learning unit 203-1 and the communication unit 160-1 are slightly different from those of exemplary embodiment 5. The other functional blocks are similar to those of exemplary embodiment 5, and therefore detailed description will not be repeated.

[0155] (Inference model information acquisition part) The inference model information acquisition unit 205-1 acquires first inference model information regarding a first inference model.

[0156] (First inference model information) The first inference model information includes, as an example, various parameters that define the first inference model. In this exemplary embodiment, the first inference model information reflects second inference model information regarding a second inference model that is different from the first inference model.

[0157] (Inference model learning part) The inference model learning unit 203-1 learns a first inference model defined by referring to the first inference model information, using the data generated by the data generating unit 202-1. Specifically, the inference model learning unit 203-1 uses a first balanced data group in which the imbalance in the first imbalanced data group is eliminated by adding the data generated by the data generating unit 202-1, for learning the first inference model.

[0158] (Communications Department) In addition to being configured similarly to exemplary embodiment 5, the communication unit 160-1 transmits third inference model information to the server 30c.

[0159] (Third inference model information) The third inference model information is information about the first inference model after training, and includes, for example, parameters that define the first inference model after training.

[0160] (Fourth inference model information) The fourth inference model information is information about the second inference model after training, and includes, for example, parameters that define the second inference model after training.

[0161] (Configuration of the second information processing device) The second information processing device 10c-2 includes an inference model information acquisition unit 205-2 in addition to a configuration similar to that of the second information processing device 10b-2 in exemplary embodiment 5. Details of the configuration of the second information processing device 10c-2 can be explained in the same manner as in the description of the configuration of the first information processing device 10c-1, except that the suffixes "1" and "2" of each reference symbol are interchangeable, "first" and "second" are interchangeable, and "third" and "fourth" are interchangeable.

[0162] (Server configuration) In addition to the same configuration as the server 30b in exemplary embodiment 5, the server 30c includes an inference model information acquisition unit 303 and an inference model information update unit 304. The configuration of the communication unit 360 is slightly different from that in exemplary embodiment 5. The other functional blocks are similar to those in exemplary embodiment 5, so detailed explanations will not be repeated.

[0163] (Inference model information acquisition part) The inference model information acquisition unit 303 acquires third inference model information regarding the first inference model and fourth inference model information regarding the second inference model.

[0164] (Inference model information update section) The inference model information update unit 304 generates updated inference model information by referring to the third inference model information and the fourth inference model information.

[0165] (Updated inference model information) The updated inference model information reflects the third generative model information and the fourth generative model information.

[0166] (Communications Department) In addition to being configured similarly to exemplary embodiment 5, the communication unit 360 distributes updated inference model information to the first information processing device 10c-1 and the second information processing device 10c-2.

[0167] <Flow of information processing method for generating data generation models> The information processing system 1c configured as described above generates a first data generation model and a second data generation model by sequentially executing the information processing method S1b shown in FIG. 10 in the same manner as in exemplary embodiment 5.

[0168] <Flow of information processing method for generating inference models> The information processing method S1c executed by the information processing system 1c will be described with reference to Fig. 16. Fig. 16 is a flow diagram explaining the flow of the information processing method S1c. The information processing system 1c generates an inference model by sequentially executing the information processing method S1c. Note that in Fig. 16, reference characters including (n) at the end indicate each step of the information processing method S1c executed for the nth time, and reference characters including (n+1) at the end indicate each step of the information processing method S1c executed for the n+1th time.

[0169] (Step S201-1) In the n-th step S201-1, the seed data acquisition unit 201-1 of the first information processing device 10c-1 acquires seed data in an amount sufficient to eliminate the imbalance in the first imbalance data group.

[0170] (Step S202-1) In the n-th step S202-1, the data generation unit 202-1 of the first information processing device 10c-1 generates learning data that can be teacher data of a minority label type by inputting each seed data into the first data generation model. As a result, a number of learning data that can eliminate the imbalance is generated. In addition, the data generation unit 202-1 adds the generated learning data to the first imbalanced data group. As a result, a first balanced data group is generated.

[0171] (Step S370) In the n-th step S370, the communication unit 360 of the server 30c distributes the updated inference model information to the first information processing device 10c-1 and the second information processing device 10c-2. If n=1, predetermined information is applied as the inference model information to be distributed. If n≧2, the "updated inference model information" updated in the n-1th step S304 is applied as the inference model information to be distributed. Step S304 will be described later.

[0172] (Step S205-1) In the n-th step S205-1, the inference model information acquisition unit 205-1 of the first information processing device 10c-1 acquires the inference model information distributed from the server 30c as the first inference model information.

[0173] (Step S203-1) In the n-th step S203-1, the inference model learning unit 203-1 of the first information processing device 10c-1 learns a first inference model defined by referring to the first inference model information acquired by the inference model information acquisition unit 205-1. The first balanced data group generated in step S202-1 is used for the learning. Specifically, the data generation model learning unit 103-1 repeats an update process for updating a parameter group of the first inference model using learning data included in the first balanced data group until the learning converges or a specified number of times is reached.

[0174] (Step S170-1) In the n-th step S170-1, the communication unit 160-1 of the first information processing device 10c-1 transmits third inference model information regarding the first inference model after learning to the server 30c.

[0175] (Steps S201-2, S202-2, S205-2, S203-2, S170-2) The second information processing device 10c-2 executes steps S201-2, S202-2, S205-2, S203-2, and S170-2 for the nth time. Details of these steps can be similarly explained by replacing the suffixes "1" and "2" of each reference sign with each other, "first" and "second" with each other, and "third" and "fourth" with each other in the explanation of steps S201-1, S202-1, S205-1, S203-1, and S170-1 executed by the first information processing device 10c-1.

[0176] (Step S303) In the (n+1)th step S303, the inference model information acquisition unit 303 of the server 30c acquires the third inference model information by receiving it from the first information processing device 10c-1. Also, the inference model information acquisition unit 303 acquires the fourth inference model information by receiving it from the second information processing device 10c-2.

[0177] (Step S304) In step S304 for the (n+1)th time, the inference model information update unit 304 generates updated inference model information by referring to the third inference model information and the fourth inference model information. Specifically, the inference model information update unit 304 includes information obtained by taking a weighted average of the third inference model information and the fourth inference model information in the updated inference model information.

[0178] (Step S370) In step S370 for the (n+1)th time, the communication unit 360 distributes the updated inference model information to the first information processing device 10c-1 and the second information processing device 10c-2.

[0179] The first information processing device 10c-1 executes steps S201-1, S202-1, S205-1, S203-1, and S170-1 for the n+1th time. The second information processing device 10c-2 executes steps S201-2, S202-2, S205-2, S203-2, and S170-2 for the n+1th time. The details are as described for each step for the nth time.

[0180] In this way, by sequentially executing the information processing method S1c, the first information processing device 10c-1 can indirectly use the learning data acquired or generated by the second information processing device 10c-2 without directly acquiring it, and can generate the first inference model accurately and efficiently. Also, the second information processing device 10c-2 can indirectly use the learning data acquired or generated by the first information processing device 10c-1 without directly acquiring it, and can generate the second inference model more accurately and efficiently.

[0181] <Advantages of this exemplary embodiment> As described above, in this exemplary embodiment, Each of the first information processing device 10c-1 and the second information processing device 10c-2 performs associative learning of an inference model using a balanced data set in which imbalance is eliminated using a data generation model generated by associative learning.

[0182] According to the above configuration, even if the number of pieces of training data included in a balanced data set in which imbalance has been eliminated using a data generation model is insufficient, it is possible to indirectly use the training data included in a balanced data set generated by another information processing device. As a result, even in a situation in which it is necessary to avoid directly acquiring a balanced data set generated by another information processing device, the amount of training data that can be indirectly referenced has increased, making it possible to efficiently generate an inference model.

[0183] Exemplary Embodiment 7 The seventh exemplary embodiment of the present invention will be described in detail with reference to the drawings. Note that components having the same functions as those described in the first to sixth exemplary embodiments are denoted by the same reference numerals, and the description thereof will not be repeated.

[0184] <Configuration of information processing system> The configuration of an information processing system 1d according to this exemplary embodiment will be described with reference to Fig. 17. Fig. 17 is a block diagram showing the configuration of the information processing system 1d. The information processing system 1d is a modified version of the information processing system 1c according to the sixth exemplary embodiment, in which the server 30c is not included. In other words, the information processing system 1d performs federated learning of a data generation model and an inference model without the intervention of a server.

[0185] 17, an information processing system 1d includes a first information processing device 10d-1 and a second information processing device 10d-2. The first information processing device 10d-1 and the second information processing device 10d-2 are connected to each other via a network N.

[0186] (Configuration of the first information processing device) The first information processing device 10d-1 includes a model information update unit 260-1 in addition to the same configuration as the first information processing device 10c-1 according to the exemplary embodiment 6. In this exemplary embodiment, the configurations of the generation model information acquisition unit 102-1, the data generation model learning unit 103-1, the inference model information acquisition unit 205-1, and the inference model learning unit 203-1 are slightly different from those of the exemplary embodiment 6. The other functional blocks are similar to those of the exemplary embodiment 6, and therefore detailed description will not be repeated.

[0187] (Generative model information acquisition unit) The generation model information acquisition unit 102-1 acquires fourth generation model information from the second information processing device 10d-2. The fourth generation model information is information about the second data generation model after learning by the second information processing device 10d-2.

[0188] (Inference model information acquisition part) The inference model information acquisition unit 205-1 acquires fourth inference model information from the second information processing device 10d-2. The fourth inference model information is information about the second inference model after learning that the second information processing device 10d-2 has learned.

[0189] (Model Information Update Department) The model information update unit 206-1 generates updated generative model information by referring to the third generative model information and the fourth generative model information. Here, the third generative model information is information on the first data generation model after learning by the data generation model learning unit 103-1.

[0190] Furthermore, the model information update unit 206 generates updated inference model information by referring to the third inference model information and the fourth inference model information. Here, the third inference model information is information about the first inference model after learning that the inference model learning unit 203-1 has trained.

[0191] (Data generation model learning part) The data generation model learning unit 103-1 learns a first data generation model defined by the updated generative model information generated by the model information update unit 206-1, using the first imbalanced data set.

[0192] (Inference model learning part) The inference model learning unit 203-1 learns a first inference model defined by the updated inference model information generated by the model information update unit 206-1, using a first balanced data set.

[0193] (Communications Department) The communication unit 160-1 transmits the third generation model information and the third inference model information to the second information processing device 10d-2.

[0194] (Configuration of the second information processing device) The second information processing device 10d-2 includes a model information update unit 260-2 in addition to the same configuration as the second information processing device 10c-2 according to exemplary embodiment 6. Details of the configuration of the second information processing device 10d-2 can be similarly described in the description of the configuration of the first information processing device 10d-1, by replacing the suffixes "1" and "2" of each reference sign with each other, "first" and "second" with each other, and "third" and "fourth" with each other.

[0195] <Flow of information processing method for generating data generation models> The information processing system 1d configured as above generates a first data generation model and a second data generation model by modifying and sequentially executing the information processing method S1b shown in Fig. 10. Specifically, the information processing method S1b is modified so that step S302, which was executed by the server 30b, is executed by the first information processing device 10d-1 and the second information processing device 10d-2 instead. As an example, the first information processing device 10d-1 executes step S302-1 between steps S102-1 and S103-1. The modified information processing method S1b will be described below.

[0196] (Step S101-1) The n-th step S101-1 is the same as in the fifth exemplary embodiment.

[0197] (Step S102-1) Step S102-1 for the nth time is executed when n≧2. In step S102-1 for the nth time, the generative model information acquisition unit 102-1 of the first information processing device 10d-1 acquires fourth generative model information from the second information processing device 10d-2. The fourth generative model information is transmitted from the second information processing device 10d-2 in step S160-2 of the previous time (n−1th time). If n=1, execution of step S102-1 is omitted.

[0198] (Step S302-1) In the n-th step S302-1, the model information update unit 206-1 of the first information processing device 10d-1 generates updated generative model information by referring to the third generative model information and the fourth generative model information. Note that, when n≧2, the third generative model information is information on the first data generation model after learning in the previous (n−1-th) step S103-1. When n=1, the model information update unit 206-1 generates predetermined information as the updated generative model information.

[0199] (Step S103-1) In the n-th step S103-1, the data generation model learning unit 103-1 of the first information processing device 10d-1 learns a first data generation model defined by the updated generation model information, using the first imbalanced data group.

[0200] (Step S160-1) In the n-th step S160-1, the communication unit 160-1 of the first information processing device 10d-1 transmits new third generation model information regarding the first data generation model after learning to the second information processing device 10d-2.

[0201] (Steps S101-2, S102-2, S302-2, S103-2, S160-2) The second information processing device 10d-2 executes steps S101-2, S102-2, S103-2, and S160-2 for the nth time. Details of these steps can be similarly explained by replacing the suffixes "1" and "2" of each reference sign with each other, "first" and "second" with each other, and "third" and "fourth" with each other in the explanation of steps S101-1, S102-1, S302-1, S103-1, and S160-1 executed by the first information processing device 10d-1.

[0202] <Flow of information processing method for generating inference models> The information processing system 1d generates a first inference model and a second inference model by modifying and sequentially executing the information processing method S1c shown in Fig. 16. The information processing method S1c is modified so that step S304, which was executed by the server 30c, is executed by the first information processing device 10d-1 and the second information processing device 10d-2 instead. As an example, the first information processing device 10d-1 executes step S304-1 between steps S205-1 and S203-1. The modified information processing method S1c will be described below.

[0203] (Steps S201-1 to S202-1) Steps S201-1 to S202-1 of the nth time are the same as those in the sixth exemplary embodiment.

[0204] (Step S205-1) The nth step S205-1 is executed when n≧2. In the nth step S205-1, the inference model information acquisition unit 205-1 of the first information processing device 10d-1 acquires fourth inference model information from the second information processing device 10d-2. The fourth inference model information is transmitted from the second information processing device 10d-2 in the previous (n-1th) step S170-2. When n=1, execution of step S205-1 is omitted.

[0205] (Step S304-1) In the nth step S304-1, the model information update unit 206-1 of the first information processing device 10d-1 generates updated inference model information by referring to the third inference model information and the fourth inference model information. Note that, if n≧2, the third inference model information is information about the first inference model after learning in the previous (n-1th) step S203-1. If n=1, the model information update unit 206-1 generates predetermined information as the updated inference model information.

[0206] (Step S203-1) In the n-th step S203-1, the inference model learning unit 203-1 of the first information processing device 10d-1 learns the first inference model defined by the updated inference model information using the first balanced data group.

[0207] (Step S170-1) In the n-th step S170-1, the communication unit 160-1 of the first information processing device 10d-1 transmits new third inference model information regarding the learned first inference model to the second information processing device 10d-2.

[0208] (Steps S201-2, S202-2, S205-2, S304-2, S203-2, S170-2) The second information processing device 10d-2 executes steps S201-2, S202-2, S205-2, S304-2, S203-2, and S170-2 for the nth time. Details of these steps can be similarly explained by replacing the "1" and "2" at the end of each reference symbol with each other, replacing "first" and "second" with each other, and replacing "third" and "fourth" with each other in the explanation of steps S201-1, S202-1, S205-1, S304-1, S203-1, and S170-1 executed by the first information processing device 10d-1.

[0209] <Advantages of this exemplary embodiment> As described above, in the first information processing device 10d-1 of this exemplary embodiment, receiving fourth generation model information regarding the second data generation model after learning from another information processing device; generating updated generative model information by referring to third generative model information and fourth generative model information related to the first data generation model after learning in the own device; Transmitting the third generative model information to another information processing device; The following configuration has been adopted.

[0210] According to the above configuration, the same effects as those of the exemplary embodiment 5 and the exemplary embodiment 6 can be achieved without requiring a server. Note that the exemplary embodiment acquires the fourth generation model information and the fourth inference model information from another information processing device. Therefore, the exemplary embodiment is suitable in a situation where there is little problem in sharing information held by multiple information processing devices.

[0211] Exemplary embodiment 8 An eighth exemplary embodiment of the present invention will be described in detail with reference to the drawings. Note that components having the same functions as those described in the first to seventh exemplary embodiments are denoted by the same reference numerals, and the description thereof will not be repeated.

[0212] <Configuration of information processing system> The configuration of an information processing system 1e according to this exemplary embodiment will be described with reference to Fig. 18. Fig. 18 is a block diagram showing the configuration of the information processing system 1e. The information processing system 1e is an aspect in which the functions of the server 30c in the exemplary embodiment 6 are distributed and realized.

[0213] 18, the information processing system 1e includes a first information processing device 10e-1, a second information processing device 10e-2, a first server 30e, and a second server 40e. The first information processing device 10e-1, the second information processing device 10e-2, the first server 30e, and the second server 40e are connected via a network N.

[0214] (Configuration of the first information processing device) The first information processing device 10e-1 is configured in a manner similar to that of the first information processing device 10c-1 according to the exemplary embodiment 6. However, in this exemplary embodiment, the configurations of the generation model information acquisition unit 102-1, the inference model information acquisition unit 205-1, and the communication unit 160-1 are slightly different from those in the exemplary embodiment 6. The other functional blocks are similar to those in the exemplary embodiment 6, and therefore detailed description thereof will not be repeated.

[0215] (Generative model information acquisition unit) The generative model information acquisition unit 102-1 is configured in a manner similar to that of the sixth exemplary embodiment, except that the source of the acquired first generative model information is the first server 30e.

[0216] (Inference model information acquisition part) The inference model information acquisition unit 205-1 is configured almost the same as in exemplary embodiment 6, except that the source of the first inference model information to be acquired is the second server 40e.

[0217] (Communications Department) The communication unit 160-1 is configured almost the same as in the sixth exemplary embodiment, except that the destination of the third generation model information is the first server 30e. Also, the destination of the third inference model information is the second server 40e.

[0218] (Configuration of the second information processing device) The second information processing device 10e-2 is configured in a manner similar to that of the second information processing device 10c-2 according to the sixth exemplary embodiment. The details of the configuration of the second information processing device 10e-2 can be explained in a similar manner to that of the first information processing device 10e-1, except that the suffixes "1" and "2" of each reference character are replaced with each other, "first" and "second" are replaced with each other, and "third" and "fourth" are replaced with each other. However, "first server" and "second server" are not replaced with each other.

[0219] (First server configuration) The first server 30e functions as a server in the federated learning of the data generation model. The first server 30e has a generation model information acquisition unit 301, a generation model information update unit 302, and a communication unit 360, among the functional blocks included in the server 30c according to the sixth exemplary embodiment. The details of each of these functional blocks are the same as those in the sixth exemplary embodiment.

[0220] (Configuring the second server) The second server 40e functions as a server in the federated learning of the inference model. The second server 40e is a device different from the first server 30e. The second server 40e has an inference model information acquisition unit 303, an inference model information update unit 304, and a communication unit 460, among the functional blocks included in the server 30c according to the sixth exemplary embodiment. The details of each of these functional blocks are the same as those in the sixth exemplary embodiment.

[0221] <Flow of information processing method for generating data generation models> The information processing system 1e configured as above generates a first data generation model and a second data generation model by sequentially executing the information processing method S1b shown in Fig. 10, similarly to the exemplary embodiment 5. However, in this exemplary embodiment, each step executed by the server 30b in the information processing method S1b is executed by the first server 30e.

[0222] <Flow of information processing method for generating inference models> The information processing system 1e configured as described above generates a first inference model and a second inference model by sequentially executing the information processing method S1c shown in Fig. 16, similarly to the exemplary embodiment 6. However, in this exemplary embodiment, each step executed by the server 30c in the information processing method S1c is executed by the second server 40e.

[0223] <Advantages of this exemplary embodiment> As described above, in this exemplary embodiment, A server that performs federated learning of a data generation model and a server that performs federated learning of an inference model using a balanced data set that has eliminated imbalances are realized by different devices. The following configuration has been adopted.

[0224] According to the above configuration, the load of the server required to achieve the same effect as in the sixth exemplary embodiment can be distributed. In addition, a device suitable for the respective loads can be applied as each server. For example, a case can be considered in which a plurality of information processing devices including a first information processing device 10e-1 and a second information processing device 10e-2 participate in the federated learning of the data generation model and the federated learning of the inference model. In such a case, the number of information processing devices participating in the federated learning of the data generation model and the number of information processing devices participating in the federated learning of the inference model may be significantly different. In this case, it is assumed that the loads of the first server 30e and the second server 40e are significantly different. In such a case, a device suitable for the respective loads can be applied as the first server 30e and the second server 40e.

[0225] Exemplary Embodiment 9 A ninth exemplary embodiment of the present invention will be described in detail with reference to the drawings. Note that components having the same functions as those described in the first to eighth exemplary embodiments are denoted by the same reference numerals, and the description thereof will not be repeated.

[0226] <Configuration of information processing system> The configuration of the information processing system 1f according to this exemplary embodiment will be described with reference to FIG. 19. FIG. 19 is a block diagram showing the configuration of the information processing system 1f. The information processing system 1f is an embodiment in which the functions of the server 30b in the information processing system 1b according to the exemplary embodiment 5 are distributed and realized. Here, the exemplary embodiment 5 is an example of a form that takes into consideration a situation in which the clients (the first information processing device 10b-1 and the second information processing device 10b-2) of the federated learning should avoid directly referring to information acquired and generated by other information processing devices. This exemplary embodiment is modified to realize an example of a form that further takes into consideration a situation in which the server should avoid directly referring to information acquired and generated by each client in the federated learning.

[0227] 19, the information processing system 1f includes a first information processing device 10f-1, a second information processing device 10f-2, a first server 30f-1, a second server 30f-2, and a third server 30f-3. The first information processing device 10f-1, the second information processing device 10f-2, the first server 30f-1, the second server 30f-2, and the third server 30f-3 are connected via a network N.

[0228] (Data fragment of generative model information) In this exemplary embodiment, data pieces generated from generative model information are transmitted and received between federated learning clients (first information processing device 10f-1 and second information processing device 10f-2) and servers (first server 30f-1, second server 30f-2, and third server 30f-3).

[0229] Here, it is assumed that three data fragments A, B, and C are generated from the generative model information, but the number of data fragments is not limited to this. Data fragment A, B, and C are different pieces of information and are used to generate generative model information. Data fragment A, B, and C cannot restore generative model information by referring to each of them alone or two of them, but they are pieces of information that can generate generative model information by referring to all of them. For example, data fragments A to C may be pieces of data that are randomly divided into three so that the sum of the generative model information does not change.

[0230] (Overview of federated learning using data fragments) Each client generates data pieces A to C from generative model information related to the generative model trained by the client, and distributes and transmits the data pieces to each server. Each server does not receive all of data pieces A, B, and C from one client, and therefore cannot directly refer to the original generative model information. Each server integrates data pieces A (or data pieces B and C) received from each client to generate integrated data pieces A (or data pieces B and C). Each client can obtain integrated data pieces A, B, and C from two or more servers. Each client can restore updated generative model information by referring to integrated data pieces A, B, and C.

[0231] (Configuration of the first information processing device) The first information processing device 10f-1 is configured in a manner similar to that of the first information processing device 10b-1 according to the exemplary embodiment 5. However, in this exemplary embodiment, the configurations of the generative model information acquisition unit 102-1 and the communication unit 160-1 are slightly different from those in the exemplary embodiment 5. As the other functional blocks are similar to those in the exemplary embodiment 5, detailed description thereof will not be repeated.

[0232] (Communications Department) The communication unit 160-1 generates third data pieces A to C from third generation model information regarding the updated first data generation model. The communication unit 160-1 also transmits the third data pieces A and B to the first server 30f-1. The communication unit 160-1 also transmits the third data pieces B and C to the second server 30f-2. The communication unit 160-1 also transmits the third data pieces C and A to the third server 30f-3. The third data pieces A to C are applied as "first data pieces A to C" in each server.

[0233] (Generative model information acquisition unit) The generative model information acquisition unit 102-1 acquires the integrated data fragment A, the integrated data fragment B, and the integrated data fragment C by receiving them from at least two of the first server 30f-1, the second server 30f-2, and the third server 30f-3. The generative model information acquisition unit 102-1 also generates updated first generative model information by referring to the integrated data fragment A, the integrated data fragment B, and the integrated data fragment C. Here, the integrated data fragment A is the sum of the first data fragment A and the second data fragment A. The integrated data fragment B is the sum of the first data fragment B and the second data fragment B. The integrated data fragment C is the sum of the first data fragment C and the second data fragment C. The generative model information acquisition unit 102-1 obtains the average of the sum of the first data pieces A to C (i.e., the first generative model information) and the sum of the second data pieces A to C (i.e., the second generative model information) by dividing the sum of the integrated data pieces A, B, and C by the total number of information processing devices 10 (2 in this case). The generative model information acquisition unit 102-1 then sets this average as the updated first generative model information. The updated first generative model information reflects the second data pieces A to C (i.e., the second generative model information).

[0234] (Configuration of the second information processing device) The second information processing device 10f-2 is configured in a manner similar to that of the second information processing device 10b-2 according to the fifth exemplary embodiment. Details of the differences from the fifth exemplary embodiment will be described in the same manner as in the description of the configuration of the first information processing device 10f-1, except that the suffixes "1" and "2" of each reference sign are replaced with each other, "first" and "second" are replaced with each other, and "third" and "fourth" are replaced with each other. However, the "first server", "second server", and "third server" are not replaced with each other.

[0235] (First server configuration) The first server 30f-1 functions as one of a plurality of distributed servers in the federated learning of the data generation model. The first server 30f-1 includes a control unit 350-1 and a communication unit 360-1. The control unit 350-1 includes a generation model information acquisition unit 301-1 and a generation model information update unit 302-1.

[0236] (Generative model information acquisition unit) The generative model information acquisition unit 301-1 receives first data pieces A and B from the first information processing device 10f-1. Also, the generative model information acquisition unit 301-1 receives second data pieces A and B from the second information processing device 10f-2.

[0237] (Generative model information update unit) The generative model information updating unit 302-1 integrates the first data fragment A and the second data fragment A to generate a post-integration data fragment A. The generative model information updating unit 302-1 also integrates the first data fragment B and the second data fragment B to generate a post-integration data fragment B. As described above, here, the sum of the first data fragment A (or data fragment B) and the second data fragment A (or data fragment B) is applied as the post-integration data fragment A (or data fragment B).

[0238] (Communications Department) The communication unit 360-1 distributes the integrated data fragment A and the integrated data fragment B in response to a request from one or both of the first information processing device 10f-1 and the second information processing device 10f-2.

[0239] (Configuring the second server) The second server 30f-2 functions as one of a plurality of distributed servers in the federated learning of the data generation model. The second server 30f-2 includes a control unit 350-2 and a communication unit 360-2. The control unit 350-2 includes a generation model information acquisition unit 301-2 and a generation model information update unit 302-2.

[0240] (Generative model information acquisition unit) The generative model information acquisition unit 301-2 receives the first data pieces B and C from the first information processing device 10f-1. Also, the generative model information acquisition unit 301-2 receives the second data pieces B and C from the second information processing device 10f-2.

[0241] (Generative model information update unit) The generative model information updating unit 302-2 integrates the first data fragment B and the second data fragment B to generate a post-integration data fragment B. The generative model information updating unit 302-2 also integrates the first data fragment C and the second data fragment C to generate a post-integration data fragment C. As described above, here, the sum of the first data fragment B (or data fragment C) and the second data fragment B (or data fragment C) is applied as the post-integration data fragment B (or data fragment C).

[0242] (Communications Department) The communication unit 360-2 distributes the integrated data fragment B and the integrated data fragment C in response to a request from one or both of the first information processing device 10f-1 and the second information processing device 10f-2.

[0243] (Third Server Configuration) The third server 30f-3 functions as one of a plurality of distributed servers in the federated learning of the data generation model. The third server 30f-3 includes a control unit 350-3 and a communication unit 360-3. The control unit 350-3 includes a generation model information acquisition unit 301-3 and a generation model information update unit 302-3.

[0244] (Generative model information acquisition unit) The generative model information acquisition unit 301-3 receives the first data pieces C and A from the first information processing device 10f-1. Also, the generative model information acquisition unit 301-3 receives the second data pieces C and A from the second information processing device 10f-2.

[0245] (Generative model information update unit) The generative model information updating unit 302-3 references the first data fragment C and the second data fragment C to generate a post-integration data fragment C. The generative model information updating unit 302-3 also integrates the first data fragment A and the second data fragment A to generate a post-integration data fragment A. As described above, here, the sum of the first data fragment C (or data fragment A) and the second data fragment C (or data fragment A) is applied as the post-integration data fragment C (or data fragment A).

[0246] (Communications Department) The communication unit 360-3 distributes the integrated data fragment C and the integrated data fragment A in response to a request from one or both of the first information processing device 10f-1 and the second information processing device 10f-2.

[0247] <Flow of information processing method for generating data generation models> The information processing system 1f configured as above generates a first data generation model and a second data generation model by modifying and sequentially executing the information processing method S1b shown in FIG.

[0248] Specifically, the information processing method S1b is modified so that the first server 30f-1, the second server 30f-2, and the third server 30f-3 execute steps S301, S302, and S360, respectively. The operations of the first server 30f-1, the second server 30f-2, and the third server 30f-3 in each of these steps can be similarly explained by replacing "third generative model information" with "first data piece," "fourth generative model information" with "second data piece," and "updated generative model information" with "integrated data piece" in the explanation of steps S301, S302, and S360 in FIG. 10. In addition, in the information processing method S1b, the operation of step S102-1 is modified so that the first generative model information is generated by referring to the integrated data pieces A to C. Furthermore, the operation of step S160-1 is modified so as to transmit two each of the third data pieces A to C generated from the third generative model information to different servers (the first server 30f-1, the second server 30f-2, and the third server 30f-3). Furthermore, the operation of step S160-2 is modified so as to transmit two each of the fourth data pieces A to C generated from the fourth generative model information to different servers (the first server 30f-1, the second server 30f-2, and the third server 30f-3).

[0249] <Advantages of this exemplary embodiment> As described above, in this exemplary embodiment, A server that performs federated learning of data generation models is distributed across multiple different devices. The following configuration has been adopted.

[0250] Here, for example, due to consideration of privacy, there are cases where it is difficult for the server itself in the federated learning to acquire information held by each information processing device. In this case, it may be undesirable for the server to directly acquire the third generation model information and the fourth generation model information. According to the above configuration, the first server 30f-1, the second server 30f-2, and the third server 30f-3 do not directly acquire information on the first generation model after learning and information on the second generation model after learning. On the other hand, the first information processing device 10f-1 and the second information processing device 10f-2 can generate updated generation model information reflecting information on the first generation model after learning and information on the second generation model after learning by referring to information received from each server. Therefore, the same effect as that of the exemplary embodiment 5 can be achieved.

[0251] In the present exemplary embodiment, the function of the server 30b in the fifth exemplary embodiment is distributed to three servers. However, the function of the server 30b may be distributed to four or more servers. In this case, the first information processing device 10f-1 and the second information processing device 10f-2 each refer to the generation model information on the data generation model after learning, generate four or more pieces of data A, B, C, ..., and distribute and transmit a part of each of the pieces to each server.

[0252] In addition, the division and restoration method of generative model information performed by the information processing system 1f according to this exemplary embodiment is also referred to as multi-party computation, as an example, but this term does not limit this exemplary embodiment.

[0253] Exemplary Embodiment 10 A tenth exemplary embodiment of the present invention will be described in detail with reference to the drawings. This exemplary embodiment is an embodiment in which the learning data acquisition units 101-1 and 101-2 are modified in the first information processing device (10b-1, 10c-1, 10d-1, 10e-1, 10f-1) and the second information processing device (10b-2, 10c-2, 10d-2, 10e-2, 10f-2) according to any one of the fifth to ninth exemplary embodiments. In the following description, the "-1" and "-2" at the end of the reference numerals will be omitted as appropriate when there is no need to distinguish between the first information processing device and the second information processing device. The learning data acquisition unit 101 in this exemplary embodiment will be described with reference to FIG. 20. FIG. 20 is a diagram showing the configuration of the learning data acquisition unit 101. Since the other configurations and the flow of the information processing method are as described in each exemplary embodiment, detailed description will be omitted.

[0254] (Learning data selection unit) 20, the learning data acquisition unit 101 includes a learning data selection unit 111. The learning data selection unit 111 is an example of a selection means according to this exemplary embodiment. The learning data selection unit 111 selects an imbalanced data group from a plurality of data group candidates.

[0255] For example, the learning data selection unit 111 may select data that satisfies the condition of being an imbalanced data group from among data set A, data set B, data set C, ... stored in the storage unit SR. For example, such a condition may be the condition of the above-mentioned minority label type. Note that the storage unit SR may be included in the information processing device 10b, 10c, 10d, 10e, or 10f, or may be included in an external device.

[0256] <Advantages of this exemplary embodiment> As described above, in this exemplary embodiment, Select an imbalanced data set to be used for training the data generation model from multiple data set candidates; The following configuration has been adopted.

[0257] According to the above configuration, each information processing device selects its own data set so as to eliminate the imbalance as a whole, so that the data generation model can be trained more stably.

[0258] [Modifications] Each of the above-mentioned exemplary embodiments has been described as including one or two information processing devices. Not limited to this, each of the exemplary embodiments can be modified to include three or more information processing devices. This allows each information processing device to generate a data generation model by indirectly using learning data used in more other information processing devices without directly acquiring the learning data.

[0259] In the above-described exemplary embodiments 6 to 9, the functional blocks included in each of the two information processing devices (the first information processing device and the second information processing device) may be distributed among a plurality of devices. For example, the functional blocks included in the first information processing device (or the second information processing device) may be distributed among (i) a device including a functional block related to learning the data generation model (a learning data acquisition unit, a generation model information acquisition unit, and a data generation model learning unit), (ii) a device including a functional block related to data generation (a seed data acquisition unit, and a data generation unit), (iii) a device including a functional block related to learning the inference model (an inference model information acquisition unit, and an inference model learning unit), and (iv) a device including a functional block related to inference (an inference unit).

[0260] [Software implementation example] Some or all of the functions of information processing devices 10, 10a, 10b-1, 10b-2, 10c-1, 10c-2, 10d-1, 10d-2, 10e-1, 10e-2, 10f-1, 10f-2, 20, and servers 30, 30a, 30b, 30c, 30d, 30e, 30f, 40e, and 50f (hereinafter referred to as each information processing device 10 to 20 and each server 30 to 50) may be realized by hardware such as an integrated circuit (IC chip), or by software.

[0261] In the latter case, each of the information processing devices 10-20 and each of the servers 30-50 described above is realized by, for example, a computer that executes instructions of a program, which is software that realizes each function. An example of such a computer (hereinafter, referred to as computer C) is shown in FIG. 21. The computer C includes at least one processor C1 and at least one memory C2. The memory C2 stores a program P for operating the computer C as each of the information processing devices 10-20 and each of the servers 30-50. In the computer C, the processor C1 reads and executes the program P from the memory C2, thereby realizing each function of the information processing devices 10-20 and each of the servers 30-50.

[0262] The processor C1 may be, for example, a central processing unit (CPU), a graphic processing unit (GPU), a digital signal processor (DSP), a micro processing unit (MPU), a floating point number processing unit (FPU), a physics processing unit (PPU), a microcontroller, or a combination of these. The memory C2 may be, for example, a flash memory, a hard disk drive (HDD), a solid state drive (SSD), or a combination of these.

[0263] The computer C may further include a RAM (Random Access Memory) for expanding the program P during execution and for temporarily storing various data. The computer C may further include a communication interface for transmitting and receiving data to and from other devices. The computer C may further include an input / output interface for connecting input / output devices such as a keyboard, a mouse, a display, and a printer.

[0264] Furthermore, the program P can be recorded on a non-transitory tangible recording medium M that can be read by the computer C. Such a recording medium M can be, for example, a tape, a disk, a card, a semiconductor memory, or a programmable logic circuit. The computer C can obtain the program P via such a recording medium M. Furthermore, the program P can be transmitted via a transmission medium. Such a transmission medium can be, for example, a communication network or broadcast waves. The computer C can also obtain the program P via such a transmission medium.

[0265] [Additional Note 1] The present invention is not limited to the above-described embodiment, and various modifications are possible within the scope of the claims. For example, embodiments obtained by appropriately combining the technical means disclosed in the above-described embodiment are also included in the technical scope of the present invention.

[0266] [Additional Note 2] Some or all of the above-described embodiments can be described as follows. However, the present invention is not limited to the following described aspects.

[0267] (Appendix 1) A learning data acquisition means for acquiring learning data; a generation model information acquisition means for acquiring first generation model information relating to a first data generation model, the first generation model information reflecting second generation model information relating to a second data generation model different from the first data generation model; a data generation model learning means for learning the first data generation model, which is defined by referring to the first generation model information, using the learning data; An information processing device comprising:

[0268] According to the above configuration, the first data generation model is trained by indirectly using other learning data used in generating the second data generation model in the other information processing device without directly acquiring the other learning data. As a result, even in a situation where acquiring other learning data used in the other information processing device should be avoided, a first data generation model capable of generating more diverse data can be generated.

[0269] (Appendix 2) a transmitting means for transmitting third generation model information regarding the first data generation model after it has been trained by the data generation model training means; 2. The information processing device according to claim 1, further comprising:

[0270] According to the above configuration, the third data generation model information on the first data generation model after learning can be provided to another device, which enables the other device to learn by indirectly using the learning data used for learning the first data generation model without directly acquiring the learning data.

[0271] (Appendix 3) The generative model information acquisition means Obtaining fourth generative model information regarding the second data generation model after training; The information processing device includes: third generation model information regarding the first data generation model after being trained by the data generation model training means; The fourth generative model information; A generation model information update means for generating updated generation model information by referring to the 2. The information processing device according to claim 1, further comprising:

[0272] According to the above configuration, by referring to the fourth generation model information, it is possible to indirectly use other learning data used in generating the second data generation model in another information processing device. As a result, even in a situation where it is necessary to avoid obtaining other learning data used in another information processing device, it is possible to generate a first data generation model capable of generating more diverse data.

[0273] (Appendix 4) The learning data acquisition means includes: A data group including a plurality of data fragments, each of which is labeled with one of a plurality of label types, and the proportion of data fragments to which a certain label type is attached is equal to or less than a predetermined proportion, is acquired as the learning data. 4. The information processing device according to claim 1,

[0274] According to the above configuration, an imbalanced data group having an imbalanced number of data pieces with label types is used as training data to train the first data generation model. As a result, the first data generation model can be used to generate data for eliminating the imbalance in such a data group.

[0275] (Appendix 5) The learning data acquisition means includes: A selection means for selecting the data group from a plurality of data group candidates is provided. 5. The information processing device according to claim 4.

[0276] According to the above configuration, by selecting an imbalanced data set, the effect described in Supplementary Note 4 can be achieved more reliably.

[0277] (Appendix 6) The data generation model learning means includes: an autoencoder including the first data generation model; and A generative adversarial network including the first data-generative model. Learn at least one of the following: 6. An information processing device according to any one of claims 1 to 5.

[0278] According to the above configuration, it is possible to realize a first data generation model for achieving the above-mentioned effects.

[0279] (Appendix 7) The autoencoder may include Variational autoencoders and conditional variational autoencoders Contains at least one of the following: 7. The information processing device according to claim 6,

[0280] According to the above configuration, it is possible to realize a first data generation model for achieving the above-mentioned effects.

[0281] (Appendix 8) A data generation means for generating data using the first data generation model; an inference model learning means for learning a first inference model by referring to the data generated by the data generating means; It also has 8. An information processing device according to any one of claims 1 to 7.

[0282] According to the above configuration, the first data generation model which achieves the above-mentioned effects refers to the generated data, so that the first inference model can be trained with high accuracy.

[0283] (Appendix 9) Further comprising an inference model information acquisition means for acquiring first inference model information regarding the first inference model, the first inference model information reflecting second inference model information regarding a second inference model different from the first inference model; The inference model learning means learns the first inference model, which is defined by referring to the first inference model information, using the data generated by the data generating means. 9. The information processing device according to claim 8,

[0284] According to the above configuration, the first inference model is trained by indirectly using other learning data used in generating the second inference model in another information processing device without directly acquiring the other learning data. As a result, even in a situation where acquiring other learning data used in another information processing device should be avoided, the first inference model can be trained with high accuracy.

[0285] (Appendix 10) A seed data acquisition means for acquiring seed data; a data generating means for generating data using the seed data, The data generating means Data generation is performed using a first data generation model that is defined by referring to first generation model information that is related to a first data generation model and reflects second generation model information related to a second data generation model that is different from the first data generation model. 23. An information processing apparatus comprising:

[0286] According to the above configuration, by using the first data generation model that is trained to reflect second generative model information regarding the second generative model, it is possible to generate more diverse data.

[0287] (Appendix 11) The method further includes an inference model learning means for learning a first inference model by referring to the data generated by the data generating means. 11. The information processing device according to claim 10.

[0288] According to the above configuration, the first data generation model which achieves the above-mentioned effects refers to the generated data, so that the first inference model can be trained with high accuracy.

[0289] (Appendix 12) Further comprising an inference model information acquisition means for acquiring first inference model information regarding the first inference model, the first inference model information reflecting second inference model information regarding a second inference model different from the first inference model; The inference model learning means learns the first inference model, which is defined by referring to the first inference model information, using the data generated by the data generating means. 12. The information processing device according to claim 11 .

[0290] According to the above configuration, the first inference model is trained by indirectly using other learning data used in generating the second inference model in another information processing device without directly acquiring the other learning data. As a result, even in a situation where acquiring other learning data used in another information processing device should be avoided, the first inference model can be trained with high accuracy.

[0291] (Appendix 13) a generation model information acquisition means for acquiring first generation model information relating to a first data generation model and second generation model information relating to a second data generation model different from the first data generation model; a generative model information update means for generating updated generative model information by referring to the first generative model information and the second generative model information; An information processing device comprising:

[0292] According to the above configuration, it is possible to generate a data generation model trained indirectly using (i) the training data used in training the first data generation model and (ii) the training data used in training the second data generation model. As a result, even in a situation where it is necessary to avoid obtaining at least one of the training data (i) and (ii), the data generation model can be trained to generate more diverse data.

[0293] (Appendix 14) The information processing device described in Appendix 13, further comprising a transmission means for transmitting the updated generative model information to a first information processing device implementing the first data generation model and a second information processing device implementing the second data generation model.

[0294] According to the above configuration, even in a situation where the first information processing device and the second information processing device should avoid providing each other with the learning data used by each other, a data generation model trained indirectly using the learning data used by both the first information processing device and the second information processing device can be provided to the first information processing device and the second information processing device.

[0295] (Appendix 15) The generation model information update means The updated generative model information is generated by averaging the first generative model information and the second generative model information. 15. The information processing device according to claim 13 or 14.

[0296] According to the above configuration, learning is realized by indirectly using the learning data used in learning the first data generation model and the learning data used in learning the second data generation model.

[0297] (Appendix 16) An information processing system including a first information processing device and a server, The first information processing device, A learning data acquisition means for acquiring learning data; a generation model information acquisition means for acquiring, from the server, first generation model information relating to a first data generation model, the first generation model information reflecting second generation model information relating to a second data generation model different from the first data generation model; a data generation model learning means for learning the first data generation model defined by referring to the first generation model information, using the learning data acquired by the learning data acquisition means; a transmitting means for transmitting third generation model information regarding the first data generation model after it has been trained by the data generation model training means; Equipped with The server, The third generative model information, and Fourth generative model information regarding the second data-generative model after training. A generative model information acquisition means for acquiring the generative model information; a generative model information update means for generating updated generative model information by referring to the third generative model information and the fourth generative model information; a transmission means for transmitting the updated generative model information to the first information processing device; An information processing system comprising:

[0298] According to the above configuration, a system that achieves the same effects as those of appendix 1 can be realized by using an information processing device and a server.

[0299] (Appendix 17) Obtaining training data; acquiring first generative model information relating to a first data generation model, the first generative model information reflecting second generative model information relating to a second data generation model different from the first data generation model; and training the first data generation model, which is defined by referring to the first generation model information, using the training data; 2. An information processing method comprising:

[0300] According to the above configuration, the same effects as those of Supplementary Note 1 are achieved.

[0301] (Appendix 18) Obtaining seed data; and generating data using the seed data; Including, In the step of generating data, Data generation is performed using a first data generation model that is defined by referring to first generation model information that is related to a first data generation model and reflects second generation model information related to a second data generation model that is different from the first data generation model. 23. An information processing method comprising:

[0302] According to the above configuration, the same effect as that of Supplementary Note 10 is achieved.

[0303] (Appendix 19) obtaining first generative model information relating to a first data generation model and second generative model information relating to a second data generation model different from the first data generation model; and generating updated generative model information by referring to the first generative model information and the second generative model information; An information processing method comprising:

[0304] According to the above configuration, the same effects as those of Supplementary Note 13 are achieved.

[0305] (Appendix 20) A program for causing a computer to function as an information processing device, the program comprising: A learning data acquisition means for acquiring learning data; a generation model information acquisition means for acquiring first generation model information relating to a first data generation model, the first generation model information reflecting second generation model information relating to a second data generation model different from the first data generation model; a data generation model learning means for learning the first data generation model, which is defined by referring to the first generation model information, using the learning data; A program that functions as a

[0306] According to the above configuration, the same effects as those of Supplementary Note 1 are achieved.

[0307] (Appendix 21) A program for causing a computer to function as an information processing device, the program comprising: A seed data acquisition means for acquiring seed data; a data generation means for generating data using the seed data, the data generation means performing data generation using a first data generation model defined by referring to first generation model information relating to a first data generation model, the first generation model information reflecting second generation model information relating to a second data generation model different from the first data generation model; A program that functions as a

[0308] According to the above configuration, the same effect as that of Supplementary Note 10 is achieved.

[0309] (Appendix 22) A program for causing a computer to function as an information processing device, the program comprising: a generation model information acquisition means for acquiring first generation model information relating to a first data generation model and second generation model information relating to a second data generation model different from the first data generation model; a generative model information update means for generating updated generative model information by referring to the first generative model information and the second generative model information; A program that functions as a

[0310] According to the above configuration, the same effects as those of Supplementary Note 13 are achieved.

[0311] [Additional Note 3] A part or all of the above-described embodiments can be further expressed as follows.

[0312] (Appendix 23) At least one processor, the processor comprising: A learning data acquisition process for acquiring learning data; a generation model information acquisition process for acquiring first generation model information relating to a first data generation model, the first generation model information reflecting second generation model information relating to a second data generation model different from the first data generation model; a data generation model learning process for learning the first data generation model, which is defined by referring to the first generation model information, using the learning data.

[0313] The information processing device may further include a memory that stores a program for causing the processor to execute the learning data acquisition process, the generation model information acquisition process, and the data generation model learning process. The program may be recorded in a computer-readable, non-transitory, tangible recording medium.

[0314] (Appendix 24) At least one processor, the processor comprising: A seed data acquisition process for acquiring seed data; An information processing device that executes a data generation process that generates data using the seed data, the data generation process generating data using a first data generation model that is defined by referring to first generation model information that relates to a first data generation model and reflects second generation model information that relates to a second data generation model different from the first data generation model.

[0315] The information processing device may further include a memory that stores a program for causing the processor to execute the seed data acquisition process and the data generation process. The program may be recorded on a computer-readable, non-transitory, tangible recording medium.

[0316] (Appendix 25) At least one processor, the processor comprising: a generation model information acquisition process for acquiring first generation model information on a first data generation model and second generation model information on a second data generation model different from the first data generation model; an information processing device that executes a generative model information update process for generating updated generative model information by referring to the first generative model information and the second generative model information.

[0317] The information processing device may further include a memory that stores a program for causing the processor to execute the generative model information acquisition process and the generative model information update process. The program may be recorded on a computer-readable, non-transitory, tangible recording medium. [Explanation of symbols]

[0318] 1a~1f Information Processing Systems 10, 10a to 10f, 20 Information processing device 30, 30a to 30f, 40e, 50f Information processing device (server) 101 Learning data acquisition unit 102, 301, 501 Generative model information acquisition unit 103. Data generation model learning part 160, 360, 460, 560 Communications Department 110, 310 Transmitter 111 Learning Data Selection Unit 150, 350 Control section 201 Seed Data Acquisition Department 202 Data Generation Department 203 Inference Model Learning Unit 204 Reasoning part 205, 303 Inference model information acquisition unit 206 Model Information Update Department 302, 502 Generative model information update unit 304 Inference model information update unit C. Computer C1 Processor C2 Memory

Claims

1. A learning data acquisition means for acquiring learning data; a generation model information acquisition means for acquiring first generation model information relating to a first data generation model, the first generation model information reflecting second generation model information relating to a second data generation model different from the first data generation model; a data generation model learning means for learning the first data generation model, the first data generation model being defined by referring to the first generation model information, using the learning data; Equipped with The learning data acquisition means includes: A data group including a plurality of data fragments, each of which is labeled with one of a plurality of label types, and the proportion of data fragments to which a certain label type is attached is equal to or less than a predetermined proportion, is acquired as the learning data.

23. An information processing apparatus comprising:

2. a transmitting means for transmitting third generation model information regarding the first data generation model after it has been trained by the data generation model training means; The information processing apparatus according to claim 1 , further comprising:

3. The generative model information acquisition means Obtaining fourth generative model information regarding the second data generation model after training; The information processing device includes: third generation model information regarding the first data generation model after being trained by the data generation model training means; The fourth generative model information; A generation model information update means for generating updated generation model information by referring to the The information processing apparatus according to claim 1 , further comprising:

4. The learning data acquisition means includes: A selection means for selecting the data group from a plurality of data group candidates is provided.

4. The information processing apparatus according to claim 1, wherein the information processing apparatus further comprises: a first input section;

5. The data generation model learning means includes: an autoencoder including the first data generation model; and A generative adversarial network including the first data-generative model. Learn at least one of the following:

5. The information processing apparatus according to claim 1, wherein the information processing apparatus further comprises: a first input section;

6. The autoencoder may include Variational autoencoders and conditional variational autoencoders Contains at least one of the following:

6. The information processing apparatus according to claim 5,

7. a data generation means for generating data using the first data generation model; an inference model learning means for learning a first inference model by referring to the data generated by the data generating means; It also has 7. The information processing apparatus according to claim 1, wherein the information processing apparatus further comprises: a first input section;

8. One or more processors, Obtaining training data; acquiring first generative model information relating to a first data generation model, the first generative model information reflecting second generative model information relating to a second data generation model different from the first data generation model; and training the first data generation model, which is defined by referring to the first generation model information, using the training data; Including, In acquiring the learning data, A data group including a plurality of data fragments, each of which is labeled with one of a plurality of label types, and the proportion of data fragments to which a certain label type is attached is equal to or less than a predetermined proportion, is acquired as the learning data.

23. An information processing method comprising:

9. A program for causing a computer to function as an information processing device, the program comprising: A learning data acquisition means for acquiring learning data; a generation model information acquisition means for acquiring first generation model information relating to a first data generation model, the first generation model information reflecting second generation model information relating to a second data generation model different from the first data generation model; a data generation model learning means for learning the first data generation model, the first data generation model being defined by referring to the first generation model information, using the learning data; Function as a The learning data acquisition means includes: A data group including a plurality of data fragments, each of which is labeled with one of a plurality of label types, and the proportion of data fragments to which a certain label type is attached is equal to or less than a predetermined proportion, is acquired as the learning data. A program characterized by:

Images