Information processing system, information processing method, and information processing program

Abstract

To provide an information processing system, an information processing method and an information processing program for grasping the influence of a pseudo correlation between an input and an output having a risk of causing a deterioration in the accuracy of a learning model.SOLUTION: A method includes an acquisition step A2 for acquiring a correlation among a learning result of a learning model using a first dataset, a data area being a portion of the first data set as an input and an output of the learning model, and a specification step A5 for specifying a pseudo correlation area on the basis of the first dataset and the correlation. The pseudo correlation area has a pseudo correlation to an output of the learning model in data areas having the correlation. Further, the method includes a generation step A11 for performing at least one of change and annotation to the pseudo correlation area to generate a second dataset, and a display processing step A12 for displaying information on the second dataset.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The present invention relates to an information processing system, an information processing method, and an information processing program. [Background technology]

[0002] Patent Document 1 discloses a feature acquisition device for acquiring feature amounts suitable for similar image search, a display device, a feature acquisition method, a similar image search method, a display method, and a program.

[0003] The feature acquisition device includes a CNN classifier having a plurality of layers, which outputs a result of classifying a first object by processing input data based on image data of an input image showing a first object and a second object surrounding the first object, using the plurality of layers. The feature acquisition device includes an activity calculation unit that derives the degree to which a unit in a certain layer among the plurality of layers influences the classification result as an activity, and a feature acquisition unit that acquires features of the input image based on the derived activity and image data of the input image, such that a feature of a low activity image region, which is a region of the input image corresponding to a second unit having a lower activity than the first unit, is smaller than a feature of a high activity image region, which is a region of the input image corresponding to the first unit. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2022-33429 A Summary of the Invention [Problem to be solved by the invention]

[0005] Incidentally, a learning model identifies correlations between inputs and outputs based on data included in a dataset, and performs various tasks such as prediction, judgment, and classification based on the identified correlations. However, the correlations may include spurious correlations that are not actually correlated. Spurious correlations may cause a decrease in the accuracy of the learning model. Therefore, it is necessary to understand the influence of such spurious correlations. [Means for solving the problem]

[0006] According to one aspect of the present invention, an information processing system is provided. The information processing system includes at least one processor capable of executing a program to perform the following steps. In the acquisition step, a correlation between a learning result of a learning model using a first dataset, a data region that is a part of the first dataset as an input, and an output of the learning model is acquired. In the identification step, a spurious correlation region is identified based on the first dataset and the correlation. The spurious correlation region is a data region that has a correlation and has a spurious correlation with the output of the learning model. In the generation step, at least one of modification and annotation is performed on the spurious correlation region to generate a second dataset.

[0007] This configuration makes it easier for the user to grasp the influence of the spurious correlation region on the learning result using the first data set. [Brief description of the drawings]

[0008] [Figure 1] 1 is a configuration diagram illustrating an information processing system 1. [Diagram 2] 2 is a block diagram showing a hardware configuration of an information processing device 2. FIG. [Diagram 3] FIG. 2 is a block diagram showing a hardware configuration of a user terminal 3. [Figure 4] FIG. 2 is a diagram illustrating an example of a functional unit included in a processor 23. [Diagram 5]2 is an activity diagram showing an example of the flow of information processing executed in the information processing system 1. FIG. [Figure 6] FIG. 13 is a diagram showing an example of learning data D including a pseudo-correlation region R2, which is displayed on the display unit 34 as a result of the display process of the activity A7. [Figure 7] FIG. 13 is a diagram illustrating an example of data processing for learning data D. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described with reference to the drawings. Various characteristic features shown in the following embodiments can be combined with each other.

[0010] Incidentally, the program for realizing the software appearing in this embodiment may be provided as a non-transitory computer-readable recording medium, or may be provided so as to be downloadable from an external server, or may be provided so that the program is started on an external computer and its functions are realized on a client terminal (so-called cloud computing).

[0011] In this embodiment, the term "unit" may include, for example, a combination of hardware resources implemented by a circuit in the broad sense and software information processing that can be specifically realized by these hardware resources. In addition, this embodiment handles various information, which may be represented by, for example, physical values ​​of signal values ​​representing voltage and current, high and low signal values ​​as a binary bit set consisting of 0 or 1, or quantum superposition (so-called quantum bits), and communication and calculation may be performed on a circuit in the broad sense.

[0012] In addition, a circuit in the broad sense is a circuit realized by at least appropriately combining a circuit, circuitry, a processor, and a memory, etc. In other words, it includes an application specific integrated circuit (ASIC), a programmable logic device (e.g., a simple programmable logic device (SPLD), a complex programmable logic device (CPLD), and a field programmable gate array (FPGA)), etc.

[0013] 1. Hardware Configuration This section describes the hardware configuration.

[0014] <Information Processing System 1> FIG. 1 is a configuration diagram showing an information processing system 1. The information processing system 1 includes an information processing device 2, a user terminal 3, and a database DB1. The information processing device 2, the user terminal 3, and the database DB1 are configured to be able to communicate with each other via a telecommunications line. In one embodiment, the information processing system 1 is made up of one or more devices or components. For example, if the information processing system 1 is made up of only the information processing device 2, the information processing system 1 can be the information processing device 2. These components will be described below.

[0015] <Database DB1> The database DB1 stores various datasets DS. The datasets DS may include open data such as MNIST, Fashion-MNIST, and ImageNet, or may be provided only to some users.

[0016] <Information processing device 2> 2 is a block diagram showing a hardware configuration of the information processing device 2. The information processing device 2 includes a communication unit 21, a storage unit 22, and a processor 23, and these components are electrically connected via a communication bus 20 inside the information processing device 2. Each component will be further described.

[0017] The communication unit 21 is preferably a wired communication means such as USB, IEEE1394, Thunderbolt (registered trademark), wired LAN network communication, etc., but may also include wireless LAN network communication, mobile communication such as 3G / LTE / 5G, BLUETOOTH (registered trademark) communication, etc. as necessary. In other words, it is more preferable to implement it as a collection of multiple communication means. In other words, the information processing device 2 may communicate various information from the outside via the communication unit 21 and the network.

[0018] The storage unit 22 stores various information defined by the above description. This can be implemented, for example, as a storage device such as a solid state drive (SSD) that stores various programs and the like related to the information processing device 2 executed by the processor 23, or as a memory such as a random access memory (RAM) that stores temporarily required information (arguments, arrays, etc.) related to the program calculations. The storage unit 22 stores various programs, variables, etc. related to the information processing device 2 executed by the processor 23.

[0019] The processor 23 processes and controls the overall operations related to the information processing device 2. The processor 23 is, for example, a central processing unit (CPU) not shown. The processor 23 realizes various functions related to the information processing device 2 by reading out a predetermined program stored in the storage unit 22. That is, information processing by software stored in the storage unit 22 can be specifically realized by the processor 23, which is an example of hardware, and executed as each functional unit included in the processor 23. These will be described in more detail in the next section. The processor 23 is not limited to being single, and may be implemented with multiple processors 23 for each function. Also, a combination of these may be used.

[0020] <User terminal 3> 3 is a block diagram showing a hardware configuration of the user terminal 3. The user terminal 3 includes a communication unit 31, a storage unit 32, a processor 33, a display unit 34, and an HMI device 35, and these components are electrically connected via a communication bus 30 inside the user terminal 3. Descriptions of the communication unit 31, the storage unit 32, and the processor 33 are omitted because they are similar to the descriptions of the respective units in the information processing device 2.

[0021] The display unit 34 may be included in the housing of the user terminal 3 or may be externally attached. The display unit 34 displays a screen of a graphical user interface (GUI) that can be operated by the user. This is preferably implemented by using display devices such as a CRT display, a liquid crystal display, an organic EL display, and a plasma display according to the type of the user terminal 3.

[0022] The HMI device 35 is a human-machine interface device. The HMI device 35 may be included in the housing of the user terminal 3, or may be externally attached. For example, the HMI device 35 may be implemented as a touch panel integrated with the display unit 34. If it is a touch panel, the user can input a tap operation, a swipe operation, or the like. Of course, instead of the touch panel, a switch button, a mouse, a QWERTY keyboard, a voice recognition device, a gesture detection device, a gaze detection device, a biosignal detection device, an imaging device, or the like may be adopted. That is, the HMI device 35 accepts an operation input made by a user. In response, the HMI device 35 transfers a signal corresponding to the operation input to the processor 33 via the communication bus 30. The processor 33 can execute a predetermined control or calculation as necessary. It can be said that the HMI device 35 includes an input unit configured to be able to accept an input from a user.

[0023] 2. Functional configuration of information processing device 2 Fig. 4 is a diagram showing an example of functional units included in the processor 23. As shown in Fig. 4, the processor 23 includes an acquisition unit 231, a similarity calculation unit 232, an identification unit 233, a display processing unit 234, a reception unit 235, and a generation unit 236. In this section, an overview of these functional units will be described. Details of each functional unit will be described together with information processing described later.

[0024] The acquisition unit 231 is configured to be able to acquire information from the user terminal 3 or other devices. The acquisition unit 231 acquires, for example, a data set DS from an information source such as a database DB1, and a learning model M trained using the data set DS. The acquisition unit 231 is also configured to be able to acquire various information by reading out various information stored in a storage area that is at least a part of the storage unit 22, and writing the read out information in a working area that is at least a part of the storage unit 22. The storage area is, for example, an area of ​​the storage unit 22 that is implemented as a storage device such as an SSD. The working area is, for example, an area that is implemented as a memory such as a RAM. The acquisition by the acquisition unit 231 includes acquiring the output results of each functional unit included in the processor 23.

[0025] The similarity calculation unit 232 is configured to be able to calculate various information based on the acquisition result by the acquisition unit 231. The similarity calculation unit 232 is configured to be able to calculate, for example, the similarity between multiple pieces of learning data D included in the dataset DS, the similarity between multiple classes into which the learning data D are classified, and the like.

[0026] The identifying unit 233 is configured to be able to identify various pieces of information based on the results of acquisition by the acquiring unit 231, the results of calculation by the similarity calculating unit 232, and the like.

[0027] The display processing unit 234 is configured to be able to display various information. The information can be presented to the user via the display unit 34 of the user terminal 3 or another device. In such a case, for example, the display processing unit 234 controls visual information such as a screen, an image including a still image or a video, an icon, a message, etc. to be displayed on the display unit 34 of the user terminal 3. The display processing unit 234 may generate only rendering information for displaying the visual information on the user terminal 3. Note that the display processing unit 234 may present the output information to the user without going through the user terminal 3 or another device user.

[0028] The receiving unit 235 is configured to be able to receive various specifications from the user. The specifications may be input via the user terminal 3 or may be input directly to the information processing device 2, for example.

[0029] The generating unit 236 is configured to be able to generate various information. For example, the generating unit 236 regenerates the data set DS based on the acquired data set DS and the received specification.

[0030] The learning unit 237 is configured to be able to execute learning of the learning model M using the acquired data set DS. Note that the learning unit 237 may transmit a command to start learning of the learning model M using the data set DS and information necessary for the learning, for example, learning conditions such as hyperparameters and the number of times of learning, in order to cause a device other than the processor 23 to perform learning.

[0031] 3. Information processing In this section, the information processing executed in the above-mentioned information processing system 1 will be described.

[0032] 3.1. Information processing flow 5 is an activity diagram showing an example of the flow of information processing executed in the information processing system 1. The information processing may include any exception processing not shown. Exception processing includes interruption of the information processing and omission of each process. Selection or input performed in the information processing may be based on a user operation or may be performed automatically without relying on a user operation.

[0033] [Activity A1] In activity A1, the processor 33 accepts an instruction to start learning from the user, and transmits the instruction to the processor 23 of the information processing device 2. The instruction includes information for identifying the dataset DS to be used for learning. For example, the instruction includes the dataset DS transmitted by the user as the dataset DS. Hereinafter, for convenience of explanation, the processor 23 of the information processing device 2 will be simply referred to as the processor 23, and the processor 33 of the user terminal 3 will be simply referred to as the processor 33.

[0034] [Activity A2] Next, in activity A2, the processor 23 acquires a dataset DS based on the transmitted instruction. The dataset DS may be input by a user or may be stored in a database DB. If the processor 23 has acquired a dataset DS in the past, the processor 23 may acquire the previously acquired dataset DS. Hereinafter, for convenience of explanation, the dataset DS acquired by the processor 23 in activity A2 is referred to as a first dataset DS1. The first dataset DS1 includes at least one data. The data may include any type of data, such as numerical data, time series data, audio data, image data, or a combination thereof. Hereinafter, for convenience of explanation, the data included in the first dataset DS1 is referred to as learning data D. The learning data D is used as teacher data to be input to the learning model M.

[0035] [Activity A3] Next, the process proceeds to activity A3, where the processor 23 executes learning of the learning model M using the data set DS. Here, the processor 23 executes learning of the learning model M using the first data set DS1 acquired in activity A2. As a result, the acquisition unit 231 acquires the learning result of the learning model M using the first data set DS1. The learning model M outputs a predetermined result by inputting the learning data D included in the data set DS. The specific form of the result output by the learning model M is arbitrarily determined according to the learning conditions, for example, a prediction result by regression analysis, a classification result into another class, etc.

[0036] The processor 23 ends the learning when the evaluation index of the learning model M satisfies a predetermined condition. The evaluation index of the learning model M is arbitrary, but is preferably an index indicating the degree of fit of the learning model M, such as a kappa coefficient, a coefficient of determination, Akaike's information criterion (AIC), an R2 score, etc. The predetermined condition is, for example, that at least one of these evaluation indexes is less than a predetermined threshold. The learning end condition is not limited to this and is arbitrary. For example, the processor 23 may end the learning when the process is repeated a prescribed number of epochs. In addition, when the above learning end condition is satisfied, the processor 23 may accept a user's selection of whether or not to end the learning.

[0037] The learning mode is appropriately set according to the type of the learning data D and the task executed by the learning model M. The learning result of this embodiment may include any information such as the learning condition, the number of times of learning, and the learning accuracy. The specific learning algorithm of the learning model M may be any, such as supervised learning, unsupervised learning, and reinforcement learning. In the case of supervised learning, linear regression, logistic regression, random forest, boosting, support vector machine, neural network, and the like can be adopted as the learning algorithm of the learning model M. In particular, when the learning data D includes image data, it is preferable to use a convolutional neural network (CNN). When the learning data D includes time-series data, it is preferable to use a recurrent neural network (RNN). On the other hand, in the case of unsupervised learning, the k-means method, principal component analysis, and the like can be adopted as the learning algorithm of the learning model M. The learning may be performed by the processor 23 itself, or by a device other than the processor 23.

[0038] The learning result of this embodiment includes class information on the class to which each of the data included in the first data set DS1 (learning data D in this embodiment) classified by the learning model M belongs. The class may be expressed, for example, by a binary value of whether it is a good product or a bad product, or by three or more indices (for example, high, medium, low, etc.) representing the degree of deterioration. Therefore, the learning model M of this embodiment can function as a classifier or a judger that classifies input data into classes. When the learning model M is generated by supervised learning, such classes are generated based on the labels assigned to the data set DS as supervised data. When the learning model M is generated by unsupervised learning, the classes are generated based on the labels obtained as the learning result of the data set DS.

[0039] [Activity A4] Next, the process proceeds to activity A4, and the similarity calculation unit 232 calculates the similarity between the classes based on the acquired class information. For example, the similarity calculation unit 232 determines a representative value of the learning data D belonging to each class, calculates the distance in the feature space between the representative values, and calculates the similarity between the classes based on the distance. The similarity calculation unit 232 determines that the shorter the distance between two classes, the more similar the two classes are. The representative value is any value, such as the center of gravity or median value of the distribution of the learning data D. In addition, the specific aspect of the distance is any value, such as Manhattan distance, Euclidean distance, cosine similarity, etc. The specific aspect of the similarity is any value, and the distance itself may be used as the similarity, or the distance may be calculated by performing any calculation process on the distance. Note that the similarity between classes is not limited to being calculated based on the distance, and may be calculated based on a confusion matrix, for example.

[0040] [Activity A5] Next, the process proceeds to activity A5, where the identification unit 233 identifies a correlation between a data region R that is a part of the first data set DS1 and the output of the learning model M that receives the learning data D as an input, based on the calculated similarity. Identifying the correlation by the identification unit 233 is one aspect of acquiring the correlation by the acquisition unit 231. Hereinafter, for convenience of explanation, a region that indicates a correlation between the input and output identified in the data region R of the learning data D is referred to as a correlation region R1. The identification unit 233 identifies the correlation region R1 as the correlation between the data region R and the output of the learning model M that receives the learning data D as an input. The correlation region R1 may include a pseudo correlation region R2 and a true correlation region R3.

[0041] <Pseudo correlation region R2> The spurious correlation region R2 is a region of the correlated data region R that has a spurious correlation with the output of the learning model M. A spurious correlation is a state in which, even though there is no direct correlation between two events (input and output in this embodiment), it is inferred that there is a causal relationship due to the presence of a latent variable. A spurious correlation is also called an apparent correlation.

[0042] <True correlation region R3> The true correlation region R3 is a region of correlated data R that has a direct correlation with the output of the learning model M. A direct correlation means that there is a direct correlation between two events (input and output). The true correlation region R3 can also be said to be a correlation region R1 other than the spurious correlation region R2. Whether the correlation region R1 is a spurious correlation region R2 or a true correlation region R3 can sometimes be determined from, for example, theory, multiple experimental facts, empirical rules, etc.

[0043] [Activity A6] Next, the process proceeds to activity A6, and the identification unit 233 identifies the pseudo-correlation region R2 based on the first data set DS1 and the correlation. In detail, the identification unit 233 identifies the pseudo-correlation region R2 from the identified correlation region R1. For example, the identification unit 233 uses a previously trained determiner to determine whether the identified correlation region R1 is a pseudo-correlation region R2 or a true correlation region R3. The learning of the determiner is performed, for example, using pre-prepared supervised data. The supervised data includes the learning data D to which the correlation region R1 is linked, and a label indicating whether the linked correlation region R1 is a pseudo-correlation region R2 or a true correlation region R3. The determiner receives such supervised data as an input, and outputs whether the region is a pseudo-correlation region R2 or a true correlation region R3. The specific aspect of the learning is arbitrary, and may be, for example, the same as that described in the learning of the learning model M.

[0044] [Activity A7] Next, the process proceeds to activity A7, and the display processing unit 234 executes the display process. As a result, the display processing unit 234 displays the specified pseudo-correlation region R2 on the display unit 34 in a manner different from the data region R other than the pseudo-correlation region R2. The display manner of the pseudo-correlation region R2 is arbitrary as long as the user can visually distinguish it. For example, the pseudo-correlation region R2 may be surrounded by a contour line, unlike the other data regions R, or may be displayed in a color different from the other data regions R. The display processing unit 234 of this embodiment displays the learning result of the learning model M on the display unit 34 by the display process. Although the display manner of the learning result is arbitrary, the display processing unit 234 displays the learning result on the display unit 34 using a confusion matrix, a scatter diagram of the data set DS, an aggregate value of the learning data D for each class, and the like. As the aggregate value of the learning data D, for example, the distribution of the feature amount for each class can be given. In particular, when the learning data D includes image data, the display processing unit 234 displays the learning result on the display unit 34 as an activation map. Any technique can be used to generate the activation map, but examples include CAM, Grad-CAM, Guided Grad-CAM, and the like.

[0045] [Activity A8] Next, the process proceeds to activity A8, and the processor 33 displays the result of the display process in activity A7 on the display unit 34. This allows the user to grasp the learning result of the learning model M and the data region R, particularly the spurious correlation region R2, contained in the learning data D used to learn the learning model M.

[0046] If the learning of the learning model M is to be terminated, this information processing ends. On the other hand, if the learning of the learning model M is to be continued, the processing proceeds to activity A9. The decision to terminate or continue the learning of the learning model M may be made by the user based on the learning results displayed in activity A8, or may be made automatically by the processor 23 based on the learning results.

[0047] [Activity A9] In the activity A9, the processor 33 transmits at least one of a change and an annotation to the pseudo-correlation region R2 in the learning data D, which is input by the user. Here, the change includes a specific data processing to be performed on the pseudo-correlation region R2. The processor 33 may also transmit information specifying the pseudo-correlation region R2 for which the data processing is performed. The annotation specifies how to use the pseudo-correlation region R2 in learning by the learning model M. The annotation may be metadata indicating that the pseudo-correlation region R2 is to be excluded from the learning target by the learning model M, or may be metadata specifying that the weighting of the pseudo-correlation region R2 is to be smaller than that of other regions in learning by the learning model M. The annotation may also be metadata specifying that the number of times the pseudo-correlation region R2 is learned is less than a predetermined value in learning by the learning model M. The annotation may also indicate data processing to be performed before the learning data D is input to the learning model M. The data processing may include at least one of a whole processing and a partial processing.

[0048] The overall processing is data processing performed on the entire training data D including the spurious correlation region R2. The overall processing includes, for example, a process of removing the training data D including the spurious correlation region R2 from the first data set DS1, and a pattern processing performed uniformly on the entire training data D. The pattern processing includes, for example, convolution of a predetermined pattern signal, subtraction of a predetermined noise pattern, and the like.

[0049] The partial processing is data processing performed only on the spurious correlation region R2 in the training data D. The partial processing includes, for example, deleting the spurious correlation region R2, replacing it with a specified pattern, masking, and the like. The partial processing may also include any processing performed on at least a part of the spurious correlation region R2. For example, the partial processing is not limited to data processing on the entire spurious correlation region R2, and may include data processing on a part of the spurious correlation region R2.

[0050] In particular, when the training data D includes image data, the data processing includes image processing, which includes whole processing such as deleting the entire image including the spurious correlation region R2 and performing pattern addition processing (e.g., style transfer processing) on ​​the entire training data D including the spurious correlation region R2, and partial processing such as deleting the spurious correlation region R2 in the training data D and masking the spurious correlation region R2.

[0051] The specific manner of designating the pseudo-correlation region R2 for performing the data processing may be any, such as a keyboard operation or a touch operation on the HMI device 35. Furthermore, the designation is not limited to designating one entire pseudo-correlation region R2, but may include designating a partial region included in the pseudo-correlation region R2. A response from the HMI device 35 is generated by the operation on the HMI device 35.

[0052] [Activity A10] Next, the process proceeds to activity A10, where the reception unit 235 receives at least one of the designation of the modification and the annotation to the spurious correlation region R2 in the training data D transmitted from the processor 33.

[0053] [Activity A11] Next, the process proceeds to activity A11, and performs at least one of data processing and annotation on the pseudo-correlation region R2 based on the designation received in activity A10. As a result, the generation unit 236 generates a second data set DS2. In particular, when the first data set DS1 includes image data, the generation unit 236 performs image processing as data processing on the image data including the pseudo-correlation region R2 to generate the second data set DS2. The image processing may include at least one of the overall processing and partial processing described above. For example, when the first data set DS1 includes image data, the generation unit 236 performs partial image processing on the pseudo-correlation region R2 (i.e., partial processing included in the image processing).

[0054] After the processing of activity A11, the process returns to activity A3, and the learning unit 237 uses the second data set DS2 to learn the learning model M. As a result, a learning model M that is less affected by spurious correlation compared to the case where learning is performed using the first data set DS1 is obtained. Therefore, the reliability of the learning model M can be improved. Thereafter, the processing from activity A4 to activity A8 is performed. As a result, the processor 23 is configured to be able to execute data processing for the spurious correlation region R2 for the learning model M using the second data set DS2 as well, in the same way as the previous information processing for the first data set DS1.

[0055] [Activity A12] After the processing of activity A11, in activity A12, the display processing unit 234 displays information about the second data set DS2 on the display unit 34. The information about the second data set DS2 includes, for example, the contents of data processing performed on the learning data D, the results of the data processing, and the difference between the first data set DS1 and the second data set DS2. This makes it easier for the user to understand the learning process of the learning model M.

[0056] 3.2. Details of data processing In this section, the above information processing will be described in detail when the learning data D is image data. The learning data D in this embodiment is an electron microscope image (SEM image) of an electrode material, and includes an image of a crystal domain of the electrode material. Each learning data D is linked to the deterioration degree of the electrode material (for example, high deterioration degree, medium deterioration degree, low deterioration degree). The first data set DS1 includes a plurality of the above learning data D. The learning model M, which has been trained based on such a first data set DS1, outputs the deterioration degree of the electrode material by inputting an electron microscope image of the electrode material. At this time, the identification unit 233 identifies the data region R used as a criterion for determining the output deterioration degree as the correlation region R1. Thereafter, the identification unit 233 identifies whether the correlation region R1 is a pseudo correlation region R2 or a true correlation region R3, and the display processing unit 234 displays information on the correlation region R1 together with the learning result on the display unit 34 in the activities A7 and A8.

[0057] 6 is a diagram showing an example of learning data D including a spurious correlation region R2, displayed on the display unit 34 as a result of the display process of activity A7. As a result of the processes from activity A3 to activity A6, the identification unit 233 identifies that the learning data D includes two correlation regions R1, one of the two correlation regions R1 is a spurious correlation region R2, and the other correlation region R1 is a true correlation region R3. The spurious correlation region R2 identified in this embodiment is, for example, a region where a separator mark remains due to contact between an electrode material and a separator.

[0058] Each of the identified correlation regions R1 is surrounded by a rectangular frame as an annotation. Thus, the correlation region R1 is displayed so as to be visually recognized by the user. In detail, the identified pseudo-correlation region R2 is surrounded by a rectangular frame drawn with solid lines, and the true correlation region R3 is surrounded by a rectangular frame drawn with dashed lines. Note that the data region R other than the correlation region R1 is not surrounded by such a rectangular frame. This display mode allows the user to visually recognize which region in the learning data D contributes to the determination of the deterioration state as the correlation region R1, and which correlation region R1 is the pseudo-correlation region R2. Note that the processor 23 may be configured to be able to change whether the identified correlation region R1 is the pseudo-correlation region R2 or the true correlation region R3 by the user's operation. In other words, the identification unit 233 may identify a candidate for the pseudo-correlation region R2 from among the correlation region R1. This makes it easy to correct the identification result of the pseudo-correlation region R2 based on the user's empirical rule. This operation can be realized by using any input to the HMI device 35, such as a mouse operation, a touch operation, a keyboard operation, a voice, a gaze, or a gesture. This change may change the display mode of the rectangular frame surrounding the correlation region R1. After that, data processing is performed on the learning data D including the identified pseudo-correlation region R2 based on the input mode specified in activity A9 and activity A10.

[0059] Next, details of the data processing of the activity A11 on the learning data D will be described. FIG. 7 is a diagram showing an example of the data processing on the learning data D. The data processing of this embodiment is image processing, particularly mask processing, on image data included in the learning data D. The generating unit 236 generates at least one learning data D in which the identified pseudo-correlation region R2 is masked by the image processing, and a second data set DS2 including the learning data D. Note that the generating unit 236 performs the data processing only on the pseudo-correlation region R2 of the identified correlation region R1, and does not perform the data processing on the true correlation region R3. The learning model M is re-trained using the second data set DS2 including the learning data D that has been subjected to such mask processing. Therefore, the second data set DS2 can be said to be a data set DS in which the input mode to the learning model M has been changed by the mask processing. Note that the contents of the second data set DS2 including the learning data D after the data processing are displayed to the user via the display unit 34 in the activity A12.

[0060] 4.Other The above information processing mode is merely an example and is not limited to this.

[0061] The method of identifying the pseudo-correlation region R2 in the activity A6 is not limited to using a determiner, and is arbitrary. The identification unit 233 may use a relational expression or a lookup table that represents the correlation between the input and the output obtained in advance to determine whether the correlation region R1 is a pseudo-correlation region R2 or a true correlation region R3 based on whether the output of the learning model M for the input is greater than or equal to a predetermined threshold value between the input and the output based on the relational expression. The identification unit 233 may also identify the pseudo-correlation region R2 based on a user's operation on the correlation region R1. The user's input includes, for example, an operation indicating that the correlation region R1 is the pseudo-correlation region R2 and an operation indicating that the correlation region R1 is the true correlation region R3. The learning of the determiner may be performed using the learning data D, in which the correlation region R1 is identified as being a pseudo-correlation region R2 or a true correlation region R3 by the user's operation, as supervised data.

[0062] In the case where a learning model M trained using the first dataset DS1 exists, the acquisition unit 231 may acquire the learning model M and perform transfer learning on the acquired learning model M using the second dataset DS2.

[0063] The data included in the first data set DS1 is not limited to the learning data D. For example, the data included in the first data set DS1 may be evaluation data. The evaluation data is, for example, data used to evaluate the performance of the learning model M. In other words, the use of the data included in the first data set DS1 is arbitrary, and the data may be used as teacher data or may be used to evaluate the learning model M.

[0064] When a response is generated from the HMI device 35 in the activity A9, the acquisition unit 231 may acquire the response from the HMI device 35. In this case, the identification unit 233 may further identify the pseudo-correlation region R2 based on the response from the HMI device 35 acquired by the acquisition unit 231, the first data set DS1, and the correlation. For example, the processor 23 may learn a classifier used to identify the pseudo-correlation region R2 in the activity A5 based on the response from the HMI device 35 acquired by the acquisition unit 231, and identify the pseudo-correlation region R2 using the learned classifier. In this case, the processor 23 may treat the second data set DS2 generated based on the response from the HMI device 35 as the first data set DS1, and learn the classifier using the first data set DS1.

[0065] The information processing device 2 may be an on-premise type or a cloud type. As the information processing device 2 in the cloud type, the above-mentioned functions and processes may be provided in the form of, for example, SaaS (Software as a Service) or cloud computing.

[0066] In the above embodiment, the information processing device 2 performs various storage and control, but multiple external devices may be used instead of the information processing device 2. That is, various information and programs may be distributed and stored in multiple external devices using block chain technology or the like.

[0067] The above embodiment is not limited to the information processing system 1, and may be an information processing method or an information processing program. The information processing method includes each step of the information processing system 1. The information processing program causes at least one computer to execute each step of the information processing system 1.

[0068] The information processing system 1 and the like may be provided in the following aspects.

[0069] (1) An information processing system comprising at least one processor capable of executing a program to perform each of the following steps: in an acquisition step, a correlation between a learning result of a learning model using a first dataset, a data domain that is part of the first dataset as an input, and an output of the learning model is acquired; in an identification step, a spurious correlation region is identified based on the first dataset and the correlation, wherein the spurious correlation region is a data domain having the correlation that has a spurious correlation with the output of the learning model; and in a generation step, at least one of modification and annotation is performed on the spurious correlation region to generate a second dataset.

[0070] According to this configuration, the learning result of the learning model differs depending on the input correspondence of the pseudo-correlation region between the first data set and the second data set. Therefore, by using the second data set when learning the learning model, the user can easily grasp the influence of the pseudo-correlation region on the learning result using the first data set.

[0071] (2) In the information processing system described in (1) above, the acquisition step further acquires a response from an HMI device, and the identification step identifies the pseudo-correlation region based on the acquired response from the HMI device, the first data set, and the correlation.

[0072] With this configuration, it becomes easier to reflect the user's empirical rules in identifying the pseudo-correlation region through the response from the HMI device.

[0073] (3) In the information processing system according to (1) or (2) above, the receiving step further includes receiving a user's specification of at least one of the change and the annotation.

[0074] According to this configuration, the user's subjective judgment regarding the spurious correlation region, such as whether the identified spurious correlation region is a region that truly has a spurious correlation, how strong the spurious correlation is, etc., can be reflected in the input mode of the spurious correlation region. Therefore, by performing learning of the learning model using the second data set generated in this way, it is possible to obtain a learning result that is less inconsistent with the user's subjectivity.

[0075] (4) In the information processing system according to any one of (1) to (3) above, in the display processing step, the identified pseudo-correlation region is displayed in a manner different from the data region other than the pseudo-correlation region.

[0076] With this configuration, it becomes easier for the user to visually determine which data regions are pseudo-correlation regions.

[0077] (5) In the information processing system according to any one of (1) to (4) above, the learning result includes class information regarding a class to which data included in the data set belongs, as classified by the learning model; and further, in the similarity calculation step, a similarity between the classes is calculated based on the acquired class information; and in the identification step, the correlation is further identified based on the calculated similarity.

[0078] According to such a configuration, the spurious correlation region is identified based on a quantitative index, that is, the similarity between classes, and therefore the objectivity of the identification result is improved.

[0079] (6) In the information processing system according to any one of (1) to (5) above, when the first data set includes image data, the generating step generates the second data set by performing image processing on the image data including the pseudo-correlation region.

[0080] According to such a configuration, the difference between the first data set and the second data set can be visually grasped more easily, so that the user can more easily grasp the influence of the spurious correlation region.

[0081] (7) In the information processing system described above in (6), in the generating step, the second data set is generated by performing partial image processing on the pseudo-correlation region.

[0082] This configuration reduces the likelihood that image processing will affect non-spurious correlation regions, particularly regions of data that have true correlation, and therefore allows the user to more accurately grasp the effects of spurious correlation regions.

[0083] (8) In the information processing system according to any one of (1) to (7) above, in the learning step, the learning model is trained using the second data set.

[0084] With this configuration, a more reliable learning model can be obtained compared to the case where the first data set is used.

[0085] (9) An information processing method, comprising each step of the information processing system according to any one of (1) to (8) above.

[0086] (10) An information processing program that causes at least one computer to execute each step of the information processing system described in any one of (1) to (8) above. Of course, this is not the case.

[0087] Finally, although various embodiments according to the present disclosure have been described, these are presented as examples and are not intended to limit the scope of the invention. The novel embodiment can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. The embodiments and their modifications are included within the scope and spirit of the invention, and are included in the scope of the invention and its equivalents described in the claims. [Explanation of symbols]

[0088] 1: Information processing system 2: Information processing equipment 3: User terminal 20: Communication bus 21: Communications Department 22: Storage section 23: Processor 30: Communication bus 31: Communications Department 32: Storage section 33: Processor 34: Display section 35: HMI device 231: Acquisition Department 232: Similarity calculation section 233: Specific part 234: Display processing unit 235: Reception 236 :Generation part 237: Learning Department DB1 : Database R: Data area R1: Correlation region R2: Pseudo correlation region R3: Correlation region

Claims

1. An information processing system, At least one processor capable of executing a program to perform the following steps: In the acquisition step, A learning result of a learning model using a first dataset including a plurality of learning data; A correlation between a data area corresponding to an input of the learning model among the learning data as an input and an output of the learning model is obtained, where the learning data is associated with a correct answer label to which the output is previously assigned; In the identification step, a spurious correlation region is identified based on the first data set and the correlation, and the spurious correlation region is a region of the data having the correlation that has a spurious correlation with an output of the learning model; In the generating step, the information processing system performs at least one of modification and annotation on the spurious correlation region without changing the ground truth label of the training data to generate a second dataset.

2. 2. The information processing system according to claim 1, The acquiring step further includes acquiring a response from the HMI device; In the identifying step, an information processing system identifies the spurious correlation region based on the acquired response from the HMI device, the first data set, and the correlation.

3. 2. The information processing system according to claim 1, Furthermore, in the receiving step, the information processing system receives a user's designation of at least one of the change and the annotation.

4. 2. The information processing system according to claim 1, In the display processing step, the identified pseudo-correlation region is displayed in a manner different from the data region other than the pseudo-correlation region.

5. 2. The information processing system according to claim 1, The learning result includes class information regarding a class to which data included in the first dataset belongs, the class information being classified by the learning model; Furthermore, in the similarity calculation step, a similarity between the classes is calculated based on the acquired class information; The information processing system further includes, in the identifying step, identifying the correlation based on the calculated similarity.

6. 2. The information processing system according to claim 1, If the first data set comprises image data, An information processing system, wherein in the generating step, the second data set is generated by performing image processing on the image data including the pseudo-correlation region.

7. 7. The information processing system according to claim 6, An information processing system, wherein in the generating step, the second data set is generated by performing partial image processing on the pseudo-correlation region.

8. 2. The information processing system according to claim 1, Further, in the learning step, the information processing system learns the learning model using the second data set.

9. 1. An information processing method, comprising: A method comprising the steps of the information processing system according to any one of claims 1 to 8.

10. An information processing program, A program for causing at least one computer to execute each step of the information processing system according to any one of claims 1 to 8.

Images