Information processing device, trained model generation device, information processing method, trained model generation method, information processing program, and trained model generation program

Abstract

To enable representation of a field showing a structure of a substance represented by an atomic point cloud.SOLUTION: A field showing a structure of a substance represented by an atomic point cloud is represented using a neural network model.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to an information processing device, a trained model generation device, an information processing method, a trained model generation method, an information processing program, and a trained model generation program. [Background technology]

[0002] Conventionally, a technology is known regarding an autoencoder-based generative deep representation learning pipeline for 3D crystal structures (see, for example, Non-Patent Document 1). [Prior art documents] [Non-patent literature]

[0003] [Non-Patent Document 1] Callum J. Court, Batuhan Yildirim, Apoorv Jain, and Jacqueline M. Cole, "3-D Inorganic Crystal Structure Generation and Property Prediction via Representation Learning", J. Chem. inf. Model. 2020, 60, 10, 4518-4535, [Retrieved November 18, 2022], Internet<URL:https: / / pubs.acs.org / doi / 10.1021 / acs.jcim.0c00464> Summary of the Invention [Problem to be solved by the invention]

[0004] The present disclosure aims to represent a field that represents the structure of a substance composed of atomic point groups. [Means for solving the problem]

[0005] In order to achieve the above object, an information processing device according to the present disclosure is an information processing device that includes a processing unit that uses a neural network model to represent a field that represents a structure of a substance constituted by a group of atomic points.

[0006] The information processing method disclosed herein is an information processing method in which a computer executes a process for expressing a field representing a structure of a substance constituted by a group of atomic points using a neural network model.

[0007] In addition, the information processing program disclosed herein is an information processing program for causing a computer to execute processing for expressing a field representing a structure of a substance constituted by a group of atomic points using a neural network model. Effect of the Invention

[0008] According to the information processing device, information processing method, and information processing program of the present disclosure, it is possible to represent a field that represents the structure of a substance constituted by a group of atomic points. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram for explaining the present embodiment. [Diagram 2] FIG. 1 is a diagram for explaining the present embodiment. [Diagram 3] FIG. 1 is a diagram for explaining the present embodiment. [Figure 4] FIG. 1 is a diagram for explaining the present embodiment. [Diagram 5] FIG. 1 is a diagram for explaining the present embodiment. [Figure 6] FIG. 1 is a diagram for explaining the present embodiment. [Figure 7] 1 is a block diagram showing a hardware configuration of an information processing device according to an embodiment of the present invention. [Figure 8] FIG. 1 is a diagram for explaining the present embodiment. [Figure 9] FIG. 1 is a diagram for explaining the present embodiment. [Figure 10]FIG. 1 is a diagram for explaining the present embodiment. [Figure 11] FIG. 1 is a diagram for explaining the present embodiment. [Figure 12] FIG. 1 is a diagram for explaining the present embodiment. [Figure 13] FIG. 1 is a diagram for explaining the present embodiment. [Figure 14] FIG. 1 is a diagram for explaining the present embodiment. [Figure 15] FIG. 1 is a diagram for explaining the present embodiment. [Figure 16] FIG. 1 is a diagram for explaining the present embodiment. [Figure 17] FIG. 1 is a diagram for explaining the present embodiment. [Figure 18] FIG. 1 is a diagram for explaining the present embodiment. [Figure 19] FIG. 1 is a diagram for explaining the present embodiment. [Figure 20] FIG. 1 is a diagram for explaining the present embodiment. [Figure 21] FIG. 1 is a diagram for explaining the present embodiment. [Figure 22] FIG. 1 is a diagram for explaining the present embodiment. [Figure 23] FIG. 1 is a diagram for explaining the present embodiment. [Figure 24] FIG. 1 is a diagram for explaining the present embodiment. [Diagram 25] FIG. 1 is a diagram for explaining the present embodiment. [Figure 26] FIG. 1 is a diagram for explaining the present embodiment. [Figure 27] FIG. 1 is a diagram for explaining the present embodiment. [Figure 28] FIG. 1 is a diagram for explaining the present embodiment. [Figure 29] FIG. 1 is a diagram for explaining the present embodiment. [Diagram 30] FIG. 1 is a diagram for explaining the present embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, an example of an embodiment of the present disclosure will be described with reference to the drawings. In this embodiment, an information processing device according to the present disclosure will be described as an example. Note that the same or equivalent components and parts in each drawing are given the same reference numerals. Also, the dimensions and ratios of the drawings are exaggerated for the convenience of explanation and may differ from the actual ratios.

[0011] <Summary> Inverse design methods for crystals, especially materials, can contribute to next-generation methods for searching for materials with desired properties without relying on "luck" or "serendipity". In this embodiment, we propose a neural structure field (NeSF) as an accurate and practical approach to represent crystal structures using neural networks. Inspired by the concept of vector fields in physics and implicit neural representations in computer vision, the proposed NeSF considers crystal structures as continuous fields rather than as discrete collections of atoms. Unlike existing grid-based discrete space representations, NeSF overcomes the trade-off between spatial resolution and computational complexity and can represent any crystal structure. In this embodiment, to evaluate NeSF, we propose a crystal structure autoencoder that can recover various crystal structures, including perovskite-structured materials and cuprate superconductors. Extensive quantitative results show the superior performance of NeSF compared to existing grid-based approaches. In the following, the numbers in [ ] represent the reference numbers shown in Figures 21 to 23.

[0012] <1. Introduction> The fundamental paradigm of materials science considers the structure-property relationship, assuming that material properties are tightly coupled with the crystal structure. Thus, traditional approaches in materials science involve theoretical and experimental analysis of the structure-property relationships of materials to search for new materials with superior properties [1,2]. However, these traditional approaches rely on labor-intensive human analysis or even “serendipity”. To automate or assist in the analysis and development of materials, data-driven approaches are being actively researched in materials science, and the field of materials informatics (MI) has been established [3-6]. Unlike traditional approaches based on the estimation of physical laws, MI aims to reveal material knowledge (e.g., the laws governing structure-property relationships) from collected data sets of materials via statistical and machine learning (ML) methods. In recent years, MI has developed rapidly due to technological advances in ML and the emergence of large-scale materials databases [6,7]. Thus, powerful neural network-based ML methods are becoming a key component of MI research [6]. Applications of MI include the prediction of material properties from material property data such as crystal structure [6] and composition [8-11], the automated analysis of experimental data [12-14], and natural language processing for knowledge retrieval from scientific literature

[15] .

[0013] Many MI studies have focused on predicting the properties of specific materials, such as band gaps, Seebeck coefficients, elastic moduli, etc. [16-18]. If we consider this type of task as the discovery of structure-property relationships between materials, there is yet another important type of task, namely the discovery of property-structure relationships, which constitutes an inverse problem [19-23].

[0014] Despite the potential usefulness of this inverse approach in materials development, few studies have addressed this [19-23] or its underlying problem [24-26], i.e., the estimation of crystal structures under specific conditions. With regard to MI and ML, a crucial difference occurs whether the crystal structure is input or output (i.e., whether the crystal structure is encoded or decoded in MI and ML terms). While the encoding of crystal structures is well established using graph neural networks [10, 16, 17, 27], a technical bottleneck remains for the decoding of crystal structures. In this study, we addressed the bottleneck.

[0015] The crystal structure of an inorganic material is a regular and periodic arrangement of atoms in three-dimensional (3D) space. This arrangement is usually described by lattice constants, which define the 3D positions and types of atoms in a unit cell, and the movement of the unit cell in 3D space. The atoms in a unit cell have no clear order, and their number can vary from one to hundreds. Dealing with crystal structures in ML models is not straightforward, since ML models, including neural networks, generally accept consistently ordered tensors with fixed dimensions for processing,

[16] and determining crystal structures through models is even more difficult.

[0016] In this embodiment, we propose a general representation of crystal structures that allows neural networks to decode or determine such structures. The key concepts underlying our approach are illustrated in Figure 1. Here, crystal structures are represented not as a discrete set of atoms but as a continuous vector field associated with a 3D space. We call our approach the Neural Structure Field (NeSF). NeSF uses two types of vector fields, a position field and a type field, to implicitly represent the positions and types of atoms in the unit cell of a crystal structure, respectively.

[0017] To explain the concept of NeSF, we assume that the target material information is given as a fixed-dimensional vector z, and consider the problem of recovering the crystal structure from z. The input z can specify, for example, information about the crystal structure of the material, or some desired criteria for the material to be generated. In NeSF, instead of the neural network f directly outputting the crystal structure as f(z), the neural network f is used as an implicit function to indirectly represent the crystal structure embedded in z. Specifically, we treat f as a vector field on a 3D Cartesian coordinate p, conditioned on the target material information z.

[0018]

number

[0019] In the crystal structure of interest, in the position field, the network f is trained to output a 3D vector pointing from a query point p to the nearest atomic position a. Thus, the output s is expected to be ap. If the position field is ideally trained, then at any query point p, the position a of the nearest atom can be obtained as p+f(p,z).

[0020] Mathematically, the position field is a scalar potential

[0021]

number

[0022] The scalar potential can be interpreted as the gradient vector field -φ(p) of the query point p and the nearest atom position {a i}. Similarly, the kind field is trained to output a categorical probability distribution indicating the type of the closest atom. Thus, the output dimension of the kind field is the number of candidate atom types.

[0023] The proposed NeSF is inspired by the concept of vector fields in classical physics and implicit neural representations in computer vision [30-34]. Implicit neural representations have been recently proposed to handle several representation problems in 3D computer vision applications, such as 3D shape estimation of objects [31-33] and free-viewpoint image synthesis [30,34]. In 3D shape estimation, having a neural network directly output a 3D mesh or point cloud leads to representation problems similar to those encountered in crystal structures. To overcome these issues, a signed distance function (SDF) is utilized in DeepSDF

[31] , where a neural network f(p) models the 3D shape by indicating with a positive or negative sign whether a query point p is outside or inside the object volume and outputs the respective scalar. NeSF follows the basic idea of ​​implicit neural representations and further extends it to the estimation of crystal structures described by the positions and species of atoms. The accurate description of atomic positions in crystal structures is of great importance in materials science. Thus, NeSF outputs vectors pointing to the nearest atoms to represent atom positions more directly than existing implicit neural representations of 3D geometry.

[0024] Our idea of ​​representing 3D geometric crystal structures as continuous vector fields has been partially and implicitly explored in recent MI studies [19,20,22,24-26] using grid-based discretization (i.e., voxelization), but without explicit consideration as a discretized vector field. In these studies, the 3D space within a unit cell is discretized into voxels, and each voxel is assigned an electron density. The electron density essentially represents the presence or absence of atoms around the voxel. However, compared to one-dimensional (e.g., audio signals) or two-dimensional (e.g., images) data, discretization of 3D data suffers from a considerable trade-off between spatial resolution and computational complexity, in terms of both computation time and memory space. For example, the ICSG3D method

[24] uses 32 × 32 × 32 voxels to represent crystal structures and estimates them using a 3D convolutional neural network (CNN). Because voxel-based 3DCNNs are computationally and memory intensive, a resolution of 32 × 32 × 32 voxels is the approximate limit for training voxel-based models on standard computing systems. On the other hand, existing crystal structures contain more than a few dozen atoms in the unit cell, or the unit cell is stretched or distorted. Therefore, a sufficiently high resolution is required to accurately represent diverse crystal structures in voxels. Moreover, voxel-based models can only indirectly provide atomic positions in representations such as peaks of a scalar field of electron density discretized in voxel space. The proposed NeSF overcomes the limitations of voxelization. In NeSF, there is essentially no trade-off between spatial resolution and required memory. In theory, NeSF can achieve infinitely high spatial resolution by using a compact (memory- and parameter-efficient) neural network instead of a costly 3DCNN. Moreover, NeSF can effectively represent any crystal structure, including elongated or distorted unit cells. Moreover, NeSF can directly provide Cartesian coordinates of atomic positions instead of peaks of scalar fields. We believe that the proposed NeSF will break through the technical bottleneck of MI approaches for crystal structure estimation and contribute to the progress of MI research in this direction.

[0025] In the next section, we describe the proposed NeSF in detail and demonstrate its representational power for various crystal structures through numerical experiments. In particular, NeSF successfully recovers a wide range of crystal structures, from the relatively basic structures of perovskite materials to the complex structures of cuprate superconductors. Extensive quantitative evaluation results show that NeSF outperforms the voxelized approach of ICSG3D

[24] .

[0026] <2 Results and Discussion> First, we describe the procedure to estimate crystal structures using NeSF and train NeSF. Then, we present an autoencoder for crystal structures as an application of NeSF. In this autoencoder, crystal structures are embedded into a vector z (called a latent vector) via an encoder, and NeSF acts as a decoder to recover the input crystal structure from z. The performance of the NeSF-based autoencoder is quantitatively analyzed by evaluating the reconstruction accuracy over the voxelization-based ICSG3D baseline. We qualitatively analyze the space of vectors z learned by the proposed autoencoder. This analysis shows that the learned space reflects the similarity between crystal structures, rather than simply embedding crystal structures randomly.

[0027] <2.1 Crystal structure by NeSF> Given the material information of the estimation target as a vector z, estimating a crystal structure from z amounts to estimating the positions and species of atoms in the unit cell along with the lattice constants. The lattice constants are modeled as lengths a, b, and c and angles α, β, and γ, and are estimated by a simple multilayer perceptron (MLP) using the input z. Meanwhile, the atomic positions and species are estimated by the position field f of the NeSF, as described in the previous section. p and type field f sThese fields are also implemented as simple MLPs, each of which takes a query location p and a vector z as input and predicts the field value (i.e., a 3D pointing vector or a categorical probability distribution). An overview of the architecture of the NeSF network is shown on the right side of Figure 1(b).

[0028] Given a vector z from the encoder, the estimation of atomic positions and species using NeSF is shown in Fig. 2 and summarized in five steps.

[0029] 1. Initialize the particles. First, estimate the lattice constants via MLP. Then, we estimate the initial query points {p 0 i} periodically. The bounding boxes are common to each dataset and are specified to roughly enclose the atoms in all training samples.

[0030] 2. Move the particle. t+1 i =p t i +f p (p t i ,z) for each particle p t i This process is repeated for all particles, and the position of {p i} as a candidate atom position. Since the position field is expected to point to the nearest atom position, the particle moves towards the nearest atom through this process.

[0031] 3. Score the particles. For each particle p i Score and filter outliers. The norm of the output of the location field ||f p (p i ,z)|| is p i For each particle p i f p (pi ,z)|| and discard the particle if its score exceeds a certain threshold (set to 0.9 Å in this case).

[0032] 4. Detect atoms. Up to this point, particles are expected to form clusters around atoms. Therefore, we apply a simple clustering algorithm to detect each cluster position as an atom position and determine the number of atoms in the crystal structure. Here, we use a clustering algorithm well known for object detection, Non-Maximum Suppression. Specifically, we create a list of candidate particles by B c ={p i} and initialize another list of accepted particles as B a ={}. 1)B c Select the particle with the lowest score (estimated to be closest to the atom) from B a 2) Move the particles within the spherical region around the selected particle to B. c (In this study, the sphere radius was set to 0.5 Å.) c Repeat until B is empty. a The atomic positions {a i} to get

[0033] 5. Infer the type. Finally, the type field f s Using (p,z), each atomic position a i Estimate the atomic species of a. i For robust estimation against errors in a i Instead of using directly as a query, use each a as a query on the kind field. i We then intensively spread the new particles around atom a. Thus, we obtain multiple probability distributions, each of which is i The most frequent atomic species is selected as the final guess.

[0034] <2.2 Training of NeSF> Training NeSF is different from the estimation algorithms above and is much simpler. We train a 3D query point {p s i} at random and calculate the loss value of the field output at these points. Therefore, f p (p s i ,z) and f s (p s i ,z) to indicate the location and type of the nearest atom, respectively. However, due to practical limitations in memory usage, it is not possible to densely sample query points. Thus, a query point sampling strategy is required for training. Existing implicit neural representations for 3D shape estimation, such as DeepSDF

[31] , sample training query points near the surface. Curriculum DeepSDF

[35] further introduces curriculum learning, where the sampling density is enhanced near the surface as training progresses.

[0035] To consider desirable sampling strategies for training the position and kind fields, we consider their dynamics in the proposed algorithm: 1) Particles move iteratively in the position field towards the nearest atoms. Thus, the position field must be accurate enough everywhere to allow particles to flow to their destination, and very accurate near the atoms. 2) The kind field is queried only around the atoms. Thus, it does not need to be accurate everywhere, but it must be robust to errors in the estimated atomic positions.

[0036] To meet the above requirements, we introduce two sampling methods to train the position and type fields. 1) Global Grid Sampling: In this method, we consider 3D grid points that uniformly cover the entire unit cell and sample the points with perturbations that follow a Gaussian distribution. 2) Local Grid Sampling: In this method, we consider local 3D grid points centered on each atomic position and sample the points with perturbations that follow a Gaussian distribution.

[0037] To train the position field, we combine both sampling methods: thus, query points are uniformly sampled across the unit cell and densely sampled around atoms. To train the kind field, we use local grid sampling to concentrate the training query points in the neighborhood of atoms.

[0038] <2.3 Crystal structure autoencoder> To demonstrate and evaluate the representational power of NeSF, we propose an autoencoder for crystal structures. Similar to other popular autoencoders, the proposed NeSF-based autoencoder consists of an encoder and a decoder. The encoder is a neural network that converts the input crystal structure (i.e., the positions and species of atoms in the unit cell, and the lattice constants) into an abstract latent vector z. The decoder, using NeSF, reconstructs the input crystal structure from the latent vector z. Autoencoders are typically used to learn latent vector representations of data via self-supervised learning, where the input data can be supervised during learning via the reconstruction loss.

[0039] We focus on deciphering crystal structures, whose encoding has been studied in MI. As crystal structures are essentially collections of atoms, their encoding needs to be invariant to permutations and handle a variable number of atoms. In ML, such encoders are commonly called set functions [28, 29]. Among them, the family of graph neural networks [10, 16, 17, 27] serves as a general crystal structure encoder. However, these networks implicitly represent the positions of atoms as edges, encoding the distances between atoms while discarding their exact coordinates. This distance-based graph representation is key to ensure invariance to coordinate systems, but the loss of information at the input may unintentionally hinder the reconstruction performance. Therefore, we adopt the basic encoder architectures of PointNet

[28] and DeepSets

[29] . This architecture is suitable for the performance evaluation of the NeSF decoder, since it not only represents the simplest type of set function-based network, but also allows us to preserve the information of the input crystal structure. The proposed autoencoder architecture is detailed in Section 4.2 of Figure 28.

[0040] <Training and evaluation procedures> We trained and evaluated the autoencoder and ICSG3D24 (baseline) on three materials datasets: ICSG3D, limited cell size 6 Å (LCS6 Å), and YBCO-like datasets. These datasets collect crystal structures of materials from the Materials Project and are designed to have a range of difficulty levels. The ICSG3D dataset

[24] is a materials collection and three datasets that contain 7897 materials with limited crystal systems (cubic) and prototypic (i.e., AB, ABX2, and ABX3). The LCS6 Å dataset consists of 6005 materials with unit cell sizes of 6 Å or less along the x, y, and z axes, with no restrictions on crystal systems and prototypic. The YBCO-like dataset consists of 100 materials with narrow unit cells along the c-axis. These structures typically include those of yttrium barium copper oxide (YBCO) superconductors. Due to its complex structure and relatively few samples, the YBCO-like dataset is the most challenging of the three datasets evaluated. For more details on these data sets, see Figure 27, section 4.1.

[0041] For training and evaluation, we randomly split each dataset into training (90.25%), validation (4.75%), and test (5%) sets. The training set was used only for training the ML models. The validation set was used to pre-validate the trained ML models, and the test set was used to calculate the final evaluation scores after training, validation, and tuning of hyperparameters. The hyperparameters were tuned based on the validation scores of the LCS6Å dataset. To reduce the performance variation due to validation score randomness (e.g., randomness in the initialization of the network weights), we repeated training and evaluation 10 times with different random seeds and evaluated the performance using the mean and standard deviation of the scores. As a dataset like YBCO has only 100 samples, we used the same scores as the other two evaluated datasets. It was processed in a slightly different way from the dot. To reduce the performance variation due to data partitioning, 20-fold cross-validation was adopted for datasets such as YBCO, but it was evaluated once instead of 10 times. The iterative training of the neural network was carried out using stochastic gradient descent with Adam

[36] as the optimizer. The detailed training procedure including the definition of the loss function is provided in Section 4.3 of Figure 28.

[0042] The reconstruction performance was measured in terms of the errors in the number of atoms, positions, and types. The error in the number of atoms is the proportion of materials in which the number of atoms in the unit cell is not correctly estimated. The position error is the average error in the reconstructed atomic positions. Depending on the denominator of the metric, the position error was evaluated in two ways. Using the actual metric, the average position error at the actual atomic sites of the crystal structure was evaluated by calculating the shortest distance to the estimated atomic sites. In contrast, the detected metric was used to evaluate the error at the estimated sites by calculating the shortest distance to the actual atomic sites. The actual metric is more sensitive to errors related to underestimation of the number of atoms, while the detected metric is more sensitive to errors related to overestimation. The type error is the average proportion of atoms whose types are not correctly estimated. Similar to the position error, the type error was evaluated using the actual measurement criterion and the detected measurement criterion. The lower the values of these metrics, the better the performance.

[0043] <Quantitative Performance Comparison with ICSG3D> Table 1 shows the reconstruction errors of the proposed NeSF-based autoencoder and the ICSG3D-based baseline in the test sets of three datasets. Overall, the proposed method is consistently superior to ICSG3D in all evaluation metrics, and the performance of the type error in all datasets and all metrics of datasets such as YBCO has been significantly improved. Figure 3 shows the crystal structures from three evaluated datasets, comparing the test samples with the reconstruction results by the proposed autoencoder and ICSG3D.

[0044] [Table 1]

[0045] For the ICSG3D dataset, the simplest of the three datasets, ICSG3D achieved good performance for atom count error and position error, but with a larger species error (approximately 65% ​​for both real and detected metrics). In contrast, the proposed method achieved a slight improvement in position error and atom count error, and a significant reduction in species error (approximately 4%). This is likely because ICSG3D estimates atomic species via electron density maps, whereas the proposed method more directly represents atomic species as categorical distributions. Extending ICSG3D to estimate categorical distributions for each voxel is impractical, as it would require approximately 100 × 323 times more memory usage at the output (i.e., 100 species categories per 323 voxels in addition to one electron density map).

[0046] For the LCS6Å and YBCO-like datasets, which are more challenging than the ICSG3D dataset, the performance advantage of the proposed method is even clearer, especially with regard to positional errors. The LCS6Å dataset contains a variety of crystal structures (e.g. non-cubic, distorted crystal structures), while the YBCO-like dataset contains a very narrow crystal structure. Moreover, the YBCO-like dataset contains very few samples, which may lead to overfitting of the model (i.e., the performance of the test set may be significantly degraded). Despite these difficulties, the proposed method is able to accurately estimate the positions and species of atoms.

[0047] To analyze in detail the relationship between the performance of the methods and the structural complexity, Figure 4 shows the distribution of reconstruction errors in 10 test trials for materials from the ICSG3D and LCS6Å datasets according to the number of atoms given as the median (point) and the 68% range around them (colored area). Datasets like YBCO are excluded from this analysis since they only contain materials with 13 atoms in the unit cell. Figures 4a and 4b show the signed error between the detected and real atom counts. These results show that both methods correctly estimate the atom count for most (i.e., more than 68%) of the samples in the ICSG3D dataset (Figure 4a). However, the ICSG3D method underestimates the atom count for the LCS6Å dataset (Figure 4b). Similarly, Figures 4c and 4d show the distribution of position errors, while Figures 4e and 4f show the distribution of type errors. In most cases, the atom count is either correctly or underestimated by both methods, so they report errors in the real metric. By examining the distribution at x = 2 in Figure 4 e, the trend in species errors for diatomic structures in the ICSG3D data set can be determined.

[0048] The proposed method provides the correct type of both atoms for more than 68% of diatomic materials, while ICSG3D often erroneously estimates one type of the two atoms. Overall, the three types of errors by both methods tend to increase with the number of atoms, but they consistently perform better than ICSG3D for materials with varying numbers of atoms. Compared to our method, the performance of ICSG3D tends to degrade more significantly for materials with a large number of atoms. ICSG3D tends to underestimate the number of atoms (Fig. 4b), and this tendency is likely due to the spatial resolution of ICSG3D being limited to 32 × 32 × 32 voxels. This suggests that ICSG3D is unable to capture polyatomic structures.

[0049] The remarkable high performance of the proposed method can be attributed to two reasons. First, our method does not use discretization, which makes it advantageous over grid-based ICSG3D for estimating complex crystal structures. In grid-based methods, spatial resolution is limited by exponentially increasing computation and memory usage. The proposed NeSF is free from such a trade-off between resolution and computational complexity, and therefore can effectively represent complex structures. Second, the model size of the proposed NeSF using MLP is much smaller than that of the 3DCNN architecture of ICSG3D. In general, the number of training samples required for an ML model is correlated with the number of trainable parameters. Grid-based methods use layers of 3D convolutional filters that contain many trainable parameters. In contrast, NeSF uses an implicit neural representation to indirectly describe the 3D space as fields rather than voxels. It is therefore efficiently implemented by MLP with fewer parameters than 3DCNN. Specifically, the NeSF-based autoencoder has 760,000 parameters, which is only 2.24% of the number of parameters in the 3DCNN-based ICSG3D (34 million parameters). This difference makes it difficult to scale the model, especially for data such as YBCO. For small datasets such as the set, NeSF has an advantage over grid-based methods.

[0050] <2.4 Latent space interpolation> We qualitatively analyzed the properties of the proposed NeSF-based autoencoder by inspecting the learned latent space of crystal structures. In general, a good latent space should map similar items (in terms of properties, characteristics, categories, etc.) closely in the space. This provides a latent data representation that facilitates analysis by humans and machines. To evaluate the construction of the latent space for crystal structures, we visualized the transitions in the latent space as a sequence of crystal structures. If the latent space is trained to capture the relationships between materials in terms of structural similarity, then interpolating between two points in the latent space should produce a sequence of materials with similar crystal structures.

[0051] The interpolation analysis proceeds as follows.

[0052] 1. Set the ICSG3D test set as the source and destination material, and run z through the trained encoder. src and z dst We obtain their latent vectors as

[0053] 2. To obtain a sequence of latent vectors, we compute z src and z dst Linearly interpolate between .

[0054] 3. Decode each latent vector via the trained decoder (NeSF) to obtain its crystal structure.

[0055] Since intermediate crystal structures between the source and destination are reconstructed from the latent vectors via a trained decoder, these structures may not appear in the dataset.

[0056] To facilitate the interpretation of the analysis, well-known zinc-blende and rock-salt structure families were chosen as benchmark materials. Both families have a composition given by AX, where A is the cation and X is the anion, and the crystal structure is based on a cubic system. Therefore, if the source and destination materials belong to one of these families, the characteristic configurations and structural prototypes should be preserved throughout the interpolation path.

[0057] As a first example, the interpolation result from ZnS (mp-10695) to CdS (mp-2469) is shown in Figure 5. The resulting composition formula transition is ZnS → MgZn3S4 (Mg 0.25 Zinc 0.75 S) → MgZnS2(Mg 0.5 Zinc 0.5 S) → Mg3ZnS4(Mg 0.75 Zinc 0.25 S) → MgS → MgCd3S4(Mg0.25 CD 0.75 S) → CdS.

[0058] As a second example, the result of the interpolation from MgO (mp-1265) to NaCl (mp-22862) is shown in Figure 6. The resulting formula transition is MgO → NaMgO2 (Na 0.5 Mg 0.5 O) → NaO → NaClO(NaCl 0.5 O 0.5 ) →Na4C l3 O( NaCl 0.75 O 0.25 ) →NaCl.

[0059] Furthermore, we provide the results of the interpolation from NaCl (mp‐22862) to PbS, from MgO (mp‐1265) to CaO (mp‐2605), and from PbS (mp‐21276) to CaO (mp‐2605) in the SI.

[0060] In the example of interpolation, the composition AX and the cubic structure are almost preserved. Furthermore, the composition is interpolated. It varies continuously along the path without collapsing. These results suggest that our encoder learns meaningful continuous representations of crystal structure features by capturing them in an abstract space, and the proposed NeSF model successfully decodes these representations into crystal structures.

[0061] 2.5 Limitations and future directions This work primarily focused on developing a fundamental approach for inferring crystal structures using implicit neural representations. We identified three main limitations of NeSF to suggest room for further improvement and important directions for future work.

[0062] First, NeSF employs a relatively simple network architecture, and architectural design choices were not fully explored. For example, NeSF treats elements as mutually independent categorical (one-hot) vectors. Thus, it does not explicitly train the model using the physical properties or similarities of the elements. Meanwhile, other developments have attempted to explicitly inject the physical properties and features of elements into the model. For example, existing crystal structure encoders

[16] represent input elements using fingerprints such as group and period, electron density, atomic radius, and electronegativity instead of using one-hot vectors. In ICSG3D24, the output of atomic species is trained using the mean squared error of atomic numbers, rather than categorical loss as considered in our method. Incorporating these schemes into the model could potentially reflect the properties and similarities between elements in the latent space and the reconstructed crystal structure. Another architectural choice regarding NeSF is whether to use traditional (the current choice) or primitive cells to represent the crystal structure. Both forms have advantages and disadvantages depending on the application. While traditional unit cells provide a more intuitive visualization that facilitates manual analysis, primitive unit cells provide a more compact structural representation that may facilitate computational processing. Future work requires a thorough analysis of the design of network architectures.

[0063] Another limitation is that the proposed NeSF does not explicitly consider the symmetry of the space group. Therefore, the local spatial arrangement of atoms in a conventional unit cell estimated by NeSF does not necessarily follow the space group symmetry. Although ICSG3D

[24] has the same limitation, symmetry is an important concept in crystallography. Therefore, incorporating space group symmetry constraints into NeSF is an important direction for future work.

[0064] Finally, for evaluation purposes, we employ an autoencoder architecture rather than generative models such as variational autoencoders [16,25,37] or generative adversarial networks [26,37-39]. These generative models intentionally perturb the latent structural representation to generate diverse structures not present in the dataset. This aspect of generative models is more suitable for discovering novel structures, but the lack of ground truth structures prevents quantitative and reliable performance analysis.

[0065] NeSF should be applied to generative models in future work with appropriate performance analysis.

[0066] <3 Summary> In this embodiment, we proposed NeSF, which uses neural networks to estimate crystal structures. It is difficult to directly determine crystal structures using neural networks, because these structures are essentially represented as unordered sets containing various numbers of atoms. NeSF overcomes this problem by treating crystal structures as continuous vector fields rather than as a set of discrete atoms. The idea of ​​NeSF is borrowed from vector fields in physics and recent implicit neural representations in computer vision. Implicit neural representations are ML methods that use neural networks to represent 3D geometry. NeSF extends this method by introducing position and type fields to estimate atomic positions and species in crystal structures, respectively. Unlike existing grid-based approaches for representing crystal structures, NeSF can represent arbitrary crystal structures without the tradeoff between spatial resolution and computational complexity.

[0067] NeSF was applied as an autoencoder for crystal structures and demonstrated its performance and expressiveness on a dataset with diverse crystal structures. Quantitative performance analysis showed clear advantages of the NeSF-based autoencoder over existing grid-based methods, especially in estimating complex crystal structures. Furthermore, qualitative analysis of the learned latent space revealed that the autoencoder captures similarities between crystal structures rather than randomly mapping them.

[0068] In materials science, designing and constructing crystal structures is a fundamental process in searching for materials with desired properties. ML is rapidly advancing due to the development of neural networks, and using those networks to represent arbitrary crystal structures is essential for the development of next-generation materials. For example, NeSF can be easily incorporated into powerful deep generative models such as variational autoencoders and generative adversarial networks to discover new crystal structures. Such generative models of crystal structures will be important for the inverse design of materials, which is a major challenge in MI. NeSF can overcome the technical bottleneck of ML in crystal structure estimation and pave the way for the development of next-generation materials.

[0069] Fig. 7 is a block diagram showing a hardware configuration of an information processing device 10 according to this embodiment. As shown in Fig. 7, the information processing device 10 has a CPU (Central Processing Unit) 12, a memory 14, a storage device 16, an input / output I / F (Interface) 18, a storage medium reading device 20, and a communication I / F 22. Each component is connected to each other via a bus 24 so as to be able to communicate with each other.

[0070] The storage device 16 stores information processing programs for executing the various processes described below. The CPU 12 is a central processing unit, and executes various programs and controls each component. That is, the CPU 12 reads the programs from the storage device 16 and executes the programs using the memory 14 as a working area. The CPU 12 performs the various arithmetic processes described above in accordance with the programs stored in the storage device 16.

[0071] The memory 14 is made up of a RAM (Random Access Memory) and temporarily stores programs and data as a working area. The storage device 16 is made up of a ROM (Read Only Memory), HDD (Hard Disk Drive), SSD (Solid State Drive), etc., and stores various programs including an operating system, and various data.

[0072] The input / output I / F 18 is an interface for inputting data from an external device and outputting data to an external device. In addition, an input device for performing various inputs, such as a keyboard or a mouse, and an output device for outputting various information, such as a display or a printer, may be connected. A touch panel display may be used as the output device to function as the input device.

[0073] The storage medium reader 20 reads data stored in various storage media such as CD (Compact Disc)-ROMs, DVD (Digital Versatile Disc)-ROMs, Blu-ray discs, and USB (Universal Serial Bus) memories, and writes data to the storage media.

[0074] The communication I / F 22 is an interface for communicating with other devices, and uses standards such as Ethernet (registered trademark), FDDI, and Wi-Fi (registered trademark).

[0075] The information processing device 10 of the present embodiment uses the above-mentioned method to train an autoencoder including an encoder and a decoder, thereby making it possible to represent a field representing a substance structure composed of atomic point groups using a neural network model.

[0076] Next, the functional configuration of the information processing device 10 will be described. As shown in Fig. 8, the information processing device 10 functionally includes a learning acquisition unit 102, a learning unit 104, an acquisition unit 108, and a processing unit 110. A data storage unit 100 and a trained model storage unit 106 are provided in a predetermined storage area of ​​the information processing device 10. Each functional configuration is realized by the CPU 12 reading each program stored in the storage device 16, expanding it in the memory 14, and executing it.

[0077] First, the information processing device 10 trains a neural network model that expresses a field that represents the structure of a substance that is configured by a group of atomic points.

[0078] Training crystal data representing the crystal structure of a substance is stored in the data storage unit 100. The training crystal data includes position data representing the positions of atoms constituting the crystal of the substance, type data representing the types of atoms constituting the crystal of the substance, and lattice constant data of the crystal of the substance.

[0079] FIG. 9 is a diagram showing an example of a plurality of training crystal data stored in the data storage unit 100. As shown in FIG. 9, one training crystal data is data representing the crystal structure of a certain substance. As shown in FIG. 9, one training crystal data is stored in such a manner that position data representing the positions of a plurality of atoms constituting a crystal of a certain substance, type data representing the types of a plurality of atoms constituting the crystal of the substance, and lattice constant data of the crystal of the substance are associated with each other. The position data is three-dimensional position coordinate data of each of the plurality of atoms. The type data is label data representing the type of each of the plurality of atoms. The lattice constant data includes the length of the crystal axis and the angle between the axes.

[0080] Fig. 10 is a diagram for explaining the structure of the autoencoder of this embodiment and an overview of the processing executed by the information processing device 10 of this embodiment. Fig. 10 is a more simplified diagram of Fig. 1(b).

[0081] As shown in FIG. 10, the autoencoder AE of this embodiment includes an encoder E, a first decoder D1, a second decoder D2, and a third decoder D3.

[0082] 10, when a combination of position data P representing the positions of atoms constituting the crystal of a substance, type data S representing the type of atoms constituting the crystal of a substance, and lattice constant data L of the crystal of the substance is input, the encoder E outputs a latent vector z. Note that one crystal data representing a combination of the position data P, type data S, and lattice constant data L is set for one crystal structure of a substance.

[0083] Also, as shown in FIG. 10, when a combination of a query point p, which is a point of interest in a substance, and a latent vector z is input, the first decoder D1 generates a position field f p This position field f p Based on this, the estimated position data P of the atoms constituting the crystal of the substance is e is calculated. The calculation method will be described later.

[0084] Also, as shown in FIG. 10, when a combination of a query point p, which is a point of interest in a substance, and a latent vector z is input, the second decoder D2 generates a type field f s This type field f s Based on this, the estimated type data S of the atoms that make up the crystal of the substance is e is calculated. The calculation method will be described later.

[0085] Also, as shown in FIG. 10, when a query point p, which is a point of interest in a material, and a latent vector z are input, the third decoder D3 generates estimated lattice constant data L of the crystal of the material. eIn this embodiment, the third decoder D3 is one. However, the third decoder D3 may be two. In this case, the third decoder D3 is composed of, for example, a decoder that outputs the length of the crystal axis and a decoder that outputs the inter-axis angle.

[0086] The information processing device 10 of this embodiment calculates a combination of position data P, type data S, and lattice constant data L input to the autoencoder AE, and estimated position data P output from the autoencoder AE. e and estimated species data S e and the estimated lattice parameter data L e Each parameter of the autoencoder AE is trained by unsupervised machine learning (or self-supervised learning) so that the combination of and matches. This results in a trained autoencoder AE. In addition, a trained first decoder D1, a trained second decoder D2, and a trained third decoder D3, which are components of the trained autoencoder AE, are obtained.

[0087] When the learning acquisition unit 102 receives an instruction signal to train the autoencoder AE, it reads out the learning crystal data stored in the data storage unit 100. The learning acquisition unit 102 also sets learning query points that are points of interest in the learning material. The learning acquisition unit 102 may set the learning query points by randomly sampling positions in space in the learning material.

[0088] When the learning unit 104 trains the autoencoder AE using unsupervised machine learning, it inputs training crystal data to the encoder E of the autoencoder AE to obtain a latent vector z representing the crystal structure of the training material. The encoder E can be realized, for example, by using the idea of ​​PointNet

[28] or DeepSets

[29] described above.

[0089] Next, the learning unit 104 inputs a combination of the latent vector z and the learning query point p to the first decoder D1 of the autoencoder AE to generate a position field f p Then, the learning unit 104 obtains the position field f p Based on this, the positions of the atoms that make up the crystal of the learning material are estimated.

[0090] FIG. 11 is a diagram for explaining the setting of training query points and position fields. Note that FIG. 11 is a diagram similar to FIG. 2, but is shown again for the sake of explanation. As shown in FIG. 11, a plurality of training query points are set in a space M within a substance. The white circles shown in FIG. 11 represent the training query points. Also, A1, A2, and A3 shown in FIG. 11(a) represent the actual positions of atoms in the space M within the substance.

[0091] The learning unit 104 inputs a combination of the learning query point p and the latent vector z to the first decoder D1, thereby generating a position field f as shown in FIG. p Each of the arrows shown in FIG. 11 points to a position field f p Corresponds to.

[0092] Then, the learning unit 104 calculates the position field f output from the first decoder D1 as shown in FIG. p In particular, the training unit 104 updates the position of each of the plurality of training query points according to the position field f p, and generates a new position of the training query point by adding a vector represented by the ... e 1,P e 2,P e You get 3.

[0093] Next, the learning unit 104 obtains a type field fs representing the field of types of atoms constituting the crystal of the training material by inputting a combination of the latent vector z and the training query point p to the second decoder D2 of the autoencoder AE. Then, the learning unit 104 estimates the types of atoms constituting the crystal of the training material based on the type field fs output from the second decoder D2.

[0094] Fig. 12 is a diagram for explaining the setting of training query points and the type field. Note that Fig. 12 is a diagram similar to Fig. 2, but is shown again for the sake of explanation. As shown in Fig. 12, a plurality of training query points are set in a space M within a substance. As in Fig. 12, the white circles shown in Fig. 12 represent the training query points.

[0095] Specifically, the learning unit 104 calculates the estimated position P e 1,P e 2,P e Position of 3 and estimated position P e 1,P e 2,P e We set multiple learning query points for the surrounding positions of 3 and .

[0096] Then, the learning unit 104 inputs a combination of the learning query point p and the latent vector z to the second decoder D2, thereby generating a type field f sAs shown in Fig. 12(g), the type field f s corresponds to the probability representing the type of atom obtained for each training query point. In the example shown in Fig. 12(g)(h), it is shown that the type of atom located at one training query point is most likely to be iron (Fe), and the type of atom located at another training query point is most likely to be copper (Cu).

[0097] Then, the learning unit 104 calculates the type field f output from the second decoder D2 as shown in FIG. s For example, the learning unit 104 estimates the type of atom corresponding to each position of the multiple learning query points according to the estimated position P e 1,P e 2,P e For each of the estimated positions P3, the learning unit 104 identifies the element with the highest probability at the learning query point corresponding to the estimated position and the element with the highest probability at the learning query points surrounding the estimated position. e 1,P e 2,P e The most frequent element at multiple learning query points set for each of 3 is estimated at the position P e 1,P e 2,P e 3. Therefore, the estimated position P e The estimated type of atoms present in 1, S e 1 and the estimated position P e The estimated type of atoms present in 2 e 2 and the estimated position P e Estimated type of atoms present in 3 S e 3 is obtained.

[0098] For example, as shown in FIG. 12(i), the estimated position P e The type of atom at 1 is estimated to be silicon Si, and the estimated position P e The type of atom at 2 is estimated to be iron Fi, and the estimated position P e The type of atom at position 3 is presumed to be copper (Cu).

[0099] Next, the learning unit 104 inputs the latent vector z to the third decoder D3 of the autoencoder AE to obtain the lattice constant data L of the crystal of the learning material. e The lattice constant data L output from the third decoder D3 is obtained. e includes the lengths of the crystal axes and the interaxial angles.

[0100] Then, the learning unit 104 generates a trained first decoder D1 and a trained second decoder D2 by training the autoencoder AE using unsupervised machine learning so that the combination of the estimated atomic positions, the estimated atomic types, and the lattice constant data output from the third decoder D3 corresponds to the combination of the atomic positions, the atomic types, and the lattice constant data in the training crystal data.

[0101] For example, in the above example, the learning unit 104 estimates the estimated position P e 1,P e 2,P e 3 matches the atomic position data P1, P2, and P3 in the learning crystal data, and the estimated type of the atom S e 1,S e 2,S e 3 matches the atomic type data S1, S2, and S3 in the learning crystal data, and the lattice constant data L e The autoencoder AE is trained using unsupervised machine learning so that the lattice constant data L in the training crystal data coincides with the lattice constant data L in the training crystal data, thereby generating a trained first decoder D1 and a trained second decoder D2.

[0102] The learning unit 104 stores the trained autoencoder AE in the trained model storage unit 106. Since the trained autoencoder AE also includes a trained first decoder D1, a trained second decoder D2, and a trained third decoder D3, these trained models are also stored in the trained model storage unit 106.

[0103] In addition, when the trained encoder E is input with crystal data representing the crystal structure of a substance, the crystal data including position data representing the positions of the atoms constituting the crystal of the substance, type data representing the types of atoms constituting the crystal of the substance, and lattice constant data of the crystal of the substance, it outputs a latent vector z representing the crystal of the substance.

[0104] As described above, the field data representing the field of the structure of a substance in this embodiment is represented by a position field representing the field of the positions of atoms constituting the crystal of the substance, and a type field representing the field of the type of atoms constituting the crystal of the substance. Therefore, when an arbitrary vector and a query point are input, the trained first decoder D1, which is an example of a trained first neural network model, generates a position field f corresponding to the query point. p In addition, the second decoder D2, which is an example of a trained second neural network model, outputs a type field f s The trained first decoder D1 and the trained second decoder D2 are an example of a trained neural network model that, when an arbitrary vector and a query point are input, outputs field data representing the field of the structure of a material at the query point.

[0105] The trained third decoder, when a combination of an arbitrary vector in place of the latent vector z and a query point is input, derives the lattice constant data L e Output.

[0106] When the acquiring unit 108 receives an instruction signal to acquire field data of the crystal structure of the target substance, the acquiring unit 108 reads out the trained first decoder D1 and the trained second decoder D2 stored in the trained model storage unit 106. In addition, the acquiring unit 108 acquires, for example, a target vector input by a user and a query point which is a point of interest in the substance.

[0107] The target vector is an arbitrary vector that replaces the latent vector z, and may be any vector that describes the properties of the material in the same manner as the latent vector. For example, the target vector may be a vector that represents the physical properties desired by the user. For example, the target vector may be a vector that represents the physical properties of a material, such as a first component of the target vector storing [bandgap = xxx] and a second component storing [formation energy = xxx]. In this case, the trained first decoder D1 and the trained second decoder D2 are treated as pre-trained models, and are re-trained by the vector that represents the physical properties of the material, so that useful field data is output from the trained first decoder D1 and the trained second decoder D2.

[0108] The processing unit 110 inputs the target vector and the query point acquired by the acquisition unit 108 to the trained first decoder D1 and the trained second decoder D2, thereby acquiring field data corresponding to the query point.

[0109] Specifically, the processing unit 110 inputs the target vector and the query point acquired by the acquisition unit 108 to the trained first decoder D1, thereby obtaining a position field f p In addition, the processing unit 110 inputs the target vector and the query point acquired by the acquisition unit 108 to the trained second decoder D2, thereby acquiring a type field f s Get the.

[0110] The field data output from the trained first decoder D1 and the trained second decoder D2 is data representing the field of the structure of a substance according to the target vector and the query point. By inputting a target vector, which is an arbitrary vector, instead of a latent vector to the trained first decoder D1 and the trained second decoder D2, it may be possible to predict the crystal structure represented by the target vector, etc.

[0111] For example, when the target vector is a vector that represents the desired physical properties as described above, the field data corresponding to the vector is output. By inputting a plurality of query points to the trained second decoder D2 and the trained second decoder D2, the field data at the plurality of query points is acquired, so that it is also possible to generate a crystal structure of a substance having desired physical properties based on the field data.

[0112] For example, measurement data of XRD (X-ray diffraction) can be used as the target vector. In this case, it is possible to predict the crystal structure of the target substance by inputting the measurement data of XRD of the target substance to the trained first decoder D1 and the trained second decoder D2. It is also possible to use the trained first decoder D1 and the trained second decoder D2 of this embodiment in combination with an encoder that processes other modalities such as text data.

[0113] <Function of the information processing device 10> Next, the operation of the information processing device 10 according to the embodiment will be described with reference to the drawings. When the information processing device 10 receives training crystal data, the data is stored in the data storage unit 100. Then, when the information processing device 10 receives an instruction signal to start a training process, the information processing device 10 executes a trained model generation process routine shown in FIG.

[0114] <Trained model generation processing routine> In step S100 , the learning acquisition unit 102 acquires a plurality of learning crystal data stored in the data storage unit 100 .

[0115] In step S102, the learning acquisition unit 102 sets one learning crystal data from the multiple learning crystal data acquired in step S100. Then, the learning unit 104 calculates multiple learning query points p i where i is an index for identifying the training query point.

[0116] In step S104, the learning unit 104 obtains a latent vector z by inputting the position data P, type data S, and lattice constant data L of the learning crystal data set in step S102 above to the encoder E of the autoencoder AE.

[0117] In step S106, the learning unit 104 uses the learning query point p i The combination of the latent vector z set in step S104 and the latent vector z is input to the first decoder D1 to obtain a position field f p In addition, the learning unit 104 acquires a position field f p Get the.

[0118] In step S108, the learning unit 104 uses the learning query point p i The combination of the latent vector z set in step S104 and the latent vector z is input to the second decoder D2, whereby the type field f s In addition, the learning unit 104 acquires a type field f s Get the.

[0119] In step S110, the learning unit 104 uses the learning query point p i The combination of the latent vector z set in step S104 and the lattice constant data L e The learning unit 104 acquires the lattice constant data L for each of the multiple learning query points. e Get the.

[0120] In step S112, the learning unit 104 calculates the position field f p The learning unit 104 updates the positions of the multiple learning query points by the above-mentioned method, and estimates the final estimated position Pe get.

[0121] In step S114, the learning unit 104 calculates the estimated position P e and the type field f obtained in step S108. s Based on this, the learning unit 104 estimates the type of atom. e The estimated type of atoms present in S e get.

[0122] In step S116, the learning unit 104 calculates the estimated position P e and the position data P of the atom in the learning crystal data match, and the estimated type S of the atom obtained in step S114 e and the atomic type data S in the learning crystal data match, and the lattice constant data L obtained in step S110 e The autoencoder AE is trained using unsupervised machine learning so that the lattice constant data L in the training crystal data coincides with the lattice constant data L in the training crystal data, thereby generating a trained first decoder D1 and a trained second decoder D2.

[0123] The processes of steps S102 to S116 are repeated until the machine learning termination condition is satisfied. For example, the machine learning termination condition may be that the machine learning process has been repeated a predetermined number of times, or that the error between the data output from the autoencoder AE and the training crystal data is equal to or less than a predetermined threshold. Note that, although the above description has been given with an example in which one training crystal data is set and training is performed, the present invention is not limited to this, and machine learning may be performed at once using multiple training crystal data.

[0124] In step S118, the learning unit 104 determines whether the above-mentioned termination condition is satisfied. If the termination condition is satisfied, the process proceeds to step S120. On the other hand, if the termination condition is not satisfied, the process returns to step S102.

[0125] In step S120, the learning unit 104 stores in the trained model storage unit 106 the trained autoencoder AE obtained by the machine learning processing in steps S102 to S116.

[0126] Next, upon receiving the target vector and the query point, the information processing device 10 executes an estimation process routine shown in FIG.

[0127] <Estimation processing routine> In step S200, the acquisition unit 108 acquires a target vector and a query point.

[0128] In step S202, the processing unit 110 reads out the trained first decoder D1 and the trained second decoder D2 stored in the trained model storage unit .

[0129] In step S204, the processing unit 110 inputs the target vector and the query point acquired in step S200 to the trained first decoder D1 read in step S202, and generates a position field f according to the target vector and the query point. p Get the.

[0130] In step S206, the processing unit 110 inputs the target vector and the query point acquired in step S200 to the trained second decoder D2 read in step S202, thereby generating a type field f s Get the.

[0131] In step S208, the processing unit 110 calculates the position field f p and the type field f obtained in step S206 s and are output as the result.

[0132] As described above, the information processing device 10 can learn a neural network model that expresses a field that represents the structure of a substance that is configured by a group of atomic points. Furthermore, the information processing device 10 can use the neural network model to express a field that represents the structure of a substance that is configured by a group of atomic points.

[0133] Specifically, the information processing device 10 acquires training crystal data representing a crystal structure of a training substance, the training crystal data including position data representing the positions of atoms constituting the crystal of the training substance, type data representing the type of atoms constituting the crystal of the training substance, and lattice constant data of the crystal of the training substance, and a training query point which is a focus point in the training substance. When training an autoencoder using unsupervised machine learning, the information processing device 10 acquires a latent vector representing the crystal structure of the training substance by inputting the training crystal data to an encoder of the autoencoder. The information processing device 10 acquires a position field representing the field of the positions of atoms constituting the crystal of the training substance by inputting a combination of the latent vector and the training query point to a first decoder of the autoencoder. The information processing device 10 estimates the positions of the atoms constituting the crystal of the training substance based on the position field output from the first decoder. The information processing device 10 acquires type field data representing the field of the type of atoms constituting the crystal of the training substance by inputting a combination of the latent vector and the training query point to a second decoder of the autoencoder. The information processing device 10 estimates the type of atoms constituting the crystal of the training material based on the type field output from the second decoder. The information processing device 10 acquires lattice constant data of the crystal of the training material by inputting a combination of the latent vector and the training query point to a third decoder of the autoencoder. The information processing device 10 generates a trained first decoder and a trained second decoder by training the autoencoder using unsupervised machine learning so that a combination of the estimated atomic position, the estimated atomic type, and the lattice constant data output from the third decoder corresponds to a combination of the position data, the type data, and the lattice constant data of the training crystal data.

[0134] In this embodiment, by adopting the above-mentioned method, it is possible to express the field representing the structure of a substance by a neural field, and it is also possible to generate crystal data from a vector of fixed length.

[0135] The information processing device 10 also acquires a target vector and a query point, which is a point of interest in a substance, and inputs the target vector and the query point to a first decoder and a second decoder, which are examples of a trained neural network model, to acquire field data corresponding to the query point. This field data is represented by a position field representing the field of the position of atoms constituting the crystal of the substance, and a type field representing the field of the type of atoms constituting the crystal of the substance. When an arbitrary vector instead of the latent vector and the query point are input, the first decoder outputs a position field corresponding to the query point. When an arbitrary vector instead of the latent vector and the query point are input, the second decoder outputs a type field corresponding to the query point. The information processing device 10 acquires a position field corresponding to the query point by inputting the target vector and the query point to the first decoder. The information processing device 10 also acquires a type field corresponding to the query point by inputting the target vector and the query point to the second decoder. For example, when the target vector is a vector representing a desired physical property, field data corresponding to the vector is output. By inputting multiple query points into the trained second decoder D2 and the trained second decoder D2, field data at the multiple query points is obtained, and it is also possible to generate a crystal structure of a material having desired physical properties based on the field data.

[0136] When changing the target vector, it is preferable to re-learn the trained first decoder D1 and the trained second decoder D2. In this case, the trained first decoder D1 and the trained second decoder D2 are used as pre-trained models.

[0137] In the above embodiment, the field representing the crystal structure is modeled by the neural field, but the present invention is not limited to this. The neural field may be used to model not only the crystal structure including the repeating structure, but also the structure of a substance composed of a group of atomic points that does not include the repeating structure. In this case, the estimation of the lattice constant may be unnecessary, and therefore the Lattice Decorder shown in FIG. 1 may be unnecessary.

[0138] In the above embodiment, the vector z input to the decoder is a latent vector output from the encoder, but the present invention is not limited to this. For example, the vector z may be a vector that represents a physical property desired by the user, and the vector z may be configured to be provided to the decoder (for example, conditions such as bandgap=xxx, formation energy=xxx are expressed by a vector). Also, the vector z may be configured to use random noise.

[0139] In the above embodiment, an autoencoder including an encoder and a decoder is used as a neural network model, but the present invention is not limited to this. Other models may be used as the neural network model, for example, a generative adversarial network (GAN).

[0140] 15 to 30 are diagrams for explaining the details of this embodiment.

[0141] In addition, various processors other than the CPU may execute each process executed by reading the software (program) in the above embodiment. Examples of the processor in this case include a PLD (Programmable Logic Device) such as an FPGA (Field-Programmable Gate Array) whose circuit configuration can be changed after manufacture, and a dedicated electric circuit such as an ASIC (Application Specific Integrated Circuit) which is a processor having a circuit configuration designed exclusively for executing a specific process. Each process may be executed by one of these various processors, or may be executed by a combination of two or more processors of the same or different types (for example, a plurality of FPGAs, a combination of a CPU and an FPGA, etc.). More specifically, the hardware structure of these various processors is an electric circuit that combines circuit elements such as semiconductor elements.

[0142] In the above embodiment, the programs are stored (installed) in advance in a storage device, but the present invention is not limited to this. The programs may be provided in a form stored in a storage medium such as a CD-ROM, a DVD-ROM, a Blu-ray disc, or a USB memory. The programs may be downloaded from an external device via a network.

[0143] (Additional Note) The following additional notes are given regarding aspects of the present disclosure.

[0144] (Appendix 1) An information processing device including a processing unit that uses a neural network model to represent a field that represents a structure of a substance constituted by a group of atomic points.

[0145] (Appendix 2) The method further includes an acquisition unit that acquires a target vector and a query point that is a point of interest within the material, the neural network model is a trained neural network model that, when an arbitrary vector and the query point are input, outputs field data representing a field of a structure of the material at the query point; the processing unit inputs the target vector and the query point acquired by the acquisition unit to the trained neural network model, thereby acquiring the field data corresponding to the query point; 2. An information processing device according to claim 1.

[0146] (Appendix 3) the field data is represented by a position field representing a field of a position of an atom constituting the crystal of the substance, and a type field representing a field of a type of an atom constituting the crystal of the substance; the trained neural network model includes a trained first neural network model and a trained second neural network model; the trained first neural network model, when the arbitrary vector and the query point are input, outputs the position field corresponding to the query point; the second trained neural network model, when the arbitrary vector and the query point are input, outputs the type field corresponding to the query point; The processing unit includes: acquiring the position field corresponding to the query point by inputting the target vector and the query point acquired by the acquisition unit into the trained first neural network model; acquiring the type field corresponding to the query point by inputting the target vector and the query point acquired by the acquisition unit into the trained second neural network model; 3. An information processing device according to claim 2.

[0147] (Appendix 4) The trained neural network model is A trained model is generated in advance by machine learning based on training crystal data, the training crystal data including: crystal data representing a crystal structure of the substance, the crystal data including position data representing positions of atoms constituting the crystal of the substance, type data representing types of atoms constituting the crystal of the substance, and lattice constant data of the crystal of the substance. 4. The information processing device according to claim 2 or 3.

[0148] (Appendix 5) The trained neural network model is a trained first decoder and a trained second decoder of a trained autoencoder, When a trained encoder of the trained autoencoder receives crystal data representing a crystal structure of the substance, the crystal data including position data representing positions of atoms constituting the crystal of the substance, type data representing types of atoms constituting the crystal of the substance, and lattice constant data of the crystal of the substance, the trained encoder outputs a latent vector representing a crystal of the substance; the trained first decoder, when the arbitrary vector replacing the latent vector and the query point are input, outputs the position field corresponding to the query point; the trained second decoder, when the arbitrary vector replacing the latent vector and the query point are input, outputs the type field corresponding to the query point; The trained first decoder and the trained second decoder are trained models obtained by performing unsupervised machine learning on an autoencoder including an encoder, a first decoder, and a second decoder based on the crystal data. 4. The information processing device according to claim 3.

[0149] (Appendix 5) the autoencoder further comprising a third decoder; The trained third decoder is a trained model that outputs lattice constant data of a crystal of the substance when the arbitrary vector instead of the latent vector is input. 5. The information processing device according to claim 4.

[0150] (Appendix 7) A trained model generating device including a learning unit that trains a neural network model that expresses a field that represents the structure of a substance composed of atomic point groups.

[0151] (Appendix 8) The learning acquisition unit further includes: learning crystal data representing a crystal structure of the learning substance, the learning crystal data including position data representing the positions of atoms constituting the crystal of the learning substance, type data representing the types of atoms constituting the crystal of the learning substance, and lattice constant data of the crystal of the learning substance; and a learning query point which is a point of interest within the learning substance; The learning unit is When training an autoencoder using unsupervised machine learning, The training crystal data is input to an encoder of the autoencoder to obtain a latent vector representing a crystal structure of the training substance; A combination of the latent vector and the training query point is input to a first decoder of the autoencoder to obtain a position field representing a position field of atoms constituting a crystal of the training material; estimating positions of atoms constituting the crystal of the learning material based on the position field output from the first decoder; A combination of the latent vector and the training query point is input to a second decoder of the autoencoder to obtain type field data representing a field of types of atoms constituting a crystal of the training substance; estimating the type of atoms constituting the crystal of the learning material based on the type field output from the second decoder; A combination of the latent vector and the training query point is input to a third decoder of the autoencoder to obtain lattice constant data of a crystal of the training material; generating a trained first decoder and a trained second decoder by training an autoencoder using unsupervised machine learning so that a combination of the estimated atomic positions, the estimated atomic types, and the lattice constant data output from the third decoder corresponds to a combination of the position data, the type data, and the lattice constant data in the training crystal data; 8. The trained model generation device according to claim 7.

[0152] (Appendix 9) An information processing method in which a computer executes a process to represent a field that represents the structure of a substance composed of a group of atomic points using a neural network model.

[0153] (Appendix 10) A trained model generation method in which a computer executes processing to train a neural network model that expresses a field that represents the structure of a substance composed of atomic point groups.

[0154] (Appendix 11) An information processing program that uses a neural network model to cause a computer to execute processing that represents a field that represents the structure of a substance composed of atomic point groups.

[0155] (Appendix 12) A trained model generation program that trains a neural network model that expresses a field that represents the structure of a substance composed of atomic point groups, and allows a computer to execute processing. [Explanation of symbols]

[0156] 10. Information processing device 10. Information processing device 100 Data storage unit 102 Learning acquisition section 104 Learning Department 106 Model Memory Section 108 Acquisition Department 110 Processing section

Claims

1. An acquisition unit that acquires target material information representing a target material composed of atoms and a query point that is a point of interest within the target material; a processing unit that, when substance information representing an arbitrary substance and a query point that is a point of interest within the arbitrary substance are input, outputs field data indicating a field that represents a structure of the arbitrary substance at the query point to a trained neural network model, by inputting the target substance information and the query point acquired by the acquisition unit, acquires the field data corresponding to the query point; An information processing device comprising:

2. The trained neural network model corresponds to an implicit function that represents a field that represents a structure of a substance composed of atoms, the processing unit inputs the target material information and the query points to the trained neural network model to obtain the field data as values ​​of the implicit function; The information processing device according to claim 1 .

3. The value of the implicit function includes position information of an atom located closest to the query point. The information processing device according to claim 2 .

4. the value of the implicit function includes information indicative of the species of the atom; 4. The information processing device according to claim 2.

5. The atoms are represented by point groups; The information processing device according to claim 1 .

6. The target material information is expressed in a continuous representation. The information processing device according to claim 1 .

7. The continuous representation is obtained by an interpolation process in a latent space. The information processing device according to claim 6.

8. the field represents the structure of the material within a unit cell of a crystal structure; The information processing device according to claim 1 .

9. The trained neural network model further comprises a decoder for estimating a lattice constant of the target material. The information processing device according to claim 4.

10. The trained neural network model is incorporated into a part of a generative model. The information processing device according to claim 1 .

11. The generative model is a variational autoencoder or a generative adversarial network. The information processing device according to claim 10.

12. the field represents at least one of a perovskite material structure, a superconductor structure, a cubic structure, a non-cubic structure, and a distorted crystal structure; The information processing device according to claim 1 .

13. The target material information is any one of a band gap and a formation energy. The information processing device according to claim 1 .

14. The target material information is a target vector which is a vector representing the target material, the neural network model is a trained neural network model that, when an arbitrary vector and the query point are input, outputs field data representing the field at the query point; the processing unit inputs the target vector and the query point acquired by the acquisition unit to the trained neural network model, thereby acquiring the field data corresponding to the query point; The information processing device according to claim 1 .

15. the field data is represented by a position field representing a field of a position of an atom constituting the crystal of the substance, and a type field representing a field of a type of an atom constituting the crystal of the substance; the trained neural network model includes a trained first neural network model and a trained second neural network model; the trained first neural network model, when the arbitrary vector and the query point are input, outputs the position field corresponding to the query point; the second trained neural network model, when the arbitrary vector and the query point are input, outputs the type field corresponding to the query point; The processing unit includes: acquiring the position field corresponding to the query point by inputting the target vector and the query point acquired by the acquisition unit into the trained first neural network model; acquiring the type field corresponding to the query point by inputting the target vector and the query point acquired by the acquisition unit into the trained second neural network model; The information processing device according to claim 14.

16. The trained neural network model is A trained model is generated in advance by machine learning based on training crystal data, the training crystal data including: crystal data representing a crystal structure of the substance, the crystal data including position data representing positions of atoms constituting the crystal of the substance, type data representing types of atoms constituting the crystal of the substance, and lattice constant data of the crystal of the substance. The information processing device according to claim 14 or 15.

17. The trained neural network model is a trained first decoder and a trained second decoder of a trained autoencoder, When a trained encoder of the trained autoencoder receives crystal data representing a crystal structure of the substance, the crystal data including position data representing positions of atoms constituting the crystal of the substance, type data representing types of atoms constituting the crystal of the substance, and lattice constant data of the crystal of the substance, the trained encoder outputs a latent vector representing a crystal of the substance; When the arbitrary vector replacing the latent vector and the query point are input, the trained first decoder calculates the position field corresponding to the query point. and the trained second decoder, when the arbitrary vector replacing the latent vector and the query point are input, outputs the type field corresponding to the query point; The trained first decoder and the trained second decoder are trained models obtained by performing unsupervised machine learning on an autoencoder including an encoder, a first decoder, and a second decoder based on the crystal data. The information processing device according to claim 15.

18. the autoencoder further comprising a third decoder; The trained third decoder is a trained model that outputs lattice constant data of a crystal of the substance when the arbitrary vector instead of the latent vector is input. The information processing device according to claim 17.

19. A learning acquisition unit that acquires learning crystal data representing a crystal structure of a learning substance composed of atoms, the learning crystal data including position data representing the positions of the atoms that constitute the crystal of the learning substance and type data representing the types of atoms that constitute the crystal of the learning substance, and a learning query point that is a point of interest within the learning substance; a learning unit that generates a trained neural network model that represents a field that represents a structure of a substance constituted by atoms, by training the neural network model so that, when the training query point is input to the neural network model, a combination of the estimated position of the atom and the estimated type of the atom output from the neural network model corresponds to a combination of the position data and the type data corresponding to the training query point in the training crystal data, and that outputs field data that represents the structure of the substance constituted by atoms when substance information that represents an arbitrary substance and a query point that is a point of interest within the arbitrary substance are input; A trained model generating device comprising:

20. The learning crystal data further includes lattice constant data of a learning crystal of the substance, the neural network model is an autoencoder; The learning unit is When training the autoencoder using unsupervised machine learning, The training crystal data is input to an encoder of the autoencoder to obtain a latent vector representing a crystal structure of the training substance; A combination of the latent vector and the training query point is input to a first decoder of the autoencoder to obtain a position field representing a position field of atoms constituting a crystal of the training substance; estimating positions of atoms constituting the crystal of the learning material based on the position field output from the first decoder; A combination of the latent vector and the training query point is input to a second decoder of the autoencoder to obtain a type field representing a field of types of atoms constituting a crystal of the training substance; estimating the type of atoms constituting the crystal of the learning material based on the type field output from the second decoder; A combination of the latent vector and the training query point is input to a third decoder of the autoencoder to obtain lattice constant data of a crystal of the training material; generating a trained first decoder and a trained second decoder by training an autoencoder using unsupervised machine learning so that a combination of the estimated atomic positions, the estimated atomic types, and the lattice constant data output from the third decoder corresponds to a combination of the position data, the type data, and the lattice constant data in the training crystal data; The trained model generating device according to claim 19.

21. A method for obtaining target material information representing a target material composed of atoms and a query point which is a point of interest within the target material, a trained neural network model that outputs field data indicating a field representing a structure of the material at the query point when substance information representing an arbitrary material and a query point that is a point of interest within the arbitrary material are input, and the trained neural network model inputs the acquired target substance information and the query point to acquire the field data corresponding to the query point; An information processing method in which processing is performed by a computer.

22. Acquiring training crystal data representing a crystal structure of a training substance composed of atoms, the training crystal data including position data representing the positions of the atoms constituting the crystal of the training substance and type data representing the types of the atoms constituting the crystal of the training substance, and a training query point which is a point of interest within the training substance; a trained neural network model that represents a field that represents a structure of a substance constituted by atoms, the trained neural network model is trained so that, when the training query point is input to the neural network model, a combination of the estimated position of the atom and the estimated type of the atom output from the neural network model corresponds to a combination of the position data and the type data corresponding to the training query point in the training crystal data, thereby generating a trained neural network model that represents a field that represents a structure of a substance constituted by atoms, and that outputs field data indicative of a field that represents the structure of the substance at the query point when substance information that represents an arbitrary substance and a query point that is a point of interest within the arbitrary substance are input; A method for generating trained models in which processing is performed by a computer.

Images