Spectrum generation device and method, and machine learning model construction device

The spectrum generation device addresses the limitations of existing training data methods by generating pseudospectra with diverse patterns, improving the performance of machine learning models for spectral analysis.

JP2025129886APending Publication Date: 2025-09-05HITACHI HIGH TECH CORP
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024026841
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-02-26
Publication Date
2025-09-05

AI Technical Summary

Technical Problem

Existing methods for generating training data for machine learning models using spectra are inadequate, particularly for models that estimate quantitative values, categories, remove noise signals, or compress spectra into lower dimensions, leading to potential overlearning and insufficient pattern diversity.

Method used

A spectrum generation device that creates pseudospectra by extracting and reconstructing characteristic basis spectra from real spectra, setting weights, and generating pseudospectra with diverse patterns using a weighted sum, along with associated attribute information, to construct a machine learning model.

Benefits of technology

Enables the generation of a large number of training datasets with varied patterns, enhancing the robustness and versatility of machine learning models for spectral analysis tasks.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025129886000001_ABST
    Figure 2025129886000001_ABST
Patent Text Reader

Abstract

To provide a spectrum generation device that generates a data set of a plurality of pseudo spectra and attribute information for learning a machine learning model matching a purpose for the machine learning model inputting a spectrum.SOLUTION: A spectrum generation device that generates a set of a pseudo spectrum and attribute information for constructing a machine learning model comprises: an input unit which inputs a spectrum data set consisting of a spectrum or the spectrum and sample information, and a generation request; a basis acquisition unit which acquires a basis spectrum of the generated pseudo spectrum; a generation unit which generates the pseudo spectrum from the basis spectrum; and an output unit which outputs the generated set of the pseudo spectrum and attribute information.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to a spectrum generation device and method, and a machine learning model construction device. [Background technology]

[0002] The physical property information of a sample can be quantified as a spectrum. For example, a three-dimensional fluorescence spectrum obtained using a spectrofluorometer is a spectrum obtained by irradiating a sample with excitation light and measuring the intensity of the fluorescence emitted by the sample, and the information on the fluorescent properties of the sample is quantified as a two-dimensional array.

[0003] By quantifying the spectra, a machine learning model can be used to construct a model that estimates the properties of a sample. For example, a model that takes a spectrum as input and estimates quantitative values ​​such as the physical properties or compound concentrations of the sample corresponding to the input spectrum can be constructed by supervised learning using a training dataset consisting of multiple pairs of spectra and quantitative values ​​prepared in advance. Models that estimate categories such as the type of sample can also be constructed in a similar manner.

[0004] Spectra may contain information other than the desired properties of a sample, as well as noise signals that show no correlation with the target quantitative value or category. Furthermore, because spectra tend to have high correlations between adjacent elements (collinearity), when training a machine learning model using each spectral element as an explanatory variable, optimization of parameters related to highly correlated elements may not be stable. Therefore, feature values ​​may be extracted from spectra depending on the purpose.

[0005] A machine learning model may also be used for the model that extracts this feature. The feature may have a form depending on the purpose, such as information on the peak coordinates and peak values ​​of the spectrum obtained by removing noise signals from the spectrum, or a feature vector with a lower dimension than the spectrum. For example, a machine learning model that estimates information on the peak coordinates and peak values ​​of the spectrum can be constructed by supervised learning using a training data set that is composed of a previously prepared spectrum and pairs of peak coordinates and peak values ​​contained in the spectrum.

[0006] To build a machine learning model for the above spectra, a training dataset is required to optimize the parameters of the machine learning model. However, in the case of spectra, there are many steps involved, from sample preparation to measurement, so it is often difficult to collect a sufficient amount of training dataset.

[0007] Patent Document 1 discloses a method for rapidly increasing the number of training data sets without actually preparing samples by separating a spectrum (original spectrum) obtained from a sample into an analytical spectrum and a non-analytical spectrum, performing various variations on the non-analytical spectrum, and generating a virtual spectrum by adding the varied non-analytical spectrum to the analytical spectrum. [Prior art documents] [Patent documents]

[0008] [Patent Document 1] Japanese Patent Application Publication No. 2023-74746 Summary of the Invention [Problem to be solved by the invention]

[0009] The technology described in Patent Document 1 uses frequency separation technology to decompose a spectrum (raw spectrum) obtained from a sample into a spectrum (analytical spectrum) that serves as the basis for analyzing the sample and a non-analytical spectrum that is different from the analytical spectrum. Patent Document 1 then generates a virtual spectrum by subjecting the non-analytical spectrum to various variations and adding it to the analytical spectrum. Furthermore, Patent Document 1 links the non-analytical spectrum to quantitative values ​​and categories that represent the properties of the sample, which have been prepared in advance, thereby increasing the amount of training data used to train a machine learning model that estimates the quantitative values ​​and categories.

[0010] However, since the number of patterns of the analytical spectrum itself does not increase, there is a possibility that overlearning may occur due to an insufficient number of patterns in the machine learning model that estimates the quantitative values ​​and categories.

[0011] Furthermore, in addition to the machine learning models that estimate the quantitative values ​​and categories mentioned above, there are also other machine learning models for spectra that have purposes other than estimating quantitative values ​​and categories associated with samples, such as models that estimate the results after removing noise signals from a spectrum, models that estimate spectral peak coordinates and peak values, and models that compress a spectrum into a feature vector with lower dimensionality than the spectrum.

[0012] However, Patent Document 1 does not mention a method for generating or learning training data for learning these models. For example, in the case of such models, comprehensive learning of all possible spectral shape patterns, not just the pattern of the analytical spectrum obtained from the original spectrum, leads to the construction of a generalized model, but the method described in Patent Document 1 does not provide an adequate number of training data patterns.

[0013] The present invention has been made in consideration of the above-mentioned problems, and aims to provide a spectrum generation device and method, and a machine learning model construction device, which generate a data set of multiple pseudospectra and attribute information for training a machine learning model according to a purpose for a machine learning model that uses a spectrum as input. [Means for solving the problem]

[0014] In order to solve the above-mentioned problems, according to one aspect of the present invention, a spectrum generation device that generates pairs of pseudospectrums and attribute information for constructing a machine learning model using spectra as explanatory variables includes an input unit that receives a spectral dataset consisting of one or more spectra or one or more pairs of spectra and sample information, and a generation request for adjusting the generation result; a basis acquisition unit that acquires one or more basis spectra that will be components of the pseudospectrum to be generated; a generation unit that sets weights on the one or more basis spectra obtained by the basis acquisition unit and generates a pseudospectrum that is different from the spectrum input to the input unit from the weighted basis spectra; and an output unit that outputs one or more pairs of the generated pseudospectrum and attribute information, wherein the basis spectra obtained by the basis acquisition unit include at least one factor spectrum that is a component of the spectrum input to the input unit, or one or more spectra obtained by applying a predetermined variation process to a factor spectrum, and the attribute information that is associated with the pseudospectrum and output from the output unit includes at least one of the basis spectra, the predetermined variation process, and the weight used to generate the pseudospectrum. [Effects of the Invention]

[0015] According to the present invention, it is possible to generate a pair of pseudospectrum and attribute information for constructing a machine learning model using a spectrum as an explanatory variable. [Brief explanation of the drawings]

[0016] [Figure 1] FIG. 2 is a hardware configuration diagram of a spectrum generating device. [Figure 2] FIG. 2 is a functional block diagram of a spectrum generating device. [Figure 3] 10 is a table showing an example of a spectrum. [Figure 4] FIG. 10 is a diagram illustrating an example of a spectrum. [Figure 5] FIG. 10 is an explanatory diagram showing an example of a set of pseudospectrum and attribute information. [Figure 6] 10 is a processing flow of a spectrum generating device. [Figure 7] FIG. 10 is a functional block diagram of a spectrum generating device according to a second embodiment. [Figure 8] 10 is a graph showing an example of a verification result. [Figure 9] 10 is another graph showing an example of a verification result. DETAILED DESCRIPTION OF THE INVENTION

[0017] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. The spectrum generating device according to this embodiment generates many pseudospectrums by extracting, expanding, and reconstructing characteristic basis spectra from a small number of real spectra. A real spectrum is a spectrum obtained by actually measuring a sample.

[0018] The spectrum generation device of this embodiment, for example, acquires one or more basis spectra from a spectral dataset consisting of one or more spectra or one or more pairs of spectra and sample information, sets weights to each basis spectrum, and calculates a weighted sum of the basis spectra and the weights, thereby outputting one or more pairs of pseudospectrums with shapes different from those of the spectra included in the spectral dataset and attribute information associated with the pseudospectrum, which can be used for training various machine learning models.

[0019] The spectrum generating device of this embodiment includes, for example, an arithmetic unit and a memory that stores a computer program executed by the arithmetic unit. The arithmetic unit receives the spectral dataset as input and outputs one or more sets of pseudospectrums and attribute information.

[0020] The spectrum generation device of this embodiment can generate pseudospectrums with a large number of patterns necessary for constructing various machine learning models according to the purpose.

[0021] The spectrum generation device of this embodiment can also construct a training pseudospectral dataset and a validation pseudospectral dataset using one or more pairs of pseudospectrum and attribute information to train a target machine learning model, and train the target machine learning model using the training pseudospectral dataset. The spectrum generation device verifies the trained machine learning model using the validation pseudospectral dataset, and recursively generates additional training pseudospectral datasets depending on the verification results. Use of this spectrum generation device can provide a machine learning model construction system that additionally trains a machine learning model and outputs the target machine learning model and the verification results. [Example]

[0022] The first embodiment will be described with reference to FIGS.

[0023] <Hardware configuration of spectrum generator> In the first embodiment, a set of pseudospectrums and attribute information that can be used as training data for various machine learning models is generated based on a spectral dataset containing a small number of spectra.

[0024] The hardware configuration of a spectrum generating device 10 will be described with reference to Fig. 1. The spectrum generating device 10 includes, for example, a memory 11, a computing device 12, an interface 13, and a bus 14. The memory 11, computing device 12, and interface 13 transmit and receive information via the bus 14.

[0025] Each part of the spectrum generating device 10 will be described. The interface 13 is a communication device that transmits and receives signals to and from devices 20, 21, and 22 external to the spectrum generating device 10. Devices that transmit and receive signals to and from the interface 13 include, for example, a spectrum measuring device 21 that measures the spectrum of a sample and outputs the measurement results, a control device 20 that controls the spectrum measuring device 21, and an output device 22 that outputs the processing results from the spectrum generating device 10. The output device 22 is, for example, a monitor display or a printer. The output device 22 may be formed like a head-mounted display. An input device (not shown) that allows a user to input instructions, data, etc. may be connected to the spectrum generating device 10.

[0026] The method for transmitting and receiving signals between the external devices 20, 21, and 22 and the spectrum generating device 10 may be a wired connection using a cable such as an optical fiber, or a wireless connection using a wireless communication technology such as Bluetooth (registered trademark).

[0027] The spectrum generating device 10 does not necessarily have to be installed in the same facility as the control device 20, the spectrum measuring device 21, and the output device 22, but may be installed on another computer or in a so-called cloud. In such a case, signals may be transmitted and received between the interface 13 and the external devices 20, 21, and 22 using, for example, a LAN (Local Area Network) or a WAN (Wide Area Network).

[0028] The arithmetic device 12 is a device that executes various processes within the spectrum generating device 10, and is, for example, a CPU (Central Processing Unit) or an FPGA (Field-Programmable Gate Array). The functions executed by the arithmetic device 12 will be described later.

[0029] The memory 11 is a device that stores programs executed by the calculation device 12, parameters of quantitative / identification models, processing results, etc., and is, for example, an HDD (Hard Disk Drive), flash memory, SSD (Solid State Drive), RAM (Random Access Memory), ROM (Read Only Memory), etc.

[0030] <Functional Configuration of Spectrum Generating Device 10> 2 is a functional block diagram of the spectrum generating device 10. Each of the illustrated functional units 101, 102, 103, and 104 may be implemented by a calculation device 12 that executes a predetermined computer program, or may be implemented by dedicated hardware. The spectrum generating device 10 includes, as functional units, an input unit 101, a basis acquisition unit 102, a generation unit 103, and an output unit 104, for example. Each functional unit will be described below.

[0031] The input unit 101 accepts one or more spectra or one or more pairs of a spectrum and a label associated with sample information, input from the interface 13. The input unit 101 also accepts a generation request for adjusting the pseudospectrum to be generated. The above spectrum is formatted as one or more dimensional array data consisting of one or more axes, and each element stores the corresponding spectral intensity.

[0032] The basis acquisition unit 102 acquires one or more basis spectra, which are components of a spectrum, based on one or more spectra or one or more pairs of spectra and labels input to the input unit 101. The basis spectra may include at least one or more basis vectors based on the spectra input to the input unit 101 or vectors obtained by performing any perturbation processing on a basis vector.

[0033] The generating unit 103 sets weights on the basis spectra acquired by the basis acquiring unit 102 and calculates a weighted sum of the basis spectra and the weights to generate a pseudospectrum and acquire attribute information associated with the pseudospectrum. The attribute information includes at least one of the basis spectra used to generate the pseudospectrum, the details of the variation process, and the set weights.

[0034] The output unit 104 outputs one or more pairs of pseudospectrum and attribute information. The information is output to the output device 22.

[0035] It should be noted that the above functions do not need to be configured exactly as the function units 101 to 104 shown in FIG. 2, as long as they can achieve processing corresponding to the operation of each function unit.

[0036] 6 shows an example of a processing flow diagram, in which steps S1 to S4 correspond to the function units 101 to 104 shown in FIG.

[0037] The input step S1 accepts one or more spectra or one or more pairs of a spectrum and a label associated with the spectrum, and a generation request for adjusting the pseudospectrum to be generated, input from the interface 13. The spectrum is formatted as one or more dimensional array data consisting of one or more axes, and each element stores the corresponding spectral intensity.

[0038] In the basis acquisition step S2, one or more basis spectra, which are components of the spectrum, are acquired based on one or more spectra received in the input step S1. The basis spectra include at least one or more basis vectors based on the spectrum input to the input unit 101 or vectors obtained by performing any perturbation processing on a basis vector.

[0039] In the generation step S3, a weight is assigned to the basis spectrum acquired in the basis acquisition step S2, and a weighted sum is calculated from the basis spectrum and the weight to generate a pseudospectrum and acquire attribute information associated with the pseudospectrum. The attribute information includes at least one of the basis spectrum used to generate the pseudospectrum, the applied variation processing, and the set weight.

[0040] In the output step S4, one or more pairs of pseudospectrum and attribute information are output.

[0041] <Configuration and operation of each part> The operations of the input unit 101, the basis acquisition unit 102, the generation unit 103, and the output unit 104 will be described in detail below.

[0042] The input unit 101 receives one or more spectra or one or more pairs of spectra and labels associated with the spectra, and a generation request via the interface 13. A spectrum refers to a multidimensional array composed of one or more axes. For example, in the case of a three-dimensional fluorescence spectrum, it is a two-dimensional array composed of axes of excitation wavelength and emission wavelength, and each element stores emission intensity. The spectrum or the pair of spectrum and label received by the input unit 101 is output to the basis acquisition unit 102, or is output to the basis acquisition unit 102 while being stored in the memory 11. The generation request refers to structure data including parameters for adjusting the pseudospectrum to be generated.

[0043] Figure 3 shows a three-dimensional fluorescence spectrum as an example of a spectrum. Three-dimensional fluorescence spectrum 30 is an example of a three-dimensional fluorescence spectrum. Figure 4 shows a visualized example 31 of a three-dimensional fluorescence spectrum. In the visualized example 31 of a three-dimensional fluorescence spectrum, the vertical axis represents the excitation wavelength and the horizontal axis represents the emission wavelength, and the emission intensity for each combination of excitation and emission wavelength is displayed as contour data.

[0044] As shown in three-dimensional fluorescence spectrum 30, the excitation wavelength, emission wavelength, and emission intensity are recorded with an arbitrary quantization interval. Three-dimensional fluorescence spectrum 30 shows an example in which excitation light / emission light was measured from 200 nm to 700 nm with a quantization interval of 5 nm. For example, row 1, column 1 of three-dimensional fluorescence spectrum 30 records the emission intensity at 200 nm detection light for 200 nm excitation light; row 1, column 2 records the emission intensity at 205 nm detection light for 200 nm excitation light; and row 2, column 1 records the emission intensity at 200 nm detection light for 205 nm excitation light. The number of columns and rows of three-dimensional fluorescence spectrum 30 is 100 × 100, since 500 nm wavelengths are recorded at 5 nm intervals.

[0045] Three-dimensional fluorescence spectrum visualization example 31 is an example in which a three-dimensional fluorescence spectrum 30 is visualized as a two-dimensional image in the form of contour line data. When humans observe a three-dimensional fluorescence spectrum, they often confirm it using a display such as three-dimensional fluorescence spectrum visualization example 31. In addition to contour line data, it may also be displayed as a gray image or heat map image in which emission intensity is assigned to brightness values ​​or colors, or as a bird's-eye view. The shape of the three-dimensional fluorescence spectrum varies depending on the nature of the target fluorescence characteristic.

[0046] The generation request is a parameter for an external (user) to adjust the settings of the input unit 101, basis acquisition unit 102, and generation unit 103. The spectrum generation device 10 changes various settings in accordance with the generation request. The generation request is set by the user using a mouse, keyboard, etc. from the control device 20 via the interface 13.

[0047] The input unit 101 may perform any pre-processing on the spectrum when outputting it to the basis acquisition unit 102 or when outputting it to the basis acquisition unit 102 while storing it in the memory 11 .

[0048] In Example 31 of 3D fluorescence spectrum visualization, the 3D fluorescence spectrum contains noise signals. For example, the wavelength range including Rayleigh scattering is generally considered to be a noise component when analyzing fluorescence characteristics from a 3D fluorescence spectrum. Rayleigh scattering is not fluorescence emitted by the sample, but light reflected from the sample. When Rayleigh scattering is detected, features unrelated to fluorescence characteristics are reflected in the 3D fluorescence spectrum.

[0049] Rayleigh scattering is characterized by the effect of the diffraction grating, which results in detection in a region near a wavelength band where the excitation wavelength is a natural number multiple or the reciprocal of a natural number multiple of the emission wavelength. Therefore, the effects of noise can be suppressed by preprocessing, such as by setting an arbitrary wavelength band and converting the emission intensity of the wavelength that matches the above condition and the surrounding bandwidth to an arbitrary fixed value such as 0, or by measuring the 3D fluorescence spectrum of a standard sample and subtracting the 3D fluorescence spectrum of the standard sample from each spectrum. Preprocessing can also be performed in any manner to eliminate Raman scattering and other artifacts.

[0050] In the method disclosed in this embodiment, the spectrum generation device 10 acquires one or more basis spectra, which are components of the spectrum, based on an input spectrum, and assigns various weights to the basis spectra.The spectrum generation device 10 then outputs one or more pairs of a pseudospectrum represented by a weighted sum of the multiple basis spectra and attribute information associated with the pseudospectrum.

[0051] The spectrum generation device 10 of this embodiment acquires a basis spectrum and changes the weights associated with the basis spectrum to generate pseudospectra of various patterns while outputting attribute information associated with the pseudospectra. This enables the spectrum generation device 10 to flexibly create training datasets for various machine learning models according to their purposes.

[0052] The basis acquisition unit 102 receives one or more spectra from the input unit 101 or the memory 11 and acquires a basis spectrum. Here, a basis spectrum refers to a component of a pseudospectrum to be generated, and corresponds to a basis vector when data that can be generated is expressed in vector space. The spectrum generation device 10 acquires various basis spectra based on a spectral data set and changes the weights associated with the basis spectra, thereby enabling the generation of a variety of pseudospectrums.

[0053] A method for acquiring a basis spectrum will be described below. A plurality of methods for acquiring a basis spectrum may be used. Hereinafter, a list of acquired basis spectra will be referred to as a basis spectrum list.

[0054] As an example of a method for acquiring a basis spectrum, a method will be described in which a factor spectrum is acquired based on the spectrum received by the input unit 101 and the factor spectrum is used as a basis spectrum. Here, the factor spectrum corresponds to a basis vector when the spectrum received by the input unit 101 is regarded as a vector, and represents a spectrum that is a component of the spectrum received by the input unit 101.

[0055] As an example of how to obtain a factor spectrum, we will explain how to obtain a factor spectrum for a 3D fluorescence spectrum using PARArell Factor analysis (PARAFAC), a type of tensor decomposition method. PARAFAC utilizes the property that the relationship between the concentration of fluorescent molecules contained in a sample and the fluorescence intensity is linear, and expresses multiple 3D fluorescence spectra using the trilinear model described in Equation 1.

[0056]

number

[0057] The circled × (hereafter (×)) indicates the operation of taking the direct product of vectors. n (×)b n is the E x ×E m This matrix is ​​multiplied by the relative concentration, c kn (a n (×)b n ) represents the signal produced by the nth fluorescent molecule in the kth sample. Equation 1 represents the three-dimensional fluorescence spectrum F k The sum of signals F' from 1 to N k This is the modeled equation.

[0058] In PARAFAC, the emission spectrum a1,...,a N Each element of the excitation spectrum b1,...,b N and the relative concentration of each fluorescent molecule in each sample, c 11 ,...,c 1N ,...,c KN Using these variables, each variable is optimized based on the objective function shown in Equation 2. Equation 2 is a three-dimensional fluorescence spectrum F1, F2, ..., F Kand the tensors F'1,F'2,...,F' expressed by the trilinear model K It means minimizing the mean square error of each element of F. ijk denotes the emission intensity of the kth sample at the ith excitation wavelength and the jth emission wavelength. in is the emission spectrum of the nth fluorescent molecule a n b indicates the value of the ith excitation wavelength in jn is the excitation spectrum of the nth fluorescent molecule b n denotes the value of the j-th emission wavelength in

[0059] The objective function shown in Equation 2 may be optimized by any optimization method, for example, ALS (Alternating Least Square) or steepest descent method.

[0060]

number

[0061] An arbitrary regularization term may be added to the objective function shown in Equation 2. For example, a feature extraction function may be defined that takes each three-dimensional fluorescence spectrum or a tensor expressed by a trilinear model as input, and the squared error of the output of the feature extraction function may be added as a regularization term to Equation 2 for pairs of each three-dimensional fluorescence spectrum and the corresponding tensor expressed by a trilinear model. The feature extraction function may load from memory 112 an arbitrary optimized model that estimates the compound concentration or compound type of the three-dimensional fluorescence spectrum. Adding such a regularization term to Equation 2 makes it possible to perform regularization that makes elements that can be inferred from the three-dimensional fluorescence spectrum, such as the compound concentration and compound type, similar when optimizing the tensor expressed by the trilinear model to resemble the three-dimensional fluorescence spectrum.

[0062] The number N of fluorescent molecules in Equations 1 and 2 is inherently unknown. Therefore, PARAFAC results for multiple patterns of N are obtained, scores are calculated for the results, and the PARAFAC result corresponding to N with the highest score can be used as the final PARAFAC result, or the PARAFAC result corresponding to one pattern of N can be used as the final PARAFAC result. Core consistency, which is widely used in PARAFAC, can be used as the scoring function.

[0063] The Cartesian product of the optimized emission and excitation spectra a1(×)b1,...,a N (×)b N is a collection of three-dimensional fluorescence spectra that represent the fluorescence characteristics specific to N types of fluorescent molecules, and is a factor spectrum that constitutes the three-dimensional fluorescence spectrum received by the input unit 101. This factor spectrum is added to the basis spectrum list as a basis spectrum.

[0064] The optimization result of the relative concentration obtained by PARAFAC may be linked to the factor spectrum and stored in the memory 11. When the input unit 101 receives a pair of a spectrum and a label, the label information may also be stored in the memory 11 together with the optimization result of the relative concentration.

[0065] Another method for obtaining factor spectra will be described, using a spectrum obtained from a standard sample composed of a single type of fluorescent molecule. Because each fluorescent molecule has its own unique fluorescent properties, the resulting three-dimensional fluorescence spectrum for a sample composed of a single type of fluorescent molecule is a two-dimensional matrix represented by a single factor spectrum whose scale changes linearly with the concentration of the fluorescent molecule. Therefore, if the three-dimensional fluorescence spectrum input to the input unit is obtained from a sample composed of a single type of fluorescent molecule, the three-dimensional fluorescence spectrum itself may be considered a factor spectrum and added to the basis spectrum list. When the input unit 101 receives a pair of a spectrum of a sample composed of a single type of fluorescent molecule and a label containing sample information such as the fluorescent molecule name and structural formula, the label information may also be stored in memory 11.

[0066] The results of applying any variation processing to a basis spectrum stored in the basis spectrum list may be added to the basis spectrum list. The factor spectrum described above is the result of acquiring the components of the spectrum received by the input unit 101. If the subsequent generation unit 103 uses only the above factor spectrum, a pseudospectrum similar in shape to the above spectrum but with different weights assigned to each factor spectrum is generated. If variation processing is applied to the above basis spectrum, a pseudospectrum with components different from the above spectrum can be generated. This enables the machine learning model to learn pseudospectra with more diverse patterns than conventional spectrum generation methods, leading to the realization of a versatile machine learning model. Examples of variations in basis spectra are described below.

[0067] For example, a variation process may be performed to shift the basis spectrum in any direction. Depending on the measurement environment and sample conditions, some of the factor spectra constituting a three-dimensional fluorescence spectrum may shift in the direction of shorter emission wavelengths. In this way, the entire factor spectrum may shift under various conditions. If the machine learning model has not learned a spectrum with such a shift, accurate inference may not be achieved when the shifted spectrum is input during inference. Therefore, by shifting the basis spectrum in any direction, the subsequent generation unit 103 can simulate the shift phenomenon of factor spectra observed in real spectra. The shifted basis spectrum will have missing values ​​at the end in the direction opposite to the shift direction. However, this can be interpolated with "0" or extrapolated using any model, such as a Gaussian process regression model.

[0068] For example, a variation process may be performed by applying a monotonically increasing function to each element of the basis spectrum. When a monotonically increasing function is applied to each element of the basis spectrum, the shape of the basis spectrum can be changed within a range that does not change the magnitude relationship between the elements. For example, in a three-dimensional fluorescence spectrum, the emission intensity at the ith excitation wavelength and jth emission wavelength of a certain basis spectrum B is expressed as B ij When the monotonically increasing function is f(), the variation process may be performed in the form of Equation 3. B' ij is the result of the fluctuation processing, and Equation 3 applies a monotonically increasing function f() to each element of the base spectrum, and normalizes it so that the maximum value of the application result is the same as the maximum value before application. f() is an exponential function exp(B ij ) or the logarithmic function ln(B ij +1) is also acceptable.

[0069]

number

[0070] The results of recursively applying the variation process to the basis spectrum by the variation process described above may also be added to the basis spectrum list.

[0071] Log information on the creation process of each acquired base spectrum is stored in memory 11. For example, it includes information on whether the base spectrum is a factor spectrum, information on the spectrum used to acquire the factor spectrum if it is a factor spectrum, and information on the variation processing if it is not a factor spectrum.

[0072] The method of acquiring the base spectrum may be set to fixed conditions in advance, or may be arbitrarily adjusted by an external party (user) using a generation request.

[0073] The generation unit 103 generates a pseudospectrum by setting weights for the basis spectra acquired by the basis acquisition unit 102 and calculating a weighted sum of the basis spectra and the weights. By using various basis spectra acquired by the basis acquisition unit 102, it is possible to generate pseudospectrums with a variety of patterns.

[0074] The weighted sum is expressed by Equation 4. In Equation 4, F' is the pseudospectrum, B m is the mth basis spectrum in the basis spectrum list, w m represents the weight applied to the mth basis spectrum. E represents noise, and any high-frequency noise or low-frequency noise may be used, or no noise may be generated, i.e., E=0. An example of how to set the weight is explained below.

[0075]

number

[0076] For example, weights may be set according to any probability distribution. For example, weights may be set using a multidimensional normal distribution as shown in Equation 5. In Equation 5, N() represents an M-dimensional normal distribution with an M-dimensional mean vector μ and an M×M variance-covariance matrix Σ as input. w represents an M-dimensional weight vector generated according to the M-dimensional normal distribution, and the m-th element is w in Equation 4. m The input of the multivariate normal distribution in Equation 5 may be set randomly for the mean vector and variance-covariance matrix, or may be set arbitrarily to fixed values.

[0077] When the relative concentration information is associated with each basis spectrum, the mean, variance, and covariance of the relative concentrations may be calculated and used as the mean vector and variance-covariance matrix of Equation 5. By using this method, a combination of weights is generated based on the tendency of the relative concentration information associated with the actual spectrum obtained during tensor decomposition, so that the result of Equation 4 can be a pseudospectrum that is not an actually observed spectrum and that naturally reflects the actual fluorescence properties.

[0078]

number

[0079] The pseudospectrum generated as described above is associated with attribute information used to generate the pseudospectrum. The attribute information includes the basis spectra acquired by the basis acquisition unit 102, information associated with the basis spectra stored in the memory 11, such as relative concentration information and log information, weights set by the generation unit 103, and a method for setting the weights, such as a probability distribution.

[0080] In this way, the spectrum generation device 10 can easily prepare a data set to be used for training a desired machine learning model by linking and managing various pieces of information resulting from the generation of pseudospectrums. Furthermore, the spectrum generation device 10 can also use the attribute information itself for training and verifying a machine learning model. Examples of using attribute information for building and verifying a machine learning model will be described later.

[0081] The output unit 104 outputs one or more pairs of pseudospectrum and attribute information generated by the generation unit 103. The pairs of pseudospectrum and attribute information are output as structure data.

[0082] The output unit 104 may display the output result on the output device 22 via the interface 13.

[0083] FIG. 5 shows a generated result display example 40 presented to the user. The generated result display example 40 includes, for example, a pseudospectrum visualization example 41, a basis spectrum visualization example 42, and an attribute information display example 43. Similar to the 3D fluorescence spectrum visualization example 30, the pseudospectrum visualization example 41 and the basis spectrum visualization example 42 are visualized using contour lines. The attribute information display example 43 displays the attribute information in text format. Specific names and numerical values ​​are entered in the "..." boxes in the attribute display example 43. For example, for "acquisition method," information such as "PARAFAC" or "single fluorescent molecule sample" is displayed. The generated result display example 40 shown in FIG. 5 is just one example, and any display format that allows observation of the pseudospectrum, basis spectrum, and attribute information can be used. [Example]

[0084] Example 2 will be described with reference to FIGS. 7 to 9. The differences between Example 2 and Example 1 will be mainly described. In this example, the spectrum generation device 10 described in Example 1 is utilized to generate a training pseudospectral dataset and a validation pseudospectral dataset required for training a desired machine learning model. A machine learning model construction device 50 of this example trains a machine learning model using the training pseudospectral dataset and verifies the trained machine learning model using the validation pseudospectral dataset. The machine learning model construction device 50 generates another training pseudospectral dataset based on the verification results, and performs additional training. Alternatively, the machine learning model construction device 50 outputs the trained machine learning model and the verification results, thereby efficiently providing a desired machine learning model.

[0085] <Hardware configuration of the spectrum analysis system> The machine learning model construction device 50 according to this embodiment is configured as a computer system including, for example, a memory, an arithmetic unit, and an interface (none of which are shown), similar to the hardware configuration described in Fig. 1. The machine learning model construction device 50 can be connected to the control device 20, the spectrum measurement device 21, and the output device 22, as described in Fig. 1.

[0086] 7 is an example of a functional block diagram of a machine learning model construction device 50. Each of the illustrated functional units 51, 52, 53, and 54 may be realized by a computing device that executes a predetermined computer program, or may be realized by dedicated hardware.

[0087] The machine learning model construction device 50 includes, as functional units, for example, a design unit 51, a learning unit 52, a verification unit 53, and a model output unit 54, and incorporates the spectrum generation device 10. Each functional unit will be described below.

[0088] The design unit 51 receives a function request input from an external device. Based on the received function request, the design unit 51 inputs a generation request to the spectrum generation device 10, to which a spectrum dataset has been input in advance. The design unit 51 constructs a training pseudospectrum dataset and a validation pseudospectrum dataset using a pair of pseudospectrum and attribute information output from the spectrum generation device 10. Furthermore, the design unit 51 uses the training pseudospectrum dataset and the validation pseudospectrum dataset to design a machine learning model and an objective function.

[0089] The learning unit 52 uses the training pseudospectral data set to train a machine learning model.

[0090] The verification unit 53 uses the verification pseudospectral dataset to verify the performance of the machine learning model trained by the learning unit 52. Depending on the verification result of the performance of the machine learning model, the verification unit 53 outputs a function requirement to the design unit 51, causing the design unit 51 to reconstruct a training pseudospectral dataset and perform additional learning, or to determine a final machine learning model and the verification result of the final machine learning model.

[0091] The model output unit 54 outputs the final machine learning model and the verification results.

[0092] The above functions do not need to be configured exactly as the functional units in FIG. 7, but only need to be able to realize processing corresponding to the operation of each functional block.

[0093] <Configuration and operation of each part> The operations of the design unit 51, learning unit 52, verification unit 53, and model output unit 54 will be described in detail below.

[0094] The design unit 51 receives a function request input, for example, from an interface (not shown). Based on the received function request, the design unit 51 inputs a generation request to the spectrum generation device 10, to which a spectrum dataset has been input in advance. The design unit 51 constructs a training pseudospectrum dataset and a validation pseudospectrum dataset using a pair of pseudospectrums and attribute information that are the output of the spectrum generation device 10. The design unit 51 uses these constructed datasets to design a machine learning model and an objective function.

[0095] The functional requirements may include functions that the machine learning model must have, such as performing dimensionality reduction, detecting peak coordinates, estimating noise-removed spectra, etc. A machine learning model is designed to meet these objectives.

[0096] The machine learning model may be a neural network such as a Convolutional Neural Network (CNN) or a Transformer, or a Support Vector Machine (SVM), depending on the purpose.

[0097] For the machine learning model described above, an objective function that utilizes attribute information is designed. With actual spectra, information such as the basis spectrum and weights is unknown and difficult to identify. On the other hand, with pseudospectrums, attribute information that represents the properties of the spectrum can be used in machine learning, making it possible to perform machine learning that is more in line with the properties of the spectrum than with actual spectra.

[0098] For example, in the case of a machine learning model that performs dimensionality reduction on three-dimensional fluorescence spectra, an objective function such as that shown in Equation 6 may be designed that uses weight information on the base spectra that are components of the pseudospectrum. In Equation 6, F' and F'' are a pair of pseudospectrums, σθ is a machine learning model with the aim of dimensionality reduction, where the parameter θ is a pseudospectrum as input and the output is a vector, w' and w'' are vectors whose elements are the weights applied to the base spectra that make up F' and F'', and d() is the distance function. Any function, including Euclidean distance, may be used as the distance function.

[0099] Equation 6 is a function intended to match the distance between the vectors representing the dimension reduction results and the distance between the vectors representing the weights for pairs of pseudospectra. In other words, pairs with similar pseudospectral weight patterns are trained to have similar dimension reduction results. The weight pattern applied to the basis spectra represents the proportion of the basis spectra, which are components of a spectrum, contained in the spectrum. Compared to comparing the difference between the distance between the pseudospectral pair itself and the distance between the dimension reduction results, rather than the weight pattern, this is not affected by factors other than the basis spectra, such as noise, and therefore makes it possible to train a dimension reduction method that is more in line with the characteristics of the spectrum.

[0100]

number

[0101] For example, in the case of a machine learning model that estimates a spectrum from which noise has been removed, an objective function may be designed that estimates the result of subtracting noise in the attribute information from the pseudospectrum.

[0102] Furthermore, the functional requirements may include required performance based on attribute information for the machine learning model.

[0103] For example, in the case of a machine learning model that performs dimensionality reduction, it may be set that the squared error between the distance function value of the pair of weight patterns in Equation 6 and the distance function value of the pair of compressed results is less than a fixed threshold for each sample in the validation pseudospectral dataset.

[0104] For example, in the case of a machine learning model that detects peak coordinates, the allowable estimation error of the estimated peak coordinates may be set as the required performance.

[0105] For example, in the case of a machine learning model that estimates a spectrum from which noise has been removed, noise removal performance such as an SNR may be set as the required performance.

[0106] Based on the above-described functional requirements, a training pseudospectral data set and a validation pseudospectral data set are constructed using the spectrum generation device 10. For example, when a machine learning model for the purpose of dimensionality reduction is trained using a pair of pseudospectrums and a pair of weights associated with the pseudospectrums, the spectrum generation device 10 is used to construct datasets with any number of elements, with a set of two pseudospectrums and attribute information being used as one element of the training pseudospectral data set and the validation pseudospectral data set.

[0107] For example, in the case of a machine learning model that detects peak coordinates, the spectrum generation device 10 can be used to comprehensively obtain basis spectra obtained by shifting factor spectra, and pseudospectrums can be generated based on these basis spectra, thereby constructing a training pseudospectral data set and a validation pseudospectral data set that contain a large number of peak coordinate patterns.

[0108] The verification pseudospectral dataset can be adjusted to become a dataset for verifying required performance by using the spectrum generation device 10. For example, in a machine learning model that performs dimensionality reduction, when required performance is set for the distance function included in Equation 6, distance patterns related to weight patterns are set at regular intervals such as [0.0, 0.1, ..., 1.0], and pairs of pseudospectrum corresponding to pairs of weight patterns with each distance and pairs of basis information associated with them are randomly generated to create a verification pseudospectral dataset, thereby enabling performance verification for each distance pattern.

[0109] Figure 8 shows an example of a verification result display 60 that is output by the model output unit 54 from the verification unit 53 and presented to the user. The horizontal axis represents the distance based on pairs of attribute information (weight patterns), the vertical axis represents the distance based on pairs of machine learning model outputs (dimensionality reduction results), and the black circles represent the average values ​​of the verification results obtained for each sample of the verification pseudospectral dataset. The coincidence line 601 is the line where these distances coincide, and the area between the threshold lines 602 represents the acceptable range of the required performance.

[0110] As described above, by using a pseudospectral dataset obtained by comprehensively varying the values ​​of attribute information as a validation pseudospectral dataset, it is possible to verify the relationship between the varied attribute information and the output of the machine learning model.

[0111] 9 shows a verification result display example 61 that is output by the model output unit 54 and presented to the user as the verification results obtained by the verification unit 53. In the verification result display example 61, the horizontal axis represents certain attribute information (numerical values), the vertical axis represents the value of the objective function, and the black circles represent the average value of the verification results obtained for each sample in the verification pseudospectral dataset. When all the black circles are below the threshold line 610, this indicates that the required performance is met.

[0112] The learning unit 52 performs learning of the machine learning model using the machine learning model designed by the design unit 51, a training pseudospectral dataset, and an objective function. Any algorithm may be used to optimize the objective function. The algorithm may be steepest descent or stochastic gradient descent.

[0113] The verification unit 53 verifies the performance of the machine learning model learned by the learning unit 52 using the verification pseudospectral dataset constructed by the design unit 51, and outputs functional requirements to the design unit 51 again based on the verification results, thereby expanding the training pseudospectral dataset and training the machine learning model again in the learning unit 52, or determining it as the final machine learning model.

[0114] For example, if a threshold is set as a functional requirement, such as the value of the objective function for the verification pseudospectral dataset being equal to or less than a specific value (or equal to or more than a specific value), and if the functional requirement is met, the machine learning model trained by the learning unit 52 is determined to be the final machine learning model, and is stored together with the verification results in the memory 11. If the functional requirement is not met, the design unit 51 expands the training pseudospectral dataset, and the learning unit 52 performs learning again, and the verification unit 53 performs verification again.

[0115] In this way, by using the spectrum generator 10 to generate a training pseudospectral data set and a validation pseudospectral data set that are tailored to the purpose, and then repeating the process of recursively expanding the training pseudospectral data set based on the validation results and the process of re-learning, it is possible to efficiently train a machine learning model that satisfies functional requirements.

[0116] The model output unit 54 outputs the final machine learning model determined by the verification unit 53 and the verification result. As described in the first embodiment, the model output unit 54 may display the output result on an output device (not shown). As in verification result display examples 60 and 61, the model output unit 54 may display the relationship between any attribute information and the output in a graph-like format in addition to the verification result based on the required performance.

[0117] <Modification> The present invention is not limited to the above-described embodiments and includes various modifications. For example, the above-described embodiments have been described in detail to clearly explain the present invention, and the present invention is not necessarily limited to those including all of the described configurations. Furthermore, it is possible to add, delete, or replace part of the configuration of each embodiment with other configurations.

[0118] Furthermore, the above-mentioned components, functions, processing units, etc. may be realized in part or in whole by hardware, for example, by designing them as integrated circuits. Furthermore, the above-mentioned components, functions, etc. may be realized in software by a processor interpreting and executing a program that realizes each function. Information such as the programs, tables, and files that realize each function can be stored in a memory, a recording device such as a hard disk or SSD (Solid State Drive), or a recording medium such as an IC card or SD card.

[0119] In addition, the control lines and information lines shown are those that are considered necessary for the explanation, and do not necessarily show all the control lines and information lines in the product. In reality, it can be assumed that almost all components are interconnected.

[0120] The spectrum generating device 10 or the machine learning model construction device 50 may be connected to a storage medium MM. The storage medium MM is configured as, for example, a memory device, a hard disk device, an optical disk device, a magneto-optical disk device, a magnetic tape device, or the like, and non-temporarily stores computer programs and data.

[0121] The storage medium MM can transfer a computer program for realizing the main functions of the spectrum generating device 10 or the machine learning model building device 50 to the spectrum generating device 10 or the machine learning model building device 50. Alternatively, a computer program for realizing some or all of the main functions of the spectrum generating device 10 or the machine learning model building device 50 can be transferred to and stored in the storage medium MM. By connecting the storage medium MM to another computer not shown in the figure and installing the computer program stored in the storage medium MM in the other computer, the other computer can function as the spectrum generating device 10 or the machine learning model building device 50.

[0122] It is clear that the above-described embodiments enable the invention expressed as follows.

[0123] (Representation 1) A spectrum generation device that generates a pair of pseudospectrums and attribute information for constructing a machine learning model that uses spectra as explanatory variables, comprising: an input unit that receives input of a spectral dataset consisting of one or more spectra or one or more pairs of spectra and sample information, and a generation request that adjusts the generation result; a basis acquisition unit that acquires one or more basis spectra that are components of the pseudospectrum to be generated; a generation unit that sets weights on the one or more basis spectra obtained by the basis acquisition unit and generates a pseudospectrum that is different from the spectrum input to the input unit from the weighted basis spectra; and an output unit that outputs one or more pairs of the generated pseudospectrum and attribute information, wherein the basis spectra obtained by the basis acquisition unit include at least one factor spectrum that is a component of the spectrum input to the input unit or a spectrum obtained by applying a predetermined variation process to the factor spectrum, and the attribute information that is associated with the pseudospectrum and output from the output unit includes at least one of the basis spectra, the predetermined variation process, and the weight used to generate the pseudospectrum.

[0124] (Representation 2) A spectrum generating device according to Representation 1, wherein the generating unit sets weights to one or more basis spectra obtained by the basis acquisition unit, and calculates a weighted sum of the basis spectra and the weights to generate a pseudospectrum having a shape different from that of the spectrum input to the input unit.

[0125] (Representation 3) A spectrum generating device according to claim 1 or 2, wherein the basis acquisition unit treats one or more spectra input to the input unit as a tensor consisting of a sample direction axis and one or more spectrum direction axes, and decomposes the spectrum using a tensor decomposition technique into one or more pairs of factor spectra and relative concentration vectors, the factor spectra being included in the basis spectra, and the relative concentration vectors being vectors with the same size as the number of spectra.

[0126] (Representation 4) A spectrum generation device according to any one of Representations 1 to 3, wherein the basis acquisition unit determines a feature extraction function based on the generation request, and the optimization function of the tensor decomposition method has a regularization term that aims to make the output of the feature extraction function when the spectrum input to the input unit is used as input similar to the output of the feature extraction function when a reconstruction result using a set of a factor spectrum and a concentration vector, which are the tensor decomposition results, is used as input, and the generation unit obtains the output of the feature extraction function when the pseudospectrum is used as input, and includes the output in the attribute information.

[0127] (Representation 5) A spectrum generating device according to any one of Representations 1 to 4, wherein the input unit receives spectra associated with one or more standard samples, and the basis acquisition unit includes the spectra in the basis spectra.

[0128] (Representation 6) In the spectrum generating device according to any one of Representations 1 to 5, the generating unit sets the weights according to an arbitrary probability distribution, and includes information on the probability distribution in the attribute information. Spectral generator.

[0129] (Representation 7) In the spectrum generating device according to any one of Representations 1 to 6, the generating unit sets the weights in accordance with a probability distribution whose parameters include statistics of the density vectors, and the attribute information includes information on the probability distribution. Spectral generator.

[0130] (Representation 8) A machine-learning model construction device includes the spectrum generation device according to any one of Representations 1 to 7, and constructs a machine-learning model using a set of pseudospectrum and basis information, the machine-learning model construction device receiving any function request for adjusting the machine-learning model to be constructed, and constructing a training pseudospectrum dataset and a validation pseudospectrum dataset using the spectrum generation device. The machine-learning model construction device further includes a design unit that defines specifications of the machine-learning model, a learning unit that trains the machine-learning model using the training pseudospectrum dataset, a verification unit that verifies the machine-learning model using the validation pseudospectrum dataset, and a model output unit that outputs the machine-learning model and a verification result obtained by the verification device. The verification unit verifies the performance of the machine-learning model trained by the learning unit, and expands the training pseudospectrum dataset by outputting a function request to the design unit in accordance with the verification result, and re-trains and verifies the machine-learning model ... design unit uses the pseudospectrum as input and designs an objective function based on the attribute information.

[0131] (Representation 9) A machine learning model construction device according to Representation 8, wherein the design unit includes a constraint term in the objective function used for training the machine learning model, the constraint term being aimed at making the latent variables or outputs of the machine learning model similar when pseudospectra with similar attribute information are input.

[0132] (Representation 10) The machine learning model construction device according to either of Representation 8 or 9, wherein the verification unit includes in the verification result data representing the relationship between the output of the machine learning model when each pseudospectrum included in the verification pseudospectrum dataset is used as input and attribute information.

[0133] (Representation 11) A spectrum generation method for generating a pair of pseudospectrum and attribute information for constructing a machine learning model using a spectrum as an explanatory variable, the method comprising: an input step for receiving a spectral dataset consisting of one or more spectra or one or more pairs of spectra and sample information, and an arbitrary generation request for adjusting the generation result; a basis acquisition step for acquiring one or more basis spectra that will be components of the pseudospectrum to be generated; a generation step for generating a pseudospectrum having a shape different from the spectrum received in the input step by assigning weights to the one or more basis spectra obtained in the basis acquisition step and calculating a weighted sum of the basis spectra and the weights; and an output step for outputting one or more pairs of the pseudospectrum and attribute information, wherein the basis spectra obtained in the basis acquisition step include at least one factor spectrum that is a component of the spectrum input in the input step, or a spectrum obtained by subjecting the factor spectrum to an arbitrary variation process, and the attribute information includes at least one of the basis spectra, the variation process, and the weight used for generation.

[0134] (Representation 12) A spectrum generation method according to Representation 11, wherein the basis acquisition step treats one or more spectra input in the input step as a tensor consisting of a sample direction axis and one or more spectrum direction axes, and decomposes the spectrum using a tensor decomposition technique into one or more pairs of factor spectra and relative concentration vectors, the factor spectra being included in the basis spectra, and the relative concentration vectors being vectors with the same size as the number of spectra.

[0135] (Representation 13) A spectrum generation method according to either of Representation 11 or 12, wherein the basis acquisition step determines a similarity function based on the generation request, the optimization function of the tensor decomposition technique has a regularization term aimed at making the spectrum received in the input step and the reconstruction result similar based on the result of the similarity function, which takes as input the spectrum input in the input step and a reconstruction result using a set of a factor spectrum and a concentration vector, which are the results of tensor decomposition, and the generation step acquires the output of a feature extraction function which takes as input the pseudospectrum, and includes the output in the attribute information.

[0136] (Representation 14) A spectrum generation method according to any one of Representations 11 to 13, wherein the input step receives spectra associated with one or more standard samples, and the basis acquisition step includes the spectra in the basis spectrum.

[0137] (Representation 15) A spectrum generation method according to any one of Representations 11 to 14, wherein the generating step sets the weights according to an arbitrary probability distribution, and the attribute information includes information on the probability distribution. [Explanation of symbols]

[0138] 10: spectrum generation device, 20: control device, 21: spectrum measurement device, 22: output device, 50: machine learning model construction device, 51: design unit, 52: learning unit, 53: verification unit, 54: model output unit, 101: input unit, 102: basis acquisition unit, 103: generation unit, 104: output unit

Claims

1. A spectrum generation device that generates a pair of pseudospectrum and attribute information for constructing a machine learning model using a spectrum as an explanatory variable, an input unit to which a spectral data set consisting of one or more spectra or one or more sets of spectra and sample information, and a generation request for adjusting the generation result are input; a basis acquisition unit that acquires one or more basis spectra that are components of the pseudospectrum to be generated; a generator that sets weights on one or more basis spectra obtained by the basis acquisition unit and generates a pseudospectrum different from the spectrum input to the input unit from the weighted basis spectra; an output unit that outputs one or more pairs of the generated pseudospectrum and attribute information; Equipped with the basis spectra acquired by the basis acquisition unit include at least one factor spectrum that is a component of the spectrum input to the input unit or a spectrum obtained by performing a predetermined variation process on the factor spectrum; The attribute information output from the output unit in association with the pseudospectrum includes at least one of information on the basis spectrum, the predetermined variation process, and the weight used to generate the pseudospectrum. Spectral generator.

2. 2. The spectrum generating device according to claim 1, The generator sets weights to one or more basis spectra obtained by the basis acquisition unit, and calculates a weighted sum of the basis spectra and the weights to generate a pseudospectrum having a shape different from that of the spectrum input to the input unit. Spectral generator.

3. 2. The spectrum generating device according to claim 1, The basis acquisition unit Treating one or more spectra input to the input unit as a tensor having a sample direction axis and one or more spectrum direction axes; decomposing the spectrum into one or more sets of factor spectra and relative concentration vectors using a tensor decomposition technique; including the factor spectrum in the basis spectrum; The relative concentration vector is a vector with the same size as the number of spectra. Spectral generator.

4. 4. The spectrum generating device according to claim 3, the basis acquisition unit determines a feature extraction function based on the generation request; the optimization function of the tensor decomposition method has a regularization term for the purpose of making the output of the feature extraction function when the spectrum input to the input unit is used as an input similar to the output of the feature extraction function when the reconstruction result using a set of a factor spectrum and a concentration vector, which are the tensor decomposition results, is used as an input; The generating unit obtains an output of the feature extraction function and includes it in the attribute information. Spectral generator.

5. 2. The spectrum generating device according to claim 1, wherein the input unit receives spectra associated with one or more standard samples, and the basis acquisition unit includes the spectra in the basis spectra. Spectral generator.

6. 3. The spectrum generating device according to claim 2, wherein the generating unit sets the weights according to an arbitrary probability distribution, and includes information about the probability distribution in the attribute information. Spectral generator.

7. 5. The spectrum generating device according to claim 3 or claim 4, The generating unit sets the weights in accordance with a probability distribution whose parameters include statistics of the density vectors, and the generating unit generates a parameter whose parameters include information on the probability distribution whose parameters include statistics of the density vectors. Spectral generator.

8. A machine learning model construction device comprising the spectrum generation device according to any one of claims 1 to 7, which constructs a machine learning model using a set of pseudospectrum and basis information, the machine learning model receiving a spectrum as an input, a design unit that receives any function request for adjusting a machine learning model to be constructed, constructs a training pseudospectral data set and a validation pseudospectral data set using the spectrum generator, and defines specifications of the machine learning model; a learning unit that uses the training pseudospectral data set to train the machine learning model; a verification unit that verifies the machine learning model using the verification pseudospectral dataset; a model output unit that outputs the machine learning model and a verification result by the verification device; Equipped with the verification unit verifies the performance of the machine learning model trained by the learning unit, and expands the training pseudospectral dataset by outputting a function request to the design unit according to the verification result, and re-trains and verifies the machine learning model; The design unit uses the pseudospectrum as an input and designs an objective function based on the attribute information. Machine learning model building device.

9. The machine learning model construction device according to claim 8, The design unit is a machine learning model construction device in which the objective function used to train the machine learning model includes constraint terms aimed at ensuring that the latent variables or outputs of the machine learning model are similar when pseudospectrums with similar attribute information are input.

10. The machine learning model construction device according to claim 8, The verification unit includes data representing a relationship between an output of the machine learning model when each pseudospectrum included in the verification pseudospectrum data set is input and attribute information, and the verification result includes the data representing a relationship between the output of the machine learning model when each pseudospectrum included in the verification pseudospectrum data set is input and attribute information. Machine learning model building device.

11. A spectrum generation method for generating a set of pseudospectrum and attribute information for constructing a machine learning model using a spectrum as an explanatory variable, comprising: an input step for receiving a spectral dataset consisting of one or more spectra or one or more sets of spectra and sample information, and an optional production request for adjusting the production results; a basis acquisition step of acquiring one or more basis spectra that will be components of the generated pseudospectrum; a generating step of generating a pseudospectrum having a shape different from that of the spectrum received in the input step by assigning weights to one or more basis spectra obtained in the basis acquisition step and calculating a weighted sum of the basis spectra and the weights; an output step of outputting one or more pairs of the pseudospectrum and attribute information; Run the basis spectra acquired in the basis acquisition step include at least one factor spectrum that is a component of the spectrum input in the input step or a spectrum obtained by performing any variation processing on the factor spectrum; The attribute information includes at least one of the information on the basis spectrum, the variation processing, and the weight used for generation. Spectrum generation method.

12. 12. A spectrum generation method according to claim 11, comprising: The basis acquisition step includes: Treating the one or more spectra input in the input step as a tensor having a sample direction axis and one or more spectrum direction axes; decomposing the spectrum into one or more sets of factor spectra and relative concentration vectors using a tensor decomposition technique; The factor spectrum is included in the basis spectrum, and the relative concentration vector is a vector of the same size as the number of the spectra. Spectrum generation method.

13. 13. A spectrum generation method according to claim 12, comprising: The basis acquisition step includes: determining a feature extraction function based on the generation request; the optimization function of the tensor decomposition method has a regularization term for the purpose of making the output of the feature extraction function when the spectrum input in the input step is used as an input similar to the output of the feature extraction function when the reconstruction result using a set of the factor spectrum and the concentration vector, which are the tensor decomposition results, is used as an input; The generating step obtains an output of a feature extraction function to which the pseudospectrum is input, and includes the output in the attribute information. Spectrum generation method.

14. 12. A spectrum generation method according to claim 11, comprising: The input step receives spectra associated with one or more standard samples, and the basis acquisition step includes the spectra in the basis spectra. Spectrum generation method.

15. 12. A spectrum generation method according to claim 11, comprising: The generating step sets the weights in accordance with an arbitrary probability distribution, and the attribute information includes information on the probability distribution.

Citation Information

Patent Citations

  • Data generation method, learning model generation method, computer program, information processor, and analysis device

    JP2023074746A