Data processing method and device

Abstract

The embodiment of the invention discloses a data processing method and device, relates to the technical field of data processing, and can screen out core SNPs with high hereditary characteristics from biological SNPs. The method includes obtaining a first SNP set. And determining a second SNP set from the first SNP set according to the first information of the SNPs. And determining a third SNP set from the second SNP set according to a target feature extraction method and a nonlinear feature extraction method. Wherein the first SNP set comprises N SNPs, the N is a positive integer, the first information comprises at least one of linkage imbalance information or variance, the second SNP set comprises M SNPs, the M is a positive integer, the M is smaller than the N, the N is a positive integer, the first information comprises at least one of linkage imbalance information and variance, and the second information comprises at least one of linkage imbalance information and variance. The target feature extraction method comprises at least one of a filtering type feature extraction method, a wrapping type feature extraction method or an embedded type feature extraction method, the third SNP set comprises H SNPs, and H is a positive integer and is smaller than M.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of data processing technology, and in particular, to a data processing method and device. Background Art

[0002] Single nucleotide polymorphism (SNP) mainly refers to DNA sequence polymorphism caused by the variation of a single nucleotide at the genomic level. It is the most common type of biological heritable variation, accounting for more than 90% of all known polymorphisms. SNP is widely present in the genome of organisms, with an average of 1 in every 300 base pairs, and the total number is estimated to be 3 million or even more. SNP is a dimorphic marker caused by the conversion or transversion of a single base, or by the insertion or deletion of a base. SNP may be within the gene sequence or in the non-coding sequence outside the gene. Genetic screening requires screening out highly heritable core SNPs from the SNPs of the organism.

[0003] However, among the tens of thousands of SNPs in organisms, only a small number are core SNPs with high genetic characteristics.

[0004] Therefore, how to screen out core SNPs with high genetic characteristics from the SNPs of an organism is one of the problems that technicians in this field need to solve urgently. Summary of the invention

[0005] The embodiment of the present application provides a data processing method and device, which relates to the field of data processing technology and can screen out core SNPs with high genetic characteristics from biological SNPs. To achieve the above purpose, the embodiment of the present application adopts the following technical solutions:

[0006] In a first aspect, an embodiment of the present application provides a data processing method, the method comprising: obtaining a first SNP set. Determine a second SNP set from the first SNP set according to the first information of the SNP. Determine a third SNP set from the second SNP set according to a target feature extraction method and a nonlinear feature extraction method. Wherein, the first SNP set includes N SNPs, N is a positive integer, the first information includes at least one of linkage disequilibrium information or variance, the second SNP set includes M SNPs, M is a positive integer, M is less than N, the target feature extraction method includes at least one of a filtering feature extraction method, a wrapping feature extraction method or an embedded feature extraction method, and the third SNP set includes H SNPs, H is a positive integer, and H is less than M.

[0007] It should be noted that among the multiple SNPs in a region, there may be one SNP that can represent the type of most SNPs in the region. The embodiment of the present application determines the representative SNPs in each region from the multiple SNPs obtained through the variance and linkage disequilibrium information of the SNPs, and eliminates the remaining redundant SNPs, thereby performing data dimension reduction on the obtained SNP data, and then performing feature screening on the reduced data through the target feature extraction method and the nonlinear feature extraction method, thereby screening out core SNPs with high genetic characteristics from the biological SNPs. In addition, the embodiment of the present application also selects SNPs with strong correlation with the dependent variable (phenotype) from the multiple SNPs obtained through the variance and linkage disequilibrium information of the SNPs.

[0008] Optionally, the linkage disequilibrium information may include a linkage disequilibrium (LD) coefficient.

[0009] In a possible implementation, the target SNP may be deleted from the first SNP set according to the LD coefficient of the SNP to obtain the second SNP set, wherein the target SNP is a SNP whose LD coefficient is outside a preset LD coefficient range.

[0010] It is understandable that if the LD coefficient of the SNP is outside the preset LD coefficient interval, the SNP has a high probability of being in a linkage disequilibrium state, and the SNP in a linkage disequilibrium state is more likely to have the same genetic characteristics as other SNPs. Therefore, the target SNP of the acquired SNP data can be eliminated to reduce the dimension of the acquired SNP data, and then the reduced data can be feature screened by the target feature extraction method and the nonlinear feature extraction method, so as to screen out the core SNP with high genetic characteristics from the biological SNP.

[0011] In a possible implementation, when there are multiple SNPs with the same variance in the first SNP set, one SNP among the multiple SNPs with the same variance is retained and other SNPs among the multiple SNPs are deleted to obtain the second SNP set.

[0012] It is understandable that the genetic characteristics of SNPs with the same variance may also be the same. Therefore, only one SNP among multiple SNPs with the same variance can be retained, and the remaining SNPs among multiple SNPs with the same variance can be deleted from the acquired SNP data to reduce the dimension of the acquired SNP data, and then feature screening is performed on the reduced-dimensional data through the target feature extraction method and the nonlinear feature extraction method, so as to screen out the core SNPs with high genetic characteristics from the biological SNPs.

[0013] In a possible implementation, a fourth SNP set may be determined from the second SNP set according to the target feature extraction method, the fourth SNP set including K SNPs, K being a positive integer, less than M and greater than H. A third SNP set may be determined from the fourth SNP set according to the nonlinear feature extraction method.

[0014] It can be seen that the embodiment of the present application determines the representative SNP in each region from the multiple SNPs obtained through the variance and linkage disequilibrium information of the SNPs, and eliminates the remaining redundant SNPs, thereby performing data dimensionality reduction on the obtained SNP data, and then performing feature screening on the reduced data through the target feature extraction method and the nonlinear feature extraction method, thereby screening out the core SNPs with high genetic characteristics from the biological SNPs.

[0015] In a possible implementation, SNPs can be eliminated from the second SNP set according to the target feature extraction method. When the determination coefficient of the remaining SNPs in the second SNP set is greater than the first threshold or the first remaining ratio is less than the first ratio threshold, the remaining SNPs in the second SNP set are determined as the fourth SNP set, and the first remaining ratio is the ratio of the number of remaining SNPs in the second SNP set to M.

[0016] It can be seen that the method provided in the embodiment of the present application determines the representative SNPs in each region from the obtained multiple SNPs through the variance and linkage disequilibrium information of the SNPs, removes the remaining redundant SNPs, thereby performing data dimension reduction on the obtained SNP data, and then further screening the obtained multiple SNPs according to the determination coefficient and number of the remaining SNPs through the target feature extraction method, and the further screened SNPs are then feature screened through nonlinear features, thereby screening the core SNPs with high genetic characteristics from the biological SNPs. In addition, the multiple SNPs obtained are further screened according to the determination coefficient and number of the remaining SNPs through the target feature extraction method, and the SNPs with penalty terms for correlation between features can be obtained.

[0017] In a possible implementation, SNPs can be eliminated from the fourth SNP set according to the nonlinear feature extraction method; when the determination coefficient of the remaining SNPs in the fourth SNP set is greater than the second threshold or the second remaining ratio is less than the second ratio threshold, the remaining SNPs in the fourth SNP set are determined as the third SNP set, and the second remaining ratio is the ratio of the number of remaining SNPs in the fourth SNP set to the M.

[0018] It can be seen that the method provided in the embodiment of the present application determines the representative SNP in each region from the multiple SNPs obtained through the variance and linkage disequilibrium information of the SNPs, and eliminates the remaining redundant SNPs, thereby performing data dimensionality reduction on the obtained SNP data, and then further screening the multiple SNPs obtained through the target feature extraction method, and the further screened SNPs are further screened through the non-linear characteristics according to the determination coefficient and the number of the remaining SNPs, thereby screening out the core SNPs with high genetic characteristics from the biological SNPs.

[0019] In a second aspect, the present application implements a data processing device, which includes: a transceiver unit and a processing unit. The transceiver unit is used to obtain a first SNP set, the first SNP set includes N SNPs, and N is a positive integer. The processing unit is used to determine a second SNP set from the first SNP set based on the first information of the SNP, the first information includes at least one of linkage disequilibrium information or variance, the second SNP set includes M SNPs, M is a positive integer, and M is less than N. The processing unit is also used to determine a third SNP set from the second SNP set based on a target feature extraction method and a nonlinear feature extraction method, the target feature extraction method includes at least one of a filtering feature extraction method, a wrapping feature extraction method, or an embedded feature extraction method, the third SNP set includes H SNPs, H is a positive integer, and H is less than M.

[0020] In a possible implementation, the first information includes linkage disequilibrium information, the linkage disequilibrium information includes the linkage disequilibrium LD coefficient, and the processing unit is specifically used to: delete the target SNP from the first SNP set according to the LD coefficient of the SNP to obtain the second SNP set, and the target SNP is a SNP whose LD coefficient is outside the preset LD coefficient range.

[0021] In a possible implementation, the first information includes variance, and the processing unit is specifically used to: when there are multiple SNPs with the same variance in the first SNP set, retain one SNP among the multiple SNPs with the same variance and delete other SNPs among the multiple SNPs to obtain the second SNP set.

[0022] In a possible implementation, the processing unit is specifically used to: determine a fourth SNP set from the second SNP set according to the target feature extraction method, the fourth SNP set including K SNPs, K is a positive integer, K is less than M and greater than H; determine a third SNP set from the fourth SNP set according to the nonlinear feature extraction method.

[0023] In a possible implementation, the processing unit is specifically used to: eliminate SNPs from the second SNP set according to the target feature extraction method; when the determination coefficient of the remaining SNPs in the second SNP set is greater than the first threshold or the first remaining ratio is less than the first ratio threshold, determine the remaining SNPs in the second SNP set as the fourth SNP set, and the first remaining ratio is the ratio of the number of remaining SNPs in the second SNP set to the M.

[0024] In a possible implementation, the processing unit is specifically used to: eliminate SNPs from the fourth SNP set according to the nonlinear feature extraction method; when the determination coefficient of the remaining SNPs in the fourth SNP set is greater than the second threshold or the second remaining ratio is less than the second ratio threshold, determine the remaining SNPs in the fourth SNP set as the third SNP set, and the second remaining ratio is the ratio of the number of remaining SNPs in the fourth SNP set to the M.

[0025] In a third aspect, an embodiment of the present application further provides a data processing device, which includes: at least one processor, when the at least one processor executes program code or instructions, it implements the method described in the above first aspect or any possible implementation method thereof.

[0026] Optionally, the data processing device may further include at least one memory, and the at least one memory is used to store the program code or instruction.

[0027] In a fourth aspect, an embodiment of the present application further provides a chip, comprising: an input interface, an output interface, and at least one processor. Optionally, the chip further comprises a memory. The at least one processor is used to execute the code in the memory, and when the at least one processor executes the code, the chip implements the method described in the first aspect or any possible implementation thereof.

[0028] Optionally, the above chip may also be an integrated circuit.

[0029] In a fifth aspect, an embodiment of the present application further provides a computer-readable storage medium for storing a computer program, wherein the computer program includes methods for implementing the method described in the above-mentioned first aspect or any possible implementation thereof.

[0030] In a sixth aspect, an embodiment of the present application further provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to implement the method described in the first aspect or any possible implementation thereof.

[0031] The data processing device, computer storage medium, computer program product and chip provided in this embodiment are all used to execute the method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the method provided above and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0033] Figure 1 A schematic diagram of the structure of a data processing system provided in an embodiment of the present application;

[0034] Figure 2 A flowchart of a data processing method provided in an embodiment of the present application;

[0035] Figure 3 A schematic diagram of the structure of a data processing device provided in an embodiment of the present application;

[0036] Figure 4 A schematic diagram of the structure of a chip provided in an embodiment of the present application;

[0037] Figure 5 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0038] Figure 6 A schematic diagram of the structure of another data processing device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0039] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the embodiments of the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the embodiments of the present application.

[0040] The term "and / or" in this article is merely a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0041] The terms "first" and "second" and the like in the description and drawings of the embodiments of the present application are used to distinguish different objects, or to distinguish different processing of the same object, rather than to describe a specific order of objects.

[0042] In addition, the terms "including" and "having" and any variations thereof mentioned in the description of the embodiments of the present application are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device including a series of steps or units is not limited to the listed steps or units, but may optionally include other steps or units that are not listed, or may optionally include other steps or units inherent to these processes, methods, products or devices.

[0043] It should be noted that in the description of the embodiments of the present application, words such as "exemplarily" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplarily" or "for example" in the embodiments of the present application should not be interpreted as having priority or advantage over other embodiments or designs. Specifically, the use of words such as "exemplarily" or "for example" is intended to present related concepts in a specific way.

[0044] First, the terms involved in the embodiments of the present application are explained.

[0045] High-dimensional small sample data: refers to data with extremely high data dimension, very small absolute number of samples or the number of samples is far smaller than the data dimension.

[0046] Linkage disequilibrium means that the probability of alleles belonging to two or more gene loci appearing on a chromosome at the same time is higher than the frequency of random occurrence. Simply put, as long as two genes are not inherited completely independently, they will show a certain degree of linkage. This situation is called "linkage disequilibrium". Linkage disequilibrium can be in different regions on the same chromosome or on different chromosomes.

[0047] Alleles generally refer to "a pair of genes that control relative traits at the same position on a pair of homologous chromosomes". It may appear in one of two or more genes at a specific position on a chromosome. If a gene at a position exists in more than two states, it is called a "multiple allele". If the two genes in a pair of alleles are exactly the same, the individual is homozygous for this trait. If the two alleles are different, the individual is heterozygous for this trait. In a heterozygous pairing, the dominant allele prevents the trait of the recessive allele from being expressed.

[0048] Linkage disequilibrium (LD) decays. Generally speaking, the closer two SNPs (SNP sites) are on the genome, the stronger the correlation and the larger the LD coefficient. Conversely, the smaller the LD coefficient. In other words, as the distance between sites increases, the LD coefficient usually decreases slowly. This law is usually presented using an LD decay graph. The decay rate of the LD coefficient varies in different subpopulations. Different populations of the same species have very different LD decay rates due to their different genetic backgrounds. Domestication selection will lead to a decrease in population genetic diversity and an increase in the correlation (linkage degree) between sites. Therefore, the higher the degree of domestication and the greater the intensity of selection, the slower the LD decay rate. For example, cultivated rice usually has a larger LD decay distance than wild rice. Similarly, a decrease in population genetic diversity caused by natural selection and genetic drift will also slow down the rate of LD decay.

[0049] D value is the basic unit of LD, which measures the deviation of the observed haplotype frequency from the expected frequency under equilibrium. Although D can well express the basic meaning of LD, it is not suitable for expressing the actual LD ​​strength because it strictly depends on allele frequency, especially for comparing LD values ​​of different studies. Among the symbols commonly used to measure LD, the most important ones are D' and r. 2 , both are based on D, each has its own characteristics and uses.

[0050] Filtering feature extraction method: refers to first selecting features from the data set and then training the learner. The feature selection process is independent of the subsequent learner, which is equivalent to "filtering" the initial features first and then training the model with the filtered features. Filtering feature extraction methods include filtering feature extraction methods that remove low variance and filtering feature extraction methods that select single variables.

[0051] Filtering feature extraction method to remove low variance: Assume that the eigenvalues ​​of a feature are only 0 and 1, and in all input samples, 95% of the instances have the value of 1, then it can be considered that this feature is not very useful. If 100% are 1, then this feature is meaningless. This method can only be used when the eigenvalues ​​are all discrete variables. If they are continuous variables, the continuous variables need to be discretized before they can be used. In addition, in reality, there are generally not many features that have a certain value for more than 95%, so this method is simple but not very easy to use. It can be used as a preprocessing for feature selection. First remove those features with small value changes, and then select the appropriate one from the feature selection methods mentioned below for further feature selection.

[0052] Filtering feature extraction method of univariate feature selection (univariate feature selection): The principle of univariate feature selection is to calculate a statistical index of each variable separately, and judge which indexes are important based on the index, and eliminate those unimportant indexes. Specifically, univariate feature selection can use the chi-square test for classification problems. Univariate feature selection can use the Pearson correlation coefficient for regression problems.

[0053] The Pearson correlation coefficient is the simplest method that can help understand the relationship between features and response variables. This method measures the linear correlation between variables. The result range is [-1, 1]. -1 indicates a complete negative correlation, +1 indicates a complete positive correlation, and 0 indicates no linear correlation.

[0054] Parcel feature extraction method: refers to the process of continuously selecting feature subsets from the initial feature set, training the learner, and evaluating the subsets based on the performance of the learner until the best subset is selected. In the parcel feature extraction method, the easiest way to search for feature subsets is the exhaustive method. You can also use a random strategy for subset search (Las Vegas rapper, LVW) in the framework of the Las Vegas method. However, since the feature subset search in the LVW algorithm uses a random strategy, each feature subset evaluation requires training the learner, which has a high computational overhead. If the initial number of features is large, the algorithm may not reach the stopping condition for a long time. If there is a running time limit, it may not be able to provide a solution. Therefore, greedy algorithms can also be used: such as forward search (gradually adding features to the optimal subset until adding features does not improve the model performance), backward search, and bidirectional search (combining forward search and backward search).

[0055] Embedded feature extraction method: In the filtering and wrapping feature selection methods, the feature selection process is significantly different from the learner training process. Embedded feature selection automatically performs feature selection during the learner training process. The most commonly used embedded feature extraction methods are L1 regularization and L2 regularization. The larger the regularization term, the simpler the model and the smaller the coefficient. When the regularization term increases to a certain extent, all feature coefficients will tend to 0. In this process, the coefficients of some features will become 0 first. This realizes the feature selection process. Logistic regression, linear regression, and decision trees can all be used as base learners for regularized feature selection. Only algorithms that can obtain feature coefficients or feature importance can be used as base learners for embedded selection.

[0056] The Hilbert-Schmidt Independence Criterion (HSIC) regression model (Lasso) feature extraction method is a kernel-based feature selection algorithm that selects important features to explain the prediction of HSIC Lasso according to the weights of different features in HSIC Lasso. The form of HSIC Lasso is as follows:

[0057]

[0058] Among them, α=[α1,α2,…,α d ] T is the feature weight, λ is the regularization parameter, is the kth eigenvalue in the data and y is the true value.

[0059] Ridge regression is a biased estimation regression method specially used for collinear data analysis. In essence, it is an improved least squares estimation method. It abandons the unbiasedness of the least squares method and obtains a more practical and reliable regression coefficient at the cost of losing some information and reducing precision. It fits pathological data better than the least squares method.

[0060] The characteristic of lasso regression is that when establishing a generalized linear model, the generalized linear model includes one-dimensional continuous dependent variables, multidimensional continuous dependent variables, non-negative frequency dependent variables, binary discrete dependent variables, and multivariate discrete dependent variables. In addition, whether the dependent variable is continuous or discrete, lasso can handle it. In general, lasso has extremely low requirements for data, so it is widely used; in addition, lasso can also screen variables and reduce the complexity of the model. Variable screening here means not putting all variables into the model for fitting, but selectively putting variables into the model to obtain better performance parameters. Complexity adjustment refers to controlling the complexity of the model through a series of parameters to avoid overfitting. For linear models, complexity is directly related to the number of variables in the model. The more variables there are, the higher the model complexity. More variables can often give a seemingly better model when fitting, but at the same time they also face the risk of overfitting.

[0061] Elastic net regularization is a method that combines L1 regularization and L2 regularization. It can control the complexity and sparsity of the model and avoid the instability that may be caused by L1 regularization in some cases.

[0062] L1 regularization is a widely used regularization method that penalizes the size of the parameters by introducing the L1 norm of the model parameters in the loss function. This regularization method can be used for feature selection because it tends to set some parameters to zero, making the model more sparse.

[0063] L2 regularization is another common regularization method that penalizes the size of the parameters by introducing the L2 norm of the model parameters in the loss function. Unlike L1 regularization, L2 regularization does not tend to set the parameters to zero, but controls the complexity of the model by reducing the size of the parameters.

[0064] Support vector regression (SVR) is a supervised learning algorithm used to predict the reunion value. Support vector regression uses the same principle as support vector machine (SVM). The basic idea behind SVR is to find the best fit line. In SVR, the best fit line is the hypercube with the most points.

[0065] Light gradient boosting machine (light GBM) is a boosting method. Boosting refers to the use of a series of linear combinations of models to complete model tasks. In boosting learning, each model is gradually determined, and each sub-model is superimposed into the composite model. In this process, the loss function is ensured to gradually decrease with the increase of sub-models.

[0066] Random Forest is an algorithm that integrates multiple trees through the idea of ​​ensemble learning. Its basic unit is the decision tree, and its essence belongs to a major branch of machine learning - the ensemble learning method. There are two keywords in the name of Random Forest, one is "random" and the other is "forest". We can understand "forest" very well. If one tree is called a tree, then hundreds or thousands of trees can be called a forest. This metaphor is very appropriate. In fact, this is also the embodiment of the main idea of ​​Random Forest - the idea of ​​integration. From an intuitive point of view, each decision tree is a classifier (assuming that the problem is classification now), then for an input sample, N trees will have N classification results. Random Forest integrates all classification voting results and designates the category with the most votes as the final output.

[0067] Pearson correlation coefficient (PCC) is a method to measure the degree of correlation between two variables. It is a value between 1 and -1, where 1 means that the variables are completely positively correlated, 0 means no linear correlation, and -1 means completely negative correlation. The PCC calculation formula is as follows:

[0068]

[0069] Where ρ is PPC, is the mean of the variable x, It is the mean of the variable y. The value range of PCC is [-1, 1]. If it is close to 0, there is no correlation. The closer it is to 1 (-1), the stronger the positive correlation (negative correlation) between the two variables.

[0070] The Spearman correlation coefficient (SCC) is used to measure the correlation between two variables. The Spearman correlation coefficient indicates the direction of the correlation between X (independent variable) and Y (dependent variable). If Y tends to increase when X increases, the Spearman correlation coefficient is positive. If Y tends to decrease when X increases, the Spearman correlation coefficient is negative. The Spearman correlation coefficient ranges from -1 to 1, where -1 indicates a complete negative correlation, 0 indicates no correlation, and 1 indicates a complete positive correlation. The SCC calculation formula is a variation of the PCC calculation formula. The SCC calculation formula is as follows:

[0071]

[0072] Among them, ρ s For SCC, R i and S i The observed values ​​x i and i SCC evaluates the monotonic relationship between two variables and determines whether the variables reflect a trend of changing together.

[0073] Mean absolute error (MAE) reflects the absolute cumulative deviation between the predicted values ​​and the true values ​​of multiple samples. The mean absolute error is the average of the absolute values ​​of the deviations of all individual observations from the arithmetic mean. The mean absolute error can avoid the problem of errors canceling each other out, and thus can accurately reflect the size of the actual prediction error. The MAE calculation formula is as follows:

[0074]

[0075] Where n is the number of samples, yi The actual observed value, is the true value.

[0076] Mean squared error (MSE) is a measure of the difference between the estimator and the estimated quantity. The MSE calculation formula is as follows:

[0077]

[0078] Root mean squared error (RMSE) is the root mean square of the prediction error. It is used to measure the accuracy of regression prediction. The RMSE calculation formula is as follows:

[0079]

[0080] R 2 , that is, the coefficient of determination is a statistical indicator that quantitatively represents the correlation between qualitative variables or factors, and is often used to measure the strength of the linear relationship between two variables. It is a quantitative measurement indicator with a value range between 0 and 1, and can also be regarded as a proportion of the total variation of the variable. When it is greater than 0.8, it indicates that the linear relationship between the two variables is very strong; when it is less than 0.4, it indicates that there is no linear relationship between them. It is the most important measurement indicator in correlation analysis statistics. The calculation formula of the coefficient of determination is as follows:

[0081] R 2 =PCC 2

[0082] The coefficient of variation (CV) is a statistic that measures the degree of variation of each observation in the data. When comparing the degree of variation of two or more data, if the measurement unit is the same as the mean, the standard deviation can be used directly for comparison. If the unit and (or) the mean are different, the standard deviation cannot be used to compare the degree of variation, but the ratio of the standard deviation to the mean (relative value) must be used for comparison. The calculation formula for the mean CV of RMSE is as follows:

[0083]

[0084] Among them, CV is the mean CV of RMSE, and Mean Value is the mean of RMSE.

[0085] SNP mainly refers to DNA sequence polymorphism caused by the variation of a single nucleotide at the genomic level. It is the most common type of heritable variation in organisms, accounting for more than 90% of all known polymorphisms. SNP is widely present in the genome of organisms, with an average of 1 in every 300 base pairs, and the total number is estimated to be 3 million or even more. SNP is a dimorphic marker caused by the conversion or transversion of a single base, or by the insertion or deletion of a base. SNP may be within the gene sequence or in the non-coding sequence outside the gene. Genetic screening requires screening out highly heritable core SNPs from the SNPs of organisms.

[0086] However, among the tens of thousands of SNPs in organisms, only a small number are core SNPs with high genetic characteristics.

[0087] To this end, an embodiment of the present application provides a data processing method, which can be applied to a data processing system. Figure 1 1 is a functional block diagram of a data processing system 10 provided in an embodiment of the present application. Figure 1 The data processing system 10 shown may include various sub-modules, such as a communication module 11 , a processing module 12 , a storage module 13 , and an interface module 14 .

[0088] Optionally, the data processing system 10 may include more or fewer sub-modules, and each sub-module may include multiple components. In addition, each sub-module and component of the data processing system 10 may be interconnected in a wired or wireless manner.

[0089] The communication module 11 may include a wireless communication system, which can communicate wirelessly with one or more devices directly or via a communication network. For example, the wireless communication system can use a third generation mobile communication technology (3G) cellular communication, such as code division multiple access (CDMA), global system for mobile communications (GSM) or general packet radio service (GPRS), or a fourth generation mobile communication technology (4G) cellular communication, such as long term evolution (LTE). Or a fifth generation mobile communication technology (5G) cellular communication. The wireless communication system can communicate with a wireless local area network (WLAN) using wireless fidelity (WiFi). In some embodiments, the wireless communication system can communicate directly with the device using an infrared link, Bluetooth or zigbee.

[0090] The processing module 12 may be any conventional processor, such as a commercially available CPU. Alternatively, the processing module 12 may also include a graphics processor (Graphic Process Unit: GPU), a field programmable gate array (Field Programmable Gate Array: FPGA), a system on chip (System on Chip: SOC), an application specific integrated circuit (Application Specific Integrated Circuit: ASIC) or a combination thereof.

[0091] The storage module 13 is used to store instructions, wherein the instructions may be computer programs.

[0092] The storage module 13 may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. The non-volatile memory may be a read-only memory (ROM), a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link DRAM (SLDRAM) and direct rambus RAM (DRRAM). The storage module 13 may also be a compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compact disc, laser disc, optical disc, digital versatile disc, Blu-ray disc, etc.), magnetic disk storage media or other magnetic storage devices, etc. It should be noted that the memory of the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0093] The interface module 14 can be used to send or receive data, instructions or information. The processing module 12 can use the data, instructions or other information received by the interface module 14 to process, and can send the processing completion information through the interface module 14.

[0094] Optionally, the above components are only examples. In actual applications, the components in the above modules may be added or deleted according to actual needs. Figure 1 It should not be understood as limiting the embodiments of the present invention.

[0095] Figure 2 A data processing method provided by an embodiment of the present application is shown, the method comprising:

[0096] S201. Obtaining the first SNP set

[0097] The first SNP set includes N SNPs, where N is a positive integer.

[0098] For example, N SNPs including soybeans may be obtained, and a set consisting of the obtained N SNPs of soybeans may be used as a first SNP set.

[0099] In a possible implementation, the first SNP set including N SNPs may be high-dimensional small sample data.

[0100] S202: Determine a second SNP set from the first SNP set according to the first information of the SNP.

[0101] The first information includes at least one of linkage disequilibrium information or variance, and the second SNP set includes M SNPs, where M is a positive integer and M is less than N. The linkage disequilibrium information may include

[0102] In a possible implementation, when there are multiple SNPs with the same variance in the first SNP set, one SNP among the multiple SNPs with the same variance is retained and other SNPs among the multiple SNPs are deleted to obtain the second SNP set.

[0103] For example, when there are 1000 SNPs with variance of 0.45 in the first SNP set, the first SNP that appears among the 1000 SNPs with variance of 0.45 can be retained in the first SNP set, and the remaining 999 SNPs with variance of 0.45 can be deleted from the first SNP set.

[0104] It is understandable that the genetic characteristics of SNPs with the same variance may also be the same. Therefore, only one SNP among multiple SNPs with the same variance can be retained, and the remaining SNPs among multiple SNPs with the same variance can be deleted from the acquired SNP data to perform data dimension reduction on the acquired SNP data, and then feature screening is performed on the reduced-dimensional data through the target feature extraction method and the nonlinear feature extraction method, so as to screen out core SNPs with high genetic characteristics from the biological SNPs. In addition, the embodiment of the present application also selects SNPs with strong correlation with the dependent variable (phenotype) from the acquired multiple SNPs through the variance and linkage disequilibrium information of the SNPs.

[0105] In a possible implementation, the target SNP may be deleted from the first SNP set according to the LD coefficient of the SNP to obtain the second SNP set, wherein the target SNP is a SNP whose LD coefficient is outside a preset LD coefficient range.

[0106] Exemplarily, the LD coefficient of the SNP can be determined according to the corresponding frequency of the characteristics of the SNP in the population, and the target SNP can be deleted from the first SNP set according to the LD coefficient of the SNP to obtain the second SNP set.

[0107] For example, suppose two SNPs (x i ,x j ), whose bases represent (A, B), and the alleles are A, a, B, and b, respectively, with corresponding frequencies π in the population. A ,π a ,π B ,π b , the two SNPs have four haplotypes AB, Ab, aB, ab, corresponding to frequencies π AB ,π Ab ,π aB ,π ab , calculate D ab =π AB -π A π B Then, based on the calculated LD coefficients of the SNPs, the SNPs whose LD coefficients are outside the preset LD coefficient interval are deleted from the first SNP set.

[0108] LD coefficient satisfies: when Where D'=0,r 2 = 0 is in complete linkage equilibrium; D' = 1, r 2 =1 is in a state of complete linkage disequilibrium; the higher the measurement from 0 to 1, the higher the LD and the stronger the degree of linkage.

[0109] S203: Determine a third SNP set from the second SNP set according to a target feature extraction method and a nonlinear feature extraction method.

[0110] Among them, the above-mentioned target feature extraction method includes at least one of a filtering feature extraction method, a wrapping feature extraction method or an embedded feature extraction method, and the above-mentioned third SNP set includes H SNPs, the above-mentioned H is a positive integer, and the above-mentioned H is less than the above-mentioned M.

[0111] In a possible implementation, a fourth SNP set can be determined from the second SNP set according to the target feature extraction method. A third SNP set can be determined from the fourth SNP set according to the nonlinear feature extraction method. The fourth SNP set includes K SNPs, K is a positive integer, and K is less than M and greater than H.

[0112] In a possible implementation, SNPs are eliminated from the second SNP set according to the target feature extraction method; when the determination coefficient of the remaining SNPs in the second SNP set is greater than the first threshold or the first remaining ratio is less than the first ratio threshold, the remaining SNPs in the second SNP set are determined as the fourth SNP set, and the first remaining ratio is the ratio of the number of remaining SNPs in the second SNP set to the M.

[0113] Exemplarily, SNPs can be screened out from the second SNP set according to the filtering feature extraction method, the wrapping feature extraction method and the embedded feature extraction method. When the determination coefficient of the remaining SNPs in the second SNP set is greater than 0.7 or the first remaining ratio is less than 20% (i.e., 80% of the SNPs have been screened out by the second SNP set), the remaining SNPs in the second SNP set are determined as the fourth SNP set.

[0114] Accordingly, when the determination coefficient of the remaining SNPs is less than the first threshold and the first remaining ratio is greater than the first ratio threshold, SNPs can continue to be eliminated from the second SNP set according to the target feature extraction method until the determination coefficient of the remaining SNPs in the second SNP set is greater than the first threshold or the first remaining ratio is less than the first ratio threshold.

[0115] It can be seen that the method provided in the embodiment of the present application determines the representative SNPs in each region from the obtained multiple SNPs through the variance and linkage disequilibrium information of the SNPs, removes the remaining redundant SNPs, thereby performing data dimension reduction on the obtained SNP data, and then further screening the obtained multiple SNPs according to the determination coefficient and number of the remaining SNPs through the target feature extraction method, and the further screened SNPs are then feature screened through nonlinear features, thereby screening the core SNPs with high genetic characteristics from the biological SNPs. In addition, the multiple SNPs obtained are further screened according to the determination coefficient and number of the remaining SNPs through the target feature extraction method, and the SNPs with penalty terms for correlation between features can be obtained.

[0116] In a possible implementation, the determination coefficient of the SNP may be determined based on the PCC of the remaining SNPs.

[0117] In a possible implementation, SNPs can be eliminated from the fourth SNP set according to the nonlinear feature extraction method; when the determination coefficient of the remaining SNPs in the fourth SNP set is greater than the second threshold or the second remaining ratio is less than the second ratio threshold, the remaining SNPs in the fourth SNP set are determined as the third SNP set, and the second remaining ratio is the ratio of the number of remaining SNPs in the fourth SNP set to the M.

[0118] Exemplarily, a nonlinear feature extraction method can be used to screen out SNPs from the fourth SNP set. When the determination coefficient of the remaining SNPs in the fourth SNP set is greater than 0.75 or the second remaining proportion is less than 1% (i.e., 99% of the SNPs have been screened out by the second SNP set), the remaining SNPs in the fourth SNP set are determined as the third SNP set.

[0119] Accordingly, when the determination coefficient of the remaining SNPs is less than the second threshold and the second remaining ratio is greater than the second ratio threshold, SNPs can continue to be eliminated from the fourth SNP set according to the above-mentioned target feature extraction method until the determination coefficient of the remaining SNPs in the fourth SNP set is greater than the second threshold or the second remaining ratio is less than the second ratio threshold.

[0120] It can be seen that the method provided in the embodiment of the present application determines the representative SNP in each region from the multiple SNPs obtained through the variance and linkage disequilibrium information of the SNPs, and eliminates the remaining redundant SNPs, thereby performing data dimensionality reduction on the obtained SNP data, and then further screening the multiple SNPs obtained through the target feature extraction method, and the further screened SNPs are further screened through the non-linear characteristics according to the determination coefficient and the number of the remaining SNPs, thereby screening out the core SNPs with high genetic characteristics from the biological SNPs.

[0121] Optionally, the above nonlinear feature extraction method includes but is not limited to the HSIC Lasso feature extraction method.

[0122] The specific implementation method for determining the SNP determination coefficient is not limited in the present application embodiment, and it can be any method that can be thought of by a person skilled in the art. For example, the SNP determination coefficient can be determined by a regression integration algorithm (Ridge regression, Lasso regression, Elastic net regularization, SVR or LightGBM).

[0123] It should be noted that among the multiple SNPs in a region, there may be one SNP that can represent the type of most SNPs in the region. The embodiment of the present application determines the representative SNPs in each region from the multiple SNPs obtained through the variance and linkage disequilibrium information of the SNPs, and eliminates the remaining redundant SNPs, thereby performing data dimension reduction on the obtained SNP data, and then performing feature screening on the reduced data through the target feature extraction method and the nonlinear feature extraction method, thereby screening out core SNPs with high genetic characteristics from the biological SNPs. In addition, the embodiment of the present application also selects SNPs with strong correlation with the dependent variable (phenotype) from the multiple SNPs obtained through the variance and linkage disequilibrium information of the SNPs.

[0124] Table 1 shows the prediction results obtained by the data processing method provided in the embodiment of the present application through soybean phenotype prediction. From Table 1, it can be seen that the prediction correlation coefficient PCC index obtained by the data processing method provided in the embodiment of the present application is more than 94%, close to the heritability of 95%. The number of characteristic SNPs after pre-processing combined with HSIC LASSO screening is 440, which is reduced by 99.7%, and the overall result is improved. Compared with the test results of related technologies, the data processing method provided in the embodiment of the present application is advanced in predicting phenotypes based on genotype data.

[0125] Table 1

[0126]

[0127]

[0128] The following will be combined Figure 3 A data processing device for executing the above data processing method is introduced.

[0129] It is understandable that, in order to realize the above functions, the data processing device includes hardware and / or software modules corresponding to the execution of each function. In combination with the algorithm steps of each example described in the embodiments disclosed herein, the embodiments of the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to exceed the scope of the embodiments of the present application.

[0130] The embodiment of the present application can divide the functional modules of the data processing device according to the above method example. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing module. The above integrated module can be implemented in the form of hardware. It should be noted that the division of modules in this embodiment is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0131] In the case of dividing each functional module into corresponding functional modules, Figure 3 A possible schematic diagram of the composition of the data processing device involved in the above embodiment is shown. Figure 3 As shown, the data processing device 300 may include: a transceiver unit 301 and a processing unit 302 .

[0132] The transceiver unit 301 is used to obtain a first SNP set, where the first SNP set includes N SNPs, where N is a positive integer.

[0133] The processing unit 302 is used to determine a second SNP set from the first SNP set according to the first information of the SNP, the first information includes at least one of linkage disequilibrium information or variance, the second SNP set includes M SNPs, M is a positive integer, and M is less than N.

[0134] The above-mentioned processing unit 302 is also used to determine a third SNP set from the above-mentioned second SNP set according to a target feature extraction method and a nonlinear feature extraction method, the above-mentioned target feature extraction method includes at least one of a filtering feature extraction method, a wrapping feature extraction method or an embedded feature extraction method, and the above-mentioned third SNP set includes H SNPs, the above-mentioned H is a positive integer, and the above-mentioned H is less than the above-mentioned M.

[0135] In a possible implementation, the first information includes linkage disequilibrium information, the linkage disequilibrium information includes the linkage disequilibrium LD coefficient, and the processing unit is specifically used to: delete the target SNP from the first SNP set according to the LD coefficient of the SNP to obtain the second SNP set, and the target SNP is a SNP whose LD coefficient is outside the preset LD coefficient range.

[0136] In a possible implementation, the first information includes variance, and the processing unit 302 is specifically used to: when there are multiple SNPs with the same variance in the first SNP set, retain one SNP among the multiple SNPs with the same variance and delete other SNPs among the multiple SNPs to obtain the second SNP set.

[0137] In a possible implementation, the processing unit 302 is specifically used to: determine a fourth SNP set from the second SNP set according to the target feature extraction method, the fourth SNP set including K SNPs, K is a positive integer, K is less than M and greater than H; determine a third SNP set from the fourth SNP set according to the nonlinear feature extraction method.

[0138] In a possible implementation, the processing unit 302 is specifically used to: eliminate SNPs from the second SNP set according to the target feature extraction method; when the determination coefficient of the remaining SNPs in the second SNP set is greater than the first threshold or the first remaining ratio is less than the first ratio threshold, determine the remaining SNPs in the second SNP set as the fourth SNP set, and the first remaining ratio is the ratio of the number of remaining SNPs in the second SNP set to the M.

[0139] In a possible implementation, the processing unit 302 is specifically used to: eliminate SNPs from the fourth SNP set according to the nonlinear feature extraction method; when the determination coefficient of the remaining SNPs in the fourth SNP set is greater than the second threshold or the second remaining ratio is less than the second ratio threshold, determine the remaining SNPs in the fourth SNP set as the third SNP set, and the second remaining ratio is the ratio of the number of remaining SNPs in the fourth SNP set to the M.

[0140] The embodiment of the present application also provides a chip. Figure 4 1 shows a schematic diagram of the structure of a chip 1000. The chip 400 includes one or more processors 401 and an interface circuit 402. Optionally, the chip 400 may also include a bus 403.

[0141] The processor 401 may be an integrated circuit chip with signal processing capability. In the implementation process, each step of the above data processing method may be completed by an integrated logic circuit of hardware in the processor 401 or by instructions in the form of software.

[0142] Optionally, the processor 401 may be a general purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods and steps disclosed in the embodiments of the present application may be implemented or executed. The general purpose processor may be a microprocessor or the processor may be any conventional processor, etc.

[0143] The interface circuit 402 can be used to send or receive data, instructions or information. The processor 401 can use the data, instructions or other information received by the interface circuit 402 to process, and can send the processing completion information through the interface circuit 402.

[0144] Optionally, the chip also includes a memory, which may include a read-only memory and a random access memory, and provides operation instructions and data to the processor. A portion of the memory may also include a non-volatile random access memory (NVRAM).

[0145] Optionally, the memory stores executable software modules or data structures, and the processor can perform corresponding operations by calling operation instructions stored in the memory (the operation instructions can be stored in the operating system).

[0146] Optionally, the chip can be used in a data processing device involved in an embodiment of the present application. Optionally, the interface circuit 402 can be used to output the execution result of the processor 401. The data processing method provided by one or more embodiments of the present application can refer to the aforementioned embodiments, which will not be repeated here.

[0147] It should be noted that the functions corresponding to the processor 401 and the interface circuit 402 can be implemented through hardware design, software design, or a combination of hardware and software, and there is no limitation here.

[0148] Figure 5 Schematic diagram of the structure of an electronic device provided in an embodiment of the present application, the electronic device 500 may be a processor or a chip or functional module in a processor. Figure 5 As shown, the electronic device 500 includes a processor 501 , a transceiver 502 and a communication circuit 503 .

[0149] Among them, the processor 501 is used to execute any step in the data processing method provided in the embodiment of the present application, and in the process of executing any step in the data processing method provided in the embodiment of the present application, the transceiver 502 and the communication line 503 can be selectively called to complete the corresponding operation.

[0150] Furthermore, the electronic device 500 may further include a memory 504. The processor 501, the memory 504 and the transceiver 502 may be connected via a communication line 503.

[0151] The processor 501 is a processor, a general-purpose processor, a network processor (NP), a digital signal processor (DSP), a microprocessor, a microcontroller, a programmable logic device (PLD), or any combination thereof. The processor 501 may also be other devices with processing functions, such as circuits, devices, or software modules, without limitation.

[0152] The transceiver 502 is used to communicate with other devices or other communication networks, such as Ethernet, radio access network (RAN), wireless local area network (WLAN), etc. The transceiver 502 can be a module, a circuit, a transceiver or any device capable of achieving communication.

[0153] The transceiver 502 is mainly used for sending and receiving commands and information, etc., and may include a transmitter and a receiver, which respectively send and receive commands and information, etc.; operations other than sending and receiving commands and information, etc. are implemented by the processor.

[0154] The communication line 503 is used to transmit information between the components included in the electronic device 500.

[0155] In one design, the processor may be considered as the logic circuit and the transceiver may be considered as the interface circuit.

[0156] The memory 504 is used to store instructions, where the instructions may be computer programs.

[0157] The memory 504 may be a volatile memory or a nonvolatile memory, or may include both volatile and nonvolatile memories. The nonvolatile memory may be a read-only memory (ROM), a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable programmable ROM (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate synchronous DRAM (DDR SDRAM), enhanced synchronous DRAM (ESDRAM), synchronous link DRAM (SLD RAM), and direct rambus RAM (DRRAM). The memory 504 may also be a compact disc read-only memory (CD-ROM) or other optical disk storage, optical disk storage (including compact disc, laser disc, optical disk, digital versatile disc, Blu-ray disc, etc.), magnetic disk storage media or other magnetic storage devices, etc. It should be noted that the memory of the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0158] It should be noted that the memory 504 can exist independently of the processor 501, or can be integrated with the processor 501. The memory 504 can be used to store instructions or program codes or some data, etc. The memory 504 can be located inside the electronic device 500, or outside the electronic device 500, without limitation. The processor 501 is used to execute the instructions stored in the memory 504 to implement the method provided in the above embodiment of the present application.

[0159] In one example, the processor 501 may include one or more processors, such as Figure 5 Processor 0 and processor 1 in.

[0160] As an optional implementation, the electronic device 500 includes multiple processors, for example, Figure 5 In addition to the processor 501, a processor 507 may also be included.

[0161] As an optional implementation, the electronic device 500 further includes an output device 505 and an input device 506. Exemplarily, the input device 506 is a device such as a keyboard, a mouse, a microphone or a joystick, and the output device 505 is a device such as a display screen and a speaker.

[0162] It should be noted that the electronic device 500 may be a chip system or a Figure 5 Devices with similar structures in the chip system. Among them, the chip system can be composed of chips, or it can include chips and other discrete devices. The actions, terms, etc. involved in the various embodiments of this application can refer to each other without limitation. The message name or parameter name in the message exchanged between the various devices in the embodiment of this application is only an example, and other names can also be used in the specific implementation without limitation. In addition, Figure 5 The components shown in the figure do not constitute a limitation on the electronic device 500. Figure 5 In addition to the components shown, the electronic device 500 may include Figure 5 More or fewer components may be shown, or certain components may be combined, or the components may be arranged differently.

[0163] The processor and transceiver described in the present application can be implemented in an integrated circuit (IC), an analog IC, a radio frequency integrated circuit, a mixed signal IC, an application specific integrated circuit (ASIC), a printed circuit board (PCB), an electronic device, etc. The processor and transceiver can also be manufactured using various IC process technologies, such as complementary metal oxide semiconductor (CMOS), N-type metal oxide semiconductor (NMOS), P-type metal oxide semiconductor (positive channel metal oxide semiconductor, PMOS), bipolar junction transistor (BJT), bipolar CMOS (BiCMOS), silicon germanium (SiGe), gallium arsenide (GaAs), etc.

[0164] Figure 6The following is a schematic diagram of the structure of a data processing device provided in an embodiment of the present application. The data processing device can be applied to the scenario shown in the above method embodiment. For the convenience of explanation, Figure 6 Only the main components of the data processing device are shown, including a processor 601, a memory 602, a control circuit 603, and an input-output device 604. The processor 601 is mainly used to process the communication protocol and communication data, execute the software program, and process the data of the software program. The memory 602 is mainly used to store the software program and data. The control circuit 603 is mainly used for power supply and transmission of various electrical signals. The input-output device 604 is mainly used to receive data input by the user and output data to the user.

[0165] When the data processing device is a processor 601, the control circuit 603 can be a mainboard, the memory 602 includes a hard disk, RAM, ROM and other media with storage functions, the processor 601 can include a baseband processor 601 and a central processing unit, the baseband processor is mainly used to process the communication protocol and communication data, the central processing unit is mainly used to control the entire data processing device, execute software programs, and process the data of the software programs, and the input and output device 604 includes a display screen, a keyboard and a mouse, etc.; the control circuit 603 can further include or connect a transceiver circuit or a transceiver, such as: a network cable interface, etc., for sending or receiving data or signals, such as data transmission and communication with other devices. Further, it can also include an antenna for sending and receiving wireless signals, and for data / signal transmission with other devices.

[0166] An embodiment of the present application also provides a data processing device, which includes: at least one processor, when the at least one processor executes program code or instructions, it implements the above-mentioned related method steps to implement the data processing method in the above-mentioned embodiment.

[0167] Optionally, the device may further include at least one memory, and the at least one memory is used to store the program code or instruction.

[0168] An embodiment of the present application also provides a computer storage medium, in which computer instructions are stored. When the computer instructions are executed on a data processing device, the data processing device executes the above-mentioned related method steps to implement the data processing method in the above-mentioned embodiment.

[0169] The embodiment of the present application also provides a computer program product. When the computer program product is run on a computer, the computer is enabled to execute the above-mentioned related steps to implement the data processing method in the above-mentioned embodiment.

[0170] The embodiment of the present application also provides a data processing device, which may be a chip, an integrated circuit, a component or a module. Specifically, the device may include a connected processor and a memory for storing instructions, or the device may include at least one processor for obtaining instructions from an external memory. When the device is running, the processor may execute instructions so that the chip executes the data processing method in each of the above method embodiments.

[0171] It should be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0172] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0173] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0174] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the above units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0175] The units described above as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, and may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0176] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0177] If the above functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the above methods in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0178] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A data processing method, characterized in that: The method comprises: Obtaining a first single nucleotide polymorphism (SNP) set, wherein the first SNP set includes N SNPs, where N is a positive integer; Determine a second SNP set from the first SNP set according to first information of SNPs, wherein the first information includes at least one of linkage disequilibrium information or variance, and the second SNP set includes M SNPs, where M is a positive integer and is less than N; A third SNP set is determined from the second SNP set according to a target feature extraction method and a nonlinear feature extraction method, wherein the target feature extraction method includes at least one of a filtering feature extraction method, a wrapping feature extraction method or an embedded feature extraction method, and the third SNP set includes H SNPs, where H is a positive integer and is less than M.

2. The method according to claim 1, characterized in that: The first information includes linkage disequilibrium information, and the linkage disequilibrium information includes a linkage disequilibrium LD coefficient. The determining of the second SNP set from the first SNP set according to the first information of the SNP includes: According to the LD coefficient of the SNP, a target SNP is deleted from the first SNP set to obtain the second SNP set, wherein the target SNP is a SNP whose LD coefficient is outside a preset LD coefficient range.

3. The method according to claim 1 or 2, characterized in that: The first information includes variance, and determining the second SNP set from the first SNP set according to the first SNP information includes: In the case that there are multiple SNPs with the same variance in the first SNP set, one SNP among the multiple SNPs with the same variance is retained and other SNPs among the multiple SNPs are deleted to obtain the second SNP set.

4. The method according to any one of claims 1 to 3, characterized in that The step of determining the third SNP set from the second SNP set according to the target feature extraction method and the nonlinear feature extraction method comprises: Determine a fourth SNP set from the second SNP set according to the target feature extraction method, wherein the fourth SNP set includes K SNPs, where K is a positive integer, and K is less than M and greater than H; A third SNP set is determined from the fourth SNP set according to the non-linear feature extraction method.

5. The method according to claim 4, characterized in that Determining a fourth SNP set from the second SNP set according to the target feature extraction method comprises: Eliminate SNPs from the second SNP set according to the target feature extraction method; When the determination coefficient of the remaining SNPs in the second SNP set is greater than the first threshold or the first remaining ratio is less than the first ratio threshold, the remaining SNPs in the second SNP set are determined as the fourth SNP set, and the first remaining ratio is the ratio of the number of remaining SNPs in the second SNP set to M.

6. The method according to claim 4 or 5, characterized in that: The determining the third SNP set from the fourth SNP set according to the nonlinear feature extraction method comprises: Eliminate SNPs from the fourth SNP set according to the nonlinear feature extraction method; When the determination coefficient of the remaining SNPs in the fourth SNP set is greater than the second threshold or the second remaining ratio is less than the second ratio threshold, the remaining SNPs in the fourth SNP set are determined as the third SNP set, and the second remaining ratio is the ratio of the number of remaining SNPs in the fourth SNP set to M.

7. A data processing device, characterized in that: The device comprises a transceiver unit and a processing unit; The transceiver unit is used to obtain a first SNP set, where the first SNP set includes N SNPs, where N is a positive integer; The processing unit is used to determine a second SNP set from the first SNP set according to first information of SNPs, wherein the first information includes at least one of linkage disequilibrium information or variance, and the second SNP set includes M SNPs, wherein M is a positive integer and is less than N; The processing unit is also used to determine a third SNP set from the second SNP set according to a target feature extraction method and a nonlinear feature extraction method, the target feature extraction method includes at least one of a filtering feature extraction method, a wrapping feature extraction method or an embedded feature extraction method, and the third SNP set includes H SNPs, where H is a positive integer and is less than M.

8. The device according to claim 7, characterized in that The first information includes linkage disequilibrium information, and the linkage disequilibrium information includes a linkage disequilibrium LD coefficient. The processing unit is specifically used for: According to the LD coefficient of the SNP, a target SNP is deleted from the first SNP set to obtain the second SNP set, wherein the target SNP is a SNP whose LD coefficient is outside a preset LD coefficient range.

9. The device according to claim 7 or 8, characterized in that The first information includes variance, and the processing unit is specifically configured to: In the case that there are multiple SNPs with the same variance in the first SNP set, one SNP among the multiple SNPs with the same variance is retained and other SNPs among the multiple SNPs are deleted to obtain the second SNP set.

10. The device according to any one of claims 7 to 9, characterized in that The processing unit is specifically used for: Determine a fourth SNP set from the second SNP set according to the target feature extraction method, wherein the fourth SNP set includes K SNPs, where K is a positive integer, and K is less than M and greater than H; A third SNP set is determined from the fourth SNP set according to the non-linear feature extraction method.

11. The device according to claim 10, characterized in that The processing unit is specifically used for: Eliminate SNPs from the second SNP set according to the target feature extraction method; When the determination coefficient of the remaining SNPs in the second SNP set is greater than the first threshold or the first remaining ratio is less than the first ratio threshold, the remaining SNPs in the second SNP set are determined as the fourth SNP set, and the first remaining ratio is the ratio of the number of remaining SNPs in the second SNP set to M.

12. The device according to claim 10 or 11, characterized in that The processing unit is specifically used for: Eliminate SNPs from the fourth SNP set according to the nonlinear feature extraction method; When the determination coefficient of the remaining SNPs in the fourth SNP set is greater than the second threshold or the second remaining ratio is less than the second ratio threshold, the remaining SNPs in the fourth SNP set are determined as the third SNP set, and the second remaining ratio is the ratio of the number of remaining SNPs in the fourth SNP set to M.

13. A data processing device, comprising at least one processor and a memory, characterized in that: The at least one processor executes a program or instruction stored in the memory, so that the data processing device implements the method according to any one of claims 1 to 6.

14. A computer-readable storage medium for storing a computer program, characterized in that: When the computer program is executed on a computer or a processor, the computer or the processor is enabled to implement the method according to any one of claims 1 to 6.

15. A computer program product, comprising instructions, characterized in that: When the instructions are executed on a computer or a processor, the computer or the processor is enabled to implement the method according to any one of claims 1 to 6.

16. A chip comprising at least one processor and a memory, characterized in that: The at least one processor executes a program or instruction stored in the memory, so that the data processing device implements the method according to any one of claims 1 to 6.

Images