A screening and analysis method based on multi-dimensional big data
Through the multi-dimensional big data screening and analysis method, the scientific data retrieval formula is converted into a matrix and the multi-dimensional unitary matrix is used for matching, which solves the problem of limited search efficiency and accuracy of traditional scientific databases, and achieves efficient and accurate scientific data matching.
Patent Information
- Application Number
- CN202410911581.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-09
- Publication Date
- 2024-11-15
- Estimated Expiration
- 2044-07-09
AI Technical Summary
The efficiency and accuracy of traditional scientific database search methods are limited. How to reduce the complexity of scientific data retrieval and improve its matching accuracy.
Using multi-dimensional big data screening and analysis method, by converting the scientific data search formula into a matrix expression structure, using multi-dimensional unitary matrix for extended operations and internal product calculations, the matching scientific data search formula is determined from the scientific data search library, achieving efficient match.
Regardless of the search formula entered by the user, the corresponding results can be retrieved accurately, reducing the search complexity and improving the matching accuracy, and avoiding the inefficiency of search due to multiple inputs.
Smart Images

Figure CN118467573B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of scientific data processing, and in particular to a method for screening and analyzing multi-dimensional big data. Background Art
[0002] With the development of information technology, scientific databases are increasingly used in various fields. However, traditional scientific database retrieval methods often rely on user-entered search formulas, which greatly limits the efficiency and accuracy of this method. In order to solve this problem, scholars have proposed many improved retrieval techniques in recent years to improve the retrieval efficiency and accuracy of scientific databases. In order to improve retrieval efficiency, researchers have proposed various indexing technologies. For example, B-tree index, B+ tree index, hash index, etc. These indexing technologies enable scientific data to be retrieved faster by preprocessing and sorting scientific data. In addition, there are some emerging indexing technologies, such as inverted index, Bloom filter, etc., which have shown excellent performance in different application scenarios.
[0003] However, its essence still depends on the search formula itself. Therefore, how to reduce the complexity of scientific data retrieval and improve the accuracy of scientific data matching is a hot topic in current research. Summary of the invention
[0004] The embodiment of the present application provides a multi-dimensional big data screening and analysis method, which is used to reduce the complexity of scientific data retrieval while improving the accuracy of scientific data matching.
[0005] In order to achieve the above purpose, this application adopts the following technical solutions:
[0006] In a first aspect, a method for screening and analyzing multi-dimensional big data is provided, which is applied to an electronic device, and the method includes: step S1: in response to a user's search operation, the electronic device obtains a scientific data search formula to be analyzed; step S2: the electronic device determines a scientific data search formula matching the scientific data search formula to be analyzed from a scientific data search formula library through multi-dimensional scientific data matching, and the scientific data search formula in the scientific data search formula library is a search formula with corresponding scientific data search results; step S3: the electronic device outputs the scientific data search result corresponding to the matched scientific data search formula, or in response to a user's rejection operation, the electronic device returns to iteratively execute step S2, outputs the scientific data search result or iterates to a preset number of times.
[0007] In a possible design scheme, the electronic device determines a scientific data retrieval formula matching the scientific data retrieval formula to be analyzed from a scientific data retrieval formula library through multi-dimensional scientific data matching, including: the electronic device converts the scientific data retrieval formula to be analyzed in a scientific data expression structure into a scientific data matrix to be analyzed in a matrix expression structure; the electronic device performs multi-dimensional scientific data matching on the scientific data matrix to be analyzed, and determines a scientific data matrix matching the scientific data matrix to be analyzed from the scientific data retrieval formula library, and the scientific data expression structure of the matching scientific data matrix in the matrix expression structure is the matching scientific data retrieval formula.
[0008] Optionally, the scientific data matrix to be analyzed is a base matrix composed of 0 and 1, and the electronic device performs multi-dimensional scientific data matching on the scientific data matrix to be analyzed, and determines a scientific data matrix that matches the scientific data matrix to be analyzed from a scientific data retrieval formula library, including: the electronic device uses a multi-dimensional unitary matrix to perform an expansion operation on the scientific data matrix to be analyzed to obtain a multi-dimensional scientific data matrix to be analyzed; the electronic device determines the inner product of each column in the multi-dimensional scientific data matrix to be analyzed and each column of the scientific data matrix in the scientific data retrieval formula library, and determines the scientific data matrix of the sum of the inner products in the scientific data retrieval formula library as the matching scientific data matrix.
[0009] Optionally, the multidimensional unitary matrix is a multidimensional DFT matrix, and the dimension of the multidimensional DFT matrix is positively correlated with the number of times step S2 is executed in rotation;
[0010] The multi-dimensional unitary matrix is a 3D DFT matrix, which is expressed as follows: ;
[0011] Alternatively, a multi-dimensional unitary matrix is a 4-dimensional DFT matrix, which is represented as follows: .
[0012] Optionally, using a multidimensional unitary matrix to perform an expansion operation on the scientific data matrix to be analyzed means: through the multidimensional unitary matrix, each column of the scientific data matrix to be analyzed is expanded to the same number of columns as the multidimensional unitary matrix, that is, the number of columns of the multidimensional scientific data matrix to be analyzed is the product of the number of columns of the multidimensional unitary matrix and the scientific data matrix to be analyzed.
[0013] Optionally, the multi-dimensional scientific data matrix to be analyzed is The kth scientific data matrix in the scientific data retrieval database is , k is a positive integer, and the inner product of the i-th column in the multi-dimensional scientific data matrix to be analyzed and the j-th column in the k-th scientific data matrix is , i is an integer from 1 to N, j is an integer from 1 to P k integer;
[0014] On this basis, the sum of the inner products of the multi-dimensional scientific data matrix to be analyzed and the k-th scientific data matrix is: .
[0015] Optionally, the electronic device converts the scientific data retrieval formula to be analyzed in a scientific data expression structure into a scientific data matrix to be analyzed in a matrix expression structure, including: the electronic device performs one-hot encoding on the scientific data retrieval formula to be analyzed to obtain a string expression of the scientific data retrieval formula to be analyzed consisting of 0 and 1, and the length of the string expression is L; the electronic device cuts the string expression into Z segments according to a preset value M, and constructs each segment in the Z segments as a column of the matrix to obtain the scientific data matrix to be analyzed, where Z is round(L / M), and round() means rounding up; wherein, if the length of the last segment in the Z segments is less than M when cut, the electronic device fills the length of the last segment to M by filling 0 / 1 at the end of the last segment.
[0016] Furthermore, the electronic device cuts the string expression into Z segments according to a preset value M, and constructs each segment in the Z segments as a column of a matrix to obtain a scientific data matrix to be analyzed, including: the electronic device cuts the string expression into Z segments according to a preset value M; the electronic device determines whether there are repeated segments with the same value in the Z segments; if there are no repeated segments with the same value in the Z segments, the electronic device constructs each segment in the Z segments as a column of a matrix to obtain a scientific data matrix to be analyzed, and the scientific data matrix to be analyzed is or, if there are repeated segments with the same value in segment X in segment Z, the electronic device deletes segment X from segment Z to obtain segment ZX, and constructs each segment in segment ZX as a column of the matrix to obtain the scientific data matrix to be analyzed. The scientific data matrix to be analyzed is The matrix of .
[0017] In one possible design scheme, the scientific data retrieval results include at least one of the following: earth science scientific data, microbiology scientific data, genomics scientific data, chemistry scientific data, zoology scientific data, agricultural science data, space science data, basic medical science data, botany scientific data, ecology scientific data, forestry science data, physics scientific data, or astronomy scientific data.
[0018] In a second aspect, a device for screening and analyzing multi-dimensional big scientific data is provided, which is applied to an electronic device, and the device is configured as follows: Step S1: In response to a user's search operation, the electronic device obtains a scientific data search formula to be analyzed; Step S2: The electronic device determines a scientific data search formula that matches the scientific data search formula to be analyzed from a scientific data search formula library through multi-dimensional scientific data matching, and the scientific data search formula in the scientific data search formula library is a search formula with corresponding scientific data search results; Step S3: The electronic device outputs the scientific data search result corresponding to the matched scientific data search formula, or in response to a user's rejection operation, the electronic device returns to iteratively execute step S2, outputs the scientific data search result, or iterates to a preset number of times.
[0019] In a possible design scheme, the electronic device determines a scientific data retrieval formula matching the scientific data retrieval formula to be analyzed from a scientific data retrieval formula library through multi-dimensional scientific data matching, including: the electronic device converts the scientific data retrieval formula to be analyzed in a scientific data expression structure into a scientific data matrix to be analyzed in a matrix expression structure; the electronic device performs multi-dimensional scientific data matching on the scientific data matrix to be analyzed, and determines a scientific data matrix matching the scientific data matrix to be analyzed from the scientific data retrieval formula library, and the scientific data expression structure of the matching scientific data matrix in the matrix expression structure is the matching scientific data retrieval formula.
[0020] Optionally, the scientific data matrix to be analyzed is a base matrix composed of 0 and 1, and the electronic device performs multi-dimensional scientific data matching on the scientific data matrix to be analyzed, and determines a scientific data matrix that matches the scientific data matrix to be analyzed from a scientific data retrieval formula library, including: the electronic device uses a multi-dimensional unitary matrix to perform an expansion operation on the scientific data matrix to be analyzed to obtain a multi-dimensional scientific data matrix to be analyzed; the electronic device determines the inner product of each column in the multi-dimensional scientific data matrix to be analyzed and each column of the scientific data matrix in the scientific data retrieval formula library, and determines the scientific data matrix of the sum of the inner products in the scientific data retrieval formula library as the matching scientific data matrix.
[0021] Optionally, the multidimensional unitary matrix is a multidimensional DFT matrix, and the dimension of the multidimensional DFT matrix is positively correlated with the number of times step S2 is executed in rotation;
[0022] The multi-dimensional unitary matrix is a 3D DFT matrix, which is expressed as follows: ;
[0023] Alternatively, a multidimensional unitary matrix is a 4-dimensional DFT matrix, j is an imaginary unit, q For 2,4 dimensional DFT matrix is expressed as follows: .
[0024] Optionally, using a multidimensional unitary matrix to perform an expansion operation on the scientific data matrix to be analyzed means: through the multidimensional unitary matrix, each column of the scientific data matrix to be analyzed is expanded to the same number of columns as the multidimensional unitary matrix, that is, the number of columns of the multidimensional scientific data matrix to be analyzed is the product of the number of columns of the multidimensional unitary matrix and the scientific data matrix to be analyzed.
[0025] Optionally, the multi-dimensional scientific data matrix to be analyzed is The kth scientific data matrix in the scientific data retrieval database is , k is a positive integer, and the inner product of the i-th column in the multi-dimensional scientific data matrix to be analyzed and the j-th column in the k-th scientific data matrix is , i is an integer from 1 to N, j is an integer from 1 to P k integer;
[0026] On this basis, the sum of the inner products of the multi-dimensional scientific data matrix to be analyzed and the k-th scientific data matrix is: .
[0027] Optionally, the electronic device converts the scientific data retrieval formula to be analyzed in a scientific data expression structure into a scientific data matrix to be analyzed in a matrix expression structure, including: the electronic device performs one-hot encoding on the scientific data retrieval formula to be analyzed to obtain a string expression of the scientific data retrieval formula to be analyzed consisting of 0 and 1, and the length of the string expression is L; the electronic device cuts the string expression into Z segments according to a preset value M, and constructs each segment in the Z segments as a column of the matrix to obtain the scientific data matrix to be analyzed, where Z is round(L / M), and round() means rounding up; wherein, if the length of the last segment in the Z segments is less than M when cut, the electronic device fills the length of the last segment to M by filling 0 / 1 at the end of the last segment.
[0028] Furthermore, the electronic device cuts the string expression into Z segments according to a preset value M, and constructs each segment in the Z segments as a column of a matrix to obtain a scientific data matrix to be analyzed, including: the electronic device cuts the string expression into Z segments according to a preset value M; the electronic device determines whether there are repeated segments with the same value in the Z segments; if there are no repeated segments with the same value in the Z segments, the electronic device constructs each segment in the Z segments as a column of a matrix to obtain a scientific data matrix to be analyzed, and the scientific data matrix to be analyzed is or, if there are repeated segments with the same value in segment X in segment Z, the electronic device deletes segment X from segment Z to obtain segment ZX, and constructs each segment in segment ZX as a column of the matrix to obtain the scientific data matrix to be analyzed. The scientific data matrix to be analyzed is The matrix of .
[0029] In one possible design scheme, the scientific data retrieval results include at least one of the following: earth science scientific data, microbiology scientific data, genomics scientific data, chemistry scientific data, zoology scientific data, agricultural science data, space science data, basic medical science data, botany scientific data, ecology scientific data, forestry science data, physics scientific data, or astronomy scientific data.
[0030] In a third aspect, a computer-readable storage medium is provided, comprising: a computer program or instructions; when the computer program or instructions are executed on a computer, the computer is caused to execute the method described in the first aspect.
[0031] In summary, the above method and system have the following technical effects:
[0032] On the one hand, through multi-dimensional scientific data matching, a scientific data search formula that matches the scientific data search formula to be analyzed is determined from the scientific data search formula library. At this time, since the scientific data search formula in the scientific data search formula library is a search formula with corresponding scientific data search results, it can be avoided that the corresponding results cannot be retrieved due to the mismatch / inaccuracy / incorrect structure of the search formula entered by the user, that is, no matter how the user enters, the corresponding search results can be obtained. On the other hand, by iteratively executing step S2, the user can enter the search formula once to perform multiple different searches. On the basis of increasing the probability that the output result is the result required by the user, it can also avoid the low search efficiency caused by multiple input of the search formula. In general, it reduces the complexity of scientific data retrieval while improving the accuracy of scientific data matching. BRIEF DESCRIPTION OF THE DRAWINGS
[0033] Figure 1 A schematic diagram of a process for a multi-dimensional big data screening and analysis method provided in an embodiment of the present application;
[0034] Figure 2 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0035] The technical solution in this application will be described below in conjunction with the accompanying drawings.
[0036] The present application will present various aspects, embodiments or features around a system that may include multiple devices, components, modules, etc. It should be understood and appreciated that each system may include additional devices, components, modules, etc., and / or may not include all of the devices, components, modules, etc. discussed in conjunction with the figures. In addition, combinations of these schemes may also be used.
[0037] In addition, in the embodiments of the present application, words such as "exemplary" and "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "exemplary" in the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of the word "exemplary" is intended to present concepts in a concrete way.
[0038] In the embodiments of the present application, "information", "signal", "message", "channel" and "signaling" can sometimes be used interchangeably. It should be noted that when the distinction between them is not emphasized, the meanings they intend to express are matched. "of", "corresponding, relevant" and "corresponding" can sometimes be used interchangeably. It should be noted that when the distinction between them is not emphasized, the meanings they intend to express are matched. In addition, the " / " mentioned in the present application can be used to express an "or" relationship.
[0039] The network architecture and business scenarios described in the embodiments of the present application are intended to more clearly illustrate the technical solutions of the embodiments of the present application, and do not constitute a limitation on the technical solutions provided in the embodiments of the present application. A person of ordinary skill in the art can appreciate that with the evolution of the network architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.
[0040] For example, Figure 1 The present application provides a flowchart of a multi-dimensional big data screening and analysis method. The method can be applied to the interaction of electronic devices.
[0041] like Figure 1 As shown, the process of the multi-dimensional big data screening and analysis method is as follows:
[0042] S101, in response to a search operation by a user, the electronic device obtains a scientific data search formula to be analyzed.
[0043] For example, a user may perform an input operation on an input interface of an electronic device to input a corresponding search formula, for example, an example of an input interface may be shown at: https: / / www.casdc.cn / . The scientific data search formula to be analyzed may be composed of characters, phrases, short sentences, numbers, etc. in text (such as Chinese and English), and the specific method is not limited.
[0044] S102, the electronic device determines a scientific data search formula that matches the scientific data search formula to be analyzed from a scientific data search formula library through multi-dimensional scientific data matching, where the scientific data search formula in the scientific data search formula library is a search formula that has a corresponding scientific data search result.
[0045] In a possible design solution, the electronic device can convert the scientific data retrieval formula to be analyzed in a scientific data expression structure into a scientific data matrix to be analyzed in a matrix expression structure.
[0046] For example, the electronic device can perform unique hot encoding on the scientific data search expression to be analyzed to obtain a string expression of the scientific data search expression to be analyzed consisting of 0 and 1, and the length of the string expression is L, or L bits. Exemplarily, the string expression is: 1110001011000101010011. The electronic device can truncate the string expression into Z segments according to the preset value of M, and construct each segment in the Z segments as a column of the matrix to obtain the scientific data matrix to be analyzed, where Z is round(L / M), and round() means rounding up; wherein, if the length of the last segment in the Z segments is less than M when truncated, the electronic device can fill the length of the last segment to M by filling 0 / 1 at the end of the last segment. Continuing the above example, set M=6, and a total of 4 segments are truncated, namely 111000, 101100, 010001, and 0011. The last segment has only 4 bits, so it is filled with 11 to obtain 001111. The resulting matrix is as follows: .
[0047] Optionally, the electronic device cuts the string expression into Z segments according to a preset value M, and constructs each segment in the Z segments as a column of a matrix to obtain a scientific data matrix to be analyzed, including: the electronic device cuts the string expression into Z segments according to a preset value M; the electronic device determines whether there are repeated segments with the same value in the Z segments; if there are no repeated segments with the same value in the Z segments, the electronic device constructs each segment in the Z segments as a column of a matrix to obtain a scientific data matrix to be analyzed, and the scientific data matrix to be analyzed is or, if there are repeated segments with the same value in segment X in segment Z, the electronic device deletes segment X from segment Z to obtain segment ZX, and constructs each segment in segment ZX as a column of the matrix to obtain the scientific data matrix to be analyzed. The scientific data matrix to be analyzed is The advantage of this is that it can reduce redundant information, improve subsequent matching efficiency, and reduce the computing power overhead caused by matching.
[0048] The electronic device can perform multi-dimensional scientific data matching on the scientific data matrix to be analyzed, and determine the scientific data matrix that matches the scientific data matrix to be analyzed from the scientific data retrieval formula library, and the scientific data expression structure of the scientific data matrix that matches the matrix expression structure is the matching scientific data retrieval formula. For example, the scientific data matrix to be analyzed is a base matrix composed of 0 and 1, and the electronic device performs multi-dimensional scientific data matching on the scientific data matrix to be analyzed, and determines the scientific data matrix that matches the scientific data matrix to be analyzed from the scientific data retrieval formula library, including: the electronic device can use a multi-dimensional unitary matrix to perform an expansion operation on the scientific data matrix to be analyzed to obtain a multi-dimensional scientific data matrix to be analyzed; the electronic device can determine the inner product of each column in the multi-dimensional scientific data matrix to be analyzed and each column of the scientific data matrix in the scientific data retrieval formula library, and determine the scientific data matrix of the sum of the inner products in the scientific data retrieval formula library as the matching scientific data matrix.
[0049] Optionally, the multi-dimensional unitary matrix is a multi-dimensional DFT matrix, and the dimension of the multi-dimensional DFT matrix is positively correlated with the number of times step S2 is executed in rotation.
[0050] The multi-dimensional unitary matrix is a 3D DFT matrix, which is expressed as follows: ;
[0051] Alternatively, a multi-dimensional unitary matrix is a 4-dimensional DFT matrix, which is represented as follows: .
[0052] Optionally, using a multidimensional unitary matrix to perform an expansion operation on the scientific data matrix to be analyzed means: through the multidimensional unitary matrix, each column of the scientific data matrix to be analyzed is expanded to the same number of columns as the multidimensional unitary matrix, that is, the number of columns of the multidimensional scientific data matrix to be analyzed is the product of the number of columns of the multidimensional unitary matrix and the number of columns of the scientific data matrix to be analyzed. Continuing with the above example, taking the above 3D DFT matrix as an example, "1" is expanded through the row vector according to the row of the multidimensional DFT matrix from top to bottom, and "0" is expanded through the zero vector, then the expansion operation ( ) can be as follows: can be as follows: = It can be understood that by extending the operation, the original matrix can be upgraded to a higher degree of precision in matching, so that the subsequent calculation of the sum of inner products can be more accurate. For example, without upgrading the dimension, there can be 10 identical matrices with the smallest sum, but after upgrading the dimension, there may be only 1-2, with higher matching precision and more accurate results. In addition, the reason for using a multi-dimensional unitary matrix, such as a multi-dimensional DFT matrix, is that the phase of the matrix is introduced while upgrading the dimension, so that the columns of different matrices will be identical, orthogonal, non-orthogonal, quasi-orthogonal, etc. due to different phases, so that the orthogonal relationship can be calculated through the inner product, thereby reflecting the similarity between the columns, so that the similarity of the matrix can be more accurately reflected through the sum of the inner products in the case of upgrading the dimension, that is, the text similarity of the search formula.
[0053] Optionally, the multi-dimensional scientific data matrix to be analyzed is The kth scientific data matrix in the scientific data retrieval database is , k is a positive integer, and the inner product of the i-th column in the multi-dimensional scientific data matrix to be analyzed and the j-th column in the k-th scientific data matrix is , i is an integer from 1 to N, j is an integer from 1 to P k integer;
[0054] On this basis, the sum of the inner products of the multi-dimensional scientific data matrix to be analyzed and the k-th scientific data matrix is: .
[0055] S103: The electronic device outputs the scientific data search result corresponding to the matching scientific data search formula, or in response to a rejection operation by the user, the electronic device returns to the iterative execution step S2 to output the scientific data search result or iterate to a preset number of times.
[0056] The scientific data search results include at least one of the following: earth science data, microbiology data, genomics data, chemistry data, zoology data, agriculture data, space data, basic medical data, botany data, ecology data, forestry data, physics data, or astronomy data. The user's rejection operation means that the user believes that the currently output scientific data search results cannot meet his needs, so he operates it to search again. At this time, the user does not need to enter the search formula again.
[0057] Optionally, when returning to iteratively execute step S2, the dimension of the multidimensional unitary matrix, that is, the number of columns, is incremented by 1 or 2, without any specific limitation.
[0058] In summary: On the one hand, through multi-dimensional scientific data matching, a scientific data search formula that matches the scientific data search formula to be analyzed is determined from the scientific data search formula library. At this time, since the scientific data search formula in the scientific data search formula library is a search formula with corresponding scientific data search results, it can be avoided that the corresponding results cannot be retrieved due to the mismatch / inaccuracy / incorrect structure of the search formula entered by the user, that is, no matter how the user enters, the corresponding search results can be obtained. On the other hand, by iteratively executing step S2, the user can enter the search formula once to perform multiple different searches. On the basis of increasing the probability that the output result is the result required by the user, it can also avoid the low retrieval efficiency caused by multiple input of the search formula. In general, it reduces the complexity of scientific data retrieval while improving the accuracy of scientific data matching.
[0059] Combination of the above Figure 1 The multi-dimensional big data screening and analysis method provided by the embodiment of the present application is described in detail. The following is a detailed description of the multi-dimensional big scientific data screening and analysis device for executing the multi-dimensional big data screening and analysis method provided by the embodiment of the present application.
[0060] The device for screening and analyzing multi-dimensional big scientific data is applied to an electronic device, and the device is configured as follows: Step S1: In response to a user's search operation, the electronic device obtains a scientific data search formula to be analyzed; Step S2: The electronic device determines a scientific data search formula that matches the scientific data search formula to be analyzed from a scientific data search formula library through multi-dimensional scientific data matching, and the scientific data search formula in the scientific data search formula library is a search formula with a corresponding scientific data search result; Step S3: The electronic device outputs the scientific data search result corresponding to the matched scientific data search formula, or in response to a user's rejection operation, the electronic device returns to iteratively execute step S2, outputs the scientific data search result, or iterates to a preset number of times.
[0061] In a possible design scheme, the electronic device determines a scientific data retrieval formula matching the scientific data retrieval formula to be analyzed from a scientific data retrieval formula library through multi-dimensional scientific data matching, including: the electronic device converts the scientific data retrieval formula to be analyzed in a scientific data expression structure into a scientific data matrix to be analyzed in a matrix expression structure; the electronic device performs multi-dimensional scientific data matching on the scientific data matrix to be analyzed, and determines a scientific data matrix matching the scientific data matrix to be analyzed from the scientific data retrieval formula library, and the scientific data expression structure of the matching scientific data matrix in the matrix expression structure is the matching scientific data retrieval formula.
[0062] Optionally, the scientific data matrix to be analyzed is a base matrix composed of 0 and 1, and the electronic device performs multi-dimensional scientific data matching on the scientific data matrix to be analyzed, and determines a scientific data matrix that matches the scientific data matrix to be analyzed from a scientific data retrieval formula library, including: the electronic device uses a multi-dimensional unitary matrix to perform an expansion operation on the scientific data matrix to be analyzed to obtain a multi-dimensional scientific data matrix to be analyzed; the electronic device determines the inner product of each column in the multi-dimensional scientific data matrix to be analyzed and each column of the scientific data matrix in the scientific data retrieval formula library, and determines the scientific data matrix of the sum of the inner products in the scientific data retrieval formula library as the matching scientific data matrix.
[0063] Optionally, the multidimensional unitary matrix is a multidimensional DFT matrix, and the dimension of the multidimensional DFT matrix is positively correlated with the number of times step S2 is executed in rotation;
[0064] The multi-dimensional unitary matrix is a 3D DFT matrix, which is expressed as follows: ;
[0065] Alternatively, a multidimensional unitary matrix is a 4-dimensional DFT matrix, j is an imaginary unit, q For 2,4 dimensional DFT matrix is expressed as follows: .
[0066] Optionally, using a multidimensional unitary matrix to perform an expansion operation on the scientific data matrix to be analyzed means: through the multidimensional unitary matrix, each column of the scientific data matrix to be analyzed is expanded to the same number of columns as the multidimensional unitary matrix, that is, the number of columns of the multidimensional scientific data matrix to be analyzed is the product of the number of columns of the multidimensional unitary matrix and the scientific data matrix to be analyzed.
[0067] Optionally, the multi-dimensional scientific data matrix to be analyzed is The kth scientific data matrix in the scientific data retrieval database is , k is a positive integer, and the inner product of the i-th column in the multi-dimensional scientific data matrix to be analyzed and the j-th column in the k-th scientific data matrix is , i is an integer from 1 to N, j is an integer from 1 to P k integer;
[0068] On this basis, the sum of the inner products of the multi-dimensional scientific data matrix to be analyzed and the k-th scientific data matrix is: .
[0069] Optionally, the electronic device converts the scientific data retrieval formula to be analyzed in a scientific data expression structure into a scientific data matrix to be analyzed in a matrix expression structure, including: the electronic device performs one-hot encoding on the scientific data retrieval formula to be analyzed to obtain a string expression of the scientific data retrieval formula to be analyzed consisting of 0 and 1, and the length of the string expression is L; the electronic device cuts the string expression into Z segments according to a preset value M, and constructs each segment in the Z segments as a column of the matrix to obtain the scientific data matrix to be analyzed, where Z is round(L / M), and round() means rounding up; wherein, if the length of the last segment in the Z segments is less than M when cut, the electronic device fills the length of the last segment to M by filling 0 / 1 at the end of the last segment.
[0070] Furthermore, the electronic device cuts the string expression into Z segments according to a preset value M, and constructs each segment in the Z segments as a column of a matrix to obtain a scientific data matrix to be analyzed, including: the electronic device cuts the string expression into Z segments according to a preset value M; the electronic device determines whether there are repeated segments with the same value in the Z segments; if there are no repeated segments with the same value in the Z segments, the electronic device constructs each segment in the Z segments as a column of a matrix to obtain a scientific data matrix to be analyzed, and the scientific data matrix to be analyzed is or, if there are repeated segments with the same value in segment X in segment Z, the electronic device deletes segment X from segment Z to obtain segment ZX, and constructs each segment in segment ZX as a column of the matrix to obtain the scientific data matrix to be analyzed. The scientific data matrix to be analyzed is The matrix of .
[0071] In one possible design scheme, the scientific data retrieval results include at least one of the following: earth science scientific data, microbiology scientific data, genomics scientific data, chemistry scientific data, zoology scientific data, agricultural science data, space science data, basic medical science data, botany scientific data, ecology scientific data, forestry science data, physics scientific data, or astronomy scientific data.
[0072] Figure 2 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. For example, the electronic device may be a terminal device, or a chip (system) or other component or assembly that can be set in the terminal device. Figure 2 As shown, the electronic device 400 may include a processor 401. Optionally, the electronic device 400 may also include a memory 402 and / or a transceiver 403. The processor 401 is coupled to the memory 402 and the transceiver 403, such as being connected via a communication bus. In addition, the electronic device 400 may also be a chip, such as including the processor 401, in which case the transceiver may be an output and input interface of the chip.
[0073] Combine the following Figure 2 The components of the electronic device 400 are specifically introduced as follows:
[0074] The processor 401 is the control center of the electronic device 400, and may be a processor or a general term for multiple processing elements. For example, the processor 401 is one or more central processing units (CPUs), or may be application specific integrated circuits (ASICs), or may be one or more integrated circuits configured to implement the embodiments of the present application, such as one or more microprocessors (digital signal processors, DSPs), or one or more field programmable gate arrays (FPGAs).
[0075] Optionally, the processor 401 can execute various functions of the electronic device 400 by running or executing the software program stored in the memory 402 and calling the scientific data stored in the memory 402, such as executing the above Figure 1 The shown method is based on multi-dimensional big data screening and analysis.
[0076] In a specific implementation, as an embodiment, the processor 401 may include one or more CPUs, such as Figure 2 CPU0 and CPU1 are shown in FIG.
[0077] In a specific implementation, as an embodiment, the electronic device 400 may also include multiple processors. Each of these processors may be a single-core processor (single-CPU) or a multi-core processor (multi-CPU). The processor here may refer to one or more devices, circuits, and / or processing cores for processing scientific data (such as computer programs or instructions).
[0078] The memory 402 is used to store the software program for executing the solution of the present application, and the execution is controlled by the processor 401. The specific implementation method can refer to the above method embodiment, which will not be repeated here.
[0079] Optionally, the memory 402 may be a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, a random access memory (RAM) or other types of dynamic storage devices that can store information and instructions, or an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compressed optical disc, laser disc, optical disc, digital versatile disc, Blu-ray disc, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store the desired program code in the form of instructions or scientific data structures and can be accessed by a computer, but is not limited thereto. The memory 402 may be integrated with the processor 401, or may exist independently and accessed through the interface circuit ( Figure 2 (not shown) is coupled to the processor 401, which is not specifically limited in this embodiment of the present application.
[0080] The transceiver 403 is used for communication with other electronic devices. For example, if the electronic device 400 is a terminal device, the transceiver 403 can be used to communicate with a network device, or with another terminal device. For another example, if the electronic device 400 is a network device, the transceiver 403 can be used to communicate with a terminal device, or with another network device.
[0081] Optionally, the transceiver 403 may include a receiver and a transmitter ( Figure 2 The receiver is used to implement a receiving function, and the transmitter is used to implement a sending function.
[0082] Optionally, the transceiver 403 may be integrated with the processor 401, or may exist independently and communicate with the electronic device 400 through an interface circuit ( Figure 2 (not shown) is coupled to the processor 401, which is not specifically limited in this embodiment of the present application.
[0083] Understandably, Figure 2 The structure of the electronic device 400 shown in the figure does not constitute a limitation on the electronic device, and the actual electronic device may include more or fewer components than those shown in the figure, or combine certain components, or arrange the components differently.
[0084] In addition, the technical effects of the electronic device 400 can refer to the technical effects of the methods described in the above method embodiments, which will not be repeated here.
[0085] It should be understood that the processor in the embodiments of the present application may be a central processing unit (CPU), and the processor may also be other general-purpose processors, digital signal processors (DSP), application specific integrated circuits (ASIC), field programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.
[0086] It should also be understood that the memory in the embodiments of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of random access memory (RAM) are available, such as static RAM (SRAM), dynamic random access memory (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), and direct rambus RAM (DR RAM).
[0087] The above embodiments can be implemented in whole or in part by software, hardware (such as circuits), firmware or any other combination. When implemented by software, the above embodiments can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions or computer programs. When the computer instructions or computer programs are loaded or executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer program or instruction can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer program or instruction can be transmitted from one website, computer, server or scientific data center to another website, computer, server or scientific data center by wired (such as infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a scientific data storage device such as a server, scientific data center, etc. that contains one or more available media sets. The available medium can be a magnetic medium (for example, a floppy disk, a hard disk, a tape), an optical medium (for example, a DVD), or a semiconductor medium. The semiconductor medium can be a solid-state hard disk.
[0088] It should be understood that the term "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. A and B can be singular or plural. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship, but it may also indicate an "and / or" relationship. Please refer to the context for specific understanding.
[0089] In this application, "at least one" means one or more, and "plurality" means two or more. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b, or c can mean: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or multiple.
[0090] It should be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.
[0091] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.
[0092] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.
[0093] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0094] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0095] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
[0096] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk, and other media that can store program codes.
[0097] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
Claims
1. A screening and analysis method based on multi-dimensional big data, characterized in that: Applied to electronic equipment, the method comprises: Step S1: In response to a search operation by a user, the electronic device obtains a scientific data search formula to be analyzed; Step S2: the electronic device determines a scientific data search formula matching the scientific data search formula to be analyzed from a scientific data search formula library through multi-dimensional scientific data matching, wherein the scientific data search formula in the scientific data search formula library is a search formula having a corresponding scientific data search result; Step S3: the electronic device outputs the scientific data search result corresponding to the matched scientific data search formula, or in response to a rejection operation by the user, the electronic device returns to iteratively execute the step S2, outputs the scientific data search result or iterates to a preset number of times; The electronic device determines a scientific data search formula matching the scientific data search formula to be analyzed from a scientific data search formula library through multi-dimensional scientific data matching, including: The electronic device converts the scientific data retrieval formula to be analyzed in a scientific data expression structure into a scientific data matrix to be analyzed in a matrix expression structure; The electronic device performs multi-dimensional scientific data matching on the scientific data matrix to be analyzed, and determines a scientific data matrix that matches the scientific data matrix to be analyzed from the scientific data search formula library, and the scientific data expression structure of the matched scientific data matrix of the matrix expression structure is the matched scientific data search formula; The scientific data matrix to be analyzed is a base matrix composed of 0 and 1, and the electronic device performs multi-dimensional scientific data matching on the scientific data matrix to be analyzed, and determines a scientific data matrix matching the scientific data matrix to be analyzed from the scientific data search formula library, including: The electronic device uses a multi-dimensional unitary matrix to perform an expansion operation on the scientific data matrix to be analyzed to obtain a multi-dimensional scientific data matrix to be analyzed; The electronic device determines the inner product of each column in the multi-dimensional scientific data matrix to be analyzed and each column in the scientific data matrix in the scientific data search formula library, and determines the scientific data matrix of the sum of the inner products in the scientific data search formula library as the matched scientific data matrix; The multidimensional unitary matrix is the multidimensional DFT matrix, and the dimension of the multidimensional DFT matrix is positively correlated with the number of times the step S2 is executed in rotation; The multi-dimensional unitary matrix is a 3-dimensional DFT matrix, and the 3-dimensional DFT matrix is expressed as follows: ; Alternatively, the multi-dimensional unitary matrix is a 4-dimensional DFT matrix, and the 4-dimensional DFT matrix is expressed as follows: ; Using a multidimensional unitary matrix to perform an expansion operation on the scientific data matrix to be analyzed means: through the multidimensional unitary matrix, each column of the scientific data matrix to be analyzed is expanded to the same number of columns as the multidimensional unitary matrix, that is, the number of columns of the multidimensional scientific data matrix to be analyzed is the product of the number of columns of the multidimensional unitary matrix and the scientific data matrix to be analyzed.
2. The method according to claim 1, characterized in that The multi-dimensional scientific data matrix to be analyzed is The kth scientific data matrix in the scientific data retrieval database is , k is a positive integer, and the inner product of the i-th column in the multi-dimensional scientific data matrix to be analyzed and the j-th column in the k-th scientific data matrix is , i is an integer from 1 to N, j is an integer from 1 to P k integer; The sum of the inner products of the multi-dimensional scientific data matrix to be analyzed and the k-th scientific data matrix is: .
3. The method according to claim 1, characterized in that The electronic device converts the scientific data retrieval formula to be analyzed in a scientific data expression structure into a scientific data matrix to be analyzed in a matrix expression structure, including: The electronic device performs one-hot encoding on the scientific data search expression to be analyzed to obtain a string expression consisting of 0s and 1s for the scientific data search expression to be analyzed, wherein the length of the string expression is L; The electronic device cuts the string expression into Z segments according to a preset value of M, and constructs each segment in the Z segments as a column of a matrix to obtain the scientific data matrix to be analyzed, where Z is round(L / M), and round() represents rounding up; wherein, if the length of the last segment in the Z segments is less than M when cut, the electronic device fills the length of the last segment to M by filling 0 / 1 at the end of the last segment.
4. The method according to claim 3, characterized in that: The electronic device cuts the string expression into Z segments according to a preset value M, and constructs each segment of the Z segments as a column of a matrix, to obtain the scientific data matrix to be analyzed, including: The electronic device cuts the string expression into the Z segments according to the preset value M; The electronic device determines whether there are repeated segments with the same value in the Z segment; If there is no repeated segment with the same value in the Z segment, the electronic device constructs each segment in the Z segment as a column of a matrix to obtain the scientific data matrix to be analyzed. The scientific data matrix to be analyzed is or, if there are X repeated segments with the same value in the Z segment, the electronic device deletes the X segment from the Z segment to obtain a ZX segment, and constructs each segment in the ZX segment as a column of a matrix to obtain the scientific data matrix to be analyzed, and the scientific data matrix to be analyzed is The matrix of .
5. The method according to claim 1, characterized in that The scientific data search results include at least one of the following: earth science scientific data, microbiology scientific data, genomics scientific data, chemistry scientific data, zoology scientific data, agricultural science data, space science scientific data, basic medical science data, botany scientific data, ecology scientific data, forestry scientific data, physics scientific data, or astronomy scientific data.
6. A screening and analysis device based on multi-dimensional big scientific data, characterized in that: Applied to an electronic device, the device is used to perform the method according to any one of claims 1 to 5, and the device is configured to: Step S1: In response to a search operation by a user, the electronic device obtains a scientific data search formula to be analyzed; Step S2: the electronic device determines a scientific data search formula matching the scientific data search formula to be analyzed from a scientific data search formula library through multi-dimensional scientific data matching, wherein the scientific data search formula in the scientific data search formula library is a search formula having a corresponding scientific data search result; Step S3: the electronic device outputs the scientific data search result corresponding to the matched scientific data search formula, or in response to a user's rejection operation, the electronic device returns to iteratively execute step S2, outputs the scientific data search result or iterates to a preset number of times.
Citation Information
Patent Citations
Search method, search set generation method, apparatus, medium, terminal and server
CN109344336A
Medical data processing method and device, storage medium and electronic equipment
CN109597827A
Session quality evaluation method and device and electronic equipment
CN111382264A
Robot customer service automatic reply method and system based on user portrait
CN118035426A
Method for querying long-form speech
WO2020041098A1
