Double-sequence alignment tool evaluation method, system and equipment and storage medium

By generating sequencing sequences that obey log-normal distribution characteristics and combining indicators such as running time and memory usage, the systematic and error problems of the dual-sequence comparison and evaluation method are solved, and a comprehensive and accurate evaluation of the performance of the comparison tool is achieved. Select the optimal tool.

CN119068989AActive Publication Date: 2024-12-03YANTAI UNIV
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202411545910.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-11-01
Publication Date
2024-12-03
Estimated Expiration
2044-11-01

AI Technical Summary

Technical Problem

The existing two-sequence alignment evaluation methods lack systematicity and cannot comprehensively and objectively compare the performance of different algorithms. The random sequences used in simulation experiments cannot truly simulate the wrong distribution characteristics of actual sequencing data, resulting in the existence of evaluation results and actual application performance. deviation.

Method used

By judging the existence of the real query sequence, different two-sequence data generation methods are used to generate sequencing sequences that obey the log-normal distribution characteristics, simulate the error distribution of actual sequencing data, form diverse two-sequence data, and run in combination. Time, peak memory usage and accuracy, evaluate the alignment effect of the two-sequence alignment tool.

Benefits of technology

It provides a more accurate and comprehensive way to evaluate the performance of two-sequence alignment tools, which can truly reflect the performance of the tool in different scenarios and help select the optimal alignment tools.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119068989A_ABST
    Figure CN119068989A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of sequence comparison, in particular to a double-sequence comparison tool evaluation method, system and device and a storage medium. In order to solve the technical problem of poor tool evaluation result effect in the prior art, the method comprises the following steps of: when a real query sequence is unknown, generating a sequencing sequence which obeys a logarithmic normal distribution read length characteristic and can really simulate an actual sequencing data error distribution characteristic on the basis of a reference genome so as to form double-sequence data; when the real query sequence is known, determining a reference sequence based on the reference genome and the real query sequence for forming double-sequence data; and finally, inputting the double-sequence data into the double-sequence comparison tool for processing, comprehensively and accurately evaluating the comparison effect of the double-sequence comparison tool in combination with the running time, the peak memory occupation and the accuracy, fairly comparing the performances of different double-sequence comparison tools, and improving the accuracy of the double-sequence comparison tool. And selection of double-sequence alignment tools with optimal performance in respective fields is facilitated.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of sequence comparison, and in particular to a method, system, device and storage medium for evaluating a double sequence alignment tool. Background Art

[0002] Pairwise sequence alignment is one of the basic problems in bioinformatics, which aims to find the similarities between two biological sequences (such as DNA, RNA or protein) to infer their functional, structural or evolutionary connections. Accurate pairwise sequence alignment can help researchers reveal gene functions, identify conserved regions, infer protein structures, and track the evolution of species. Since the accuracy of pairwise sequence alignment results is crucial to subsequent biological analysis, it is particularly necessary to evaluate pairwise sequence alignment methods.

[0003] Through systematic evaluation, researchers can compare the performance of different alignment algorithms, including alignment accuracy, computational speed, and applicability on various sequencing data sets. However, current binary sequence alignment evaluation methods have certain limitations. First, the lack of systematic evaluation tools makes it impossible to comprehensively and objectively compare the performance of different algorithms. Secondly, existing evaluation methods, especially simulation experiments, usually use randomly generated sequences as test data. However, these random sequences often cannot truly simulate the error distribution characteristics of actual sequencing data, resulting in deviations between tool evaluation results and performance in actual applications, reducing the accuracy of binary sequence alignment results. Summary of the invention

[0004] The purpose of the present invention is to provide a method, system, device and storage medium for evaluating a double sequence alignment tool The technical solution of the present invention is as follows: A method for evaluating a double sequence alignment tool comprises the following operations: S1, determine whether there is a real query sequence; if not, execute S2; if so, execute S3; S2, based on the reference genome, lognormal distribution parameters and sequence information error rate, obtain several sequencing sequences and simulation comparison results; extract sequence information of several sequencing sequences respectively to obtain several simulation query sequences; based on the positions and offsets of several simulation query sequences on the reference genome, extract corresponding sequence information on the reference genome respectively to obtain several reference sequences; several simulation query sequences and corresponding reference sequences form dual sequence data, and execute S4; S3, comparing the position, length and sequence information of the real query sequence with the reference genome to obtain a comparison result; based on the comparison result, extracting the corresponding sequence from the reference genome as a reference sequence; the real query sequence and the reference sequence form a double sequence data, and executing S4; S4. Input the dual sequence data into a dual sequence alignment tool for processing to obtain a target alignment result; obtain an evaluation result based on the running time, or / and peak memory usage, or / and accuracy during the processing of the dual sequence alignment tool.

[0005] The accuracy in S4 is the sequence score similarity between the target comparison result and the simulation comparison result, which is ratio A, or ratio B, or ratio C, or is obtained based on ratio A, ratio B and ratio C; ratio A is the ratio of the number of simulation query sequences whose sequence comparison score in the target comparison result is the same as the sequence comparison score of the corresponding sequence in the simulation comparison result to the total number of simulation query sequences; ratio B is the ratio of the number of simulation query sequences whose sum of sequence comparison scores in the target comparison result is greater than the sum of sequence comparison scores of the corresponding sequence in the simulation comparison result to the total number of simulation query sequences; ratio C is the ratio of the number of simulation query sequences whose sum of sequence comparison scores in the target comparison result is less than the sum of sequence comparison scores of the corresponding sequence in the simulation comparison result to the total number of simulation query sequences.

[0006] The sequence alignment scores include: sequence edit distance score, sequence linear gap penalty score, sequence affine gap penalty score, and sequence two-segment affine gap penalty score.

[0007] In S2, the operations for obtaining several sequencing sequences are as follows: inputting the reference genome into the PBSIM3 tool, generating a sequence read length that conforms to the log-normal distribution according to the preset log-normal distribution parameters; based on the sequence read length, controlling the reference genome to generate several initial sequencing sequences that obey the log-normal distribution read length characteristics; then, for each base position in each initial sequencing sequence, assigning insertion, deletion, or substitution errors according to the corresponding base error type preference and the expected probability of base errors, to obtain several sequencing sequences.

[0008] The simulation comparison result in S2 is the comparison processing result of the sequencing sequence and the reference genome in terms of position, length and sequence information.

[0009] A binary sequence alignment tool evaluation system, used to implement the above binary sequence alignment tool evaluation method, comprising: A real query sequence existence judgment module is used to judge whether there is a real query sequence; if not, the first double sequence data generation module is executed; if it exists, the second double sequence data generation module is executed; The first dual sequence data generation module is used to obtain a number of sequencing sequences and simulation comparison results based on the reference genome, lognormal distribution parameters and sequence information error rate; extract sequence information of a number of sequencing sequences respectively to obtain a number of simulation query sequences; based on the positions and offsets of the several simulation query sequences on the reference genome, extract the corresponding sequence information on the reference genome respectively to obtain a number of reference sequences; the several simulation query sequences and the corresponding reference sequences form dual sequence data, and execute the evaluation result generation module; The second dual sequence data generation module is used to compare the position, length and sequence information of the real query sequence with the reference genome to obtain the comparison result; based on the comparison result, the corresponding sequence is extracted from the reference genome as the reference sequence; the real query sequence and the reference sequence form dual sequence data, and the evaluation result generation module is executed; The evaluation result generation module is used to input the dual sequence data into the dual sequence alignment tool for processing to obtain the target alignment result; the evaluation result is obtained based on the running time, or / and peak memory usage, or / and accuracy during the processing of the dual sequence alignment tool.

[0010] A dual sequence alignment tool evaluation device comprises a processor and a memory, wherein the processor implements the above-mentioned dual sequence alignment tool evaluation method when executing a computer program stored in the memory.

[0011] A computer-readable storage medium is used to store a computer program, wherein the computer program implements the above-mentioned double sequence alignment tool evaluation method when executed by a processor.

[0012] The beneficial effects of the present invention are: The present invention provides a method for evaluating a binary sequence alignment tool. First, different binary sequence data generation methods are formulated for situations where a real query sequence is known and unknown, respectively, to construct diversified binary sequence data with different complexities. When the real query sequence is unknown, a sequencing sequence that not only obeys a log-normal distribution read length feature but can also truly simulate the error distribution feature of actual sequencing data is generated based on a reference genome. The binary sequence data thus formed has good quality score non-uniformity and homopolymer error rate, and can better reflect the comparison effect of the binary sequence alignment tool. When the real query sequence is known, a reference sequence is determined based on the comparison result of the reference genome and the real query sequence in position, length and sequence information, and binary sequence data is formed, which can more quickly reflect the comparison effect of the binary sequence alignment tool. Finally, the running time, peak memory usage and accuracy are combined to comprehensively and accurately evaluate the comparison effect of the binary sequence alignment tool, and the performance of different binary sequence alignment tools is fairly compared, which is helpful to select the binary sequence alignment tool with the best performance in their respective fields. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] By reading the detailed description of the preferred embodiment below, the scheme and advantages of the present application will become clear to those skilled in the art. The accompanying drawings are only for the purpose of illustrating the preferred embodiment and are not to be considered as limiting the present invention.

[0014] In the attached picture: Figure 1 In the embodiment, a schematic diagram of the flow of the evaluation method of this embodiment; Figure 2 This is a summary diagram of the running time of different dual sequence alignment tools when processing long-read sequencing data in the embodiment; Figure 3 A summary diagram of peak memory usage of different dual sequence alignment tools when processing long-read sequencing data in the embodiment; Figure 4 This is a summary graph of the accuracy of different dual sequence alignment tools when processing long-read sequencing data in the embodiments. DETAILED DESCRIPTION

[0015] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings.

[0016] This example provides a method for evaluating a binary sequence alignment tool. Figure 1 , including the following operations: S1, determine whether there is a real query sequence; if not, execute S2; if so, execute S3; S2, based on the reference genome, lognormal distribution parameters and sequence information error rate, obtain several sequencing sequences and simulation comparison results; extract sequence information of several sequencing sequences respectively to obtain several simulation query sequences; based on the positions and offsets of several simulation query sequences on the reference genome, extract corresponding sequence information on the reference genome respectively to obtain several reference sequences; several simulation query sequences and corresponding reference sequences form dual sequence data, and execute S4; S3, comparing the position, length and sequence information of the real query sequence with the reference genome to obtain a comparison result; based on the comparison result, extracting the corresponding sequence from the reference genome as a reference sequence; the real query sequence and the reference sequence form a double sequence data, and executing S4; S4. Input the dual sequence data into a dual sequence alignment tool for processing to obtain a target alignment result; obtain an evaluation result based on the running time, or / and peak memory usage, or / and accuracy during the processing of the dual sequence alignment tool.

[0017] S1. Determine whether there is a real query sequence; if not, execute S2; if so, execute S3.

[0018] Different methods for generating dual-sequence data are formulated for the cases where the real query sequence is known and unknown, respectively. This is conducive to building diverse data sets with different complexities, providing comprehensive and rich data support for the evaluation of subsequent tools, and helping to comprehensively detect the comparison capabilities of dual-sequence comparison tools and obtain more accurate tool evaluation results.

[0019] S2. Based on the reference genome, lognormal distribution parameters and sequence information error rate, several sequencing sequences and simulation comparison results are obtained; the sequence information of several sequencing sequences is extracted respectively to obtain several simulation query sequences; based on the positions and offsets of several simulation query sequences on the reference genome, the corresponding sequence information on the reference genome is extracted respectively to obtain several reference sequences; several simulation query sequences and corresponding reference sequences form dual sequence data, and S4 is executed.

[0020] When the true query sequence is unknown, a sequencing sequence is generated based on the reference genome, which not only obeys the log-normal distribution read length characteristics but also has a similar error pattern to the standard sequencing sequence. The sequencing sequence can truly simulate the error distribution characteristics of the actual sequencing data. The dual sequence data thus formed has good quality score unevenness and homopolymer error rate. When used for subsequent dual sequence alignment tool evaluation and processing, it can better reflect the comparison effect of the dual sequence alignment tool.

[0021] First, based on the reference genome, lognormal distribution parameters and sequence information error rate, several sequencing sequences are obtained. Specifically, the reference genome Ref file is first input into the PBSIM3 tool, and a sequence read length that conforms to the lognormal distribution is generated according to the preset lognormal distribution parameters (including position parameters and data distribution discreteness); then, based on the sequence read length, the reference genome is controlled to generate several initial sequencing sequences that obey the lognormal distribution read length characteristics; then, for each base position in each initial sequencing sequence, according to the corresponding base error type preference and the expected probability of base error, insertion, deletion, or substitution errors are assigned, and several sequencing sequences that not only obey the lognormal distribution read length characteristics, but also have similar error patterns with the standard sequencing sequence are obtained, which can better reflect the evaluation performance of the tool for subsequent tool evaluation.

[0022] Then, several sequencing sequences are compared with the sequences at corresponding positions in the reference genome to obtain simulation comparison results. The simulation comparison results are the comparison results of the sequencing sequences and the reference genome in terms of position, length and sequence information.

[0023] Next, the sequence information (base information) of several sequencing sequences is extracted respectively to obtain several simulated query sequences; and based on the positions and offsets of several simulated query sequences on the reference genome (which can be obtained from the simulation comparison results), the corresponding sequence information on the reference genome is extracted respectively to obtain several reference sequences.

[0024] Finally, several simulated query sequences and corresponding reference sequences form binary sequence data, which are used to perform the evaluation operation of the binary sequence alignment tool in S4.

[0025] S3, compare the position, length and sequence information of the real query sequence with the reference genome to obtain a comparison result; based on the comparison result, extract the corresponding sequence from the reference genome as a reference sequence; the real query sequence and the reference sequence form dual sequence data, and execute S4.

[0026] When the true query sequence is known, the reference sequence is determined based on the comparison results of the reference genome and the true query sequence in terms of position, length and sequence information, and dual-sequence data is formed to improve computing efficiency. This is used for subsequent dual-sequence comparison tool evaluation and processing, and can more quickly reflect the comparison effect of the dual-sequence comparison tool.

[0027] S4. Input the dual sequence data into a dual sequence alignment tool for processing to obtain a target alignment result; obtain an evaluation result based on the running time, or / and peak memory usage, or / and accuracy during the processing of the dual sequence alignment tool.

[0028] Evaluating binary sequence alignment tools by combining running time, peak memory usage, and accuracy can not only accurately demonstrate the alignment effect of the binary sequence alignment tools, but also facilitate a comprehensive understanding of the performance of the binary sequence alignment tools in various aspects and a fair comparison of the performance of different binary sequence alignment tools, which helps to select the binary sequence alignment tools with the best performance in their respective fields.

[0029] First, the dual sequence data is input into a dual sequence alignment tool for processing. The dual sequence alignment tool is an existing tool. The dual sequence alignment tool obtains the target alignment result by analyzing and comparing the position, length and sequence information of the reference sequence and the query sequence in the dual sequence data.

[0030] Then, the evaluation results are obtained based on the running time, or / and peak memory usage, or / and accuracy during the processing of the two-sequence alignment tool.

[0031] Specifically, if the actual query sequence is unknown, the evaluation results are obtained based on the running time and peak memory usage during the processing of the two-sequence alignment tool, as well as the accuracy. If the actual query sequence is known, the evaluation results are obtained based on the running time and peak memory usage during the processing of the two-sequence alignment tool.

[0032] The above accuracy is the sequence score similarity between the target comparison result and the simulation comparison result, which is ratio A, or ratio B, or ratio C, or is obtained based on ratio A, ratio B and ratio C (obtained based on weighted processing of ratio A, ratio B and ratio C).

[0033] The ratio A is the ratio of the number of simulated query sequences whose sequence alignment scores in the target alignment result are the same as the sequence alignment scores of the corresponding sequences in the simulated alignment result to the total number of simulated query sequences.

[0034] The ratio B is the ratio of the number of simulated query sequences whose sum of sequence alignment scores in the target alignment result is greater than the sum of sequence alignment scores of the corresponding sequences in the simulated alignment result to the total number of simulated query sequences.

[0035] The ratio C is the ratio of the number of simulated query sequences whose sum of sequence alignment scores in the target alignment result is less than the sum of sequence alignment scores of the corresponding sequences in the simulated alignment result to the total number of simulated query sequences.

[0036] The above sequence alignment scores include: sequence edit distance score, sequence linear gap penalty score, sequence affine gap penalty score, and sequence two-stage affine gap penalty score.

[0037] To facilitate understanding, the following examples are given.

[0038] Cases included in the calculation of the ratio A: If the sequence edit distance score, sequence linear gap penalty score, sequence affine gap penalty score, and sequence two-stage affine gap penalty score between the simulated query sequence q and the reference sequence t in the target alignment result are respectively the same as the sequence edit distance score, sequence linear gap penalty score, sequence affine gap penalty score, and sequence two-stage affine gap penalty score between the sequencing sequence corresponding to the simulated query sequence q in the simulation comparison result and the reference genome, then the simulated query sequence q is included in the calculation of the ratio A as a sequence number.

[0039] Cases included in the calculation of ratio B: If the sum of the sequence edit distance score, sequence linear gap penalty score, sequence affine gap penalty score and sequence two-stage affine gap penalty score between the simulated query sequence q and the reference sequence t in the target comparison result is greater than the sum of the sequence edit distance score, sequence linear gap penalty score, sequence affine gap penalty score and sequence two-stage affine gap penalty score between the sequencing sequence corresponding to the simulated query sequence q in the simulation comparison result and the reference genome, then the simulated query sequence q is included in the calculation of ratio B as a sequence number.

[0040] Cases included in the calculation of the ratio C: If the sum of the sequence edit distance score, sequence linear gap penalty score, sequence affine gap penalty score and sequence two-stage affine gap penalty score between the simulated query sequence q and the reference sequence t in the target comparison result is less than the sum of the sequence edit distance score, sequence linear gap penalty score, sequence affine gap penalty score and sequence two-stage affine gap penalty score between the sequencing sequence corresponding to the simulated query sequence q in the simulation comparison result and the reference genome, then the simulated query sequence q is included in the calculation of the ratio C as a sequence number.

[0041] Finally, the evaluation results are output in JSON format for subsequent visual analysis. Specifically, the running time, peak memory usage, and accuracy are output as evaluation results.

[0042] In order to verify the effect of the evaluation method of this embodiment, the following experiment was conducted.

[0043] Experiment 1: The purpose is to evaluate the running time of different tools when processing long-read sequencing data. In the experiment, two-sequence data with a sequence length of 100bp and an error rate (sequence information error rate) of 5%, 10%, 15% and 20% were generated, and four existing advanced methods - edlib tool, bitpal tool, ksw2 tool and wfa2 tool were selected as two-sequence alignment tools. The experimental results can be found in Figure 2 It can be found that the bitpal tool takes the least running time, has the fastest running speed, and performs best, making it suitable for use in scenarios that require fast processing of large amounts of data.

[0044] Experiment 2: The purpose is to evaluate the peak memory usage of different tools when processing long-read sequencing data. In the experiment, two-sequence data with a sequence length of 100bp and an error rate of 5%, 10%, 15% and 20% were generated, and four existing advanced methods - edlib tool, bitpal tool, ksw2 tool and wfa2 tool were selected as two-sequence alignment tools. The experimental results can be found in Figure 3 , it can be found that the bitpal tool has the smallest peak memory usage and the best performance, which is suitable for use in scenarios with strict space requirements.

[0045] Experiment 3: The purpose is to evaluate the accuracy of different tools when processing long-read sequencing data. In the experiment, two-sequence data with a sequence length of 100bp and an error rate of 5% were generated, and four existing advanced methods - edlib tool, bitpal tool, ksw2 tool and wfa2 tool were selected as two-sequence alignment tools. The experimental results can be found in Figure 4 ( Figure 4A, B, and C represent ratio A, ratio B, and ratio C respectively. It can be found that the ratio A of the edlib tool and the bitpal tool is relatively high, showing a preference for accuracy, which is suitable for use in scenarios with strict space requirements.

[0046] This embodiment also provides a dual sequence alignment tool evaluation system, which is used to implement the above dual sequence alignment tool evaluation method, including: A real query sequence existence judgment module is used to judge whether there is a real query sequence; if not, the first double sequence data generation module is executed; if it exists, the second double sequence data generation module is executed; The first dual sequence data generation module is used to obtain a number of sequencing sequences and simulation comparison results based on the reference genome, lognormal distribution parameters and sequence information error rate; extract sequence information of a number of sequencing sequences respectively to obtain a number of simulation query sequences; based on the positions and offsets of the several simulation query sequences on the reference genome, extract the corresponding sequence information on the reference genome respectively to obtain a number of reference sequences; the several simulation query sequences and the corresponding reference sequences form dual sequence data, and execute the evaluation result generation module; The second dual sequence data generation module is used to compare the position, length and sequence information of the real query sequence with the reference genome to obtain the comparison result; based on the comparison result, the corresponding sequence is extracted from the reference genome as the reference sequence; the real query sequence and the reference sequence form dual sequence data, and the evaluation result generation module is executed; An evaluation result generation module is used to input the binary sequence data into the binary sequence alignment tool for processing to obtain a target alignment result; and obtain an evaluation result based on the running time, or / and peak memory usage, or / and accuracy during the processing of the binary sequence alignment tool; Data visualization module, used to visualize evaluation results, supports multiple file formats (including SVG, PNG, PDF).

[0047] Among them, the data visualization module includes a bar chart display submodule, a line chart display submodule and a box plot display submodule.

[0048] The bar graph display submodule is used to display the performance of different pairwise alignment tools in terms of running time, peak memory usage, and accuracy under fixed set sequence length and error rate. The horizontal axis of each bar graph is a different pairwise alignment tool, and the vertical axis is the indicator value, which makes the comparison between different tools clear at a glance.

[0049] The line graph display submodule is used to display the performance changes of different binary sequence alignment tools under different parameter settings in a line graph. Through the line graph, you can observe how the alignment accuracy or running time of different tools changes when the error rate, sequence length or other parameters change.

[0050] The box plot display submodule is used to display the performance distribution of different binary sequence alignment tools on multiple test data using box plots. It is suitable for analyzing the distribution of peak memory usage and running time.

[0051] This embodiment also provides a dual sequence alignment tool evaluation device, including a processor and a memory, wherein the processor implements the above-mentioned dual sequence alignment tool evaluation method when executing a computer program stored in the memory.

[0052] This embodiment also provides a computer-readable storage medium for storing a computer program, wherein the computer program implements the above-mentioned dual sequence alignment tool evaluation method when executed by a processor.

[0053] The present embodiment provides a method for evaluating a binary sequence alignment tool. First, different binary sequence data generation methods are formulated for the cases where the real query sequence is known and unknown, respectively, to construct diversified binary sequence data with different complexities. When the real query sequence is unknown, a sequencing sequence that not only obeys the log-normal distribution read length characteristics but also can truly simulate the error distribution characteristics of the actual sequencing data is generated based on the reference genome. The binary sequence data thus formed has good quality score unevenness and homopolymer error rate, and can better reflect the comparison effect of the binary sequence alignment tool. When the real query sequence is known, the reference sequence is determined based on the comparison results of the reference genome and the real query sequence in terms of position, length and sequence information, and the binary sequence data is formed, which can more quickly reflect the comparison effect of the binary sequence alignment tool. Finally, the running time, peak memory usage and accuracy are combined to comprehensively and accurately evaluate the comparison effect of the binary sequence alignment tool, and the performance of different binary sequence alignment tools is fairly compared, which is helpful to select the binary sequence alignment tool with the best performance in their respective fields.

Claims

1. A method for evaluating a binary sequence alignment tool, characterized in that: The following operations are included: S1, determine whether there is a real query sequence; if not, execute S2; if so, execute S3; S2. Based on the reference genome, lognormal distribution parameters and sequence information error rate, several sequencing sequences and simulation comparison results are obtained; Sequence information of several sequencing sequences is extracted respectively to obtain several simulated query sequences; based on the positions and offsets of the several simulated query sequences on the reference genome, corresponding sequence information on the reference genome is extracted respectively to obtain several reference sequences; The plurality of simulated query sequences and the corresponding reference sequences form dual sequence data, and S4 is executed; S3, comparing the position, length and sequence information of the real query sequence with the reference genome to obtain a comparison result; based on the comparison result, extracting the corresponding sequence from the reference genome as a reference sequence; the real query sequence and the reference sequence form a binary sequence data, and executing S4; S4, inputting the dual sequence data into a dual sequence alignment tool for processing to obtain a target alignment result; The evaluation results are obtained based on the running time, peak memory usage, and / or accuracy of the binary sequence alignment tool during processing.

2. The method for evaluating a double sequence alignment tool according to claim 1, characterized in that: In S4, the accuracy is the sequence score similarity between the target comparison result and the simulation comparison result, which is ratio A, ratio B, or ratio C, or is obtained based on ratio A, ratio B and ratio C; The ratio A is the ratio of the number of simulated query sequences whose sequence alignment scores in the target alignment result are the same as the sequence alignment scores of the corresponding sequences in the simulated alignment result to the total number of simulated query sequences; The ratio B is the ratio of the number of simulated query sequences whose sum of sequence alignment scores in the target alignment result is greater than the sum of sequence alignment scores of the corresponding sequences in the simulated alignment result to the total number of simulated query sequences; The ratio C is the ratio of the number of simulated query sequences whose sum of sequence alignment scores in the target alignment result is less than the sum of sequence alignment scores of the corresponding sequences in the simulated alignment result to the total number of simulated query sequences.

3. The method for evaluating a double sequence alignment tool according to claim 2, characterized in that: The sequence alignment scores include: sequence edit distance score, sequence linear gap penalty score, sequence affine gap penalty score, and sequence two-stage affine gap penalty score.

4. The method for evaluating a double sequence alignment tool according to claim 1, characterized in that: In S2, the operation of obtaining a plurality of sequencing sequences is specifically as follows: The reference genome is input into the PBSIM3 tool, and a sequence read length that conforms to the log-normal distribution is generated according to the preset log-normal distribution parameters; based on the sequence read length, the reference genome is controlled to generate several initial sequencing sequences that obey the log-normal distribution read length characteristics; then, for each base position in each initial sequencing sequence, insertion, deletion, or substitution errors are assigned according to the corresponding base error type preference and the expected probability of base errors, to obtain several sequencing sequences.

5. The method for evaluating a double sequence alignment tool according to claim 1, characterized in that: The simulation comparison result in S2 is the comparison processing result of the sequencing sequence and the reference genome in terms of position, length and sequence information.

6. A binary sequence alignment tool evaluation system, used to implement the binary sequence alignment tool evaluation method according to claim 1, characterized in that: include: A real query sequence existence judgment module is used to judge whether there is a real query sequence; If it does not exist, execute the first double sequence data generation module; If it exists, execute the second dual sequence data generation module; The first dual-sequence data generation module is used to obtain a number of sequencing sequences and simulation comparison results based on the reference genome, lognormal distribution parameters and sequence information error rate; extract sequence information of a number of sequencing sequences respectively to obtain a number of simulation query sequences; based on the positions and offsets of the several simulation query sequences on the reference genome, extract the corresponding sequence information on the reference genome respectively to obtain a number of reference sequences; the several simulation query sequences and the corresponding reference sequences form dual-sequence data, and execute the evaluation result generation module; The second dual-sequence data generation module is used to compare the position, length and sequence information of the real query sequence with the reference genome to obtain a comparison result; based on the comparison result, the corresponding sequence is extracted from the reference genome as a reference sequence; the real query sequence and the reference sequence form dual-sequence data, and the evaluation result generation module is executed; The evaluation result generation module is used to input the binary sequence data into the binary sequence comparison tool for processing to obtain the target comparison result; The evaluation results are obtained based on the running time, peak memory usage, and / or accuracy of the binary sequence alignment tool during processing.

7. A dual sequence alignment tool evaluation device, characterized in that: The method comprises a processor and a memory, wherein the processor implements the method for evaluating a double sequence alignment tool as described in any one of claims 1 to 5 when executing a computer program stored in the memory.

8. A computer-readable storage medium, characterized in that: Used to store a computer program, wherein when the computer program is executed by a processor, the method for evaluating a dual sequence alignment tool according to any one of claims 1 to 5 is implemented.

Citation Information

Patent Citations

  • Method, device and terminal for detecting genome variations

    CN109074429A

  • Base sequencing quality evaluation method

    CN116434843A

  • Quality evaluation method, device and equipment for long-read-length gene sequencing data and medium

    CN118692565A

  • Method, device and terminal for detecting genome variations

    WO2017181368A1