Civil aircraft system safety development capability maturity evaluation method and device

Abstract

The invention belongs to the technical field of civil aircraft safety evaluation, and provides a civil aircraft system safety development capability maturity evaluation method and device, and the method comprises the steps: searching a keyword in a civil aircraft standard file, and determining an evaluation index related to safety evaluation; dividing capability domains for the evaluation indexes, and scoring the maturity of the evaluation indexes in each capability domain; and determining a comprehensive maturity score according to the score of each capability domain. According to the method, the evaluation index for safety evaluation is determined by searching the keyword in the civil aircraft standard file, then the evaluation index is divided into the multiple capability domains, the comprehensive maturity score is calculated according to the capability domains, a more objective maturity score can be obtained, and the situation that subjective influence is too large is avoided.

Description

Technical Field

[0001] The present invention relates to the technical field of civil aircraft safety assessment, and in particular to a method and device for assessing the maturity of civil aircraft system safety development capability. Background Art

[0002] Safety is the most important feature of civil aircraft. Airworthiness clauses such as CCAR 25.1309 have put forward mandatory requirements for safety design. With the continuous development of the civil aircraft industry, more and more suppliers want to join the civil aircraft industry chain, but the host has strict requirements on the development level of suppliers. "Safety development capability" is an important and key link in evaluating the overall development capability of suppliers. Current development units generally carry out safety design and evaluation work in accordance with industrial standards such as ARP 4754A and ARP 4761, but it is difficult to evaluate the degree of understanding and implementation of the standards.

[0003] Currently, there are many methods to evaluate the supplier's system security development capabilities, mainly from the aspects of development experience, development personnel level, etc., but these methods are relatively simple and cannot be quantified. This will make the evaluation process difficult to control and the subjective influence is too large. The evaluation results are not accurate and it is difficult to truly reflect the unit's system security development capabilities. Summary of the invention

[0004] In view of the defects in the prior art, the present invention provides a method and device for assessing the maturity of the safety development capability of a civil aircraft system, so as to solve the problem that the assessment process of the current safety development capability assessment is difficult to control and the subjective influence is too large, resulting in low accuracy of the assessment results.

[0005] In a first aspect, the present invention provides a method for assessing the maturity of a civil aircraft system safety development capability, comprising:

[0006] Search keywords in civil aircraft standard documents to identify evaluation indicators related to safety assessment;

[0007] Dividing the evaluation indicators into capability domains, and scoring the maturity of the evaluation indicators in each capability domain;

[0008] Based on the scores of each of the capability domains, an overall maturity score is determined.

[0009] It can be seen from the above technical scheme that the present invention provides a civil aircraft system safety development capability maturity assessment method, which determines the evaluation indicators used for safety evaluation by searching for keywords in civil aircraft standard documents, and then divides the evaluation indicators into multiple capability domains, and calculates the comprehensive maturity score according to the capability domains, so as to obtain a more objective maturity score and avoid excessive subjective influence.

[0010] Optionally, searching for keywords in civil aircraft standard documents to determine safety evaluation indicators includes:

[0011] The tf-idf keyword extraction algorithm is used to extract the keywords of civil aircraft system entities from the names and descriptive attribute values ​​of aviation system entities.

[0012] Keywords of similar entities in the civil aircraft system are counted and sorted to obtain high-frequency keywords of industrial standard documents, and the evaluation index vocabulary is constructed using the high-frequency keywords.

[0013] Optionally, the method for dividing the capability domain of the evaluation indicator includes:

[0014] The K-means cluster analysis method is used to perform cluster analysis on the evaluation indicators, and the evaluation indicators are divided into each of the capability domains.

[0015] Optionally, before searching for keywords in the industrial standard documents to determine the evaluation indicators related to the safety evaluation, the method further includes:

[0016] The entity attributes of the civil aircraft standard file are normalized, and the normalized entity attributes include attribute names and attribute values.

[0017] Optionally, the maturity score of the evaluation indicator in the capability domain is determined according to the following formula:

[0018] Where m i is the external environment influencing factor of technology maturity of capability domain i, b i is the technology maturity shape factor of capability domain i, τ i is the technology maturity displacement factor of capability domain i.

[0019] Optionally, the comprehensive maturity score is determined according to the following formula:

[0020] The technology maturity coefficient The numerator is the index y i Technology has to reach its limit The denominator of the unfinished technology maturity range is the completed technology maturity range. is the indicator y i The technical initial value, ω i is the weight of capability domain i;

[0021] Longitudinal offset

[0022] Where α is the preset lateral offset coefficient, is the initial longitudinal offset, is the shape parameter for the comprehensive maturity score, Displacement parameters for overall maturity scoring.

[0023] Optionally, it also includes:

[0024] Determine the development capability level based on the comprehensive maturity score;

[0025] The correspondence between the comprehensive maturity score and the development capability level is: L5-low level (comprehensive maturity score ≥ 0.9), L4-primary level (0.75≤comprehensive maturity score <0.9), L3-intermediate level (0.6≤comprehensive maturity score <0.75), L2-intermediate and advanced level (30%≤comprehensive maturity score <0.6), L1-advanced level (comprehensive maturity score <0.3).

[0026] In a second aspect, the present invention provides a civil aircraft system safety development capability maturity assessment device, comprising:

[0027] The indicator extraction module is used to search for keywords in civil aircraft standard documents and determine the evaluation indicators involved in safety evaluation;

[0028] A capability domain scoring module is used to divide the evaluation indicators into capability domains and score the maturity of the evaluation indicators in each capability domain;

[0029] The comprehensive scoring module is used to determine the comprehensive maturity score according to the scores of each capability domain.

[0030] Optionally, the indicator extraction module is further used to:

[0031] The tf-idf keyword extraction algorithm is used to extract the keywords of civil aircraft system entities from the names and descriptive attribute values ​​of aviation system entities.

[0032] Keywords of similar entities in the civil aircraft system are counted and sorted to obtain high-frequency keywords of industrial standard documents, and the evaluation index vocabulary is constructed using the high-frequency keywords.

[0033] Optionally, the capability domain scoring module is further configured to:

[0034] The K-means cluster analysis method is used to perform cluster analysis on the evaluation indicators, and the evaluation indicators are divided into each of the capability domains.

[0035] Optionally, a normalization processing module is also included, which is specifically used to:

[0036] The entity attributes of the civil aircraft standard file are normalized, and the normalized entity attributes include attribute names and attribute values.

[0037] Optionally, the capability domain scoring module is further configured to determine the maturity score of the evaluation indicator in the capability domain according to the following formula:

[0038] Where m i is the external environment influencing factor of technology maturity of capability domain i, b i is the technology maturity shape factor of capability domain i, τ i is the technology maturity displacement factor of capability domain i.

[0039] Optionally, the comprehensive scoring module is further configured to determine the comprehensive maturity score according to the following formula:

[0040] The technology maturity coefficient The numerator is the index y i Technology has to reach its limit The denominator of the unfinished technology maturity range is the completed technology maturity range. is the indicator y i The technical initial value, ω i is the weight of capability domain i;

[0041] Longitudinal offset

[0042] Where α is the preset lateral offset coefficient, is the initial longitudinal offset, is the shape parameter for the comprehensive maturity score, Displacement parameters for overall maturity scoring.

[0043] Optionally, a level classification module is also included, specifically used for:

[0044] Determine the development capability level based on the comprehensive maturity score;

[0045] The correspondence between the comprehensive maturity score and the development capability level is: L5-low level (comprehensive maturity score ≥ 0.9), L4-primary level (0.75≤comprehensive maturity score <0.9), L3-intermediate level (0.6≤comprehensive maturity score <0.75), L2-intermediate and advanced level (30%≤comprehensive maturity score <0.6), L1-advanced level (comprehensive maturity score <0.3).

[0046] In a third aspect, an embodiment of the present invention provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of any of the above methods when executing the computer program.

[0047] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium having computer program instructions stored thereon, which implement the steps of any of the above methods when executed by a processor.

[0048] By adopting the above technical solution, the present application has the following beneficial effects:

[0049] The civil aircraft system safety development capability maturity assessment method provided by the present invention determines the assessment indicators for safety assessment by searching keywords in civil aircraft standard documents, and then divides the assessment indicators into multiple capability domains, and calculates the comprehensive maturity score according to the capability domains, so as to obtain a more objective maturity score and avoid excessive subjective influence. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] In order to more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the following is a brief introduction to the drawings required for the specific embodiments or the description of the prior art. In all the drawings, similar elements or parts are generally identified by similar reference numerals. In the drawings, the elements or parts are not necessarily drawn according to the actual scale.

[0051] Figure 1 A flowchart of a method for assessing the maturity of a civil aircraft system safety development capability provided by an embodiment of the present invention is shown;

[0052] Figure 2 A structural block diagram of a civil aircraft system safety development capability maturity assessment device provided by an embodiment of the present invention is shown;

[0053] Figure 3 A structural block diagram of an electronic device provided by an embodiment of the present invention is shown. DETAILED DESCRIPTION

[0054] The following embodiments of the technical solution of the present invention are described in detail in conjunction with the accompanying drawings. The following embodiments are only used to more clearly illustrate the technical solution of the present invention, and are therefore only used as examples, and cannot be used to limit the protection scope of the present invention.

[0055] It should be noted that, unless otherwise specified, the technical terms or scientific terms used in this application should have the common meanings understood by those skilled in the art to which the present invention belongs.

[0056] like Figure 1 As shown, this embodiment provides a method for assessing the maturity of a civil aircraft system safety development capability, including:

[0057] S1. Search for keywords in civil aircraft standard documents and determine the evaluation indicators involved in safety assessment.

[0058] S11. Use the tf-idf keyword extraction algorithm to extract the keywords of civil aircraft system entities from the aviation system entity names and descriptive attribute values.

[0059] S12. Count and sort the keywords of similar entities in the civil aircraft system to obtain high-frequency keywords of industrial standard documents, and use the high-frequency keywords to construct an evaluation index vocabulary.

[0060] The tf-idf keyword extraction algorithm is an algorithm that evaluates the importance of keywords in a text. It is divided into two parts: tf and idf. The calculation formula is tf-idf = tf·idf.

[0061] Among them, tf: word frequency = the number of times a word appears in a document / the total number of words in the article, idf: inverse document frequency = log [total number of documents in the corpus / (number of documents containing the word + 1)]. The specific steps include:

[0062] (1) Performing data preprocessing operations such as word segmentation, part-of-speech screening, deduplication, and stop word removal on the documents containing the keywords to be extracted to obtain candidate keywords;

[0063] (2) Calculate the tf-idf value of all candidate keywords;

[0064] (3) Take the keywords with the top N tf-idf values ​​among all candidate keywords as the final keywords of the document.

[0065] After obtaining the final keywords, a vocabulary of evaluation indicators is constructed, and the evaluation indicators are used to obtain maturity scores later. Based on this, evaluation indicators are obtained objectively to ensure the objectivity of security evaluation and avoid excessive subjective influence.

[0066] Before step S1, the method further comprises:

[0067] The entity attributes of the civil aircraft standard file are normalized, and the normalized entity attributes include attribute names and attribute values.

[0068] The diversity of language expressions will result in different descriptions of the same attribute. In order to make the keywords extracted in step S1 meet the standards of the evaluation index, before performing step S1, the system file is standardized to unify the description and avoid extracting different keyword expressions with the same meaning.

[0069] S2. Divide the evaluation indicators into capability domains, and evaluate the scores of the evaluation indicators in each capability domain;

[0070] In this step, the capability domain division of the evaluation indicators is specifically as follows: cluster analysis is performed on the evaluation indicators using the K-means cluster analysis method to divide the evaluation indicators into various capability domains.

[0071] The maturity score of the evaluation indicators in each capability domain is determined according to the following formula:

[0072] Where m i is the external environment influencing factor of technology maturity of capability domain i, b i is the technology maturity shape factor of capability domain i, τ i is the technology maturity displacement factor of capability domain i.

[0073] S3. Determine the maturity score based on the scores of each capability domain.

[0074] After obtaining the technical maturity of each capability domain, the comprehensive maturity score is obtained by combining each capability domain. The comprehensive maturity score is determined according to the following formula:

[0075]

[0076] The technology maturity coefficient The numerator is the index y i Technology has to reach its limit The denominator of the unfinished technology maturity range is the completed technology maturity range. is the indicator y i The technical initial value, ω i is the weight of capability domain i;

[0077] Longitudinal offset

[0078] Where α is the preset lateral offset coefficient, is the initial longitudinal offset, is the shape parameter for the comprehensive maturity score, Displacement parameters for overall maturity scoring.

[0079] Based on the civil aircraft system safety development capability maturity assessment method provided in this embodiment, by searching for keywords in civil aircraft standard documents, the assessment indicators used for safety assessment are determined, and then the assessment indicators are divided into multiple capability domains. The comprehensive maturity score is calculated according to the capability domains, so as to obtain a more objective maturity score and avoid excessive subjective influence.

[0080] In one embodiment, Figure 2 As shown, a civil aircraft system safety development capability maturity assessment device 40 is provided, comprising:

[0081] The index extraction module 401 is used to search for keywords in civil aircraft standard documents to determine evaluation indicators related to safety evaluation;

[0082] A capability domain scoring module 402 is used to divide the evaluation indicators into capability domains and score the maturity of the evaluation indicators in each capability domain;

[0083] The comprehensive scoring module 403 is used to determine a comprehensive maturity score according to the scores of each capability domain.

[0084] Optionally, the indicator extraction module is further used to:

[0085] The tf-idf keyword extraction algorithm is used to extract the keywords of civil aircraft system entities from the names and descriptive attribute values ​​of aviation system entities.

[0086] Keywords of similar entities in the civil aircraft system are counted and sorted to obtain high-frequency keywords of industrial standard documents, and the evaluation index vocabulary is constructed using the high-frequency keywords.

[0087] Optionally, the capability domain scoring module is further configured to:

[0088] The K-means cluster analysis method is used to perform cluster analysis on the evaluation indicators, and the evaluation indicators are divided into each of the capability domains.

[0089] Optionally, a normalization processing module is also included, which is specifically used to:

[0090] The entity attributes of the civil aircraft standard file are normalized, and the normalized entity attributes include attribute names and attribute values.

[0091] Optionally, the capability domain scoring module is further configured to determine the maturity score of the evaluation indicator in the capability domain according to the following formula:

[0092] Where m i is the external environment influencing factor of technology maturity of capability domain i, b i is the technology maturity shape factor of capability domain i, τ i is the technology maturity displacement factor of capability domain i.

[0093] Optionally, the comprehensive scoring module is further configured to determine the comprehensive maturity score according to the following formula:

[0094] The technology maturity coefficient The numerator is the index y i Technology has to reach its limit The denominator of the unfinished technology maturity range is the completed technology maturity range. is the indicator y i The technical initial value, ω i is the weight of capability domain i;

[0095] Longitudinal offset

[0096] Where α is the preset lateral offset coefficient, is the initial longitudinal offset, is the shape parameter for the comprehensive maturity score, Displacement parameters for overall maturity scoring.

[0097] Optionally, a level classification module is also included, specifically used for:

[0098] Determine the development capability level based on the comprehensive maturity score;

[0099] The correspondence between the comprehensive maturity score and the development capability level is: L5-low level (comprehensive maturity score ≥ 0.9), L4-primary level (0.75≤comprehensive maturity score <0.9), L3-intermediate level (0.6≤comprehensive maturity score <0.75), L2-intermediate and advanced level (30%≤comprehensive maturity score <0.6), L1-advanced level (comprehensive maturity score <0.3).

[0100] The civil aircraft system safety development capability maturity assessment device 40 provided in the embodiment of the present application adopts the same inventive concept as the above-mentioned civil aircraft system safety development capability maturity assessment method and can achieve the same beneficial effects, which will not be repeated here.

[0101] Based on the same inventive concept as the above-mentioned civil aircraft system safety development capability maturity assessment method, the present application embodiment also provides an electronic device 50, such as Figure 3 As shown, the electronic device 50 may include a processor 501 and a memory 502 .

[0102] The steps of the method disclosed in the embodiment of the present invention can be directly embodied as being executed by a hardware processor, or being executed by a combination of hardware and software modules in the processor. The memory 502, as a non-volatile computer-readable storage medium, can be used to store non-volatile software programs, non-volatile computer executable programs and modules. The memory is any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited to this. The memory 502 in the embodiment of the present invention can also be a circuit or any other device that can realize a storage function, used to store program instructions and / or data.

[0103] An embodiment of the present invention provides a computer-readable storage medium for storing computer program instructions used by the above-mentioned electronic device, which includes a program for executing the above-mentioned civil aircraft system safety development capability maturity assessment method.

[0104] The above embodiments are only used to introduce the technical solutions of the present application in detail, but the description of the above embodiments is only used to help understand the methods of the embodiments of the present invention and should not be understood as limiting the embodiments of the present invention. Any changes or substitutions that can be easily thought of by technicians in this technical field should be included in the protection scope of the embodiments of the present invention.

Claims

1. A method for assessing the maturity of civil aircraft system safety development capability, characterized in that: include: Search keywords in civil aircraft standard documents to identify evaluation indicators related to safety assessment; Dividing the evaluation indicators into capability domains, and scoring the maturity of the evaluation indicators in each capability domain; Based on the scores of each of the capability domains, an overall maturity score is determined.

2. The method according to claim 1, characterized in that: The searching of keywords in civil aircraft standard documents to determine safety evaluation indicators includes: The tf-idf keyword extraction algorithm is used to extract the keywords of civil aircraft system entities from the names and descriptive attribute values ​​of aviation system entities. Keywords of similar entities in the civil aircraft system are counted and sorted to obtain high-frequency keywords of industrial standard documents, and the evaluation index vocabulary is constructed using the high-frequency keywords.

3. The method according to claim 2, characterized in that The method for dividing the capability domain of the evaluation indicator includes: The K-means cluster analysis method is used to perform cluster analysis on the evaluation indicators, and the evaluation indicators are divided into a plurality of capability domains.

4. The method according to claim 3, characterized in that Before searching for keywords in industrial standard documents to determine evaluation indicators related to safety evaluation, the method further includes: The entity attributes of the civil aircraft standard file are normalized, and the normalized entity attributes include attribute names and attribute values.

5. The method according to claim 4, characterized in that The maturity score of the evaluation indicators in the capability domain is determined according to the following formula: where b i is the maturity score shape parameter of capability domain i, τ i is the maturity score displacement parameter of capability domain i, for y i The maturity limit.

6. The method according to claim 5, characterized in that The overall maturity score is determined according to the following formula: The technology maturity coefficient The numerator is y i To reach its limit The denominator of the unfinished technology maturity range is the completed technology maturity range. is the indicator y i The technical initial value, ω i The weight of the maturity score for capability domain i; Longitudinal offset Where α is the preset lateral offset coefficient, is the initial longitudinal offset, is the shape parameter for the comprehensive maturity score, Displacement parameters for overall maturity scoring.

7. The method according to claim 4, characterized in that Also includes: Determine the development capability level based on the comprehensive maturity score; The correspondence between the comprehensive maturity score and the development capability level is: L1-advanced (the comprehensive maturity score ≥ 0.9), L2-intermediate-advanced (0.75≤the comprehensive maturity score<0.9), L3-intermediate (0.6≤the comprehensive maturity score<0.75), L4-primary (30%≤the comprehensive maturity score<0.6), L5-low (the comprehensive maturity score<0.3).

8. A civil aircraft system safety development capability maturity assessment device, characterized in that: include: The indicator extraction module is used to search for keywords in civil aircraft standard documents and determine the evaluation indicators involved in safety evaluation; A capability domain scoring module is used to divide the evaluation indicators into capability domains and score the maturity of the evaluation indicators in each capability domain; The comprehensive scoring module is used to determine the comprehensive maturity score according to the scores of each capability domain.

Images