Method for constructing effectiveness verification architecture of capability evaluation index system based on grammar and semantic pragmatic

Through the three-level verification architecture of grammatical semantic pragmatism, the shortcomings in the effectiveness verification of the equipment system combat capability evaluation index system are solved, the scientificity and adaptability of the evaluation results are improved, and cross-field cooperation is promoted.

CN118940741APending Publication Date: 2024-11-12DALIAN UNIV OF TECH
View PDF 0 Cites 2 Cited by

Patent Information

Application Number
CN202411065206.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-05
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

The existing technology lacks methods to verify the effectiveness of the equipment system's combat capability evaluation index system, which makes it difficult to guarantee the scientificity, comprehensiveness and objectivity of the evaluation results.

Method used

A validity verification architecture of the ability evaluation index system based on grammatical semantic and pragmatic use is proposed. By establishing a three-level information model and verification mechanism model, including verification of grammatical information, semantic information and pragmatic information, we ensure the standardization and logic of the index system. Relationship and performance rationality.

Benefits of technology

It has enhanced the scientificity and accuracy of the evaluation index system, improved the integrity and adaptability of the evaluation system, promoted cooperation among multiple parties, and improved the reliability and breadth of application of evaluation results.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118940741A_ABST
    Figure CN118940741A_ABST
Patent Text Reader

Abstract

The invention provides a grammar semantic pragmatic-based capability evaluation index system validity verification architecture construction method, and relates to the technical field of equipment system test identification, and the method comprises the following steps: S1, building a three-level information model for evaluating index system validity; s2, establishing a three-level verification mechanism model for evaluating the effectiveness of the index system based on the three-level information model; and S3, introducing non-functional index verification of the index system into the three-level verification mechanism model to obtain an effectiveness verification architecture of the evaluation index system. According to the method, through detailed three-level verification, the correctness and reasonability of the evaluation index system in the aspects of structure, logic relation and performance can be ensured. The scientific verification process is beneficial to eliminating errors and ambiguity in evaluation and improving the reliability and accuracy of evaluation results.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of equipment system test and identification, and in particular to a method for constructing a validity verification framework of a capability evaluation index system based on grammar, semantics and pragmatics. Background Art

[0002] The evaluation of equipment system combat capability is a hot and difficult issue in the current domestic and international combat and equipment construction fields. A complete evaluation index system that fully reflects the characteristics of the equipment system is the basis and necessary condition for the evaluation of the equipment system combat capability. Only by ensuring the effectiveness of the evaluation index system for the evaluation target can the scientificity, comprehensiveness and objectivity of the evaluation results of the equipment system combat capability be ensured. However, most of the current literature only focuses on the establishment of the index system and the construction of the evaluation model, and lacks research on the effectiveness of the evaluation index system. Therefore, studying the effectiveness verification method of the equipment system combat capability evaluation index system has strong theoretical significance and practical application value.

[0003] Equipment system personnel form an equipment system combat capability evaluation index system by decomposing the equipment system's mission and tasks. On the surface, after the general evaluation indicators are decomposed and allocated, they can basically guarantee the correctness of "grammar", but it is difficult to guarantee whether there is a conflict in the "semantics" of various indicators and whether they can achieve the best "pragmatics". Therefore, whether the established equipment system combat capability evaluation index system is effective needs to be verified, but there are few literatures on this. In summary, a method to verify the effectiveness of the evaluation index system needs to be invented. Summary of the invention

[0004] In view of this, the purpose of the present invention is to propose a method for constructing a validity verification framework for an ability evaluation index system based on grammar, semantics and pragmatics, so as to solve the technical problem that the existing methods do not verify the validity of the evaluation index system.

[0005] The technical means adopted by the present invention are as follows:

[0006] A method for constructing a validity verification framework for a grammatical, semantic and pragmatic competence evaluation index system includes the following steps:

[0007] S1. Establish a three-level information model for evaluating the effectiveness of the indicator system;

[0008] S2. Establish a three-level verification mechanism model for the effectiveness of the evaluation index system based on the three-level information model;

[0009] S3. Introduce non-functional indicator verification of the indicator system into the three-level verification mechanism model to obtain the effectiveness verification framework of the evaluation indicator system.

[0010] Furthermore, the three-level information model includes grammatical information, semantic information and pragmatic information of the evaluation index system;

[0011] The grammatical information is information contained or provided by the external form of the evaluation index system; the grammatical information corresponds to the evaluation index, the relationship between the indexes and the attributes of the evaluation index system;

[0012] The semantic information is the logical meaning of each indicator of the evaluation indicator system after combination; the semantic information corresponds to the logical relationship formed by the evaluation indicators and their mutual relationship;

[0013] The pragmatic information refers to the tasks and functions that can be completed by the evaluation index system, reflecting the performance of the evaluation index system and the evaluation effectiveness ultimately achieved. The pragmatic information corresponds to the performance and effectiveness possessed or provided by the evaluation index system as a whole.

[0014] Furthermore, the verification steps of the three-level verification mechanism model include:

[0015] S21, performing grammatical verification on the grammatical information;

[0016] S22, after the syntax verification is correct, semantic verification is performed on the semantic information;

[0017] S23. After the grammatical verification and semantic verification are correct, pragmatic verification is performed on the pragmatic information.

[0018] Furthermore, the grammar verification checks and verifies the standardization and grammar rules of the evaluation index system;

[0019] The verification types of the grammar verification include indicator text error verification, indicator terminology standard verification, data reference verification, and graphic symbol standard verification.

[0020] The verification contents of the syntax verification include indicator design integrity check verification, indicator application correctness check verification, indicator alignment analysis and indicator consistency analysis.

[0021] Furthermore, the syntax verification comprises the following steps:

[0022] S211. Locate and find out the possible grammatical description errors in the system structure or evaluation indicators of the equipment system combat capability evaluation indicator system;

[0023] S212, identifying and determining whether the evaluation indicator and its structural description are grammatically incorrect;

[0024] S213: Classify: classify the confirmed grammatical errors.

[0025] Furthermore, the semantic verification checks whether the semantic information formed by the evaluation indicators and their relationships is correct and complete, whether it complies with semantic rules, and whether there are any contradictory, conflicting and unreasonable contents.

[0026] Furthermore, the semantic verification comprises the following steps:

[0027] S221. Verify the correlation errors of evaluation indicators at different levels in the construction of the equipment system combat capability evaluation indicator system;

[0028] S222. Verify the logical correctness of evaluation indicators at different levels, focusing on checking whether the subordinate relationships between evaluation indicators at different levels are correct and reasonable;

[0029] S223. Verify the logical rationality of evaluation indicators at different levels, focusing on checking whether the descriptive semantic rules formed by evaluation indicators at different levels are correct and reasonable, and whether the data admission status of the evaluation indicators is reachable.

[0030] Furthermore, the pragmatic verification checks the effectiveness of the equipment system combat capability evaluation index system, and analyzes whether the constructed equipment system combat capability evaluation index system meets the design requirements and satisfies various evaluation demand indicators.

[0031] Furthermore, the pragmatic verification comprises the following steps:

[0032] S231. Conduct performance verification and evaluation of the pragmatic information of the evaluation index system to verify whether the performance indicators of the evaluation index system can meet the performance indicators of the designed equipment system combat capability evaluation requirements and the degree to which the requirements are met;

[0033] S232, conduct effectiveness verification and evaluation of the pragmatic information of the evaluation index system to verify whether the effectiveness indicators of the evaluation index system can reach the designed evaluation requirement effectiveness indicators and the degree to which the requirements are met;

[0034] S233. Comprehensively verify and evaluate the satisfaction of the pragmatic information of the evaluation index system, and comprehensively evaluate the functional and non-functional indicators of the evaluation index system to determine whether the evaluation index system meets the initial requirements of the system combat capability evaluation, and whether it meets the needs of equipment system combat use, equipment system configuration and other business activities.

[0035] Furthermore, the validation steps of the effectiveness validation framework of the evaluation index system include:

[0036] S31. Validation of the effectiveness based on pragmatic indicators;

[0037] Pragmatic level indicators include indicator system performance, indicator system effectiveness and comprehensive satisfaction of needs;

[0038] S32, completeness and correctness verification based on grammatical and semantic layer indicators;

[0039] The indicators at the grammatical and semantic level include the standardization of indicator design, the logical rationality of indicators and their relationships, the completeness of indicators, and the consistency of indicators;

[0040] S33, non-functional indicator verification of the indicator system;

[0041] Non-functional indicators are indicators related to the non-functional characteristics of the evaluation indicator system. Non-functional indicators include the complexity of the evaluation process, the reliability of the conclusions, the risk of the conclusions, the total cost of the task and the scalability of the system for the evaluation indicator system.

[0042] Compared with the prior art, the present invention has the following advantages:

[0043] Enhance the scientificity and accuracy of the evaluation index system: Through meticulous three-level verification (grammar, semantics, pragmatics), the correctness and rationality of the evaluation index system in terms of structure, logical relationship and performance can be ensured. Such a scientific verification process helps to eliminate errors and ambiguities in the evaluation and improve the reliability and accuracy of the evaluation results.

[0044] Comprehensively improve the integrity of the evaluation system: This method emphasizes the review and adjustment of every detail of the indicator system during the evaluation process to ensure that information at every level is fully considered and integrated. This helps to build an evaluation system that comprehensively covers all necessary functions and tasks, thereby enhancing the breadth and depth of the system's application.

[0045] Improve adaptability and flexibility: Through continuous verification and feedback loops, the evaluation system can continuously optimize and adjust itself to adapt to new needs and conditions. This dynamic adaptation mechanism enables the evaluation system to continue to effectively serve the development and changes of the equipment system.

[0046] Enhance cooperation and communication among multiple stakeholders: This verification method involves the joint participation of equipment developers, combat commanders and military experts, which helps promote cross-domain exchanges and cooperation, thereby improving the comprehensiveness and practicality of the evaluation system. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0048] Figure 1 It is a three-level information model diagram for the effectiveness of the evaluation index system of the present invention.

[0049] Figure 2 It is a three-level verification mechanism model diagram for the effectiveness of the evaluation index system of the present invention.

[0050] Figure 3 This is a diagram of the effectiveness verification architecture of the evaluation index system of the present invention. DETAILED DESCRIPTION

[0051] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0052] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0053] The present invention provides a method for constructing a validity verification framework of a capability evaluation index system based on grammar, semantics and pragmatics, comprising the following steps:

[0054] S1. Establish a three-level information model for evaluating the effectiveness of the indicator system;

[0055] As an important part of the equipment system combat capability evaluation process, the effectiveness verification of the evaluation index system is the preliminary confirmation of the results of the system combat capability evaluation and analysis. Its fundamental purpose is to ensure that the evaluation conclusion of the equipment system combat capability is valid. It is necessary to verify the accuracy of the evaluation index system and the consistency between the realized evaluation conclusion and the effectiveness of the index system. In fact, the implementation of the index system effectiveness verification activity is very difficult, because the index system effectiveness and the evaluation conclusion system do not exist physically and objectively, and it is difficult to determine whether the functions and performance of the evaluation conclusion meet the requirements. Usually, the index system effectiveness verification work is carried out with a prototype that can reflect most of the core functions and performance of the evaluation conclusion (the prototype refers to a model that imitates the evaluation conclusion) as a reference.

[0056] The process of verifying the effectiveness of the equipment system combat capability evaluation index system is actually a process of continuous feedback, review and circulation of the index system construction. If the description of any layer of index information does not meet the requirements, it will affect the effectiveness of the evaluation index system. Therefore, it is necessary to ensure that the grammatical information, semantic information and pragmatic information of the evaluation index system effectiveness are fully verified from the process. Since the materialization of the effectiveness of the equipment system combat capability evaluation index system is the formatted and standardized index system construction process, its content covers a wide range. At present, the research on the effectiveness verification of the combat capability evaluation index system at home and abroad has not formed a complete effectiveness verification system. Based on the fact that the effectiveness of the equipment system combat capability evaluation index system is an information mechanism composed of three levels: grammar, semantics and pragmatics, this paper proposes a process model for the effectiveness verification of the equipment system combat capability evaluation index system based on the three levels of grammatical information, semantic information and pragmatics information. Among them, the grammatical information of the equipment system combat capability evaluation index system refers to the information contained or provided by the external expression of the evaluation index system, which is the most abstract expression of the evaluation data; the semantic information of the evaluation index system refers to the logical meaning of each indicator of the evaluation index system after combination, such as the structure and decomposition relationship of the index system, the information flow relationship between indicators, the activity or function operation process and time sequence relationship of indicator mapping, etc.; the pragmatic information of the evaluation index system refers to the tasks and functions that the evaluation index system can complete, reflecting the performance of the evaluation index system and the evaluation effectiveness ultimately achieved.

[0057] The grammatical information, semantic information and pragmatic information of the equipment system combat capability evaluation index system are the information on the three levels of effectiveness of the evaluation index system. The effectiveness of the evaluation index system is the combination of the three levels of information. The effectiveness information model of the equipment system combat capability evaluation index system can be constructed as follows: Figure 1 shown.

[0058] Figure 1 The grammatical information of the equipment system combat capability evaluation index system corresponds to the evaluation index system's evaluation indexes, the relationship between the indexes, and their attributes; the semantic information corresponds to the evaluation indexes and the logical relationship formed by their mutual relationships; the pragmatic information corresponds to the performance and effectiveness possessed or provided by the evaluation index system as a whole. Obviously, the grammatical information of the equipment system combat capability evaluation index system is the most direct content in the index system construction or design activities, and is also the most direct form of expression of the evaluation index data. The semantic information and pragmatic information are the information implied in the grammatical information, which belongs to the information at the logical level. Of course, if the grammatical information of the equipment system combat capability evaluation index system is different, the semantic information and pragmatic information implied in the evaluation index system will also be different.

[0059] S2. Establish a three-level verification mechanism model for the effectiveness of the evaluation index system based on the three-level information model;

[0060] The mission function of the equipment system combat capability evaluation index system is expressed through grammatical information, semantic information and pragmatic information. The current problems in the construction or design of the evaluation index system, such as non-standard design, inconsistent data, and failure to meet the actual needs of system capability evaluation, are essentially design problems of the grammatical layer, semantic layer and pragmatic layer of the evaluation index system.

[0061] in accordance with Figure 1 In the information model shown, the grammatical information verification of the equipment system combat capability evaluation index system is the most basic verification, which mainly checks whether the grammar of the equipment system combat capability evaluation index is correct, verifies the completeness and consistency of the evaluation data, etc.; semantic verification is based on the correctness of the grammar of the evaluation index system, and verifies whether the logical relationship between the equipment system combat capability evaluation indexes is correct and reasonable; pragmatic verification is based on grammatical and semantic verification, and mainly analyzes the performance and effectiveness of the equipment system combat capability evaluation index system, and checks whether the effectiveness of the evaluation index system meets the requirements and the degree to which it meets the requirements. Based on the above information model and information verification mechanism, a three-level equipment system combat capability evaluation index system effectiveness verification mechanism model is established, such as Figure 2 As shown, this is a gradual process.

[0062] S21. Syntactic verification of the effectiveness of the evaluation index system;

[0063] The grammatical verification of the effectiveness of the equipment system combat capability evaluation index system mainly verifies the standardization and grammatical rules of the evaluation index system. The main verification types include indicator text error verification, indicator terminology standard verification, data reference verification, graphic symbol standard verification, etc. The main verification contents include indicator design integrity check verification, indicator application correctness check verification, indicator alignment analysis and indicator consistency analysis.

[0064] Among them, the indicator design integrity check and verification mainly checks whether the user has completed all the necessary construction or design content. The first is the combat capability, combat applicability and system contribution rate required by the construction of the system combat capability evaluation indicator system, and the second is whether the specific content of the combat capability evaluation indicator system of a specific equipment system is complete. For example, is the design of the evaluation indicator for combat effectiveness or task completion complete? Are the capability indicators required for a specific task stage specified? The indicator application correctness check and verification mainly checks the application of all indicators, and determines whether all evaluation data are used by indicators, and whether there are evaluation data that are not used by indicators. For example, whether the combat activity data of the equipment system to complete the specified task has all constructed corresponding evaluation indicators, and whether there are evaluation data without indicators to carry. The indicator alignment analysis mainly checks the connotation and extension of all evaluation indicators, guides users to compare evaluation indicators with the same name, and mark evaluation indicators with the same essence, otherwise rename the evaluation indicators to avoid the possibility of naming different objects with the same indicator name, which will cause greater hidden dangers for subsequent data description, calculation and aggregation. The indicator consistency analysis mainly checks and verifies whether there are contradictions in the evaluation indicators, mainly including the consistency verification of evaluation indicators in the combat capability evaluation indicator systems of different equipment systems and the consistency verification of the relationship between evaluation indicators. The consistency of evaluation indicators in the combat capability evaluation indicator systems of different equipment systems means that the same evaluation indicators appearing in the combat capability evaluation indicator systems of different equipment systems must be consistent, and the consistency of the relationship between evaluation indicators means that the relationship between the same type of evaluation indicators reflected in the combat capability evaluation indicator systems of different equipment systems must be consistent.

[0065] The grammatical verification of the effectiveness of the evaluation index system is further refined into several steps from the process perspective, including positioning, identification, and classification. Positioning is to find the content in the system architecture or evaluation index of the equipment system combat capability evaluation index system that may have grammatical description errors, identification is to determine whether the evaluation index and its structural description are grammatical errors, and classification is to classify the confirmed grammatical errors.

[0066] S22, semantic verification of the effectiveness of the evaluation index system;

[0067] The semantic verification of the effectiveness of the equipment system combat capability evaluation index system mainly checks whether the semantic information formed by the evaluation indicators and their relationships is correct and complete, whether it conforms to the semantic rules, and whether there are contradictory, conflicting and unreasonable contents. The main verification types include three aspects, and logically follow a certain sequence: first, the correlation error verification of the evaluation indicators at different levels in the construction of the equipment system combat capability evaluation index system is carried out, and then the logical correctness verification of the evaluation indicators at different levels is carried out, focusing on checking whether the subordinate relationship between the evaluation indicators at different levels is correct and reasonable, and then the logical rationality verification of the evaluation indicators at different levels is carried out, focusing on checking whether the descriptive semantic rules formed by the evaluation indicators at different levels are correct and reasonable, and whether the evaluation indicator data admission status is reachable.

[0068] S23, pragmatic verification of the effectiveness of the evaluation index system;

[0069] The pragmatic verification of the effectiveness of the equipment system combat capability evaluation index system mainly checks the effectiveness of the equipment system combat capability evaluation index system, especially the overall effectiveness of the evaluation index system, and analyzes whether the constructed equipment system combat capability evaluation index system meets the design requirements and satisfies various evaluation demand indicators. The types of pragmatic verification mainly include three levels: first, the performance verification and evaluation of the evaluation index system pragmatic information is carried out to verify whether the evaluation index system performance indicators can reach the designed equipment system combat capability evaluation demand performance indicators and the degree to which the requirements are met; second, the effectiveness verification and evaluation of the evaluation index system pragmatic information is carried out to verify whether the evaluation index system effectiveness indicators can reach the designed evaluation demand effectiveness indicators and the degree to which the requirements are met; finally, the demand satisfaction of the evaluation index system pragmatic information is comprehensively verified and evaluated, and the functional indicators and non-functional indicators of the comprehensive evaluation index system are comprehensively evaluated to judge whether the evaluation index system meets the initial requirements of the system combat capability evaluation and whether it meets the needs of other business activities such as equipment system combat application and equipment system configuration.

[0070] S3. Introduce non-functional indicator verification of the indicator system into the three-level verification mechanism model to obtain the effectiveness verification framework of the evaluation indicator system.

[0071] According to the logical process of constructing the equipment system combat capability evaluation index system, and the three-level information model and verification mechanism framework of the index system effectiveness, the present invention establishes a validity verification framework that reflects the completeness and correctness of the equipment system combat capability evaluation index system from three aspects: the effectiveness based on the pragmatic layer, the completeness and correctness based on the grammatical semantic layer, and the non-functional indicators. Figure 3 shown.

[0072] S31, utility verification based on pragmatic layer;

[0073] The effectiveness index is mainly an evaluation index of the specific performance and effectiveness of the equipment system combat capability evaluation index system. The performance index and effectiveness index are closely related to the structure of the specific evaluation index system and are also related to the evaluation target. For example, the corresponding object of the equipment system combat capability evaluation index system is the typical reactance equipment system, and the establishment of specific performance index and effectiveness index is basically similar to the evaluation index of the typical reactance equipment system.

[0074] The selection of utility indicators based on the pragmatic layer can be combined with equipment system construction or design data. The equipment system construction requirements overview and summary information may contain some indicator requirements for the evaluation of the equipment system's combat capability. In addition, for various descriptive views of the equipment system, such as the system performance parameter matrix, relevant performance and effectiveness parameters such as the system, system function, and interface are designed. These performance and effectiveness indicators can also serve as the basis for the establishment of utility evaluation indicators; the equipment system's combat information exchange matrix, combat activity model, etc. may also contain some performance or effectiveness requirements. These indicator parameters are also the basis for constructing utility evaluation indicators.

[0075] S32, completeness and correctness verification based on syntax and semantic layer;

[0076] The grammatical and semantic layer indicators are mainly aimed at the design process and quality of the equipment system combat capability evaluation indicator system. For the design of multi-level and multi-angle evaluation indicator systems, whether the evaluation indicator system design is standardized and reasonable also has an important impact on the quality of the indicator system.

[0077] The grammatical and semantic layer indicators mainly include the standardization of indicator design, the logical rationality of indicators and their relationships, the completeness of indicators and the consistency of indicators. Among them, the standardization of indicator design mainly evaluates whether the standardized indicator system design framework and methods are adopted, whether the special key combat problem decomposition, typical combat task decomposition, system structure design and other tools are selected; logical rationality mainly evaluates whether the logical relationship and process of the evaluation indicators and their relationship design are reasonable; indicator completeness mainly evaluates whether the evaluation indicator system design indicators meet the requirements of equipment system combat capability evaluation, system contribution rate analysis, sensitivity factor analysis and other design and development requirements; indicator consistency mainly evaluates whether the evaluation indicator system design indicators are consistent. The acquisition of these indicators depends on the verification and evaluation results of related content.

[0078] S33, non-functional indicator verification of the indicator system;

[0079] Non-functional indicators are indicators related to the non-functional characteristics of the evaluation indicator system, mainly including the complexity of the evaluation process, the reliability of the conclusions, the risk of the conclusions, the total cost of the task, the scalability of the system, etc. These indicators can be obtained using general system evaluation methods.

[0080] based on Figure 3 The effectiveness verification framework of the equipment system combat capability evaluation index system is designed. The relevant underlying index data is collected for the combat application scenarios of the equipment system. The commonly used comprehensive decision-making methods such as weighted summation and grey correlation analysis are used from bottom to top to finally obtain the effectiveness verification results of the evaluation index system. This result can not only be used to compare and analyze the effectiveness of different equipment system combat capability evaluation index systems, but also to compare and analyze the applicability of the capability evaluation index system to different equipment system combat application scenarios.

[0081] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for constructing a validity verification framework for a grammatical, semantic and pragmatic competence evaluation index system, characterized in that: The steps include: S1. Establish a three-level information model for evaluating the effectiveness of the indicator system; S2. Establish a three-level verification mechanism model for the effectiveness of the evaluation index system based on the three-level information model; S3. Introduce non-functional indicator verification of the indicator system into the three-level verification mechanism model to obtain the effectiveness verification framework of the evaluation indicator system.

2. The method for constructing a validity verification framework for a grammatical, semantic and pragmatic competence evaluation index system according to claim 1 is characterized in that: The three-level information model includes grammatical information, semantic information and pragmatic information of the evaluation index system; The grammatical information is information contained or provided by the external form of the evaluation index system; the grammatical information corresponds to the evaluation index, the relationship between the indexes and the attributes of the evaluation index system; The semantic information is the logical meaning of each indicator of the evaluation indicator system after combination; the semantic information corresponds to the logical relationship formed by the evaluation indicators and their mutual relationship; The pragmatic information refers to the tasks and functions that can be completed by the evaluation index system, reflecting the performance of the evaluation index system and the evaluation effectiveness ultimately achieved. The pragmatic information corresponds to the performance and effectiveness possessed or provided by the evaluation index system as a whole.

3. The method for constructing a validity verification framework for a grammatical, semantic and pragmatic competence evaluation index system according to claim 1 is characterized in that: The verification steps of the three-level verification mechanism model include: S21, performing grammatical verification on the grammatical information; S22, after the syntax verification is correct, semantic verification is performed on the semantic information; S23. After the grammatical verification and semantic verification are correct, pragmatic verification is performed on the pragmatic information.

4. The method for constructing a validity verification framework for a grammatical, semantic and pragmatic competence evaluation index system according to claim 3 is characterized in that: The grammar verification checks and verifies the standardization and grammar rules of the evaluation index system; The verification types of the grammar verification include indicator text error verification, indicator terminology standard verification, data reference verification, and graphic symbol standard verification. The verification contents of the syntax verification include indicator design integrity check verification, indicator application correctness check verification, indicator alignment analysis and indicator consistency analysis.

5. The method for constructing a validity verification framework for a grammatical, semantic and pragmatic competence evaluation index system according to claim 3 is characterized in that: The syntax verification includes the following steps: S211. Locate and find out the possible grammatical description errors in the system structure or evaluation indicators of the equipment system combat capability evaluation indicator system; S212, identifying and determining whether the evaluation indicator and its structural description are grammatically incorrect; S213: Classify: classify the confirmed grammatical errors.

6. The method for constructing a validity verification framework for a grammatical, semantic and pragmatic competence evaluation index system according to claim 3 is characterized in that: The semantic verification checks whether the semantic information formed by the evaluation indicators and their relationships is correct and complete, whether it complies with semantic rules, and whether there are any contradictory, conflicting and unreasonable contents.

7. The method for constructing a validity verification framework for a grammatical, semantic and pragmatic competence evaluation index system according to claim 3 is characterized in that: The semantic verification comprises the following steps: S221. Verify the correlation errors of evaluation indicators at different levels in the construction of the equipment system combat capability evaluation indicator system; S222. Verify the logical correctness of evaluation indicators at different levels, focusing on checking whether the subordinate relationships between evaluation indicators at different levels are correct and reasonable; S223. Verify the logical rationality of evaluation indicators at different levels, focusing on checking whether the descriptive semantic rules formed by evaluation indicators at different levels are correct and reasonable, and whether the data admission status of the evaluation indicators is reachable.

8. The method for constructing a validity verification framework for a grammatical, semantic and pragmatic competence evaluation index system according to claim 3 is characterized in that: The pragmatic verification checks the effectiveness of the equipment system combat capability evaluation index system, and analyzes whether the constructed equipment system combat capability evaluation index system meets the design requirements and satisfies various evaluation demand indicators.

9. The method for constructing a validity verification framework for a grammatical, semantic and pragmatic competence evaluation index system according to claim 3 is characterized in that: The pragmatic verification comprises the following steps: S231. Conduct performance verification and evaluation of the pragmatic information of the evaluation index system to verify whether the performance indicators of the evaluation index system can meet the performance indicators of the designed equipment system combat capability evaluation requirements and the degree to which the requirements are met; S232, conduct effectiveness verification and evaluation of the pragmatic information of the evaluation index system to verify whether the effectiveness indicators of the evaluation index system can reach the designed evaluation requirement effectiveness indicators and the degree to which the requirements are met; S233. Comprehensively verify and evaluate the satisfaction of the pragmatic information of the evaluation index system, and comprehensively evaluate the functional and non-functional indicators of the evaluation index system to determine whether the evaluation index system meets the initial requirements of the system combat capability evaluation, and whether it meets the needs of equipment system combat use, equipment system configuration and other business activities.

10. The method for constructing a validity verification framework for a grammar-semantics-pragmatics-based competence evaluation index system according to claim 1, characterized in that: The validation steps of the effectiveness validation framework of the evaluation index system include: S31. Validation of the effectiveness based on pragmatic indicators; Pragmatic level indicators include indicator system performance, indicator system effectiveness and comprehensive satisfaction of needs; S32, completeness and correctness verification based on grammatical and semantic layer indicators; The indicators at the grammatical and semantic level include the standardization of indicator design, the logical rationality of indicators and their relationships, the completeness of indicators, and the consistency of indicators; S33, non-functional indicator verification of the indicator system; Non-functional indicators are indicators related to the non-functional characteristics of the evaluation indicator system. Non-functional indicators include the complexity of the evaluation process, the reliability of the conclusions, the risk of the conclusions, the total cost of the task and the scalability of the system for the evaluation indicator system.

Citation Information

Cited By

  • Security code automatic generation method and system based on full information theory and mechanism ambiguity

    CN120447881A

  • Method and system for automatic generation of secure code based on full information theory and mechanism theory

    CN120447881B