Data incremental testing method and system for resource-based data

An incremental and data-based technology, applied in the field of data incremental testing for resource-based data, can solve the problems of no automatic evaluation plan for test results, exclusion of error entries, and no comprehensive test plan for resource-based data, so as to achieve verification and High frequency updates, the effect of improving test intensity

Active Publication Date: 2022-07-08
AISPEECH CO LTD
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In order to at least solve the problem that there is no comprehensive test plan for these new resource-type data in the prior art, there is no automated evaluation plan for test results, and the problem of automated error entry exclusion

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data incremental testing method and system for resource-based data
  • Data incremental testing method and system for resource-based data
  • Data incremental testing method and system for resource-based data

Examples

Experimental program
Comparison scheme
Effect test

test Embodiment 10000

[0035] For step S13, although there are only three examples above, in actual operation, there will be a large number of actual semantic parsing results and expected semantic parsing results. Therefore, the comparison work of this volume is difficult for the staff to handle, and it is necessary to use automated semantics Results comparison tool for evaluation. The expected semantic parsing results of the entries "one-size-fits-all" and "please allow me to be ordinary" are consistent with the actual semantic parsing results, and the entry is reserved. The expected semantic parsing result of the entry "Insomnia Broadcast" does not match the actual semantic parsing result. The "Insomnia Skill" was mistakenly triggered instead of "Insomnia Broadcast", indicating that this entry needs to be adjusted and modified by the developer. The corresponding wrong entry is inferred through the thesaurus function template. For example, "I want to listen to the insomnia broadcast" can be inferr...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the present invention provides a data increment testing method for resource-type data. The method includes: expanding the incremental entry data through a thesaurus function template, generating an incremental entry test case, and an expected semantic analysis result corresponding to the incremental entry test case; using the updated semantic understanding of the incremental entry data The service parses the incremental entry test case, and determines the actual semantic parsing result; the automated semantic result comparison tool evaluates the expected semantic parsing result and the actual semantic parsing result, and determines the wrong entry in the incremental entry data. Filter the wrong entries from the data to determine the functionality of the updated semantic understanding service. The embodiment of the present invention also provides a data incremental testing system for resource-based data. In the embodiment of the present invention, the number of test cases can be expanded by expanding the number of templates, thereby improving the test intensity.

Description

technical field [0001] The present invention relates to the field of intelligent speech, in particular to a data incremental testing method and system for resource-based data. Background technique [0002] Resource-based data used in semantic understanding, including thesaurus resources such as song name / singer name / movie name / story name, etc., need to be updated regularly to adapt to new songs / movies to improve the accuracy of semantic understanding and users experience. At present, when these manufacturers update these thesaurus data, the test plan is relatively lacking, and they can only ensure the quality of the source data, or conduct manual inspection through a single functional statement. [0003] In the process of realizing the present invention, the inventor found that there are at least the following problems in the related art: [0004] Add the entry data to the resource, test the result of semantic understanding through the functional statement, and manually ch...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F11/36G06F40/30
CPCG06F11/3684G06F40/30
Inventor 王建忠徐华张瑜
Owner AISPEECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap