Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Intelligent data checking method, device and equipment

A data and intelligent technology, applied in the field of data processing, can solve problems such as high cost, incomplete data coverage, and heavy workload of manually writing check scripts, and achieve the effect of many check rules and low input cost

Pending Publication Date: 2022-03-11
杭州笨马网络技术有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The invention provides a method for intelligent data checking, which aims to solve the problems in the prior art that manual writing of checking scripts requires a lot of work, high cost, and incomplete data coverage so that the production environment data abnormalities cannot be found in time

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Intelligent data checking method, device and equipment
  • Intelligent data checking method, device and equipment
  • Intelligent data checking method, device and equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0044] Such as figure 1 As shown, a method for intelligent data checking, comprising the following steps:

[0045] S110. Train the link data corresponding to each TraceId according to machine learning, determine the association relationship between the data, and obtain the checking rules of the link data corresponding to each TraceId;

[0046] S120. Obtain the data to be checked and the corresponding TraceId;

[0047] S130. Select an appropriate verification rule from the verification rules according to the corresponding TraceId to verify the data to be verified, and report an exception if the verification fails.

[0048]According to implementation 1, when the software is tested, a unique TraceId will be generated following the request sent out, and the TraceId will accompany the request from beginning to end, recording the complete call link during the request execution process, which can be used for logs For information query and positioning, add a field to record TraceId ...

Embodiment 2

[0050] Such as figure 2 As shown, a method for data intelligent verification includes:

[0051] S210. Obtain sample data and multiple TraceIds, where the multiple TraceIds are used to mark the calling link of the sample data;

[0052] S220. Filter the sample data according to the multiple TraceIds to obtain link data related to each TraceId;

[0053] S230. Perform training on the link data according to supervised learning, obtain the association relationship between the data in the link data, and determine the checking rules of the link data corresponding to each TraceId;

[0054] S240. Obtain the data to be checked and the corresponding TraceId;

[0055] S250. Select an appropriate verification rule from the verification rules according to the corresponding TraceId to verify the data to be verified, and report an exception if the verification fails.

[0056] According to Example 2, under the trend of microservices, the log information of a call is distributed in different...

Embodiment 3

[0058] Such as image 3 As shown, a specific implementation method can be:

[0059] S310. Query the data in the database table;

[0060] The backend interface generates a unique TraceId for each call, and passes it down as the context, so that the entire call chain can be connected through the TraceId, and at the same time, a field for recording the TraceId is added to each table in the database. , the TraceId is also stored in the library, so that the link data can be associated through the TraceId, the data in all tables of all databases can be queried as sample data, and all TraceIds can be intercepted from it.

[0061] S320. Filter the data in the database table according to the TraceId to obtain link data related to each TraceId;

[0062] Use TraceId to filter the query results, that is, filter the sample data through TraceId to get all the data under one call, that is, the link data corresponding to each TraceId, and use it as training data.

[0063] S330. Perform tra...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an intelligent data checking method, device and equipment, and the method comprises the following steps: training link data corresponding to each TraceId according to machine learning, determining an incidence relation between the data, and obtaining a checking rule of the link data corresponding to each TraceId; obtaining data to be checked and a corresponding TraceId; and selecting a proper checking rule from the checking rules according to the corresponding TraceId to check the to-be-checked data, and if the checking fails, reporting an exception. According to the method, the checking rules are trained through machine learning, the investment cost is lower than that of manual script writing and checking, the method is more comprehensive, updating is more timely, and meanwhile, problems can be found in time by testing through an algorithm.

Description

technical field [0001] The present invention relates to the technical field of data processing, in particular to a method, device and equipment for intelligent data checking. Background technique [0002] The responsibilities of software testers are different in different stages of the software life cycle. The main responsibility in the test environment is to efficiently and comprehensively test the software and find as many defects as possible; The above problems, now the main means of proactively finding online problems are: to find production environment problems by monitoring exception logs, or to find production environment data errors by manually writing check scripts, but there are various problems in both methods. For example, monitoring can only find problems reported in abnormal logs, but not data errors. Manually writing check scripts is expensive, and it is difficult to fully cover all data. At the same time, it is difficult to update in time, and the maintainabi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/36G06N20/00
CPCG06F11/3688G06N20/00
Inventor 曹存凯
Owner 杭州笨马网络技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com