Unlock instant, AI-driven research and patent intelligence for your innovation.

Quality detection method and device for semi-structured data, storage medium and equipment

A technology of semi-structured data and quality inspection methods, which is applied in semi-structured data retrieval, semi-structured data query, special data processing applications, etc., and can solve the problems of data discarding, data storage and storage, etc.

Active Publication Date: 2020-01-17
RUN TECH CO LTD BEIJING
View PDF9 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In this way, if the detection conditions are relaxed, a large amount of unusable data will be stored in the database, and if the detection conditions are tightened, valuable data will be discarded

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Quality detection method and device for semi-structured data, storage medium and equipment
  • Quality detection method and device for semi-structured data, storage medium and equipment
  • Quality detection method and device for semi-structured data, storage medium and equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0034] figure 1 It is a flow chart of the semi-structured data quality detection method provided in Embodiment 1 of the present application, and this embodiment is applicable to the situation of performing quality detection on semi-structured data. The method can be executed by the semi-structured data quality detection device provided by the embodiment of the present application, which can be implemented by software and / or hardware, and can be integrated into electronic devices such as smart phones and computers.

[0035] Such as figure 1 As shown, the quality detection method of the semi-structured data includes:

[0036] S110. Determine the business scenario mark of the target field in the semi-structured data through the self-description file.

[0037] Wherein, the semi-structured data may be data in txt, bcp, excel, csv format, or data in other formats. Semi-structured data can include multiple pieces of data, and each piece of data can include multiple fields. Among ...

Embodiment 2

[0049] In order to enable those skilled in the art to understand the solution more clearly, the present application also provides a preferred implementation manner.

[0050] The invention is aimed at a verification method of semi-structured data with self-description files in xml format, and discloses a data quality detection method thereof.

[0051] The technical problem solved by the present invention: the purpose of the present invention is to provide a multi-field data quality verification method, which can judge the compliance of a piece of data by performing joint verification on all fields of a piece of data.

[0052] To achieve the above object, the solution of the present invention is:

[0053] A semi-structured data quality detection method, which includes:

[0054] a. Configure the data verification template according to the self-describing xml file: Usually, the verification rules for a single field include whether the field value is required and regular expressio...

Embodiment 3

[0072] image 3 It is a schematic structural diagram of the semi-structured data quality detection device provided in Embodiment 3 of the present application. Such as image 3 As shown, the quality detection device of the semi-structured data includes:

[0073] The business scene mark acquisition module 310 is used to determine the business scene mark of the target field in the semi-structured data through the self-description file;

[0074] The verification template determination module 320 is used to determine the verification template of the semi-structured data according to the business scene mark of the target field; wherein, the verification template also includes a detection function for the business scene mark of the target field;

[0075] The detection result generation module 330 is configured to perform global detection on the target field and associated fields associated with the target field according to the detection function, and generate a quality detection r...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention discloses a semi-structured data quality detection method and device, a storage medium and equipment. The method comprises the steps of determining a service scene markof a target field in semi-structured data through a self-description file; determining a verification template of the semi-structured data according to the business scene mark of the target field, wherein the verification template further comprises a detection function for a service scene mark of a target field; and according to the detection function, performing global detection on the target field and the associated field associated with the target field, and generating a quality detection result. By implementing the technical scheme provided by the invention, the effect of more accuratelydetecting the content of each field of the semi-structured data can be achieved.

Description

technical field [0001] The embodiments of the present application relate to the technical field of equipment, and in particular, to a semi-structured data quality detection method, device, storage medium, and equipment. Background technique [0002] With the gradual improvement of the level of science and technology, the use of various semi-structured data has been widely used in various fields. At present, the detection method for semi-structured data is still a single detection method for each field. Since this detection method is to perform regular verification on the field value, if it passes, the data will be stored in the database, and if it does not pass, the data will be discarded. In this way, if the detection conditions are relaxed, a large amount of unusable data will be stored in the database, and if the detection conditions are tightened, valuable data will be discarded. Regardless of the above phenomenon, we don't want to see it. Therefore, how to detect sem...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/83
CPCG06F16/83
Inventor 胡立杰张志远万月亮
Owner RUN TECH CO LTD BEIJING