Unlock instant, AI-driven research and patent intelligence for your innovation.

A method and server for locating operations that cause data exceptions

A data anomaly and server technology, applied in the field of communication, can solve the problems of inaccurate positioning, data anomaly, inaccessible abnormal data processing and maintenance, etc., and achieve the effect of shortening the response time

Active Publication Date: 2021-10-01
亚信科技(中国)有限公司
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] At present, since the smallest unit of processing data in the Spark computing framework is a batch, that is, the Spark framework needs to process batch data. Therefore, when the content of the batch data is abnormal, the Spark computing framework can be used to locate the abnormal data batch. , but cannot accurately locate the specific operation that caused the abnormal data, resulting in the inability to quickly process and maintain the abnormal data, increasing the response time to the abnormal data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method and server for locating operations that cause data exceptions
  • A method and server for locating operations that cause data exceptions
  • A method and server for locating operations that cause data exceptions

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0017] The method and server for locating operations that cause data exceptions provided by the embodiments of the present application will be described in detail below with reference to the accompanying drawings.

[0018] The terms "including" and "having" and any variations thereof mentioned in the description of the present application are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device comprising a series of steps or units is not limited to the listed steps or units, but optionally also includes other unlisted steps or units, or optionally also includes Other steps or elements inherent to the process, method, product or apparatus are included.

[0019] It should be noted that, in the embodiments of the present application, words such as "exemplary" or "for example" are used as examples, illustrations or descriptions. Any embodiment or design scheme described as "exemplary" or "for example" in the embodiments of the pres...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

This application provides a method and server for locating operations that cause data anomalies, which relate to the communication field, and can accurately locate specific operations that cause data anomalies when using the spark framework to process batch data, and shorten the response time for abnormal data. The method includes: if the server determines that there is an abnormality in the target business data, the server obtains blood relationship tracking data corresponding to the target business data, and the blood relationship tracking data is obtained after performing at least one preset type of operation on the target business data and is related to each preset type Operate the corresponding data; the server determines the target operation that causes abnormalities in the target business data according to the data corresponding to each preset type of operation in the lineage tracking data.

Description

technical field [0001] The present application relates to the communication field, and in particular to a method and server for locating operations that cause data exceptions. Background technique [0002] Spark is an open source cluster computing framework that enables in-memory distributed datasets, provides interactive queries, and can optimize iterative workloads. [0003] At present, since the smallest unit of processing data in the Spark computing framework is a batch, that is, the Spark framework needs to process batch data. Therefore, when the content of the batch data is abnormal, the Spark computing framework can be used to locate the abnormal data batch. , but cannot accurately locate the specific operation that caused the abnormal data, resulting in the inability to quickly process and maintain the abnormal data, increasing the response time to the abnormal data. Contents of the invention [0004] This application provides a method and server for locating oper...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F11/07
CPCG06F11/0709G06F11/079
Inventor 王庚吴鹏马松杨光明子杨杰
Owner 亚信科技(中国)有限公司