Data exception processing method and device, electronic equipment and storage medium

A data exception and processing method technology, applied in the field of data processing, can solve the problems of complex data processing process and increase the complexity of data exception processing, and achieve the effect of simplifying complexity and realizing unified processing

Pending Publication Date: 2022-05-27
BEIJING QIANXIN TECH +1
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, in the above-mentioned related technologies, data verification needs to be performed at each processing no

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data exception processing method and device, electronic equipment and storage medium
  • Data exception processing method and device, electronic equipment and storage medium
  • Data exception processing method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0047] In order to make the objectives, technical solutions and advantages of the present invention clearer, the technical solutions in the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present invention. , not all examples. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0048] Combine below Figure 1-Figure 7 Describe the data exception handling method of the present invention.

[0049] figure 1 is one of the schematic flow charts of the data exception processing method provided by the present invention, such as figure 1 As shown, the data exception processing method includes the following steps:

[0050] Step 101: Capture abnormal data when an exception occurs in the data str...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data exception processing method and device, electronic equipment and a storage medium, and the method comprises the steps: capturing exceptional data when a data stream processed by a current processing node is exceptional; determining whether the abnormal data is thrown again or not; when it is determined that the abnormal data is not thrown again, obtaining target abnormal processing configuration information corresponding to the current processing node; and processing the abnormal data based on the target abnormal processing configuration information. According to the data exception processing method and device, the electronic equipment and the storage medium provided by the invention, unified processing of abnormal data is realized, and the complexity of data exception processing is simplified.

Description

technical field [0001] The present invention relates to the technical field of data processing, and in particular, to a data exception processing method, device, electronic device and storage medium. Background technique [0002] During data processing, big data processing platforms such as Flink and Spark may cause abnormal data processing due to the format of the input data. In order not to affect the normal flow of data processing, it is usually necessary to process abnormal data. [0003] In the related art, data verification is added to the data stream, abnormal data and normal data are distinguished through data verification, normal data is then processed, and abnormal data is divided or discarded. [0004] However, in the above-mentioned related art, data verification needs to be performed at each processing node, and the data processing process is relatively complicated, thereby increasing the complexity of data exception processing. SUMMARY OF THE INVENTION [0...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F11/07
CPCG06F11/0793
Inventor 叶盛
Owner BEIJING QIANXIN TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap