Unlock instant, AI-driven research and patent intelligence for your innovation.

A method and system for detecting distributed data

A distributed data and detection method technology, applied in the field of data processing, can solve problems such as data misjudgment

Active Publication Date: 2022-07-29
睿至科技集团有限公司
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] With the vigorous development of Internet, Internet of Things and other industries and the increasing improvement of computer technology, along with the rapid development of cloud computing technology, the development of data collection and storage technology has brought massive data, and in the process of data processing, often Data detection will be carried out. The traditional data detection method is to make a simple judgment on the output data, but this judgment often does not detect the real abnormality of the data, or causes misjudgment of the data.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method and system for detecting distributed data
  • A method and system for detecting distributed data
  • A method and system for detecting distributed data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0022] like figure 1 As shown, it is a detection method of distributed data provided by this application, which specifically includes the following steps:

[0023] Step S110: Obtain distributed data.

[0024] Specifically, the distributed data is embodied as data composed of time series data.

[0025] Step S120: Perform anomaly detection on the acquired distributed data.

[0026] Among them, anomaly detection for distributed data is to find out whether there are data points that are obviously separated from other large-scale data.

[0027] The abnormal data point refers to the obvious difference in its data behavior compared with other data, it does not belong to any cluster, nor is it a noise data point.

[0028] At the same time, abnormal data points may also be those noise points generated during the clustering process, which do not belong to any cluster or cluster-like small pattern.

[0029] The abnormal data points may be caused by the following aspects:

[0030] 1....

Embodiment 2

[0078] like figure 2 As shown, the present application provides a distributed data detection system, which specifically includes: an acquisition unit 210 , an abnormality detection unit 220 , a missing judgment unit 230 , a determination unit 240 , a supplementary unit 250 , and a feedback unit 260 .

[0079] The acquiring unit 210 is used for acquiring distributed data.

[0080] The abnormality detection unit 220 is connected to the acquisition unit 210, and is used for abnormality detection on the distributed data.

[0081] The missing judging unit 230 is connected with the abnormality detecting unit 220, and is used for judging whether there is a missing data point in the distributed data.

[0082] The determining unit 240 is connected to the missing judging unit 230, and is configured to determine a supplementary data point strongly associated with the missing data point if there is a missing data point in the distributed data.

[0083] The supplementing unit 250 is con...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present application discloses a distributed data detection method and system, wherein the distributed data detection method specifically includes the following steps: acquiring distributed data; performing anomaly detection on the acquired distributed data; Anomaly detection, to determine whether there are missing data points in the distributed data; if there are missing data points in the distributed data, determine the supplementary data points strongly associated with the missing data points; in response to determining the supplementary data points strongly associated with the missing data points, The missing data points are supplemented according to the supplementary data points; the distributed data after supplementing the missing data points are fed back and output. The present application can perform detection and processing on data, specifically including abnormal data detection and missing data detection, which enhances data security and ensures data stability.

Description

technical field [0001] The present application relates to the field of data processing, and in particular, to a method and system for detecting distributed data. Background technique [0002] With the vigorous development of the Internet, Internet of Things and other industries and the increasing improvement of computer technology, along with the rapid development of cloud computing technology, the development of data collection and storage technology has brought massive data, and in the process of data processing often Data detection will be carried out. The traditional data detection method is to make a simple judgment on the output data, but this judgment often does not detect the real abnormality of the data, or causes the misjudgment of the data. [0003] Therefore, how to provide a detection method capable of improving data security is an urgent problem to be solved by those skilled in the art. SUMMARY OF THE INVENTION [0004] The present application provides a met...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F21/64G06K9/62
CPCG06F21/64G06F18/2433
Inventor 侯宝元
Owner 睿至科技集团有限公司