Supercharge Your Innovation With Domain-Expert AI Agents!

Data processing method,device and system, equipment, and storage medium

A data processing device and data processing technology, applied in the field of data processing, can solve problems such as inaccurate processing results of actuators, and achieve the effect of improving accuracy

Pending Publication Date: 2021-05-28
MASHANG CONSUMER FINANCE CO LTD
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Embodiments of the present invention provide a data processing method, device, device, system, and storage medium to solve the problem of inaccurate processing results of actuators

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method,device and system, equipment, and storage medium
  • Data processing method,device and system, equipment, and storage medium
  • Data processing method,device and system, equipment, and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0035] see figure 1 , figure 1 It is a flow chart of the data processing method provided by the embodiment of the present invention, which is applied to the executor of Spark, and the executor is at least one, such as figure 1 shown, including the following steps:

[0036] Step 101. Obtain the accumulated value of the target variable, wherein the accumulated value is obtained by the distributed accumulator according to the accumulated information sen...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data processing method,device and system, equipment, and a storage medium, relates to the technical field of data processing, and aims to solve the problem that the processing result of an actuator is inaccurate. The method comprises the steps that an accumulated value of a target variable is obtained from a distributed accumulator, and the accumulated value is obtained by the distributed accumulator according to accumulated information sent by an actuator in Spark; whether the accumulated value meets a preset condition or not to obtain a judgment result is judged; and a processing mode is determined according to the judgment result. According to the embodiment of the invention, the accuracy of an actuator processing result can be improved.

Description

technical field [0001] The present invention relates to the technical field of data processing, in particular to a data processing method, device, equipment, system and storage medium. Background technique [0002] Spark is a distributed cluster computing platform. Driver (driver) is the application (Application) running in Spark, which is used to coordinate and manage the whole process; Executor (executor) is the executor of Spark, which runs on the worker node (work node) for an Application a process. [0003] When using the Spark big data platform to process data, it is necessary to perform real-time accumulation calculations on a variable, and perform different processing on the variable according to the accumulation results. In this process, the driver distributes the initial value of the variable to each actuator, and the value of the variable is accumulated by each actuator. [0004] Due to the limitation of the distributed processing structure, in this way, the ex...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/50G06F9/48
CPCG06F9/5083G06F9/5027G06F9/485
Inventor 陈国锋余万水杨锋
Owner MASHANG CONSUMER FINANCE CO LTD
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com