Label updating method and device, cluster and storage medium

An update method and labeling technology, applied in software deployment and other directions, can solve problems such as high development and maintenance costs

Pending Publication Date: 2020-07-07
深圳市卡牛科技有限公司
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The existing labeling usually processes the data by writing a MapReduce program to output the result file. The new label marking process needs to change the label calculation program to adapt to the new label marking process, and the development and maintenance costs are relatively high.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Label updating method and device, cluster and storage medium
  • Label updating method and device, cluster and storage medium
  • Label updating method and device, cluster and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0049] figure 1 It is a flow chart of the tag update method provided in Embodiment 1 of the present invention, the method can be executed by a cluster, and specifically includes the following steps:

[0050] Step 110, receiving the first marking rule sent by the server.

[0051] In this embodiment, the first marking rule is a marking rule provided by the user to the server through the client, and the server sends the first marking rule to the cluster after receiving the first marking rule. Specifically, the marking rule is a rule for adding labels to data; for example, if the marking rule is a marking rule for group consumption records, the marking rule can add low-consumption labels for individuals whose average daily consumption is less than 100 yuan , Add the medium consumption label to individuals with an average daily consumption of 100-1,000 yuan, and add the high consumption label to individuals with an average daily consumption of more than 1,000 yuan.

[0052] Step ...

Embodiment 2

[0066] Figure 4 It is a flow chart of the tag update method provided in Embodiment 2 of the present invention, which can be executed by a cluster, and specifically includes the following steps:

[0067] Step 210, receiving the label calculation program sent by the server;

[0068] In this embodiment, the server is a Livy server, the label calculation program is a program built on the Spark calculation engine, and the label calculation program is a program for marking data. Livy is a typical REST service architecture. On the one hand, it accepts and parses the user's REST request, converts it into a corresponding operation, and sends the operation to the cluster for processing; on the other hand, it manages all the clusters started by the user.

[0069] Specifically, when the user needs to send a label calculation program to the cluster, the user can create a new Livy Session on the Livy server by calling the Livy Client (Livy Client). The receiving the label calculation pro...

Embodiment 3

[0088] The label update device provided by the embodiment of the present invention can execute the label update method provided by any embodiment of the present invention, see Image 6 , the label update device 3 specifically includes:

[0089] A receiving module 31, configured to receive the first marking rule sent by the server;

[0090] A reading module 32, configured to read the data to be processed and the corresponding second label, the second label is a second label defined by the data to be processed based on the second marking rule;

[0091] A marking module 33, configured to mark the data to be processed according to the first marking rule, so as to obtain a first label defined by the data to be processed based on the first marking rule;

[0092] An updating module 34, configured to combine the first label and the second label corresponding to the data to be processed to obtain a target label.

[0093] In an alternative embodiment, the update module is further config...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a label updating method and device, a cluster and a storage medium. The label updating method comprises the following steps: receiving a first marking rule sent by a server; reading to-be-processed data and a corresponding second label, wherein the second label is defined by the to-be-processed data based on a second marking rule; marking the to-be-processed data accordingto the first marking rule to obtain a first label defined by the to-be-processed data based on the first marking rule; and combining the first label and the second label corresponding to the to-be-processed data to obtain a target label. According to the label updating method and the device, the label updating problem is solved, and the effects that label updating is conducted according to the user-defined marking rule, the situation that a label updating program needs to be changed according to the label updating rule every time label updating is conducted is avoided, and the label updating program development and maintenance cost is reduced are achieved.

Description

technical field [0001] Embodiments of the present invention relate to label-based update technologies, and in particular, to a label update method, device, cluster, and storage medium. Background technique [0002] In the era of big data, it is very challenging to quickly mine the value of data from massive amounts of data. More and more companies will process data through offline processing, through data characteristics and data aggregation. Statistics and other methods are labeled with various labels, so as to facilitate the algorithm model to support upper-level applications to achieve precision marketing and other functions. The existing labeling usually processes the data by writing a MapReduce program to output the result file. The new label marking process needs to modify the label calculation program to adapt to the new label marking process, and the development and maintenance costs are relatively large. Contents of the invention [0003] The present invention pr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F8/65
CPCG06F8/65
Inventor 李科
Owner 深圳市卡牛科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap