Supercharge Your Innovation With Domain-Expert AI Agents!

A data distributed self-incrementing encoding method, system, equipment and medium

A coding method and distributed technology, applied in the field of systems, equipment and media, and data distributed self-increment coding methods, can solve the problems of low efficiency and high development cost, and achieve the effect of reducing development cost and improving development efficiency.

Active Publication Date: 2020-08-04
重庆天蓬网络有限公司
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In the existing technology, data auto-increment coding is realized by writing UDF functions, etc., which needs to be developed by Java, which has high development cost and low efficiency. With the increasing demand for big data processing, the disadvantages of traditional data auto-increment coding are gradually becoming prominent. Therefore, there is an urgent need for a data self-incrementing coding technology that can help reduce development difficulty and improve development efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data distributed self-incrementing encoding method, system, equipment and medium
  • A data distributed self-incrementing encoding method, system, equipment and medium
  • A data distributed self-incrementing encoding method, system, equipment and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047] Embodiments of the technical solutions of the present invention will be described in detail below in conjunction with the accompanying drawings. The following examples are only used to illustrate the technical solutions of the present invention more clearly, and therefore are only examples, rather than limiting the protection scope of the present invention.

[0048] It should be noted that, unless otherwise specified, the technical terms or scientific terms used in this application shall have the usual meanings understood by those skilled in the art to which the present invention belongs.

[0049] Such as figure 1 As shown, it is an embodiment of a data distributed self-incrementing encoding method of the present invention, including:

[0050] S11: Obtain data from external sources, and generate a first collection;

[0051] S12: Obtain processed data and generate a second set;

[0052] S13: Calculate the union of the first set and the second set to obtain the total d...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data distributed self-increasing coding method and system, electronic equipment and a medium, and the method comprises the steps: obtaining external source data, and generating a first set; obtaining processed data, and generating a second set; calculating a union of the first set and the second set to obtain a total data set; performing de-duplication processing on the total data set to obtain a de-duplication data set; and obtaining newly added data in the duplicate removal data set, and encoding the newly added data to complete data self-adding encoding. Accordingto the method, a UDF function does not need to be compiled, and data self-coding of hive is realized through sql, so that the purpose of carrying out data coding on a certain known field is achieved,the development cost is effectively reduced, and the development efficiency is improved.

Description

technical field [0001] The present invention relates to the field of big data technology, in particular to a data distributed auto-increment encoding method, system, equipment and medium. Background technique [0002] With the improvement of computer storage capacity and the development of complex algorithms, the amount of network data has grown exponentially in recent years. Applications with massive data requirements such as scientific data processing and business intelligence data analysis have become more and more common. The mainstream big data processing Technology uses hive and distributed data processing, and data auto-increment coding is an important part of it. In the existing technology, data auto-increment coding is realized by writing UDF functions, etc., which needs to be developed by Java, which has high development costs and low efficiency. With the increasing demand for big data processing, the disadvantages of traditional data auto-increment coding are grad...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/245G06F16/24
CPCG06F16/24G06F16/245
Inventor 周孝文
Owner 重庆天蓬网络有限公司
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com