Unlock instant, AI-driven research and patent intelligence for your innovation.

Data association processing method, system and electronic device

A data association and processing method technology, applied in the direction of electrical digital data processing, special data processing applications, digital data information retrieval, etc., can solve the problems of manual processing work, low data security, and inability to make full use of hadoop parallel algorithms

Active Publication Date: 2021-04-30
BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD +1
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In this processing method, the data is separated from the processing software, the manual processing is too much, the data security is low, the data export consumes a lot of resources, and the advantages of Hadoop parallel algorithms cannot be fully utilized.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data association processing method, system and electronic device
  • Data association processing method, system and electronic device
  • Data association processing method, system and electronic device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033]Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete and fully convey the concept of example embodiments to those skilled in the art. The drawings are merely schematic illustrations of the invention and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus repeated descriptions thereof will be omitted.

[0034] Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided in order to give a thorough understanding of embodiments of the invention. However, those skilled in the art will appreciate ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a data association processing method, system and electronic equipment. A data association processing method, comprising: generating a first information table according to basic log data, a record in the first information table is uniquely identified by a first key field and a second key field; within a preset time period performing self-association on the second key field corresponding to the first key field in the first information table to generate a second information table; The number of the first key field corresponding to the second key field is counted to generate a third information table; according to the first information table, the second information table and the third information table, the third information table is generated Four information tables, the fourth information table includes an index representing the degree of association between at least two of the second key fields.

Description

technical field [0001] The present invention relates to data association processing technology, in particular to a data association processing method, system and electronic equipment. Background technique [0002] In the big data environment, many companies will choose Hadoop's big data association processing architecture, and hive is more commonly used as a data query language on Hadoop. But for the exploration of large amounts of data, sometimes simple query logic cannot meet the needs of deep data exploration in actual scenarios, such as some complex relational operations in data mining, such as association rules. In many cases, users need to first query the basic data through Hadoop, then export or download (down) to the local, and then import these basic data into related data mining software for further processing. [0003] In this processing method, data and processing software are separated, manual processing is too much, data security is low, data export consumes a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/2458
CPCG06F16/2462
Inventor 刘俊
Owner BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD