Ranking analysis function processing method and device, electronic equipment and storage medium

A technology for analyzing functions and processing methods, applied in the field of data analysis, can solve problems such as poor data processing performance, and achieve the effect of improving the effect, reducing the amount of data, and improving the performance

Active Publication Date: 2021-11-30
SHANGHAI DAMENG DATABASE
View PDF11 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Embodiments of the present invention provide a ranking analysis function processing method, device, equipment, and medium, which can solve the problem of poor data processing performance when a pruned ranking analysis function is involved in the data processing process of a multi-threaded system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Ranking analysis function processing method and device, electronic equipment and storage medium
  • Ranking analysis function processing method and device, electronic equipment and storage medium
  • Ranking analysis function processing method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0026] The embodiments of the present invention will be further described in detail below in conjunction with the drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the embodiments of the present invention, rather than to limit the embodiments of the present invention. In addition, it should be noted that, for the convenience of description, the drawings only show some but not all structures related to the embodiments of the present invention.

[0027] figure 1 It is a flow chart of a ranking analysis function processing method provided by Embodiment 1 of the present invention. This embodiment of the present invention is applicable to data distribution during data processing. The method can be executed by a ranking analysis function processing device. The device can be implemented in the form of software and / or hardware. The apparatus may be configured in a server. In a specific embodiment, the apparatus ma...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a ranking analysis function processing method and device, electronic equipment and a storage medium, and the method comprises the steps: detecting that a target execution plan meets a preset ranking function optimization condition, and randomly distributing to-be-ranked data to a multi-thread system; performing preset ranking function processing on the to-be-ranked data to obtain initial ranking data, and deleting the initial ranking data according to preset ranking function data retention items to obtain initial deleted ranking data; summarizing the initial deletion ranking data to obtain middle ranking data, and distributing the middle ranking data to a plurality of threads; and performing preset ranking function processing on the middle ranking data according to the group information to obtain final ranking data, and deleting the final ranking data according to preset ranking function data retention items to obtain an execution result of the target execution plan. According to the method, the problem of high data distribution performance consumption in the data analysis process is solved, and the effect of effectively improving the performance of the analysis function in the processing process of the analysis function is achieved.

Description

technical field [0001] The embodiments of the present invention relate to data analysis technology, and in particular to a ranking analysis function processing method, device, electronic equipment, and storage medium. Background technique [0002] Various requirements often arise during data analysis, for example, student achievement rankings, performance rankings, etc. In the process of data analysis, the analysis function used is to calculate each group of data on the basis of grouping and return all rows in the group, which will cause the entire data to be distributed when the data volume is large. The distribution process is more complicated. [0003] Generally, in a multi-threaded system, the premise of parallelism between groups is that the data needs to be distributed, and the data of the same group is processed by the same thread. [0004] For the existing data analysis method, the entire data analysis process will lead to large performance consumption in the distr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06Q10/04G06Q50/20
CPCG06Q10/04G06Q50/205Y02D10/00
Inventor 张钦万伟韩朱忠
Owner SHANGHAI DAMENG DATABASE
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap