Unlock instant, AI-driven research and patent intelligence for your innovation.

Data processing method and device, storage medium, electronic device

A data processing and data technology, applied in the field of data processing, can solve problems such as unproposed solutions, achieve the effect of improving data parallel efficiency and solving distributed processing

Active Publication Date: 2022-04-12
BEIJING MININGLAMP SOFTWARE SYST CO LTD
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] For the above technical problems, no effective solution has been proposed in the related art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device, storage medium, electronic device
  • Data processing method and device, storage medium, electronic device
  • Data processing method and device, storage medium, electronic device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] Hereinafter, the present invention will be described in detail with reference to the drawings and examples. It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined with each other.

[0023] It should be noted that the terms "first" and "second" in the description and claims of the present invention and the above drawings are used to distinguish similar objects, but not necessarily used to describe a specific sequence or sequence.

[0024] The method embodiment provided in Embodiment 1 of the present application may be executed in a mobile terminal, a computer terminal, or a similar computing device. Taking running on a mobile terminal as an example, figure 1 It is a hardware structural block diagram of a mobile terminal of a data processing method in an embodiment of the present invention. Such as figure 1 As shown, the mobile terminal 10 may include one or more ( figure 1 On...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides a data processing method and device, a storage medium, and an electronic device. The method includes: determining the first data interval where N pieces of data to be processed are located, wherein N is greater than or equal to 1; The distribution state in the first data interval, wherein the distribution state includes uniform distribution and uneven distribution; according to the distribution state, the first data interval is divided into intervals to obtain M data intervals, wherein M is greater than 1; in the M data intervals Search for intervals distributed in N data sets to be processed to obtain a target data interval, wherein the target data interval is included in the first data interval. Through the present invention, the problem of data distribution processing is solved, and the effect of improving data parallel efficiency is achieved.

Description

technical field [0001] The present invention relates to the field of data processing, in particular to a data processing method and device, a storage medium, and an electronic device. Background technique [0002] In big data processing, in many cases, it is necessary to divide the data approximately evenly according to a certain data column and then extract them in parallel. This data column needs to meet the following conditions: [0003] 1. Most of the values ​​are not empty; [0004] 2. There are no or very few values ​​with the same value. Positive example: ID number, name, negative example: gender, blood type. [0005] But these values ​​are often not evenly distributed. If the distribution is arranged according to this column and the value is uniform, special methods must be used to sample to make it evenly or approximately uniformly distributed, so as to avoid a lot of data falling into one shard and affecting parallel efficiency. [0006] For the above technical...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/25G06F16/2453
CPCG06F16/254G06F16/24532
Inventor 叶文涛
Owner BEIJING MININGLAMP SOFTWARE SYST CO LTD