Data processing method and data processing device
A data processing device and data processing technology, applied in the field of data processing, can solve problems such as poor calculation stability, low memory requirements, and high memory requirements, and achieve the effect of reducing memory requirements
Active Publication Date: 2020-03-17
TENCENT TECH (SHENZHEN) CO LTD
View PDF6 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0004] Embodiments of the present invention provide a data processing method and a data processing device with relatively low memory requirements, low overall computational complexity, and high computational stability; to solve the memory requirements of existing data processing methods and data processing devices Higher, higher overall computational complexity, and poorer computational stability
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0037] Referring to the drawings, wherein like reference numerals represent like components, the principles of the present invention are exemplified when implemented in a suitable computing environment. The following description is based on illustrated specific embodiments of the invention, which should not be construed as limiting other specific embodiments of the invention not described in detail herein.
[0038] In the following description, specific embodiments of the present invention are described with reference to steps and symbols for operations performed by one or more computers, unless otherwise stated. Accordingly, it will be understood that the steps and operations, which at times are referred to as being performed by a computer, include manipulation by a computer processing unit of electronic signals representing data in a structured form. This manipulation transforms the data or maintains it at a location in the computer's memory system that can reconfigure or ot...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The present invention provides a data processing method, which includes: reading processed data, and obtaining a plurality of preset clustering centers of the processed data; classifying the processed data according to the plurality of preset clustering centers, and obtaining classified processed data ;Create multiple computing tasks that can be combined according to the classified post-processing data; use multiple computing threads to calculate the computing tasks that can be combined, and perform a merge operation on the calculation results; according to the combined calculation results, the preset clustering center performing correction and saving; and determining the data clustering processing result according to the preset cluster center, the corrected preset cluster center and the number of correction operations. The invention also provides a data processing device. The data processing method and data processing device of the present invention establish a plurality of computing tasks that can be combined, and save the preset clustering centers, thereby reducing the demand for memory, reducing the overall computing complexity and improving the stability of computing.
Description
technical field [0001] The invention relates to the field of data processing, in particular to a data processing method and a data processing device. Background technique [0002] With the rapid development of Internet technology, the amount of calculation for data processing is increasing. In order to improve data processing efficiency, a large amount of data will be clustered before data processing to improve data processing efficiency. [0003] However, the existing data processing process requires multiple iterations, such as loading all clustering data into memory, which requires high processing memory. When performing iterative operations at the same time, it is necessary to assign a variable to each data for labeling. When the amount of data is large, the overall computational complexity will also be high. In addition, the existing clustering calculations do not support the recovery calculation after the calculation is interrupted, which leads to high requirements o...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/62
CPCG06F18/23211G06F18/24137
Inventor 钱梦仁
Owner TENCENT TECH (SHENZHEN) CO LTD