A high-capacity data statistical method and system
A technology for accessing data and data statistics, which is applied in the field of statistical methods and systems for large-capacity access data to achieve the effect of improving efficiency and making statistics easy
Active Publication Date: 2011-09-21
TENCENT CLOUD COMPUTING BEIJING CO LTD
View PDF0 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0005] The purpose of the embodiments of the present invention is to provide a statistical method for large-capacity access data, aiming to solve the problem in the prior art that it is difficult to make statistics on large-capacity access data due to the limitation of device performance
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0018] In order to make the objectives, technical solutions, and advantages of the present invention clearer, the following further describes the present invention in detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention, but not to limit the present invention.
[0019] In the embodiment of the present invention, according to a user's access operation to a certain service provided by the network, access data corresponding to the access operation is generated, and the generated access data is randomly distributed to multiple shard servers, and the shard server responds to the access data. Perform fragmentation processing to obtain access data composed of keywords and values. According to the keywords of the access data, the access data is allocated to the protocol server. The protocol server performs protocol and statistics on the access data to obtain...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention is applicable to the data processing field, and provides a statistical method of large volume access data and the system thereof. The method includes the following steps: distributing the large volume access data to one or a plurality of slicing server(s); performing slicing process to the large volume access data by the slicing server to obtain the access data which is composed of a key word part and a value part, and distributing the access data after the slicing process to a code server according to the key word part of the access data composed of the key work part and the value part; coding and accounting the access data after the slicing process by the code server to obtain the statistical data of the access data after the slicing process. Through the adoption of the distributed processing environment, the embodiment of the invention can make full use of a great mass of spare network resources, account easily the large volume access data, as well as exert fully the parallelism of the data processing, and improve the processing efficiency.
Description
Technical field [0001] The invention belongs to the field of data processing, and in particular relates to a statistical method and system for large-capacity access data. Background technique [0002] With the development of computer and network communication technology, the network has also become the main tool for people to communicate in work and life. There are also many large-capacity visit data that need to be counted on the Internet, such as web browsing data, website browsing data or registration data, and online advertising browsing data. Due to the huge amount of access data, the performance requirements of the database management system used to store these large-capacity access data and the statistical equipment (such as computers) used to count these large-capacity access data are very high, even with web pages With the increase in the number of views of websites and online advertisements, the performance of a single data statistics device cannot meet the statistical...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06Q30/00G06F17/30
Inventor 吴双谢建东黄明生林志亮徐盎谢明沈丽莉祁洪辉
Owner TENCENT CLOUD COMPUTING BEIJING CO LTD