A performance optimization method for hash table concurrent access in multi-core environment
A technology for access performance and optimization methods, applied in concurrent instruction execution, instrumentation, computing, etc., can solve the problems of high concurrent connection processing, lock competition, cache consistency overhead and system scalability, so as to improve network IO efficiency and reliability The effect of scalability and uniform distribution of data
Active Publication Date: 2017-07-07
HUAZHONG UNIV OF SCI & TECH
View PDF2 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Its purpose is to solve the technical problems of high concurrent connection processing, lock contention, cache consistency overhead and system scalability in existing methods
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0025] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention. In addition, the technical features involved in the various embodiments of the present invention described below can be combined with each other as long as they do not constitute a conflict with each other.
[0026] The overall structure of the system is as figure 1 As shown, a hash table concurrent access performance optimization method under a multi-core environment of the present invention includes the following technical features:
[0027] (1) For the concurrent connection processing of high concurrent access to the hash table, a semi-synchronous and semi-asynchronous network connection processi...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a hash table concurrent access performance optimization method in a multi-core environment, comprising: for concurrent connection processing of high concurrent access to hash tables, adopting a semi-synchronous and semi-asynchronous network connection processing mechanism; for high concurrent access of hash tables For concurrent data processing, the hash table is divided into multiple independent sub-hash tables according to the number of CPU cores. Each worker thread corresponds to an independent sub-hash table one by one. Each worker thread is only responsible for processing its own corresponding The data of the sub-hash table; the main thread selects the corresponding worker thread to process according to the Key of each data using a consistent hash strategy; each sub-hash table maintains an LRU queue. When the memory space is insufficient, cold data is removed and new data is inserted. Elements. The method of the invention improves the concurrent connection processing capability and the concurrent access capability of the hash table, and at the same time eliminates the problems of synchronous overhead and cache consistency overhead when multiple threads access the shared hash table.
Description
technical field [0001] The invention belongs to the field of performance optimization of multi-core software, and more specifically relates to a method for optimizing concurrent access performance of a hash table in a multi-core environment. Background technique [0002] A hash table is a commonly used data structure that accesses records by mapping a key value to a location in the table to speed up lookups. Due to its high search efficiency, it is widely used in practical applications such as storage systems and search engines, such as hash indexes in databases and hash table structures in cache systems. A single-core processor improves the performance of the processor by increasing the main frequency, but the resulting power consumption and heat dissipation problems have become a bottleneck for further improvement of the processor speed. Subsequently, processor manufacturers began to expand the CPU horizontally, integrating multiple computing cores on one processor, that ...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06F9/38G06F12/123G06F12/0842G06F12/0884
Inventor 郑然金海王文瑾章勤贾金莉
Owner HUAZHONG UNIV OF SCI & TECH