High concurrency data storage method and device

一种数据存储、数据的技术，应用在数据处理领域，能够解决数据库链接多、服务器宕机、占用资源多等问题，达到提升存储效率、避免宕机的效果
CN104598563AActive Publication Date: 2015-05-06BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD +1
5 Cites 27 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD
Publication Date
2015-05-06

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention discloses a high concurrency data storage method and device. The method comprises the steps; receiving high concurrency data transmitted by a plurality of clients; pushing the high concurrency data to a main data queue, and responding to the corresponding client; consuming the high concurrency data in the main data queue by utilizing a multithread; fragmenting the high concurrency data according to the quantity of a local queue; pushing the fragmented high concurrency data to the local queue; consuming the high concurrency data in the local queue, and storing the high concurrency data into a database. The high concurrency data is cashed by utilizing the main data queue and the local queue, the data storage is carried out by adopting an asynchronous storage way, the pressure of the database is alleviated, the downtime problem of the database under the high concurrency storage situation can be avoided, and the storage efficiency of the high concurrency data can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] Embodiments of the present invention relate to data processing technologies, and in particular to a high-concurrency data storage method and device. Background technique

[0002] With the explosive growth of Internet information, more and more Internet servers will encounter the environment of high concurrency and massive data, and in this environment, they will face the problem of high concurrency data storage. In order to solve this problem, some NoSql (Not Only SQL, non-relational database) languages ​​such as Hadoop, MongoDB, and Hbase have been widely used.

[0003] However, for some old business systems, the cost of replacing new storage methods will be relatively high, so traditional relational databases are still used to store data, such as MySql, Oracle, etc. When the system is faced with high-concurrency data storage, it will lead to too many links to the database, occupying too many resources, reducing storage efficiency, and causing proble...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More