Distributed storage method and system for checkpoint vehicle pass data

A distributed storage and distributed technology, applied in the field of bayonet passing information data storage, can solve the problems that cannot guarantee the writing efficiency and query efficiency, and affect the real-time response, so as to achieve high availability, enhance user experience, and improve query speed effect

Inactive Publication Date: 2015-03-25
ANHUI SUN CREATE ELECTRONICS
View PDF2 Cites 21 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although the existing bayonet system implemented by traditional database storage can record a certain amount of passing information, when the recorded data flow reaches a certain order of magnitude, it cannot guarant

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed storage method and system for checkpoint vehicle pass data
  • Distributed storage method and system for checkpoint vehicle pass data
  • Distributed storage method and system for checkpoint vehicle pass data

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0028] A distributed storage method for bayonet vehicle traffic data, comprising: first, configuring computing nodes and data node servers, setting up a parallel computing cluster environment, installing data access middleware that matches the version of the cluster environment, and using Apache Phoenix data access middleware to The SQL statement of the traditional database is compiled into the operation statement required for HBase storage, which speeds up the development efficiency and reduces the difficulty of development; secondly, a table structure is established according to the characteristics of the vehicle to be collected, and at least two characteristics are selected as the primary key in the table structure. The primary key forms a piece of bayonet data information; again, a distributed variable index is established for the primary key and common query fields, such as vehicle speed, and then a distributed search index is established for the license plate number; then,...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a distributed storage method for checkpoint vehicle pass data. The method includes the steps that servers of computational nodes and data nodes are configured and a concurrent computation cluster environment is erected; a list structure is established according to vehicle features needing to be collected, at least two features are selected from the list structure to serve as main keys, and a piece of checkpoint data information is composed of the main keys; a distributed variable index is established for the main keys and commonly-used inquiry fields and a distributed retrieval index is established for license plate numbers; vehicle pass information data sources to be stored of all checkpoints are input; a user inquires the data through the fields containing the indexes and the corresponding data are returned by a system within 100 ms. The invention further discloses the distributed storage system for the checkpoint vehicle pass data. According to the method and device, the requirement for massive vehicle pass information data storage of a checkpoint system used for daily services is met, the index data structure of the data structure of vehicle pass information is designed to achieve the rapid inquiry function, the inquiry rate is greatly increased, and user experience is enhanced.

Description

technical field [0001] The invention relates to the technical field of bayonet passing information data storage technology, in particular to a method and system for distributed storage of bayonet vehicle passing data. Background technique [0002] With the advancement of the Safe City project, more and more data sources need to be connected to the checkpoint system. Currently, Ping An Hefei adds about 400,000 pieces of checkpoint data every day, and has about 46 million pieces of historical data. Efficient storage And reading a large amount of data has become the bottleneck of the traditional database storage structure. Although the existing bayonet system implemented by traditional database storage can record a certain amount of vehicle passing information, when the recorded data flow reaches a certain order of magnitude, the writing efficiency and query efficiency cannot be guaranteed, which seriously affects the real-time response. In addition, traditional databases have...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/328G06F16/182G06F16/334
Inventor 王佐成刘春珲范联伟张跃周春寅王汉林余保华
Owner ANHUI SUN CREATE ELECTRONICS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products