Method and system for incremental data capture of batch vehicles

Abstract

The invention discloses a method and system for incremental data capture of batch vehicles, and the method comprises the steps: a server side obtains a hash key corresponding to a vehicle machine ID after receiving a vehicle storage request which is sent by a vehicle storage terminal and comprises the vehicle machine ID and vehicle information, and stores the vehicle information in an Hbase partition corresponding to the hash key; when the server side receives an incremental data capture request of batch vehicles containing a data capture time period sent by a vehicle query terminal, querying a hash key corresponding to the data capture time period; and the server side captures incremental capture data results of the batch vehicles from the Hbase partition corresponding to the hash key by using the hash key and the data capture time period, and sends the captured incremental capture data results of the batch vehicles to the vehicle query terminal.

Description

technical field [0001] The invention relates to the field of communication technology, in particular to a method and system for incrementally capturing data of batch vehicles. Background technique [0002] In order to better maintain and monitor the operation of the vehicle, the electric vehicle continuously sends data to the data center through the on-board machine, and the data includes vehicle condition data, location data, on-board battery data, etc. The daily incremental data will reach tens of millions or billions. In order to store these data more efficiently, conveniently, and continuously, the data center will store it in Hbase (a distributed, column-oriented open source database) after receiving and analyzing the data results. [0003] In order to avoid problems such as data hotspots, Hbase generally distributes and stores data in multiple partitions. In this case, pre-partitioning or secondary indexes are generally used to search accurately, and subsequent analy...

AI Technical Summary

Problems solved by technology

[0004] 1. The secondary index needs to maintain a set of indexes with the same data volume level;

[0005] 2. The car ID needs to be generated according to the structure of linear distribution and increment, but in the actual scene, the car ID is generally assigned directly from the factory and not incremented;

[0006] 3. When incrementally capturing all vehicles in batches, since the ID of the vehicle is not fixed, there are too many data to be filtered and the processing time is too long;

[0007] 4. When switching analysis scenarios, it is necessary to rewrite the application program, etc.

Images