Distributed caching method and system for IOT scene
A distributed cache and scene technology, applied in database distribution/replication, special data processing applications, instruments, etc., can solve problems such as data inconsistency
Pending Publication Date: 2021-09-14
杭州数知梦科技有限公司
View PDF15 Cites 2 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Moreover, in a distributed business cluster, developers need to use algorithms such as CAS to solve the problem of data inconsistency caused by cache / database double-writing. The present invention provides a distributed cache based on Base theory that is more suitable for IOT scenarios method and system
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment 1
[0034] A distributed cache method for IOT scenarios (see attached figure 2 to attach Figure 4 ), including the following steps,
[0035]Step 1: Expose the Dubbo service interface to the outside world, and provide general query and processing of hotspot data and cache data of vehicle communication services. The scope search in the cache data query responds to the query request by matching the storage node that is most suitable for the query condition through the strategy, and provides methods including dubbo, kafka, and canal, and converts the input data into standard protocol data to change hot data, cache data;
[0036] Step 2: The change of hot data and cached data is realized by the execution engine in an asynchronous manner, and the data is stored in the disk in an asynchronous manner. In the query of cached data, there are two query forms, by parsing the query statement and adapting a responsibility link The engine that is most suitable for the query condition is use...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention relates to a distributed caching method for an IOT scene, and solves the problems in the prior art. The method is characterized by comprising the following steps: 1, exposing a Dubbo service interface to the outside, and processing hotspot data of a communication service of a vehicle-mounted machine in a general query and data change manner; 2, changing hot data and cache data, achieving two query forms of data in-disk storage and range search in query of the cache data in an asynchronous mode through an execution engine, and adapting to the engine most suitable for query conditions to query data through analysis of query statements and responsibility links; 3, in a distributed environment, if the cache data in-disk storage fails, for the condition of network waiting timeout, enabling an execution engine to realize a retry queue by maintaining Topic of kafka, and when a retry frequency configuration value is not successfully exceeded, regarding data updating as failure, and abandoning the updating command.
Description
technical field [0001] The present invention relates to a distributed caching method and system for IOT scenarios, in particular to a distributed caching method and system based on Base theory that are more suitable for IOT scenarios. Background technique [0002] Under the two business backgrounds of bus on-board machine communication and bus dispatching system, an on-board machine GPS message often triggers various technical scenarios involving data reading and writing, such as vehicle matching, vehicle location monitoring, and vehicle trip matching. Taking our current bus cloud intelligent dispatching communication platform as an example, the operating buses in Hangzhou, Shangrao, and Weihai need to process more than 2 million vehicle-mounted GPS messages per minute during morning and evening peak hours. If the read and write operations of this batch of data are all implemented through the database, the following problems will arise: [0003] Low resource utilization: Ma...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More IPC IPC(8): G06F16/2455G06F16/2457G06F16/27
CPCG06F16/24552G06F16/24578G06F16/27Y02D10/00
Inventor 刘黎明刘美胜奇
Owner 杭州数知梦科技有限公司