Load-oriented dynamic self-adaptive relation schema representation method for semi-structured JSON data

Abstract

The application discloses a kind of semi-structured JSON data's relational mode expression method for load dynamic adaptation, its characteristics are using the system architecture including storage layer and query layer and the multi-granularity analysis method of load sensing dynamic adaptation, realize the low online analysis overhead JSON data access, the storage layer includes: data storage and analysis, metadata storage, mode analyzer, column statistician and trigger;The query layer includes: data initialization loading module, mode viewing and query execution;The multi-granularity analysis of load sensing dynamic adaptation includes: determining resolution granularity, the frequency of statistical query access content, dynamically expanding the granularity of resolution, resolution granularity and the dynamic adaptation strategy of schema.The application has the resolution granularity of dynamic adjustment JSON data compared with prior art, reduces the overhead of data resolution and access in query process, improves the delay of query and the overall throughput of system, realizes the efficient access of JSON data.

Images