Data model processing method based on Spring Data for MongoDB cluster

A processing method and data model technology, applied in the direction of electronic digital data processing, special data processing applications, structured data retrieval, etc., can solve the problems of storing unstructured data and processing hierarchical structure data, etc., to achieve high availability, detailed The effect of dividing granularity and improving query efficiency

Inactive Publication Date: 2016-09-21
JIANGSU CAS JUNSHINE TECH
View PDF3 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Solve the very difficult problem of storing unstructu

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data model processing method based on Spring Data for MongoDB cluster
  • Data model processing method based on Spring Data for MongoDB cluster

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0013] The present invention will be further described below in conjunction with specific drawings and embodiments.

[0014] Below in conjunction with embodiment the present invention is further described.

[0015] 1. Spring Data for MongoDB infrastructure configuration

[0016] The main purpose of Spring Data templates, and the purpose of all other Spring templates, is resource allocation and exception handling. The resources mentioned here are data storage resources, which are usually accessed through remote TCP / IP connections. The following example shows how to configure MongoDB templates in XML:

[0017]

[0018]

[0019]

[0020]

[0021]

[0022] First, you need to define a connection factory, which will be referenced by MongoTemplate. In this example, Spring Data uses a lower-level database driver, MongoDB Java driver.

[0023] Generally speaking, such lower-level database drivers will have their own set of exception handling strategies. Spring's...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data model processing method based on Spring Data for a MongoDB cluster, in particular to a data processing method of a distributed cluster MapReduce. A MongoDB document-oriented NoSQL (Structured Query Language) database is used as bottom data storage, the data of other documents is quoted through the virtual union query of a client side to solve the problem of the union query of unstructured data; data processing adopts a Map/Reduce computational frame provided by the Spring Data for a MongoDB, and a MapReduce task can carry out data concurrent processing on a plurality of nodes so as to improve system processing speed; and on a data storage aspect, the long-term operation of mass data storage service provides a data center of high availability and expansibility. The high-availability data cluster which supports horizontal and longitudinal expansion is designed by the MongoDB technology, a compound key of double fields is used for optimization, so that the operation of CRUD (Create, Retrieve, Update and Delete) can utilize locality to improve query efficiency and support cloud-level flexibility.

Description

technical field [0001] The invention relates to a data model processing method based on Spring Data for MongoDB cluster, in particular to a data processing method of distributed cluster MapReduce. Background technique [0002] The characteristics of data in the era of big data are mainly manifested in the problems of various data formats, large quantities, unstructured, and lack of unified storage management. Scale data becomes a key issue. When using relational database storage, its disadvantages are: when the data is stored to a certain stage, the efficiency of SQL query (or multi-table connection query) in a database table with hundreds of millions of records is extremely low; it is difficult to expand horizontally, The requirements for scalability and high availability are difficult to meet; the relational model is currently the most widely used organizational model, but it is very difficult to use this model to store unstructured data and process hierarchical data, and...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/27G06F16/24532G06F16/2471
Inventor 王祥张海英胡冰
Owner JIANGSU CAS JUNSHINE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap