Data processing method and device

A data processing and metadata technology, applied in the field of mobile communications, can solve the problems of relational database load, data redundancy, and unsatisfactory performance, and achieve the effect of ensuring response speed

Active Publication Date: 2014-06-11
XINYANG BRANCH HENAN CO LTD OF CHINA MOBILE COMM CORP
View PDF5 Cites 16 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] 1. Due to the large number of customers in the mobile communication industry, although the massive customer attribute data based on relational database storage has been optimized for query, the performance is still not ideal, and it is easily affected by the load of the relational database. The response sp

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device
  • Data processing method and device
  • Data processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0028] Example one

[0029] The first embodiment of the present invention provides a data processing method, and the step flow of the method can be as follows figure 2 Shown, including:

[0030] Step 101: Perform data conversion.

[0031] In order to write the full amount of customer attribute data into the memory, in this step, for each customer information table in the data warehouse, the customer information table can be periodically converted into a file to be cached. The file to be cached includes a metadata file and a customer data file. The metadata file includes table structure information of the customer information table. The customer data file includes each piece of customer information and one piece of customer information in the customer information table. Includes at least one customer attribute data corresponding to the customer attribute.

[0032] Step 102: Perform data loading.

[0033] In this step, the metadata file and the customer data file may be loaded into a d...

Example Embodiment

[0049] Embodiment two

[0050] The second embodiment of the present invention provides a data processing device. The structure of the device may be as follows Figure 4 Shown, including:

[0051] The conversion module 11 is configured to periodically convert each customer information table in the data warehouse into a file to be cached, and the file to be cached includes a metadata file and a customer data file. The metadata file Including table structure information of the customer information table, the customer data file includes each piece of customer information in the customer information table, and one piece of customer information includes customer attribute data corresponding to at least one customer attribute;

[0052] The loading module 12 is configured to load the metadata file and the customer data file converted by the conversion module to the distributed cache system.

[0053] The loading module 12 is specifically configured to load the metadata file into the distribute...

Example Embodiment

[0059] Embodiment three

[0060] The third embodiment of the present invention provides a method for loading customer attribute data. The schematic flow chart of the method may be as follows Figure 5 As shown, the conversion module in the data processing device can periodically extract the customer information table from the data warehouse and convert the customer information table into a cache file. The loading module can read the cache file converted by the conversion module and store the The cache file is loaded into the distributed cache system.

[0061] The method can specifically include the following steps, such as Image 6 Shown:

[0062] Step 201: Perform data conversion.

[0063] For each customer information table in the data warehouse, the customer information table can be periodically converted into a file to be cached. The files to be cached include metadata files and customer data files. The metadata file may include a piece of metadata, which represents the table st...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

An embodiment of the invention provides a data processing method and device. Each client information table in a database is converted into metadata files carrying table structure information and client data files carrying client information in the table periodically, and total client attribute data are loaded to a distributed cache system actively by loading the metadata files and the client data files to the distributed cache system. By means of the method and the device, mass client attribute data are cached through the distributed cache system, so that the response speed, the throughput and the stability of client attribute data providing can be effectively guaranteed.

Description

technical field [0001] The present invention relates to the technical field of mobile communication, in particular to a data processing method and device. Background technique [0002] In the business analysis system, various customer-level data scattered in various systems are reorganized and reasonably classified through customer attribute services to form customer attribute data sets, business operation support system (BOSS), customer service system, and outbound call management system , marketing management system, handheld business analysis system and other application systems need to realize efficient and reliable access to different customer attribute data through customer attribute services. [0003] In order to meet the access requirements of the application system, the existing customer attribute service develops a corresponding customer attribute summary program according to the requirements of each application system, periodically summarizes the corresponding cus...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/27G06F16/283
Inventor 杜怀忠李明崔刚高啸颖杨晓博李远
Owner XINYANG BRANCH HENAN CO LTD OF CHINA MOBILE COMM CORP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap