A data processing method and system

A data processing and data technology, applied in the computer field, can solve the problem of large consumption of storage resources, and achieve the effect of reducing the consumption of storage resources

Active Publication Date: 2020-12-08
CHINA MOBILE SUZHOU SOFTWARE TECH CO LTD +1
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0009] The embodiment of the present invention provides a data processing method and system to solve the technical problem of large consumption of storage resources in the prior art when storing massive concurrent log data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data processing method and system
  • A data processing method and system
  • A data processing method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0054] See figure 2 , an embodiment of the present invention provides a data processing method, which can be used as figure 1 In the data processing system shown, the execution process of the method can be described as follows:

[0055] S101: Obtain multiple business log files; wherein, each business log file includes multiple business log data, and each business log data includes terms and term feature information for representing business operations;

[0056] S102: Analyze a plurality of business log files, establish a mapping file, and the mapping file is used to indicate the relationship between the terms of each business log data and the feature information of the terms in the plurality of business log data included in each business log file Mapping relations;

[0057] S103: Perform data reorganization on each business log data based on the mapping file, and obtain and store the file data set to be stored; wherein, the number of terms of each piece of file data in the ...

Embodiment 2

[0100] See Figure 5 , based on the same inventive concept, an embodiment of the present invention provides a data processing system, including a data source module 51 , a file data compression module 52 and a file data recovery module 53 .

[0101] Wherein, the data source module 51 can be used to obtain a plurality of business log files, each business log file includes a plurality of business log data, and each business log data includes terms and term feature information for representing business operations;

[0102] The file data compression module 52 is configured to analyze the plurality of business log files, and establish a mapping file, and the mapping file is used to indicate each business log data in the plurality of business log data included in each business log file. The mapping relationship between terms and term feature information;

[0103] The file data recovery module 53 is configured to perform data reorganization on each of the business log data based on th...

Embodiment 3

[0111] See Figure 6 , based on the same inventive concept, an embodiment of the present invention provides a data processing system, including at least one processor 61, a memory 62 and a communication interface 63 communicating with the at least one processor 61, Figure 6 In the figure, one processor 61 is shown as an example.

[0112] Wherein, the memory 62 stores instructions that can be executed by the at least one processor 61, and the at least one processor 61 executes the instructions stored in the memory 62 by using the communication interface 63 to execute the instructions in the first embodiment. the method described.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a data processing method and a data processing system, which are used for solving the technical problem that in the prior art, when massive log data are storedunder large concurrency, the consumption of storage resources is relatively high. The method comprises the following steps: obtaining a plurality of business log files; Wherein each business log filecomprises a plurality of pieces of business log data, and each piece of business log data comprises lexical items used for representing business operation and lexical item feature information; Analyzing the plurality of business log files, and establishing a mapping file, the mapping file being used for indicating a mapping relationship between the lexical item and the lexical item feature information of each piece of business log data in the plurality of pieces of business log data included in each business log file; Performing data recombination on each piece of business log data based on the mapping file, and obtaining and storing a to-be-stored file data set; Wherein the number of the lexical items of each piece of file data in the to-be-stored file data set is smaller than or equal to the number of the lexical items of each piece of business log data.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a data processing method and system. Background technique [0002] In today's business support field, many business support systems in operation, such as customer relationship management (Customer Relationship Management, CRM), business operation support system (Business Operation Support System, BOSS), business analysis support system (Business Analysis Support System, BASS) And other systems, with the continuous online operation of the business support system and the continuous increase in business volume, business log data is gradually accumulated. These massive data contain rich information, and the extraction and analysis of this information is the key for operators. It is an important guarantee for the efficient operation and control of the system. The traditional use of relational databases to store business logs can better complete the storage and retrieval of ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/17G06F16/18
Inventor 邓杰
Owner CHINA MOBILE SUZHOU SOFTWARE TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap