Method for processing mass data based on SQL like function of file

A technology of massive data and files, applied in data exchange network, electronic digital data processing, special data processing applications, etc., can solve the problems of untimely data, incomplete data, incomplete data, etc. The effect of strong expansion ability

Inactive Publication Date: 2009-12-02
INSPUR TIANYUAN COMM INFORMATION SYST CO LTD
View PDF0 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In addition, the large data volume operation of the data summary itself occupies a large amount of resources of the database itself, which weakens the ability of the database to provide services to users; the delay of data generation leads to differences in the t

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for processing mass data based on SQL like function of file
  • Method for processing mass data based on SQL like function of file
  • Method for processing mass data based on SQL like function of file

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0069] The method for processing massive data based on the file-like SQL function of the present invention will be further described below with reference to the accompanying drawings and specific embodiments.

[0070] The file-based data processing scheme makes full use of the current computer hardware, and puts the data to be processed into the memory through an array for processing, which greatly accelerates the speed of data processing. Array is a common way to deal with variables in programs, but arrays are generally arranged based on numbers, and it is impossible to directly find the name of the variable that needs to be processed (usually by traversing the array and comparing it with the corresponding value); the hash array introduced in this solution To avoid this shortcoming, you can directly use the variable as the subscript of the array to distinguish and arrange the data. The use of hash arrays makes direct manipulation of variables convenient and flexible, and speeds u...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the field of data processing in telecommunication network, and in particular provides a method for processing mass data based on the SQL like function of a file. The method for processing the mass data based on the SQL like function of the file comprises the following steps: A, carrying out standardized format treatment on a text file generated after acquiring; B, processing the mass data based on the standardized text file, and performing related data operation in a mode of SQL like statements; and c, defining and outputting the operating result as a final result and an intermediate result, and continuing performing data operation on the file until the requirement of the result is met when the intermediate result accords with the standardized format. The method combines the respective advantages of the file and a database mode, ensures the high efficiency of mass data processing, has quite convenient and flexible operation and has strong expansion capability.

Description

technical field [0001] The invention relates to the field of data processing in telecommunication networks, and specifically provides a method for processing massive data based on file-like SQL functions. Background technique [0002] The development of computer technology is synchronized with the adaptation of data processing, and they promote each other. The initial data processing existed in the form of data files: storing data in files has many disadvantages, such as inconvenient operation, non-reusability, and lack of standards. Therefore, various relational databases have been produced in the development process, which has promoted the development of data processing applications. [0003] For the processing of massive data, according to the characteristics of the data, selecting the corresponding processing method is the key to improving the processing efficiency. At present, the measures to improve the efficiency of massive data processing mainly include: [0004] ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30H04L12/24
Inventor 祝乃国
Owner INSPUR TIANYUAN COMM INFORMATION SYST CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap