Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method for processing mass data based on SQL like function of file

A technology of massive data and files, applied in data exchange network, electronic digital data processing, special data processing applications, etc., can solve the problems of untimely data, incomplete data, incomplete data, etc. The effect of strong expansion ability

Inactive Publication Date: 2009-12-02
INSPUR TIANYUAN COMM INFORMATION SYST CO LTD
View PDF0 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In addition, the large data volume operation of the data summary itself occupies a large amount of resources of the database itself, which weakens the ability of the database to provide services to users; the delay of data generation leads to differences in the triggering of data summary, which may lead to incomplete data
All database-based optimization and operations are inseparable from the database; the limitations of database operations lead to untimely and incomplete data and weak ability to provide external services

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for processing mass data based on SQL like function of file
  • Method for processing mass data based on SQL like function of file
  • Method for processing mass data based on SQL like function of file

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0069] A method for processing massive data based on file-like SQL functions of the present invention will be further described below in conjunction with the accompanying drawings and specific embodiments.

[0070] The file-based data processing scheme makes full use of the current computer hardware, and puts the data to be processed into the memory for processing through the array, so that the speed of data processing is greatly accelerated. Arrays are a common way to process variables in programs, but arrays are generally arranged based on numbers, and it is impossible to directly find the name of the variable to be processed (usually by traversing the array and comparing it with the corresponding value); the hash array introduced in this program To avoid this shortcoming, you can directly use variables as the subscript of the array to distinguish and arrange the data. The use of hash arrays makes it convenient and flexible to operate directly on variables, and speeds up dat...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to the field of data processing in telecommunication network, and in particular provides a method for processing mass data based on the SQL like function of a file. The method for processing the mass data based on the SQL like function of the file comprises the following steps: A, carrying out standardized format treatment on a text file generated after acquiring; B, processing the mass data based on the standardized text file, and performing related data operation in a mode of SQL like statements; and c, defining and outputting the operating result as a final result and an intermediate result, and continuing performing data operation on the file until the requirement of the result is met when the intermediate result accords with the standardized format. The method combines the respective advantages of the file and a database mode, ensures the high efficiency of mass data processing, has quite convenient and flexible operation and has strong expansion capability.

Description

technical field [0001] The invention relates to the field of data processing in telecommunication networks, and specifically provides a method for processing massive data based on file-like SQL functions. Background technique [0002] The development of computer technology is synchronized with the adaptation of data processing, and they promote each other. The initial data processing existed in the form of data files: storing data in files has many disadvantages, such as inconvenient operation, non-reusability, and lack of standards. Therefore, various relational databases have been produced in the development process, which has promoted the development of data processing applications. [0003] For the processing of massive data, according to the characteristics of the data, selecting the corresponding processing method is the key to improving the processing efficiency. At present, the measures to improve the efficiency of massive data processing mainly include: [0004] ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30H04L12/24
Inventor 祝乃国
Owner INSPUR TIANYUAN COMM INFORMATION SYST CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com