Supercharge Your Innovation With Domain-Expert AI Agents!

File processing method and device based on big data

A technology of data processing and file processing, applied in the computer field, can solve the problems of high coupling between business and technology of file processing methods, and achieve the effect of improving and enhancing data processing capability, reducing dependence, and reducing difficulty

Pending Publication Date: 2021-02-26
CHINA CONSTRUCTION BANK
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In view of this, the embodiment of the present invention provides a big data-based file processing method and device, which can solve the problem of high coupling between business and technology in the existing file processing methods

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • File processing method and device based on big data
  • File processing method and device based on big data
  • File processing method and device based on big data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0056] Exemplary embodiments of the present invention are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present invention to facilitate understanding, and they should be regarded as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

[0057] In the mainframe environment, data sets are generally processed through DFSort. When the system is migrated to an open environment, it is necessary to find a capability to support offline batch business processing. In an open environment, there are two ways to process a large amount of data: one is to use the SQL (Structured Query Language) capability of the databas...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a file processing method and device based on big data, and relates to the technical field of computers. One specific embodiment of the file processing method based on the big data comprises the following steps: analyzing data processing parameters and file parameters from a file processing model used for defining parameters required by file processing, wherein the file parameters are parameters related to an input file and an output file; calling a corresponding processor according to the data processing parameters, carrying out data processing on an input file of the file parameters, and writing a result obtained by processing into the output file. According to the embodiment, the file processing capacity can be packaged based on big data, applications and technologies can be isolated, and application developers can develop and implement big data technologies without mastering specific big data development technologies and tools.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a method and device for processing files based on big data. Background technique [0002] Due to the high coupling of business and technology in the existing file processing methods, the file processing process needs to be customized and developed, and developers are required to master some kind of big data technology. If the technology is iteratively updated, it will be difficult to migrate and upgrade. Contents of the invention [0003] In view of this, the embodiments of the present invention provide a method and device for processing files based on big data, which can solve the problem of highly coupled business and technology in existing file processing methods. [0004] To achieve the above purpose, according to an aspect of the embodiments of the present invention, a method for processing files based on big data is provided. [0005] The file processing method based ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/13G06F8/35G06F16/14G06F16/16G06F16/182
CPCG06F16/13G06F16/14G06F16/182G06F16/16G06F8/35
Inventor 张浩陈军
Owner CHINA CONSTRUCTION BANK
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More