A method and apparatus for processing documents

A file processing and file technology, applied in the direction of electrical digital data processing, special data processing applications, electrical components, etc., can solve the problems of processing results errors, processing inconvenience, etc., to achieve convenient processing, avoid wrong results, and facilitate effective use Effect

Active Publication Date: 2019-02-22
PLA STRATEGIC SUPPORT FORCE INFORMATION ENG UNIV PLA SSF IEU
View PDF7 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The inventor found through research that if the task files are simply divided according to the above ideas and then distributed to each distributed node, it may bring some inconvenience in processing, or even cause errors in processing results

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method and apparatus for processing documents
  • A method and apparatus for processing documents
  • A method and apparatus for processing documents

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0049] refer to figure 1A schematic flow chart of the file processing method shown, the method includes the following steps:

[0050] Step 101 , analyzing dependencies among files included in the task to be processed.

[0051] The task to be processed may be, but not limited to, project source code to be processed (such as to be compiled). This application will mainly use the project source code to be processed as an example to describe the file processing method of this application in detail.

[0052] The project source code often includes multiple source code files, and multiple source code files form a project with corresponding functions through a certain organizational structure. In view of this, in this step, for the project source code to be processed, it can be analyzed specifically. Dependencies between source code files.

[0053] The following is an example of the dependency relationship. For example, assuming that the variables defined in the B file need to be ref...

Embodiment 2

[0071] Corresponding to the file processing method in the first embodiment above, the second embodiment of the present application also provides a file processing device, refer to Figure 4 Shown is a schematic structural diagram of a file processing device, which includes an analysis unit 401, a classification and information recording unit 402, a distribution unit 403, and a result processing unit 404, wherein:

[0072] The analysis unit 401 is configured to analyze the dependencies among the files included in the task to be processed.

[0073] The task to be processed may be, but not limited to, project source code to be processed (such as to be compiled). This application will mainly use the project source code to be processed as an example to describe the file processing method of this application in detail.

[0074] The project source code often includes multiple source code files, and multiple source code files form a project with corresponding functions through a certa...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The document processing method and apparatus provided by the present application. The method comprises the following steps: Classifying the files of the task according to the dependency relationship among the files of the task, Classifying the files with dependency relationship into the same category, distribute the files on the basis of the classification, and distributing the files divided intothe same category to the same node of the distributed cluster. As such, based on that scheme of the present application,ensuring that individual files in the task that have dependencies are distributed to the same node in the cluster, Correspondingly, there is no dependency between the files of different nodes in the cluster, which brings convenience to the processing of the files by the nodes, eliminates the need of cross-node reference, effectively avoids the error results of the nodes in the distributed system, and is more conducive to the effective utilization of the computing resources inthe distributed system.

Description

technical field [0001] The invention belongs to the fields of distributed computing, network communication and network security, and in particular relates to a file processing method and device. Background technique [0002] With the advent of the "Internet +" era, the network not only has a profound impact on people's lifestyles, but also poses a severe challenge to the computing power of servers. More and more enterprises are deploying back-end servers to distributed systems, using the power of distributed computing to break through the bottleneck of development. [0003] For some real-time large-scale batch computing tasks, how to quickly and efficiently distribute files plays a vital role in making full and efficient use of computing resources. In view of this, we are currently committed to realizing efficient file distribution in a distributed environment, and specifically by decomposing the problem into small problems, using ideas such as divide and conquer and pipeli...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/182H04L29/08
CPCH04L67/104
Inventor 张铮潘传幸邬江兴王晓梅王俊超谢光伟王立群李卫超刘镇武
Owner PLA STRATEGIC SUPPORT FORCE INFORMATION ENG UNIV PLA SSF IEU
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap