Unlock instant, AI-driven research and patent intelligence for your innovation.

File reading and writing parallel processing method combining with semaphore

A parallel processing and semaphore technology, applied in the direction of concurrent instruction execution, machine execution devices, etc., can solve the problem of increased computer memory consumption, achieve the effect of reducing memory consumption and improving usage efficiency

Inactive Publication Date: 2012-11-28
TIANJIN UNIV
View PDF3 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

When the scale of data to be processed by the application problem becomes larger and the dependencies between subtasks become more complicated, the consumption of computer memory will also increase

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • File reading and writing parallel processing method combining with semaphore
  • File reading and writing parallel processing method combining with semaphore

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0014] The specific implementation, structure, features and effects provided by the present invention will be described in detail below in conjunction with the accompanying drawings and preferred embodiments.

[0015] The present invention builds on a large-scale dataset parallel programming model for DAG data-dependent applications. Different from the previous DAG data-dependent programming model, in order to deal with the calculation of large-scale data, the present invention innovates the processing of data synchronization and sharing in file reading and writing, which is mainly realized by combining semaphore and file reading and writing data sharing and indirect transfer.

[0016] The process of writing a file is regarded as the process of sending a message in message passing, and the process of reading a file is regarded as the process of receiving a message in message passing. However, unlike message passing, in the process of reading and writing files, it is necessary...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a file reading and writing parallel processing method combining with semaphore. The file reading and writing parallel processing method is executed in a Linux multi-core environment. The file reading and writing parallel processing method comprises the following steps of: carrying out data synchronizing and sharing processing on file reading and writing: carrying out file writing operation by combining empty semaphore with an initial value being 1 when a file is written; carrying out p operation on semaphore empty before the file writing is started, and carrying out v operation on semaphore full after the file writing is completed; and carrying out p operation on the semaphore full in a process before the file reading is started, and carrying out the v operation on the semaphore empty after data reading is completed. Compared with the prior art, a novel data synchronizing and sharing processing manner is utilized for solving the DAG (directed acyclic graph) data dependence application problem of large-scale data sets, improving the use efficiency of an internal memory and reducing the consumption of the internal memory.

Description

technical field [0001] The invention relates to a parallel method for multi-process data synchronization and sharing. When faced with DAG data-dependent applications, the memory size cannot meet the calculation requirements of its large-scale data set, and the multi-process data synchronization and sharing method. Background technique [0002] Dividing the overall computing task into several subtasks is a means of parallelizing application problems. Among them, there is a dependency relationship between subtasks after a class of problems is divided, and we call this type of application DAG data-dependent applications. [0003] EasyPDP (Tang Shanjiang. Research and implementation of DAG-oriented data-dependent application system [D]. Tianjin: Tianjin University, 2010.) system is an operating system developed based on DAG data-driven model for multi-core shared storage environment, which solves the problem of multi-core sharing DAG data dependency application problem in stora...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F9/38
Inventor 孙济洲杜君于策孙超金舟王萌萌陈松
Owner TIANJIN UNIV