Data processing system, data processing method, and program

The data processing system addresses reliability and load issues by checking for file changes before transfer, ensuring accurate data replication and efficient processing.

JP2025155280APending Publication Date: 2025-10-14NIPPON STEEL CORPORATION
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
JP2024059023
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-04-01
Publication Date
2025-10-14

AI Technical Summary

Technical Problem

Existing data processing technologies face issues with decreased reliability in secondary storage and increased processing load due to mismatched data changes and the need for sequential address logging during data transfer, leading to delays and inefficiencies.

Method used

A data processing system that includes a determination mechanism to check for file changes on a per-file basis before transferring data from a first storage to a second storage, using setting information like timestamps to ensure data integrity and reduce unnecessary processing.

Benefits of technology

Prevents data mismatches and reduces processing load by ensuring only unchanged data is transferred, maintaining reliability and enabling real-time control without excessive file locking or sequential logging.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025155280000001_ABST
    Figure 2025155280000001_ABST
Patent Text Reader

Abstract

To store a file stored in first storage means into second storage means while suppressing decrease in reliability of the file stored in the second storage means, and also suppressing increase in processing loads of processing means that uses the first storage means.SOLUTION: A first data processing device 110 determines, on a file-by-file basis, whether or not a first file stored in a first storage unit 115 has been modified after reading of the first file stored in the first storage unit 115 is started. A second data processing device 120 controls to store the first file as a second file in a second storage unit 124 based on the determination results.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present disclosure relates to a data processing system, a data processing method, and a program. [Background technology]

[0002] There is a technology that allows data stored in both the first storage means and the second storage means to be used by storing the data stored in the first storage means in the second storage means as well. There is also a technology that allows the data stored in the first storage means to be used even when storing data in the second storage means by not restricting access to the data stored in the first storage means. Examples of such a technology include those described in Patent Documents 1 and 2.

[0003] Patent Document 1 discloses the following technology. First, when starting a backup of a database recorded in a first large memory, the database in the first large memory is copied to temporary storage means. Also, information on accesses made to the database while the database is being copied to the first large memory is recorded. Then, when copying of the database in the first large memory is completed, update data for the database made during the copy is obtained, and the database copied to temporary storage means is updated based on the update data. Then, a backup file is generated in a second large memory based on the updated database.

[0004] Patent Document 2 discloses the following technology: First, when data copy processing is performed in parallel with processing by a data processing means, the address of the block of the file accessed by the data processing means is stored. Then, if the data processing means updates or adds data to a copied block during the copy process, the block of the source file indicated by the address of the updated or added data is recopied to the destination file. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Publication No. 7-13829 [Patent Document 2] Japanese Unexamined Patent Publication No. 1-230147 Summary of the Invention [Problem to be solved by the invention]

[0006] However, with the technology described in Patent Document 1, if the database in the first large memory is changed after the database in the first large memory is copied, the change is not reflected in the second large memory. In this case, the data in the first large memory and the data in the second large memory do not match. This may result in a decrease in the reliability of the data in the second large memory. Furthermore, with the technology described in Patent Document 1, the location and content of writes performed on the first large memory must be sequentially stored as an access log. This increases the processing load. This may result in delays in processes other than the backup performed using the first large memory.

[0007] Furthermore, in the technology described in Patent Document 2, blocks of a file accessed by the data processing means during the copy process are always recopied. Therefore, if the data in the recopied blocks is incorrect, the file itself will also become incorrect. This may result in a decrease in the reliability of the file (a specific example of this point will be described later with reference to FIGS. 8A to 8D). Furthermore, in the technology described in Patent Document 2, it is necessary to sequentially store the addresses of blocks of a file accessed by the data processing means. Therefore, as with the technology described in Patent Document 1, the processing load increases. This may result in delays in processes other than the copy performed using the source file.

[0008] As described above, in the techniques described in Patent Documents 1 and 2, when data stored in a first storage means is stored in a second storage means, there is a risk that the reliability of the data stored in the second storage means will decrease, and there is also a risk that the processing load on the processing means that uses the first storage means will increase.

[0009] The present disclosure has been made in consideration of the above-mentioned problems, and aims to suppress a decrease in the reliability of files stored in a second storage means when storing files stored in a first storage means in a second storage means, and to suppress an increase in the processing load of a processing means that uses the first storage means. [Means for solving the problem]

[0010] The data processing system of the present disclosure comprises a first reading means for reading first storage data stored in a first storage means, a storage control means for controlling the storage of the first storage data read by the first reading means in a second storage means as second storage data, and a determination means for determining on a file-by-file basis whether the first storage data stored in the first storage means has been changed after reading of the first storage data began, and the storage control means controls the storage of the second storage data in the second storage means based on the result of the determination by the determination means.

[0011] The data processing method disclosed herein comprises a first read step of reading out first storage data stored in a first storage means, a storage control step of controlling storage of the first storage data read out in the first read step in a second storage means as second storage data, and a determination step of determining on a file-by-file basis whether the first storage data stored in the first storage means has been changed since reading of the first storage data began, and the storage control step controls storage of the second storage data in the second storage means based on the result of the determination made in the determination step.

[0012] The program disclosed herein causes a computer to function as each part of the data processing system. [Effects of the Invention]

[0013] According to the present disclosure, after the start of reading the first stored data, it is determined on a file-by-file basis whether the first stored data stored in the first storage means has been changed, and based on the result of the determination, it is controlled to store the first stored data in the second storage means. By determining whether data has been changed on a file-by-file basis in this manner, it is possible to prevent overlooking the fact that data within a file has been changed and to prevent a file in which unintended data changes have been made during processing from being stored in the second storage means. Furthermore, it is not necessary to check each piece of data within a file one by one. Therefore, when a file stored in the first storage means is stored in the second storage means, it is possible to prevent a decrease in the reliability of the file stored in the second storage means and to prevent an increase in the processing load of the processing means using the first storage means. [Brief explanation of the drawings]

[0014] [Figure 1] FIG. 1 illustrates an example of a configuration of a data processing system. [Figure 2A] FIG. 10 is a diagram showing a first example of first definition information. [Figure 2B] FIG. 10 is a diagram conceptually illustrating a first example of processing in accordance with first definition information. [Figure 3] FIG. 10 is a diagram showing a first example of second definition information. [Figure 4] FIG. 2 is a diagram showing a first example of the contents of a first file and a second file. [Figure 5] FIG. 10 is a diagram showing a second example of second definition information. [Figure 6] FIG. 10 is a diagram showing a second example of the contents of the first file and the second file. [Figure 7] 10 is a flowchart illustrating an example of a data processing method. [Figure 8A] FIG. 10 is a diagram showing a second example of the first definition information. [Figure 8B]FIG. 10 is a diagram conceptually illustrating a second example of processing in accordance with the first definition information. [Figure 8C] FIG. 10 is a diagram illustrating an example of an execution order of tasks. [Figure 8D] FIG. 10 is a diagram showing an example of the contents of a first file before each task is executed. [Figure 8E] FIG. 10 is a diagram illustrating an example of the contents of a first file after a first task has been executed. [Figure 8F] FIG. 10 is a diagram illustrating an example of the contents of the first file after the second task has been executed. [Figure 8G] FIG. 10 is a diagram illustrating an example of the contents of the first file after the execution of the third task. [Figure 8H] FIG. 10 is a diagram showing an example of the contents of the first file after the fourth task has been executed. DETAILED DESCRIPTION OF THE INVENTION

[0015] Hereinafter, an embodiment of the present disclosure will be described with reference to the drawings. Note that the term "comparison objects" as being the same in terms of length, position, size, spacing, etc., includes not only cases where they are exactly the same, but also cases where they are different within the scope of the present disclosure (for example, differences within the tolerance range determined at the time of design).

[0016] FIG. 1 is a diagram illustrating an example of the configuration of a data processing system. 1, the present embodiment illustrates a case where the data processing system includes a first data processing device 110 and a second data processing device 120. The present embodiment also illustrates a case where the first data processing device 110 and the second data processing device 120 are connected to each other via a network so that they can communicate with each other. In this case, files are sent and received according to a predetermined communication protocol (for example, FTP (File Transfer Protocol)). The first data processing device 110 and the second data processing device 120 may communicate with each other via wired or wireless communication.

[0017] The first data processing device 110 and the second data processing device 120 each have, as hardware, one or more hardware processors, such as a central processing unit (CPU), and one or more memories, such as a random access memory (RAM) or a read-only memory (ROM). Various calculations are performed by executing one or more programs stored in the memories using the one or more hardware processors. Furthermore, the first data processing device 110 and the second data processing device 120 each have, as hardware, input and output devices. The input device may include, for example, at least one of a storage device, a communication device, and a user interface. The output device may include, for example, at least one of a storage device, a communication device, and a computer display. The first data processing device 110 and the second data processing device 120 may also be implemented by a programmable logic controller (PLC), or dedicated hardware such as an application-specific integrated circuit (ASIC) or a field programmable gate array (FPGA).

[0018] In this embodiment, an example is shown in which the first data processing device 110 includes a processing unit 111, an output unit 112, a first acquisition unit 113, a first reading unit 114, a first storage unit 115, a determination unit 116, and a first input / output unit 117. In addition, in this embodiment, an example is shown in which the second data processing device 120 includes a second input / output unit 121, a second acquisition unit 122, a storage control unit 123, and a second storage unit 124. An example of the functions of the data processing system of this embodiment will be described below.

[0019] The processing unit 111 included in the first data processing device 110 executes various programs. In this embodiment, an example is shown in which the processing unit 111 opens a file stored in the first storage unit 115, reads and writes data from the file, and then closes the file. The processing unit 111 may or may not perform file locking when opening a file stored in the first storage unit 115. Note that, for a file that has been locked, data cannot be written to the file but data can be read from it. The processing unit 111 may also perform parallel processing. In FIG. 1, the processing unit 111 has multiple processing units 111a to 111b. Here, an example is shown in which the multiple processing units 111a to 111b each perform processing, but a single processing unit may also perform processing. In this case, the single processing unit may perform parallel processing.

[0020] Furthermore, in this embodiment, a case where the first reading unit 114 does not lock the file when opening the file is illustrated. Therefore, for example, it is possible to prevent the processing in the processing unit 111 from having to wait (due to the file lock).

[0021] The output unit 112 outputs information based on the results of the processing in the processing unit 111 . In this embodiment, the first data processing device 110 is a process computer (processor). In this case, the processing unit 111 receives, for example, various measured values ​​in the manufacturing process and performs processing for controlling the manufacturing process based on the measured values. Furthermore, the output unit 112 outputs, for example, various operation commands to devices provided in the manufacturing process based on the results of processing in the processing unit 111.

[0022] Process computers require real-time control from the viewpoint of, for example, suppressing degradation of product quality, suppressing degradation of product yield, and suppressing degradation of production efficiency (e.g., T / H (tons per hour)). To achieve such real-time control, process computers often store files (data) using a database in a format unique to the process computer, rather than a database such as a relational database, which may slow down processing speed. However, to enable other computers to handle files (data) handled by such a process computer, extensive modifications, such as modifying the program (software) executed by the processing unit 111, are required. Therefore, it is costly and time-consuming to store files stored in a database in a format unique to the process computer, using a database in a format that can be handled by other computers.

[0023] From this perspective, this embodiment illustrates a case where a file (data) used by the first data processing device 110 is stored in the first storage unit 115 using a first database. This embodiment also illustrates a case where a file (data) stored in the first storage unit 115 is stored in the second storage unit 124 of the second data processing device 120 using a second database that is more versatile than the first database and can be used by a wider range of data processing devices. This embodiment also illustrates a case where the second data processing device 120 cannot use the first database (as is). For example, the first database may be a database created specifically for the first data processing device 110. The second database may also be a general-purpose database. However, this is not necessarily the case. For example, when applying the method of this embodiment to a case where a file (data) is copied directly from a first storage unit to a second storage unit, as in the techniques described in Patent Documents 1 and 2, the database stored in the first storage unit 115 and the database stored in the second storage unit 124 may be databases of the same format. The first storage unit 115 may be located outside the first data processing device 110. Similarly, the second storage unit 124 may be located outside the second data processing device 120. Preferably, the first storage unit 115 and the second storage unit 124 are non-volatile memories such as HDDs (Hard Disk Drives) and SSDs (Solid State Drives).

[0024] The first acquisition unit 113 acquires various pieces of information necessary for processing performed by the first data processing device 110. In this embodiment, a case is exemplified in which the information is input to the aforementioned input device provided in the first data processing device 110, and the first acquisition unit 113 outputs the input information. In addition, this embodiment exemplifies a case in which the first acquisition unit 113 acquires various measurement values ​​in the manufacturing process and first definition information.

[0025] The first definition information is information that defines conditions for reading out the first stored data. In this embodiment, a case is exemplified in which (the data of) a file stored in the first storage unit 115 is the first stored data. In addition, in this embodiment, a case is exemplified in which (the data of) a file stored in the second storage unit 124 is the second stored data. In the following description, a file stored in the first storage unit 115 will be referred to as a first file as necessary, and a file stored in the second storage unit 124 will be referred to as a second file as necessary.

[0026] 2A is a diagram showing an example of first definition information 210. In Fig. 2A, first definition information 210 is information indicating that only when a task (task name: DA4) closes a file (file name: FDD015), the file is read from first storage unit 115 and stored in second storage unit 124 (transmitted to second data processing device 120). Note that file operations performed by a program (task) include open, read, write, and close.

[0027] FIG. 2B is a diagram conceptually illustrating an example of processing in accordance with the first definition information 210. As shown in FIG. FIG. 2B shows that a plurality of tasks 221a to 221c perform operations on the first file 222 (file name: FDD015). FIG. 2B illustrates a state in which a command to close the first file 222 has been issued (see "file close"). The first definition information 210 defines that the first file 222 is read and stored in the second storage unit 124 (transmitted to the second data processing device 120) only when the first file 222 is closed in task 221a. Therefore, when data is written to or the first file 222 is closed in other tasks 221b to 221c, the first file 222 is not stored in the second storage unit 124.

[0028] As described above, in this embodiment, even if a change is made to the first file 222, the change may not be reflected in the second file stored in the second storage unit 124. For example, data included in the first file 222 that is only required by the first data processing device 110 is unlikely to be stored in the second file stored in the second storage unit 124. Therefore, this embodiment illustrates a case in which, when the conditions defined in the first definition information 210 are met, processing is performed to read (the data of) the first file from the first storage unit 115 and store it as (the data of) the second file. This makes it possible, for example, to reduce the number of times the first file is read and transmitted. Therefore, it is possible to reduce the possibility that the processing to store the first file as the second file will prevent the real-time control described above from being realized.

[0029] The first definition information may be created by an operator such as a designer of a program executed by the processing unit 111. In this case, the operator may determine which of the first files needs to be stored as a second file in the second storage unit 124 and determine conditions for reading the first file from the first storage unit 115, and create the first definition information based on these decisions. In this case, for example, the operator may input information such as numerical values ​​or characters indicating the first definition information into an input device included in the first data processing device 110. In this case, the first acquisition unit 113 may acquire the information input into the input device as the first definition information. Note that a file of the first definition information may be stored in the input device included in the first data processing device 110. In this case, the first acquisition unit 113 may acquire the file of the first definition information stored in the input device.

[0030] In FIG. 2B, for example, if there is first definition information that defines that the first file 222 is stored in the second storage unit 124 (transmitted to the second data processing device 120) only when the task 221a closes the first file 222, the first definition information 210 shown in FIG. 2A is acquired by the first acquisition unit 113 for the first file 222.

[0031] As described above, this embodiment illustrates a case where the first reading unit 114 does not perform file locking on the first file 222 when reading the first file 222. Therefore, when executing tasks 221a to 221c, the processing unit 111 can write data to the first file 222 in parallel with the processing of the first reading unit 114.

[0032] Furthermore, when the first file is closed, writing to the first file by the task that opened the first file ends (the first file is not changed by the task). Therefore, this embodiment illustrates a case in which the first reading unit 114 reads the first file in response to the first file being closed. Furthermore, this embodiment illustrates a case in which, when the first file is closed, the processing unit 111 notifies the first reading unit 114 that the first file has been closed. Note that the first reading unit 114 does not necessarily have to read the first file in response to the first file being closed. For example, the first reading unit 114 may read the first file when no task is running (for example, when the first file has been closed for a predetermined time).

[0033] As described above, the present embodiment illustrates a case in which the first reading unit 114 reads (data of) the first file in accordance with the first definition information. Therefore, in the present embodiment, the first reading unit 114 reads the first file when the first file is closed and the condition for reading the first file (first stored data) is met according to the first definition information defined for the first file. On the other hand, even when the first file is closed, if the condition for reading the first file (first stored data) is not met according to the first definition information defined for the first file, the first reading unit 114 does not read the first file.

[0034] 2A and 2B, when the first file 222 is closed in task 221a, the first reading unit 114 reads the first file 222. On the other hand, when the first file 222 is closed in tasks 221b to 221c, the first reading unit 114 does not read the first file 222.

[0035] The determination unit 116 determines, on a file-by-file basis, whether or not the first file stored in the first storage unit 115 has been changed since the first reading unit 114 started reading (the data of) the first file.

[0036] When determining whether the first file stored in the first storage unit 115 has been changed with respect to the first file read by the first reading unit 114, the determination unit 116 may compare each piece of data in the first file. However, doing so increases the processing load on the first data processing device 110. This may make it difficult to achieve the real-time control described above. Therefore, this embodiment illustrates a case in which the determination unit 116 determines whether the first file stored in the first storage unit 115 has been changed with respect to the first file read by the first reading unit 114, using setting information set in the first file that changes in response to changes to the first file. To achieve this, this embodiment illustrates a case in which the determination unit 116 (temporarily) stores the setting information set in the first file when the first reading unit 114 reads the first file. By doing so, if the setting information set in the first file is changed due to a subsequent change to the first file, the setting information will differ from the (temporarily) stored setting information, making it possible to determine that the first file has been changed. The setting information stored by the judgment unit 116 may be all of the setting information set in the first file, or may be only the setting information set in the first file that is used for the judgment made by the judgment unit 116.

[0037] The setting information is, for example, incidental information (e.g., metadata) of the first file. In this embodiment, the determination unit 116 determines whether the first file stored in the first storage unit 115 has been changed relative to the first file read by the first reading unit 114, based on information indicating the timing of creation and update of the first file, among the setting information set for the first file. In the following description, information indicating the timing of creation and update of the first file will be referred to as a timestamp as necessary. Note that the timestamp included in the incidental information of the first file does not usually certify the timing of creation and update of the first file (i.e., the timestamp referred to in this embodiment does not necessarily mean a general timestamp (one that certifies the date and time)). However, information certifying the timing of creation and update of the first file may be used as the setting information. Note that the determination unit 116 may determine whether the first file stored in the first storage unit 115 has been changed relative to the first file read by the first reading unit 114, for example, using the size of the data (file size) instead of or in addition to the timestamp.

[0038] Furthermore, in this embodiment, a case is exemplified in which, after the first file read by the first reading unit 114 is transmitted to the second data processing device 120, the determining unit 116 determines whether or not the first file stored in the first storage unit 115 has been changed with respect to the first file. Therefore, in this embodiment, a case is exemplified in which the first input / output unit 117 transmits the first file read by the first reading unit 114 to the second data processing device 120.

[0039] In this case, the second input / output unit 121 of the second data processing device 120 receives the first file transmitted from the first input / output unit 117. Upon receiving the first file, the second input / output unit 121 transmits a file reception notification indicating that the first file has been received to the first data processing device 110. Upon receiving the file reception notification, the first input / output unit 117 of the first data processing device 110 outputs the file reception notification to the determination unit 116.

[0040] Upon receiving the file reception notification output from first input / output unit 117, determination unit 116 identifies a first file from among the first files stored in first storage unit 115, the first file having setting information including the same file identification information as the file identification information included in the setting information (temporarily) stored as described above. Then, determination unit 116 determines whether the timestamp included in the setting information set for the identified first file matches the timestamp included in the (temporarily) stored setting information. If the result of this determination shows that the two timestamps match, determination unit 116 determines that the first file stored in first storage unit 115 has not been changed with respect to the first file read by first read unit 114. On the other hand, if the two timestamps do not match, determination unit 116 determines that the first file stored in first storage unit 115 has been changed with respect to the first file read by first read unit 114.

[0041] The determination unit 116 then outputs an alteration determination result indicating the result of the above determination to the first input / output unit 117. The alteration determination result includes, for example, information indicating whether the first file has been altered. The alteration determination result may also include file identification information of the first file. The first input / output unit 117 transmits an alteration notification indicating the alteration determination result to the second data processing device 120. The second input / output unit 121 of the second data processing device 120 receives the alteration notification transmitted from the first input / output unit 117.

[0042] The storage control unit 123 controls the storage of the second file in the second storage unit 124 based on the result of the determination by the determination unit 116. In this embodiment, a case is illustrated in which the storage control unit 123 stores the first file received by the second input / output unit 121 in the second storage unit 124 as described above when the alteration notification indicates that the first file has not been altered. On the other hand, in this embodiment, a case is illustrated in which the storage control unit 123 does not store the first file received by the second input / output unit 121 in the second storage unit 124 as described above when the alteration notification indicates that the first file has been altered. When the alteration notification indicates that the first file has been altered, the storage control unit 123 may store the first file received by the second input / output unit 121 in a storage unit other than the second storage unit 124. However, doing so increases the amount of storage required in the second data processing device 120. Furthermore, a less reliable first file will remain in the data processing system. Therefore, in this embodiment, a case is illustrated in which the storage control unit 123 discards the first file received by the second input / output unit 121 when the alteration notification indicates that the first file has been altered.

[0043] As described above, this embodiment illustrates a case where the first file (data) used by the first data processing device 110 is stored in the first storage unit 115 as a first database, and the second data processing device 120 cannot use the first database as is.

[0044] Therefore, in this embodiment, an example is given of a case where the storage control unit 123 stores (data of) a first file as a second file in the second storage unit 124 in accordance with second definition information that defines a method for storing (data of) a first file as (data of) a second file. In this embodiment, an example is given of a case where the second definition information is information for each file. However, the second definition information may be information common to multiple first files. In this way, the second definition information may be information for one or multiple files.

[0045] The second acquisition unit 122 acquires various pieces of information necessary for processing performed by the second data processing device 120. In this embodiment, a case is exemplified in which the information is input to the aforementioned input device provided in the second data processing device 120, and the second acquisition unit 122 outputs the input information. Also, in this embodiment, a case is exemplified in which the second acquisition unit 122 acquires second definition information.

[0046] Fig. 3 is a diagram showing a first example of the second definition information. Note that in Figs. 3 to 6, "-" indicates that specific information content has been omitted for convenience of notation. Fig. 3(a) illustrates an example in which the second definition information includes summary information 310 and database correspondence information 320. Fig. 3(a) also illustrates an example in which summary information 310 includes a file name, the number of items, the number of records, whether row / column conversion is performed, and the number of converted records.

[0047] The file name is the file name of the first file. The number of items is the number of data items in the first file. The number of records is the number of records in the first file. Row / column conversion indicates whether or not to swap the row data items of the first database that stores the data of the first file with the column data items of the second database that stores the data of the second file. The number of converted records is set when row / column conversion is "yes" and is not set when it is "no." The number of converted records indicates for how many records in the first file the aforementioned row and column data items are swapped (specific examples will be described later with reference to Figures 5 and 6).

[0048] FIG. 3(b) illustrates an example in which the database correspondence information 320 includes the file structure of the first file and registration information for the second file. The file structure of the first file includes information that is necessary for storing the first file as a second file, among the information that identifies the file structure of the first file. Figure 3(b) illustrates an example in which the file structure of the first file includes an item name, abbreviation, type, bytes, and whether or not DB registration is required. The item name is the name of the data item. The abbreviation is the abbreviation of the data item. The type is the type of the data. The bytes is the size of the data. Whether or not DB registration is required indicates whether or not storage in the second storage unit 124 is required. Figure 3(b) shows only "1" indicating that storage in the second storage unit 124 is required, but "0" indicating that storage in the second storage unit 124 is not required for some (or all) data items of the first file may be set for whether or not DB registration is required.

[0049] The information registered in the second file also includes information used when storing (the data in) the second file in the second storage unit 124 (second database). FIG. 3(b) illustrates an example in which the information registered in the second file includes a column name and a type. The column name is the name of the column (row) item in the first database. The type is the data type when storing the data in the first file as data in the second file.

[0050] FIG. 4 shows a first example of the contents of a first database 410 storing data of a first file and a second database 420 storing data of a second file. Here, the first database 410 shown in FIG. 4(a) is stored in the second storage unit 124 as the second database 420 shown in FIG. 4(b) in accordance with the second definition information shown in FIG. 3. In FIG. 4(b), "add" stores additional information for each record. The additional information includes, for example, the date and time the record was registered in the second storage unit 124, the date and time the record was updated in the second storage unit 124, the date and time the record was transmitted from the first data processing device 110, and attributes (e.g., name and IP address) of the first data processing device 110 that transmitted the record. Using the additional information, for example, it is possible to check the record history after the fact. As shown in FIGS. 3 and 4, the second definition information may specify that the first database 410 storing data of the first file is stored as the second database 420 (except for the addition of the additional information "add").

[0051] FIG. 5 is a diagram showing a second example of the second definition information. Summary information 510 and database correspondence information 520 correspond to summary information 310 and database correspondence information 320 shown in FIG. 3, respectively. The second definition information shown in FIG. 3 illustrates an example in which "No" is set as the row / column conversion enable / disable setting (see summary information 310 shown in FIG. 3(a)). In contrast, summary information 510 of the second definition information shown in FIG. 5 illustrates an example in which "Yes" is set as the row / column conversion enable / disable setting. In this case, a numeric value is set as the number of converted records. As described above, the number of converted records indicates every how many records in the first file the row data items of the first database that stores the data of the first file are to be swapped with the column data items of the second database that stores the data of the second file. FIG. 5 illustrates an example in which the number of converted records indicates that the swapping is to be performed every 200 records in the first file.

[0052] 6 is a diagram showing a second example of the contents of the first database 610 that stores the first file and the second database 620 that stores the second file. Here, a case is illustrated in which the first database 610 shown in FIG. 6(a) is changed to the second database 620 shown in FIG. 6(b) in accordance with the second definition information shown in FIG. 5 and stored in the second storage unit 124.

[0053] FIG. 6(a) illustrates an example in which the first database 610 includes 12,000 row data items. These 12,000 data items are divided into groups of 200 data items. Specifically, data groups 611a-611b, each consisting of 200 items, are operation performance data groups for one coil. The fact that an operation performance data group for one coil consists of 200 data items is indicated by the data number (DataNo: 1, 2, ..., 200). Note that in FIGS. 6(a) and 6(b), "-9999" indicates that no operation performance data has been obtained. Furthermore, data_0m, data_25m, and ...data_2475m indicate operation performance data in 25-meter increments of 0m-25m, 25m-50m, ..., and 2450m-2475m, respectively, starting from the tip of the coil.

[0054] 5(a) illustrates an example in which the number of converted records is set to 200 in the summary information 510. Therefore, the data items of the rows of the first database 610 that stores the data of the first file are swapped with the data items of the columns of the second database 620 that stores the data of the second file every 200 records of the first database 610. That is, in the rows of the first database 610 for the first file, the data items from the (number of converted records × m + 1)th field to the (number of converted records × m + number of converted records)th field become the data items from the 1st field to the (number of converted records)th field in the columns of the second database 620. Here, m is an integer from 0 to M, and M is the number of records in the first file divided by the number of converted records. In the example shown in Figures 5 and 6(a), the number of converted records is 200, so the data items from the (200 x m + 1)th field to the (200 x m + 200)th field in the row of the first database 610 become the data items from the 1st field to the 200th field in the column of the second database 620 (m = 0, 1, 2, 3, 4, 5, 6, ..., 59 (M = 60 (= 12000 ÷ 200)).

[0055] 6(a) and 6(b), in order to show the correspondence between the first database 610 and the second database 620, the names of data items in columns in the second database 620 are indicated with arrows to the right of each row in the first database 610. Also, the names of data items in columns in the first database 610 are indicated with arrows to the right of each row in the second database 620.

[0056] As shown in FIGS. 5 and 6, the second definition information may be set to store the first file as a second file in a second database 620, which has a different format from the first database 610, by changing the storage method (storage mode, etc.) of the first file without changing the meaning of the data in the first file. Here, the meaning of the data refers to the content of the data interpreted by a device (e.g., a computer) when processing is performed. For example, if the result of processing using the data in the first file is the same as the result of processing using data stored as a second file without changing the meaning of the data, the meaning of the data in the second file is the same as the meaning of the data in the first file. Note that cases where the meaning of the data does not change include cases where the meaning of the data is strictly the same as well as cases where the meaning of the data is substantially the same. Examples of cases where the meaning of the data is not substantially the same include cases where it is unavoidable to change the meaning of the data in the first file when at least one of the data in the second file is stored and used. Specifically, for example, if the data in the first file is real number data and the data in the second file must be integer data, the meaning of these data will be different in the strict sense, but the meaning of these data will remain the same. For example, if the data in the first file is data meaning "5.1" and the data in the second file is data meaning "5," the meaning of these data will remain the same.

[0057] 5 and 6, for simplicity of explanation, an example is shown in which the column data items and row data items of the first database 610 that stores the data of the first file are respectively treated as row data items and column data items of the second database 620 that stores the data of the second file. However, as long as a method for storing (the data of) the first file as (the data of) the second file is defined, the contents of the second definition information are not limited to those shown in FIG.

[0058] For example, the second definition information may define a method for changing the content of the data in the first file without changing the meaning of the data. For example, the second definition information may define changing the type of data. Furthermore, the second definition information may define changing quantitative data to qualitative data such as high, medium, or low.

[0059] The second definition information may also define a method for storing (data of) a newly stored second file when (data of) the second file is already stored in the second storage unit 124. For example, the second definition information may define overwriting changed data on already stored data of the second file, while not storing the overwritten data. The second definition information may also define both overwriting changed data on already stored data of the second file and storing the overwritten data. In this case, the second definition information may define further storing, in addition to the overwritten data, data associated with the data (for example, data of the same record as the overwritten data).

[0060] As described above, the second definition information is set for each of one or more first files. For example, an operator, such as a designer of a program executed by the processing unit 111, may determine the first files operated by the program executed by the processing unit 111, determine which of the first files need to be stored as second files in the second storage unit 124, determine which data items of the first files need to be stored as data of the second file, and determine a method for storing the data of the first file (first database) as data of the second file (second database), and create the second definition information based on these decisions. In this case, for example, the operator may input information such as numerical values ​​or characters indicating the second definition information into an input device included in the second data processing unit 120. In this case, the second acquisition unit 122 may acquire the information input into the input device as the second definition information. Note that a file of the second definition information may be stored in the input device included in the second data processing unit 120. In this case, the second acquisition unit 122 may acquire the file of the second definition information stored in the input device.

[0061] In the present embodiment, a case will be exemplified in which the storage control unit 123 stores (data of) the first file as the second file in the second storage unit 124 in accordance with the second definition information as described above. The second data processing device 120 may have the function of the determination unit 116. In this case, for example, the first input / output unit 117 transmits to the second data processing device 120 setting information (e.g., a timestamp and file identification information of the first file) set in the first file read by the first reading unit 114, and transmits to the second data processing device 120 setting information (e.g., a timestamp and file identification information of the first file) set in the first file stored in the first storage unit 115 at a timing after the timing of receiving the file reception notification. In this case, the second data processing device 120 determines whether the timestamps included in the setting information match. If the timestamps match as a result of this determination, it is determined that the first file stored in the first storage unit 115 has not been changed with respect to the first file read by the first reading unit 114.

[0062] Next, an example of a data processing method performed using the data processing system of this embodiment will be described with reference to the flowchart of Fig. 7. It is assumed that the first definition information and the second definition information have been acquired by the first acquisition unit 113 and the second acquisition unit 122 before the flowchart of Fig. 7 starts. The flowchart of Fig. 7 is performed each time the processing unit 111 closes the first file.

[0063] First, in step S701, the first reading unit 114 determines whether the first file has been closed. If the result of this determination is that it is not the timing when the first file should be closed (NO in step S701), the processing according to the flowchart in FIG. 7 ends.

[0064] On the other hand, if the first file is closed (YES in step S701), the process of step S702 is performed. In step S702, the first reading unit 114 refers to the first definition information related to the first file determined to be closed in step S701.

[0065] Next, in step S703, the first reading unit 114 determines whether the condition for reading the first file determined to be closed in step S701 is met, based on the first definition information referenced in step S702. If the result of this determination is that the condition for reading the first file is not met (NO in step S703), the processing according to the flowchart in Fig. 7 ends. On the other hand, if the condition for reading the first file is met (YES in step S703), the processing of step S704 is performed.

[0066] In step S704, the first reading unit 114 reads from the first storage unit 115 the first file that was determined to be closed in step S701. Next, in step S705, the determination unit 116 (temporarily) stores information including the time stamp and file identification information from the setting information set for the first file read in step S704.

[0067] Next, in step S706, the first input / output unit 117 transmits the first file read in step S704 to the second data processing device 120. Then, the second input / output unit 121 of the second data processing device 120 receives the first file transmitted from the first input / output unit 117. Next, in step S707, upon receiving the first file, the second input / output unit 121 transmits a file reception notification indicating that the first file has been received to the first data processing device 110. The second input / output unit 121 also outputs the first file to the storage control unit 123. Then, the first input / output unit 117 of the first data processing device 110 receives the file reception notification transmitted from the second input / output unit 121.

[0068] Next, in step S708, upon receiving the file reception notification, first input / output unit 117 outputs the file reception notification to determination unit 116. Then, determination unit 116 determines whether or not the first file stored in first storage unit 115 has been changed with respect to the first file read in step S704.

[0069] Specifically, determination unit 116 identifies a first file having setting information set therein that includes file identification information identical to the file identification information included in the setting information of the first file stored in step S705 from among the first files stored in first storage unit 115. Then, determination unit 116 determines whether or not the timestamp included in the setting information set for the first file identified from among the first files stored in first storage unit 115 matches the timestamp included in the setting information stored in step S705.

[0070] If the two timestamps match, it is determined that the first file stored in first storage unit 115 has not been changed relative to the first file read in step S704. On the other hand, if the two timestamps do not match, it is determined that the first file stored in first storage unit 115 has been changed relative to the first file read in step S704.

[0071] If the result of the determination in step S708 is that the first file stored in the first storage unit 115 has been modified with respect to the first file read out in step S704 (YES in step S708), the process of step S709 is performed. In step S709, the determination unit 116 outputs an alteration presence / absence determination result indicating that the first file has been modified to the first input / output unit 117. Then, the first input / output unit 117 transmits an alteration presence / absence notification indicating that the first file has been modified to the second data processing device 120. Then, the second input / output unit 121 of the second data processing device 120 receives the alteration presence / absence notification transmitted from the first input / output unit 117. Then, the process of step S711, which will be described later, is performed.

[0072] On the other hand, if the result of the determination in step S708 is that the first file stored in the first storage unit 115 has not been changed with respect to the first file read in step S704 (NO in step S708), the process of step S710 is performed. In step S710, the determination unit 116 outputs an alteration determination result indicating that the first file has not been changed to the first input / output unit 117. Then, the first input / output unit 117 transmits an alteration notification indicating that the first file has not been changed to the second data processing device 120. Then, the second input / output unit 121 of the second data processing device 120 receives the alteration notification transmitted from the first input / output unit 117. Then, the process of step S711 is performed.

[0073] In step S711, upon receiving the alteration notification, second input / output unit 121 outputs the alteration notification to storage control unit 123. Then, based on the alteration notification, storage control unit 123 determines whether the first file output from second input / output unit 121 in step S707 has been altered relative to the first file stored in first storage unit 115.

[0074] If the result of this determination is that the first file output from second input / output unit 121 in step S707 has been changed relative to the first file stored in first storage unit 115 (YES in step S711), the process of step S712 is performed. In step S712, storage control unit 123 discards the first file output from second input / output unit 121 in step S707. When the process of step S712 ends, the process according to the flowchart of FIG. 7 ends.

[0075] On the other hand, if the result of the determination in step S711 is that the first file output from second input / output unit 121 in step S707 has not been changed relative to the first file stored in first storage unit 115 (NO in step S711), the process of step S713 is performed. In step S713, storage control unit 123 refers to the second definition information related to the first file.

[0076] Next, in step S714, in accordance with the second definition information referenced in step S713, storage control unit 123 stores (the data of) the first file output from second input / output unit 121 in step S707 as a second file in second storage unit 124. When the processing of step S714 ends, the processing according to the flowchart in FIG. 7 ends.

[0077] As described above, in this embodiment, the first data processing device 110 determines, on a file-by-file basis, whether a first file stored in the first storage unit 115 has been changed since the first reading unit 114 started reading the first file stored in the first storage unit 115. Based on the result of this determination, the second data processing device 120 controls the storage of the first file as a second file in the second storage unit 124. By determining whether data has been changed on a file-by-file basis in this manner, it is possible to prevent overlooking a determination that data within a file has been changed and to prevent unintended data from being stored in the second storage unit 124 during processing of the file. Furthermore, it is not necessary to check each piece of data within the file one by one. Therefore, when storing a first file stored in the first storage unit 115 in the second storage unit 124, it is possible to prevent a decrease in the reliability of the file stored in the second storage unit 124 and to prevent an increase in the processing load on the first data processing device 110.

[0078] Here, a specific example will be described in which the techniques described in Patent Documents 1 and 2 result in a decrease in the reliability of the copy destination data and an increase in the processing load on the copy source device. Fig. 8A is a diagram showing an example of first definition information 810. In Fig. 8A, first definition information 810 is information indicating that only when a task (task name: DA3) closes a file (file name: FDD010), the file is read from first storage unit 115 and stored in second storage unit 124 (transmitted to second data processing device 120).

[0079] FIG. 8B is a diagram conceptually illustrating an example of processing in accordance with the first definition information 810. As shown in FIG. FIG. 8B shows that the first to fourth tasks 821a to 821d perform operations on the first file 822 (file name: FDD010). (Similar to FIG. 2B, FIG. 8B also illustrates a state in which a command to close the first file 822 has been issued (see "file close"). Fig. 8C is a diagram showing an example of the execution order of the first task 821a to the fourth task 821d. Fig. 8C illustrates a case in which the second task 821b is executed after the first task 821a is executed, and the third task 821c and the fourth task 821d are executed after the second task 821b is executed. Note that the task with the task name DA3 shown in Fig. 8A is the fourth task 821d. Furthermore, the second task 821b and the third task 821c are assumed to be tasks that are executed every time the coil is transported 25 m.

[0080] Fig. 8D is a diagram showing an example of the contents of first database 830a that stores data of the first file before execution (before opening) of each task (first task 821a to fourth task 821d) shown in Fig. 8B. Figs. 8E, 8F, 8G, and 8H are diagrams showing examples of the contents of first databases 830b, 830c, 830d, and 830e that store data of the first file after execution of first task 821a, second task 821b, third task 821c, and fourth task 821d, respectively. Note that the meanings of the data items of first databases 830a to 830e shown in Figs. 8D to 8H are the same as those of the data items of first database 610 shown in Fig. 6(a).

[0081] In FIG. 8F, when the second task 821b is executed, the sensor measurement value indicates an abnormal value, and the value of data 831 (=250) is therefore an abnormal value. After the sensor measurement value indicates an abnormal value, the third task 821c determines whether the sensor measurement value is abnormal, and as shown in FIG. 8G, the value of data 831 is corrected to 100. Thereafter, the fourth task 821d is executed, and the operation for the coil (CoilNo=12345) is completed. Furthermore, the cycle for acquiring the operation performance data (data_0m, data_25m, data_50m, . . . , data_2475m) in 25-m units is usually longer than the time required for the flowchart of FIG. 7 to be executed (once) and the time required for the data copy process in Patent Document 2. However, for the sake of explaining the differences from Patent Documents 1 and 2, the former is assumed to be shorter than the latter.

[0082] In the technology described in Patent Document 2, if copied data is changed during the copy process, the data is recopied. Therefore, if data 831 indicating an abnormal value (=250) is stored in the first storage unit 115 as shown in FIG. 8F during the copy process of the first database 830b shown in FIG. 8E, the data indicating the abnormal value is recopied and stored in the second storage unit 124. This may result in the copying of unreliable data. Note that the technology described in Patent Document 2 assumes that data is copied as is, and therefore does not have the concept of a second file (second database). In the technology described in Patent Document 2, data 831 indicating a corrected value (=100) is then stored in the first storage unit 115 as shown in FIG. 8G, and the abnormal value (=250) stored in the second storage unit 124 is then changed again to the corrected value. Furthermore, until the operation for the coil (CoilNo=12345) is completed (i.e., until the first database 830e shown in FIG. 8H is obtained), the first database stored in the first storage unit 115 is stored in the second storage unit 124 every time operation performance data is acquired in 25-m increments. Therefore, the technology described in Patent Document 2 increases the processing load on the first data processing device 110. As a result, there is a risk that the above-mentioned real-time control cannot be realized.

[0083] On the other hand, in this embodiment, whether or not a first file has been changed is determined on a file-by-file basis. Therefore, in this embodiment, if an abnormal value (=250) is stored in first storage unit 115 as shown in FIG. 8F after reading of first database 830b shown in FIG. 8E begins, first database 830b is not stored as the second database (second file) (because first database 830b is different from first database 830c). Also, if data 831 indicating a normal value (=100) is stored in first storage unit 115 as shown in FIG. 8G after reading of first database 830c shown in FIG. 8F begins, first database 830c is not stored as the second database (second file) (because first database 830c is different from first database 830d). Furthermore, by using the first definition information 810 as shown in Figure 8A, it is possible to prevent the first databases 830b to 830d shown in Figures 8E to 8G from being read out, regardless of the period at which the operational performance data in 25m units (data_0m, data_25m, data_50m, ..., data_2475m) is acquired.

[0084] On the other hand, after the first database 830e shown in FIG. 8H is obtained and the first file is closed by the fourth task 821d, the operation of the coil (Coil No. = 12345) has ended. Therefore, the contents of the first file (first database 830e) will not be changed after reading of the first file (first database 830e) has begun. Therefore, once the operation performance data for the coil (Coil No. = 12345) is collected, the first file (first database 830e) can be stored as the second file (second database) in the second storage unit 124. This allows reliable data to be stored in the second storage unit 124 and reduces the number of times the first file (data) is read from the first storage unit 115. This prevents the aforementioned real-time control from being impossible to achieve.

[0085] Furthermore, with the technology described in Patent Document 1, for example, if the first file (first database) is copied during the execution of a task (first task 821a to fourth task 821d), there is a risk that the remaining data of the task will not be stored in the second storage unit 124. Specifically, for example, if the first file is copied at the timing when writing of the data with DataNo=1 to 100 among the data with DataNo=1 to 200 of the operation performance data (data_0m, data_25m, data_50m, . . . , data_2475m) in 25m units in the first databases 830a to 830e is completed, the subsequent data with DataNo=101 to 200 will not be reflected in the copy destination. Therefore, there is a risk that the reliability of the data at the copy destination will be reduced. Note that the technology described in Patent Document 1, like the technology described in Patent Document 2, is premised on copying data as is, and therefore does not have the concept of a second file (second database). Furthermore, in the technology described in Patent Document 1, it is necessary to sequentially store the access logs for each field of the first databases 830b to 830e in order to copy the first databases 830b to 830e. This increases the processing load on the first data processing device 110. This may make it impossible to achieve the real-time control described above.

[0086] On the other hand, in this embodiment, whether or not the first files (first databases 830a to 830e) have been changed is determined on a file-by-file basis. Therefore, it is possible to prevent the first files from being stored as second files during the execution of the tasks (first task 821a to fourth task 821d). Also, it is not necessary to sequentially store access logs for each field of the first databases 830b to 830e in order to store the first databases 830b to 830e as second databases. This makes it possible to prevent the above-mentioned real-time control from becoming impossible to achieve.

[0087] As described above, in this embodiment, when a first file stored in the first storage unit 115 is stored in the second storage unit 124, it is possible to suppress a decrease in the reliability of the file stored in the second storage unit 124 and to suppress an increase in the processing load on the first data processing device 110.

[0088] In the present embodiment, the first data processing device 110 (determination unit 116) always determines whether the first file stored in the first storage unit 115 has been modified after the first read unit 114 starts reading the first file from the first storage unit 115. However, there may be first files for which this determination is not performed. For example, the first data processing device 110 (determination unit 116) may not perform this determination for first files that satisfy predetermined conditions. In this case, the second data processing device 120 may unconditionally store the first file as a second file in the second storage unit 124 (for example, regardless of the content of the modification notification). An example of a first file that satisfies the aforementioned predetermined conditions is a file that is known in advance not to be modified immediately after closing the file. Furthermore, information indicating whether this determination is necessary may be included in the first definition information. In this case, by referring to the first definition information, it is possible to confirm whether this determination is necessary for each first file. By doing so, the frequency with which the determination is made can be reduced, and an increase in the processing load on the first data processing device 110 can be further suppressed.

[0089] Furthermore, in this embodiment, if the first data processing device 110 determines that the first file has not been changed, the second data processing device 120 stores the first file as the second file in the second storage unit 124, and if not, does not store the first file as the second file in the second storage unit 124. Therefore, it is possible to prevent a first file that has been changed after reading of the first file has started from being stored as the second file in the second storage unit 124.

[0090] Furthermore, in this embodiment, the first reading unit 114 of the first data processing device 110 reads the first file stored in the first storage unit 115 without locking the first file. Therefore, the first file can be used in another process that is performed in parallel with the process of storing the first file as the second file in the second storage unit 124.

[0091] In this embodiment, the first data processing device 110 determines whether the first file has been changed based on setting information set for the first file, which setting information is changed in response to changes to the first file stored in the first storage unit 115. Therefore, it is possible to determine whether the first file has been changed without referencing the data in the first file. In this case, if a timestamp is used as the setting information, it is possible to improve the accuracy of determining whether the first file has been changed.

[0092] Furthermore, in this embodiment, the first data processing device 110 reads (data of) the first file in response to the first file being closed. Therefore, the first file can be read at the stage when writing of the first file is completed. This makes it possible to prevent the first file from being read when there is a high possibility that the first file will be changed. This makes it possible to reduce the frequency with which the first file is discarded in the second data processing device 120, for example.

[0093] Furthermore, in this embodiment, the second file is stored in a manner that does not limit the devices that can use it, compared to the first file, and therefore the first file can be used on a greater number of devices.

[0094] In this embodiment, the first data processing device 110 reads the first file according to the first definition information that defines the conditions for reading the first file. Therefore, for example, it is possible to avoid reading a first file that does not need to be stored as a second file. In this case, it is possible to reduce the processing load on the first data processing device 110.

[0095] Furthermore, in this embodiment, the second data processing device 120 stores the first file as the second file in the second storage unit 124 in accordance with second definition information that defines a method for storing the first file as the second file. Therefore, the first file can be stored in the second storage unit 124 in various ways. Note that, without using such second definition information, for example, a first file whose storage method (storage mode, etc.) has been changed without changing the meaning of the data in accordance with predetermined conditions written in a program may be stored in the second storage unit 124 as the second file.

[0096] Furthermore, in this embodiment, when it is determined that the first file has been changed by the first data processing device 110, the second data processing device 120 discards the first file read by the first data processing device 110. This makes it possible to prevent unreliable data from remaining in the data processing system and reduce the amount of data stored.

[0097] (Other embodiments) The above-described embodiments of the present disclosure can be realized by a computer executing a program. A computer-readable recording medium on which the program is recorded and a computer program product such as the program can also be applied as embodiments of the present disclosure. Examples of recording media that can be used include flexible disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, magnetic tapes, non-volatile memory cards, and ROMs. Furthermore, the above-described embodiments of the present disclosure are merely examples of specific embodiments for carrying out the present disclosure, and the technical scope of the present disclosure should not be interpreted as being limited by these. In other words, the present disclosure can be embodied in various forms without departing from its technical concept or main features.

[0098] The above disclosure can be summarized as follows, for example. [Disclosure 1] a first reading means for reading out the first stored data stored in the first storage means; a storage control means for controlling the storage of the first stored data read by the first reading means in the second storage means as second stored data; a determination means for determining whether or not the first stored data stored in the first storage means has been changed on a file-by-file basis after reading of the first stored data has started; Equipped with The storage control means controls the storage of the second storage data in the second storage means based on the result of the determination by the determination means. [Disclosure 2] The data processing system described in Disclosure 1, wherein the storage control means stores the first storage data as the second storage data when the determination means determines that the first storage data has not been changed, and does not store the first storage data as the second storage data when the determination means determines that the first storage data has not been changed. [Disclosure 3] 3. The data processing system according to claim 1, wherein the first reading means reads the first stored data stored in the first storage means without file locking a file including the first stored data. [Disclosure 4] The data processing system described in any one of Disclosures 1 to 3, wherein the determination means determines whether or not there is a change based on setting information that is set for the first stored data stored in the first storage means and that is changed in accordance with changes to the first stored data stored in the first storage means. [Disclosure 5] The data processing system according to Disclosure 4, wherein the setting information includes information indicating the timing of creation and update of the first stored data. [Disclosure 6] The data processing system according to any one of Disclosures 1 to 5, wherein the first reading means reads the first stored data in response to a file in which the first stored data is stored being closed. [Disclosure 7] The data processing system according to any one of Disclosures 1 to 6, wherein the second stored data is stored in a manner that is less restrictive in terms of the devices that can use the second stored data than the first stored data. [Disclosure 8] The data processing system according to any one of Disclosures 1 to 7, wherein the first reading means reads the first stored data in accordance with first definition information that defines a condition for reading the first stored data. [Disclosure 9] The data processing system according to any one of Disclosures 1 to 8, wherein the storage control means stores the first storage data as the second storage data in the second storage means in accordance with second definition information that defines a method for storing the first storage data as the second storage data. [Disclosure 10] The data processing system according to any one of Disclosures 1 to 9, wherein the storage control means discards the first storage data read by the first reading means if the first storage data stored in the first storage means is changed after reading of the first storage data has started. [Disclosure 11] The data processing system described in any one of Disclosures 1 to 10, wherein the storage control means stores data in which the storage method has been changed without changing the meaning of the first storage data in the second storage means as the second storage data. [Disclosure 12] a first reading step of reading out the first stored data stored in the first storage means; a storage control step of performing control to store the first stored data read in the first read step as second stored data in a second storage means; a determining step of determining whether or not the first stored data stored in the first storage means has been changed on a file-by-file basis after reading of the first stored data has started; Equipped with The data processing method, wherein the storage control step controls storage of the second storage data in the second storage means based on a result of the determination in the determination step. [Disclosure 13] A program for causing a computer to function as each means of the data processing system according to any one of Disclosures 1 to 11. [Explanation of symbols]

[0099] 110 First Data Processing Device 111 (111a to 111b) Processing section 112 Output section 113 First acquisition part 114 1st reading section 115 1st memory section 116 Judgment section 117 1st input / output section 120 Second Data Processing Device 121 2nd input / output section 122 Second acquisition part 123 Memory control unit 124 2nd memory section 210 First definition information 221a~221c Tasks 222 File 1 310, 510 Overview Information 320, 520 Database Correspondence Information 410, 610 First Database 420, 620 Second Database 810 First definition information 821a~821d Tasks 1~4 822 File 1 830a~830e Database 1 831 Data

Claims

1. a first reading means for reading the first stored data stored in the first storage means; a storage control means for controlling the storage of the first storage data read by the first reading means in the second storage means as second storage data; a determination means for determining whether or not the first stored data stored in the first storage means has been changed on a file-by-file basis after reading of the first stored data has started; Equipped with The storage control means controls the storage of the second storage data in the second storage means based on the result of the determination by the determination means.

2. 2. The data processing system according to claim 1, wherein the storage control means stores the first storage data as the second storage data when the determination means determines that the first storage data has not been changed, and does not store the first storage data as the second storage data when the determination means determines that the first storage data has not been changed.

3. 3. The data processing system according to claim 1, wherein said first reading means reads the first stored data stored in said first storage means without locking a file containing said first stored data.

4. 3. The data processing system according to claim 1, wherein the determination means determines whether or not a change has occurred based on setting information set for the first stored data stored in the first storage means, the setting information being changed in accordance with changes to the first stored data stored in the first storage means.

5. 5. The data processing system according to claim 4, wherein said setting information includes information indicating timings for creating and updating said first stored data.

6. 3. The data processing system according to claim 1, wherein said first reading means reads said first stored data in response to a file in which said first stored data is stored being closed.

7. 3. The data processing system according to claim 1, wherein the second stored data is stored in a manner that is less restrictive in terms of devices that can be used than the first stored data.

8. 3. The data processing system according to claim 1, wherein said first reading means reads said first stored data in accordance with first definition information that defines a condition for reading said first stored data.

9. 3. The data processing system according to claim 1, wherein the storage control means stores the first storage data as the second storage data in the second storage means in accordance with second definition information that defines a method for storing the first storage data as the second storage data.

10. 3. The data processing system according to claim 1, wherein the storage control means discards the first storage data read by the first reading means if the first storage data stored in the first storage means is changed after reading of the first storage data has begun.

11. 3. The data processing system according to claim 1, wherein said storage control means causes said second storage means to store data in which the storage method has been changed without changing the meaning of said first storage data.

12. a first reading step of reading first stored data stored in a first storage means; a storage control step of performing control to store the first storage data read in the first reading step as second storage data in a second storage means; a determining step of determining whether or not the first stored data stored in the first storage means has been changed on a file-by-file basis after reading of the first stored data has started; Equipped with The data processing method, wherein the storage control step controls storage of the second storage data in the second storage means based on a result of the determination step.

13. 3. A program for causing a computer to function as each of the means of the data processing system according to claim 1 or 2.

Citation Information

Patent Citations

  • Data base backup system

    JP1995013829A

  • JP230147A