Batch processing automatic acceleration device, batch processing automatic acceleration method, and program

Abstract

To provide a batch processing automatic acceleration device, a batch processing automatic acceleration method, and a program which easily and automatically accelerate batch processing.SOLUTION: A batch processing automatic acceleration device includes: a storage part for storing data in which an object condition indicating a feature of a processing object, an environment condition indicating a feature of an execution environment, and a processing time when the processing object is subjected to batch processing under the object condition and the environment condition are associate with each other; a batch processing execution part for retrieving a first environment condition that the processing time is highest, among data associated with the object condition corresponding to a first processing object which is scheduled to be subjected to the processing, in the storage part, and subjecting the first processing object to batch processing under the retrieved first environment condition; and a determination part for updating a first processing time stored in the storage part with an actual processing time of the batch processing, on the basis of a comparison result between a difference between the actual processing time and the first processing time associated with the first environment condition in the storage part, and a prescribed threshold.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to an automatic batch processing speed-up device, an automatic batch processing speed-up method, and a program. [Background technology]

[0002] Known techniques for improving the processing speed of various batch processes include adjusting the memory size, cache size, number of work files, disks used, algorithms, and the like.

[0003] For example, Patent Document 1 describes a process setting search device for presenting appropriate process settings according to the load state of the execution environment. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 6524875 Summary of the Invention [Problem to be solved by the invention]

[0005] The process setting search device described in Patent Document 1 searches for appropriate process settings by referencing trial information on processing times obtained by performing process trials in advance. If the processing times registered in such pre-prepared trial information are appropriate, an improvement in processing speed can be expected. However, if an incorrect processing time is registered due to a measurement error or the like, the user continues processing at a slow processing speed without noticing the error. Even if the user does notice the error, they would have to measure the processing speed for each condition from scratch and re-collect the trial information, which is a burden on the user.

[0006] An object of the present disclosure is to provide a batch processing automatic speed-up device, a batch processing automatic speed-up method, and a program that solve the above-mentioned problems. [Means for solving the problem]

[0007] A batch processing automatic acceleration device according to one embodiment of the present disclosure includes a memory unit that stores data that associates target conditions indicating characteristics of a processing target, environmental conditions indicating characteristics of an execution environment, and a processing time when the processing target is batch-processed under the target conditions and the environmental conditions; a batch processing execution unit that searches the memory unit for a first environmental condition that has the shortest processing time among data associated with the target conditions corresponding to a first processing target to be processed, and batch-processes the first processing target under the searched first environmental conditions; and a determination unit that updates the first processing time stored in the memory unit with the actual processing time based on a comparison result between the difference between the actual processing time of the batch processing and the first processing time associated with the first environmental condition in the memory unit and a predetermined threshold value.

[0008] A method for automatically accelerating batch processing according to one aspect of the present disclosure includes a computer storing data in a memory unit that associates target conditions indicating characteristics of a processing target, environmental conditions indicating characteristics of an execution environment, and a processing time when the processing target is batch-processed under the target conditions and the environmental conditions; searching the memory unit for a first environmental condition that has the fastest processing time among the data associated with the target conditions corresponding to a first processing target scheduled for processing; batch-processing the first processing target under the searched first environmental conditions; and updating the first processing time stored in the memory unit with the actual processing time based on a comparison result between the difference between the actual processing time of the batch processing and the first processing time associated with the first environmental condition in the memory unit and a predetermined threshold value.

[0009] A program according to one embodiment of the present disclosure causes a computer to store data in a memory unit that associates target conditions indicating characteristics of a processing target, environmental conditions indicating characteristics of an execution environment, and a processing time when the processing target is batch-processed under the target conditions and the environmental conditions; causes the memory unit to search for a first environmental condition that has the fastest processing time among data associated with the target conditions corresponding to a first processing target scheduled for processing; causes the first processing target to be batch-processed under the searched first environmental conditions; and updates the first processing time stored in the memory unit with the actual processing time based on a comparison result between the difference between the actual processing time of the batch processing and the first processing time associated with the first environmental condition in the memory unit and a predetermined threshold value. [Effects of the Invention]

[0010] According to the above aspect, batch processing can be easily and automatically accelerated. [Brief explanation of the drawings]

[0011] [Figure 1] 1 is a functional block diagram of a batch processing automatic speed-up device according to the present disclosure. [Figure 2] 1 is a hardware configuration diagram of a batch processing automatic speed-up device according to the present disclosure. [Figure 3] 10 is a flowchart showing the flow of an analysis result collection process of the batch processing automatic speed-up device according to the present disclosure. [Figure 4] FIG. 10 is a diagram illustrating an example of an analysis result according to the present disclosure. [Figure 5] 10 is a flowchart showing the flow of automatic speed-up processing of the batch processing automatic speed-up device according to the present disclosure. [Figure 6] FIG. 10 is a diagram illustrating how analysis results according to the present disclosure are updated. DETAILED DESCRIPTION OF THE INVENTION

[0012] Each embodiment will be described below with reference to the drawings. In all drawings, the same or corresponding components are designated by the same reference numerals, and common descriptions will be omitted.

[0013] <Embodiment> (composition) 1 is a functional block diagram of a batch processing automatic speed-up device 1 according to the present disclosure. The batch processing automatic speed-up device 1 includes, for example, a data processing unit 10, an input interface 20, a display unit 30, and a storage unit 40.

[0014] The data processing unit 10 controls the overall operation of the batch processing automatic speed-up device 1. The data processing unit 10 includes, for example, an analysis unit 11, a batch processing execution unit 12, an information collection unit 13, an abnormality determination unit 14, and a display control unit 15. Each functional unit of the data processing unit 10 may be realized by, for example, a computer having a processor such as a CPU (Central Processing Unit) and a memory which is a storage device. For example, each functional unit of the data processing unit 10 may be realized by the processor executing a program stored in the memory.

[0015] The analysis unit 11 analyzes environmental conditions that indicate the characteristics of the optimal execution environment for each condition that indicates the characteristics of the input file to be processed in batch processing (hereinafter referred to as "input file conditions") and stores the analysis results in the storage unit 40. Types of input file conditions include, for example, the number of input files, their size, file format, number of records, maximum record length, average record length, number of keys, the presence / absence of identical keys, and data alignment. The type of input file conditions to be analyzed may not be one type, but may be a combination of multiple types. Types of environmental conditions include, for example, the layout of input files on disk, the layout and number of divisions of work files generated from the input files, the layout of output files, the disk used, memory usage, and processing algorithms. The type of environmental conditions to be analyzed may not be one type, but may be a combination of multiple types. The analysis results include registered data that associates one or more input file conditions, one or more environmental conditions, and the processing time when the input files are batch processed under the input file conditions and environmental conditions. The analysis results also include information identifying the combined environmental condition with the shortest processing time among the one or more environmental conditions associated with the one or more input file conditions (fastest determination result). The analysis unit 11 is an example of an "analysis unit." The input file conditions are an example of "target conditions indicating characteristics of the processing target." The environmental conditions are an example of "environmental conditions indicating characteristics of the execution environment."

[0016] The batch processing execution unit 12 executes a predetermined batch process under specified input file conditions and environmental conditions. The predetermined batch process refers to any computer process performed on an input file. Examples of batch processes include sorting, merging, tallying, backup, filtering, and splitting. The batch processing execution unit 12 is an example of a "batch processing execution unit."

[0017] The information collection unit 13 collects processing status information (machine status information) when the batch processing execution unit 12 executes batch processing, and stores the information in the storage unit 40. The processing status information includes, for example, information on the actual processing time required for the batch processing.

[0018] If there is a large discrepancy between the actual processing time collected by the information collecting unit 13 and the processing time (also called "predicted processing time") registered in the analysis result AD, the abnormality determining unit 14 determines that the processing time registered in the analysis result AD is an abnormal value, and updates the predicted processing time registered in the analysis result AD with the actual processing time. The abnormality determining unit 14 is an example of a "determination unit".

[0019] The display control unit 15 controls the display of the display unit 30. For example, the display control unit 15 controls the display of a GUI (Graphical User Interface) image or the like that accepts various operations by a user such as a batch processing manager on the display unit 30. The display control unit 15 also controls the display of, for example, the analysis results AD by the analysis unit 11, the processing status information collected by the information collection unit 13, the determination results by the abnormality determination unit 14, and the like on the display unit 30.

[0020] The input interface 20 accepts various input operations by a user and outputs a signal corresponding to the accepted input operation to the data processing unit 10. The input interface 20 includes, for example, a keyboard, a mouse, etc. The input interface 20 may be integrated with the function of the display unit 30 to be configured as a touch panel display.

[0021] The display unit 30 displays various types of information. For example, the display unit 30 displays GUI images generated by the data processing unit 10 and configured to accept various operations by the user. The display unit 30 also displays, for example, the analysis results AD by the analysis unit 11, processing status information collected by the information collection unit 13, and the determination results by the abnormality determination unit 14. The display unit 30 is, for example, a liquid crystal display, a CRT (Cathode Ray Tube), or an organic EL (Electroluminescence) display. The display unit 30 may be a desktop type, or may be a display device (for example, a tablet terminal) capable of wireless communication with the main body of the batch processing automatic speed-up device 1.

[0022] The storage unit 40 stores, for example, the analysis results AD generated by the analysis unit 11. The storage unit 40 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory), a ROM (Read Only Memory), or a flash memory, or a hard disk. The storage unit 40 may also be realized by another storage device connected via a communication network.

[0023] Fig. 2 is a hardware configuration diagram of the batch processing automatic speed-up device 1. As shown in Fig. 2, the batch processing automatic speed-up device 1 is a computer equipped with various pieces of hardware such as a CPU 101, a ROM 102, a RAM 103, a database 104, and a communication module 105. The batch processing automatic speed-up device 1 may be configured as a single computer, or multiple computers may be connected to each other for communication and configured as an integrated batch processing automatic speed-up device 1.

[0024] (Processing flow) (Analysis result collection process) Next, the processing of the batch processing automatic speed-up device according to the present disclosure will be described. Fig. 3 is a flowchart showing the flow of the analysis result collection processing of the batch processing automatic speed-up device according to the present disclosure. The processing shown in Fig. 3 is started, for example, when a user issues an instruction to start the analysis result collection processing via the input interface 20. Here, a case where a sorting process is performed as the batch processing will be described as an example.

[0025] First, the input interface 20 accepts a designation of an input file condition based on a user operation (step S101). Furthermore, the input interface 20 accepts a designation of an environmental condition based on a user operation (step S103). Here, it is assumed that a size of "1 GB" is designated as the input file condition and a maximum usable memory amount of "6 GB" is designated as the environmental condition.

[0026] Next, the analysis unit 11 executes batch processing under the specified combination of input file conditions and environmental conditions (step S105). At the same time, the analysis unit 11 measures the processing time of this batch processing. Here, the analysis unit 11 executes batch processing (sort processing) for each combination of the input file condition specification of "1 GB" size and the environmental condition specification of six memory usages (0 GB, 1 GB, 2 GB, 3 GB, 4 GB, 5 GB, 6 GB) that are less than the maximum available memory amount (six combination conditions in total), and measures the processing time for each combination. The information collection unit 13 stores the measured processing time in the storage unit 40.

[0027] Next, the analysis unit 11 analyzes the measured processing time and determines the conditions (combined conditions) that result in the fastest processing (step S107). Furthermore, after identifying the conditions that result in the fastest processing, the analysis unit 11 saves the analysis results AD (step S109). That is, the analysis unit 11 generates data by batch processing the input file (processing target) under the input file conditions (target conditions) and environmental conditions, and stores the data in the storage unit 40.

[0028] FIG. 4 is a diagram showing an example of an analysis result AD according to the present disclosure. In the analysis result AD shown in FIG. 4, the measured "processing time (seconds)" is registered in association with the combined condition of "input file condition (size GB)" and "environmental condition (memory usage GB)." For example, the analysis unit 11 determines that the processing time (55 seconds) for the combined condition of input file condition (size 1 GB) and environmental condition (memory usage 4 GB) is the fastest. Then, the analysis unit 11 associates the "fastest determination result (fastest flag)" with the combined condition, and stores the analysis result AD in the storage unit 40. This completes the processing of this flowchart.

[0029] (Automatic high-speed processing) Next, the processing of the batch processing automatic speed-up device according to the present disclosure will be described. FIG. 5 is a flowchart showing the flow of automatic speed-up processing of the batch processing automatic speed-up device according to the present disclosure. The processing shown in FIG. 5 is started, for example, when a user issues an instruction to start batch processing via the input interface 20. Here, a case where sorting processing is performed as the batch processing will be described as an example. Note that the batch processing may not be started based on a user instruction, but may be started automatically at a preset execution timing such as daily or weekly.

[0030] First, the input interface 20 accepts the specification of input file conditions based on a user operation (step S201). Here, it is assumed that a size of "2 GB" is specified as the input file condition. If batch processing is started at a predetermined execution timing such as daily or weekly, the input file conditions may be specified by the user in advance before the start of the batch processing. Furthermore, the input file conditions (e.g., size) may be automatically measured according to the input file to be processed.

[0031] Next, the batch processing execution unit 12 searches the analysis result AD for the environmental condition that provides the fastest processing speed under the specified input file conditions (step S203). For example, in the case of the analysis result AD shown in FIG. 4, the batch processing execution unit 12 determines that the environmental condition that provides the fastest processing speed under the input file size of 2 GB is "memory usage 3 GB" (processing time 100 seconds). The batch processing execution unit 12 may determine the environmental condition that provides the fastest processing speed by referring to the "fastest determination result" in the analysis result AD. That is, the batch processing execution unit 12 searches the storage unit 40 for the environmental condition (first environmental condition) that provides the fastest processing time among the data associated with the input file conditions (target conditions) specified by the user.

[0032] Next, the batch processing execution unit 12 executes the batch processing under the environmental conditions determined to result in the fastest processing speed (step S205). During this batch processing, the information collection unit 13 measures the processing time. That is, the batch processing execution unit 12 searches for the first environmental conditions that result in the fastest processing time among the data associated with the input file conditions (target conditions) corresponding to the input file (first processing target) to be processed, and batch processes the input file (first processing target) under the searched first environmental conditions.

[0033] After the batch processing is completed, the abnormality determination unit 14 determines whether the difference between the processing time (actual processing time) measured in step S205 and the processing time (predicted time) registered in the analysis result AD is equal to or greater than a threshold (step S207). The threshold is specified in advance by a user or the like. For example, if the actual processing time measured in step S205 is "120 seconds" and the predicted time obtained from the analysis result AD shown in FIG. 4 is "100 seconds," the ratio of this difference to the predicted time is 20% (=|120-100| / 100×100). Here, if the threshold is "10%, the abnormality determination unit 14 determines that the difference between the two is equal to or greater than the threshold and that the predicted time "100 seconds" is highly likely to be an abnormal value.

[0034] When the abnormality determination unit 14 determines that the difference between the two is equal to or greater than the threshold value (step S207; YES), it updates the analysis result AD stored in the storage unit 40 (step S209). FIG. 6 is a diagram illustrating how the analysis result AD according to the present disclosure is updated. As shown in FIG. 6, in the analysis result AD, the processing time of "100 seconds" for the combined condition of the input file condition (size 2 GB) and the environmental condition (memory usage 3 GB) is updated to the actual processing time of "120 seconds." As a result of updating the processing time in this manner, the processing time of "105 seconds" for the environmental condition (memory usage 2 GB) becomes the fastest processing time among the environmental conditions associated with the input file condition (size 2 GB). Therefore, the fastest determination result is updated to indicate that the combined condition of the input file condition (size 2 GB) and the environmental condition (memory usage 2 GB) is the fastest.

[0035] That is, the abnormality determination unit 14 updates the processing time stored in the storage unit 40 with the actual processing time based on a comparison result between the difference between the actual processing time of the batch processing and the processing time associated with the environmental condition in the storage unit 40 and a preset threshold. If the difference between the actual processing time and the processing time is equal to or greater than the threshold (if the ratio of the difference between the actual processing time and the processing time to the processing time is equal to or greater than the threshold), the abnormality determination unit 14 updates the processing time stored in the storage unit 40 with the actual processing time. When the storage unit 40 has been updated, the batch processing execution unit 12 performs batch processing based on the data stored in the updated storage unit 40.

[0036] On the other hand, if the abnormality determination unit 14 determines that the difference between the two is not equal to or greater than the threshold value (step S207; NO), the analysis result AD is not updated. This completes the processing of this flowchart.

[0037] The batch processing automatic acceleration device 1 of this embodiment updates the analysis results based on the difference between the predicted batch processing time determined based on the analysis results and the actual processing time when the batch processing is actually executed, and the result of comparing this difference with a threshold. If there is a large discrepancy between the predicted time and the actual processing time (for example, if the analysis results are incorrect), the batch processing automatic acceleration device 1 automatically detects this, determines it to be an abnormal value, and updates the analysis results. This makes it easy to automatically accelerate batch processing. Since all data other than the data to be updated has already been measured, new fastest conditions can be automatically determined simply by replacing the predicted time for the incorrect conditions with correct data. By automating the time-consuming performance adjustment of batch processing, processing can be accelerated without much effort. Performance adjustment can be performed automatically even in a multiple-machine environment.

[0038] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-described embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.

[0039] Some or all of the above-described embodiments can be described as, but are not limited to, the following supplementary notes.

[0040] (Appendix 1) a storage unit that stores data in which target conditions indicating characteristics of a processing target, environmental conditions indicating characteristics of an execution environment, and processing times when the processing target is batch-processed under the target conditions and the environmental conditions are associated with each other; a batch processing execution unit that searches the storage unit for a first environmental condition that has the shortest processing time among data associated with the target conditions corresponding to a first processing target to be processed, and performs batch processing on the first processing target under the searched first environmental condition; a determination unit that updates the first processing time stored in the storage unit with the actual processing time based on a comparison result between a difference between an actual processing time of the batch processing and a first processing time associated with the first environmental condition in the storage unit and a preset threshold value; Equipped with Automatic batch processing high-speed device.

[0041] (Appendix 2) When the difference between the actual processing time and the first processing time is equal to or greater than the threshold, the determination unit updates the first processing time stored in the storage unit with the actual processing time. 2. The batch processing automation high-speed device according to claim 1.

[0042] (Appendix 3) when a ratio of a difference between the actual processing time and the first processing time to the first processing time is equal to or greater than the threshold, the determination unit updates the first processing time stored in the storage unit with the actual processing time; 3. The batch processing automatic high-speed device according to claim 1 or 2.

[0043] (Appendix 4) when the storage unit is updated, the batch processing execution unit performs the batch processing based on the data stored in the updated storage unit. 4. The batch processing automatic high-speed device according to any one of appendices 1 to 3.

[0044] (Appendix 5) an analysis unit that generates the data by batch processing the processing object under the target condition and the environmental condition, and stores the data in the storage unit; 5. The batch processing automatic high-speed device according to any one of appendices 1 to 4.

[0045] (Appendix 6) the batch processing execution unit searches the storage unit for the first environmental condition that has the shortest processing time among data associated with the target condition specified by the user; 6. An automatic batch processing high-speed device according to any one of appendices 1 to 5.

[0046] (Appendix 7) The target conditions include at least one condition of the size, number, format, number of records, maximum record length, average record length, number of keys, presence or absence of equivalent keys, and data alignment of the file to be processed. 7. The batch processing automatic high-speed device according to any one of appendices 1 to 6.

[0047] (Appendix 8) The environmental conditions include at least one of the following: memory usage of the execution environment, location of the file to be processed on a disk, location or division number of work files generated from the file, location of output files on a disk, a disk to be used, and a processing algorithm. 8. The batch processing automatic high-speed device according to any one of appendices 1 to 7.

[0048] (Appendix 9) The computer storing data in a storage unit that associates target conditions indicating characteristics of a processing target, environmental conditions indicating characteristics of an execution environment, and processing times when the processing target is batch-processed under the target conditions and the environmental conditions; In the storage unit, a first environmental condition that has the shortest processing time is searched for among data associated with the target conditions corresponding to a first processing target to be processed, and batch processing the first processing target under the searched first environmental condition is performed; updating the first processing time stored in the storage unit with the actual processing time based on a comparison result between a difference between an actual processing time of the batch processing and a first processing time associated with the first environmental condition in the storage unit and a preset threshold value; Automatic batch processing speed-up method.

[0049] (Appendix 10) If the difference between the actual processing time and the first processing time is equal to or greater than the threshold, the first processing time stored in the storage unit is updated with the actual processing time. 10. The batch processing automatic acceleration method according to claim 9.

[0050] (Appendix 11) When a ratio of a difference between the actual processing time and the first processing time to the first processing time is equal to or greater than the threshold value, the first processing time stored in the storage unit is updated with the actual processing time. 11. The batch processing automatic speed-up method according to claim 9 or 10.

[0051] (Appendix 12) When the storage unit is updated, the batch processing is performed based on the data stored in the updated storage unit. 12. A batch processing automatic speed-up method according to any one of appendices 9 to 11.

[0052] (Appendix 13) Furthermore, the data is generated by batch processing the processing object under the object conditions and the environmental conditions, and is stored in the storage unit. 13. A batch processing automatic speed-up method according to any one of appendices 9 to 12.

[0053] (Appendix 14) In the storage unit, a search is made for the first environmental condition that has the shortest processing time among data associated with the target condition designated by the user. 14. A batch processing automatic speed-up method according to any one of appendices 9 to 13.

[0054] (Appendix 15) The target conditions include at least one condition of the size, number, format, number of records, maximum record length, average record length, number of keys, presence or absence of equivalent keys, and data alignment of the file to be processed. 15. A batch processing automatic speed-up method according to any one of appendices 9 to 14.

[0055] (Appendix 16) The environmental conditions include at least one of the following: memory usage of the execution environment, location of the file to be processed on a disk, location or division number of work files generated from the file, location of output files on a disk, a disk to be used, and a processing algorithm. 16. A batch processing automatic speed-up method according to any one of appendices 9 to 15.

[0056] (Appendix 17) On the computer, storing data in a storage unit that associates target conditions indicating characteristics of a processing target, environmental conditions indicating characteristics of an execution environment, and processing times when the processing target is batch-processed under the target conditions and environmental conditions; a search is made in the storage unit for a first environmental condition that has the shortest processing time among data associated with the target conditions corresponding to a first processing target to be processed, and the batch processing is made on the first processing target under the searched first environmental condition; updating the first processing time stored in the storage unit with the actual processing time based on a comparison result between a difference between an actual processing time of the batch processing and a first processing time associated with the first environmental condition in the storage unit and a preset threshold value; program.

[0057] (Appendix 18) When the difference between the actual processing time and the first processing time is equal to or greater than the threshold value, the first processing time stored in the storage unit is updated with the actual processing time. 17. The program described in Appendix 17.

[0058] (Appendix 19) When a ratio of a difference between the actual processing time and the first processing time to the first processing time is equal to or greater than the threshold, the first processing time stored in the storage unit is updated with the actual processing time. 19. The program according to claim 17 or 18.

[0059] (Appendix 20) When the storage unit is updated, the batch processing is performed based on the data stored in the updated storage unit. 20. The program of any one of appendices 17 to 19.

[0060] (Appendix 21) Furthermore, the data is generated by batch processing the processing object under the object conditions and the environmental conditions, and the data is stored in the storage unit. 21. The program of any one of appendices 17 to 20.

[0061] (Appendix 22) causing the storage unit to search for the first environmental condition that has the shortest processing time among data associated with the target condition specified by the user; 22. The program of any one of appendices 17 to 21.

[0062] (Appendix 23) The target conditions include at least one condition of the size, number, format, number of records, maximum record length, average record length, number of keys, presence or absence of equivalent keys, and data alignment of the file to be processed. 23. The program of any one of appendices 17 to 22.

[0063] (Appendix 24) The environmental conditions include at least one of the following: memory usage of the execution environment, location of the file to be processed on a disk, location or division number of work files generated from the file, location of output files on a disk, a disk to be used, and a processing algorithm. 24. The program of any one of appendices 17 to 23. [Explanation of symbols]

[0064] 1. Automatic high-speed batch processing equipment 10 Data Processing Unit 11 Analysis Department 12 Batch processing execution unit 13 Information Gathering Department 14 Abnormality determination section 15 Display control unit 20 Input Interface 30 Display section 40 Storage section

Claims

1. a storage unit that stores data in which target conditions indicating characteristics of a processing target, environmental conditions indicating characteristics of an execution environment, and processing times when the processing target is batch-processed under the target conditions and the environmental conditions are associated with each other; a batch processing execution unit that searches the storage unit for a first environmental condition that has the shortest processing time among data associated with the target conditions corresponding to a first processing target to be processed, and performs batch processing on the first processing target under the searched first environmental condition; a determination unit that updates the first processing time stored in the storage unit with the actual processing time based on a comparison result between a difference between an actual processing time of the batch processing and a first processing time associated with the first environmental condition in the storage unit and a preset threshold value; Equipped with Automatic batch processing high-speed device.

2. When the difference between the actual processing time and the first processing time is equal to or greater than the threshold, the determination unit updates the first processing time stored in the storage unit with the actual processing time.

2. The batch processing automatic high-speed device according to claim 1.

3. When a ratio of a difference between the actual processing time and the first processing time to the first processing time is equal to or greater than the threshold, the determination unit updates the first processing time stored in the storage unit with the actual processing time.

2. The batch processing automatic high-speed device according to claim 1.

4. when the storage unit is updated, the batch processing execution unit performs the batch processing based on the data stored in the updated storage unit. The batch processing automatic high-speed device according to any one of claims 1 to 3.

5. an analysis unit that generates the data by batch processing the processing object under the target condition and the environmental condition, and stores the data in the storage unit; The batch processing automatic high-speed device according to any one of claims 1 to 3.

6. the batch processing execution unit searches the storage unit for the first environmental condition that has the shortest processing time among data associated with the target condition specified by the user; The batch processing automatic high-speed device according to any one of claims 1 to 3.

7. The target conditions include at least one condition of the size, number, format, number of records, maximum record length, average record length, number of keys, presence or absence or bias of equivalent keys, and data arrangement of the file to be processed. The batch processing automatic high-speed device according to any one of claims 1 to 3.

8. The environmental conditions include at least one of the following: memory usage of the execution environment, location of the file to be processed on a disk, location or division number of work files generated from the file, location of output files on a disk, a disk to be used, and a processing algorithm. The batch processing automatic high-speed device according to any one of claims 1 to 3.

9. The computer storing data in a storage unit that associates target conditions indicating characteristics of a processing target, environmental conditions indicating characteristics of an execution environment, and processing times when the processing target is batch-processed under the target conditions and the environmental conditions; In the storage unit, a first environmental condition that has the shortest processing time is searched for among data associated with the target conditions corresponding to a first processing target to be processed, and batch processing the first processing target under the searched first environmental condition is performed; updating the first processing time stored in the storage unit with the actual processing time based on a comparison result between a difference between an actual processing time of the batch processing and a first processing time associated with the first environmental condition in the storage unit and a preset threshold value; Automatic batch processing speed-up method.

10. On the computer, storing data in a storage unit that associates target conditions indicating characteristics of a processing target, environmental conditions indicating characteristics of an execution environment, and processing times when the processing target is batch-processed under the target conditions and environmental conditions; a search is made in the storage unit for a first environmental condition that has the shortest processing time among data associated with the target conditions corresponding to a first processing target to be processed, and the batch processing is made on the first processing target under the searched first environmental condition; updating the first processing time stored in the storage unit with the actual processing time based on a comparison result between a difference between an actual processing time of the batch processing and a first processing time associated with the first environmental condition in the storage unit and a preset threshold value; program.

Images