File data processing method and device, electronic equipment and storage medium

Abstract

The invention discloses a file data processing method and device, electronic equipment and a storage medium, and relates to the technical field of data processing. A specific embodiment of the method comprises the steps of obtaining to-be-processed task information in response to triggering of a file processing task; extracting a plurality of parameter values, and generating task type characters according to the plurality of parameter values so as to query the task state of the file processing task; obtaining a first file set of which the first catalog meets a preset condition, extracting a second file set associated with the first file set from the second catalog, and obtaining description information of each second file, so as to match a corresponding target file according to the task state; and calling a processing program associated with the task state and processing the target file to obtain a corresponding processing result, and updating the processing state of the target file based on the processing result. According to the embodiment, the problems that the number of files of each overseas branch is not uniform, file overstock and task idle are easily caused, task allocation is not uniform, and resource waste is caused can be solved.

Description

Technical Field

[0001] The present invention relates to the field of data processing technology, and in particular to a method, device, electronic device and storage medium for file data processing. Background Art

[0002] In different business fields, in order to enable business data to be traced back and tracked, the archiving of files is an indispensable process. For example, in the financial field, not only domestic business files need to be processed, but also the files of overseas branches are involved, so how to achieve the archiving of files becomes a major issue. In related technologies, a scheduled archiving task can usually be set for each overseas branch to archive the files of each overseas branch separately. However, the number of files in each overseas branch is not uniform, so it is easy to cause file backlogs and idle tasks, resulting in uneven task distribution and waste of resources. Summary of the invention

[0003] In view of this, an embodiment of the present invention provides a method, device, electronic device and storage medium for file data processing, which can solve the problem that the number of files in each overseas branch is uneven, which can easily lead to file backlogs and idle tasks, resulting in uneven task distribution and waste of resources.

[0004] To achieve the above objective, according to one aspect of an embodiment of the present invention, a method for processing file data is provided.

[0005] A method for file data processing in an embodiment of the present invention includes: in response to a file processing task being triggered, obtaining information on pending tasks in a task list; extracting multiple parameter values ​​from the pending task information, calling a preset generation model, and generating task type characters based on the multiple parameter values ​​to query the task status of the file processing task; obtaining a first file set that meets a preset condition in a first directory, extracting a second file set associated with the first file set from a second directory, and obtaining description information of each second file to match a corresponding target file according to the task status; calling a processing program associated with the task status and processing the target file to obtain a corresponding processing result, and updating the processing status of the target file based on the processing result.

[0006] In one embodiment, multiple parameter values ​​are extracted from the task information to be processed, a preset generation model is called, and task type characters are generated according to the multiple parameter values, including: in response to the task information to be processed being structured data, each structured field in the task information to be processed is identified to extract the field value of the structured field and determine it as the parameter value; in response to the task information to be processed being unstructured data, text information of the task information to be processed is obtained, and corresponding parameter values ​​in the text information are extracted according to multiple preset parameters; and a preset generation model is called to arrange the multiple parameter values ​​in a preset order, and generate a task type character based on the arranged parameter values.

[0007] In another embodiment, obtaining the first file set in the first directory that meets preset conditions includes: obtaining file content information of each file in the first directory, clustering the files according to the file content information, and filtering the file set belonging to the preset target type to determine it as the first file set.

[0008] In yet another embodiment, extracting a second file set associated with the first file set from a second directory includes: obtaining a file name of each first file in the first file set to extract a second file set matching the file name from the second directory.

[0009] In another embodiment, the method further includes: in response to a file consumption instruction, obtaining corresponding file information and consumption status; in response to the consumption status being a preset status, obtaining the corresponding file according to the file information and storing it in the second directory, and obtaining the attribute value of the preset attribute according to the file information to generate the corresponding file and store it in the first directory.

[0010] In another embodiment, multiple parameter values ​​are extracted from the pending task information, a preset generation model is called, and a task type character is generated according to the multiple parameter values ​​to query the task status of the file processing task, including: extracting the task execution time and task identifier from the pending task information to call the preset generation model to generate the task type character, and determining the task type of the file processing task based on the task type character and the current time information.

[0011] In another embodiment, calling the processing program associated with the task type to process the target file and obtaining the processing result further includes: obtaining a file list corresponding to the file to be processed, and updating the file information of the target file corresponding to the file list according to the processing result.

[0012] To achieve the above objective, according to another aspect of an embodiment of the present invention, a device for processing file data is provided.

[0013] A device for file data processing in an embodiment of the present invention includes: an acquisition unit, which is used to obtain task information to be processed in a task list in response to a processing task being triggered; a determination unit, which is used to extract multiple parameter values ​​from the task information to be processed, call a preset generation model, and generate task type characters according to the multiple parameter values ​​to query the task status of the file processing task; a matching unit, which is used to obtain a first file set that meets a preset condition in a first directory, extract a second file set associated with the first file set from a second directory, and obtain description information of each second file to match a corresponding target file according to the task status; a processing unit, which is used to call a processing program associated with the task status and process the target file to obtain a corresponding processing result, and update the processing status of the target file based on the processing result.

[0014] In one embodiment, the determination unit is specifically used to: in response to the task information to be processed being structured data, identify each structured field in the task information to be processed to extract the field value of the structured field and determine it as the parameter value; in response to the task information to be processed being unstructured data, obtain text information of the task information to be processed, and extract corresponding parameter values ​​in the text information according to multiple preset parameters; call a preset generation model to arrange the multiple parameter values ​​in a preset order, and generate a task type character based on the arranged parameter values.

[0015] In yet another embodiment, the matching unit is specifically used to: obtain file content information of each file in the first directory, cluster the files according to the file content information, and filter a file set belonging to a preset target type to determine it as the first file set.

[0016] In yet another embodiment, the matching unit is specifically configured to obtain a file name of each first file in the first file set, so as to extract a second file set matching the file name from the second directory.

[0017] In another embodiment, the acquisition unit is further used to obtain corresponding file information and consumption status in response to a file consumption instruction; the device also includes: a storage unit, used to obtain the corresponding file according to the file information and store it in the second directory in response to the consumption status being a preset state, and obtain the attribute value of the preset attribute according to the file information to generate the corresponding file and store it in the first directory.

[0018] In another embodiment, the determination unit is specifically used to: extract the task execution time and task identifier from the task information to be processed, to call a preset generation model to generate a task type character, and determine the task type of the file processing task based on the task type character and current time information.

[0019] To achieve the above objective, according to another aspect of an embodiment of the present invention, an electronic device is provided.

[0020] An electronic device according to an embodiment of the present invention includes: one or more processors; a storage device for storing one or more programs, when the one or more programs are executed by the one or more processors, the one or more processors implement the file data processing method provided by the embodiment of the present invention.

[0021] To achieve the above objective, according to another aspect of an embodiment of the present invention, a computer readable medium is provided.

[0022] A computer-readable medium according to an embodiment of the present invention stores a computer program, and when the program is executed by a processor, the method for processing file data provided by the embodiment of the present invention is implemented.

[0023] To achieve the above objective, according to another aspect of an embodiment of the present invention, a computer program product is provided.

[0024] A computer program product according to an embodiment of the present invention includes a computer program, and when the program is executed by a processor, the file data processing method provided by the embodiment of the present invention is implemented.

[0025] One embodiment of the above invention has the following advantages or beneficial effects: in the embodiment of the present invention, after the file processing task is triggered, the information of the task to be processed can be obtained, and then the task type character of the processing task can be determined according to the information of the task to be processed to query the task status corresponding to the processing task; then according to the first file obtained in the first directory, the second file associated with it is extracted from the second directory to match the target file corresponding to the task status, so that the target file can be processed by the task status associated processing program and the processing result can be obtained, and the processing status of the target file can be updated at the same time. In this way, in the embodiment of the present invention, the target file and the processing program to be processed can be determined by the file processing task and the information of the task to be processed to realize the archiving processing of the file, so that the centralized processing of the files of the overseas branches can be realized, and the idleness and backlog due to the uneven distribution of files can be avoided, and the waste of resources can be avoided; and in the embodiment of the present invention, the file processing task is divided into different task types, and the corresponding type processing can be performed on the file according to its task status, so that the processing efficiency of the file can be improved.

[0026] The further effects of the above-mentioned non-conventional optional manner will be described below in conjunction with the specific implementation manner. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] The accompanying drawings are used to better understand the present invention and do not constitute an improper limitation of the present invention. Figure 1 is a schematic diagram of a main process of a method for processing file data according to an embodiment of the present invention; Figure 2 is a schematic diagram of another main process of the method for processing file data according to an embodiment of the present invention; Figure 3 is a schematic diagram of another main process of the method for processing file data according to an embodiment of the present invention; Figure 4 is a schematic diagram of main units of an apparatus for file data processing according to an embodiment of the present invention; Figure 5 is an exemplary system architecture diagram to which embodiments of the present invention may be applied; Figure 6 It is a schematic diagram of the structure of a computer system suitable for implementing the embodiment of the present invention. DETAILED DESCRIPTION

[0028] The following is a description of exemplary embodiments of the present invention in conjunction with the accompanying drawings, including various details of the embodiments of the present invention to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present invention. Similarly, for clarity and conciseness, the description of well-known functions and structures is omitted in the following description.

[0029] It should be pointed out that the embodiments of the present invention and the features in the embodiments can be combined with each other without conflict. The acquisition, transmission, storage, use, and processing of data in the technical solution of this application are in compliance with the relevant provisions of national laws and regulations. In the embodiments of this application, some existing solutions in the industry such as certain software, components, and models may be mentioned, which should be considered as exemplary. Their purpose is only to illustrate the feasibility of the implementation of the technical solution of this application, but it does not mean that the applicant has or will necessarily use the solution.

[0030] An embodiment of the present invention provides a file data processing system, which can be used in a scenario of processing files, and specifically can be used in a scenario of archiving files in the financial field.

[0031] The embodiment of the present invention provides a method for processing file data, which can be executed by a file data processing system. Figure 1 As shown, the method includes the following steps.

[0032] S101: In response to a file processing task being triggered, obtaining task information to be processed in a task list.

[0033] The file processing task may be pre-set, and may specifically be a file archiving task. The task list is pre-generated, and may include tasks to be executed when each file needs to be processed, such as an archiving task. The specific content of the task information to be processed may be set according to actual needs, such as including a task name, a task identifier, a subtask identifier, a task execution time, etc.

[0034] In the embodiment of the present invention, in order to facilitate task processing and improve file processing efficiency, the task can be divided into multiple different subtasks, so that the file can be processed by executing the subtasks on each file in sequence. Taking the task to be processed as a file archiving task as an example, the file archiving task processing process can include file registration, file copying, file compression and notification, so the file processing task can be divided into task types of file registration, file copying, file compression and notification based on this, and the corresponding subtask identifier, name and other information can be set for each subtask.

[0035] Specifically, the file archiving task is split into different task types, that is, the file archiving task may include file registration, file copying, file compression and notification.

[0036] File registration: register the file into the record information to be archived, and change the execution status of the main task; file copy: query the data of the archive record table of the day, and generate or copy the file of the message content of the archive record to the specified directory and the specified file name as required; file compression: compress the current directory, and change the status of the archive task information to pending notification after the compression is completed; notification: query the notification table according to the task information, obtain the list of recipients to be notified and the notification method (such as SMS, interface, email, etc.), and notify the recipients one by one according to the notification method.

[0037] On this basis, a corresponding pending task can be set for each subtask in the task list, so that when the business processing task is triggered, the corresponding subtask can be executed on the file through the processing of the pending task.

[0038] It should be noted that the pending task processing information can be stored according to a preset format, which can be a structured format, and the detailed information of each task can be stored in the structured format. For example, the structured format can be a format of fields and corresponding field values.

[0039] S102: extracting multiple parameter values ​​from the task information to be processed, calling a preset generation model, and generating a task type character according to the multiple parameter values ​​to query the task status of the file processing task.

[0040] Among them, the task type is determined according to the splitting of the file processing task, and the task type of each subtask can establish a corresponding relationship with the corresponding task type character to represent the corresponding subtask. In the embodiment of the present invention, after the file to be processed is processed by each task to be processed, the subtask currently executed can be represented by the task status, so that the next subtask can be processed later. Therefore, the task status associated with each task type character can also be set in the embodiment of the present invention. In this step, the information to be processed includes the corresponding file processing task and subtask information, so in this step, multiple parameter values ​​can be extracted from it to generate a task type character, and then the task status corresponding to the file processing task triggered this time can be queried, that is, the task status of the file to be processed.

[0041] Specifically, in the embodiment of the present invention, for the task information to be processed stored in a structured format, each structured field stored therein can be identified to extract the corresponding field value, that is, the parameter value; for the task information to be processed stored in an unstructured format, it can be converted into text information, and the parameter values ​​corresponding to multiple preset parameters can be extracted therefrom by identifying the text information. Then, the extracted multiple parameter values ​​can be used to generate task type characters.

[0042] It should be noted that in the embodiments of the present invention, for the task information to be processed in a structured format, the field names of the required field values ​​to be extracted can be pre-set, such as task identifier, subtask identifier, etc., so that each parameter value can be extracted from the structured data; for the task information to be processed in an unstructured format, the parameter value extraction method in the text information can be preset, such as a machine learning model, etc., so that each parameter value can be extracted, and the parameter value can be specifically a task identifier, a subtask identifier, etc.

[0043] In the embodiment of the present invention, after obtaining each parameter value, the task type character is generated by the generation model. The generation model can be preset, and in this specific step, each parameter value can be arranged in a preset order, and then the task type character is generated according to the arranged parameter value, such as a hash value of the arranged parameter value can be generated to determine it as the task type character.

[0044] In one embodiment, in order to facilitate the efficiency and balance of each subtask execution, the execution time of different subtasks can be set to execute each subtask at different times. Therefore, in this step, the corresponding subtask type can also be determined based on the time information, that is, the task execution time and task identifier are extracted from the task information to be processed, so as to call the preset generation model to generate the task type character, and determine the task status of the file processing task based on the task type character and the current time information. In this step, the task type character can determine the corresponding task status, but at the same time, the current time and the execution time can also be compared. If the current time reaches the execution time, the corresponding task status can be determined according to the task type character; if the current time does not reach the execution time, it can be determined to stop the execution of the task. The execution time is pre-configured, which can be specifically an execution cycle and a specific execution time period, etc., so that the specific execution time can be determined.

[0045] S103: Acquire a first file set that meets a preset condition in a first directory, extract a second file set associated with the first file set from a second directory, and acquire description information of each second file to match a corresponding target file according to a task status.

[0046] Among them, the first directory and the second directory are pre-set, the second directory can be used to store the files generated by the business processing, that is, the files corresponding to the file processing tasks, and the first directory can be used to store the mark files, and the mark files can be used to extract the files to be processed from the second directory. Therefore, in this step, the first file set that meets the preset conditions can be first obtained from the first directory, and the second file set can be extracted from the second directory based on it, so that the target file, that is, the file to be processed by the task, can be determined therefrom. In this step, the description information of the second file can be carried by the corresponding first file, such as by the name, mark, etc. of the first file. According to the description information, the task status of the second file can be determined, and then the target file can be matched.

[0047] In another embodiment, this step can be specifically performed as follows: obtaining file content information of each file in the first directory, clustering the files according to the file content information, screening a set of files belonging to a preset target type, and determining the first set of files. The content information may include specific content in the file, whether the file is empty, and / or the size of the content in the file, etc. The corresponding target type can be set according to demand, for example, it can be an empty file type.

[0048] In another embodiment, the files in the first target and the files in the second directory may be associated with each other through file attributes, such as file names, so after obtaining the first file set, the second file set may be determined based on the association.

[0049] It should be noted that the files to be archived are usually files obtained after consumption processing, so before this step, it can also include: in response to the file consumption instruction, obtaining the corresponding file information and consumption status; in response to the consumption status being the preset state, obtaining the corresponding file according to the file information and storing it in the second directory, obtaining the attribute value of the preset attribute according to the file information to generate the associated first file and store it in the first directory. The preset state can be specifically a consumption completion state. At this time, the file to be archived has been generated, so the corresponding file can be obtained according to the file information and stored in the second directory to wait for the processing of the embodiment of the present invention. At the same time, the first file associated with the file can also be generated and stored in the first directory. This first file can be generated according to demand. For example, the first file and the second file can be associated by name, and the name of the first file can be generated according to the name of the second file. The preset attribute can include the attribute corresponding to the preset condition in this step, so that the first file can be obtained in this step.

[0050] S104: calling a processing program associated with the task status and processing the target file to obtain a corresponding processing result, and updating the processing status of the target file based on the processing result.

[0051] Among them, a corresponding processing program can be set for each subtask to memorize and process the file, so in the embodiment of the present invention, each processing program can be associated with the task state. After the target file is determined, the processing program associated with the task state can be called to process the target file to obtain the processing result. The processing result may include the information after the file is processed, based on which the processing state of the target file can be updated so that the target file can perform subsequent processing. For example, the processing state can include the corresponding task state, that is, the task state of the first file corresponding to the target file is memorized and updated to the task state corresponding to the next subtask to be executed.

[0052] It should be noted that, for the processing result of the target file, we can first determine whether the target file has completed the evening archiving task. If so, it means that the file has been archived, and the operation on it can be notified, and the corresponding first file can be deleted; if not, it means that the file has not been archived, and the task status of the corresponding first file can be updated to the task status associated with the next subtask.

[0053] In an embodiment of the present invention, each file processing task can be set as a high-frequency scheduled task, such as being set to execute once every 5 minutes, each time the file processing task is triggered. The processing program of each subtask may include the configuration information and execution program of the task, and the configuration information may include parameters required for the execution plan, archiving scope, etc. In order to avoid conflicts in file processing, a distributed lock mechanism may be adopted in an embodiment of the present invention, and a distributed lock may be set after each task is determined to be executed, and unlocked after the execution is completed, so that multiple tasks can be executed concurrently in different threads and different servers of the same server, and the archiving task can be completed more efficiently, avoiding uneven pressure on a single server and failure to complete tasks in time due to multiple tasks. In addition, in an embodiment of the present invention, high-frequency scheduled tasks can be templated, so that each subtask can be configured according to the template to realize the corresponding processing process, and the number of tasks of the same type or different types can be plugged in and out in different dimensions.

[0054] It should be noted that, in the embodiment of the present invention, a file list may also be set to timely record the processing progress and file information of each file, so the corresponding information in the file list may be updated after the processing result is obtained.

[0055] In an embodiment of the present invention, the target files and processing programs that need to be processed can be determined through file processing tasks and pending task information to achieve archiving of files, thereby realizing centralized file processing of overseas branches, avoiding idleness and backlogs due to uneven file distribution, and avoiding waste of resources; and in an embodiment of the present invention, the file processing tasks are split into different task types, and the corresponding type of processing can be performed on the files according to their task status, thereby improving the processing efficiency of the files.

[0056] Combine the following Figure 1 The embodiment shown in the figure specifically describes the method for processing file data in the embodiment of the present invention. Figure 2 As shown, the method includes the following steps.

[0057] S201: In response to a file processing task being triggered, obtaining task information to be processed in a task list.

[0058] S202: extracting multiple parameter values ​​from the task information to be processed, generating a task type character according to the multiple parameter values, so as to query the task status of the file processing task.

[0059] S203: Obtain file content information of each file in the first directory, cluster the files according to the file content information, and filter a file set belonging to a preset target type to determine it as a first file set.

[0060] S204: Obtain the file name of each first file in the first file set to extract a second file set matching the file name from the second directory, and obtain description information of each second file to match the corresponding target file according to the task status.

[0061] S205: calling a processing program associated with the task status and processing the target file to obtain a corresponding processing result, and updating the processing status of the target file based on the processing result.

[0062] It should be noted that the data processing principle in the embodiment of the present invention is the same as Figure 1 The corresponding data processing principles in the illustrated embodiments are the same and will not be described in detail here.

[0063] In an embodiment of the present invention, the target files and processing programs that need to be processed can be determined through file processing tasks and pending task information to achieve archiving of files, thereby realizing centralized file processing of overseas branches, avoiding idleness and backlogs due to uneven file distribution, and avoiding waste of resources; and in an embodiment of the present invention, the file processing tasks are split into different task types, and the corresponding type of processing can be performed on the files according to their task status, thereby improving the processing efficiency of the files.

[0064] Combine the following Figure 1 The embodiment shown in the figure specifically describes the method for processing file data in the embodiment of the present invention. Figure 3 As shown, the method includes the following steps.

[0065] S301: In response to a file consumption instruction, obtain corresponding file information and consumption status.

[0066] S302: In response to the consumption status being the preset status, obtaining a corresponding file according to the file information and storing it in the second directory, and obtaining an attribute value of a preset attribute according to the file information to generate an associated first file and store it in the first directory.

[0067] S303: In response to the file processing task being triggered, obtaining task information to be processed in the task list.

[0068] S304: extracting the task execution time and the task identifier from the task information to be processed to generate a task type character, and determining the task status of the file processing task based on the task type character and the current time information.

[0069] S305: Acquire a first file set that meets a preset condition in the first directory, extract a second file set associated with the first file set from the second directory, and acquire description information of each second file to match a corresponding target file according to the task status.

[0070] S306: calling a processing program associated with the task status and processing the target file to obtain a corresponding processing result, and updating the processing status of the target file based on the processing result.

[0071] It should be noted that the data processing principle in the embodiment of the present invention is the same as Figure 1 The corresponding data processing principles in the illustrated embodiments are the same and will not be described in detail here.

[0072] In order to solve the problems existing in the prior art, an embodiment of the present invention provides a device 400 for processing file data, such as Figure 4 As shown, the device 400 includes: an acquisition unit 401, which is used to obtain task information to be processed in a task list in response to a processing task being triggered; a determination unit 402, which is used to extract multiple parameter values ​​from the task information to be processed, call a preset generation model, and generate a task type character according to the multiple parameter values ​​to query the task status of the file processing task; a matching unit 403, which is used to obtain a first file set that meets a preset condition in a first directory, extract a second file set associated with the first file set from a second directory, and obtain description information of each second file to match the corresponding target file according to the task status; a processing unit 404, which is used to call a processing program associated with the task status and process the target file to obtain a corresponding processing result, and update the processing status of the target file based on the processing result.

[0073] It should be understood that the manner of implementing the embodiments of the present invention is different from the Figure 1 The method of the illustrated embodiment is the same and will not be repeated here.

[0074] In one embodiment, the determination unit 402 is specifically used to: in response to the task information to be processed being structured data, identify each structured field in the task information to be processed to extract the field value of the structured field and determine it as the parameter value; in response to the task information to be processed being unstructured data, obtain text information of the task information to be processed, and extract corresponding parameter values ​​in the text information according to multiple preset parameters; call a preset generation model to arrange the multiple parameter values ​​in a preset order, and generate a task type character based on the arranged parameter values.

[0075] In yet another embodiment, the matching unit 403 is specifically used to obtain file content information of each file in the first directory, cluster the files according to the file content information, and filter a file set belonging to a preset target type to determine the first file set.

[0076] In yet another embodiment, the matching unit 403 is specifically configured to obtain a file name of each first file in the first file set, so as to extract a second file set matching the file name from the second directory.

[0077] In another embodiment, the acquisition unit 401 is also used to obtain corresponding file information and consumption status in response to a file consumption instruction; the device 400 also includes: a storage unit, used to obtain the corresponding file according to the file information and store it in the second directory in response to the consumption status being a preset state, and obtain the attribute value of the preset attribute according to the file information to generate the corresponding file and store it in the first directory.

[0078] In another embodiment, the determination unit 402 is specifically used to: extract the task execution time and task identifier from the task information to be processed, to call a preset generation model to generate a task type character, and determine the task type of the file processing task based on the task type character and the current time information.

[0079] It should be understood that the manner of implementing the embodiments of the present invention is different from the Figure 1 , 2 , and 3 are the same as the embodiments shown in FIG. 3 and will not be described again here.

[0080] In an embodiment of the present invention, the target files and processing programs that need to be processed can be determined through file processing tasks and pending task information to achieve archiving of files, thereby realizing centralized file processing of overseas branches, avoiding idleness and backlogs due to uneven file distribution, and avoiding waste of resources; and in an embodiment of the present invention, the file processing tasks are split into different task types, and the corresponding type of processing can be performed on the files according to their task status, thereby improving the processing efficiency of the files.

[0081] According to an embodiment of the present invention, the embodiment of the present invention further provides an electronic device and a readable storage medium.

[0082] The electronic device of an embodiment of the present invention comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the one processor, and the instructions are executed by the at least one processor so that the at least one processor executes the method for file data processing provided by the embodiment of the present invention.

[0083] Figure 5 An exemplary system architecture 500 is shown to which the method or apparatus for file data processing according to the embodiment of the present invention may be applied.

[0084] like Figure 5As shown, system architecture 500 may include terminal devices 501, 502, 503, a network 504 and a server 505. Network 504 is used to provide a medium for communication links between terminal devices 501, 502, 503 and server 505. Network 504 may include various connection types, such as wired, wireless communication links or optical fiber cables, etc.

[0085] Users can use terminal devices 501, 502, 503 to interact with server 505 through network 504 to receive or send messages, etc. Various client applications can be installed on terminal devices 501, 502, 503, such as shopping applications, web browser applications, search applications, instant messaging tools, email clients, social platform software, etc. (only examples).

[0086] The terminal devices 501 , 502 , and 503 may be various electronic devices having a display screen and supporting web browsing, including but not limited to smart phones, tablet computers, laptop computers, desktop computers, and the like.

[0087] The server 505 may be a server that provides various services, such as a backend management server (only an example) that provides support for shopping websites browsed by users using the terminal devices 501, 502, and 503. The backend management server may analyze and process the received data such as product information query requests, and feed back the processing results (such as product information - only an example) to the terminal device.

[0088] It should be noted that the file data processing method provided in the embodiment of the present invention is generally executed by the server 505 , and accordingly, the file data processing device is generally set in the server 505 .

[0089] It should be understood that Figure 5 The number of terminal devices, networks and servers in the embodiment is only for illustration. Any number of terminal devices, networks and servers may be provided according to implementation requirements.

[0090] Reference below Figure 6 , which shows a schematic diagram of the structure of a computer system 600 suitable for implementing an embodiment of the present invention. Figure 6 The computer system shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0091] like Figure 6As shown, the computer system 600 includes a central processing unit (CPU) 601, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 602 or a program loaded from a storage part 608 into a random access memory (RAM) 603. In the RAM 603, various programs and data required for the operation of the system 600 are also stored. The CPU 601, the ROM 602, and the RAM 603 are connected to each other through a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.

[0092] The following components are connected to the I / O interface 605: an input section 606 including a keyboard, a mouse, etc.; an output section 607 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 608 including a hard disk, etc.; and a communication section 609 including a network interface card such as a LAN card, a modem, etc. The communication section 609 performs communication processing via a network such as the Internet. A drive 610 is also connected to the I / O interface 605 as needed. A removable medium 611, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 610 as needed, so that a computer program read therefrom is installed into the storage section 608 as needed.

[0093] In particular, according to the embodiments disclosed in the present invention, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present invention include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 609, and / or installed from the removable medium 611. When the computer program is executed by the central processing unit (CPU) 601, the above-mentioned functions defined in the system of the present invention are executed.

[0094] It should be noted that the computer-readable medium shown in the present invention may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present invention, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In the present invention, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.

[0095] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present invention. In this regard, each box in the flow chart or block diagram can represent a unit, a program segment, or a part of a code, and the above-mentioned unit, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0096] The units involved in the embodiments of the present invention may be implemented by software or hardware. The units described may also be arranged in a processor, for example, it may be described as: a processor includes a receiving unit, a determining unit, an acquiring unit, and a comparing unit. The names of these units do not constitute a limitation on the units themselves in some cases, for example, the receiving unit may also be described as a "unit of the function of the receiving unit".

[0097] As another aspect, the present invention further provides a computer-readable medium, which may be included in the device described in the above embodiment; or may exist independently without being assembled into the device. The above computer-readable medium carries one or more programs, and when the above one or more programs are executed by a device, the device executes the file data processing method provided by the present invention.

[0098] As another aspect, the present invention further provides a computer program product, including a computer program, which, when executed by a processor, implements the file data processing method provided by an embodiment of the present invention.

[0099] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may occur depending on design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A method for file data processing, characterized in that: include: In response to the file processing task being triggered, obtaining information of tasks to be processed in the task list; Extracting multiple parameter values ​​from the task information to be processed, calling a preset generation model, and generating a task type character according to the multiple parameter values ​​to query the task status of the file processing task; Acquire a first file set that meets a preset condition in a first directory, extract a second file set associated with the first file set from a second directory, and acquire description information of each second file to match a corresponding target file according to the task status; The processing program associated with the task status is called to process the target file to obtain a corresponding processing result, and the processing status of the target file is updated based on the processing result.

2. The method according to claim 1, characterized in that Extracting multiple parameter values ​​from the task information to be processed, calling a preset generation model, and generating a task type character according to the multiple parameter values, including: In response to the task information to be processed being structured data, identifying each structured field in the task information to be processed, extracting the field value of the structured field, and determining it as the parameter value; in response to the task information to be processed being unstructured data, acquiring text information of the task information to be processed, and extracting the corresponding parameter value in the text information according to a plurality of preset parameters; A preset generation model is called, a plurality of the parameter values ​​are arranged in a preset order, and a task type character is generated based on the arranged parameter values.

3. The method according to claim 1, characterized in that The step of obtaining a first file set in a first directory that meets a preset condition includes: The file content information of each file in the first directory is obtained, the files are clustered according to the file content information, and a file set belonging to a preset target type is screened to determine the first file set.

4. The method according to claim 1 or 3, characterized in that: Extracting a second file set associated with the first file set from a second directory includes: The file name of each first file in the first file set is obtained to extract a second file set matching the file name from the second directory.

5. The method according to claim 1, characterized in that The method further comprises: In response to the file consumption instruction, obtain the corresponding file information and consumption status; In response to the consumption status being a preset status, a corresponding file is acquired according to the file information and stored in the second directory, and an attribute value of a preset attribute is acquired according to the file information to generate an associated first file and store it in the first directory.

6. The method according to claim 1, characterized in that Extracting multiple parameter values ​​from the task information to be processed, calling a preset generation model, and generating a task type character according to the multiple parameter values ​​to query the task status of the file processing task, including: The task execution time and the task identifier are extracted from the task information to be processed, so as to call a preset generation model to generate a task type character, and the task status of the file processing task is determined based on the task type character and the current time information.

7. A device for processing file data, characterized in that: include: An acquisition unit, configured to acquire task information to be processed in a task list in response to a processing task being triggered; A determination unit, configured to extract a plurality of parameter values ​​from the task information to be processed, call a preset generation model, and generate a task type character according to the plurality of parameter values ​​to query the task status of the file processing task; A matching unit, configured to obtain a first file set that meets a preset condition in a first directory, extract a second file set associated with the first file set from a second directory, and obtain description information of each second file to match a corresponding target file according to the task status; The processing unit is used to call the processing program associated with the task status and process the target file to obtain a corresponding processing result, and update the processing status of the target file based on the processing result.

8. The device according to claim 7, characterized in that The determining unit is specifically configured to: In response to the task information to be processed being structured data, identifying each structured field in the task information to be processed, extracting the field value of the structured field, and determining it as the parameter value; in response to the task information to be processed being unstructured data, acquiring text information of the task information to be processed, and extracting the corresponding parameter value in the text information according to a plurality of preset parameters; A preset generation model is called, a plurality of the parameter values ​​are arranged in a preset order, and a task type character is generated based on the arranged parameter values.

9. The device according to claim 7, characterized in that The matching unit is specifically used for: The file content information of each file in the first directory is obtained, the files are clustered according to the file content information, and a file set belonging to a preset target type is screened to determine the first file set.

10. An electronic device, characterized in that: include: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 6.

11. A computer readable medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.

12. A computer program product, comprising a computer program, characterized in that When the program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.

Images