Data processing method, data processing device, electronic device and storage medium

Abstract

The present disclosure provides a data processing method, a data processing device, an electronic device and a storage medium, which relate to the field of computer technology. The method is applied to a file service system, which has multiple users, and comprises: obtaining data to be archived uploaded by the user; writing the data to be archived into a preset archive template to generate an archive file; storing the archive file in a first storage component by calling a business interface, obtaining a label and a storage address of the returned archive file; and storing the label and the storage address of the archive file in a second storage component corresponding to the user.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and more specifically, to a data processing method, a data processing device, an electronic device, a readable storage medium, and a computer program product. Background Art

[0002] Data archiving is the process of moving data to a separate storage device for long-term storage, which can avoid the loss of stored data due to host crashes.

[0003] In the process of realizing the concept of the present disclosure, the inventors found that there are at least the following problems in the related technology: due to the non-uniform interfaces between application systems of different users and file service systems, the workload of interface development increases, and there is a risk of non-standard interface development. Summary of the invention

[0004] In view of this, the present disclosure provides a data processing method, a data processing device, an electronic device, a readable storage medium, and a computer program product.

[0005] One aspect of the present disclosure provides a data processing method, which is applied to a file service system, wherein the file service system has multiple users, and the method includes: obtaining the data to be archived uploaded by the user; writing the data to be archived into a preset archive template to generate an archive file; storing the archive file in a first storage component by calling a business interface to obtain a label and a storage address of the archive file returned; and storing the label and the storage address of the archive file in a second storage component corresponding to the user.

[0006] According to an embodiment of the present disclosure, the above-mentioned data to be archived includes multiple data fields; wherein, the above-mentioned data to be archived is written into a preset archive template to generate an archive file, including: obtaining an archive data table, wherein the above-mentioned archive data table includes multiple empty fields arranged in a preset order; processing the above-mentioned archive data table based on the multiple data fields of the above-mentioned data to be archived to obtain imported data; and writing the above-mentioned imported data into the above-mentioned preset archive template to generate the above-mentioned archive file.

[0007] According to an embodiment of the present disclosure, the data field of the above-mentioned data to be archived has a first field identifier, and the empty field in the above-mentioned archived data table has a second field identifier; wherein the above-mentioned processing of the above-mentioned archived data table based on multiple data fields of the above-mentioned data to be archived includes: matching the first field identifier of the above-mentioned data field with the second field identifiers of multiple empty fields in the above-mentioned archived data table for each data field of the above-mentioned data to be archived in turn; and replacing the above-mentioned current empty field in the above-mentioned archived data table with the above-mentioned data field when the first field identifier of the above-mentioned data field matches the second field identifier of the current empty field.

[0008] According to an embodiment of the present disclosure, the data processing method also includes: in response to a file download request of the above-mentioned user, obtaining a label of the target archive file carried in the above-mentioned file download request; determining a storage address corresponding to the label of the above-mentioned target archive file from a second storage component corresponding to the above-mentioned user by calling the above-mentioned business interface, wherein the above-mentioned storage address includes a pre-signed address; and accessing the first storage component based on the storage address of the above-mentioned target archive file to download the above-mentioned target archive file from the above-mentioned first storage component.

[0009] According to an embodiment of the present disclosure, the storage address corresponding to the label of the target archive file is determined from the second storage component corresponding to the user by calling the business interface, including: obtaining the identity information of the user; calling the business interface to determine the target second storage component corresponding to the user based on the identity information of the user; and determining the storage address corresponding to the label of the target archive file from the target second storage component.

[0010] According to an embodiment of the present disclosure, the above-mentioned business interface is called to determine the storage address corresponding to the tag of the above-mentioned target archive file from the second storage component corresponding to the above-mentioned user, and it also includes: after calling the above-mentioned business interface, authenticating the above-mentioned user; when the authentication is successful, determining the above-mentioned target second storage component corresponding to the above-mentioned user based on the identity information of the above-mentioned user; and when the authentication fails, sending feedback information of download failure to the above-mentioned user.

[0011] Another aspect of the present disclosure provides a data processing device, including: an acquisition module, used to acquire the data to be archived uploaded by the above-mentioned user; a writing module, used to write the above-mentioned data to be archived into a preset archiving template to generate an archive file; a processing module, used to store the above-mentioned archive file in a first storage component by calling a business interface, and obtain the label and storage address of the returned archive file; and a storage module, used to store the label and storage address of the above-mentioned archive file in a second storage component corresponding to the above-mentioned user.

[0012] Another aspect of the present disclosure provides an electronic device, comprising: one or more processors; and a memory for storing one or more instructions, wherein when the one or more instructions are executed by the one or more processors, the one or more processors implement the method as described above.

[0013] Another aspect of the present disclosure provides a computer-readable storage medium storing computer-executable instructions, which are used to implement the above method when executed.

[0014] Another aspect of the present disclosure provides a computer program product, which includes computer executable instructions, and when the instructions are executed, are used to implement the method as described above.

[0015] According to the embodiments of the present disclosure, by setting an archiving template, the data to be archived uploaded by different users through different application systems can be written into the archiving template to generate an archive file in a unified format, which can be transmitted to the first storage component through the business interface, and the metadata of the archive file can be stored through the second storage component. Through the above technical means, the archiving of data in different application systems is realized using a unified business interface, which at least partially overcomes the technical problem of increased repeated interface development workload caused by the inconsistency of the interfaces of different users' application systems, thereby effectively improving the implementation efficiency of the connection between different users and the file service system, and reducing the development cost and interface development risk. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] The above and other objects, features and advantages of the present disclosure will become more apparent through the following description of the embodiments of the present disclosure with reference to the accompanying drawings, in which:

[0017] Figure 1 A schematic diagram schematically shows a system architecture of an application data processing method in the related art;

[0018] Figure 2 The exemplary system architecture of the application data processing method according to the embodiment of the present disclosure is schematically shown;

[0019] Figure 3 A flowchart schematically shows a data processing method according to an embodiment of the present disclosure;

[0020] Figure 4 A flowchart schematically shows a data processing method according to another embodiment of the present disclosure;

[0021] Figure 5 A schematic diagram of an application scenario of a data processing method according to an embodiment of the present disclosure is schematically shown;

[0022] Figure 6A block diagram schematically shows a data processing device according to an embodiment of the present disclosure; and

[0023] Figure 7 A block diagram of an electronic device for implementing a data processing method according to an embodiment of the present disclosure is schematically shown. DETAILED DESCRIPTION

[0024] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. However, it should be understood that these descriptions are exemplary only and are not intended to limit the scope of the present disclosure. In the following detailed description, for ease of explanation, many specific details are set forth to provide a comprehensive understanding of the embodiments of the present disclosure. However, it is apparent that one or more embodiments may also be implemented without these specific details. In addition, in the following description, descriptions of known structures and technologies are omitted to avoid unnecessary confusion of the concepts of the present disclosure.

[0025] The terms used herein are only for describing specific embodiments and are not intended to limit the present disclosure. The terms "comprise", "include", etc. used herein indicate the existence of the features, steps, operations and / or components, but do not exclude the existence or addition of one or more other features, steps, operations or components.

[0026] All terms (including technical and scientific terms) used herein have the meanings commonly understood by those skilled in the art, unless otherwise defined. It should be noted that the terms used herein should be interpreted as having a meaning consistent with the context of this specification, and should not be interpreted in an idealized or overly rigid manner.

[0027] When using expressions such as "at least one of A, B, and C, etc.", they should generally be interpreted according to the meaning of the expression commonly understood by those skilled in the art (for example, "a system having at least one of A, B, and C" should include but is not limited to a system having A alone, B alone, C alone, A and B, A and C, B and C, and / or A, B, C, etc.).

[0028] Figure 1 A schematic diagram schematically shows a system architecture of an application data processing method in related art.

[0029] like Figure 1As shown, different users have their own application systems, for example, user A, user B, user C and user D correspond to application system A, application system B, application system C and application system D respectively. Different users can upload structured data and / or unstructured data to the big data cloud platform for archiving through the interface between the application system and the file service system, so as to facilitate the subsequent data call. For example, the user can merge the ID of the attachment to be uploaded into a dat file through the application system, and then call the business interface between the file service system to push the dat file to the big data cloud platform.

[0030] However, the archived data structures of each user's application system are not unified, and each has its own business fields and data structures. Some application systems archive structured data while archiving unstructured files. In related technologies, the interface of each application system is usually developed separately, resulting in a large amount of repeated development work, which is time-consuming and labor-intensive, and also generates risks such as non-standard development.

[0031] In view of this, the embodiments of the present disclosure provide a standardized, single-interface data docking solution, which achieves the unification of application system interfaces and ensures the secure transmission of data archives.

[0032] Specifically, the embodiments of the present disclosure provide a data processing method, a data processing device, an electronic device, a readable storage medium and a computer program product. The method includes obtaining data to be archived uploaded by a user; writing the data to be archived into a preset archive template to generate an archive file; storing the archive file in a first storage component by calling a business interface to obtain a label and storage address of the returned archive file; and storing the label and storage address of the archive file in a second storage component corresponding to the user.

[0033] In the technical solution disclosed in the present invention, the acquisition, storage and application of user personal information involved are in compliance with the provisions of relevant laws and regulations, necessary confidentiality measures are taken, and do not violate public order and good morals.

[0034] Figure 2 The exemplary system architecture 200 to which the data processing method according to the embodiment of the present disclosure can be applied is schematically shown. It should be noted that: Figure 2 What is shown is merely an example of a system architecture to which the embodiments of the present disclosure can be applied, in order to help those skilled in the art understand the technical content of the present disclosure, but it does not mean that the embodiments of the present disclosure cannot be used in other devices, systems, environments or scenarios.

[0035] like Figure 2As shown, the system architecture 200 according to this embodiment may include terminal devices 201, 202, 203, a network 204 and a server 205. The network 204 is used to provide a medium for communication links between the terminal devices 201, 202, 203 and the server 205. The network 204 may include various connection types, such as wired and / or wireless communication links, etc.

[0036] The user can use the terminal devices 201, 202, 203 to interact with the server 205 through the network 204 to upload or download archive files, etc. Various client applications can be installed on the terminal devices 201, 202, 203, such as file upload applications, download applications, instant messaging tools, email clients and / or social platform software, etc. (only as examples).

[0037] The terminal devices 201, 202, 203 may be various electronic devices having a display screen and supporting uploading or downloading of archived files, including but not limited to smart phones, tablet computers, laptop computers, desktop computers, and the like.

[0038] The server 205 may be a server that provides various services, such as a background management server (only as an example) that provides support for archive files uploaded or downloaded by users using the terminal devices 201, 202, and 203. The background management server may analyze and process the received data such as the user's file download request, and feed back the processing result (such as whether the target archive file is successfully downloaded according to the user's request, etc.) to the terminal device.

[0039] It should be noted that the data processing method provided in the embodiment of the present disclosure can generally be executed by the server 205. Accordingly, the data processing device provided in the embodiment of the present disclosure can generally be set in the server 205. The data processing method provided in the embodiment of the present disclosure can also be executed by a server or server cluster that is different from the server 205 and can communicate with the terminal device 201, 202, 203 and / or the server 205. Accordingly, the data processing device provided in the embodiment of the present disclosure can also be set in a server or server cluster that is different from the server 205 and can communicate with the terminal device 201, 202, 203 and / or the server 205. Alternatively, the data processing method provided in the embodiment of the present disclosure can also be executed by the terminal device 201, 202, or 203, or it can also be executed by other terminal devices different from the terminal device 201, 202, or 203. Accordingly, the data processing device provided in the embodiment of the present disclosure can also be set in the terminal device 201, 202, or 203, or it can be set in other terminal devices different from the terminal device 201, 202, or 203.

[0040] It should be understood that Figure 2The number of terminal devices, networks and servers in the embodiment is only for illustration. Any number of terminal devices, networks and servers may be provided according to implementation requirements.

[0041] Figure 3 The flowchart of the data processing method according to the embodiment of the present disclosure is schematically shown.

[0042] like Figure 3 As shown, the data processing method is applied to a file service system, the file service system has multiple users, and the method includes operations S310-S340.

[0043] It should be noted that, unless it is explicitly stated that there is a sequence of execution between different operations shown in the flowchart in the embodiments of the present disclosure, or there is a sequence of execution between different operations in technical implementation, otherwise, the execution order of multiple operations may not be prioritized, and multiple operations may also be executed simultaneously.

[0044] In operation S310, data to be archived uploaded by a user is obtained.

[0045] In operation S320, the data to be archived is written into a preset archive template to generate an archive file.

[0046] In operation S330, the archive file is stored in the first storage component by calling the service interface, and the label and storage address of the returned archive file are obtained.

[0047] In operation S340, the tag and storage address of the archived file are stored in a second storage component corresponding to the user.

[0048] According to an embodiment of the present disclosure, the data to be archived may include structured data and / or unstructured data. Among them, structured data may represent data with a fixed format or limited length, such as database tables, metadata, etc. Unstructured data may represent data with variable length or no fixed format, such as business data such as emails, word, excel and pdf documents.

[0049] According to an embodiment of the present disclosure, the preset archiving template may be set based on the interface configuration of all application systems connected to the file service system.

[0050] According to an embodiment of the present disclosure, the preset archive template may be a Dat file, and the correspondingly generated archive file may also be a Dat file.

[0051] According to an embodiment of the present disclosure, the business interface may include but is not limited to a data acquisition component of a big data cloud platform, such as an application programming interface such as an API. The first storage component may include a cloud archive server of a big data cloud platform, such as an object storage service (Cloud Object Service, COS) or a data storage system (Hadoop Distributed File System, HDFS). The second storage component may include a data management component of a big data cloud platform.

[0052] According to the embodiments of the present disclosure, by setting an archiving template, the data to be archived uploaded by different users through different application systems can be written into the archiving template to generate an archive file in a unified format, which can be transmitted to the first storage component through the business interface, and the metadata of the archive file can be stored through the second storage component. Through the above technical means, the archiving of data in different application systems is realized using a unified business interface, which at least partially overcomes the technical problem of increased repeated interface development workload caused by the inconsistency of the interfaces of different users' application systems, thereby effectively improving the implementation efficiency of the connection between different users and the file service system, and reducing the development cost and interface development risk.

[0053] According to an embodiment of the present disclosure, the data to be archived includes a plurality of data fields.

[0054] According to an embodiment of the present disclosure, writing the data to be archived into a preset archive template to generate an archive file may include the following operations: obtaining an archive data table, wherein the archive data table includes a plurality of empty fields arranged in a preset order. Processing the archive data table based on the plurality of data fields of the data to be archived to obtain imported data. Writing the imported data into a preset archive template to generate an archive file.

[0055] According to an embodiment of the present disclosure, field attributes such as the type, length, whether the field can be empty, and order of each field may be configured in the archive data table.

[0056] According to the embodiments of the present disclosure, a variety of strategies can be used to process archived data tables. For example, a data field of the data to be archived can have a first field identifier, and an empty field in the archived data table has a second field identifier. The first field identifier and the second field identifier can be the name, primary key, unique key, etc. of the field, which are not limited here; for each data field of the data to be archived, the first field identifier of the data field can be matched with the second field identifiers of multiple empty fields in the archived data table; and when the first field identifier of the data field matches the second field identifier of the current empty field, the current empty field in the archived data table is replaced with the data field.

[0057] According to an embodiment of the present disclosure, after the imported data is written into a preset archive template, the unstructured data contained in the archive data can be packaged into a tar package, and the path of the tar package can be added to the last field of the preset archive template to generate an archive file. The metadata of the archive file can include information such as the incoming server IP port and the path of the tar package.

[0058] Figure 4 The flowchart schematically shows a data processing method according to another embodiment of the present disclosure.

[0059] like Figure 4 As shown, the data processing method may further include operations S410 to S430.

[0060] In operation S410, in response to a file download request from a user, a tag of a target archive file carried in the file download request is obtained.

[0061] In operation S420, a storage address corresponding to the tag of the target archive file is determined from a second storage component corresponding to the user by calling a service interface, wherein the storage address includes a pre-signed address.

[0062] In operation S430, the first storage component is accessed based on the storage address of the target archive file to download the target archive file from the first storage component.

[0063] According to an embodiment of the present disclosure, an archived file has metadata, and the user to whom the archived file belongs can be determined from the metadata.

[0064] According to an embodiment of the present disclosure, determining a storage address corresponding to a tag of a target archive file from a second storage component corresponding to a user by calling a service interface may include the following operations: obtaining identity information of the user. Calling a service interface to determine a target second storage component corresponding to the user based on the identity information of the user. Determining a storage address corresponding to the tag of the target archive file from the target second storage component.

[0065] According to an embodiment of the present disclosure, by calling a service interface, determining a storage address corresponding to a tag of a target archive file from a second storage component corresponding to a user may also include the following operations: after calling the service interface, authenticating the user. If the authentication is successful, determining a target second storage component corresponding to the user based on the user's identity information. If the authentication fails, sending feedback information of download failure to the user.

[0066] According to an embodiment of the present disclosure, when a user downloads a target archive file, it is necessary to determine whether the user has the right to access the second storage component. In the case of successful authentication, the target second storage component corresponding to the user is determined based on the user's identity information, so as to obtain the target archive file from the target second storage component. In the case of failed authentication, feedback information is sent to the user to remind the user that his file download request cannot be completed. Among them, successful authentication indicates that the user has the right to access the second storage component, and failed authentication indicates that the user does not have the right to access the second storage component.

[0067] Figure 5 The following is a schematic diagram of an application scenario of the data processing method according to an embodiment of the present disclosure.

[0068] like Figure 5 As shown, the data to be archived 501 uploaded by the user can generate an archive file 502 according to the method of operation S302. In the storage process of the archive file 502, the archive file will first be stored in the first storage component 504 specified by the user by calling the business interface 503; after the first storage component 504 completes the file storage, the storage address and file label of the archive file 502 will be returned; thereafter, the storage address, file label and other metadata of the archive file 502 can be stored in the second storage component 505.

[0069] On the other hand, after completing the storage of the archive file 502, the business interface 503 can transmit the business-related data to the external platform 506, so that users of the external system can download the archive file 502 through the external platform.

[0070] When receiving a request from any user to download the target archive file 507, the storage address of the target archive file 507 can be determined from the second storage component 505 through the label of the target archive file 507 carried in the request. When accessing the second storage component 505 through the business interface 503, the second storage component 505 will authenticate the user to determine whether the user has the authority to obtain the target archive file 507. After the authentication is successful, the second storage component 505 will return the pre-signed storage address of the second storage component 505 to the business interface 503. Based on the storage address, the target archive file 507 can be obtained from the corresponding first storage component 504.

[0071] Figure 6 The block diagram schematically shows a data processing device according to an embodiment of the present disclosure.

[0072] like Figure 6 As shown, the data processing device 600 may include an acquisition module 610 , a writing module 620 , a processing module 630 and a storage module 640 .

[0073] The acquisition module 610 is used to acquire the data to be archived uploaded by the user.

[0074] The writing module 620 is used to write the data to be archived into a preset archiving template to generate an archive file.

[0075] The processing module 630 is used to store the archive file in the first storage component by calling the business interface, and obtain the label and storage address of the returned archive file.

[0076] The storage module 640 is used to store the label and storage address of the archived file in the second storage component corresponding to the user.

[0077] According to the embodiments of the present disclosure, by setting an archiving template, the data to be archived uploaded by different users through different application systems can be written into the archiving template to generate an archive file in a unified format, which can be transmitted to the first storage component through the business interface, and the metadata of the archive file can be stored through the second storage component. Through the above technical means, the archiving of data in different application systems is realized using a unified business interface, which at least partially overcomes the technical problem of increased repeated interface development workload caused by the inconsistency of the interfaces of different users' application systems, thereby effectively improving the implementation efficiency of the connection between different users and the file service system, and reducing the development cost and interface development risk.

[0078] According to an embodiment of the present disclosure, the data to be archived includes a plurality of data fields.

[0079] According to an embodiment of the present disclosure, the writing module 620 may include a first acquiring unit, a processing unit, and a writing unit.

[0080] The first acquisition unit is used to acquire an archived data table, wherein the archived data table includes a plurality of empty fields arranged in a preset order.

[0081] The processing unit is used to process the archived data table based on multiple data fields of the data to be archived to obtain the imported data.

[0082] The writing unit is used to write the imported data into a preset archive template to generate an archive file.

[0083] According to an embodiment of the present disclosure, a data field of the data to be archived has a first field identifier, and an empty field in the archived data table has a second field identifier.

[0084] According to an embodiment of the present disclosure, the processing unit may include a first processing sub-unit and a second processing sub-unit.

[0085] The first processing subunit is used to match, for each data field of the to-be-archived data, a first field identifier of the data field with second field identifiers of a plurality of empty fields in the archived data table.

[0086] The second processing subunit is used to replace the current empty field in the archived data table with the data field when the first field identifier of the data field matches the second field identifier of the current empty field. According to an embodiment of the present disclosure, the data processing device 600 may also include a second acquisition module, a determination module and a download module.

[0087] The second acquisition module is used to respond to the user's file download request and acquire the label of the target archive file carried in the file download request.

[0088] The determination module is used to determine the storage address corresponding to the label of the target archive file from the second storage component corresponding to the user by calling the business interface, wherein the storage address includes a pre-signed address.

[0089] The download module is used to access the first storage component based on the storage address of the target archive file to download the target archive file from the first storage component.

[0090] According to an embodiment of the present disclosure, the determination module may include a second acquisition unit, a first determination unit, and a second determination unit.

[0091] The second acquisition unit is used to acquire the identity information of the user.

[0092] The first determining unit is used to call the business interface and determine the target second storage component corresponding to the user based on the user's identity information.

[0093] The second determining unit is used to determine a storage address corresponding to the label of the target archive file from the target second storage component.

[0094] According to an embodiment of the present disclosure, the determination module may further include an authentication unit, a third determination unit and a sending unit.

[0095] The authentication unit is used to authenticate the user after calling the business interface.

[0096] The third determining unit is used to determine a target second storage component corresponding to the user based on the user's identity information when the authentication is successful.

[0097] The sending unit is used to send download failure feedback information to the user when the authentication fails.

[0098] According to the embodiments of the present invention, any one or more of the modules, units, and sub-units, or at least part of the functions of any one of them can be implemented in one module. According to the embodiments of the present invention, any one or more of the modules, units, and sub-units can be split into multiple modules for implementation. According to the embodiments of the present invention, any one or more of the modules, units, and sub-units can be at least partially implemented as hardware circuits, such as field programmable gate arrays (FPGAs), programmable logic arrays (PLAs), systems on chips, systems on substrates, systems on packages, application specific integrated circuits (ASICs), or can be implemented by hardware or firmware in any other reasonable way of integrating or packaging the circuit, or in any one of the three implementation methods of software, hardware, and firmware, or in any appropriate combination of any of them. Alternatively, according to the embodiments of the present invention, one or more of the modules, units, and sub-units can be at least partially implemented as computer program modules, and when the computer program modules are run, the corresponding functions can be performed.

[0099] For example, any multiple of the acquisition module 610, the write module 620, the processing module 630, and the storage module 640 can be combined in one module / unit / sub-unit for implementation, or any one of the modules / units / sub-units can be split into multiple modules / units / sub-units. Alternatively, at least part of the functions of one or more modules / units / sub-units in these modules / units / sub-units can be combined with at least part of the functions of other modules / units / sub-units and implemented in one module / unit / sub-unit. According to an embodiment of the present disclosure, at least one of the acquisition module 610, the write module 620, the processing module 630, and the storage module 640 can be at least partially implemented as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on a chip, a system on a substrate, a system on a package, an application specific integrated circuit (ASIC), or can be implemented by hardware or firmware such as any other reasonable way of integrating or packaging the circuit, or by any one of the three implementation methods of software, hardware, and firmware, or by a suitable combination of any of them. Alternatively, at least one of the acquisition module 610 , the writing module 620 , the processing module 630 , and the storage module 640 may be at least partially implemented as a computer program module, and when the computer program module is executed, a corresponding function may be performed.

[0100] It should be noted that the data processing device part in the embodiments of the present disclosure corresponds to the data processing method part in the embodiments of the present disclosure. The description of the data processing device part specifically refers to the data processing method part, which will not be repeated here.

[0101] Figure 7 A block diagram of an electronic device suitable for implementing a data processing method according to an embodiment of the present disclosure is schematically shown. Figure 7 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0102] like Figure 7 As shown, the computer electronic device 700 according to the embodiment of the present disclosure includes a processor 701, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 702 or the program loaded from the storage part 708 to the random access memory (RAM) 703. The processor 701 may include, for example, a general-purpose microprocessor (such as a CPU), an instruction set processor and / or a related chipset and / or a special-purpose microprocessor (for example, an application-specific integrated circuit (ASIC)), etc. The processor 701 may also include an onboard memory for caching purposes. The processor 701 may include a single processing unit or multiple processing units for performing different actions of the method flow according to the embodiment of the present disclosure.

[0103] In RAM 703, various programs and data required for the operation of electronic device 700 are stored. Processor 701, ROM 702 and RAM 703 are connected to each other via bus 704. Processor 701 performs various operations of the method flow according to the embodiment of the present disclosure by executing the program in ROM 702 and / or RAM 703. It should be noted that the program can also be stored in one or more memories other than ROM 702 and RAM 703. Processor 701 can also perform various operations of the method flow according to the embodiment of the present disclosure by executing the program stored in the one or more memories.

[0104] According to an embodiment of the present disclosure, the electronic device 700 may further include an input / output (I / O) interface 705, which is also connected to the bus 704. The electronic device 700 may further include one or more of the following components connected to the I / O interface 705: an input portion 706 including a keyboard, a mouse, etc.; an output portion 707 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage portion 708 including a hard disk, etc.; and a communication portion 709 including a network interface card such as a LAN card, a modem, etc. The communication portion 709 performs communication processing via a network such as the Internet. A drive 710 is also connected to the I / O interface 705 as needed. A removable medium 711, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 710 as needed, so that a computer program read therefrom is installed into the storage portion 708 as needed.

[0105] According to an embodiment of the present disclosure, the method flow according to an embodiment of the present disclosure can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable storage medium, and the computer program contains a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 709, and / or installed from the removable medium 711. When the computer program is executed by the processor 701, the above-mentioned functions defined in the system of the embodiment of the present disclosure are executed. According to an embodiment of the present disclosure, the system, equipment, device, module, unit, etc. described above can be implemented by a computer program module.

[0106] The present disclosure also provides a computer-readable storage medium, which may be included in the device / apparatus / system described in the above embodiments; or may exist independently without being assembled into the device / apparatus / system. The above computer-readable storage medium carries one or more programs, and when the above one or more programs are executed, the method according to the embodiment of the present disclosure is implemented.

[0107] According to an embodiment of the present disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium. For example, it may include, but is not limited to: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, apparatus, or device.

[0108] For example, according to an embodiment of the present disclosure, the computer-readable storage medium may include the ROM 702 and / or the RAM 703 described above and / or one or more memories other than the ROM 702 and the RAM 703 .

[0109] The embodiments of the present disclosure also include a computer program product, which includes a computer program, which contains program code for executing the method provided by the embodiments of the present disclosure. When the computer program product runs on an electronic device, the program code is used to enable the electronic device to implement the data processing method provided by the embodiments of the present disclosure.

[0110] When the computer program is executed by the processor 701, the above functions defined in the system / device of the embodiment of the present disclosure are executed. According to the embodiment of the present disclosure, the system, device, module, unit, etc. described above can be implemented by a computer program module.

[0111] In one embodiment, the computer program may rely on tangible storage media such as optical storage devices, magnetic storage devices, etc. In another embodiment, the computer program may also be transmitted and distributed in the form of signals on a network medium, and downloaded and installed through the communication part 709, and / or installed from the removable medium 711. The program code contained in the computer program may be transmitted using any appropriate network medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0112] According to an embodiment of the present disclosure, the program code for executing the computer program provided by the embodiment of the present disclosure can be written in any combination of one or more programming languages. Specifically, these computing programs can be implemented using high-level process and / or object-oriented programming languages, and / or assembly / machine languages. Programming languages ​​include, but are not limited to, Java, C++, python, "C" language or similar programming languages. The program code can be executed entirely on the user's computing device, partially on the user's device, partially on a remote computing device, or entirely on a remote computing device or server. In the case of a remote computing device, the remote computing device can be connected to the user's computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computing device (e.g., using an Internet service provider to connect through the Internet).

[0113] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram may represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of the code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box may also occur in an order different from that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions. It can be understood by those skilled in the art that the features recorded in the various embodiments and / or claims of the present disclosure can be combined and / or combined in a variety of ways, even if such a combination or combination is not explicitly recorded in the present disclosure. In particular, without departing from the spirit and teaching of the present disclosure, the features described in the various embodiments and / or claims of the present disclosure may be combined and / or combined in a variety of ways. All of these combinations and / or combinations fall within the scope of the present disclosure.

[0114] The embodiments of the present disclosure are described above. However, these embodiments are only for the purpose of illustration and are not intended to limit the scope of the present disclosure. Although the embodiments are described above separately, this does not mean that the measures in the various embodiments cannot be used in combination to advantage. The scope of the present disclosure is defined by the attached claims and their equivalents. Without departing from the scope of the present disclosure, those skilled in the art may make various substitutions and modifications, which should all fall within the scope of the present disclosure.

Claims

1. A data processing method, applied to a file service system, wherein the file service system has multiple users, the method comprising: Obtaining the data to be archived uploaded by the user; Writing the data to be archived into a preset archiving template to generate an archive file; By calling the service interface, the archive file is stored in the first storage component, and the label and storage address of the archive file are returned; as well as storing the label and storage address of the archived file in a second storage component corresponding to the user; Wherein, the data to be archived includes a plurality of data fields; The step of writing the data to be archived into a preset archive template to generate an archive file includes: Acquire an archived data table, wherein the archived data table includes a plurality of empty fields arranged in a preset order; Processing the archived data table based on multiple data fields of the data to be archived to obtain imported data; and Writing the imported data into the preset archive template to generate the archive file; The data field of the data to be archived has a first field identifier, and the empty field in the archived data table has a second field identifier; Wherein, processing the archived data table based on the multiple data fields of the data to be archived includes: For each data field of the to-be-archived data, matching the first field identifier of the data field with the second field identifiers of a plurality of empty fields in the archived data table in sequence; and In the case where the first field identifier of the data field matches the second field identifier of the currently empty field, the currently empty field in the archived data table is replaced with the data field.

2. The method according to claim 1, further comprising: In response to a file download request from the user, obtaining a label of a target archive file carried in the file download request; Determine, by calling the service interface, a storage address corresponding to the tag of the target archive file from a second storage component corresponding to the user, wherein the storage address includes a pre-signed address; as well as The first storage component is accessed based on the storage address of the target archive file to download the target archive file from the first storage component.

3. The method according to claim 2, wherein: The step of determining the storage address corresponding to the label of the target archive file from the second storage component corresponding to the user by calling the service interface includes: Obtaining identity information of the user; Calling the service interface to determine a target second storage component corresponding to the user based on the identity information of the user; and A storage address corresponding to the tag of the target archive file is determined from the target second storage component.

4. The method according to claim 3, further comprising: After calling the service interface, authenticating the user; In case of successful authentication, determining the target second storage component corresponding to the user based on the identity information of the user; as well as In case of authentication failure, feedback information of download failure is sent to the user.

5. A data processing device, comprising: The acquisition module is used to obtain the data to be archived uploaded by the user; A writing module, used for writing the data to be archived into a preset archiving template to generate an archive file; A processing module, configured to store the archive file in the first storage component by calling a business interface, and obtain a label and a storage address of the archive file returned; as well as A storage module, used for storing the label and storage address of the archived file in a second storage component corresponding to the user; Wherein, the data to be archived includes a plurality of data fields; Wherein, the writing module includes: A first acquisition unit is used to acquire an archived data table, wherein the archived data table includes a plurality of empty fields arranged in a preset order; a processing unit, configured to process the archived data table based on a plurality of data fields of the data to be archived to obtain imported data; and A writing unit, used for writing the imported data into the preset archiving template to generate the archiving file; The data field of the data to be archived has a first field identifier, and the empty field in the archived data table has a second field identifier; Wherein, the processing unit comprises: A first processing subunit is configured to match, for each data field of the to-be-archived data, a first field identifier of the data field with second field identifiers of a plurality of empty fields in the archived data table; and The second processing subunit is configured to replace the current empty field in the archived data table with the data field if the first field identifier of the data field matches the second field identifier of the current empty field.

6. An electronic device comprising: one or more processors; A memory for storing one or more instructions, Wherein, when the one or more instructions are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 4.

7. A computer-readable storage medium having executable instructions stored thereon, wherein when the executable instructions are executed by a processor, the processor is enabled to implement the method according to any one of claims 1 to 4.

8. A computer program product, comprising computer executable instructions, wherein the computer executable instructions are used to implement the method according to any one of claims 1 to 4 when executed.

Images