Data processing method and device, electronic equipment and storage medium

Abstract

The invention relates to a data processing method and device, electronic equipment and a storage medium, and relates to the field of data processing. The method comprises the following steps: in response to a received data processing request, analyzing the data processing request, and determining an application identifier; according to the application identifier, a corresponding data dictionary is determined, and the data dictionary comprises the application identifier; according to the type of the data processing request, processing data in the data dictionary and generating feedback information; and outputting the feedback information. According to the invention, the data can be updated and maintained more conveniently and quickly.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular, to a data processing method, apparatus, electronic device, and storage medium. Background Art

[0002] In modern information systems, it is often necessary to update and maintain various configuration items and data types. Usually, in the form of key-value pairs, data types are associated with specific data values, which facilitates more efficient and convenient updating and maintenance. However, there are still defects in existing data processing methods, such as difficulties in modifying and expanding data. Summary of the Invention

[0003] Embodiments of the present disclosure provide a data processing method, apparatus, electronic device, and storage medium, which can facilitate the update and maintenance of data.

[0004] In a first aspect, an embodiment of the present disclosure provides a data processing method, including: in response to receiving a data processing request, parsing the data processing request to determine an application identifier; according to the application identifier, determining a corresponding data dictionary, where the data dictionary includes the application identifier; according to the type of the data processing request, processing the data in the data dictionary and generating feedback information; outputting the feedback information.

[0005] In a second aspect, an embodiment of the present disclosure provides a data processing apparatus, including: an identifier determination unit configured to, in response to receiving a data processing request, parse the data processing request to determine an application identifier; a dictionary determination unit configured to determine a corresponding data dictionary according to the application identifier, where the data dictionary includes the application identifier; a request processing unit configured to process the data in the data dictionary and generate feedback information according to the type of the data processing request; an information output unit configured to output the feedback information.

[0006] In a third aspect, an embodiment of the present disclosure provides an electronic device, including a memory, a processor, a bus, and a computer program stored on the memory and executable on the processor, where the processor implements the data processing method described in the first aspect when executing the computer program.

[0007] In a fourth aspect, an embodiment of the present disclosure provides a non-transitory computer-readable storage medium, on which a computer program is stored, and the computer program implements the data processing method described in the first aspect when executed by a processor.

[0008] By applying the technical solution of the present disclosure, when a data processing request is received, the application identifier can be determined first, and then the corresponding data dictionary can be determined according to the application identifier. Further, according to the type of the data processing request, the dictionary items in the data dictionary are processed and feedback information is generated. Finally, the feedback information is output. That is, the present application can store the data of different applications in the corresponding data dictionaries. When maintaining and updating the data, only the dictionary items in the data dictionaries need to be updated and maintained, so that the data can be updated and maintained more conveniently and quickly.

[0009] It should be understood that the content described in this part is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it used to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] The drawings are used to better understand the solution and do not constitute a limitation to the present disclosure. Among them:

[0011] Figure 1 FIG. is an exemplary system architecture diagram in which an embodiment of the data processing method of the present disclosure can be applied;

[0012] Figure 2 FIG. is a flowchart of an embodiment of the data processing method of the present disclosure;

[0013] Figure 3 FIG. is a flowchart of another embodiment of the data processing method of the present disclosure;

[0014] Figure 4 FIG. is a structural diagram of an actual application scenario of the data processing method of the present disclosure;

[0015] Figure 5 FIG. is a structural diagram of an embodiment of the data processing apparatus of the present disclosure;

[0016] Figure 6 FIG. is a structural diagram of an embodiment of the electronic device of the present disclosure. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0017] It should be noted that the following detailed description is exemplary and is intended to provide further illustration of the present disclosure. Unless otherwise specified, all technical and scientific terms used herein have the same meaning as commonly understood by those of ordinary skill in the technical field to which the present disclosure belongs.

[0018] It should be noted that the terms used herein are only for describing specific embodiments and are not intended to limit the exemplary embodiments according to the present disclosure. As used herein, unless the context clearly indicates otherwise, the singular forms are also intended to include the plural forms. In addition, it should be understood that when the terms "comprising" and / or "including" are used in this specification, they specify the presence of features, steps, operations, devices, components, and / or combinations thereof.

[0019] In the case of no conflict, the embodiments in the present disclosure and the features in the embodiments can be combined with each other.

[0020] In order to make the technical solutions and advantages of the present disclosure clearer and more understandable, the following further describes the present disclosure in detail with reference to the accompanying drawings and specific embodiments.

[0021] Figure 1 An exemplary system architecture 100 is shown, which can apply the embodiments of the data processing method or data processing device of the present disclosure.

[0022] As Figure 1 shown, the system architecture 100 may include a terminal device 101, a network 102, a server 103, and a database set 104. The network 102 is used to provide a medium for communication links among the terminal device 101, the server 103, and each database in the database set 104. The network 102 may include various connection types, such as wired, wireless communication links, or fiber optic cables, etc.

[0023] The user can use the terminal device 101 to interact with the server 105 through the network 104 to receive or send messages, etc. Various communication client applications, such as browser applications, etc., may be installed on the terminal device 101. The user can access a specified page through the above browser applications to input a processing request for data or configuration information for a data dictionary.

[0024] The terminal device 101 can be hardware or software. When the terminal device 101 is hardware, it can be various electronic devices, including but not limited to smart phones, tablet computers, in-vehicle computers, laptop portable computers, and desktop computers, etc. When the terminal device 101 is software, it can be installed in the above-listed electronic devices. It can be implemented as multiple software or software modules (for example, used to provide distributed services), or it can be implemented as a single software or software module. No specific limitation is made here.

[0025] Server 103 can be a server that provides various services, such as a background server for processing data processing requests of the terminal device 101. The background server can receive data processing requests sent by the terminal device 101 through the network 102, and process the data stored in the database set 104 according to the data processing requests and give feedback.

[0026] The database set 104 can include multiple databases, and each database can be used to store various types of data. Specifically, one or more databases in the database set can form a data dictionary. One data dictionary can correspond to one application (which can also be called a business system).

[0027] It should be noted that the data processing method provided by the embodiments of the present disclosure is generally executed by the server 103. Correspondingly, the data processing device is generally arranged in the server 103.

[0028] It should be understood that Figure 1 the numbers of the terminal device, network, server, and database set in

[0029] Figure 2 are only illustrative. According to actual needs, there can be any number of terminal devices, networks, servers, and database sets. Figure 2 As shown in

[0030] Step 201, in response to receiving a data processing request, parse the data processing request to determine the application identifier.

[0031] In this embodiment, the execution entity of the data processing method (such as Figure 1 the server 103 shown in Figure 1 ) can receive the data processing request. The data processing request can be sent by a terminal device (such as

[0032] the terminal device 101 shown in

[0033] In this embodiment, a corresponding relationship between the application identifier and the data dictionary can be established in advance. After determining the application identifier, the corresponding data dictionary can be determined by querying the above corresponding relationship. Alternatively, a specified operation can be performed on the application identifier (for example, using an existing algorithm to perform an operation on the application identifier) to obtain a corresponding value, and the obtained value can be used to find the corresponding data dictionary. Alternatively, the specified fields in the data dictionary can also be directly searched, and the data dictionary that matches the application identifier is used as the corresponding data dictionary.

[0034] Here, the data in the data dictionary can include the application identifier, dictionary type, dictionary key, dictionary value, dictionary value type (numeric, time, string, text, etc.), version, remarks, etc. Among them, the dictionary type is used to describe the application scenario of the data dictionary. The dictionary key and the dictionary value are stored correspondingly. To solve the management and storage of numerous configuration items and configuration files in a conventional business system, a text-type dictionary value is specifically designed to store the corresponding configuration file information, and a version attribute is also designed to manage and store the values of the same data item at different time points.

[0035] Step 203: Process the data in the data dictionary according to the type of the data processing request and generate feedback information.

[0036] After determining the data dictionary, the data in the data dictionary can be processed according to the type of the data processing request, and feedback information can be generated. Specifically, if the type of the data processing request is a type that requires data update, the data in the data dictionary can be updated. If the update is completed within the preset time duration, feedback information indicating that the update is completed can be generated. If the update is not completed within the preset time duration, feedback information indicating that the update is not completed can be generated. If the type of the data processing request is not a type that does not require data update, the query result or the dictionary value can be used as the feedback information.

[0037] Step 204: Output the feedback information.

[0038] After generating the feedback information, the feedback information can be output. In this embodiment, the device that receives the above feedback information can be a terminal device or a message queue (such as kafka) for storing messages.

[0039] The data processing method provided by the above embodiments of the present disclosure can, when receiving a data processing request, first determine an application identifier, and then determine a corresponding data dictionary according to the application identifier. Further, according to the type of the data processing request, process the dictionary items in the data dictionary and generate feedback information. Finally, output the feedback information. That is, the present application can store the data of different applications in the corresponding data dictionaries. When maintaining and updating the data, only the dictionary items in the data dictionaries need to be updated and maintained, so that the data can be updated and maintained more conveniently and quickly.

[0040] Continue to refer to Figure 3 , which shows a flow 300 of another embodiment of the data processing method according to the present disclosure. As Figure 3 shown, the method in this embodiment may include the following steps:

[0041] Step 301, in response to obtaining application information through a preset page, generate an application identifier; obtain configuration information corresponding to the application identifier; initialize the data dictionary according to the configuration information.

[0042] In this embodiment, the user can access the preset page through a terminal device. Through this page, the user can input application information. The application information may include information such as the name and type of the application. After obtaining the application information, an application identifier can be generated. Specifically, the application identifier can be generated according to the user's information, or according to the application information, or according to the historical application identifier to generate the current application identifier.

[0043] After generating the application identifier, the configuration information corresponding to the application identifier can also be obtained. Specifically, the configuration information can still be obtained through the above-mentioned preset page, and can also be obtained in the form of importing a document or inputting text. The configuration information may include configuration parameters for each item of data in the data dictionary, for example, may include parameter values or description texts of the dictionary type, and may also include configuration parameters of the dictionary values, etc.

[0044] After obtaining the configuration information, the data can be initialized.

[0045] Step 302, in response to receiving a data processing request, parse the data processing request to determine the application identifier.

[0046] Step 303, determine the corresponding data dictionary according to the application identifier.

[0047] Step 304, in response to determining that the type of the data processing request is the first type, update the dictionary items in the data dictionary; generate a notification message according to the update result.

[0048] In this embodiment, if the type of the data processing request is the first type, that is, the type that requires updating the data in the data dictionary, the data in the data dictionary can be updated, and a notification message can be generated according to the update result. Specifically, if the update is successful, a successful update message can be generated. If the update is not successful, a failed update message can be generated.

[0049] Step 305, in response to determining that the type of the data processing request is the second type, generate feedback information according to the data in the data dictionary.

[0050] If the type of the data processing request is the second type, that is, the type that requires updating the data in the data dictionary, feedback information can be directly generated according to the data in the data dictionary. Specifically, feedback information can be generated according to the dictionary values in the data dictionary.

[0051] Step 306, output the feedback information.

[0052] After processing the data, the feedback information can be output.

[0053] In some optional implementation manners of this embodiment, if encryption algorithm information is obtained, the processed data can be encrypted according to the above encryption algorithm information, or encrypted when transmitting the feedback message.

[0054] In this implementation manner, if encryption algorithm information is obtained, it is necessary to first determine which part of the data the encryption algorithm information is used to encrypt. After determination, the type of the encryption algorithm can be further analyzed. If it is a symmetric encryption algorithm, a password needs to be specified. If an asymmetric encryption algorithm is selected, a public key file and a private key file need to be uploaded.

[0055] When it is necessary to query the data in the data dictionary, first, the password or public key of the interface encryption algorithm is used to encrypt the interface return value. After the business system obtains the interface return value, it uses the corresponding password or private key for decryption. In the decrypted return value, the dictionary value is still in an encrypted state. When using the corresponding dictionary value, it can be decrypted using the corresponding password or private key.

[0056] To further improve the security of the dictionary values in the data dictionary, the dictionary values can be encrypted using the above encryption algorithm and then stored.

[0057] In some optional implementation manners of this embodiment, when transmitting the feedback information, the feedback information can be transmitted to a message queue (such as Kafka Topic). The business system consumes the corresponding Topic data in real time to delete or update the dictionary data queried locally. The data structure of the Topic includes: application identifier, dictionary type, and dictionary key.

[0058] See Figure 4 , which shows a schematic structural diagram of a specific application scenario of the data processing method of the present disclosure. In Figure 4 , it may include a business system 1, a business system 2, Kafka, and a data item management system. Among them, the business system refers to other systems with data item management requirements, and interacts with the data item management system using a unified Restful Api or integrating the front-end interface of the data item management system. The data item management system consists of application management, key management, and dictionary management. The application management is used to apply to the connected business systems and assign them unique identifiers and encryption algorithms. The unique identifier is used to distinguish data item management between different applications; the encryption algorithm is used to encrypt and store and transmit dictionary data to ensure data security. The dictionary management is responsible for data entry, maintenance, storage, and query. The business system and the data item management system communicate through an interface, which can facilitate data sharing, exchange, and synchronization between different systems, improving system compatibility.

[0059] In some alternative implementation manners of this embodiment, if the data in the data dictionary is updated, feedback information can be regenerated for the processed second-type data processing requests. In this way, timely update of the data can be achieved.

[0060] The data processing method provided in the above embodiments of the present disclosure stores the business system and the corresponding data dictionary independently, making it more convenient to expand data item management; supports data including strings, numerical values, times, and text types, and can solve data management in multiple scenarios such as business constant data items and system configuration files; can also have its own independent database storage system and development language, reducing the coupling degree of data item management and improving the scalability of the system. By adopting encryption storage and encryption transmission technologies, the security of data item management is improved. The change operation of the dictionary data is transmitted through Kafka messages to synchronize the dictionary data between systems in real time.

[0061] Further referring to Figure 5 , as an implementation of the methods shown in the above figures, the present disclosure provides an embodiment of a data processing device. This device embodiment corresponds to the method embodiment shown in Figure 2 , and this device can be specifically applied to various electronic devices.

[0062] As shown in Figure 5 , the data processing device 500 in this embodiment includes: an identifier determination unit 501, a dictionary determination unit 502, a request processing unit 503, and an information output unit 504.

[0063] An identification determination unit 501, configured to parse a data processing request in response to receiving the data processing request and determine an application identification.

[0064] A dictionary determination unit 502, configured to determine a corresponding data dictionary according to the application identification, where the data dictionary includes the application identification.

[0065] A request processing unit 503, configured to process the data in the data dictionary according to the type of the data processing request and generate feedback information.

[0066] An information output unit 504, configured to output the feedback information.

[0067] In addition, in the technical solution of this application, an electronic device is further proposed.

[0068] Figure 6 The structural schematic diagram of an electronic device provided by an embodiment of the present disclosure is shown.

[0069] As Figure 6 shown, the electronic device may include a processor 601, a memory 602, a bus 603, and a computer program stored on the memory 602 and executable on the processor 601. Among them, the processor 601 and the memory 602 complete mutual communication through the bus 603. When the processor 601 executes the computer program, the steps of the above method are implemented, for example, including: parsing a data processing request in response to receiving the data processing request and determining an application identification; determining a corresponding data dictionary according to the application identification, where the data dictionary includes the application identification; processing the data in the data dictionary according to the type of the data processing request and generating feedback information; outputting the feedback information.

[0070] In addition, a non-transitory computer-readable storage medium is further provided in an embodiment of the present disclosure. A computer program is stored thereon. When the computer program is executed by a processor, the steps of the above method are implemented, for example, including: parsing a data processing request in response to receiving the data processing request and determining an application identification; determining a corresponding data dictionary according to the application identification, where the data dictionary includes the application identification; processing the data in the data dictionary according to the type of the data processing request and generating feedback information; outputting the feedback information.

[0071] In summary, in the technical solution of the present disclosure, when a data processing request is received, the application identifier can be first determined, and then the corresponding data dictionary can be determined according to the application identifier. Further, according to the type of the data processing request, the dictionary items in the data dictionary are processed and feedback information is generated. Finally, the feedback information is output. That is, in the present application, the data of different applications can be stored in the corresponding data dictionaries. When maintaining and updating the data, only the dictionary items in the data dictionaries need to be updated and maintained, so that the data can be updated and maintained more conveniently and quickly.

[0072] The foregoing are only the preferred embodiments of the present disclosure and are not intended to limit the present disclosure. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principle of the present disclosure shall be included within the scope of protection of the present disclosure.

Claims

1. A data processing method, comprising: In response to receiving the data processing request, parsing the data processing request to determine an application identifier; Determine a corresponding data dictionary according to the application identifier, wherein the data dictionary includes the application identifier; According to the type of the data processing request, processing the data in the data dictionary and generating feedback information; The feedback information is output.

2. The method according to claim 1, wherein: The method further comprises: In response to obtaining the application information through the preset page, generating the application identifier; Obtaining configuration information corresponding to the application identifier; The data dictionary is initialized according to the configuration information.

3. The method according to claim 1, wherein: The method further comprises: In response to acquiring the encryption algorithm information, the processed data is encrypted according to the encryption algorithm information, or the feedback message is encrypted when it is transmitted.

4. The method according to claim 1, wherein: The processing of the data in the data dictionary and generating feedback information according to the type of the data processing request includes: In response to determining that the type of the data processing request is a first type, updating the data in the data dictionary; Generate a notification message based on the update result.

5. The method according to claim 4, wherein: The processing of the data in the data dictionary and generating feedback information according to the type of the data processing request includes: In response to determining that the type of the data processing request is the second type, feedback information is generated according to the data in the data dictionary.

6. The method according to claim 5, wherein: The outputting the feedback information comprises: The feedback information is uploaded to a message queue.

7. The method according to claim 5, wherein: The method further comprises: In response to determining that the data in the data dictionary is updated, feedback information is regenerated for the processed second type of data processing request.

8. A data processing device, comprising: an identification determination unit, configured to, in response to receiving a data processing request, parse the data processing request and determine an application identification; a dictionary determination unit, configured to determine a corresponding data dictionary according to the application identifier, wherein the data dictionary includes the application identifier; a request processing unit, configured to process the data in the data dictionary and generate feedback information according to the type of the data processing request; The information output unit is configured to output the feedback information.

9. An electronic device comprising a memory, a processor, a bus, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, the data processing method according to any one of claims 1 to 7 is implemented.

10. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the data processing method according to any one of claims 1 to 7 is implemented.

Images