Data processing method, device, electronic device and storage medium
By using a virtual database to process business instructions in the data processing method, the problem of database access delay in the prior art is solved, and more efficient data processing and business processing are achieved.
Patent Information
- Application Number
- CN202210112939.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-01-29
- Publication Date
- 2025-04-29
- Estimated Expiration
- 2042-01-29
AI Technical Summary
The existing technology will generate delays when accessing the database, especially when the number of customers and contracts is large, the delay will block the next stage of the calculation process, causing the system to be unable to calculate the customer's funds in a timely manner, affecting the customer's business processing process.
By using a pre-established virtual database simulated by the data structure in the data processing method, it avoids direct reading of the pending data from the physical database and reduces access delay. The specific steps include receiving business instructions, determining the pending data based on the instructions, performing corresponding business operations, and storing the results in a physical database.
It effectively reduces data access delay, avoids delay blocking the next stage of computing process, and improves the efficiency of handling business for customers.
Smart Images

Figure CN114443748B_ABST
Abstract
Description
Technical Field
[0001] Embodiments of the present invention relate to the field of data processing technology, and in particular, to a data processing method, device, electronic device and storage medium. Background Art
[0002] The current financial market is changing rapidly, requiring the trading system to quickly calculate the customer's financial situation and complete customer business processing. With the increase in customers, the amount of calculation in the system continues to increase, and completing data calculations efficiently and quickly has become an important step in the business processing process.
[0003] In the prior art, when calculating a large amount of capital data, the capital data such as customer margin data, transaction data and quotation data are usually read directly from the physical database, and then calculated according to the calculation method of the processing business. The calculation process includes two methods: reading all customers' data into memory at one time for batch calculation and reading customer data for each customer individually for calculation.
[0004] However, whether it is a one-time batch reading of customer data or reading data one by one through polling, the existing technology will generate delays when accessing the database. Especially when the number of customers and contracts is large, the delay will block the calculation process of the next stage, causing the system to be unable to calculate the customer's funds in time, affecting the customer's business processing process and wasting time and resources. Summary of the invention
[0005] The embodiments of the present invention provide a data processing method, device, electronic device and storage medium to accelerate the speed of acquiring data and improve the efficiency of handling business for customers.
[0006] In a first aspect, an embodiment of the present invention provides a data processing method, including:
[0007] Receive business instructions sent by the distribution server;
[0008] Based on the business instruction, determine the to-be-processed data corresponding to the business instruction from a pre-established virtual database simulated by a data structure;
[0009] A business operation corresponding to the business instruction is performed on the data to be processed, and the business data obtained after the business operation is stored in a physical database.
[0010] In a second aspect, an embodiment of the present invention further provides a data processing device, the device comprising:
[0011] A business instruction receiving module is used to receive business instructions sent by the distribution server;
[0012] A module for determining data to be processed, used to determine data to be processed corresponding to the business instruction from a pre-established virtual database simulated by a data structure based on the business instruction;
[0013] The business data storage module is used to perform a business operation corresponding to the business instruction on the data to be processed, and store the business data obtained after the business operation in the physical database.
[0014] In a third aspect, an embodiment of the present invention further provides an electronic device, the electronic device comprising:
[0015] one or more processors;
[0016] a storage device for storing one or more programs,
[0017] When the one or more programs are executed by the one or more processors, the one or more processors implement the data processing method provided by any embodiment of the present invention.
[0018] In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the data processing method provided by any embodiment of the present invention.
[0019] A data processing method provided by an embodiment of the present invention can determine the data to be processed corresponding to the business instruction from a pre-established virtual database simulated by a data structure based on the business instruction when receiving the business instruction sent by the distribution server, thereby avoiding reading the data to be processed from the physical database, avoiding access delay, and performing business operations corresponding to the business instruction on the data to be processed, and storing the business data obtained after the business operation in the physical database. The embodiment of the present invention can ensure the speed of obtaining the data to be processed, avoid delays that block the calculation of the next stage, and improve the efficiency of handling business for customers.
[0020] In addition, a data processing device, an electronic device and a storage medium provided by the present invention correspond to the above method and have the same beneficial effects. BRIEF DESCRIPTION OF THE DRAWINGS
[0021] In order to more clearly illustrate the embodiments of the present invention, the following briefly introduces the drawings required for use in the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0022] Figure 1 A flowchart of a data processing method provided by an embodiment of the present invention;
[0023] Figure 2 A flowchart of another data processing method provided by an embodiment of the present invention;
[0024] Figure 3 A structural diagram of a data processing device provided by an embodiment of the present invention;
[0025] Figure 4 A structural diagram of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION
[0026] The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are only used to explain the present invention, rather than to limit the present invention. It should also be noted that, for ease of description, only parts related to the present invention, rather than all structures, are shown in the accompanying drawings.
[0027] It should also be noted that, for ease of description, only the part relevant to the present invention but not all content is shown in the accompanying drawings. It should be mentioned before discussing exemplary embodiments in more detail that some exemplary embodiments are described as processing or methods depicted as flow charts. Although the flow chart describes each operation (or step) as sequential processing, many operations therein can be implemented in parallel, concurrently or simultaneously. In addition, the order of each operation can be rearranged. When its operation is completed, the processing can be terminated, but it can also have additional steps not included in the accompanying drawings. The processing can correspond to methods, functions, procedures, subroutines, subprograms, etc.
[0028] In order to enable those skilled in the art to better understand the solution of the present invention, the present invention is further described in detail below in conjunction with the accompanying drawings and specific implementation methods.
[0029] Embodiment 1
[0030] Figure 1 A flowchart of a data processing method provided in an embodiment of the present invention. The method can be executed by a data processing device, which can be implemented by software and / or hardware and can be configured in a terminal and / or server to implement the data processing method in an embodiment of the present invention.
[0031] like Figure 1 As shown, the method of this embodiment may specifically include:
[0032] S101: Receive a service instruction sent by a distribution server.
[0033] In a specific implementation, the distribution server can extract instructions from the instruction queue and distribute the instructions to the corresponding computing nodes. After each computing node receives the instructions sent by the distribution server, it can process data based on the received instructions. It should be noted that in order to more clearly explain the data processing process, the following takes the process of a computing node processing data as an example for detailed description.
[0034] The business content indicated by the business instruction may be data processing of transaction data. For example, the business instruction may be an instruction for risk measurement of transaction business. After receiving the business instruction, the business operation indicated by the business instruction may be completed.
[0035] Optionally, before receiving the business instruction sent by the distribution server, it also includes: when receiving the startup initialization instruction, reading the running static parameters stored in the physical database, creating a virtual parameter table in the virtual database, and storing the running static parameters in the virtual parameter table.
[0036] In a specific implementation, before receiving a business instruction, a virtual database is simulated through a data structure. The data structure includes a concurrent hash map (ConcurrentHashMap) data structure. After the virtual database is built, an initialization operation is performed when the system starts based on receiving a large startup initialization instruction. Specifically, the running static parameters stored in the physical database can be read, and the database can be operated normally through the running static data, and the running static data is stored in the virtual data table of the virtual database, so as to realize data operation through the virtual database.
[0037] Exemplarily, the data structure of the virtual database in memory can be set to a four-layer ConcurrentHashMap class data structure. When used in a customer funds trading application scenario, the virtual database can be organized by customer as a view, with customer number and product number as the primary keys, to store customer data, such as the customer's margin and all the customer's positions.
[0038] The data structure of the four-layer ConcurrentHashMap class is as follows: the key value of the first layer of the data structure is the identification number, such as the customer number and product number; the key value of the second layer is the data table name, and a virtual parameter table is also set up to store cache parameters such as the local currency funds adequacy ratio and the foreign currency funds adequacy ratio; the key value of the third layer is the primary key of each data table, for example, the primary key string in the form of "product number + customer number + settlement currency + banknote mark"; the key value of the last layer is used to save each attribute in the data table and its corresponding value. The data structure of the ConcurrentHashMap class has good versatility and extensibility, and data tables of different structures can be dynamically added in memory as needed to meet various types of computing needs.
[0039] Furthermore, the data structure may also include a class QMemDaoSupport to support various data operations of the virtual database. It is understandable that the class QMemDaoSupport uses Java's reflection mechanism to implement the addition and deletion of data tables and the addition, deletion, query and modification of data based on the primary key, thereby completing the data operations in the virtual database, avoiding frequent access to the physical database, and reducing network delays and communication overhead. In a specific implementation, the basic data processing operations of the constructed virtual database can be encapsulated into modules, and encapsulated into independent processing modules based on different functions to improve the usability of the virtual database.
[0040] Furthermore, after the computing node is initialized, the customer data can be read from the physical database and loaded into the virtual database. Specifically, the existing data in the virtual database can be compared with the read data, and the stored data in the virtual database can be updated based on the difference between the existing data and the read data.
[0041] S102: Based on the business instruction, determine the to-be-processed data corresponding to the business instruction from a pre-established virtual database simulated by a data structure.
[0042] In a specific implementation, the corresponding business content to be executed is determined based on the business instruction. The data to be processed required to execute the business instruction is determined through the business content. For example, the data to be processed may be data indicators such as capital adequacy ratio used for risk calculation.
[0043] Optionally, based on the business instructions, the data to be processed corresponding to the business instructions are determined from a pre-established virtual database simulated by a data structure, including: determining whether the pre-established virtual database simulated by a data structure contains the data to be processed corresponding to the business instructions; if not, reading the physical database, obtaining the data to be processed in the physical database, and updating the virtual database based on the obtained data to be processed.
[0044] Specifically, when executing the data processing process corresponding to the business instruction, in order to ensure that the data processing process can proceed normally, it can be determined whether the virtual database contains the to-be-processed data corresponding to the business instruction. If so, the to-be-processed data in the virtual database can be obtained to perform the corresponding data processing operation. If not, the to-be-processed data can be obtained from the physical database for data processing. In order to facilitate the subsequent rapid acquisition of data, the virtual database can be updated based on the to-be-processed data.
[0045] S103: Perform business operations corresponding to the business instructions on the data to be processed, and store the business data obtained after the business operations in a physical database.
[0046] Specifically, business operations corresponding to business instructions can be performed on the data to be processed. For example, when the business instruction is a risk calculation instruction, risk calculation processing can be performed based on the data to be processed to obtain risk indicators for the current business, and the obtained risk indicator data can be stored in a physical database for easy provision to customers for viewing.
[0047] A data processing method provided by an embodiment of the present invention can determine the data to be processed corresponding to the business instruction from a pre-established virtual database simulated by a data structure based on the business instruction when receiving the business instruction sent by the distribution server, thereby avoiding reading the data to be processed from the physical database, avoiding access delay, and performing business operations corresponding to the business instruction on the data to be processed, and storing the business data obtained after the business operation in the physical database. The embodiment of the present invention can ensure the speed of obtaining the data to be processed, avoid delays that block the calculation of the next stage, and improve the efficiency of handling business for customers.
[0048] Embodiment 2
[0049] Figure 2 A flowchart of another data processing method provided by an embodiment of the present invention. This embodiment is optimized based on the above-mentioned technical solutions. Optionally, performing a business operation corresponding to the business instruction on the data to be processed includes: performing a business operation corresponding to the business instruction on the data to be processed in a multi-threaded parallel manner. Among them, the explanation of the terms that are the same or corresponding to the above-mentioned embodiments is not repeated here.
[0050] S201. Receive a service instruction sent by a distribution server.
[0051] S202: Based on the business instruction, determine the to-be-processed data corresponding to the business instruction from a pre-established virtual database simulated by a data structure.
[0052] S203 , performing business operations corresponding to the business instructions on the data to be processed in a multi-threaded parallel manner, and storing the business data obtained after the business operations in a physical database.
[0053] Among them, multithreading can be understood as multiple threads running simultaneously in a program. Parallel processing can be understood as using multiple computing resources at the same time to solve computing problems, which can include time parallelism and space parallelism. By using multithreaded parallel processing to process data to be processed, processing efficiency can be improved and business operations required by customers can be completed in a timely manner.
[0054] In a specific implementation, in order to improve the processing efficiency of the data to be processed, the data to be processed may be processed in a multi-threaded parallel processing manner, and the obtained business data may be stored in a physical database. Optionally, the business operation corresponding to the business instruction may be performed on the data to be processed in a multi-threaded parallel manner, including: controlling each thread to perform the business operation corresponding to the business instruction on the data to be processed in parallel according to a preset business processing volume requirement.
[0055] Specifically, in the process of multi-threaded parallel processing, in order to prevent resource conflicts, the data processing operations of each thread can be controlled by presetting the maximum business processing volume that each thread can process. Exemplarily, an upper limit value of the business processing volume of each thread can be set to prevent resource conflicts. For example, each thread can process risk calculation instructions of up to 50 customers at a time.
[0056] It should be noted that, through the data structure of the ConcurrentHashMap class, the virtual database can store data in segments, and then assign a lock to each segment of data; when a thread accesses a segment of data and occupies the lock, other segments of data can be accessed by other threads, thereby achieving concurrent access; the data structure of the ConcurrentHashMap class can reduce lock contention and improve performance.
[0057] Optionally, a multi-threaded parallel approach is used to perform business operations corresponding to business instructions on the processed data, including: determining each processing thread currently processing the business instruction based on a preset semaphore; and controlling each processing thread to perform business operations corresponding to the business instruction on the processed data in parallel.
[0058] Specifically, the business operations of each processing thread on the data to be processed can be controlled by setting a semaphore. Specifically, when a thread is running, it first tries to obtain the semaphore. If it can be obtained, it performs the corresponding business operation. If it cannot be obtained, it means that other threads are already processing, and it can be skipped directly to process other business instructions. When the processing is completed, the semaphore can be released, thereby completing the synchronization between threads through the semaphore.
[0059] The embodiment of the present invention can adopt a multi-threaded parallel data processing method to complete the business operations corresponding to the business instructions, thereby improving the processing efficiency in the data processing process; in multi-threaded high-concurrency business scenarios, the data structure of the ConcurrentHashMap class can ensure thread safety and avoid failures caused by blocking and resource conflicts.
[0060] Embodiment 3
[0061] Figure 3A structural diagram of a data processing device provided in an embodiment of the present invention, the device is used to execute the data processing method provided in any of the above embodiments. The device and the data processing method of the above embodiments belong to the same inventive concept, and the details not described in detail in the embodiment of the data processing device can refer to the embodiment of the above data processing method. The device may specifically include:
[0062] A service instruction receiving module 10 is used to receive a service instruction sent by a distribution server;
[0063] A module 11 for determining data to be processed, for determining data to be processed corresponding to the business instruction from a pre-established virtual database simulated by a data structure based on the business instruction;
[0064] The business data storage module 12 is used to perform a business operation corresponding to the business instruction on the data to be processed, and store the business data obtained after the business operation in the physical database.
[0065] Based on any optional technical solution in the embodiments of the present invention, optionally, the following further includes:
[0066] A virtual parameter table creation module is used to read the operating static parameters stored in the physical database when a startup initialization instruction is received before the business instruction sent by the receiving distribution server, create a virtual parameter table in the virtual database, and store the operating static parameters in the virtual parameter table.
[0067] Based on any optional technical solution in the embodiments of the present invention, optionally, the business data storage module includes:
[0068] The parallel processing unit is used to perform a business operation corresponding to the business instruction on the data to be processed in a multi-threaded parallel manner.
[0069] Based on any optional technical solution in the embodiments of the present invention, optionally, the parallel processing unit includes:
[0070] The parallel processing subunit is used to control each thread to perform the business operation corresponding to the business instruction on the data to be processed in parallel according to the preset business processing volume requirement.
[0071] Based on any optional technical solution in the embodiments of the present invention, optionally, the parallel processing unit includes:
[0072] The processing thread determination subunit is used to determine each processing thread currently processing the business instruction based on a preset signal quantity; and control each processing thread to perform a business operation corresponding to the business instruction on the data to be processed in parallel.
[0073] Based on any optional technical solution in the embodiment of the present invention, optionally, determining the module 11 for data to be processed includes:
[0074] The updating virtual database unit is used to determine whether the pre-established virtual database simulated by the data structure contains the data to be processed corresponding to the business instruction; if not, read the physical database, obtain the data to be processed in the physical database, and update the virtual database based on the obtained data to be processed.
[0075] Based on any optional technical solution in the embodiments of the present invention, optionally, the data structure includes a concurrent hash map data structure.
[0076] The data processing device provided in the embodiment of the present invention can execute the following method: receiving a business instruction sent by a distribution server; based on the business instruction, determining the data to be processed corresponding to the business instruction from a pre-established virtual database simulated by a data structure; performing a business operation corresponding to the business instruction on the data to be processed, and storing the business data obtained after the business operation in a physical database. The embodiment of the present invention can ensure the speed of obtaining the data to be processed, avoid the delay that blocks the calculation of the next stage, and improve the efficiency of handling business for customers.
[0077] It is worth noting that in the embodiment of the above-mentioned data processing device, the various units and modules included are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of the present invention.
[0078] Embodiment 4
[0079] Figure 4 A structural diagram of an electronic device provided in an embodiment of the present invention. Figure 4 A block diagram of an exemplary electronic device 20 suitable for implementing an embodiment of the present invention is shown. The electronic device 20 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.
[0080] like Figure 4 As shown, the electronic device 20 is in the form of a general computing device. The components of the electronic device 20 may include but are not limited to: one or more processors or processing units 201, a system memory 202, and a bus 203 connecting different system components (including the system memory 202 and the processing unit 201).
[0081] Bus 203 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor or a local bus using any of a variety of bus structures. For example, these architectures include but are not limited to Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MAC) bus, Enhanced ISA bus, Video Electronics Standards Association (VESA) local bus and Peripheral Component Interconnect (PCI) bus.
[0082] The electronic device 20 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by the electronic device 20, including volatile and non-volatile media, removable and non-removable media.
[0083] The system memory 202 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 204 and / or cache memory 205. The electronic device 20 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, the storage system 206 may be used to read and write non-removable, non-volatile magnetic media. A disk drive for reading and writing removable non-volatile disks (such as "floppy disks"), and an optical disk drive for reading and writing removable non-volatile optical disks (such as CD-ROM, DVD-ROM or other optical media) may be provided. In these cases, each drive may be connected to the bus 203 via one or more data medium interfaces. The memory 202 may include at least one program product having a set (e.g., at least one) of program modules that are configured to perform the functions of various embodiments of the present invention.
[0084] A program / utility 208 having a set (at least one) of program modules 207 may be stored, for example, in the memory 202, such program modules 207 including but not limited to an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment. The program modules 207 generally perform the functions and / or methods of the embodiments described herein.
[0085] The electronic device 20 may also communicate with one or more external devices 209 (e.g., keyboards, pointing devices, displays 210, etc.), may communicate with one or more devices that enable a user to interact with the electronic device 20, and / or may communicate with any device that enables the electronic device 20 to communicate with one or more other computing devices (e.g., network cards, modems, etc.). Such communication may be performed via an input / output (I / O) interface 211. Furthermore, the electronic device 20 may also communicate with one or more networks (e.g., local area networks (LANs), wide area networks (WANs), and / or public networks, such as the Internet) via a network adapter 212. As shown, the network adapter 212 communicates with other modules of the electronic device 20 via a bus 203. It should be understood that other hardware and / or software modules may be used in conjunction with the electronic device 20, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, etc.
[0086] The processing unit 201 executes various functional applications and data processing by running programs stored in the system memory 202 .
[0087] An electronic device provided by the present invention can implement the following method: receiving a business instruction sent by a distribution server; based on the business instruction, determining the data to be processed corresponding to the business instruction from a pre-established virtual database simulated by a data structure; performing a business operation corresponding to the business instruction on the data to be processed, and storing the business data obtained after the business operation in a physical database. The embodiment of the present invention can ensure the speed of obtaining the data to be processed, avoid the delay that blocks the calculation of the next stage, and improve the efficiency of handling business for customers.
[0088] Embodiment 5
[0089] An embodiment of the present invention provides a storage medium containing computer executable instructions, wherein the computer executable instructions are used to perform a data processing method when executed by a computer processor, the method comprising:
[0090] Receive the business instruction sent by the distribution server; based on the business instruction, determine the data to be processed corresponding to the business instruction from a pre-established virtual database simulated by a data structure; perform the business operation corresponding to the business instruction on the data to be processed, and store the business data obtained after the business operation in the physical database. The embodiment of the present invention can ensure the speed of obtaining the data to be processed, avoid the delay that blocks the calculation of the next stage, and improve the efficiency of handling business for customers.
[0091] Of course, the computer executable instructions of a storage medium including computer executable instructions provided by an embodiment of the present invention are not limited to the method operations described above, and can also execute related operations in the data method provided by any embodiment of the present invention.
[0092] The computer storage medium of the embodiment of the present invention can adopt any combination of one or more computer-readable media. The computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. The computer-readable storage medium can be, for example, but not limited to, a system, device or device of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above. More specific examples (non-exhaustive list) of computer-readable storage media include: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this document, a computer-readable storage medium can be any tangible medium containing or storing a program, which can be used by an instruction execution system, a device or a device or used in combination with it.
[0093] Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, which carry computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.
[0094] Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
[0095] Computer program code for performing the operation of embodiments of the present invention may be written in one or more programming languages or a combination thereof, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on a user's computer, partially on a user's computer, as an independent software package, partially on a user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).
[0096] Note that the above are only preferred embodiments of the present invention and the technical principles used. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in more detail through the above embodiments, the present invention is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims
1. A data processing method, characterized in that: include: Receive business instructions sent by the distribution server; Based on the business instruction, determining the to-be-processed data corresponding to the business instruction from a pre-established virtual database simulated by a data structure; wherein the data structure includes a concurrent hash map data structure; Performing a business operation corresponding to the business instruction on the data to be processed, and storing the business data obtained after the business operation in a physical database; Wherein, before receiving the service instruction sent by the distribution server, the method further includes: When a startup initialization instruction is received, the operation static parameters stored in the physical database are read, a virtual parameter table is created in the virtual database, and the operation static parameters are stored in the virtual parameter table. The operation static parameters are parameters for normal operation of the database.
2. The method according to claim 1, characterized in that The performing a business operation corresponding to the business instruction on the data to be processed includes: The business operation corresponding to the business instruction is performed on the data to be processed in a multi-threaded parallel manner.
3. The method according to claim 2, characterized in that The performing a business operation corresponding to the business instruction on the data to be processed in a multi-threaded parallel manner includes: Control each thread to perform a business operation corresponding to the business instruction on the data to be processed in parallel according to a preset business processing volume requirement.
4. The method according to claim 2, characterized in that: The performing a business operation corresponding to the business instruction on the data to be processed in a multi-threaded parallel manner includes: Based on a preset signal quantity, determining each processing thread currently processing the service instruction; Control each of the processing threads to perform a business operation corresponding to the business instruction on the data to be processed in parallel.
5. The method according to claim 1, characterized in that The step of determining, based on the business instruction, data to be processed corresponding to the business instruction from a pre-established virtual database simulated by a data structure includes: Determining whether the pre-established virtual database simulated by the data structure contains the to-be-processed data corresponding to the business instruction; If not, the physical database is read, the data to be processed is acquired in the physical database, and the virtual database is updated based on the acquired data to be processed.
6. A data processing device, characterized in that: include: A business instruction receiving module is used to receive business instructions sent by the distribution server; A module for determining data to be processed, used to determine data to be processed corresponding to the business instruction from a pre-established virtual database simulated by a data structure based on the business instruction; wherein the data structure includes a concurrent hash map data structure; A business data storage module is used to perform a business operation corresponding to the business instruction on the data to be processed, and store the business data obtained after the business operation into a physical database; A virtual parameter table module is created, which is used to read the operating static parameters stored in the physical database when a startup initialization instruction is received before the business instruction sent by the receiving distribution server, create a virtual parameter table in the virtual database, and store the operating static parameters in the virtual parameter table. The operating static parameters are parameters for the normal operation of the database.
7. An electronic device, characterized in that: include: one or more processors; A memory for storing one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the data processing method according to any one of claims 1 to 5.
8. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the data processing method according to any one of claims 1 to 5 is implemented.