Data Processing Method and Apparatus

By obtaining and converting the flow data query request of the first business system in the second business system, and generating flow data with a general structure, the problem of high cost efficiency and low efficiency under diversified business systems is solved, and efficient cross-system query and reduced operational costs are achieved.

CN111104425BActive Publication Date: 2025-07-29TENCENT TECHNOLOGY (SHENZHEN) CO LTD
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
CN201911104858.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2019-11-13
Publication Date
2025-07-29
Estimated Expiration
2039-11-13

AI Technical Summary

Technical Problem

The existing technical solutions design flow formats for a single business system, resulting in increased costs and low operational efficiency under the rapid development of the network.

Method used

By obtaining the flow data query request of the first business system in the second business system, converting the query conditions and generating flow data with a general structure, the commonality and scalability between different business systems are realized, and operating costs are reduced.

Benefits of technology

It improves query efficiency, solves the commonality and scalability problems between different business systems, and reduces operating costs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN111104425B_ABST
    Figure CN111104425B_ABST
Patent Text Reader

Abstract

An embodiment of the present invention discloses a data processing method and apparatus. The data processing method includes: obtaining a query request for the transaction data in the first service system in the second service system, where the query request includes a first query condition; converting the first query condition into a second query condition corresponding to a storage structure according to the query request; generating transaction query data according to the second query condition; converting the transaction query data into first transaction data in a general structure; and outputting the first transaction data in the second service system. By obtaining the query condition for the transaction data in the first service system in the second service system and enabling the second service system to query the transaction data in the first service system through a format converter, the embodiment of the present invention solves the problems of generality and scalability between different service systems, reduces the operation cost, and improves the query efficiency.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of communication technologies, and particularly to a data processing method and apparatus. Background Art

[0002] With the rapid development of the Internet, the types of its services are increasing. When a certain service is being operated, corresponding transaction data will be generated, and these transaction data need to be stored.

[0003] The existing transaction technology solutions are designed and implemented based on a memory. For one object, a transaction format is designed, and then operations for adding and querying in the database are added. However, in the current situation of the rapid development of the network, the types of services will no longer be single. Thus, designing for each single service separately results in a significant increase in cost and low operation efficiency. Summary of the Invention

[0004] This application provides a data processing method and apparatus. By obtaining a query condition for transaction data in a first service system in a second service system, and enabling the second service system to query the transaction data in the first service system through a format converter, the generality and extensibility problems between different service systems are solved. At the same time, the operation cost is reduced and the query efficiency is improved.

[0005] In a first aspect, this application provides a data processing method, and the method includes:

[0006] Obtain a query request for transaction data in a first service system in a second service system, where the query request includes a first query condition;

[0007] According to the query request, convert the first query condition into a second query condition corresponding to a storage structure;

[0008] Generate transaction query data according to the second query condition;

[0009] Convert the transaction query data into first transaction data in a general structure;

[0010] Output the first transaction data in the second service system.

[0011] In some embodiments of this application, the method further includes:

[0012] Obtain a first storage request for storing the first transaction data in a memory corresponding to the second service system, where the first storage request includes a first storage condition;

[0013] Convert the first transaction data into transaction data in a corresponding first storage format;

[0014] Store the streaming data in the first storage format into the memory corresponding to the first service system according to the first storage condition.

[0015] In some embodiments of the present application, the method further includes:

[0016] Obtain a second storage request for storing the first streaming data into the memory corresponding to the second service system, where the second storage request includes a first storage condition;

[0017] Convert the first streaming data into streaming data in a corresponding second storage format;

[0018] Store the streaming data in the second storage format into the memory corresponding to the second service system according to the second storage condition.

[0019] In some embodiments of the present application, the storing the streaming data in the second storage format into the memory corresponding to the second service system according to the second storage condition includes:

[0020] Statistically calculate the target data volume of the first streaming data;

[0021] When the target data volume reaches a preset data volume, asynchronously store the first streaming data according to the second storage condition.

[0022] In some embodiments of the present application, the asynchronously storing the first streaming data according to the second storage condition includes:

[0023] Send the first streaming data to a preset message queue;

[0024] When the message queue is due to process the first streaming data, read the first streaming data from the message queue and store it in the memory corresponding to the second service system according to the second storage condition.

[0025] In some embodiments of the present application, after obtaining the second storage condition for storing the first streaming data into the memory corresponding to the second service system, the method further includes:

[0026] Repeatedly compare the streaming type of the streaming data with the streaming types of the already stored streaming data;

[0027] When the result of the comparison is non-repetitive, define the streaming type of the streaming data as enumeration information;

[0028] Convert the enumeration information into a query field and output it to the terminal for display.

[0029] In some embodiments of the present application, the method further includes:

[0030] When generating streaming data;

[0031] Generate a new block according to the streaming data;

[0032] Add the new block to the blockchain.

[0033] In a second aspect, the present application provides a data processing device, the device includes:

[0034] A first acquisition unit, configured to acquire a query request for streaming data in a first business system in a second business system, where the query request includes a first query condition;

[0035] A first conversion unit, configured to convert the first query condition into a second query condition corresponding to a storage structure according to the query request;

[0036] A first generation unit, configured to generate streaming query data according to the second query condition;

[0037] A second conversion unit, configured to convert the streaming query data into first streaming data in a general structure;

[0038] A first output unit, configured to output the first streaming data in the second business system.

[0039] In some embodiments of the present application, the device further includes:

[0040] A second acquisition unit, configured to acquire a first storage request for storing first streaming data into a memory corresponding to the second business system;

[0041] A third conversion unit, configured to convert the first streaming data into streaming data in a corresponding first storage format;

[0042] A first storage unit, configured to store the streaming data in the first storage format into the memory corresponding to the first business system according to the first storage condition.

[0043] In some embodiments of the present application, the device further includes:

[0044] A third acquisition unit, configured to acquire a second storage request for storing first streaming data into a memory corresponding to the second business system;

[0045] A fourth conversion unit, configured to convert the first streaming data into streaming data in a corresponding second storage format;

[0046] A second storage unit, configured to store the streaming data in the second storage format into the memory corresponding to the second business system according to the second storage condition.

[0047] In some embodiments of the present application, the device further includes:

[0048] a statistical unit configured to count the target data volume of the first streaming data;

[0049] a third storage unit configured to asynchronously store the first streaming data according to the second storage condition when the target data volume reaches a preset data volume.

[0050] In a third aspect, the present application provides a server, including a memory and a processor. When a computer program stored in the memory is executed by the processor, the processor is caused to perform the following steps:

[0051] Obtain a query request for the streaming data in the first service system in the second service system, where the query request includes a first query condition;

[0052] Convert the first query condition into a second query condition corresponding to a storage structure according to the query request;

[0053] Generate streaming query data according to the second query condition;

[0054] Convert the streaming query data into first streaming data in a general structure;

[0055] Output the first streaming data in the second service system.

[0056] In a fourth aspect, the present application provides a computer-readable storage medium, on which a computer program is stored. When the computer program is loaded and executed by a processor, it is used to perform the data processing method steps described in any one of the first aspect.

[0057] In the embodiments of the present application, a query request for the streaming data in the first service system is obtained in the second service system, where the query request includes a first query condition; according to the query request, the first query condition is converted into a second query condition corresponding to a storage structure; according to the second query condition, streaming query data is generated; the streaming query data is converted into first streaming data in a general structure; and the first streaming data is output in the second service system. In the embodiments of the present invention, by obtaining the query condition for the streaming data in the first service system in the second service system and using a format converter, the second service system can query the streaming data in the first service system, thereby solving the problems of generality and scalability between different service systems, reducing the operation cost, and improving the query efficiency. Description of the Drawings

[0058] To more clearly illustrate the technical solutions in the embodiments of the present invention, the following will briefly introduce the accompanying drawings required for the description of the embodiments. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For those skilled in the art, without creative efforts, other accompanying drawings can be obtained based on these drawings.

[0059] Figure 1 It is a schematic diagram of the scenario of the service system provided by the embodiment of the present invention;

[0060] Figure 2 It is an optional structural schematic diagram of the distributed system applied to the blockchain system provided by the embodiment of the present invention;

[0061] Figure 3 It is an optional schematic diagram of the block structure provided by the embodiment of the present invention;

[0062] Figure 4 It is a schematic diagram of the process of an embodiment of the data processing method in the embodiment of the present invention;

[0063] Figure 5 It is a schematic diagram of the process of another embodiment of the data processing method in the embodiment of the present invention;

[0064] Figure 6 It is a schematic diagram of the process of another embodiment of the data processing method in the embodiment of the present invention;

[0065] Figure 7 It is a schematic diagram of the process of another embodiment of the data processing method in the embodiment of the present invention;

[0066] Figure 8 It is a schematic diagram of the process of another embodiment of the data processing method in the embodiment of the present invention;

[0067] Figure 9 It is a schematic diagram of the process of the data query process provided by the embodiment of the present invention;

[0068] Figure 10 It is a schematic diagram of the second service system architecture provided by the embodiment of the present invention;

[0069] Figure 11 It is a schematic diagram of the structure of the data processing device provided by the embodiment of the present invention;

[0070] Figure 12 It is a schematic diagram of the structure of the server provided by the embodiment of the present invention;

[0071] Figure 13 It is a schematic diagram of the structure of the terminal provided by the embodiment of the present invention. Detailed implementation manners

[0072] The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative efforts shall fall within the protection scope of the present invention.

[0073] In the following description, specific embodiments of the present invention will be described with reference to steps and symbols executed by one or more computers, unless otherwise specified. Therefore, these steps and operations will be mentioned several times as being executed by a computer. As used herein, computer execution includes the operations of a computer processing unit that represents electronic signals in a structured form of data. This operation transforms the data or maintains it at a position in the computer's memory system, which can be reconfigured or otherwise changed in a manner well known to those skilled in the art to change the operation of the computer. The data structure maintained by the data is the physical location of the memory, which has specific characteristics defined by the data format. However, the principles of the present invention are described in the above text, which does not represent a limitation. Those skilled in the art will understand that the following various steps and operations can also be implemented in hardware.

[0074] The term "module" or "unit" as used herein can be regarded as a software object executed on the computing system. Different components, modules, engines, and services herein can be regarded as implementation objects on the computing system. The devices and methods herein are preferably implemented in software, and of course can also be implemented in hardware, both within the protection scope of the present invention.

[0075] Those skilled in the art of the present technology can understand that, unless specifically stated otherwise, the singular forms "a", "an", "the", and "said" used herein may also include the plural forms. It should be further understood that the term "comprising" used in the specification of the present invention means the presence of the feature, integer, step, operation, element, and / or component, but does not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or their groups. It should be understood that when we say an element is "connected" or "coupled" to another element, it can be directly connected or coupled to other elements, or there may also be intermediate elements. In addition, the "connection" or "coupling" used herein may include a wireless connection or wireless coupling. The phrase "and / or" used herein includes all or any unit and all combinations of one or more related listed items.

[0076] To facilitate the understanding of the embodiments of the present invention, several basic concepts introduced in the description of the embodiments of the present invention will be introduced here first:

[0077] Transaction: A specific transaction record, such as a bank transaction statement.

[0078] Transaction data: A software engineering term, which is a data structure used to record a transaction and is called a transaction structure.

[0079] Transaction object: A software engineering term, which represents a specific data in the transaction structure and is used to store a specific transaction data. Here, the object refers to the main object of the transaction record. For example, in the case of a bank transfer transaction, the object refers to the user's deposit. For example, objects also include: users, articles, comments, etc. Specific transactions are called user transactions (including user registration, user being followed, user liking, user being reported, etc.), article transactions, comment transactions, etc.

[0080] Transaction type: A structure used to manage transaction data of multiple objects, which realizes storing the transaction data of specific objects into specific memories.

[0081] Business system: A system used to record user operation records. Among them, the business system can be of various business types, such as a banking business system, a logistics business system, etc. The first business system and the second business system can be different types of business systems. For example, one is a banking business system and the other is a logistics business system, or they can be the same type of business system but different versions, such as Banking Business System 1.0 and Banking Business System 2.0, etc.

[0082] Memory: Abbreviated as memory, it is a system that stores transaction objects. It is an abstract object. Specific memories include mysql memory, mongodb memory, elastic search memory, etc.

[0083] Storage routing: In network engineering, routing refers to the process of determining the end-to-end path within the network scope when a packet travels from the source to the destination. The routing in this application refers to the path selection relationship for storing a transaction data into a specific memory. The logic for recording this storage relationship is called routing. Since the storage space of a table is limited, when the stored data increases to a certain level, it will cause problems such as slow querying and even inability to write. Therefore, when storing and reading, adding a storage routing management module can aggregate data according to certain conditions. For example, data of the same user is aggregated into the same table for easy querying. However, for most transaction data, it needs to be partitioned by time. This kind of management is called routing, which is to locate the table according to the query conditions or locate the storage table according to the transaction data.

[0084] Artificial Intelligence (AI) is the theory, method, technology, and application system that uses digital computers or machines controlled by digital computers to simulate, extend, and expand human intelligence, perceive the environment, acquire knowledge, and use knowledge to obtain the best results. In other words, artificial intelligence is a comprehensive technology in computer science that attempts to understand the essence of intelligence and produce a new intelligent machine that can respond in a way similar to human intelligence. Artificial intelligence also studies the design principles and implementation methods of various intelligent machines, enabling the machines to have the functions of perception, reasoning, and decision-making.

[0085] Artificial intelligence technology is an interdisciplinary subject that covers a wide range of fields, including both hardware-level and software-level technologies. The basic technologies of artificial intelligence generally include technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing technology, operation / interaction systems, and mechatronics. The software technologies of artificial intelligence mainly include several major directions such as computer vision technology, speech processing technology, natural language processing technology, and machine learning / deep learning.

[0086] Computer Vision Technology (CV) Computer vision is a science that studies how to enable machines to "see". More specifically, it refers to using cameras and computers to replace human eyes to perform machine vision such as object recognition, tracking, and measurement on targets, and further performing graphic processing to make the computer-processed images more suitable for human eyes to observe or be transmitted to instruments for detection. As a scientific discipline, computer vision studies related theories and technologies, attempting to build artificial intelligence systems that can obtain information from images or multi-dimensional data. Computer vision technology usually includes technologies such as image processing, image recognition, image semantic understanding, image retrieval, OCR, video processing, video semantic understanding, video content / behavior recognition, three-dimensional object reconstruction, 3D technology, virtual reality, augmented reality, simultaneous localization and mapping, and also includes common biometric recognition technologies such as face recognition and fingerprint recognition.

[0087] The solution provided in the embodiments of this application may be a data processing method related to artificial intelligence, that is, a data processing method based on artificial intelligence is provided in the embodiments of this application. This method may include: obtaining a first query condition for the transaction data in the first business system in the second business system; determining the corresponding memory according to this first query condition; converting this first query condition into a second query condition corresponding to the storage structure; generating transaction query data according to this second query condition; converting this transaction query data into first transaction data in a general structure; and outputting this first transaction data in the second business system.

[0088] The embodiments of the present invention provide a data processing method and device.

[0089] Please refer to Figure 1 , Figure 1 which is a schematic diagram of the scenario of the service system provided by the embodiment of the present invention. The service processing system may include a server and a terminal. Among them, the terminal and the server are connected through a network. A data processing device is integrated in the server, and the server may be a workbench server (i.e., a server loaded with a workbench), such as Figure 1 the first service system in

[0090] includes a first server 101 and a first terminal 102, and the second service system includes a second server 103 and a second terminal 104. Among them, the first terminal can access the first server, and the first terminal can also access the second server through the first server. The second terminal can access the second server, and the second terminal can also access the first server through the second server. The first terminal may be one terminal or more than one terminal. In the embodiment of the present invention, the server is mainly used to obtain a query request for the transaction data in the first service system in the second service system, and the query request includes a first query condition; according to the query request, convert the first query condition into a second query condition corresponding to the storage structure; according to the second query condition, generate transaction query data; convert the transaction query data into first transaction data in a general structure; and output the first transaction data in the second service system.

[0091] It can be understood that the first terminal 102 / second terminal 104 used in the embodiments of the present invention can be understood as terminal devices, which include devices with both receiving and transmitting hardware, that is, devices with the receiving and transmitting hardware capable of performing two-way communication on a two-way communication link. Such terminal devices can include: cellular or other communication devices, which can have a single-line display or a multi-line display or cellular or other communication devices without a multi-line display. Specifically, the terminal can be a desktop terminal or a mobile terminal, and specifically, it can be one of a mobile phone, a tablet computer, a laptop computer, etc.

[0092] Those skilled in the art can understand that Figure 1 the application environment shown in is only one application scenario of the solution of this application, and does not constitute a limitation on the application scenario of the solution of this application. Other application environments can also include more or fewer servers than Figure 1 shown in, or the server network connection relationship. For example Figure 1 only 2 servers and 2 terminals are shown in. It can be understood that this business system can also include one or more other servers, and / or one or more terminals network-connected to the server. Specifically, it is not limited here.

[0093] In some embodiments of the present invention, this business system can be an enterprise office system, such as an enterprise bank account system. Taking the server 101 as an example, it can specifically also include an enterprise bank account server, an enterprise office configuration management server, and a Web management server. Enterprise users or developers can access the Web management server through a Web browsing terminal to configure the field configuration information on the enterprise office platform configuration management server, and set and store the enterprise user information of the enterprise employees on the enterprise office platform contact server.

[0094] In addition, as Figure 1 shown, this business system can also include a memory, and the memory includes a first memory 105 and a second memory 106. Among them, the first memory 105 corresponds to the first business system, and the second memory corresponds to the second business system. The memory is used to store data, such as storing a business transaction database, and the business transaction database stores transaction object data. Correspondingly, the business transaction database can also be divided into various types of data, such as an application database, a file database, or a picture database, etc.

[0095] It should be noted that Figure 1The schematic diagram of the business system shown is only an example. The business system and scenarios described in the embodiments of the present invention are used to more clearly illustrate the technical solutions of the embodiments of the present invention, and do not constitute a limitation on the technical solutions provided by the embodiments of the present invention. As known to those of ordinary skill in the art, with the evolution of the business system and the emergence of new business scenarios, the technical solutions provided by the embodiments of the present invention are equally applicable to similar technical problems.

[0096] The business system involved in the embodiments of the present invention may be a distributed system formed by connecting multiple nodes (any form of computing device in the access network, such as electronic devices and servers, etc.) through network communication.

[0097] Taking the distributed system as a blockchain system as an example, see Figure 2 , Figure 2 is an optional structural schematic diagram of the distributed system applied to the blockchain system provided by the embodiments of the present invention, formed by multiple nodes (any form of computing device in the access network, such as servers, user terminals) and terminals. A peer-to-peer (P2P) network is formed between the nodes. The P2P protocol is an application layer protocol running on top of the Transmission Control Protocol (TCP). In a distributed system, any machine such as a server or a terminal can join and become a node. A node includes a hardware layer, an intermediate layer, an operating system layer, and an application layer. In the embodiments of the present invention, the electronic device and the server are respectively a node in the blockchain system.

[0098] See Figure 2 for the functions of each node in the blockchain system shown. The functions involved include:

[0099] 1) Routing, a basic function of a node, used to support communication between nodes.

[0100] In addition to the routing function, a node may also have the following functions:

[0101] 2) Application, used to be deployed in the blockchain, implement specific services according to actual business needs, record the data related to the implemented functions to form record data, carry a digital signature in the record data to indicate the source of the task data, and send the record data to other nodes in the blockchain system. When other nodes verify the source and integrity of the record data successfully, the record data is added to the temporary block.

[0102] For example, the services implemented by the application include:

[0103] 2.1) Wallet, which is used to provide the function of conducting electronic currency transactions, including initiating a transaction (i.e., sending the transaction record of the current transaction to other nodes in the blockchain system. After successful verification by other nodes, as a response to acknowledging the validity of the transaction, the record data of the transaction is deposited into the temporary block of the blockchain; of course, the wallet also supports querying the remaining electronic currency in the electronic currency address;

[0104] 2.2) Shared ledger, which is used to provide functions such as storage, query, and modification of account data. The record data of the operations on the account data is sent to other nodes in the blockchain system. After other nodes verify its validity, as a response to acknowledging the validity of the account data, the record data is deposited into the temporary block, and can also send a confirmation to the node that initiated the operation.

[0105] 2.3) Smart contract, a computerized protocol that can execute the terms of a certain contract, implemented by code deployed on the shared ledger and used to execute when certain conditions are met. According to actual business requirements, the code is used to complete automated transactions, such as querying the logistics status of the goods purchased by the buyer, and transferring the buyer's electronic currency to the merchant's address after the buyer signs for the goods; of course, smart contracts are not limited to executing contracts for transactions, but can also execute contracts for processing received information.

[0106] 3) Blockchain, including a series of blocks (Block) that are sequentially connected in the order of generation. Once a new block is added to the blockchain, it will not be removed again. The block records the record data submitted by nodes in the blockchain system.

[0107] See Figure 3 , Figure 3 is an optional schematic diagram of the block structure provided by the embodiments of the present invention. Each block includes the hash value of the transaction records stored in this block (the hash value of this block), and the hash value of the previous block. Each block is connected through the hash value to form a blockchain. In addition, the block can also include information such as the timestamp when the block is generated. Blockchain, essentially a decentralized database, is a string of data blocks generated by using cryptographic methods. Each data block contains relevant information, used to verify the validity of its information (anti-counterfeiting) and generate the next block.

[0108] It should be noted that in the embodiments of the present invention, the transaction data and query data can be stored in the blocks of the blockchain.

[0109] The following will be described in detail with specific embodiments.

[0110] In this embodiment, a description will be made from the perspective of a data processing device, which may be specifically integrated in a server.

[0111] The present invention provides a data processing method, which includes: obtaining a query request for transaction data in a first service system in a second service system, where the query request includes a first query condition; converting the first query condition into a second query condition corresponding to a storage structure according to the query request; generating transaction query data according to the second query condition; converting the transaction query data into first transaction data in a general structure; and outputting the first transaction data in the second service system.

[0112] Please refer to Figure 4 , Figure 4 which is a schematic flowchart of an embodiment of the data processing method in an embodiment of the present invention. The data processing method includes:

[0113] 401. Obtain a query request for transaction data in a first service system in a second service system, where the query request includes a first query condition.

[0114] Among them, the first query condition includes the transaction type and object of the transaction data. Specifically, the object refers to the main object of the transaction record. For example, in the case of a bank transfer transaction, the object here refers to the user's deposit, and the transfer transaction is the transaction type.

[0115] 402. Convert the first query condition into a second query condition corresponding to a storage structure according to the query request.

[0116] When querying data in the system, according to the first query condition, the corresponding memory is determined, and the first query condition needs to be converted into a second query condition corresponding to the storage structure.

[0117] 403. Generate transaction query data according to the second query condition.

[0118] Through the second query condition, the target data in the corresponding memory can be read, thereby generating corresponding transaction query data.

[0119] 404. Convert the transaction query data into first transaction data in a general structure.

[0120] After the flow query data is queried, the flow query data is converted into the first flow data in a general structure through a format converter. The general structure is the general data format of the flow data in the second business system. For example, the general structure is the flow structure of the business flow model. The business flow model (OperateLogModel) is a general flow structure, which mainly includes five categories of fields: attributes related to the object being operated, index attributes of the object being operated, operation-related attributes, operator-related attributes, and extended attributes.

[0121] 405. Output the first flow data in the second business system.

[0122] Among them, the general first flow data conforms to the output format of the second business system, so the first flow data can be output through the second business system.

[0123] In summary, in the embodiments of the present application, a query request for the flow data in the first business system is obtained in the second business system, and the query request includes a first query condition; according to the query request, the first query condition is converted into a second query condition corresponding to a storage structure; according to the second query condition, flow query data is generated; the flow query data is converted into the first flow data in a general structure; and the first flow data is output in the second business system. In the embodiments of the present invention, by obtaining the query condition for the flow data in the first business system in the second business system and using a format converter, the second business system can query the flow data of the first business system, thereby solving the problems of generality and scalability between different business systems, reducing the operation cost, and improving the query efficiency.

[0124] In some embodiments of the present application, the data processing method further includes: obtaining a first storage request for storing the first flow data in the memory corresponding to the second business system, and the first storage request includes a first storage condition. Converting the first flow data into flow data in a corresponding first storage format. According to the first storage condition, storing the flow data in the first storage format in the memory corresponding to the first business system.

[0125] Please refer to Figure 5 , Figure 5 , which is a schematic flowchart of another embodiment of the data processing method in the embodiments of the present invention. The data processing method further includes:

[0126] 501. Obtain a first storage request for storing the first flow data in the memory corresponding to the second business system, and the first storage request includes a first storage condition.

[0127] 502. Convert the first flow data into flow data in a corresponding first storage format.

[0128] 503. Store the streaming data in the first storage format into the memory corresponding to the first business system according to the first storage condition.

[0129] In some embodiments of the present application, the data processing method further includes: obtaining a second storage request for storing the first streaming data into the memory corresponding to the second business system, where the second storage request includes the first storage condition; converting the first streaming data into streaming data in a corresponding second storage format; and storing the streaming data in the second storage format into the memory corresponding to the second business system according to the second storage condition.

[0130] Please refer to Figure 6 , Figure 6 which is a schematic flowchart of another embodiment of the data processing method in the embodiments of the present invention. The data processing method further includes:

[0131] 601. Obtain a second storage request for storing the first streaming data into the memory corresponding to the second business system, where the second storage request includes the first storage condition.

[0132] 602. Convert the first streaming data into streaming data in a corresponding second storage format.

[0133] 603. Store the streaming data in the second storage format into the memory corresponding to the second business system according to the second storage condition.

[0134] In some embodiments of the present application, storing the streaming data in the second storage format into the memory corresponding to the second business system according to the second storage condition includes: counting the target data volume of the first streaming data; when the target data volume reaches a preset data volume, asynchronously store the first streaming data according to the second storage condition.

[0135] Specifically, the storage methods include synchronous saving and asynchronous saving. Among them, synchronous saving means that when called, the data is directly saved into the relevant memory, and then the saving result is returned. Asynchronous saving, in contrast to synchronous saving, means that when the saving is called, the system does not directly save the data, but pushes the data into the message queue. The asynchronous saving service reads the message queue and writes the data into the relevant memory. This type of saving can reduce the system's time consumption. The disadvantage is that the data just saved cannot be queried immediately.

[0136] In some embodiments of the present application, asynchronously storing the first stream data according to the second storage condition includes: sending the first stream data to a preset message queue; when the message queue is due to process the first stream data, reading the first stream data from the message queue according to the second storage condition and storing it in the corresponding memory of the second service system.

[0137] In some embodiments of the present application, after obtaining the second storage condition for storing the first stream data in the corresponding memory of the second service system, the method further includes: repeatedly comparing the stream type of the stream data with the stream types of the stored stream data; when the result of the comparison is no duplication, defining the stream type of the stream data as enumeration information; converting the enumeration information into a query field and outputting it to a terminal for display.

[0138] Please refer to Figure 7 , which is a schematic flowchart of another embodiment of the data processing method in the embodiment of the present invention. After obtaining the second storage condition for storing the first stream data in the corresponding memory of the second service system, the method further includes:

[0139] 701. Repeatedly compare the stream type of the stream data with the stream types of the stored stream data.

[0140] 702. When the result of the comparison is no duplication, define the stream type of the stream data as enumeration information.

[0141] 703. Convert the enumeration information into a query field and output it to a terminal for display.

[0142] Please refer to Figure 8 , Figure 8 , which is a schematic flowchart of another embodiment of the data processing method in the embodiment of the present invention. After obtaining the second storage condition for storing the first stream data in the corresponding memory of the second service system, the method further includes:

[0143] 801. Repeatedly compare the stream type of the stream data with the stream types of the stored stream data;

[0144] Specifically, when a new transaction type is added, it is necessary to repeatedly compare the new transaction type with the existing transaction data types to prevent confusion. Due to the addition of the new transaction type, for convenient subsequent query, it can be set as enumeration information. In this embodiment, a comparison function can be used to compare each of the existing transaction types one by one. For example, the newly added transaction type is the like type. The like transaction can be that when user A is watching the live broadcast of a certain live broadcast room and gives a like to the host of the live broadcast room. When user A performs this like behavior, the corresponding like transaction data will be stored. During this process, since the like transaction data type is a newly created transaction data type, the like transaction data type is repeatedly compared with the original transaction data types.

[0145] 802. When the result of the comparison is no duplication, define the transaction type of the transaction data as enumeration information;

[0146] According to the example in step 801, when the comparison result between the like transaction data type and the original transaction data types is no duplication, then define the like transaction data type as the corresponding enumeration information.

[0147] 803. Convert the enumeration information into a query field and output it to the terminal for display.

[0148] In some embodiments of the present application, the data processing method further includes: when generating transaction data; generating a new block according to the transaction data; adding the new block to the blockchain.

[0149] Next, a specific application scenario is used to describe the data query process in the data processing method in the embodiments of the present invention.

[0150] Please refer to Figure 9 , Figure 9 which is a flowchart of the data query process provided by the embodiments of the present invention. The process includes:

[0151] 901. The first terminal receives a query request from user A to obtain bank account transaction data in the first business system in the second business system. The query request includes a first query condition.

[0152] Specifically, assume that user B has deposited 100,000 yuan in the Bank of China in a certain area of Shenzhen and the record is made through the first business system of this bank. User A in the Bank of China in Hubei Province needs to confirm user B's deposit information through the second business system of the local bank. Among them, the first business system is the bank account transaction business system, and the second business system is the upgraded transaction business system of the first business system. In addition to querying the fund deposit and withdrawal transactions of the first business system, the second business system can also query the bank card consumption record transactions and personal transfer information of the bank's users, etc. The query request includes the transaction type and the object, and the object is the bank account.

[0153] Specifically, please refer to Figure 10 , Figure 10 which is the schematic diagram of the second business system architecture provided by the embodiment of the present invention. Among them, the second business system includes a presentation layer 1001, an abstraction layer 1002, and a storage layer 1003. The presentation layer provides a unified data structure and query interface service externally; the abstraction layer realizes the abstraction of the underlying storage, and through functions such as routing and data conversion, realizes the conversion between general transactions and specific storage structures; the storage layer consists of various instances of stored data.

[0154] Among them, step 901 is carried out in the presentation layer of the second business system. The presentation layer mainly provides external services, including a write transaction interface, a read transaction interface, and an application programming interface (API) call service. At the same time, it maintains the enumeration information of the enumeration fields. Through the enumeration information, it is possible to realize the business transaction query with prompts. Specifically, at the API level, data query is realized. During the query process, a Criteria (condition / criterion) query object is first constructed, and then the query of the abstraction layer is executed in the entire module or specific log types.

[0155] The interface call at the bottom layer is implemented based on API calls, and at the same time, some field mapping functions are encapsulated to realize the processing of special fields. The specific query process is realized in the abstraction layer.

[0156] Among them, the specific call relationship is as follows: The business transaction model (OperateLogModel) is a general transaction structure, and the main fields it includes are divided into five categories: attributes related to the object being operated, index attributes of the object being operated, attributes related to the operation, attributes related to the operator, and extended attributes.

[0157] Among them, the operation object indicates that the relevant fields include type, object, and objectid; the indexed field of the object to be operated is a function supported to enable multi-dimensional queries, including index1-5. The fields related to the operator mainly include the operator, operation platform, sub-operation platform, etc. The fields related to the operation mainly include operate, suboperate, operation time, message, remarks, priority, whether it takes effect, etc. The business transaction query (OperateLogCriteria) is a general query structure, and its main purpose is to implement the query function for the fields related to the operation object. The comparison functions supported include equality, greater than, less than, fuzzy query, etc.

[0158] The relevant functions of creating and querying business transactions are executed through a centralized business transaction management module; the task management module is used to manage the relevant services in the background, including the service of asynchronously saving transactions, functions such as batch exporting business transactions, etc.; the Http interface controller provides a network interface based on the Http protocol and is the entry for interaction with the front end or other services.

[0159] 902. The second business system generates target bank account transaction data according to the query request.

[0160] Among them, step 902 is carried out in the abstraction layer of the second business system. After receiving the query request from the presentation layer, the abstraction layer points the new transaction object data to the corresponding memory of the first business system by adding corresponding routing rules, and converts the first query condition into a second query condition corresponding to the storage structure by using a format converter, and performs mutual conversion and query conversion on the bank account transaction data in the first business system and the target bank account transaction data in the second business system, so as to realize the access of the second business system to the first business system. Specifically, it converts the storage structure to a general transaction structure and the conversion of query fields. For example, the operator field in a relational database is user, but the field of a general transaction object is operator. Therefore, some format conversion functions need to be implemented, and this function is realized here. When querying, the fields in the query object are mapped.

[0161] The abstraction layer is responsible for matching the abstract transaction data with the specific memory. The two most important processes are the mapping of storage structure fields and the table routing function.

[0162] 903. The second business system outputs the target bank account transaction data.

[0163] Specifically, after generating the target bank account transaction data, the target bank account transaction data is transmitted to the presentation layer of the second business system, and the target bank account transaction data is output.

[0164] To facilitate better implementation of the data processing method provided by the embodiments of the present invention, the embodiments of the present invention further provide an apparatus based on the above data processing method. The meanings of the nouns are the same as those in the above data processing method, and the specific implementation details can be referred to the description in the method embodiments.

[0165] Please refer to Figure 11 , Figure 11 which is a schematic structural diagram of the data processing apparatus provided by the embodiments of the present invention. The data processing apparatus 1100 may include a first acquisition unit 1101, a first conversion unit 1102, a first generation unit 1103, a second conversion unit 1104, and a first output unit 1105, where:

[0166] The first acquisition unit 1101 is configured to acquire a query request for the flow data in the first service system in the second service system, and the query request includes a first query condition.

[0167] The first conversion unit 1102 is configured to convert the first query condition into a second query condition corresponding to the storage structure according to the query request.

[0168] The first generation unit 1103 is configured to generate flow query data according to the second query condition.

[0169] The second conversion unit 1104 is configured to convert the flow query data into first flow data in a general structure.

[0170] The first output unit 1105 is configured to output the first flow data in the second service system.

[0171] In some embodiments of the present application, the apparatus further includes:

[0172] A second acquisition unit, configured to acquire a first storage request for storing the first flow data into the memory corresponding to the second service system.

[0173] A third conversion unit, configured to convert the first flow data into flow data in a corresponding first storage format.

[0174] A first storage unit, configured to store the flow data in the first storage format into the memory corresponding to the first service system according to the first storage condition.

[0175] In some embodiments of the present application, the apparatus further includes:

[0176] A third acquisition unit, configured to acquire a second storage request for storing the first flow data into the memory corresponding to the second service system.

[0177] A fourth conversion unit, configured to convert the first pipelined data into pipelined data in a corresponding second storage format.

[0178] A second storage unit, configured to store the pipelined data in the second storage format into a memory corresponding to the second service system according to the second storage condition.

[0179] In some embodiments of the present application, the apparatus further includes:

[0180] A statistics unit, configured to count a target data volume of the first pipelined data.

[0181] A third storage unit, configured to asynchronously store the first pipelined data according to the second storage condition when the target data volume reaches a preset data volume.

[0182] In some embodiments of the present application, the third storage unit is specifically configured to:

[0183] Send the first pipelined data to a preset message queue.

[0184] When the message queue is due to process the first pipelined data, read the first pipelined data from the message queue and store it in a memory corresponding to the second service system according to the second storage condition.

[0185] In some embodiments of the present application, after obtaining the second storage condition for storing the first pipelined data into a memory corresponding to the second service system, the apparatus further includes:

[0186] A comparison unit, configured to repeatedly compare the pipelined type of the pipelined data with the pipelined type of the stored pipelined data.

[0187] A definition unit, configured to define the pipelined type of the pipelined data as enumeration information when the result of the comparison is non-duplicate.

[0188] A fifth conversion unit, configured to convert the enumeration information into a query field.

[0189] A second output unit, configured to output the query field to a terminal for display.

[0190] In some embodiments of the present application, the apparatus further includes a blockchain unit, and the blockchain unit is specifically configured to:

[0191] When generating pipelined data;

[0192] Generate a new block according to the pipelined data;

[0193] Add the new block to the blockchain.

[0194] In the embodiment of the present application, a query request for the transaction data in the first business system is obtained in the second business system, and the first query condition is included in the query request; according to the query request, the first query condition is converted into a second query condition corresponding to the storage structure; according to the second query condition, transaction query data is generated; the transaction query data is converted into first transaction data in a general structure; and the first transaction data is output in the second business system. In the embodiment of the present invention, by obtaining the query condition for the transaction data in the first business system in the second business system, and enabling the second business system to query the transaction data of the first business system through a format converter, the universality and scalability problems between different business systems are solved, while the operation cost is reduced and the query efficiency is improved.

[0195] The embodiment of the present invention also provides a server, as Figure 12 shown, which shows the schematic structural diagram of the server involved in the embodiment of the present invention. Specifically:

[0196] The server may include components such as a processor 1201 with one or more processing cores, a memory 1202 with one or more computer-readable storage media, a power supply 1203, and an input unit 1204. Those skilled in the art can understand that Figure 12 the server structure shown in

[0197] does not constitute a limitation on the server, and may include more or fewer components than shown in the figure, or combine certain components, or have different component arrangements. Among them:

[0198] The memory 1202 can be used to store software programs and modules. The processor 1201 executes various functional applications and data processing by running the software programs and modules stored in the memory 1202. The memory 1202 mainly includes a program storage area and a data storage area. Among them, the program storage area can store application programs required for operating the storage medium and at least one function (such as the sound playback function, the image playback function, etc.); the data storage area can store data created according to the use of the server. In addition, the memory 1202 can include high-speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state storage devices. Correspondingly, the memory 1202 can also include a memory controller to provide the processor 1201 with access to the memory 1202.

[0199] The server further includes a power supply 1203 for powering each component. Preferably, the power supply 1203 can be logically connected to the processor 1201 through a power management storage medium, so as to implement functions such as management of charging, discharging, and power consumption management through the power management storage medium. The power supply 1203 can also include any components such as one or more DC or AC power supplies, a rechargeable storage medium, a power failure detection circuit, a power converter or inverter, and a power status indicator.

[0200] The server may further include an input unit 1204, which can be used to receive input digital or character information, and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function controls.

[0201] Although not shown, the server may further include a display unit, etc., which will not be elaborated here. Specifically, in this embodiment, the processor 1201 in the server will load the executable files corresponding to the processes of one or more application programs into the memory 1202 according to the following instructions, and the processor 1201 will run the application programs stored in the memory 1202 to implement various functions as follows:

[0202] Obtain a query request for the transaction data in the first business system in the second business system, where the query request includes a first query condition; according to the query request, convert the first query condition into a second query condition corresponding to the storage structure; according to the second query condition, generate transaction query data; convert the transaction query data into first transaction data in a general structure; output the first transaction data in the second business system. In the above embodiments, the descriptions of each embodiment have their own emphases. For the parts not elaborated in a certain embodiment, reference can be made to the detailed description of the data processing method above, which will not be elaborated here.

[0203] Correspondingly, an embodiment of the present invention further provides a terminal, such as Figure 13 As shown, the terminal may include a radio frequency (RF) circuit 1301, a memory 1302 including one or more computer-readable storage media, an input unit 1303, a display unit 1304, a sensor 1305, an audio circuit 1306, a wireless fidelity (WiFi) module 1307, a processor 1308 including one or more processing cores, and a power supply 1309 and other components. Those skilled in the art can understand that Figure 13 The terminal structure shown in

[0204] does not constitute a limitation on the terminal, and may include more or fewer components than shown, or combine certain components, or have different component arrangements. Among them:

[0205] The memory 1302 can be used to store software programs and modules. The processor 1308 executes various functional applications and data processing by running the software programs and modules stored in the memory 1302. The memory 1302 may mainly include a program storage area and a data storage area. Among them, the program storage area can store application programs required for operating the storage medium and at least one function (such as a sound playback function, an image playback function, etc.); the data storage area can store data created according to the use of the terminal (such as audio data, phone book, etc.). In addition, the memory 1302 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state storage devices. Correspondingly, the memory 1302 may further include a memory controller to provide access to the memory 1302 by the processor 1308 and the input unit 1303. In the embodiments of the present application, the memory can store the above-mentioned relationship chain data of the user and the attribute information of the user.

[0206] The input unit 1303 can be used to receive input digital or character information, and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function controls. Specifically, in a specific embodiment, the input unit 1303 may include a touch-sensitive surface and other input devices. The touch-sensitive surface, also known as a touch display screen or a touchpad, can collect touch operations of the user on or near it (such as operations of the user using a finger, a stylus, or any suitable object or accessory on or near the touch-sensitive surface), and drive the corresponding connection device according to a pre-set program. Optionally, the touch-sensitive surface may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the touch position of the user and detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into touch point coordinates, and then sends it to the processor 1308, and can receive and execute the commands sent by the processor 1308. In addition, various types such as resistive, capacitive, infrared, and surface acoustic wave can be used to implement the touch-sensitive surface. In addition to the touch-sensitive surface, the input unit 1303 may further include other input devices. Specifically, the other input devices may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, etc.

[0207] The display unit 1304 can be used to display information input by the user or information provided to the user, as well as various graphical user interfaces of the terminal. These graphical user interfaces can be composed of graphics, text, icons, videos, and any combination thereof. The display unit 1304 can include a display panel. Optionally, the display panel can be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc. Further, a touch-sensitive surface can cover the display panel. When the touch-sensitive surface detects a touch operation on or near it, it is transmitted to the processor 1308 to determine the type of touch event. Subsequently, the processor 1308 provides a corresponding visual output on the display panel according to the type of touch event. Although in Figure 13 , the touch-sensitive surface and the display panel are implemented as two independent components to achieve input and input functions, but in some embodiments, the touch-sensitive surface and the display panel can be integrated to achieve input and output functions.

[0208] The terminal may further include at least one sensor 1305, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor can include an ambient light sensor and a proximity sensor. Among them, the ambient light sensor can adjust the brightness of the display panel according to the brightness of the ambient light, and the proximity sensor can turn off the display panel and / or the backlight when the terminal is moved to the ear. As a kind of motion sensor, the gravity acceleration sensor can detect the magnitude of acceleration in all directions (generally three axes). When stationary, it can detect the magnitude and direction of gravity, and can be used in applications for identifying the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition-related functions (such as pedometer, tapping), etc. As for other sensors that the terminal can also be configured with, such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., they will not be elaborated here.

[0209] The audio circuit 1306, the speaker, and the microphone can provide an audio interface between the user and the terminal. The audio circuit 1306 can transmit the electrical signal converted from the received audio data to the speaker, and the speaker converts it into a sound signal for output. On the other hand, the microphone converts the collected sound signal into an electrical signal, which is received by the audio circuit 1306 and then converted into audio data. After the audio data is output to the processor 1308 for processing, it is sent to another terminal, for example, via the RF circuit 1301, or the audio data is output to the memory 1302 for further processing. The audio circuit 1306 may also include an earphone jack to provide communication between the peripheral earphone and the terminal.

[0210] WiFi belongs to short - range wireless transmission technology. The terminal can help users send and receive emails, browse the web, and access streaming media through the WiFi module 1307, which provides users with wireless broadband Internet access. Although Figure 13 the WiFi module 1307 is shown, it can be understood that it does not belong to an essential component of the terminal and can be omitted entirely within the scope of not changing the essence of the invention as needed.

[0211] The processor 1308 is the control center of the terminal, connecting various parts of the entire mobile phone using various interfaces and circuits. By running or executing software programs and / or modules stored in the memory 1302, and by invoking data stored in the memory 1302, it executes various functions of the terminal and processes data, thereby monitoring the mobile phone as a whole. Optionally, the processor 1308 may include one or more processing cores; preferably, the processor 1308 may integrate an application processor and a modem processor. Among them, the application processor mainly processes operations on storage media, user interfaces, and application programs, etc., and the modem processor mainly processes wireless communications. It can be understood that the above - mentioned modem processor may not be integrated into the processor 1308 either.

[0212] The terminal also includes a power source 1309 (such as a battery) that powers each component. Preferably, the power source can be logically connected to the processor 1308 through a power management storage medium, thereby realizing functions such as management of charging, discharging, and power consumption management through the power management storage medium. The power source 1309 may also include any components such as one or more DC or AC power sources, rechargeable storage media, power failure detection circuits, power converters or inverters, and power status indicators.

[0213] Although not shown, the terminal may also include a camera, a Bluetooth module, etc., which will not be elaborated here. Specifically, in this embodiment, the processor 1308 in the terminal will, according to the following instructions, load the executable files corresponding to the processes of one or more application programs into the memory 1302, and the processor 1308 will run the application programs stored in the memory 1302 to implement various functions.

[0214] In the above - mentioned embodiments, the descriptions of each embodiment have their own focuses. For parts not detailed in a certain embodiment, reference can be made to the detailed description of the data - processing method above, which will not be elaborated here.

[0215] Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above - mentioned embodiments can be completed by instructions, or by controlling relevant hardware through instructions. The instructions can be stored in a computer - readable storage medium and loaded and executed by the processor.

[0216] To this end, an embodiment of the present invention provides a storage medium storing multiple instructions that can be loaded by a processor to execute the steps in any of the data processing methods provided by the embodiments of the present invention. For example, the instructions may execute the following steps:

[0217] Obtain a query request for the transaction data in the first business system in the second business system, where the query request includes a first query condition; convert the first query condition into a second query condition corresponding to the storage structure according to the query request; generate transaction query data according to the second query condition; convert the transaction query data into first transaction data in a general structure; and output the first transaction data in the second business system.

[0218] Since the instructions stored in the storage medium can execute the steps in any of the data processing methods provided by the embodiments of the present invention, the beneficial effects achievable by any of the data processing methods provided by the embodiments of the present invention can be realized. For details, refer to the previous embodiments and will not be elaborated here.

[0219] An embodiment of the present invention provides another storage medium storing multiple instructions that can be loaded by a processor to execute the steps in any of the data processing methods provided by the embodiments of the present invention. For example, the instructions may execute the following steps:

[0220] Obtain a second storage request for storing the first transaction data in the memory corresponding to the second business system, where the second storage request includes a first storage condition; convert the first transaction data into transaction data in a corresponding second storage format; and store the transaction data in the second storage format in the memory corresponding to the second business system according to the second storage condition.

[0221] Since the instructions stored in the storage medium can execute the steps in any of the data processing methods provided by the embodiments of the present invention, the beneficial effects achievable by any of the data processing methods provided by the embodiments of the present invention can be realized. For details, refer to the previous embodiments and will not be elaborated here.

[0222] For the specific implementation of each of the above operations, refer to the previous embodiments and will not be elaborated here.

[0223] The storage medium may include, for example, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disc.

[0224] The above has introduced in detail a data processing method and apparatus provided by an embodiment of the present invention. Specific examples are used herein to elaborate on the principle and implementation manner of the present invention. The description of the above embodiments is only used to help understand the method and its core idea of the present invention; at the same time, for those skilled in the art, according to the idea of the present invention, there will be changes in the specific implementation manner and application scope. In summary, the content of this specification should not be construed as a limitation on the present invention.

Claims

1. A data processing method, characterized in that, The method includes: Obtaining a query request of the presentation layer of the second business system through the abstraction layer of the second business system, where the query request is a query request for the transaction data in the first business system, the query request includes a first query condition, the first business system and the second business system are different types of systems, the first query condition includes the transaction type and object of the transaction data, the transaction type is used to manage the structure of the transaction data of multiple objects, and the transaction of a specific object is stored in a specific memory; When querying data from the first business system, according to the first query condition, through the routing rules of the abstraction layer, determining the memory corresponding to the first business system, and converting the first query condition into a second query condition corresponding to the storage structure of the memory; Generating transaction query data according to the second query condition; Converting the transaction query data into first transaction data in a general structure through a format converter, where the general structure is the general data format of the transaction data in the second business system; Outputting the first transaction data in the second business system.

2. The data processing method according to claim 1, wherein The method further includes: Obtaining a first storage request for storing the first transaction data in the memory corresponding to the first business system, where the first storage request includes a first storage condition; Converting the first transaction data into transaction data in a corresponding first storage format; Storing the transaction data in the first storage format into the memory corresponding to the first business system according to the first storage condition.

3. The data processing method according to claim 1, wherein The method further includes: Obtaining a second storage request for storing the first transaction data in the memory corresponding to the second business system, where the second storage request includes a second storage condition; Converting the first transaction data into transaction data in a corresponding second storage format; Storing the transaction data in the second storage format into the memory corresponding to the second business system according to the second storage condition.

4. The data processing method according to claim 3, wherein The storing the transaction data in the second storage format into the memory corresponding to the second business system according to the second storage condition includes: Counting the target data volume of the first transaction data; When the target data volume reaches a preset data volume, asynchronously storing the first transaction data according to the second storage condition.

5. The data processing method according to claim 4, wherein The asynchronously storing the first transaction data according to the second storage condition includes: Sending the first transaction data to a preset message queue; When the message queue is due to process the first transaction data, reading the first transaction data from the message queue and storing it in the memory corresponding to the second business system according to the second storage condition.

6. The data processing method according to claim 4, wherein After obtaining the second storage condition for storing the first transaction data in the memory corresponding to the second business system, the method further includes: Repeatedly comparing the transaction type of the transaction data with the transaction types of the stored transaction data; When the comparison result is no duplication, defining the transaction type of the transaction data as enumeration information; Converting the enumeration information into a query field and outputting it to the terminal for display.

7. The data processing method according to any one of claims 1 to 6, characterized in that The method further includes: When generating transaction data; Generate a new block based on the said streaming data; Add the said new block to the blockchain.

8. A data processing device, characterized in that, The said device includes: A first acquisition unit, configured to receive, through the abstraction layer of a second service system, a query request from the presentation layer of the second service system, where the query request is a query request for streaming data in a first service system, the query request includes a first query condition, the first service system and the second service system are service systems of different types, the first query condition includes the streaming type and object of the streaming data, the streaming type is used to manage the structure of the streaming data of multiple objects, and the streaming data of a specific object is stored in a specific memory; A first conversion unit, configured to, when querying data from the first service system, determine the memory corresponding to the first service system according to the first query condition through the routing rules of the abstraction layer, and convert the first query condition into a second query condition corresponding to the storage structure of the memory; A first generation unit, configured to generate streaming query data according to the second query condition; A second conversion unit, configured to convert the streaming query data into first streaming data in a general structure through a format converter, where the general structure is the general data format of the streaming data in the second service system; A first output unit, configured to output the first streaming data in the second service system.

9. The data processing device according to claim 8, wherein The said device further includes: A second acquisition unit, configured to acquire a first storage request for storing the first streaming data into the memory corresponding to the first service system, where the first storage request includes a first storage condition; A third conversion unit, configured to convert the first streaming data into streaming data in a corresponding first storage format; A first storage unit, configured to store the streaming data in the first storage format into the memory corresponding to the first service system according to the first storage condition.

10. The data processing device according to claim 8, wherein The said device further includes: A third acquisition unit, configured to acquire a second storage request for storing the first streaming data into the memory corresponding to the second service system, where the second storage request includes a second storage condition; A fourth conversion unit, configured to convert the first streaming data into streaming data in a corresponding second storage format; A second storage unit, configured to store the streaming data in the second storage format into the memory corresponding to the second service system according to the second storage condition.

11. A server, characterized in that, It includes a memory and a processor. When the computer program stored in the memory is executed by the processor, the processor executes the steps in the data processing method according to any one of claims 1 to 7.

12. A computer-readable storage medium, characterized in that, The said computer-readable storage medium stores a computer program, and the computer program is loaded by a processor to execute the steps in the data processing method according to any one of claims 1 to 7.

Citation Information

Patent Citations

  • Data processing system and data processing method

    CN108319358A

  • A massive regular data processing method and system applied to a block chain

    CN108959562A

  • Data fabric services

    US10474723B2

  • Method and apparatus for stress management in a searchable data service

    US20160055229A1

  • Method and device for processing service requests

    CN108595451A