A Big Data-Based Intelligent Trading System
By designing missing data processing modules in the intelligent trading system and using the correlation data in the database to fill and update missing data, the problem of missing data in the intelligent trading system is solved, and the integrity and simulation accuracy of transaction data are improved.
Patent Information
- Application Number
- CN202111122506.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-09-24
- Publication Date
- 2025-04-22
- Estimated Expiration
- 2041-09-24
AI Technical Summary
Due to the failure or interference in data collection, measurement, transmission, conversion and other links in the intelligent trading system, the data loss problem is significant, and the quality of the data set is degraded, which directly affects the simulation accuracy of the intelligent trading system.
An intelligent trading system based on big data is designed, including acquisition module, missing data processing module and trading module. The missing data processing module obtains missing data and attributes in the transaction data, obtains the most relevant data from the database to fill it, updates the transaction data, and ensures the integrity of the data.
By filling and updating transaction data, the data loss problem is solved, and the integrity of transaction data and the simulation accuracy of intelligent transactions are improved.
Smart Images

Figure CN113919947B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of data processing technology, and in particular to an intelligent trading system based on big data. Background Art
[0002] Smart trading is commonly known as intelligent trading system. Simply put, it is to write trading ideas and strategies into a computer program using programming language, so that the computer can automatically buy, sell and trade according to pre-set conditions. If you want to achieve accurate simulation of transactions by intelligent trading system, you have to rely on a large amount of transaction data.
[0003] With the improvement of the informationization, automation and interaction level of intelligent trading systems and the mutual penetration and integration with the Internet of Things, a large amount of data has been accumulated inside the intelligent trading system. However, only real and reliable data can correctly reflect the characteristics and objective laws of the trading process. However, failures or interference may occur in each link of data collection, measurement, transmission and conversion, resulting in significant data loss and reduced data set quality, which directly affects the simulation accuracy of the intelligent trading system. Summary of the invention
[0004] The embodiment of the present invention provides an intelligent trading system based on big data, which ensures the comprehensiveness of data and improves the simulation accuracy of the intelligent trading system based on big data.
[0005] A first aspect of an embodiment of the present application provides an intelligent trading system based on big data, including: an acquisition module, a missing data processing module and a trading module;
[0006] Wherein, the acquisition module is used to acquire the first transaction data according to the database;
[0007] a missing data processing module, configured to perform missing data processing on the first transaction data, specifically: obtaining missing data and a first attribute in the first transaction data according to the first transaction data; obtaining filling data according to the first attribute and a database; updating the first transaction data according to the filling data to obtain second transaction data; wherein the first attribute is an attribute of the missing data;
[0008] The transaction module is used to perform intelligent transaction according to the second transaction data.
[0009] In a possible implementation manner of the first aspect, acquiring the filling data according to the first attribute and the database is specifically:
[0010] Acquire a second attribute, and calculate the correlation between the second attribute and the first attribute; wherein the second attribute is an attribute of all data in the database;
[0011] According to the relevance, the data with the greatest relevance is obtained from the database as the filling data and obtained.
[0012] In a possible implementation of the first aspect, the method further includes: a storage module;
[0013] The storage module is used to store the second transaction data in the database so that the database is updated.
[0014] In a possible implementation manner of the first aspect, the method further includes: a transmission module;
[0015] The transmission module is used to receive the first transaction data sent by the acquisition module, and send the first transaction data to the missing data processing module so that the missing data processing module performs missing data processing;
[0016] The second transaction data sent by the missing data processing module is received, and the second transaction data is sent to the transaction module, so that the transaction module performs intelligent transaction.
[0017] In a possible implementation manner of the first aspect, the method further includes: a transmission record module;
[0018] The transmission recording module is used to record the transmission path of the transmission module, specifically: the data transmission path between the acquisition module, the missing data processing module and the transaction module.
[0019] In a possible implementation manner of the first aspect, the device further includes: a display module;
[0020] The display module is used to display the process of the transaction module performing intelligent transaction according to the second transaction data.
[0021] In a possible implementation of the first aspect, an evaluation module;
[0022] The evaluation module is used to calculate the accuracy of the transaction module and make an evaluation based on the accuracy.
[0023] Compared with the prior art, an embodiment of the present invention provides an intelligent trading system based on big data, including: an acquisition module, a missing data processing module and a trading module; wherein the acquisition module is used to acquire first transaction data according to a database; the missing data processing module is used to perform missing data processing on the first transaction data, specifically: according to the first transaction data, acquire missing data and a first attribute in the first transaction data; according to the first attribute and the database, acquire filling data; according to the filling data, update the first transaction data to obtain second transaction data; wherein the first attribute is the attribute of the missing data; the trading module is used to perform intelligent trading according to the second transaction data.
[0024] Since the intelligent trading system is based on a large amount of transaction data, it is very important to solve the missing problem in big data to improve the accuracy of the intelligent trading system. The missing data processing module proposed in the embodiment of the present invention obtains filling data from the database according to the attributes of the missing data, and fills and updates the transaction data according to the filling data, thereby ensuring the integrity of the transaction data and further ensuring the accuracy of intelligent trading based on the transaction data.
[0025] In addition, the intelligent trading system also includes: a storage module, which can ensure that the complete second transaction data is stored in the database, so that the complete transaction data can be directly obtained next time without re-processing the missing data; a transmission recording module, which can record the data transmission path between the acquisition module, the missing data processing module and the trading module, which facilitates data tracing when data errors occur, improves the accuracy of data acquisition, and further improves the accuracy of intelligent trading; an evaluation module, which can evaluate the accuracy of the trading module, so that the staff can more intuitively observe the accuracy of the intelligent trading system and facilitate improvements. BRIEF DESCRIPTION OF THE DRAWINGS
[0026] Figure 1 It is a structural diagram of an intelligent trading system based on big data provided by an embodiment of the present invention;
[0027] Figure 2 is a schematic diagram of a case library module search page provided by an embodiment of the present invention;
[0028] Figure 3 This is a schematic diagram of a channel-to-order analysis module search page provided by an embodiment of the present invention;
[0029] Figure 4 This is a schematic diagram of a channel trend analysis module search page provided by an embodiment of the present invention;
[0030] Figure 5 This is a schematic diagram of a channel resource conversion analysis module search page provided by an embodiment of the present invention;
[0031] Figure 6 It is a schematic diagram of a channel cost module search page provided by an embodiment of the present invention. DETAILED DESCRIPTION
[0032] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0033] Reference Figure 1 , is a schematic diagram of the structure of an intelligent trading system based on big data provided by an embodiment of the present invention, comprising: an acquisition module 101, a missing data processing module 102 and a trading module 103;
[0034] The acquisition module 101 is used to acquire first transaction data from a database.
[0035] The missing data processing module 102 is used to perform missing data processing on the first transaction data, specifically: according to the first transaction data, obtain the missing data and the first attribute in the first transaction data; according to the first attribute and the database, obtain the filling data; according to the first attribute, update the first transaction data to obtain the second transaction data; wherein the first attribute is the attribute of the missing data.
[0036] In this embodiment, the step of obtaining the filling data according to the first attribute and the database is specifically as follows:
[0037] Acquire a second attribute, and calculate the correlation between the second attribute and the first attribute; wherein the second attribute is an attribute of all data in the database;
[0038] According to the correlation, the data with the greatest correlation is obtained from the database as the filling data, wherein the correlation coefficient is a Pearson correlation coefficient or a grey correlation degree.
[0039] The transaction module 103 is used to perform intelligent transaction according to the second transaction data.
[0040] Since the second transaction data is obtained by updating the first transaction data according to the filling data, the second transaction has integrity. Intelligent trading through the second transaction data can improve the accuracy of the intelligent trading system based on big data.
[0041] In this embodiment, it also includes: a storage module;
[0042] The storage module is used to store the second transaction data in the database, so that the database is updated, so that the complete transaction data can be directly obtained next time without re-processing the missing data;
[0043] In this embodiment, it also includes: a transmission module;
[0044] The transmission module is used to receive the first transaction data sent by the acquisition module, and send the first transaction data to the missing data processing module, so that the missing data processing module performs missing data processing;
[0045] The second transaction data sent by the missing data processing module is received, and the second transaction data is sent to the transaction module, so that the transaction module performs intelligent transaction.
[0046] In this embodiment, it also includes: a transmission record module;
[0047] The transmission recording module is used to record the transmission path of the transmission module, specifically: the data transmission path between the acquisition module, the missing data processing module and the transaction module. The transmission recording module can record the data transmission path between the acquisition module, the missing data processing module and the transaction module, which is convenient for data tracing when data errors occur, improves the accuracy of data acquisition, and further improves the accuracy of intelligent transactions.
[0048] In this embodiment, it also includes: an evaluation module;
[0049] The evaluation module is used to calculate the accuracy of the transaction module and make an evaluation based on the accuracy. Specifically: obtain the first transaction result of manual transaction based on the second transaction data; obtain the second transaction result of intelligent transaction based on the second transaction data by the intelligent transaction system based on big data; calculate the similarity between the first transaction result and the second transaction result, and use the similarity result as the accuracy of the transaction module. When the accuracy is greater than 85%, the accuracy of the transaction module is evaluated as excellent; when the accuracy is greater than or equal to 60%, the accuracy of the transaction module is evaluated as general; when the accuracy is less than 60%, the accuracy of the transaction module is evaluated as poor. The evaluation module can evaluate the accuracy of the transaction module so that the staff can more intuitively observe the accuracy of the intelligent transaction system and facilitate improvement.
[0050] In order to ensure the timeliness of intelligent trading by the intelligent trading system based on big data, the acquisition module of the intelligent trading system needs to accurately and quickly obtain the first transaction data from the database, so the database is needed to achieve unified management of various data.
[0051] The database used in the embodiment of the present invention includes: a case library module, a channel-to-order analysis module, a channel trend analysis module, a channel resource conversion analysis module, and a channel cost module.
[0052] When obtaining the first transaction data from the database, relevant transaction cases can be searched in the case library module, such as Figure 2 As shown, Figure 2 It is a schematic diagram of a case library module search page provided by an embodiment of the present invention.
[0053] After entering the "Case Library" module, click / enter the input boxes such as submission type / customer ID / case type / submission time / personnel screening according to actual needs, and then click the "Query" button to view the transaction cases corresponding to actual needs, and use the transaction cases as the first transaction data. Click the "Query" button to obtain the following transaction case content: submission department, case type, submitter, submission time, label, user ID, case details and operation.
[0054] When the first transaction data is obtained from the database, the relevant transaction channel-to-order data can be searched in the channel-to-order analysis module, such as Figure 3 As shown, Figure 3 It is a schematic diagram of the channel-to-order analysis module retrieval page provided by an embodiment of the present invention. Click / enter the type / team / package / channel and other input boxes according to actual needs, and click the "Query" button to view the transaction channel-to-order data corresponding to the actual needs, and use the transaction channel-to-order data as the first transaction data. Through the channel-to-order analysis module in the database, the quality of transaction channel resources can be displayed in more detail. Click the "Query" button to get the following channel-to-order content: total allocation, total allocation in the same period, orders, orders in the same period, order amount, amount in the same period, refund, refund in the same period, number of incoming resources, number of incoming resources to orders, total output value of incoming resources, output value of incoming resources per order, and average value of incoming resources per order.
[0055] When the first transaction data is obtained from the database, the relevant transaction channel trend data can be searched in the channel trend analysis module, such as Figure 4 As shown, Figure 4 It is a schematic diagram of the channel trend analysis module retrieval page provided by an embodiment of the present invention. Click / input operations in the type / team and other input boxes according to actual needs, click the "Query" button, you can view the transaction channel trend data corresponding to the actual needs, and use the transaction channel trend data as the first transaction data. Click the "Query" button to get the following channel trend content: total resource volume, outbound call volume, effective connection volume, new resources not followed up, high seas not followed up, follow-up, wasted, invalid resources, number of orders, order amount, average customer price, 3 types of conversion rate, order conversion rate, single user output value, warehousing to order, warehousing to distribution, distribution to order, warehousing to contact average time, contact to 3 categories, contact to order and 3 categories to order.
[0056] When the first transaction data is obtained from the database, the relevant transaction channel resource conversion data can be searched in the channel resource conversion analysis module, such as Figure 5 As shown, Figure 5This is a schematic diagram of the retrieval page of the channel resource conversion analysis module provided by an embodiment of the present invention. According to actual needs, the corresponding transaction channel resource conversion data can be viewed from two different dimensions: "Channel Resource Time Analysis" and "Channel Person in Charge Analysis". You can also click / enter in the input boxes such as channel attributes / types / channel persons in charge / channel labels, and click the "Query" button to view the transaction channel resource conversion data corresponding to the actual needs, and use the transaction channel resource conversion data as the first transaction data. Click the "Query" button to obtain the following channel resource conversion content: number of channels, total resource volume, number of orders, conversion rate, output value, total channel cost and ROI (return on investment).
[0057] When obtaining the first transaction data from the database, the relevant transaction channel cost data can be searched in the channel cost module, such as Figure 6 As shown, Figure 6 This is a schematic diagram of the channel cost module search page provided by an embodiment of the present invention. After filtering the name and selecting the channel according to actual needs, click the "Query" button to view the corresponding transaction channel cost data. And use the transaction channel cost data as the first transaction data. Click the "Query" button to obtain the following channel cost content: channel name, order amount, channel cost and ROI.
[0058] An embodiment of the present invention proposes an intelligent trading system based on big data, including: an acquisition module, a missing data processing module and a trading module; wherein the acquisition module is used to acquire first transaction data according to a database; the missing data processing module is used to perform missing data processing on the first transaction data, specifically: according to the first transaction data, acquiring missing data and a first attribute in the first transaction data; according to the first attribute and the database, acquiring filling data; according to the filling data, updating the first transaction data to obtain second transaction data; wherein the first attribute is the attribute of the missing data; the trading module is used to perform intelligent trading according to the second transaction data.
[0059] Since the intelligent trading system is based on a large amount of transaction data, it is very important to solve the missing problem in big data to improve the accuracy of the intelligent trading system. The missing data processing module proposed in the embodiment of the present invention obtains filling data from the database according to the attributes of the missing data, and fills and updates the transaction data according to the filling data, thereby ensuring the integrity of the transaction data and further ensuring the accuracy of intelligent trading based on the transaction data.
[0060] In addition, the intelligent trading system also includes: a storage module, which can ensure that the complete second transaction data is stored in the database, so that the complete transaction data can be directly obtained next time without re-processing the missing data; a transmission recording module, which can record the data transmission path between the acquisition module, the missing data processing module and the trading module, which facilitates data tracing when data errors occur, improves the accuracy of data acquisition, and further improves the accuracy of intelligent trading; an evaluation module, which can evaluate the accuracy of the trading module, so that the staff can more intuitively observe the accuracy of the intelligent trading system and facilitate improvements.
[0061] The above is a preferred embodiment of the present invention. It should be pointed out that a person skilled in the art can make several improvements and modifications without departing from the principle of the present invention. These improvements and modifications are also considered to be within the scope of protection of the present invention.
Claims
1. An intelligent trading system based on big data, characterized in that: include: Acquisition module, missing data processing module and transaction module; The acquisition module is used to acquire the first transaction data from the database; specifically, to search for data from the case library module, the channel-to-order analysis module, the channel trend analysis module, the channel resource conversion analysis module, and the channel cost module of the database respectively; The missing data processing module is used to perform missing data processing on the first transaction data, specifically: according to the first transaction data, obtain the missing data and the first attribute in the first transaction data; according to the first attribute and the database, obtain the filling data; the obtaining of the filling data according to the first attribute and the database is specifically: Acquire a second attribute, and calculate the correlation between the second attribute and the first attribute; wherein the second attribute is an attribute of all data in the database; According to the correlation, the data with the greatest correlation is obtained from the database as the filling data; The first transaction data is updated according to the filling data to obtain second transaction data; wherein the first attribute is an attribute of the missing data; The transaction module is used to perform intelligent transaction according to the second transaction data; It also includes: a transmission module, a transmission recording module and a display module; the transmission recording module is used to record the transmission path of the transmission module, specifically: the data transmission path between the acquisition module, the missing data processing module and the transaction module; the display module is used to display the process of the transaction module performing intelligent transactions according to the second transaction data.
2. According to claim 1, a smart trading system based on big data is characterized in that: Also includes: Storage module; The storage module is used to store the second transaction data in the database so that the database is updated.
3. The intelligent trading system based on big data according to claim 1, characterized in that: The transmission module is used to receive the first transaction data sent by the acquisition module, and send the first transaction data to the missing data processing module, so that the missing data processing module performs missing data processing; The second transaction data sent by the missing data processing module is received, and the second transaction data is sent to the transaction module, so that the transaction module performs intelligent transaction.
4. The intelligent trading system based on big data according to claim 1, characterized in that: Also includes: Evaluation module; The evaluation module is used to calculate the accuracy of the transaction module and make an evaluation based on the accuracy.
Citation Information
Patent Citations
Data processing method and device
CN106844781A
Stock quantitative transaction method based on deep reinforcement learning, storage medium and equipment
CN111861751A