Property information management method and system based on message queue and heterogeneous data fusion

Abstract

The invention provides a property information management method and system based on message queues and heterogeneous data fusion, and relates to the technical field of data transmission, the method comprises the following steps: constructing a first message queue, and receiving and storing property information from an external system or an internal system through the first message queue; in response to the property right information reading instruction, reading corresponding first target property right information from the first message queue, obtaining verification information of the first target property right information, and if it is determined that a sender of the first target property right information comes from an external system according to the verification information of the first target property right information, sending the first target property right information to the external system; verifying the verification information of the first target property right information through a first rule; if the sender of the first target property right information is determined to be from the internal system according to the verification information of the first target property right information, verifying the verification information of the first target property right information through a second rule; if it is determined that the first target property information is legal according to the verification result, sending the first target property information to a receiver of the first target property information, and if it is determined that the first target property information is illegal according to the verification result, deleting the first target property information from the first message queue, and returning error information to the sender of the first target property right information. The data processing efficiency of the property right information can be improved.

Description

Technical Field

[0001] The present application relates to the technical field of data transmission, and in particular to a property rights information management method based on message queue and heterogeneous data fusion, a property rights information management system based on message queue and heterogeneous data fusion, a computer-readable storage medium and a terminal device. Background Art

[0002] At present, the business of energy industry group enterprises is complex, which is internally linked to other business systems of the group, such as finance, human resources, legal affairs, dispatch, etc., and externally linked to industrial and commercial registration, credit reporting systems and major property rights exchanges. In the existing property rights data management, data docking faces the following problems: numerous and heterogeneous data sources, huge data volume and high real-time requirements, complex and changeable business scenarios, and high system integration complexity. Usually, energy industry group enterprises often have multi-level organizational structures within the group enterprises, and different departments and subsidiaries have different data docking requirements, which leads to complex and inefficient processing of property rights data.

[0003] At present, traditional data docking methods include the following:

[0004] 1. Point-to-point integration, but each system establishes connections with other systems separately, resulting in complex integration and high maintenance costs. It cannot meet the needs of complex business scenarios and is prone to data inconsistency and integration interruption.

[0005] 2. Custom development, which requires customized development code for each integration, has a long development cycle, high cost, and difficult maintenance, requiring continuous investment of resources for maintenance and upgrades.

[0006] 3. ETL (data extraction, transformation, loading) tools require manual configuration of data mapping rules, are prone to errors, and cannot process real-time data. They are not suitable for business scenarios that require rapid response.

[0007] 4. ESB (Enterprise Service Bus) requires the creation of adapters for each integration, which is complex to configure and has performance bottlenecks. As the number of integrations increases, the performance of ESB will decrease.

[0008] 5. Data warehouse needs to extract data from the source system regularly. There is data delay. The data quality depends on the data quality of the source system. If the source system data is inaccurate or incomplete, the data in the data warehouse will also be affected.

[0009] 6. Manual data exchange is inefficient, error-prone, cannot meet the needs of large-scale data exchange, and is not suitable for automation scenarios.

[0010] At present, the above-mentioned traditional data connection methods have certain defects and cannot meet the characteristics of energy enterprises with complex business, large data volume and high real-time requirements. Summary of the invention

[0011] The purpose of the embodiments of the present application is to provide a property rights information management method based on message queues and heterogeneous data fusion, a property rights information management system based on message queues and heterogeneous data fusion, a computer-readable storage medium and a terminal device to solve the above problems.

[0012] In order to achieve the above-mentioned purpose, the first aspect of the present application provides a property rights information management method based on message queue and heterogeneous data fusion, including:

[0013] Building a first message queue, receiving and storing property rights information from an external system or an internal system through the first message queue;

[0014] In response to the property information reading instruction, read the corresponding first target property information from the first message queue, obtain verification information of the first target property information, and if it is determined that the sender of the first target property information is from an external system according to the verification information of the first target property information, verify the verification information of the first target property information according to a first rule; and

[0015] If it is determined according to the verification information of the first target property information that the sender of the first target property information is from an internal system, verifying the verification information of the first target property information using a second rule;

[0016] Obtain a verification result of the verification information of the first target property information; if the first target property information is determined to be legal based on the verification result, send the first target property information to a recipient of the first target property information; if the first target property information is determined to be illegal based on the verification result, delete the first target property information from the first message queue, and return an error message to the sender of the first target property information.

[0017] Optionally, sending the first target property information to a recipient of the first target property information includes:

[0018] Reading the first target property information from the first message queue, determining a recipient of the first target property information, and sending the first target property information to the recipient of the first target property information;

[0019] If the first target property information cannot be successfully sent to the recipient of the first target property information, the first target property information is stored in a pre-constructed second message queue.

[0020] Optionally, after storing the first target property rights information in a pre-built second message queue, the method further includes:

[0021] Obtaining preset benchmark retransmission times and benchmark adjustment times;

[0022] Counting the failure rate of sending information to the recipient of the first target property information within a preset historical period, and determining an adjustment coefficient of the benchmark adjustment number based on the failure rate, so that the adjustment coefficient increases as the failure rate increases;

[0023] Rounding up or down the product of the benchmark adjustment number and the adjustment coefficient and summing it with the benchmark retransmission number to determine the target retransmission number of the first target property rights information;

[0024] resending the first target property information according to the target resending number until the first target property information is successfully sent to the recipient of the first target property information; or

[0025] If the first target property information cannot be successfully sent to the receiver of the first target property information within the target retransmission number, the first target property information is marked as sending failure, and the first target property information is sent to a pre-constructed third message queue.

[0026] Optionally, resending the first target property rights information according to the target resending number includes:

[0027] Determine whether the current number of retransmissions reaches the retransmission threshold;

[0028] If the current retransmission number does not reach the retransmission number threshold, retransmitting the first target property rights information at a first retransmission time interval;

[0029] If the current number of retransmissions does not reach the retransmission threshold, retransmitting the first target property rights information at a second retransmission time interval until the current number of retransmissions reaches the target number of retransmissions;

[0030] The retransmission number threshold is smaller than the target retransmission number, and the first retransmission time interval is smaller than the second retransmission time interval.

[0031] Optionally, the verification information of the first target property information includes:

[0032] a first identity code of the sender of the first target property information, wherein the first identity code includes N digits, wherein the 1st to (N-1)th digits are the first N-1 digits of the first identity code, and the Nth digit is the check digit of the first identity code;

[0033] Determining, based on the verification information of the first target property information, that the sender of the first target property information is from an external system includes:

[0034] If the verification information of the first target property information includes the first identity code, it is determined that the sender of the first target property information is from an external system;

[0035] The first rule includes:

[0036] Determine a check coefficient corresponding to each digit in the first N-1 digits of the first identity code, and determine a modulus coefficient of the first identity code;

[0037] Using each check coefficient as the weight of the corresponding digit, taking the weighted sum of the first N-1 digits of the first identity code as the dividend, using the modulus coefficient as the divisor, performing a modulus operation on the dividend and the divisor to obtain a modulus operation result;

[0038] Matching the modulo operation result with the Nth digit of the first identity code to obtain a verification result of the verification information of the first target property information;

[0039] Determining, based on the verification result, that the first target property rights information is legal includes:

[0040] If the modulo operation result is the same as the Nth digit of the first identity code, it is determined that the first target property information is legal;

[0041] Determining that the first target property information is illegal according to the verification result includes:

[0042] If the modulo operation result is different from the Nth digit of the first identity code, it is determined that the first target property information is illegal.

[0043] Optionally, the verification information of the first target property information includes:

[0044] a property right code of the first target property right information;

[0045] The second rule includes:

[0046] Matching the property code of the first target property information with a preset property code list to obtain a verification result of verifying verification information of the first target property information, wherein the property code list includes different registered unique property codes;

[0047] Determining, based on the verification result, that the first target property rights information is legal includes:

[0048] If the property code list contains a property code that is the same as the property code of the first target property information, determining that the first target property information is legal;

[0049] Determining that the first target property information is illegal according to the verification result includes:

[0050] If the property code list does not contain the same property code as the property code of the first target property information, it is determined that the first target property information is illegal.

[0051] Optionally, before sending the first target property information to a recipient of the first target property information, the method further includes:

[0052] Parsing the first target property information, and extracting data from each field in the first target property information;

[0053] Mapping each field in the first target property information through a preset field mapping relationship table, wherein the field mapping relationship table at least includes a mapping relationship between each field in the first target property information and a corresponding field in a preset internal data structure;

[0054] The data of each field in the first target property information is written into the corresponding field in the mapped first target property information.

[0055] The second aspect of the present application provides a property rights information management system based on message queue and heterogeneous data fusion, including:

[0056] A data communication module is configured to construct a first message queue, and receive and store property rights information from an external system or an internal system through the first message queue;

[0057] a data verification module configured to respond to a property information reading instruction, read the corresponding first target property information from the first message queue, obtain verification information of the first target property information, and verify the verification information of the first target property information according to a first rule if it is determined that the sender of the first target property information is from an external system according to the verification information of the first target property information; and

[0058] If it is determined according to the verification information of the first target property information that the sender of the first target property information is from an internal system, verifying the verification information of the first target property information using a second rule;

[0059] The data processing module is configured to obtain a verification result of verifying the verification information of the first target property information; if the first target property information is determined to be legal based on the verification result, the first target property information is sent to a recipient of the first target property information; if the first target property information is determined to be illegal based on the verification result, the first target property information is deleted from the first message queue, and an error message is returned to the sender of the first target property information.

[0060] A third aspect of the present application provides a computer-readable storage medium storing a computer program which, when executed by a processor, causes the processor to execute the above-mentioned property rights information management method based on message queue and heterogeneous data fusion.

[0061] The fourth aspect of the present application provides a terminal device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the above-mentioned property rights information management method based on message queue and heterogeneous data fusion when executing the computer program.

[0062] The embodiments provided in this application have the following beneficial effects:

[0063] This application builds a data fusion hub by constructing message queue technology and utilizing heterogeneous data fusion, thereby enabling efficient, secure and reliable data connection between energy enterprise business systems and external systems, and improving the data processing efficiency of property rights information.

[0064] Other features and advantages of the embodiments or implementations of the present application will be described in detail in the subsequent specific implementation section. BRIEF DESCRIPTION OF THE DRAWINGS

[0065] The accompanying drawings are used to provide a further understanding of the embodiments of the present application and constitute a part of the specification. Together with the following specific implementations, they are used to explain the embodiments of the present application, but do not constitute a limitation on the embodiments of the present application. In the accompanying drawings:

[0066] Figure 1 A method flow chart of a property information management method based on a message queue and heterogeneous data fusion according to an embodiment of the present application is schematically shown;

[0067] Figure 2 A schematic block diagram of a property rights information management system based on a message queue and heterogeneous data fusion according to an embodiment of the present application is schematically shown;

[0068] Figure 3 A schematic diagram of the structure of a terminal device according to an embodiment of the present application is shown schematically.

[0069] Description of Reference Numerals

[0070] 10-terminal device, 100-processor, 101-memory, 102-computer program. DETAILED DESCRIPTION

[0071] The specific implementation of the embodiment of the present application is described in detail below in conjunction with the accompanying drawings. It should be understood that the specific implementation described here is only used to illustrate and explain the embodiment of the present application, and is not used to limit the embodiment of the present application.

[0072] In order to solve the above problems, Figure 1 As shown, the first aspect of the present application provides a property rights information management method based on message queue and heterogeneous data fusion, including:

[0073] S100, constructing a first message queue, receiving and storing property rights information from an external system or an internal system through the first message queue;

[0074] S200, in response to the property information reading instruction, read the corresponding first target property information from the first message queue, obtain verification information of the first target property information, and if it is determined that the sender of the first target property information is from an external system according to the verification information of the first target property information, verify the verification information of the first target property information according to the first rule; and

[0075] If it is determined that the sender of the first target property information is from an internal system according to the verification information of the first target property information, the verification information of the first target property information is verified by a second rule;

[0076] S300. Obtain a verification result of the verification information of the first target property information. If the first target property information is determined to be legal based on the verification result, send the first target property information to the recipient of the first target property information. If the first target property information is determined to be illegal based on the verification result, delete the first target property information from the first message queue and return an error message to the sender of the first target property information.

[0077] In this way, this application builds a data fusion hub system by constructing message queue technology and utilizing heterogeneous data fusion, thereby enabling efficient, secure and reliable data connection between energy enterprise business systems and external systems, and improving the data processing efficiency of property rights information.

[0078] Among them, the method of the present application can be applied to the data fusion hub system. The data fusion hub serves as a unified data docking platform. The property rights information management method based on message queue and heterogeneous data fusion of the present application can achieve the following purposes:

[0079] 1. Centralized data management: data from all data sources are concentrated on one platform to achieve unified data view and management.

[0080] 2. Heterogeneous data integration supports data integration of different data sources, different data formats and different data standards to meet the complex data docking needs of energy companies.

[0081] 3. Real-time data processing, using message queue technology to achieve real-time data transmission and processing to meet the energy companies' needs for real-time data.

[0082] 4. Data quality assurance: ensure the consistency, accuracy and completeness of data through data cleaning, conversion and standardization.

[0083] 5. Safe and reliable data transmission, using security protocols and encryption technology to ensure the security and reliability of data transmission.

[0084] 6. Flexible and scalable architecture, with modular design and scalable architecture, can easily expand and integrate new data sources and business scenarios.

[0085] This can effectively solve the defects of traditional data docking methods, achieve efficient, secure and reliable data docking, and provide timely and accurate data support for business decision-making and operational management.

[0086] Specifically, in step S100 of the present application, a first message queue is first constructed, wherein the first message queue is used to store the data to be shared until the receiver is ready to receive it. The data transmitted between the sender and the receiver is managed based on the message proxy mechanism. At the same time, the receiver can subscribe to a specific topic or data type through a subscription mechanism, and ensure data security through a preset security mechanism to prevent unauthorized access or tampering.

[0087] For example, a sender can publish data such as property information to a data queue and specify a topic or data type. The data is passed from the sender's queue to the receiver's queue through a message broker. The receiver subscribes to a specific topic or data type, and the message broker notifies the receiver when new data is available for the subscribed topic or data type. The receiver retrieves the data from its queue and processes or stores the data.

[0088] It has the following advantages:

[0089] 1. Asynchronous communication: allows systems and applications to exchange data at different times without having to be online at the same time.

[0090] 2. Decoupling: The sender and receiver are decoupled in time and space, which improves the elasticity and scalability of the system.

[0091] 3. Reliability: Data queues ensure that data is transmitted safely and reliably between senders and receivers.

[0092] 4. Scalability: The module can be easily expanded to support large amounts of data and concurrent connections.

[0093] In this application, the message queue can use free open source components such as Kafka and RabbitMQ. If the docking system supports direct connection to the message queue, the connection information of the message queue is given to the other party, allowing it to directly send messages to a queue as a producer. If the docking system does not support direct connection to the message queue, data docking can be done in the traditional way. The system of this application does not process the data after receiving the data, but only writes the received message to the first message queue. In this way, even if the other party cannot directly connect to the message queue, the message queue can be used to buffer the data.

[0094] It is understandable that in this application, the internal system refers to the internal business system of the enterprise, such as property rights, finance, scheduling and other systems, and the external system refers to the external business system of the enterprise, such as industrial and commercial registration, property rights exchange and other systems. The data fusion hub system of this application is used for unified management of data connection between the property rights system and the internal system, and between the property rights system and the external system.

[0095] In step S200, when the internal system or the external system interacts with the property system, the internal system or the external system first stores the property information to be sent to the property system in the first message queue. When the property system is ready to receive the data, the corresponding first target property information is read from the first message queue, wherein there may be multiple first target property information. After reading the first target property information, the first target property information is parsed to obtain the verification information in the first target property information. According to the verification information, it can be determined whether the sender of the current first target property information is from the external system or the internal system. It can be understood that there is at least one field in the property information for identifying the verification information of the sender.

[0096] In the present application, the verification information of the first target property information includes: the first identity code of the sender of the first target property information, the first identity code includes N digits, wherein the 1st to (N-1)th digits are the first N-1 digits of the first identity code, and the Nth digit is the verification digit of the first identity code. The first identity code can be the corporate credit code of the sender, or other custom codes.

[0097] Among them, the enterprise credit code is generated based on the enterprise's name, registered address, industry and other information. This information is unique to each enterprise. Therefore, the enterprise credit code is a unique and non-repeatable identification code. Each enterprise can only have one credit code, and there will be no duplicate credit codes between different enterprises. At the same time, once the enterprise credit code is generated, it will not change, even if the enterprise name, registered address or other information changes, its credit code will not change.

[0098] Due to its uniqueness and immutability, the enterprise credit code is widely used in various systems as a unique primary key. For example, it can be used in the industrial and commercial registration system to identify and manage the registration information of the enterprise; in the tax system to identify and manage the tax information of the enterprise; in the customs system to identify and manage the import and export business information of the enterprise; in the banking system to identify and manage the account information of the enterprise; in the credit investigation system to identify and manage the credit information of the enterprise; in the judicial system to identify and manage the legal information of the enterprise. The uniqueness and immutability of the enterprise credit code make it an ideal identifier for identifying and managing enterprise information. It can ensure the accurate identification of the enterprise between different systems and institutions and track the entire life cycle of the enterprise.

[0099] This application can effectively integrate data from different external systems by using enterprise credit codes for data standardization, accurately identify and associate data from different systems, and eliminate data duplication and differences. It can ensure that the data format, data type, and data value in different systems remain consistent, thereby improving the quality and reliability of data.

[0100] In step S200, if it is determined that the verification information of the first target property information is a first identity code, such as a corporate credit code, it can be determined that the sender of the first target property information is from an external system.

[0101] Then, the first rule includes:

[0102] S210. Determine the check coefficient corresponding to each digit in the first N-1 digits of the first identity code, and determine the modulus coefficient of the first identity code; taking the first identity code as an enterprise credit code as an example, the enterprise credit code consists of 18 digits, of which the 18th digit is the check digit. Then, first determine the check coefficients corresponding to the first 17 digits. For example, according to the numerical sequence of the enterprise credit code, the check coefficients corresponding to each digit are determined in turn as 2, 7, 9, 10, 5, 8, 4, 2, 1, 6, 3, 7, 9, 10, 5, 8, 4, and the modulus coefficient is determined to be 11.

[0103] S220, taking each verification coefficient as the weight of the corresponding digit, taking the weighted sum of the first N-1 digits of the first identity code as the dividend, taking the modulus coefficient as the divisor, performing a modulus operation on the dividend and the divisor, and obtaining a modulus operation result, the specific calculation formula is:

[0104] (x1*3+x2*7+x3*9+x4*10+x5*5+x6*8+x7*4+x8*2+x9*1+x10*6+x11*3+x12*7+x13*9+x14*10+x15*5+x16*8+x17*4)%11, where x1-x17 are the first 17 digits of the enterprise credit code.

[0105] S230, matching the modulo operation result with the Nth digit of the first identity code, and obtaining a verification result of the verification information of the first target property information. Specifically, if the modulo operation result is the same as the Nth digit of the first identity code, the first target property information is determined to be legal, for example, if the modulo operation result is the same as the 18th digit of the enterprise credit code, the first target property information is determined to be legal; if the modulo operation result is different from the Nth digit of the first identity code, the first target property information is determined to be illegal, for example, if the modulo operation result is different from the 18th digit of the enterprise credit code, the first target property information is determined to be illegal.

[0106] In the present application, the verification information of the first target property information may also be: the property code of the first target property information. If the sender of the first target property information is an internal system, the verification information of the first target property information is the property code commonly used by the internal system. It is understandable that the verification information can be identified as the enterprise credit code or the property code by identifying the field identifier, or by identifying the structure and format of the enterprise credit code and the property code.

[0107] When the sender is an internal system, the second rule includes:

[0108] The property code of the first target property information is matched with a preset property code list to obtain a verification result of the verification information of the first target property information, wherein the property code list includes different registered unique property codes, wherein the property code list includes the unique property codes corresponding to all enterprises that have completed property registration.

[0109] Among them, all enterprises that have completed property registration are given an 18-digit, practical and unique property code in the internal system in advance. This code can directly reflect the company's management superiors, management levels, property levels, company types and other information. The property system pushes the property code to the master data system as a prerequisite for the company to handle various businesses, such as account opening, account set setting and fund payment, so as to achieve process control and rigid constraints of property management.

[0110] If the sender is a domestic enterprise, the property rights code includes the following fields:

[0111] Four-character abbreviation of the secondary management company, province abbreviation, city code, management level, enterprise type, property level, enterprise establishment year code, and credit code (last four digits).

[0112] Alternatively, if the sender is a foreign enterprise, the property rights code includes the following fields:

[0113] The four-character abbreviation of the secondary management company, the country abbreviation, the management level, the enterprise category, the property rights level, the enterprise establishment year code, and the credit code (the last four digits).

[0114] This application uses property rights codes to standardize data, which can effectively integrate data from different internal systems, accurately identify and associate corporate property rights information, improve data quality and consistency, promote data fusion and association analysis, support comprehensive risk management and compliance assessment, and provide a basis for better decision-making and analysis.

[0115] Then, in step S300, if there is a property code in the property code list that is identical to the property code of the first target property information, the first target property information is determined to be legal. For example, if the same property code is not retrieved in the property code list, it means that the property code is invalid; if there is no property code in the property code list that is identical to the property code of the first target property information, the first target property information is determined to be illegal. If the same property code is retrieved in the property code list, it means that the property code is valid.

[0116] It is understandable that in this application, before the business verification of the property information is performed, the property information is also technically verified to confirm the data integrity of the property information. In data communication, communication code verification is a verification method used to detect and correct errors in data transmission. It introduces specific redundant information in the encoding of data transmission so that the receiver can detect and correct errors that may occur during the transmission process. Among them, common communication code verification methods include parity check, cyclic redundancy check (CRC) and checksum, etc. These methods are to add some additional information to the sent data so that the receiver can verify based on this information to determine whether the data is transmitted correctly.

[0117] Among them, parity check is a simple check method that adds a parity bit to each data block to ensure that the number of 1s in the data meets the predetermined rules, thereby detecting single-bit errors. Cyclic redundancy check (CRC) is a more powerful check method that uses polynomial division to generate a check value and attaches the check value to the transmitted data. The receiver uses the same polynomial division to calculate the received data and compares it with the received check value to detect and correct multi-bit errors. Checksum is a simple check method that obtains a value by summing the data, and the sender attaches the value to the data for transmission. The receiver sums the received data and compares it with the checksum transmitted by the sender to detect errors. It can be understood that the above-mentioned check method is a prior art, and the specific selection of which communication code check method depends on the requirements, performance and complexity of the communication system, which is not limited here.

[0118] In step S300, if it is determined that the first target property information is illegal, the first target property information is deleted from the first message queue, and an error message is returned to the sender of the first target property information. If it is determined that the first target property information is legal, the first target property information is sent to the receiver of the first target property information. It can be understood that the sender and receiver information can be included in the property information data. For example, a field in the property information data can be used to identify the sender or receiver of the property information.

[0119] In step S300, sending the first target property information to a recipient of the first target property information includes:

[0120] S310: Read first target property information to be sent from a first message queue, determine a recipient of the first target property information, and send the first target property information to the recipient of the first target property information.

[0121] S320: If the first target property information fails to be successfully sent to the recipient of the first target property information, the first target property information is stored in a pre-built second message queue. A second message queue is created, and if the information fails to be sent, the information is stored in the second message queue.

[0122] In the present application, after storing the first target property rights information in the pre-built second message queue, the method further includes:

[0123] S331. Obtain a preset benchmark retransmission number and a benchmark adjustment number. For example, the benchmark retransmission number M and the benchmark adjustment number K may be predetermined.

[0124] S332, calculate the failure rate of sending information to the recipient of the first target property information within a preset historical period, and determine the adjustment coefficient of the benchmark adjustment times based on the failure rate, so that the adjustment coefficient increases as the failure rate increases. For example, calculate the failure rate f of sending information to the recipient of the first target property information within the past six months, and determine the adjustment coefficient of K by the preset magnification coefficient and failure rate. For example, if the magnification coefficient a is preset, the adjustment coefficient of K is a*f; or, construct the adjustment coefficient of K as e (1+f) .

[0125] S333. Round up or down the product of the reference adjustment times and the adjustment coefficient and sum it with the reference retransmission times to determine the target retransmission times of the first target property information. That is, the target retransmission times of the first target property information = M + a*f*K, or the target retransmission times of the first target property information = M + e (1+f) *K, where e is a natural constant. Thus, the greater the failure rate, the greater the target number of retransmissions. That is, for the receiver, if the failure rate is greater, the number of retransmissions will be greater, so that the number of retransmissions can be dynamically adjusted according to the data transmission situation of the receiver. In order to avoid too high a number of retransmissions, an upper limit value of the number of retransmissions can be set to constrain it. For example, if the calculated target number of retransmissions is higher than the upper limit value, the upper limit value is used as the target number of retransmissions.

[0126] S334, resending the first target property information according to the target resending times until the first target property information is successfully sent to the recipient of the first target property information; or

[0127] If the first target property information cannot be successfully sent to the receiver of the first target property information within the target retransmission times, the first target property information is marked as sending failure, and the first target property information is sent to a pre-constructed third message queue.

[0128] In this application, the first target property rights information is resent according to the target resent times, including:

[0129] S335: Determine whether the current number of retransmissions reaches the retransmission threshold.

[0130] S336: If the current number of retransmissions does not reach the retransmission threshold, retransmit the first target property rights information at a first retransmission time interval. For example, if the current number of retransmissions does not reach the retransmission threshold, retransmit the information at a smaller time interval to increase the transmission frequency.

[0131] S337. If the current number of retransmissions does not reach the retransmission threshold, retransmit the first target property rights information at a second retransmission time interval until the current number of retransmissions reaches the target number of retransmissions; wherein the retransmission threshold is less than the target number of retransmissions, and the first retransmission time interval is less than the second retransmission time interval. For example, if the current number of retransmissions has reached the retransmission threshold, and the first target property rights information has not been successfully sent, retransmit the information at a larger time interval to reduce the transmission frequency, so as to improve the success rate of data transmission.

[0132] In the present application, before sending the first target property information to the recipient of the first target property information, the method further includes:

[0133] S410: Parse the first target property information and extract data from each field in the first target property information.

[0134] S420: Map each field in the first target property information through a preset field mapping relationship table, where the field mapping relationship table at least includes a mapping relationship between each field in the first target property information and a corresponding field in a preset internal data structure.

[0135] By pre-establishing a field mapping relationship table, the correspondence between the standardized data fields and the internal data fields of the property rights is determined. For example, the standardized data fields may be certain specific fields or all fields in the property rights information sent by the external system.

[0136] S430, write the data of each field in the first target property information into the corresponding field in the mapped first target property information. According to the mapping rules, convert the standardized data into the property internal data format, and map the fields of the property information sent by the external system according to the mapping relationship table, so as to uniformly convert the data information of different systems, thereby realizing the integration of data from different systems. Perform data verification on the converted data to verify whether the converted data is accurate and complete. It can be understood that data verification can be achieved by manual inspection or using data verification tools. Finally, load the converted data into the property internal system to complete the data conversion.

[0137] like Figure 2 As shown, the second aspect of the present application provides a property rights information management system based on message queue and heterogeneous data fusion, including:

[0138] The data communication module is configured to construct a first message queue, and receive and store property rights information from an external system or an internal system through the first message queue;

[0139] a data verification module configured to respond to the property information reading instruction, read the corresponding first target property information from the first message queue, obtain verification information of the first target property information, and verify the verification information of the first target property information according to the first target property information if it is determined that the sender of the first target property information is from an external system according to the verification information of the first target property information; and

[0140] If it is determined that the sender of the first target property information is from an internal system according to the verification information of the first target property information, the verification information of the first target property information is verified by a second rule;

[0141] The data processing module is configured to obtain a verification result of verifying the verification information of the first target property information. If the first target property information is determined to be legal based on the verification result, the first target property information is sent to the recipient of the first target property information. If the first target property information is determined to be illegal based on the verification result, the first target property information is deleted from the first message queue and an error message is returned to the sender of the first target property information.

[0142] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.

[0143] A third aspect of the present application provides a computer-readable storage medium storing a computer program which, when executed by a processor, causes the processor to execute the above-mentioned property rights information management method based on message queue and heterogeneous data fusion.

[0144] The fourth aspect of the present application provides a terminal device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the above-mentioned property rights information management method based on message queue and heterogeneous data fusion is implemented.

[0145] like Figure 3 FIG. 1 is a schematic diagram of a terminal device provided in an embodiment of the present application. Figure 3 As shown, the terminal device 10 of this embodiment includes: a processor 100, a memory 101, and a computer program 102 stored in the memory 101 and executable on the processor 100. When the processor 100 executes the computer program 102, the steps in the above method embodiment are implemented. Alternatively, when the processor 100 executes the computer program 102, the functions of each module / unit in the above device embodiments are implemented.

[0146] Exemplarily, the computer program 102 may be divided into one or more modules / units, one or more modules / units are stored in the memory 101, and are executed by the processor 100 to complete the present application. One or more modules / units may be a series of computer program instruction segments capable of completing specific functions, and the instruction segments are used to describe the execution process of the computer program 102 in the terminal device 10.

[0147] The terminal device 10 may be a computing device such as a desktop computer, a notebook, a PDA, or a cloud server. The terminal device 10 may include, but is not limited to, a processor 100 and a memory 101. Those skilled in the art will appreciate that Figure 3 It is only an example of the terminal device 10 and does not constitute a limitation of the terminal device 10. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, the terminal device may also include input and output devices, network access devices, buses, etc.

[0148] The processor 100 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or the processor may be any conventional processor, etc.

[0149] The memory 101 may be an internal storage unit of the terminal device 10, such as a hard disk or memory of the terminal device 10. The memory 101 may also be an external storage device of the terminal device 10, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the terminal device 10. Further, the memory 101 may also include both an internal storage unit of the terminal device 10 and an external storage device. The memory 101 is used to store computer programs and other programs and data required by the terminal device 10. The memory 101 may also be used to temporarily store data that has been output or is to be output.

[0150] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.

[0151] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0152] The above are only embodiments of the present application and are not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included within the scope of the claims of the present application.

Claims

1. A property rights information management method based on message queue and heterogeneous data fusion, characterized in that: include: Building a first message queue, receiving and storing property rights information from an external system or an internal system through the first message queue; In response to the property information reading instruction, read the corresponding first target property information from the first message queue, obtain verification information of the first target property information, and if it is determined that the sender of the first target property information is from an external system according to the verification information of the first target property information, verify the verification information of the first target property information according to a first rule; as well as If it is determined according to the verification information of the first target property information that the sender of the first target property information is from an internal system, verifying the verification information of the first target property information by using a second rule; Obtain a verification result of the verification information of the first target property information; if the first target property information is determined to be legal based on the verification result, send the first target property information to a recipient of the first target property information; if the first target property information is determined to be illegal based on the verification result, delete the first target property information from the first message queue, and return an error message to the sender of the first target property information.

2. The property rights information management method based on message queue and heterogeneous data fusion according to claim 1 is characterized in that: Sending the first target property information to a recipient of the first target property information includes: Reading the first target property information from the first message queue, determining a recipient of the first target property information, and sending the first target property information to the recipient of the first target property information; If the first target property information cannot be successfully sent to the recipient of the first target property information, the first target property information is stored in a pre-constructed second message queue.

3. The property rights information management method based on message queue and heterogeneous data fusion according to claim 2 is characterized in that: After storing the first target property rights information in a pre-built second message queue, the method further includes: Obtaining preset benchmark retransmission times and benchmark adjustment times; Counting the failure rate of sending information to the recipient of the first target property information within a preset historical period, and determining an adjustment coefficient of the benchmark adjustment number based on the failure rate, so that the adjustment coefficient increases as the failure rate increases; Rounding up or down the product of the benchmark adjustment number and the adjustment coefficient and summing it with the benchmark retransmission number to determine the target retransmission number of the first target property rights information; resending the first target property information according to the target resending number until the first target property information is successfully sent to the recipient of the first target property information; or If the first target property information cannot be successfully sent to the receiver of the first target property information within the target retransmission number, the first target property information is marked as sending failure, and the first target property information is sent to a pre-constructed third message queue.

4. The property rights information management method based on message queue and heterogeneous data fusion according to claim 3 is characterized in that: Resending the first target property rights information according to the target resending number of times includes: Determine whether the current number of retransmissions reaches the retransmission threshold; If the current retransmission number does not reach the retransmission number threshold, retransmitting the first target property rights information at a first retransmission time interval; If the current number of retransmissions does not reach the retransmission threshold, retransmitting the first target property rights information at a second retransmission time interval until the current number of retransmissions reaches the target number of retransmissions; The retransmission number threshold is smaller than the target retransmission number, and the first retransmission time interval is smaller than the second retransmission time interval.

5. The property rights information management method based on message queue and heterogeneous data fusion according to claim 1 is characterized in that: The verification information of the first target property information includes: a first identity code of the sender of the first target property information, wherein the first identity code includes N digits, wherein the 1st to (N-1)th digits are the first N-1 digits of the first identity code, and the Nth digit is the check digit of the first identity code; Determining that the sender of the first target property information is from an external system according to the verification information of the first target property information includes: If the verification information of the first target property information includes the first identity code, it is determined that the sender of the first target property information is from an external system; The first rule includes: Determine a check coefficient corresponding to each digit in the first N-1 digits of the first identity code, and determine a modulus coefficient of the first identity code; Using each check coefficient as the weight of the corresponding digit, taking the weighted sum of the first N-1 digits of the first identity code as the dividend, using the modulus coefficient as the divisor, performing a modulus operation on the dividend and the divisor to obtain a modulus operation result; Matching the modulo operation result with the Nth digit of the first identity code to obtain a verification result of the verification information of the first target property information; Determining, based on the verification result, that the first target property rights information is legal includes: If the modulo operation result is the same as the Nth digit of the first identity code, it is determined that the first target property information is legal; Determining that the first target property information is illegal according to the verification result includes: If the modulo operation result is different from the Nth digit of the first identity code, it is determined that the first target property information is illegal.

6. The property rights information management method based on message queue and heterogeneous data fusion according to claim 1 is characterized in that: The verification information of the first target property information includes: a property right code of the first target property right information; The second rule includes: Matching the property code of the first target property information with a preset property code list to obtain a verification result of verifying verification information of the first target property information, wherein the property code list includes different registered unique property codes; Determining, based on the verification result, that the first target property rights information is legal includes: If the property code list contains a property code that is the same as the property code of the first target property information, determining that the first target property information is legal; Determining that the first target property information is illegal according to the verification result includes: If the property code list does not contain the same property code as the property code of the first target property information, it is determined that the first target property information is illegal.

7. The property rights information management method based on message queue and heterogeneous data fusion according to claim 1 is characterized in that: Before sending the first target property information to a recipient of the first target property information, the method further includes: Parsing the first target property information, and extracting data from each field in the first target property information; Mapping each field in the first target property information through a preset field mapping relationship table, wherein the field mapping relationship table at least includes a mapping relationship between each field in the first target property information and a corresponding field in a preset internal data structure; The data of each field in the first target property information is written into the corresponding field in the mapped first target property information.

8. A property rights information management system based on message queue and heterogeneous data fusion, characterized in that: include: A data communication module is configured to construct a first message queue, and receive and store property rights information from an external system or an internal system through the first message queue; a data verification module configured to respond to the property information reading instruction, read the corresponding first target property information from the first message queue, obtain verification information of the first target property information, and verify the verification information of the first target property information according to a first rule if it is determined that the sender of the first target property information is from an external system according to the verification information of the first target property information; as well as If it is determined according to the verification information of the first target property information that the sender of the first target property information is from an internal system, verifying the verification information of the first target property information by using a second rule; The data processing module is configured to obtain a verification result of verifying the verification information of the first target property information; if the first target property information is determined to be legal based on the verification result, the first target property information is sent to a recipient of the first target property information; if the first target property information is determined to be illegal based on the verification result, the first target property information is deleted from the first message queue, and an error message is returned to the sender of the first target property information.

9. A computer-readable storage medium storing a computer program which, when executed by a processor, causes the processor to execute the property rights information management method based on message queue and heterogeneous data fusion as claimed in any one of claims 1 to 7.

10. A terminal device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the property rights information management method based on message queue and heterogeneous data fusion as described in any one of claims 1 to 7 is implemented.

Images