Processing method for hierarchical assembly and grouping synchronization of data between intelligent terminal and service system

Abstract

The invention provides a processing method for hierarchical synchronization and hierarchical assembly of data between an intelligent terminal and a service system, and the method comprises the steps: enabling the service system to determine a target intelligent terminal according to a data change event when the data of an SQL database is changed; determining a target first-level synchronous assembly service according to the network topology relationship of the target intelligent terminal, and sending a data change notification to the target first-level synchronous assembly service; after receiving the data change notification, the target first-level synchronous assembly service pulls changed data from an SQL database of a business system, performs data assembly according to a current-level assembly strategy, stores the data into a kvDB database of the target first-level synchronous assembly service, determines a lower-level device to be synchronized according to a network topology relationship of the target intelligent terminal, and performs synchronization according to the lower-level device to be synchronized. A data change notification is sent to the lower-level to-be-synchronized device; and after receiving the data change notice, each level of to-be-synchronized equipment judges whether the to-be-synchronized equipment is a target intelligent terminal, and if not, the next level of to-be-synchronized equipment is determined again and the data change notice is sent.

Description

Technical Field

[0001] The present invention relates to the technical field of data synchronization, and in particular to a processing method for hierarchical synchronization and hierarchical assembly of data between an intelligent terminal and a business system. Background Art

[0002] In the process of informatization of campuses and small and medium-sized enterprises, there are many intelligent terminal business data synchronization and assembly businesses such as consumption, water and electricity, water control, access control, door locks, etc. At present, most intelligent terminals adopt the common single-level data synchronization and assembly mode, that is, the business system directly synchronizes business data with the intelligent terminal; this mode has problems such as slow data synchronization, untimely synchronization, large assembly volume, high code implementation coupling, and high server pressure. When the external network environment is abnormally interrupted, untimely data synchronization will cause problems such as the inability to use the intelligent terminal.

[0003] Most of the existing device data synchronization methods are synchronization between devices. For example, patent CN110798444B proposes a data synchronization method and device based on the Internet of Things. According to the data synchronization request of the device to be synchronized, the target device is determined, and the data information of the target device is obtained to build a synchronization data set. The device to be synchronized is updated through the synchronization data set, thereby realizing data synchronization between the device to be synchronized and the target device; another example is a cloud-edge data synchronization method proposed by CN116233148A. According to the data to be synchronized, a communication connection between the target edge node and the target edge device is established to realize data synchronization and improve the data transmission efficiency during cloud-edge data synchronization. Regardless of which method is used, no solution for data synchronization between the business system and the smart terminal is provided.

[0004] In order to solve the above problems, people have been seeking an ideal technical solution. Summary of the invention

[0005] The purpose of the present invention is to address the deficiencies of the prior art and thus provide a processing method for hierarchical synchronization and hierarchical assembly of data between an intelligent terminal and a business system.

[0006] In order to achieve the above object, the technical solution adopted by the present invention is: In a first aspect, a method for processing hierarchical synchronization and hierarchical assembly of data between an intelligent terminal and a business system comprises: When the data in the SQL database of the business system changes, the target intelligent terminal is determined according to the data change event; the target first-level synchronization assembly service is determined according to the network topology relationship of the target intelligent terminal, and a data change notification is sent to the target first-level synchronization assembly service; After receiving the data change notification, the target first-level synchronization assembly service pulls the changed data from the SQL database of the business system, assembles the data according to the assembly strategy of this level and stores it in its own kvDB database, determines the lower-level devices to be synchronized according to the network topology relationship of the target smart terminal, and sends data change notifications to the lower-level devices to be synchronized; After receiving the data change notification, each level of synchronization device determines whether it is the target smart terminal. If not, it pulls the change data from the kvDB database of the upper-level synchronization device, assembles the data according to the assembly strategy of this level and stores it in its own kvDB database, determines the lower-level synchronization device according to the network topology relationship of the target smart terminal, and sends a data change notification to the lower-level synchronization device; repeats the current step until each level of synchronization device determines that it is the target smart terminal, and pulls the change data from the kvDB database of the upper-level synchronization level assembly service for data synchronization.

[0007] Furthermore, the data change notification includes the identity information of the target intelligent terminal, the terminal type, the network topology relationship and the service type of the changed data; The current-level assembly strategy is to assemble the pulled change data based on a standard data assembly format associated with the terminal type of the target intelligent terminal and the business type of the change data.

[0008] Furthermore, after each level of device to be synchronized or the target first-level synchronization assembly service receives the change notification, it searches the pre-stored standard data assembly format library for the standard data assembly format associated with the terminal type of the target smart terminal and the business type of the changed data to execute the strategy of the current level of assembly; and determines the lower-level device to be synchronized based on the network topology relationship of the target smart terminal.

[0009] A second aspect provides a processing system for hierarchical synchronization and hierarchical assembly of data between an intelligent terminal and a business system, including a primary synchronization assembly service and a secondary synchronization assembly service; The first-level synchronization assembly service includes a first-level synchronization service, a first-level assembly service and a first-level kvDB; after the first-level synchronization service receives the data change notification issued by the business system, it pulls the changed data from the SQL database in the business system, calls the first-level assembly service to perform first-level data assembly according to the assembly strategy of this level and stores it in the first-level kvDB database, determines the target second-level synchronization assembly service according to the network topology relationship of the target intelligent terminal, and sends a second-level data change notification to the target second-level synchronization assembly service; The secondary synchronization assembly service includes a secondary synchronization service, a secondary assembly service and a secondary kvDB; after the secondary synchronization service receives the secondary data change notification issued by the primary synchronization service, it pulls the changed data from the kvDB database of the primary synchronization assembly service according to the secondary data change notification. The secondary assembly service is called to assemble the secondary data according to the current assembly strategy and store it in the secondary kvDB database. The target smart terminal to be synchronized is determined according to the network topology relationship of the target smart terminal, and a third-level data change notification is sent to the target smart terminal so that the target smart terminal can pull the changed data from the kvDB database of the secondary synchronization assembly service for data synchronization according to the third-level data change notification.

[0010] A third aspect provides a data synchronization system, including a business system, a first-class intelligent terminal, a second-class intelligent terminal, and the processing system described in the second aspect, wherein data synchronization is performed between the business system and the first-level synchronization assembly service of the processing system based on an RPC communication method; The first type of intelligent terminal directly synchronizes data with the business system through the first-level synchronization assembly service of the processing system; The second type of intelligent terminal synchronizes data with the business system through the secondary synchronization assembly service of the processing system and the primary synchronization assembly service of the processing system in turn.

[0011] The present invention has outstanding substantive features and significant progress compared to the prior art. Specifically, (1) The business system operating environment is lightweight and customers need less server resources to deploy: hierarchical synchronization and hierarchical assembly of data disperses the computing pressure of data synchronization and data assembly to multiple different data synchronization and assembly service nodes or intelligent gateway nodes, reducing the operating pressure of the business system server, requiring fewer resources for system operation, and requiring customers to purchase fewer server resources; (2) High real-time stability: When a local data synchronization assembly node is abnormal, it will not affect the data processing of other data synchronization service nodes, thus improving stability; when the platform data changes, the terminal is notified in real time to synchronize and obtain the latest data, thus achieving good real-time performance; (3) Technical implementation code has high cohesion and low coupling: Data assembly can be classified and distributed according to business. During technical implementation, different assembly implementations do not affect each other, and the code coupling is low. (4) Smart terminals can be used offline: Data synchronization enables smart terminals to be used offline. When the customer network occasionally experiences an abnormality, the smart terminal can be used offline. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Figure 1 It is a schematic flow chart of the processing method described in Example 1 of the present invention.

[0013] Figure 2 It is a principle block diagram of the processing system described in Example 2 of the present invention. DETAILED DESCRIPTION

[0014] The technical solution of the present invention is further described in detail below through specific implementation methods.

[0015] Example 1 This embodiment provides a processing method for hierarchical synchronization and hierarchical assembly of data between an intelligent terminal and a business system, such as Figure 1 As shown, the method includes: When the data in the SQL database changes, the business system determines the target intelligent terminal based on the data change event; determines the target first-level synchronization assembly service to be synchronized based on the network topology relationship of the target intelligent terminal, and sends a first-level data change notification to the target first-level synchronization assembly service to start the data hierarchical synchronization and hierarchical assembly process. Specifically, it supports multiple SQL databases, such as SQL, sqlserver, dm and other relational databases.

[0016] Preferably, the data change event includes the business type of the changed data and the identity information of the target smart terminal; specifically, the business type of the changed data includes device data, parameter data, authorization data, user data, and business data; after the target smart terminal is determined based on the data change event, the network topology structure associated with the identity information of the target smart terminal is searched in the business system; wherein, the network topology relationship of the smart terminal is stored in the business system when the smart terminal accesses the business system; specifically, the network topology relationship of the smart terminal is planned and designed according to parameters such as the communication type and data volume of the smart terminal, and the network topology relationship of the smart terminal is associated with the identity information of the smart terminal and stored.

[0017] Specifically, if the communication type of the smart terminal type is Mqtt communication, then the smart gateway or front-end service that uses the Mqtt communication method with the smart terminal type is selected as its upper synchronization device; When the communication type of the smart terminal type is LoRa communication, select the smart gateway or front-end service that uses LoRa communication with the smart terminal type as its upper synchronization device; When the communication type of the smart terminal type is Sub-1G communication, select the smart gateway or front-end service that uses the Sub-1G communication method with the smart terminal type as its upper synchronization device.

[0018] The data change notification includes the identity information of the target intelligent terminal, the terminal type, the network topology relationship and the service type of the changed data.

[0019] After receiving the data change notification, the target first-level synchronization assembly service pulls the changed data from the SQL database of the business system, assembles the data according to the assembly strategy of this level and stores it in its own kvDB database, determines the second-level devices to be synchronized according to the network topology relationship of the target smart terminal, and sends data change notifications to the second-level devices to be synchronized.

[0020] In specific implementation, the current level assembly strategy is to assemble the pulled change data based on the standard data assembly format associated with the terminal type of the target smart terminal and the business type of the change data. After receiving the change notification, the target first-level synchronization assembly service searches for the standard data assembly format associated with the terminal type of the target smart terminal and the business type of the change data in the pre-stored standard data assembly format library to execute the current level assembly strategy; and determines the second-level device to be synchronized based on the network topology relationship of the target smart terminal.

[0021] After receiving the data change notification, the second-level device to be synchronized determines whether it is the target smart terminal. If not, it pulls the change data from the kvDB database of the first-level synchronization device, assembles the data according to the assembly strategy of this level and stores it in its own kvDB database. According to the network topology relationship of the target smart terminal, the third-level device to be synchronized is determined, and a data change notification is sent to the third-level device to be synchronized.

[0022] After receiving the data change notification, the third-level device to be synchronized determines whether it is the target smart terminal. If not, it pulls the change data from the kvDB database of the second-level synchronization device, assembles the data according to the assembly strategy of this level and stores it in its own kvDB database. According to the network topology relationship of the target smart terminal, the fourth-level device to be synchronized is determined, and a data change notification is sent to the fourth-level device to be synchronized.

[0023] Repeat the current step until the device to be synchronized determines that it is the target intelligent terminal, and pulls the change data from the kvDB database of the upper-level synchronization-level assembly service for data synchronization without assembling the data.

[0024] Furthermore, after each level of synchronization device determines the lower level synchronization device according to the network topology relationship of the target intelligent terminal, it sends data change notifications and pulls changed data according to the communication type between each level of synchronization device and the lower level synchronization device.

[0025] It should be noted that each level of data assembly is a standardization of data. Simply put, for the same data, different types of smart terminals have their own data formats. Therefore, it is necessary to design a corresponding standard data assembly format for each business type of each type of smart terminal so that the pulled data can be assembled into the corresponding format of the target smart terminal.

[0026] Specifically, if each level of synchronization device receives a data change notification and determines that it is the target smart terminal, it directly pulls the change data from the kvDB database of the upper synchronization level assembly service for data synchronization without the need to assemble the data again.

[0027] In the above technical solution, data is assembled according to business classification and in steps. When the technology is implemented, different assembly implementations do not affect each other and the code coupling is low.

[0028] It should be noted that, compared with the sql DB database, kvDB is a concise and efficient key-value pair storage library that supports ordered key-value storage and simple full-text search, and has the advantages of high performance and low memory usage. The present invention uses kvDB to store and pull assembly data, which can greatly improve the data synchronization rate and ensure the real-time performance of data synchronization.

[0029] In this embodiment, the hierarchical synchronization and hierarchical assembly of data disperse the computing pressure of data synchronization and data assembly to multiple different data synchronization and assembly service nodes or intelligent gateway nodes, thereby reducing the operating pressure of the business system server, requiring fewer resources for system operation, and requiring customers to purchase fewer server resources.

[0030] When a local data synchronization assembly node is abnormal, it will not affect the data processing of other data synchronization service nodes, thereby improving stability; when the platform data changes, the terminal is notified in real time to synchronize and obtain the latest data, with good real-time performance.

[0031] And because the data is synchronized in time, that is, the data on the smart terminal is real-time data, its use will not be affected when the customer network occasionally fails, and it has the ability to be used offline.

[0032] It should be noted that in many cases, there is more than one or more types of changed data. Therefore, the target first-level synchronization assembly service and each level of synchronized device store the data change notification in the message queue in the order of receipt, and process the data change notification based on the message queue mechanism.

[0033] Example 2 This embodiment provides a processing system for hierarchical synchronization and hierarchical assembly of data between an intelligent terminal and a business system, such as Figure 2 As shown, it includes the first-level synchronous assembly service and the second-level synchronous assembly service; Includes first-level synchronous assembly service and second-level synchronous assembly service; The first-level synchronization assembly service includes a first-level synchronization service, a first-level assembly service and a first-level kvDB; after the first-level synchronization service receives the data change notification issued by the business system, it pulls the changed data from the SQL database in the business system, calls the first-level assembly service to perform first-level data assembly according to the assembly strategy of this level and stores it in the first-level kvDB database, determines the target second-level synchronization assembly service according to the network topology relationship of the target intelligent terminal, and sends a second-level data change notification to the target second-level synchronization assembly service; The secondary synchronization assembly service includes a secondary synchronization service, a secondary assembly service and a secondary kvDB; after the secondary synchronization service receives the secondary data change notification issued by the primary synchronization service, it pulls the changed data from the kvDB database of the primary synchronization assembly service according to the secondary data change notification, calls the secondary assembly service to assemble the secondary data according to the current assembly strategy and stores it in the secondary kvDB database, determines the target smart terminal to be synchronized according to the network topology relationship of the target smart terminal, and sends a tertiary data change notification to the target smart terminal, so that the target smart terminal can pull the changed data from the kvDB database of the secondary synchronization assembly service for data synchronization according to the tertiary data change notification.

[0034] Furthermore, the data change notification includes the identity information of the target intelligent terminal, the terminal type, the network topology relationship and the service type of the changed data; The current-level assembly strategy is to assemble the pulled change data based on a standard data assembly format associated with the terminal type of the target intelligent terminal and the business type of the change data.

[0035] The first-level assembly service or the second-level assembly service searches a pre-stored standard data assembly format library for a standard data assembly format associated with the terminal type of the target intelligent terminal and the service type of the changed data to execute the strategy of the current-level assembly.

[0036] Example 3 This embodiment provides a data synchronization system, including a business system, an intelligent terminal, and the processing system described in Embodiment 2, wherein the intelligent terminal includes a first type of intelligent terminal and a second type of intelligent terminal; The business system and the first-level synchronization assembly service of the processing system perform data synchronization based on the RPC communication method; The first type of intelligent terminal directly synchronizes data with the business system through the first-level synchronization assembly service of the processing system; preferably, the first-level synchronization assembly service of the processing system and the first type of intelligent terminal synchronize data based on the WebSocket method; The second type of intelligent terminal synchronizes data with the business system through the secondary synchronization assembly service of the processing system and the primary synchronization assembly service of the processing system in turn. Preferably, the primary synchronization assembly service and the secondary synchronization assembly service of the processing system use Socket, RPC, and Mqtt to synchronize data; the secondary synchronization assembly service of the processing system and the second type of intelligent terminal use SUB-1G, LoRa, and Mqtt communication methods to synchronize data.

[0037] In the specific implementation, the change data includes equipment data, parameter data, authorization data, user data and business data; the smart terminals include consumer terminals, access control terminals, door lock terminals, water and electricity terminals and water control terminals; the secondary synchronous assembly service includes smart gateways and front-end servers.

[0038] Normally, consumer terminals must communicate in a timely manner, so Web Socket direct communication is used. This method only supports secondary synchronous assembly services, that is, consumer terminals are first-class smart terminals; and for example, access control terminals, door lock terminals, water and electricity terminals, and water control terminals need to use intelligent gateways or front-end services to communicate and support third-class synchronous assembly services. Therefore, access control terminals, door lock terminals, water and electricity terminals, and water control terminals are second-class smart terminals.

[0039] Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, ordinary technicians in the field should understand that the specific implementation methods of the present invention can still be modified or some technical features can be replaced by equivalents without departing from the spirit of the technical solution of the present invention, which should be included in the scope of the technical solution for protection of the present invention.

Claims

1. A method for processing hierarchical synchronization and hierarchical assembly of data between an intelligent terminal and a business system, characterized in that: The method comprises: When the data in the SQL database of the business system changes, the target intelligent terminal is determined according to the data change event; the target first-level synchronization assembly service is determined according to the network topology relationship of the target intelligent terminal, and a data change notification is sent to the target first-level synchronization assembly service; After receiving the data change notification, the target first-level synchronization assembly service pulls the changed data from the SQL database of the business system, assembles the data according to the assembly strategy of this level and stores it in its own kvDB database, determines the lower-level devices to be synchronized according to the network topology relationship of the target smart terminal, and sends data change notifications to the lower-level devices to be synchronized; After receiving the data change notification, each level of synchronization device determines whether it is the target smart terminal. If not, it pulls the change data from the kvDB database of the upper-level synchronization device, assembles the data according to the assembly strategy of this level and stores it in its own kvDB database, determines the lower-level synchronization device according to the network topology relationship of the target smart terminal, and sends a data change notification to the lower-level synchronization device; repeats the current step until each level of synchronization device determines that it is the target smart terminal, and pulls the change data from the kvDB database of the upper-level synchronization level assembly service for data synchronization.

2. A method for processing hierarchical synchronization and hierarchical assembly of data between an intelligent terminal and a business system according to claim 1, characterized in that: The data change notification includes the identity information of the target intelligent terminal, the terminal type, the network topology relationship and the service type of the changed data; The current-level assembly strategy is to assemble the pulled change data based on a standard data assembly format associated with the terminal type of the target intelligent terminal and the business type of the change data.

3. A method for processing hierarchical synchronization and hierarchical assembly of data between an intelligent terminal and a business system according to claim 2, characterized in that: After receiving the change notification, each level of the synchronization device or the target level one synchronization assembly service searches the pre-stored standard data assembly format library for the standard data assembly format associated with the terminal type of the target intelligent terminal and the business type of the changed data to execute the strategy of the current level assembly; And determine the lower-level devices to be synchronized according to the network topology relationship of the target intelligent terminal.

4. A method for processing hierarchical synchronization and hierarchical assembly of data between an intelligent terminal and a business system according to any one of claims 1 to 3, characterized in that: After the lower-level devices to be synchronized are determined according to the network topology of the target intelligent terminal, data change notifications are sent and changed data are pulled according to the communication type between each level of synchronization device and the lower-level devices to be synchronized.

5. A method for processing hierarchical synchronization and hierarchical assembly of data between an intelligent terminal and a business system according to any one of claims 1 to 3, characterized in that: The target first-level synchronization assembly service and each level of the to-be-synchronized device store the data change notification in the message queue in the order of receipt, and process the data change notification based on the message queue mechanism.

6. A processing system for hierarchical synchronization and hierarchical assembly of data between intelligent terminals and business systems, including a primary synchronization assembly service and a secondary synchronization assembly service; The first-level synchronization assembly service includes a first-level synchronization service, a first-level assembly service and a first-level kvDB; after the first-level synchronization service receives the data change notification issued by the business system, it pulls the changed data from the SQL database in the business system, calls the first-level assembly service to perform first-level data assembly according to the assembly strategy of this level and stores it in the first-level kvDB database, determines the target second-level synchronization assembly service according to the network topology relationship of the target intelligent terminal, and sends a second-level data change notification to the target second-level synchronization assembly service; The secondary synchronization assembly service includes a secondary synchronization service, a secondary assembly service and a secondary kvDB; After the secondary synchronization service receives the secondary data change notification issued by the primary synchronization service, the secondary synchronization service pulls the changed data from the kvDB database of the primary synchronization assembly service according to the secondary data change notification, calls the secondary assembly service to assemble the secondary data according to the current assembly strategy and stores the data in the secondary kvDB database, determines the target smart terminal to be synchronized according to the network topology relationship of the target smart terminal, and sends a tertiary data change notification to the target smart terminal, so that the target smart terminal can pull the changed data from the kvDB database of the secondary synchronization assembly service for data synchronization according to the tertiary data change notification.

7. A processing system for hierarchical synchronization and hierarchical assembly of data between an intelligent terminal and a business system according to claim 6, characterized in that: The data change notification includes the identity information of the target intelligent terminal, the terminal type, the network topology relationship and the service type of the changed data; The current-level assembly strategy is to assemble the pulled change data based on a standard data assembly format associated with the terminal type of the target intelligent terminal and the business type of the change data.

8. A processing system for hierarchical synchronization and hierarchical assembly of data between an intelligent terminal and a business system according to claim 6 or 7, characterized in that: The first-level assembly service or the second-level assembly service searches a pre-stored standard data assembly format library for a standard data assembly format associated with the terminal type of the target intelligent terminal and the service type of the changed data to execute the strategy of the current-level assembly.

9. A data synchronization system, characterized in that: It comprises a business system, a first-class intelligent terminal, a second-class intelligent terminal and a processing system as claimed in any one of claims 6 to 8, wherein data synchronization is performed between the business system and the first-level synchronization assembly service of the processing system based on an RPC communication method; The first type of intelligent terminal directly synchronizes data with the business system through the first-level synchronization assembly service of the processing system; The second type of intelligent terminal synchronizes data with the business system through the secondary synchronization assembly service of the processing system and the primary synchronization assembly service of the processing system in turn.

10. A processing system for hierarchical synchronization and hierarchical assembly of data between an intelligent terminal and a business system according to claim 9, characterized in that: The change data includes device data, parameter data, authorization data, user data and business data; the smart terminals include consumer terminals, access control terminals, door lock terminals, water and electricity terminals and water control terminals; the secondary synchronous assembly service includes smart gateways and front-end servers; The communication method between the first type of intelligent terminal and the first level synchronization assembly service is WebsSocket; The communication method between the secondary synchronization assembly service and the primary synchronization assembly service includes Socket, Mqtt and RPC; The communication methods between the secondary synchronization assembly service and the smart terminal include Sub-1G, LoRa and Mqtt.

Images