A data communication method and related device

Abstract

The present application discloses a data communication method and related devices, the method comprising: obtaining target data collected by an associated device, storing the target data in a target memory; generating data index information based on the target data; wherein the data index information is determined based on the storage address and storage size of the target data; sending the data index information to the data processing server, so that the data processing server obtains the target data from the target memory through the data index information. In the above manner, the present application can improve the stability and security of data communication.

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a data communication method and related devices. Background Art

[0002] In the field of IoT, IoT servers are used to collect target data generated or acquired by different types of devices during operation, and transmit the target data to data processing servers for data analysis. Currently, the commonly used method is to achieve data communication between data processing servers and IoT servers by setting corresponding communication protocols. However, during the transmission process, since IoT servers are only used for data transmission and data processing servers are only used for data reception, real-time verification cannot be performed during data communication, and data loss is prone to occur.

[0003] In view of this, how to propose a data communication method with higher stability and security has become an urgent problem to be solved. Summary of the invention

[0004] The main technical problem solved by the present application is to provide a data communication method and related devices, which can improve the stability and security of data communication.

[0005] To solve the above technical problems, a technical solution adopted in the present application is: to provide a data communication method, comprising: obtaining target data collected by an associated device, and storing the target data in a target memory; generating data index information based on the target data; wherein the data index information is determined based on the storage address and storage size of the target data; and sending the data index information to a data processing server, so that the data processing server obtains the target data from the target memory through the data index information.

[0006] To solve the above technical problems, another technical solution adopted in the present application is: providing a data communication method, comprising: obtaining data index information sent by an Internet of Things server and the read permission granted by a target storage device; wherein the data index information is determined based on the target data obtained by the Internet of Things server; based on the data index information and the read permission, extracting the target data matching the data index information from the target database.

[0007] To solve the above technical problems, another technical solution adopted in the present application is: to provide an electronic device, comprising a memory and a processor coupled to each other, wherein the memory stores program instructions, and the processor is used to execute the data communication method mentioned in the above technical solution.

[0008] In order to solve the above technical problems, another technical solution adopted by the present application is: providing a storage device storing program instructions that can be executed by a processor, and the program instructions are used to implement the data communication method mentioned in the above technical solution.

[0009] The beneficial effect of the present application is as follows: Different from the prior art, the data communication method proposed in the present application, after the IoT server obtains the target data collected by the associated device, stores the target data in the target memory, and generates data index information based on the storage address and storage size of the target data in the target memory. The IoT server sends the data index information to the data processing server, so that the data processing server extracts the target data from the target memory according to the data index information. This method avoids direct data communication between the IoT server and the data processing server, and improves the stability and security of data transmission. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. Among them:

[0011] Figure 1 It is a structural schematic diagram of an implementation method of the data communication system of the present application;

[0012] Figure 2 It is a flowchart of an implementation method of the data communication method of the present application;

[0013] Figure 3 yes Figure 2 Step S101 corresponds to a flow chart of another implementation method;

[0014] Figure 4 yes Figure 2 Step S101 corresponds to a flowchart of another implementation method;

[0015] Figure 5 It is a flow chart of another implementation method of the data communication method of the present application;

[0016] Figure 6 It is a flowchart of another implementation method of the data communication method of the present application;

[0017] Figure 7 It is a structural schematic diagram of an embodiment of the electronic device of the present application;

[0018] Figure 8 It is a structural diagram of an implementation method of a storage device of the present application. DETAILED DESCRIPTION

[0019] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments, and different embodiments can be adaptively combined. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0020] See also Figure 1 , Figure 1 Schematic diagram of the structure of an implementation method of the data communication system of the present application. Figure 1 As shown, the data communication system includes an Internet of Things server, a data processing server and a target storage.

[0021] Specifically, the IoT server is used to obtain the target data collected by the associated device and store the target data in the target storage. The data processing server is used to extract the target data from the target database. The target storage is used to store the target data stored by the IoT server.

[0022] In one implementation scenario, a serial communication line is provided between the IoT server and the data processing server, and information related to the target data is transmitted between the IoT server and the data processing server through the serial communication line. Alternatively, in other implementation scenarios, the IoT server and the data processing server may be integrated into the same server device.

[0023] Please combine Figure 1 See also Figure 2 , Figure 2 This is a flow chart of an implementation method of the data communication method of the present application. This implementation method uses the Internet of Things server in the data communication system as the execution subject, and the specific implementation process includes:

[0024] S101: Acquire target data collected by associated devices, and store the target data in a target memory.

[0025] In one embodiment, in response to the Internet of Things server being coupled to at least one associated device, the Internet of Things server acquires target data collected by the associated device and stores the target data in a target memory.

[0026] In one implementation scenario, the associated device includes different types of sensors, such as a temperature sensor, a humidity sensor, or a pressure sensor. In response to the wired connection between the associated device and the IoT server, the IoT server obtains the target data collected by the associated device through the connected line. Alternatively, the associated device may also be other, such as an image acquisition device or a video acquisition device. Alternatively, the associated device may also be other devices, and the target data is the data generated by the associated device during operation. Optionally, in other implementation scenarios, the IoT server and the associated device may also be connected wirelessly.

[0027] In one implementation scenario, the target storage is a SAS (Serial Attached SCSI) hard disk with a relatively high transmission rate. A SAS bus is provided between the IoT server and the target storage, so that the IoT server stores the target data in the target storage through the SAS bus.

[0028] In another embodiment, after acquiring the target data, the IoT server adds the unique target information that matches it to the target data, and stores the target data including the target information in the target memory.

[0029] In one implementation scenario, the target information of the IoT server is determined based on the IP address of the IoT server to distinguish it from other servers. Specifically, the IP address of the IoT server is encrypted according to a preset encryption method to obtain the target information.

[0030] S102: Generate data index information based on the target data; wherein the data index information is determined based on the storage address and storage scale of the target data.

[0031] In one embodiment, the IoT server generates corresponding data index information according to the target data while storing the acquired target data in the target memory.

[0032] Specifically, the storage address and storage size of the target data in the target memory are obtained, and the storage address and storage size are used as data index information, wherein the storage size is used to indicate the data volume of the target data.

[0033] In another embodiment, the generated data index information also includes the target information of the Internet of Things server, that is, when the Internet of Things server generates the data index information, the encrypted target information of the Internet of Things server is used as part of the data index information. By integrating the target information of the Internet of Things server into the data index information, a verification basis is provided for the subsequent data processing server to extract the target data, thereby improving the security of data communication.

[0034] S103: Send the data index information to the data processing server, so that the data processing server obtains the target data from the target storage through the data index information.

[0035] In one embodiment, the Internet of Things server sends the generated data index information to the data processing server, so that after the data processing server obtains the data index information, it obtains the target data from the target storage according to the data index information.

[0036] In one implementation scenario, in response to a serial communication line being set between the Internet of Things server and the data processing server, the Internet of Things server sends data index information to the data processing server through a communication protocol matching the serial communication line.

[0037] In another embodiment, the Internet of Things server may send the data index information to the data processing server in other ways, such as sending the data index information to the data processing server via a wireless network.

[0038] In another embodiment, before sending the data index information to the data processing server, the IoT server first determines whether the communication status between it and the data processing server is normal. If normal, the data index information is sent; otherwise, it is determined that the communication between it and the data processing server is interrupted and stops sending the data index information.

[0039] Specifically, the process of determining the communication status between the IoT server and the data processing server includes: the IoT server sends a keep-alive instruction to the data processing server in a preset manner; for example, the keep-alive instruction is sent to the data processing server through a serial communication line every preset time period. In addition, after receiving the keep-alive instruction, the data processing server sends a feedback instruction to the IoT server to indicate that the communication status between the IoT server and the data processing server is normal. If the data processing server does not send a feedback instruction within the preset time period, the communication between the IoT server and the data processing server is interrupted.

[0040] The data communication method proposed in the present application is that after the IoT server obtains the target data collected by the associated device, it stores the target data in the target memory and generates data index information based on the storage address and storage size of the target data in the target memory. The IoT server sends the data index information to the data processing server so that the data processing server extracts the target data from the target memory according to the data index information. This method avoids direct data communication between the IoT server and the data processing server, and improves the stability and security of data transmission.

[0041] See also Figure 3 , Figure 3 yes Figure 2 Step S101 in the flowchart corresponds to another embodiment. Specifically, after the IoT server acquires the target data, the specific implementation process of storing the target data in the target storage includes:

[0042] S201: Obtain storage permissions granted by the target storage.

[0043] In one embodiment, after acquiring the target data, the IoT server generates a storage request instruction and sends the storage request instruction to the target memory. In response to the target memory allowing data storage and granting storage authority to the IoT server, the IoT server stores the target data in the target memory according to the storage authority after acquiring the storage authority.

[0044] In another embodiment, in order to improve the security of the data processing server obtaining the target data from the target storage and prevent other servers from misappropriating the storage permission to perform malicious storage on the target storage, the storage request instruction generated by the Internet of Things server includes the target information of the Internet of Things server. Based on this, the storage permission generated by the target storage according to the storage request instruction includes the encrypted identity authentication information. When the Internet of Things server stores the target data according to the storage permission, the target storage verifies whether the identity authentication information in the storage permission provided by the Internet of Things server matches the target information of the Internet of Things server. If it matches, the Internet of Things server successfully stores the target data to the target storage; otherwise, the storage fails. Among them, the process of obtaining the target information of the Internet of Things server can refer to the corresponding embodiment above, and will not be elaborated in detail here.

[0045] S202: Based on the storage authority, store the target data into the target storage.

[0046] In one implementation, the IoT server stores the target data in the target storage according to the acquired storage permission.

[0047] In another embodiment, in response to the target memory including multiple storage modules, the storage permission further includes a recommended address, which is determined according to the storage conditions of different storage modules in the target memory. The IoT server stores the target data in the target memory according to the recommended address in the storage permission to improve the balance of data storage in the target memory.

[0048] In a specific implementation, based on the storage conditions of different storage modules, the storage modules with larger remaining storage space are preferentially used as the recommended addresses. Alternatively, all storage modules in the target memory are sorted in descending order of remaining storage space, and the obtained storage module sequence is used as the recommended address, so that the IoT server stores the target data or the data blocks obtained after the target data is split into corresponding storage modules in sequence according to the storage module sequence.

[0049] Please combine Figure 1 See also Figure 4 , Figure 4 yes Figure 2 Step S101 in the flowchart corresponds to another embodiment. Specifically, in response to the target memory including multiple storage modules, the specific implementation process of storing the target data in the target memory in any of the above embodiments may also include:

[0050] S301: Split target data into multiple data blocks and verification information matching the multiple data blocks.

[0051] In one embodiment, the target data is split into multiple data blocks and verification information matching the multiple data blocks. The verification information is used to characterize the association relationship between the multiple data blocks, and the remaining data blocks can be verified and restored through the verification information and some data blocks. By splitting the target data into multiple data blocks and verification information, the security of the target data storage is improved.

[0052] In one implementation scenario, the verification information may be a Hamming code.

[0053] S302: Store all data blocks and verification information in different storage modules.

[0054] In one implementation, in response to the target memory including a plurality of storage modules, all data blocks and check information corresponding to the target data are stored in different storage modules.

[0055] In another embodiment, according to the remaining storage space of each storage module in the target memory, the data block is preferentially stored in the storage module with the larger remaining storage space.

[0056] The above scheme stores the data blocks and verification information corresponding to the target data in different storage modules in the target memory, so that when some data blocks are lost or some storage modules in the target memory are damaged, resulting in the loss of some data blocks, the lost data blocks can be restored based on the remaining data blocks and verification information, thereby improving the security of the target data storage.

[0057] Furthermore, after all data blocks and verification information are stored in different storage modules, the method further includes: obtaining reference information that matches the data blocks and verification information respectively. Based on the reference information corresponding to the data blocks and verification information respectively, data index information is determined. The reference information includes at least one of a storage address and a storage size.

[0058] Specifically, the storage address and storage size of each data block in the target memory are obtained, and the storage address and storage size are used as reference information of the corresponding data block; similarly, the storage address and storage size of the verification information in the target memory are obtained, and used as reference information corresponding to the verification information. The reference information matching all data blocks and verification information corresponding to the target data is used as data index information, so that the subsequent data processing server can extract all data blocks and verification information from the target memory according to the data index information.

[0059] See also Figure 5 , Figure 5 This is a flow chart of another implementation of the data communication method of the present application. This implementation is based on the data processing server in the data communication system as the execution subject, and the specific implementation process includes:

[0060] S401: Obtain data index information sent by the Internet of Things server and the read permission granted by the target storage; wherein the data index information is determined based on the target data obtained by the Internet of Things server.

[0061] In one embodiment, the data processing server obtains the data index information sent by the Internet of Things server, generates a read request instruction based on the data index information, and sends the read request instruction to the target memory. In response to the target memory allowing data reading and granting the data processing server read permission, the data processing server extracts the target data from the target memory according to the read permission and the data index information after obtaining the read permission. The data index information is determined based on the target data obtained by the Internet of Things server, and the specific generation process can refer to the corresponding embodiment above, which will not be elaborated in detail here.

[0062] In one implementation scenario, in response to a serial communication line being set between the data processing server and the Internet of Things server, the data processing server obtains data index information sent by the Internet of Things server through the serial communication line.

[0063] In another embodiment, in response to the data index information also including target information, after obtaining the data index information, the data processing server generates a read request instruction according to the target information therein, and sends the read request instruction to the target memory. After obtaining the read request instruction, the target memory grants the data processing server corresponding read permission according to the target information therein. Among them, the read permission only supports the data processing server to read the target data stored in the Internet of Things server that matches the corresponding target information, thereby ensuring the security of other data stored in the target memory.

[0064] S402: Based on the data index information and the read permission, target data matching the data index information is extracted from the target database.

[0065] In one implementation, the data processing server extracts matching target data from the target database according to the acquired data index information and read permissions.

[0066] Specifically, in response to the data index information including the storage address and storage size matching the target data, the target data is acquired from the target storage based on the read permission, the storage address and the storage size.

[0067] In another embodiment, in response to the target data being split into multiple data blocks and verification information matching the multiple data blocks, and the acquired data index information includes reference information matching the data blocks and reference information matching the verification information, the data processing server acquires all data blocks and verification information from different storage modules of the target memory according to the reference information in the data index information, and obtains the target data according to all data blocks and verification information. The target data splitting process can refer to the above corresponding embodiment, and will not be elaborated in detail here.

[0068] In one implementation scenario, in response to the data processing server obtaining all corresponding data blocks and verification information according to the data index information, all data blocks are verified using the verification information to determine whether a data bit error occurs in the data block. If a data bit error occurs, the data processing server corrects the data in the corresponding data block according to the verification information, and obtains the target data according to all the corrected data blocks.

[0069] Furthermore, after the data processing server extracts the target data, it processes and analyzes the target data, wherein the processing and analysis methods include but are not limited to data operation and maintenance management and equipment operation status analysis.

[0070] See also Figure 6 , Figure 6This is a flow chart of an implementation method of the data communication method of the present application. To facilitate understanding of the data communication method proposed in the present application, the data communication method is described from the perspective of the Internet of Things server and the data processing server. The specific implementation process includes:

[0071] S501: The IoT server obtains target data collected by the associated device and stores the target data in a target storage.

[0072] In one embodiment, in response to the Internet of Things server being coupled to at least one associated device, the Internet of Things server acquires target data collected by the associated device and stores the target data in a target memory.

[0073] Among them, the specific process of the Internet of Things server obtaining the target data and the specific storage process of the target data can refer to the above-mentioned corresponding implementation methods, which will not be repeated here.

[0074] S502: The IoT server generates data index information based on the target data, and sends the data index information to the data processing server; wherein the data index information is determined based on the storage address and storage scale of the target data.

[0075] In one embodiment, the IoT server determines the storage address and storage size of the target data in the target memory while storing the acquired target data in the target memory, and uses the storage address and storage size as data index information. The storage size is used to indicate the data volume of the target data.

[0076] Furthermore, the Internet of Things server sends the generated data index information to the data processing server. The generation process and sending process of the data index information can refer to the above corresponding implementation mode.

[0077] S503: The data processing server obtains the data index information sent by the Internet of Things server and the read permission granted by the target storage.

[0078] In one embodiment, the data processing server obtains the data index information sent by the IoT server, generates a read request instruction according to the data index information, and sends the read request instruction to the target memory. In response to the target memory allowing data reading, the data processing server is granted read permission.

[0079] S504: The data processing server extracts target data matching the data index information from the target database based on the data index information and the read permission.

[0080] In one embodiment, in response to the data index information including the storage address and storage size matching the target data, the data processing server obtains the target data from the target storage according to the storage address and storage size.

[0081] Furthermore, the data processing server performs data processing and analysis for specific tasks based on the acquired target data.

[0082] See also Figure 7 , Figure 7 1 is a schematic diagram of the structure of an embodiment of an electronic device of the present application. The electronic device comprises: a memory 10 and a processor 20 coupled to each other. The memory 10 stores program instructions, and the processor 20 is used to execute the program instructions to implement the data communication method mentioned in any of the above embodiments. Specifically, the electronic device includes but is not limited to: a desktop computer, a laptop computer, a tablet computer, a server, etc., which are not limited here. In addition, the processor 20 can also be called a CPU (Center Processing Unit). The processor 20 may be an integrated circuit chip with signal processing capabilities. The processor 20 may also be a general-purpose processor, a digital signal processor (Digital Signal Processor, DSP), an application-specific integrated circuit (Application Specific Integrated Circuit, ASIC), a field-programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc. In addition, the processor 20 may be implemented by an integrated circuit chip.

[0083] See also Figure 8 , Figure 8 It is a structural diagram of an embodiment of a storage device of the present application. The storage device 30 stores program instructions 40 that can be executed by a processor. When the program instructions 40 are executed by the processor, the data communication method mentioned in any of the above embodiments is implemented.

[0084] In the several embodiments provided in the present application, it should be understood that the disclosed methods and devices can be implemented in other ways. For example, the device implementation described above is only schematic. For example, the division of modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, and the indirect coupling or communication connection of devices or units can be electrical, mechanical or other forms.

[0085] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0086] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0087] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) or a processor to execute all or part of the steps of each implementation method of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program code.

[0088] The above description is only an implementation method of the present application, and does not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly used in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A data communication method, characterized in that: The data communication method is applied to an Internet of Things server, comprising: Acquire target data collected by the associated device, add target information matched by the IoT server to the target data, and store the target data including the target information in a target memory; wherein the target information is determined based on the IP address of the IoT server; Based on the target data, generate data index information; wherein the data index information is determined based on the storage address and storage scale of the target data, and the data index information includes target information of the Internet of Things server; Sending the data index information to a data processing server, so that the data processing server obtains the target data from the target storage through the data index information; Among them, sending the data index information to the data processing server includes: in response to a serial communication line being set between the Internet of Things server and the data processing server, sending the data index information to the data processing server through the serial communication line.

2. The method according to claim 1, characterized in that The storing the target data including the target information into the target memory comprises: Obtaining storage permissions granted by the target storage; Based on the storage permission, the target data is stored in the target storage.

3. The method according to claim 1, characterized in that In response to the target memory comprising a plurality of storage modules, storing the target data including the target information into the target memory comprises: Splitting the target data into a plurality of data blocks and verification information matching the plurality of data blocks; All the data blocks and the verification information are stored in different storage modules.

4. The method according to claim 3, characterized in that The step of generating data index information based on the target data includes: Acquire reference information that matches the data block and the verification information respectively; wherein the reference information includes at least one of a storage address and a storage size; The data index information is determined based on the reference information respectively corresponding to the data block and the verification information.

5. A data communication method, characterized in that: The data communication method is applied to a data processing server, comprising: Obtaining data index information sent by the Internet of Things server and the read permission granted by the target storage; wherein the data index information is determined based on the target data obtained by the Internet of Things server; Based on the data index information and the read permission, extracting the target data matching the data index information from the target storage; Wherein, in response to the data index information including the target information of the Internet of Things server, after obtaining the data index information, it includes: generating a read request instruction according to the target information, and sending the read request instruction to the target memory; wherein the target information is determined based on the IP address of the Internet of Things server; Wherein, the obtaining of the data index information sent by the Internet of Things server comprises: in response to a serial communication line being provided between the data processing server and the Internet of Things server, obtaining the data index information sent by the Internet of Things server through the serial communication line; Wherein, extracting the target data matching the data index information from the target memory based on the data index information and the read permission includes: in response to the data index information including a storage address and a storage scale matching the target data, obtaining the target data from the target memory based on the read permission, the storage address and the storage scale.

6. An electronic device, characterized in that: It comprises a memory and a processor coupled to each other, wherein the memory stores program instructions, and the processor is used to execute the program instructions to implement the data communication method according to any one of claims 1 to 5.

7. A storage device, characterized in that: Program instructions that can be executed by a processor are stored, and the program instructions are used to implement the data communication method according to any one of claims 1 to 5.

Images