Data interaction method and device, equipment and storage medium

Abstract

The application provides a data interaction method, device and equipment and a storage medium, the method comprising: obtaining to-be-transmitted data; storing the to-be-transmitted data in a data folder corresponding to a data type according to the data type of the to-be-transmitted data; packaging the data folder to obtain a data package; storing the data package in a CD; and transmitting the data package into a data receiving end by the CD, so that the data receiving end analyzes the data package, and stores to-be-transmitted data obtained after analysis in a preset data set. The application can solve the technical problem of how to transmit data in a physically isolated or poor network quality environment while ensuring that the data is not garbled, repeated or lost, thereby improving the data transmission reliability in a harsh environment.

Description

Technical Field

[0001] This invention relates to the field of data transmission technology, and in particular to a data interaction method, apparatus, device, and storage medium. Background Technology

[0002] Data exchange has become a fundamental technological means in the information age. However, in some special environments, data transmission can still be difficult, such as in mountainous areas with poor network conditions, areas affected by natural disasters such as floods, fires, and avalanches that may disrupt network access, and environments with physical network isolation.

[0003] In these harsh environments, internet transmission cannot be used normally, and common data exchange methods, such as importing and exporting data via Excel, are prone to problems such as formatting issues, data duplication, and data loss, making reliable transmission difficult and affecting the speed and quality of information sending and receiving. Summary of the Invention

[0004] To address the problems existing in the prior art, embodiments of the present invention provide a data interaction method, apparatus, device, and storage medium.

[0005] This invention provides a data interaction method, comprising:

[0006] Get the data to be transmitted;

[0007] According to the data type of the data to be transmitted, the data to be transmitted is stored in the data folder corresponding to the data type;

[0008] The data folder is packaged to obtain a data package;

[0009] The data packet is stored in a recordable disc; the recordable disc is used to transmit the data packet to the data receiving end, so that the data receiving end can parse the data packet and store the parsed data to be transmitted into a preset dataset.

[0010] According to a data interaction method provided by the present invention, the step of storing the data to be transmitted into a data folder corresponding to the data type includes:

[0011] If the data type is structured data, then the data to be transmitted will be stored in the structured data folder.

[0012] A data interaction method provided by the present invention further includes:

[0013] If the data type is unstructured data, then the data to be transmitted will be stored in the unstructured data folder.

[0014] According to a data interaction method provided by the present invention, after packaging the data folder to obtain a data packet, the method further includes:

[0015] The data packet is encrypted according to a preset encryption algorithm;

[0016] The data receiving end is further configured to, after receiving the encrypted data packet, decrypt and unpack the encrypted data packet sequentially to obtain the data to be transmitted, and store the data to be transmitted into the preset dataset.

[0017] According to a data interaction method provided by the present invention, the step of packaging the data folder to obtain a data package includes:

[0018] The data folder is packaged according to a preset standard specification to obtain the data package; the preset standard specification includes one or more of the following: version number, system identifier, data usage description, source table information and target table information, source field information and target field information, and import conditions.

[0019] According to a data interaction method provided by the present invention, storing the data to be transmitted in an unstructured data folder includes:

[0020] The data to be transmitted is stored in the unstructured data folder according to the user-defined directory.

[0021] The present invention also provides a data interaction device, comprising:

[0022] The data acquisition module is used to acquire the data to be transmitted.

[0023] The data classification module is used to store the data to be transmitted into a data folder corresponding to the data type according to the data type of the data to be transmitted;

[0024] The data packaging module is used to package the data folder to obtain a data package;

[0025] The data recording module stores the data packet into a recording disc; the recording disc is used to transmit the data packet to the data receiving end, so that the data receiving end can parse the data packet and store the parsed data to be transmitted into a preset dataset.

[0026] The present invention also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the data interaction method as described above.

[0027] The present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the data interaction method as described above.

[0028] The present invention also provides a computer program product, including a computer program that, when executed by a processor, implements the data interaction method as described above.

[0029] The data interaction method, apparatus, device, and storage medium provided by this invention can solve the technical problem of how to transmit data in environments with physical isolation or poor network quality by classifying and storing the data to be transmitted, packaging it, and then carrying it to the target server via a recordable disc. This ensures that the data is not garbled, duplicated, or lost, and improves the reliability of data transmission in harsh environments. Attached Figure Description

[0030] To more clearly illustrate the technical solutions in this invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this invention. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.

[0031] Figure 1 This is a schematic diagram of the application environment of the data interaction method provided by the present invention;

[0032] Figure 2 This is one of the flowcharts illustrating the data interaction method provided by the present invention;

[0033] Figure 3 This is the second flowchart illustrating the data interaction method provided by the present invention;

[0034] Figure 4 This is a schematic diagram of the functional modules of the data interaction method provided by the present invention;

[0035] Figure 5 This is a schematic diagram of the structure of the data interaction device provided by the present invention;

[0036] Figure 6 This is a schematic diagram of the structure of the electronic device provided by the present invention. Detailed Implementation

[0037] To make the objectives, technical solutions, and advantages of this invention clearer, the technical solutions of this invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this invention. All other embodiments obtained by those skilled in the art based on the embodiments of this invention without creative effort are within the scope of protection of this invention.

[0038] It should be noted that in the description of the embodiments of the present invention, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element. The terms "upper," "lower," etc., indicating orientation or positional relationships based on the orientation or positional relationships shown in the accompanying drawings, are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of the present invention. Unless otherwise expressly specified and limited, the terms "installed," "connected," and "linked" should be interpreted broadly, for example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; they can refer to the internal communication of two elements. Those skilled in the art can understand the specific meaning of the above terms in this invention according to the specific circumstances.

[0039] The terms "first," "second," etc., used in this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class, without limiting the number of objects; for example, a first object can be one or more. Furthermore, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects have an "or" relationship.

[0040] The following is combined Figures 1-6 Description of the present invention

[0041] The data interaction method provided in this application embodiment can be applied to, for example... Figure 1In the application environment shown, servers 101 and 102 are physically isolated, or the network quality between them is insufficient to meet the needs of real-time data transmission. The data storage system can store the data that servers 101 or 102 need to process. The data storage system can be integrated onto server 101 or server 102, or it can be located on a cloud or other network server. Server 101 or server 102 can be implemented using a standalone server or a server cluster consisting of multiple servers.

[0042] In one embodiment, such as Figure 2 As shown, a data interaction method is provided, which can be applied to... Figure 1 Taking server 101 as an example, the explanation includes the following steps:

[0043] Step 201: Obtain the data to be transmitted;

[0044] The data to be transmitted refers to the data that the user needs to transfer from the data storage system of server 101 to other storage systems. The data to be transmitted can be data in any format.

[0045] Specifically, server 101 obtains the data that the user needs to transmit;

[0046] Optionally, server 101 may, in response to a user's data selection instruction, extract the data to be transmitted from the data storage system according to the user's data configuration rules.

[0047] Step 202: Based on the data type of the data to be transmitted, store the data to be transmitted into the data folder corresponding to that data type.

[0048] Here, data type refers to the category to which the data belongs. In this invention, data type can be structured data or unstructured data.

[0049] Specifically, the data to be transmitted is stored in the corresponding data folder based on its data type. For example, if the data to be transmitted is structured data, it is stored in the structured data folder; if it is unstructured data, it is stored in the unstructured data folder.

[0050] Step 203: Package the above data folder to obtain a data package;

[0051] Packetization, also known as data packetization, refers to mapping business data into the payload of a specific encapsulation protocol, filling in the corresponding protocol header to form a data packet, and completing rate adaptation. When transmitting data between different devices over a network, in order to reliably and accurately deliver it to the destination, it is also necessary to append the destination address, local address, and some error correction bytes to the transmitted data packet.

[0052] Specifically, server 101 encapsulates and packages the aforementioned data folder according to a certain encapsulation protocol to obtain data packets; for example, it compresses the data to obtain compressed packages (such as ZIP packages).

[0053] Furthermore, during the data packaging process, data can be added or deleted; files can also be added or deleted, including file paths and file names.

[0054] Step 204: Store the data packet into a recordable disc; the recordable disc is used to transmit the data packet to the data receiving end so that the data receiving end can parse the data packet and store the parsed data to be transmitted into a preset dataset.

[0055] In this context, a recordable disc is a data carrier, such as an optical disc. Typically, a recordable disc can be a one-time recordable disc or a rewritable recordable disc. The data receiving end refers to the target storage system from which the user needs to input data, and the preset dataset refers to the dataset on the local database of the data receiving end.

[0056] Specifically, server 101 burns the aforementioned data packets onto a recording disc. This recording disc can be carried to server 102 by a person, and the data packets within it are passed to a data receiving end (e.g., server 102). The data receiving end parses the data packets and, based on the destination address or other data storage rules in the data packets, stores the parsed data to be transmitted into the corresponding preset dataset.

[0057] The above embodiments, by classifying and storing the data to be transmitted, packaging it, and then carrying it to the target server via a CD, can solve the technical problem of accurate transmission without garbled characters, duplication, or loss in environments with physical isolation or poor network quality, thereby improving the reliability of data transmission in harsh environments.

[0058] In one embodiment, step 202 above further includes: if the data type is structured data, then storing the data to be transmitted in a structured data folder.

[0059] Structured data refers to data that is logically expressed and implemented using a two-dimensional table structure, strictly adhering to data format and length specifications. It is mainly stored and managed through relational databases, typically data with row or column structures.

[0060] Specifically, such as Figure 3 As shown, Figure 3 The flowchart illustrates the process of classifying and storing data. First, it determines whether the data to be transmitted is structured data. If it is structured data, it is stored in a structured data folder. Generally, this structured data folder contains SQLite files.

[0061] In the above embodiment, by identifying structured data in the data to be transmitted and storing the structured data in a preset folder, this embodiment can store the data to be transmitted according to a certain storage structure to avoid garbled characters or loss during transmission.

[0062] In one embodiment, step 202 further includes: if the data type is unstructured data, then the data to be transmitted is stored in an unstructured data folder.

[0063] Unstructured data refers to data with irregular or incomplete data structures, without a predefined data model, and that is inconvenient to represent using a two-dimensional logical table in a database. It includes all formats of office documents, text, images, HTML (Hyper Text Markup Language), various reports, images, and audio or video information, etc.

[0064] Specifically, if the data to be transmitted is determined to be unstructured data, then the data to be transmitted will be stored in the unstructured data folder.

[0065] Optionally, the aforementioned unstructured data folder can provide directory customization capabilities. That is, the server 101 can store the data to be transmitted into the unstructured data folder according to the user-defined directory, further standardizing the storage of unstructured data.

[0066] Furthermore, such as Figure 4 As shown, Figure 4 This embodiment illustrates a functional module diagram of a data interaction method. A Software Development Kit (SDK) is stored at both the data sending and receiving ends. The data sending end also provides a structured data description interface, which includes a category management module, a resource management module, and an attribute management module. The category management module is used for adding, deleting, modifying, and querying structured data categories. The resource management module's fields include the resource name and remarks of data resources; this module is used for adding, deleting, modifying, and querying data resources. The attribute management module's fields include the attribute name, type, and remarks of data attributes; this module is used for adding, deleting, modifying, and querying data attributes.

[0067] The above embodiments, by identifying structured data in the data to be transmitted and storing the structured data in a preset folder, can avoid garbled characters or data loss during transmission.

[0068] In one embodiment, after step 203 above, the method further includes: encrypting the data packet according to a preset encryption algorithm; the data receiving end is further configured to, after receiving the encrypted data packet, decrypt and unpack the encrypted data packet in sequence to obtain the data to be transmitted, and store the data to be transmitted in the preset dataset.

[0069] Specifically, after packaging the data folder containing the data to be transmitted, the packaged data packet can be encrypted using a preset encryption algorithm. The encryption algorithm can be flexibly selected according to the user's needs, such as using a symmetric encryption algorithm or an asymmetric encryption algorithm. Furthermore, after receiving the encrypted data packet, the data receiving end decrypts and unpacks the encrypted data packet sequentially to obtain the data to be transmitted, and stores the data to be transmitted in a preset dataset.

[0070] The above embodiments improve data security during transmission by using preset encryption and decryption algorithms to encrypt and decrypt data packets.

[0071] In one embodiment, step 203 includes: packaging the data folder according to a preset standard specification to obtain a data package; the preset standard specification includes one or more of the following: version number, system identifier, data usage description, source table information and target table information, source field information and target field information, and import conditions.

[0072] The preset standard specification is a data description file, which can be in XML or JSON format, and is used to specify the specific standards used for data packaging.

[0073] Specifically, based on the data selection conditions configured by the user in the data configuration interface, the server 101 extracts the user-configured data to be transmitted from the data resources. The server 101 packages the extracted data to be transmitted according to the aforementioned preset standard specifications, which include one or more of the following: version number, system identifier, data usage description, source table information and target table information, source field information and target field information, and import conditions.

[0074] The above embodiments, by setting preset standard specifications, can package the data to be transmitted according to certain standard specifications, further ensuring the reliability of data transmission and avoiding garbled characters.

[0075] The data interaction device provided by the present invention is described below. The data interaction device described below and the data interaction method described above can be referred to in correspondence.

[0076] In one embodiment, such as Figure 5 As shown, a data interaction device is provided, including: a data acquisition module 501, a data classification module 502, a data packaging module 503, and a data recording module 504, wherein,

[0077] Data acquisition module 501 is used to acquire data to be transmitted;

[0078] The data classification module 502 is used to store the data to be transmitted into a data folder corresponding to the data type according to the data type of the data to be transmitted;

[0079] The data packaging module 503 is used to package the data folder to obtain a data package;

[0080] The data recording module 504 stores the data packet into a recording disk; the recording disk is used to transmit the data packet to the data receiving end, so that the data receiving end can parse the data packet and store the parsed data to be transmitted into a preset dataset.

[0081] In one embodiment, the data classification module 502 is further configured to: if the data type is structured data, store the data to be transmitted in a structured data folder.

[0082] In one embodiment, the data classification module 502 is further configured to: if the data type is unstructured data, store the data to be transmitted in an unstructured data folder.

[0083] In one embodiment, the system further includes a data encryption unit for encrypting the data packet according to a preset encryption algorithm;

[0084] The data decryption unit, located at the data receiving end, is used to decrypt the encrypted data packet after receiving it.

[0085] In one embodiment, the data packaging module 503 is further configured to: package the data folder according to a preset standard specification to obtain the data package; the preset standard specification includes one or more of the following: version number, system identifier, data usage description, source table information and target table information, source field information and target field information, and import conditions.

[0086] In one embodiment, the data classification module 502 is further configured to: store the data to be transmitted into the unstructured data folder according to a user-defined directory.

[0087] Figure 6 An example is a schematic diagram of the physical structure of an electronic device, such as... Figure 6As shown, the electronic device may include a processor 610, a communications interface 620, a memory 630, and a communication bus 640. The processor 610, communications interface 620, and memory 630 communicate with each other via the communication bus 640. The processor 610 can call logical instructions in the memory 630 to execute a data interaction method. This method includes: acquiring data to be transmitted; storing the data to be transmitted into a data folder corresponding to the data type; packaging the data folder to obtain a data packet; storing the data packet into a recording disc; the recording disc is used to transmit the data packet to a data receiving end for the data receiving end to parse the data packet and store the parsed data to be transmitted into a preset dataset.

[0088] Furthermore, the logical instructions in the aforementioned memory 630 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, essentially, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0089] On the other hand, the present invention also provides a computer program product, which includes a computer program that can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the data interaction method provided by the above methods. The method includes: acquiring data to be transmitted; storing the data to be transmitted into a data folder corresponding to the data type according to the data type of the data to be transmitted; packaging the data folder to obtain a data packet; storing the data packet into a recordable disc; the recordable disc is used to transmit the data packet to a data receiving end for the data receiving end to parse the data packet and store the parsed data to be transmitted into a preset dataset.

[0090] In another aspect, the present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon. When executed by a processor, the computer program implements the data interaction method provided by the above methods. The method includes: acquiring data to be transmitted; storing the data to be transmitted into a data folder corresponding to the data type according to the data type of the data to be transmitted; packaging the data folder to obtain a data packet; storing the data packet into a recordable disc; the recordable disc is used to transmit the data packet to a data receiving end for the data receiving end to parse the data packet and store the parsed data to be transmitted into a preset dataset.

[0091] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0092] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.

[0093] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A data interaction method, characterized in that, include: Get the data to be transmitted; According to the data type of the data to be transmitted, the data to be transmitted is stored in the data folder corresponding to the data type; Specifically, this includes: if the data type is structured data, then the data to be transmitted is stored in a structured data folder; the structured data folder is a SQLite file; if the data type is unstructured data, then the data to be transmitted is stored in an unstructured data folder; wherein, the structured data and the unstructured data are stored according to their respective directory structures. The data folder is packaged as a whole to obtain a data package; specifically, this includes: packaging the data folder according to a preset standard specification to obtain the data package; the preset standard specification includes one or more of the following: version number, system identifier, data usage description, source table information and target table information, source field information and target field information, and import conditions; wherein, the directory structure presented after unpacking the data package is a predetermined directory structure; the predetermined directory structure includes both structured data and unstructured data following their respective corresponding directory structures; The data packet is stored in a disc; the disc is used to transmit the data packet to the data receiving end, so that the data receiving end can automatically parse and classify the data packet based on the predetermined directory structure, and store the parsed data to be transmitted into a preset dataset.

2. The data interaction method of claim 1, wherein, After packaging the data folder into a data package, the process also includes: The data packet is encrypted according to a preset encryption algorithm; The data receiving end is further configured to, after receiving the encrypted data packet, decrypt and unpack the encrypted data packet sequentially to obtain the data to be transmitted, and store the data to be transmitted into the preset dataset.

3. The data interaction method of claim 1, wherein, The step of storing the data to be transmitted into an unstructured data folder includes: The data to be transmitted is stored in the unstructured data folder according to the user-defined directory.

4. A data interaction device, characterized by The device includes: The data acquisition module is used to acquire the data to be transmitted. The data classification module is used to store the data to be transmitted into a data folder corresponding to the data type, based on the data type of the data to be transmitted. Specifically, it includes: if the data type is structured data, then the data to be transmitted is stored in a structured data folder; the structured data folder is a SQLite file; if the data type is unstructured data, then the data to be transmitted is stored in an unstructured data folder; wherein, both the structured data and the unstructured data are stored according to their respective directory structures. The data packaging module is used to package the data folder as a whole to obtain a data package; specifically, it includes: packaging the data folder according to a preset standard specification to obtain the data package; the preset standard specification includes one or more of the following: version number, system identifier, data usage description, source table information and target table information, source field information and target field information, and import conditions; wherein, the directory structure presented after the data package is unpacked is the predetermined directory structure; the predetermined directory structure includes both structured data and unstructured data following their respective corresponding directory structures; The data recording module stores the data packet into a recording disk; the recording disk is used to transmit the data packet to the data receiving end, so that the data receiving end can automatically parse and classify the data packet based on the predetermined directory structure, and store the parsed data to be transmitted into a preset dataset.

5. An electronic device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that, When the processor executes the program, it implements the data interaction method as described in any one of claims 1 to 3. 6.A non-transitory computer-readable storage medium having stored thereon a computer program, characterized in that, When the computer program is executed by a processor, it implements the data interaction method as described in any one of claims 1 to 3.

7. A computer program product comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the data interaction method as described in any one of claims 1 to 3.

Images