Target data processing method and device

By using dynamic and static streamlined mapping tables for streamlined encoding and decoding in an information system, the problem of incomplete and unreliable data transmission under narrowband communication conditions is solved, and more efficient and reliable data transmission is achieved.

CN119420817APending Publication Date: 2025-02-11NO 15 INST OF CHINA ELECTRONICS TECH GRP

Patent Information

Application Number
CN202411336587.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-25
Publication Date
2025-02-11

AI Technical Summary

Technical Problem

In existing information systems, the string pattern with conventional character-separated characters and the string structure pattern of JSON format are likely to cause messages to be blocked or packet loss under narrowband communication conditions, and data integrity and reliability are difficult to guarantee.

Method used

Simplified encoding and decoding are performed to optimize the data transmission process by using dynamic streamlined mapping tables and static streamlined mapping tables corresponding to dynamic metadata and static metadata on the sending and receiving ends.

Benefits of technology

It effectively reduces the storage space of data during transmission, improves the integrity and reliability of data, reduces the time for data mapping and search, supports high concurrent message processing for multiple devices, and improves the number of device access concurrency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119420817A_ABST
    Figure CN119420817A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of informatization, in particular to a target data processing method and device, and the method comprises the steps: taking dynamic metadata and a dynamic simplification mapping table corresponding to the dynamic metadata as parameters through a transmitting end, and transmitting the parameters to a first simplification coding and decoding program; performing simplified coding on the dynamic metadata, the dynamic simplified mapping table, the static mapping table and the protocol format through a first simplified coding and decoding program to obtain coded data; sending the coded data and protocol data corresponding to the coded data to a receiving end through a sending end; after the receiving end receives the coded data, the coded data and the dynamic simplified mapping table are sent to a second simplified coding and decoding program through the receiving end; and decoding the data formats of the coded data, the dynamic simplification mapping table, the static simplification mapping table and the protocol data corresponding to the coded data through a second simplification coding and decoding program to obtain decoded data, and the method can improve the integrity of the data and the efficiency of reliability data matching.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of information technology, and in particular to a target data processing method and device. Background Art

[0002] With the continuous development of modern computer information technology, data and information exchanges in various fields are becoming more frequent, and the strategies for streamlining communication data are also constantly developing and improving, providing strong support for achieving efficient storage and transmission.

[0003] When the information system is deployed, each deployment node is in a different physical space, and the communication between nodes mainly includes conventional communication means and unconventional communication means (i.e. narrowband communication means). The information transmission in different physical spaces mainly relies on the stable conventional wired network environment communication means. When the conventional communication network environment is destroyed, it is necessary to switch to unconventional communication means, i.e. narrowband communication means.

[0004] In existing information systems, most of them use string patterns separated by agreed characters or string structure patterns in JSON format as data communication protocols, but both technologies have some defects.

[0005] When using a string pattern separated by agreed characters as the protocol format, the selection of agreed characters is a pain point. Generally, rarely used characters are used as separators. However, due to the complexity of data in the information system, it is difficult to ensure that the business data does not contain the separators agreed upon during system design, which causes the problem that the business data cannot be accurately expressed. In addition, the total length of some special field values ​​in the protocol data cannot be limited, which makes the protocol data occupy a large amount of data space. Under high concurrency conditions of narrowband communication, message congestion or packet loss is prone to occur, which leads to incomplete and unreliable protocol data.

[0006] When using the JSON string structure pattern as the protocol format, since the data in the JSON format is based on the key-value pattern, the existence of the key value occupies a large amount of data space. Although it improves the readability and accuracy of the business data, it also increases a large amount of redundant information in the transmission state, making the protocol data occupy a larger data space than the first protocol format. It also leads to message congestion or packet loss under narrowband communication conditions, and the data integrity and reliability are unlikely to be guaranteed.

[0007] In view of this, how to provide a streamlined strategy encoding and decoding method for a custom data protocol to improve the integrity and reliability of data during transmission has become a technical problem that urgently needs to be solved. Summary of the invention

[0008] The embodiments of the present application provide a target data processing method, a target data processing device, an electronic device and a computer storage medium, which are used to solve the problems of incomplete data and poor transmission reliability in the current data transmission process.

[0009] In a first aspect of an embodiment of the present application, a target data processing method is provided, comprising:

[0010] The dynamic metadata and the dynamic simplified mapping table corresponding to the dynamic metadata are sent as parameters to the first simplified codec program through the sending end, wherein the static metadata of the sending end and the receiving end of the control system are kept consistent;

[0011] The dynamic metadata, the dynamic simplified mapping table, the static mapping table and the protocol format are simplified and encoded by the first simplified encoding and decoding program to obtain encoded data;

[0012] Sending the coded data and the protocol data corresponding to the coded data to the receiving end through the sending end;

[0013] After the receiving end receives the coded data, the coded data and the dynamic simplified mapping table are sent to a second simplified coding and decoding program through the receiving end;

[0014] The second simplified encoding and decoding program decodes the data formats of the encoded data, the dynamic simplified mapping table, the static simplified mapping table, and the protocol data corresponding to the encoded data to obtain decoded data.

[0015] Optionally, the method for generating the dynamic simplified mapping table includes:

[0016] After the first simplified codec program receives the dynamic metadata, a first hash dictionary table is generated using a first field name and a first field content corresponding to the dynamic metadata as a key value and a unique mapping code corresponding to the first field content as a value value, wherein the dynamic metadata is a change in a value corresponding to the metadata obtained based on a change in data requirements when the system is running;

[0017] A dynamic reduced mapping table is generated based on the first hash dictionary table.

[0018] Optionally, the method for generating the static simplified mapping table includes:

[0019] After the first simplified codec program receives the static metadata, a second hash dictionary table is generated using the second field name and the second field content corresponding to the static metadata as the key value and the unique mapping code corresponding to the second field content as the value value, wherein the static metadata is metadata that does not change when the system is running;

[0020] Based on the second Hash dictionary table, a static simplified mapping table is generated.

[0021] In a second aspect of an embodiment of the present application, a target data processing device is provided, including:

[0022] A first sending module is configured to send the dynamic metadata and the dynamic simplified mapping table corresponding to the dynamic metadata as parameters to the first simplified codec program through the sending end, wherein the static metadata of the sending end and the receiving end in the control system are kept consistent;

[0023] The encoding module is configured to perform simplified encoding on the dynamic metadata, the dynamic simplified mapping table, the static mapping table and the protocol format through the first simplified encoding and decoding program to obtain encoded data;

[0024] A second sending module is configured to send the coded data and the protocol data corresponding to the coded data to the receiving end through the sending end;

[0025] A third transmitting module is configured to send the encoded data and the dynamic simplified mapping table to a second simplified codec program through the receiving end after the receiving end receives the encoded data;

[0026] The decoding module is configured to decode the data format of the encoded data, the dynamic simplified mapping table, the static simplified mapping table and the protocol data corresponding to the encoded data through the second simplified encoding and decoding program to obtain decoded data.

[0027] According to a third aspect of an embodiment of the present application, a computing device is provided, including:

[0028] Memory and processor;

[0029] The memory is used to store computer executable instructions, and the processor is used to execute the computer executable instructions. When the computer executable instructions are executed by the processor, the steps of the above-mentioned target data processing method are implemented.

[0030] According to a fourth aspect of an embodiment of the present application, a computer-readable storage medium is provided, which stores computer-executable instructions, and when the instructions are executed by a processor, the steps of the above-mentioned target data processing method are implemented.

[0031] The present application provides a target data processing method, comprising: first, through a sending end, dynamic metadata and a dynamic simplified mapping table corresponding to the dynamic metadata are sent as parameters to a first simplified coding and decoding program, wherein the static metadata of the sending end and the receiving end in the control system are kept consistent; then, through the first simplified coding and decoding program, the dynamic metadata, the dynamic simplified mapping table, the static mapping table and the protocol format are simplified and encoded to obtain encoded data; secondly, through the sending end, the encoded data and the protocol data corresponding to the encoded data are sent to a receiving end; thirdly, after the receiving end receives the encoded data, the encoded data and the dynamic simplified mapping table are sent to a second simplified coding and decoding program through the receiving end; finally, through the second simplified coding and decoding program, the data format of the encoded data, the dynamic simplified mapping table, the static simplified mapping table and the protocol data corresponding to the encoded data are decoded to obtain decoded data.

[0032] The target processing method provided by the embodiment of the present application can effectively reduce the storage space of data during the transmission process and improve the integrity and reliability of data during the transmission process; at the same time, it can reduce the data mapping search time and improve the efficiency of data matching; support high-concurrency message processing of multiple devices and increase the number of concurrent device accesses, so that the message proxy server can receive data sent by more devices with less time, so that it can run efficiently and stably, and messages can be reliably transmitted at high concurrency.

[0033] The above description is only an overview of the technical solution of the present application. In order to more clearly understand the technical means of the present application, which can be implemented in accordance with the contents of the specification, and in order to make the above and other purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] Various other advantages and benefits will become apparent to those of ordinary skill in the art by reading the detailed description of the preferred embodiments below. The accompanying drawings are only for the purpose of illustrating the preferred embodiments and are not to be considered as limiting the present application. Also, the same reference symbols are used throughout the accompanying drawings to represent the same components. In the accompanying drawings:

[0035] Figure 1 A flowchart of a target data processing method provided in an embodiment of the present application;

[0036] Figure 2 A schematic diagram of a dynamically simplified mapping table in a target data processing method provided in an embodiment of the present application;

[0037] Figure 3A schematic diagram of a static simplified mapping table in a target data processing method provided in an embodiment of the present application;

[0038] Figure 4 A schematic diagram of the composition of a static simplified mapping table of a target data processing method provided in an embodiment of the present application;

[0039] Figure 5 A schematic diagram of the structure of a target data processing device provided in an embodiment of the present application;

[0040] Figure 6 A structural block diagram of a computing device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0041] The exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0042] The present application provides a simplified strategy encoding and decoding method for a custom data protocol. The method is designed to reduce the data space occupied by protocol data information, and is used for data transmission between command posts in different physical spaces under narrowband communication conditions, thereby improving the integrity and reliability of data during transmission, and is applicable to low-bandwidth network environments and devices with low processing capabilities.

[0043] See also Figure 1 , Figure 1 A flowchart of a target data processing method provided in an embodiment of the present application is shown in FIG. Figure 1 As shown, the specific steps include the following steps.

[0044] Step S102: Through the sending end, the dynamic metadata and the dynamic simplified mapping table corresponding to the dynamic metadata are sent as parameters to the first simplified encoding and decoding program, wherein the static metadata of the sending end and the receiving end in the command and control system are consistent; it should be noted that the command and control system is deployed at multiple deployment points and ensures the consistency of dynamic metadata at the database level (static metadata has ensured data consistency during system design).

[0045] Step S104: The dynamic metadata, the dynamic simplified mapping table, the static mapping table and the protocol format are simplified and encoded by the first simplified encoding and decoding program to obtain encoded data;

[0046] Step S106: sending the coded data and the protocol data corresponding to the coded data to the receiving end through the sending end;

[0047] Step S108: after the receiving end receives the coded data, the receiving end sends the coded data and the dynamic simplified mapping table to a second simplified coding and decoding program;

[0048] Step S110: decoding the data format of the encoded data, the dynamic simplified mapping table, the static simplified mapping table, and the protocol data corresponding to the encoded data through the second simplified encoding and decoding program to obtain decoded data.

[0049] After obtaining the decoded data, the receiving end performs subsequent service processing based on the obtained decoded data.

[0050] Aiming at the defects of the string mode separated by agreed characters and the string structure mode in JSON format, considering the advantages of these two protocol modes and based on the characteristics of data consistency in the information field system, this paper proposes two streamlining optimization methods: dynamic streamlining mapping table and static streamlining mapping table.

[0051] In an embodiment of the present application, the method for generating the dynamic simplified mapping table includes: after a first simplified encoding and decoding program receives dynamic metadata, a first field name and a first field content corresponding to the dynamic metadata are used as key values, and a unique mapping code corresponding to the first field content is used as a value value to generate a first hash dictionary table, wherein the dynamic metadata is a change in the value corresponding to the metadata based on changes in data requirements when the system is running; and a dynamic simplified mapping table is generated based on the first hash dictionary table.

[0052] In actual applications, the mapping table is dynamically simplified. After obtaining the dynamic metadata in the system (the metadata value changes as the data requirements change during system operation, but the metadata values ​​of the sender and the receiver are consistent), because the field name is unique in the protocol and the field content is also unique relative to the current field name, "field name@field content" is used as the key value (if the rule still does not meet the uniqueness in other systems, it can be further expanded, for example: "table name@field name@field content"), and the unique mapping code corresponding to the field content is used as the value value to form a hash dictionary table (that is, the dynamic simplified mapping table) as a parameter to pass in, which is used to simplify the encoding of the data by the codec program.

[0053] See also Figure 2 , Figure 2 A schematic diagram of a dynamically simplified mapping table in a target data processing method provided in an embodiment of the present application.

[0054] like Figure 2As shown, t_bm is the table name of the department table, bmId is the department Id field (primary key) of the department table, bmName is the department name field of the department table, uuid1 and uuid2 are the values ​​of the bmId field of the department table, and bm1 and bm2 are the values ​​of the bmName field of the department table.

[0055] t_zb is the table name of the equipment table, zbId is the equipment Id field (primary key) of the equipment table, zbName is the equipment name field of the equipment table, uuid1 and uuid2 are the values ​​of the zbId field of the equipment table, and zb1 and zb2 are the values ​​of the zbName field of the equipment table.

[0056] dict_dt is the table name of the dynamic simplified mapping table, key is the primary key field of the dynamic simplified mapping table (the data in this column must ensure that the sending and receiving ends are in consistent ordered rules), value is the simplified codec value corresponding to the key field in the dynamic simplified mapping table, bmId@uuid1, bmId@uuid2, zbId@uuid1, zbId@uuid2 are the values ​​of the key field of the dynamic simplified mapping table, 0, 1, 0, 1 are the simplified codec values ​​corresponding to the key field values ​​in the dynamic simplified mapping table respectively.

[0057] In an embodiment of the present application, the method for generating the static simplified mapping table includes: after the first simplified encoding and decoding program receives the static metadata, using the second field name and the second field content corresponding to the static metadata as the key value, and using the unique mapping code corresponding to the second field content as the value value, to generate a second hash dictionary table, wherein the static metadata is metadata that does not change when the system is running; based on the second hash dictionary table, a static simplified mapping table is generated.

[0058] In actual applications, a static simplified mapping table is used to obtain static metadata in the system (metadata that does not change when the system is running, and the metadata values ​​of the sender and the receiver are consistent), and a hash dictionary table (i.e., a static simplified mapping table) is formed in the same way as the dynamic simplified mapping table as the basic data of the software, which is used to simplify the encoding and decoding work of the codec program on the data.

[0059] See also Figure 3 , Figure 3 A schematic diagram of a static simplified mapping table in a target data processing method provided in an embodiment of the present application.

[0060] like Figure 3 As shown, t_sb is the table name of the equipment table, sbId is the equipment Id field (primary key) of the equipment table, sbxh is the equipment model field of the equipment table, 1 and 2 are the values ​​of the sbId field of the equipment table, and XH-AB and XH-BD are the values ​​of the sbxh field of the department table;

[0061] dict_jt is the table name of the static simplified mapping table, key is the primary key field of the static simplified mapping table (the data in this column must ensure that the sending end and the receiving end are in consistent order), value is the simplified codec value corresponding to the key field in the static simplified mapping table, sbxh@XH-AB and sbxh@XH-BD are the values ​​of the key field of the static simplified mapping table, and 0 and 1 are the simplified codec values ​​corresponding to the key field value in the static simplified mapping table.

[0062] Exemplarily, the protocol data agreed upon by the system sending end and the receiving end are shown in Table 1.

[0063] Table 1 Protocol data field table

[0064] Serial number Field Name Field meaning Message Type Required Maximum length Streamlining strategy sjlx Data Types String yes 6 bytes 1 version Version Number String yes 1 byte 0 bmId BMID String yes 16 bytes 2 zbI ZBID String yes 16 bytes 2 sxh Device Model String yes 8 bytes 1 fsj Send time String yes 19 bytes 3

[0065] It should be noted that 0 means not using any simplification strategy, 1 means using a static simplification mapping table for simplification, 2 means using a dynamic simplification mapping table for simplification, and other values ​​greater than 0 use conventional simplification methods (for example, 3 means compressing time into a 4-byte integer value, etc.).

[0066] A simplified strategy coding table is designed for the agreed protocol, wherein the simplified strategy coding table is shown in Table 2.

[0067] Table 2 Simplified strategy coding table

[0068]

[0069]

[0070] For the simplified strategy coding table, a static simplified mapping table and a dynamic simplified mapping table are designed. The static simplified mapping table is shown in Table 3.

[0071] Table 3 Static simplified mapping table (supports 256 device models)

[0072] Serial number Dictionary key value Dictionary value (mapping code) sjlx@WQFSJC 0 sjlx@WQDJZT 1 sjlx@?????? … sjlx@XXXXXX 15 sbxh@XH-AB 0 sbxh@XH-01234 1 sbxh@XH-RFREG 2 sbxh@XH-... … sbxh@XH-XXXXX 255

[0073] For the reduction strategy coding table, a static reduction mapping table and a dynamic reduction mapping table are designed. The dynamic reduction mapping table is shown in Table 4.

[0074] Table 4 Dynamic simplified mapping table (supports 256 device models)

[0075]

[0076]

[0077] Therefore, it can be seen that before simplified encoding, the maximum total length of the data is 128 bytes, see Table 5 for details.

[0078] Table 5 Simplified sample data before encoding

[0079]

[0080] After simplified encoding, the theoretical maximum total length of the data is 12 bytes, see Table 6 for details.

[0081] Table 6 Simplified coding sample data

[0082]

[0083] Conclusion: The maximum total length of the data is 128 bytes before simplified coding and 12 bytes after simplified coding, with a simplified length of 121 bytes and a compression ratio of 10.67 times; see Table 7 for details.

[0084] Table 7 Simplified strategy data conclusion table

[0085] Before streamlining After streamlining the coding Reduced length Streamlined compression ratio Maximum total length of data 128 bytes 12 bytes 116 bytes 10.67 times

[0086] See also Figure 4 , Figure 4 A schematic diagram of the composition of a static simplified mapping table of a target data processing method provided in an embodiment of the present application.

[0087] like Figure 4 As shown, in the static simplified mapping table, the sender is used to send simplified coded data to the receiver; the receiver is used to generate decoded data after processing the simplified coded data, and return the decoded data to the sender.

[0088] Specifically, on the sender side, the database includes dynamic metadata, static metadata and other data, wherein the dynamic metadata corresponds to a dynamic simplified mapping table, which is generated when the system is running, and the static metadata corresponds to a static simplified mapping table, which is generated when the system is compiled.

[0089] The dynamic metadata is processed based on the dynamic simplified mapping table to generate the target dynamic metadata; the static metadata is processed through the static simplified mapping table to generate the target static metadata; the generated target dynamic metadata and target static metadata are input into the simplified encoding and decoding program, the simplified encoded data is output, and the simplified encoded data is sent to the receiver.

[0090] On the receiving side, the database includes dynamic metadata, static metadata and other data, wherein the data in the receiving database is consistent with the data in the sending database.

[0091] After receiving the simplified coded data, the receiver performs decoding processing through a simplified coding and decoding program to generate decoded data.

[0092] By applying the method provided in this application, the storage space of data during the transmission process can be effectively reduced, and the integrity and reliability of data during the transmission process can be improved; at the same time, the data mapping search time can be reduced, and the efficiency of data matching can be improved; high-concurrency message processing of multiple devices can be supported, and the number of concurrent device accesses can be increased, so that the message proxy server can receive data sent by more devices with less time, so that it can run efficiently and stably, and messages can be reliably transmitted at high concurrency.

[0093] Corresponding to the above method embodiment, this specification also provides a target data processing device embodiment, Figure 5 This is a schematic diagram of the structure of a target data processing device provided in an embodiment of the present application. Figure 5 As shown, the device comprises:

[0094] The first sending module 502 is configured to send the dynamic metadata and the dynamic simplified mapping table corresponding to the dynamic metadata as parameters to the first simplified codec program through the sending end, wherein the static metadata of the sending end and the receiving end of the control system are kept consistent;

[0095] The encoding module 504 is configured to perform simplified encoding on the dynamic metadata, the dynamic simplified mapping table, the static mapping table and the protocol format through the first simplified encoding and decoding program to obtain encoded data;

[0096] A second sending module 506 is configured to send the coded data and the protocol data corresponding to the coded data to the receiving end through the sending end;

[0097] The third transmitting module 508 is configured to send the encoded data and the dynamic reduced mapping table to the second reduced codec program through the receiving end after the receiving end receives the encoded data;

[0098] The decoding module 510 is configured to decode the data format of the encoded data, the dynamic simplified mapping table, the static simplified mapping table and the protocol data corresponding to the encoded data through the second simplified encoding and decoding program to obtain decoded data.

[0099] In an optional embodiment, the first sending module 502 is further configured to:

[0100] After the first simplified codec program receives the dynamic metadata, a first hash dictionary table is generated using a first field name and a first field content corresponding to the dynamic metadata as a key value and a unique mapping code corresponding to the first field content as a value value, wherein the dynamic metadata is a change in a value corresponding to the metadata obtained based on a change in data requirements when the system is running;

[0101] A dynamic reduced mapping table is generated based on the first hash dictionary table.

[0102] In an optional embodiment, the third sending module 508 is further configured to:

[0103] After the first simplified codec program receives the static metadata, a second hash dictionary table is generated using the second field name and the second field content corresponding to the static metadata as the key value and the unique mapping code corresponding to the second field content as the value value, wherein the static metadata is metadata that does not change when the system is running;

[0104] Based on the second Hash dictionary table, a static simplified mapping table is generated.

[0105] The application of the device provided in the present application can effectively reduce the storage space of data during the transmission process and improve the integrity and reliability of data during the transmission process; at the same time, reduce the data mapping search time and improve the efficiency of data matching; support high-concurrency message processing of multiple devices and increase the number of concurrent device accesses, so that the message proxy server can receive data sent by more devices in less time, enabling it to run efficiently and stably, and messages can be reliably transmitted at high concurrency.

[0106] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the target data processing device, since it is basically similar to the target data processing method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the target data processing method embodiment.

[0107] Figure 6 This is a block diagram of a computing device provided in an embodiment of the present application. The components of the computing device 600 include but are not limited to a memory 610 and a processor 620. The processor 620 is connected to the memory 610 via a bus 630, and the database 650 is used to store data.

[0108] The computing device 600 also includes an access device 640, which enables the computing device 600 to communicate via one or more networks 660. Examples of these networks include a public switched telephone network (PSTN), a local area network (LAN), a wide area network (WAN), a personal area network (PAN), or a combination of communication networks such as the Internet. The access device 640 may include one or more of any type of network interface (e.g., a network interface card (NIC)) of wired or wireless, such as an IEEE 802.11 wireless local area network (WLAN) wireless interface, a world-wide interoperability for microwave access (Wi-MAX) interface, an Ethernet interface, a universal serial bus (USB) interface, a cellular network interface, a Bluetooth interface, and a near field communication (NFC).

[0109] In one embodiment of the present specification, the above components of the computing device 600 and Figure 6 Other components not shown in the figure may also be connected to each other, for example, via a bus. It should be understood that Figure 6 The computing device structure block diagram shown is only for the purpose of illustration, and is not intended to limit the scope of this specification. Those skilled in the art can add or replace other components as needed.

[0110] The computing device 600 may be any type of stationary or mobile computing device, including a mobile computer or mobile computing device (e.g., a tablet computer, a personal digital assistant, a laptop computer, a notebook computer, a netbook, etc.), a mobile phone (e.g., a smart phone), a wearable computing device (e.g., a smart watch, smart glasses, etc.), or other types of mobile devices, or a stationary computing device such as a desktop computer or a personal computer (PC). The computing device 600 may also be a mobile or stationary server.

[0111] The processor 620 is used to execute the following computer executable instructions, which, when executed by the processor, implement the steps of the above-mentioned target data processing method.

[0112] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the computing device embodiment, since it is basically similar to the target data processing method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the target data processing method embodiment.

[0113] An embodiment of the present specification also provides a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, implement the steps of the above-mentioned target data processing method.

[0114] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the computer-readable storage medium embodiment, since it is basically similar to the target data processing method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the target data processing method embodiment.

[0115] An embodiment of the present specification further provides a computer program, wherein when the computer program is executed in a computer, the computer is caused to execute the steps of the above-mentioned target data processing method.

[0116] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the computer program embodiment, since it is basically similar to the target data processing method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the target data processing method embodiment.

[0117] The above is a description of a specific embodiment of the specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0118] The computer instructions include computer program codes, which may be in source code form, object code form, executable files or some intermediate forms, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, USB flash drive, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal and software distribution medium, etc. It should be noted that the content contained in the computer-readable medium may be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer-readable media do not include electric carrier signals and telecommunication signals.

[0119] It should be noted that the above is a description of a specific embodiment of the present specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the accompanying drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the embodiments of the present specification.

[0120] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0121] The preferred embodiments of this specification disclosed above are only used to help explain this specification. The optional embodiments do not describe all the details in detail, nor do they limit the invention to only the specific implementation methods described. Obviously, many modifications and changes can be made according to the content of the embodiments of this specification. This specification selects and specifically describes these embodiments in order to better explain the principles and practical applications of the embodiments of this specification, so that technicians in the relevant technical field can well understand and use this specification. This specification is only limited by the claims and their full scope and equivalents.

Claims

1. A target data processing method, characterized in that: include: The dynamic metadata and the dynamic simplified mapping table corresponding to the dynamic metadata are sent as parameters to the first simplified codec program through the sending end, wherein the static metadata of the sending end and the receiving end of the control system are kept consistent; The dynamic metadata, the dynamic simplified mapping table, the static mapping table and the protocol format are simplified and encoded by the first simplified encoding and decoding program to obtain encoded data; Sending the coded data and the protocol data corresponding to the coded data to the receiving end through the sending end; After the receiving end receives the coded data, the coded data and the dynamic simplified mapping table are sent to a second simplified codec program through the receiving end; The second simplified encoding and decoding program decodes the encoded data, the dynamic simplified mapping table, the static simplified mapping table, and the data format of the protocol data corresponding to the encoded data to obtain decoded data.

2. The method according to claim 1, characterized in that The method for generating the dynamic simplified mapping table comprises: After the first simplified codec program receives the dynamic metadata, a first hash dictionary table is generated using a first field name and a first field content corresponding to the dynamic metadata as a key value and a unique mapping code corresponding to the first field content as a value value, wherein the dynamic metadata is a change in a value corresponding to the metadata obtained based on a change in data requirements when the system is running; A dynamic reduced mapping table is generated based on the first hash dictionary table.

3. The method according to claim 1, characterized in that The method for generating the static simplified mapping table comprises: After the first simplified codec program receives the static metadata, a second hash dictionary table is generated using the second field name and the second field content corresponding to the static metadata as the key value and the unique mapping code corresponding to the second field content as the value value, wherein the static metadata is metadata that does not change when the system is running; Based on the second Hash dictionary table, a static simplified mapping table is generated.

4. A target data processing device, characterized in that: include: A first sending module is configured to send the dynamic metadata and the dynamic simplified mapping table corresponding to the dynamic metadata as parameters to the first simplified codec program through the sending end, wherein the static metadata of the sending end and the receiving end in the control system are kept consistent; The encoding module is configured to perform simplified encoding on the dynamic metadata, the dynamic simplified mapping table, the static mapping table and the protocol format through the first simplified encoding and decoding program to obtain encoded data; A second sending module is configured to send the coded data and the protocol data corresponding to the coded data to the receiving end through the sending end; A third transmitting module is configured to send the encoded data and the dynamic simplified mapping table to a second simplified codec program through the receiving end after the receiving end receives the encoded data; The decoding module is configured to decode the data format of the encoded data, the dynamic simplified mapping table, the static simplified mapping table and the protocol data corresponding to the encoded data through the second simplified encoding and decoding program to obtain decoded data.

5. A computer device, characterized in that: The computer device comprises a memory, a processor and a computer program stored in the memory and executable on the processor, and the processor implements the steps of the method according to any one of claims 1 to 3 when executing the program.

6. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores an implementation program for information transmission, and when the program is executed by a processor, the steps of the method according to any one of claims 1 to 3 are implemented.

Citation Information

Patent Citations

  • Equipment log storage method and device, electronic equipment and medium

    CN113672483A

  • Data transmission method and device based on HTTP2 protocol

    CN115883682A

  • Communication method, apparatus and system

    WO2021203445A1

Cited By

  • Method and system for automatic mapping of multi-source heterogeneous data based on configurable rule expression

    CN122733389A