Data processing method and device for communication data frame

Abstract

The invention relates to the technical field of data processing, and discloses a data processing method and device for a communication data frame, and the method comprises the steps: when an intermediate entity receives a target data frame sent by a first computer, determining the data flow direction information of the target data frame according to the first computer and the target data frame, and carrying out the data processing of the target data frame based on the data flow direction information; determining a first target type; according to the target data frame and the first target type, log record information corresponding to the target data frame is generated; and determining a second target type based on the log record information and the target data frame, generating data frame content based on the second target type, and transmitting the data frame content to a second host computer. Therefore, the data processing efficiency of the bus communication data frame can be improved, and the data processing intelligence of the bus communication data frame can be improved.

Description

Technical Field

[0001] This invention relates to the field of data processing technology, and in particular to a data processing method and apparatus for communication data frames. Background Technology

[0002] Currently, bus communication, as the core carrier of data interaction, is widely used in industrial control, intelligent devices, and other technical fields. With the increasing complexity of communication systems, the frequency of data interaction between upper and lower level machines has increased significantly. The transmission volume, type diversity, and flow complexity of data frames have also grown accordingly, placing higher demands on the traceability, analyzability, and problem localization efficiency of bus communication data. Currently, the logging of bus communication data frames largely follows different rules depending on the bus type (e.g., CAN bus, USB bus) or connection method (e.g., wireless Bluetooth, wired serial port). This makes it difficult to unify, integrate, and compare log data across buses and scenarios, resulting in low data processing efficiency.

[0003] Therefore, it is particularly important to provide a data processing method for bus communication data frames to improve the efficiency and intelligence of data processing. Summary of the Invention

[0004] This invention provides a data processing method and apparatus for communication data frames, which can improve the efficiency of data processing for bus communication data frames and also enhance the intelligence of data processing for bus communication data frames.

[0005] The first aspect of this invention discloses a data processing method for communication data frames, the method comprising: When the intermediate entity receives the target data frame sent by the first host, it determines the data flow direction information of the target data frame based on the first host and the target data frame, and determines the first target type based on the data flow direction information; Based on the target data frame and the first target type, generate log recording information corresponding to the target data frame; Based on the log information and the target data frame, a second target type is determined, and based on the second target type, data frame content is generated and transmitted to the second host machine.

[0006] As an optional implementation, in the first aspect of the present invention, before generating log recording information corresponding to the target data frame based on the target data frame and the first target type, the method further includes: Determine the data frame byte length of the target data frame, and determine whether the data frame byte length matches a preset data frame length threshold; When it is determined that the length of the data frame matches the preset data frame length threshold, the operation of generating log recording information corresponding to the target data frame based on the target data frame and the first target type is triggered.

[0007] As an optional implementation, in a first aspect of the present invention, the method further includes: When it is determined that the length of the data frame does not match the preset data frame length threshold, abnormal frame information of the target data frame is generated based on the length of the data frame and the preset data frame length threshold, and an abnormal identification field is generated based on the abnormal frame information. The step of generating log record information corresponding to the target data frame based on the target data frame and the first target type includes: Based on the target data frame, the first target type, and the anomaly identifier field, generate log record information corresponding to the target data frame.

[0008] As an optional implementation, in a first aspect of the present invention, transmitting the data frame content to a second host machine includes: Determine the communication priority parameters of the bus communication entity of the second host machine, and based on the communication priority parameters of the second host machine, determine the transmission priority of each data frame to be transmitted included in the data frame content; A data transmission order is generated based on the transmission priority of each of the data frames to be transmitted; According to the data transmission order, each data frame included in the data frame content is transmitted to the second host machine.

[0009] As an optional implementation, in a first aspect of the present invention, the method further includes: Obtain the data transmission result of the target data frame, and generate a target log record based on the data transmission result; Extract the characteristic log information of the target log record, generate associated index information based on the characteristic log information, and perform data tracing operation on the data of the first host machine and the second host machine based on the key index information to obtain the data tracing result.

[0010] As an optional implementation, in the first aspect of the present invention, before generating the associated index information based on the feature log information, the method further includes: Obtain the first clock parameter corresponding to the first host machine, the second clock parameter corresponding to the second host machine, and the third clock parameter corresponding to the intermediate entity; Determine the clock deviation values ​​of the first clock parameter, the second clock parameter, and the third clock parameter; perform a clock compensation calibration operation on the feature log information based on the clock deviation values ​​to obtain a clock calibration result. Based on the clock calibration results, an update operation is performed on the feature log information.

[0011] As an optional implementation, in a first aspect of the present invention, the method further includes: Based on the target log records, determine the frame type field of each data frame content; Based on the frame type field of each data frame content, determine the classification database table corresponding to each data frame content; For each data frame content, the data frame content is stored in the corresponding classification database table according to the classification database table of the data frame content; The table name of the classification database table matches the frame type field of each data frame content.

[0012] A second aspect of the present invention discloses a data processing apparatus for communication data frames, the apparatus comprising: The determination module is used to determine the data flow direction information of the target data frame based on the first host and the target data frame when the intermediate entity receives the target data frame sent by the first host, and to determine the first target type based on the data flow direction information. The generation module is used to generate log record information corresponding to the target data frame based on the target data frame and the first target type. The determining module is further configured to determine a second target type based on the log record information and the target data frame; The generation module is further configured to generate data frame content based on the second target type; The transmission module is used to transmit the data frame content to the second host machine.

[0013] As an optional implementation, in a second aspect of the present invention, the determining module is further configured to determine the data frame byte length of the target data frame before the generating module generates log recording information corresponding to the target data frame based on the target data frame and the first target type; The device further includes: The judgment module is used to determine whether the data frame byte length matches a preset data frame length threshold; when it is determined that the data frame byte length matches the preset data frame length threshold, the generation module is triggered to perform the operation of generating log record information corresponding to the target data frame based on the target data frame and the first target type.

[0014] As an optional implementation, in a second aspect of the present invention, the generation module is further configured to, when the judgment module determines that the length of the data frame byte does not match the preset data frame length threshold, generate abnormal frame information of the target data frame according to the data frame byte length and the preset data frame length threshold, and generate an abnormal identification field according to the abnormal frame information; The specific method by which the generation module generates the log record information corresponding to the target data frame based on the target data frame and the first target type includes: Based on the target data frame, the first target type, and the anomaly identifier field, generate log record information corresponding to the target data frame.

[0015] As an optional implementation, in a second aspect of the present invention, the specific method by which the transmission module transmits the data frame content to the second host machine includes: Determine the communication priority parameters of the bus communication entity of the second host machine, and based on the communication priority parameters of the second host machine, determine the transmission priority of each data frame to be transmitted included in the data frame content; A data transmission order is generated based on the transmission priority of each of the data frames to be transmitted; According to the data transmission order, each data frame included in the data frame content is transmitted to the second host machine.

[0016] As an optional implementation, in a second aspect of the invention, the apparatus further includes: An acquisition module is used to acquire the data transmission result of the target data frame; The generation module is also used to generate target log records based on the data transmission results; The extraction module is used to extract the characteristic log information of the target log record; The generation module is further configured to generate associated index information based on the feature log information, and based on the key index information; The data tracing module is used to perform data tracing operations on the data from the first and second host machines to obtain data tracing results.

[0017] As an optional implementation, in a second aspect of the present invention, the acquisition module is further configured to acquire, before the generation module generates the associated index information based on the feature log information, the first clock parameter corresponding to the first host machine, the second clock parameter corresponding to the second host machine, and the third clock parameter corresponding to the intermediate entity; The determining module is further configured to determine the clock deviation values ​​of the first clock parameter, the second clock parameter, and the third clock parameter, and perform a clock compensation calibration operation on the feature log information based on the clock deviation values ​​to obtain a clock calibration result; The device further includes: The update module is used to perform an update operation on the feature log information based on the clock calibration result.

[0018] As an optional implementation, in a second aspect of the present invention, the determining module is further configured to determine a frame type field of each data frame content based on the target log record; and determine a classification database table corresponding to each data frame content based on the frame type field of each data frame content. The device further includes: The storage module is used to store the content of the data frame into the category database table corresponding to the content of the data frame; The table name of the classification database table matches the frame type field of each data frame content.

[0019] A third aspect of the present invention discloses another data processing apparatus for communication data frames, the apparatus comprising: Memory containing executable program code; A processor coupled to the memory; The processor calls the executable program code stored in the memory to execute some or all of the steps in the data processing method for communication data frames according to any of the first aspects of the present invention.

[0020] The fourth aspect of the present invention discloses a computer storage medium storing computer instructions, which, when invoked, are used to execute some or all of the steps in the data processing method for communication data frames described in any of the first aspects of the present invention.

[0021] Compared with the prior art, the present invention has the following beneficial effects: In this embodiment of the invention, when the intermediate entity receives the target data frame sent by the first host machine, it determines the data flow direction information of the target data frame based on the first host machine and the target data frame, and determines a first target type based on the data flow direction information; it generates log recording information corresponding to the target data frame based on the target data frame and the first target type; it determines a second target type based on the log recording information and the target data frame, generates data frame content based on the second target type, and transmits the data frame content to the second host machine. Therefore, implementing this invention can improve the efficiency of data processing for bus communication data frames and also enhance the intelligence of data processing for bus communication data frames. Attached Figure Description

[0022] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0023] Figure 1 This is a flowchart illustrating a data processing method for communication data frames disclosed in an embodiment of the present invention; Figure 2 This is a flowchart illustrating another data processing method for communication data frames disclosed in an embodiment of the present invention; Figure 3 This is a schematic diagram of the structure of a data processing device for communication data frames disclosed in an embodiment of the present invention; Figure 4 This is a schematic diagram of the structure of another data processing device for communication data frames disclosed in an embodiment of the present invention; Figure 5 This is a schematic diagram of the structure of another communication data frame data processing device disclosed in an embodiment of the present invention. Detailed Implementation

[0024] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0025] The terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this invention are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, apparatus, product, or end that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or ends.

[0026] In this document, the term "embodiment" means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of the invention. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.

[0027] This invention discloses a data processing method and apparatus for communication data frames, which can improve the efficiency of data processing for bus communication data frames and enhance the intelligence of data processing for bus communication data frames. These will be described in detail below.

[0028] Example 1 Please see Figure 1 , Figure 1 This is a flowchart illustrating a data processing method for communication data frames disclosed in an embodiment of the present invention. Figure 1 The described data processing method for communication data frames can be applied to a data processing device for communication data frames, wherein the data processing device for communication data frames can be integrated into a cloud server or a local server, and the embodiments of the present invention are not limited thereto. Figure 1 As shown, the data processing method for this communication data frame may include the following operations.

[0029] 101. When the intermediate entity receives the target data frame sent by the first machine, it determines the data flow direction information of the target data frame based on the first machine and the target data frame, and determines the first target type based on the data flow direction information.

[0030] In this embodiment of the invention, optionally, the first machine includes a host machine or a slave machine, and the second machine includes a host machine or a slave machine; when the first machine is a host machine, the second machine is a slave machine; when the first machine is a slave machine, the second machine is a host machine.

[0031] In this embodiment of the invention, optionally, the intermediate entity listens for communication requests from access devices in real time through a preset communication port (such as a USB port, CAN bus interface, Bluetooth communication channel, etc.). When a data frame transmission signal is detected, the entity first obtains the identity identifier of the first machine. The identity identifier is obtained by parsing preset fields (such as device address code, bus type identifier bit) in the header of the data frame, including the device type of the first machine (host machine entity / lower machine bus communication entity), the bus type (USB / CAN / SPI / serial bus, etc.), and the connection method (wired / wireless).

[0032] In this embodiment of the invention, optionally, the data flow is as follows: First, the first machine sends a data frame to the intermediate entity ("host computer entity → intermediate entity → slave bus communication entity"), with the first target type being "RecvNet"; second, the data flow is as follows: First, the first machine sends a data frame to the intermediate entity ("slave bus communication entity → intermediate entity → host computer entity"), with the first target type being "RecvCan". Here, RecvNet may include network data receiving function instructions; RecvCan may include instructions from the CAN bus receiving API.

[0033] 102. Generate log record information corresponding to the target data frame based on the target data frame and the first target type.

[0034] In this embodiment of the invention, optionally, the log recording information corresponding to the target data frame may include one or more of the following: data frame type information, data frame length information, data frame timestamp information, data direction information, data frame quantity information, and data frame number index information.

[0035] 103. Based on the log information and the target data frame, determine the second target type, generate the data frame content based on the second target type, and transmit the data frame content to the second host machine.

[0036] In this embodiment of the invention, optionally, if the first target type is RecvNet (receiving data frames from the host computer), then the second target type is SendCan (sending data frames to the lower-level bus communication entity); if the first target type is RecvCan (receiving data frames from the lower-level bus communication entity), then the second target type is SendNet (sending data frames to the host computer entity).

[0037] In this embodiment of the invention, optionally, generating data frame content based on the second target type may include: Based on the core data payload of the target data frame, data encapsulation operation is performed on the core data payload according to the bus protocol format supported by the second host machine to obtain the first encapsulated data, and the data check code of the target data frame is calculated. Based on the data check code and the core data payload, the second encapsulated data is generated. Based on the first encapsulated data and the second encapsulated data, the data frame content is generated. The core data payload of the target data frame may include a header checksum used for local verification of intermediate entities, the first encapsulated data may include a direction identifier bit corresponding to the second target type and a second bit device address code, and the data checksum may include a CRC32 checksum.

[0038] In a further optional embodiment of the present invention, before transmitting the data frame content to the second host machine, the method may further include: If the second host machine supports data compression transmission, the LZ4 algorithm is used to compress the data frame content, and a compression flag is added to the frame header to indicate the compression algorithm type and original length, so as to obtain the data compression result corresponding to the data frame content, and update the data frame content according to the data compression result.

[0039] It is evident that implementation Figure 1 The described data processing method for communication data frames can determine the data flow direction information and the first target type based on the first host and the target data frame. It generates corresponding log information based on the target data frame and the first target type, determines the second target type based on the log information and the target data frame, generates data frame content, and transmits the data frame content to the second host. This method clearly identifies the data receiving source and data flow direction, improving the intelligence and reliability of target data frame transmission. Furthermore, by using key elements in the log information, combined with flow identification, it can quickly locate the specific link of the data frame in the transmission link, improving data processing efficiency. It also solves the problems of chaotic traditional log formats and difficulties in cross-scenario integration through a unified log format template, improving the uniformity, accuracy, and reliability of data processing. Moreover, by using a fixed mapping logic between the second and first target types, it avoids data forwarding errors, ensuring that the target data frame from the first host is accurately delivered to the corresponding second host, further improving the accuracy and reliability of data transmission. This, in turn, improves the efficiency and intelligence of data processing for bus communication data frames.

[0040] Example 2 Please see Figure 2 , Figure 2 This is a flowchart illustrating another data processing method for communication data frames disclosed in an embodiment of the present invention. Figure 2The described data processing method for communication data frames can be applied to a data processing device for communication data frames, wherein the data processing device for communication data frames can be integrated into a cloud server or a local server, and the embodiments of the present invention are not limited thereto. Figure 2 As shown, the data processing method for this communication data frame may include the following operations: 201. When the intermediate entity receives the target data frame sent by the first machine, it determines the data flow direction information of the target data frame based on the first machine and the target data frame, and determines the first target type based on the data flow direction information.

[0041] 202. Determine the data frame byte length of the target data frame and determine whether the data frame byte length matches the preset data frame length threshold.

[0042] In this embodiment of the invention, optionally, the data frame byte length of the target data frame may include the minimum length threshold, standard length threshold, maximum length threshold, and current byte length of the target data frame.

[0043] In this embodiment of the invention, optionally, the above-mentioned determination of whether the data frame byte length matches a preset data frame length threshold may include: Determine whether the length of the data frame bytes is within the preset data frame length threshold range; When it is determined that the length of the data frame bytes is within the range corresponding to the preset data frame length threshold, it is determined that the length of the data frame bytes matches the preset data frame length threshold; when it is determined that the length of the data frame bytes is not within the range corresponding to the preset data frame length threshold, it is determined that the length of the data frame bytes does not match the preset data frame length threshold.

[0044] In this embodiment of the invention, optionally, after determining whether the data frame byte length matches a preset data frame length threshold, a matching judgment result is obtained, and the matching judgment result is cached in a temporary log space.

[0045] 203. When it is determined that the length of the data frame matches the preset data frame length threshold, log record information corresponding to the target data frame is generated according to the target data frame and the first target type.

[0046] 204. Based on the log information and the target data frame, determine the second target type, generate the data frame content based on the second target type, and transmit the data frame content to the second host machine.

[0047] In this embodiment of the invention, for detailed descriptions of steps 201 and 203-204, please refer to the other descriptions of steps 101-103 in Embodiment 1. These descriptions will not be repeated in this embodiment of the invention.

[0048] It is evident that implementation Figure 2 The described data processing method for communication data frames can determine the data frame byte length of the target data frame and judge whether it matches the preset data frame length threshold. If it matches, it triggers the operation of generating corresponding log record information based on the target data frame and the first target type. It can remove the data that affects the target data frame to ensure that the final log only contains valid data that conforms to the protocol length specification, avoiding invalid data from occupying log storage space and interfering with subsequent parsing. This is beneficial to improving the efficiency and intelligence of subsequent data processing and data transmission. It also ensures that the log content is all valid communication data, which saves storage and bandwidth resources, improves the accuracy of log retrieval and analysis, and further improves the accuracy and reliability of data transmission. In this way, it can improve the efficiency of data processing of bus communication data frames and enhance the intelligence of data processing of bus communication data frames.

[0049] In an optional embodiment, the method further includes: When it is determined that the length of the data frame does not match the preset data frame length threshold, abnormal frame information of the target data frame is generated based on the length of the data frame and the preset data frame length threshold, and an abnormal identification field is generated based on the abnormal frame information. Specifically, based on the target data frame and the first target type, log recording information corresponding to the target data frame is generated, including: Based on the target data frame, the first target type, and the exception identifier field, generate the log record information corresponding to the target data frame.

[0050] In this optional embodiment, the process of generating abnormal frame information for the target data frame based on the data frame byte length and a preset data frame length threshold may include: Based on the data frame byte length and the preset data frame length threshold, a length anomaly parameter is determined, and based on the length anomaly parameter, anomaly frame information of the target data frame is generated. The anomaly frame information may include the actual length information and length difference value information of the target data frame.

[0051] In this optional embodiment, the generation of the exception identifier field based on the exception frame information may include: Based on the abnormal frame information, determine the abnormal format parameters corresponding to the abnormal frame information, and generate an abnormal identifier field based on the abnormal frame information and the abnormal format parameters.

[0052] In this optional embodiment, the process of generating log record information corresponding to the target data frame based on the target data frame, the first target type, and the anomaly identifier field may include: Based on the target data frame, the first target type, and the anomaly identifier field, determine the anomaly log format parameters. The anomaly log format parameters may include one or more of the following: timestamp parameters, data flow direction parameters, frame index and total number parameters, frame type parameters, and data length parameters. Based on the exception log format parameters, the target data frame, and the exception identifier field, generate the log record information corresponding to the target data frame.

[0053] As can be seen, implementing this optional embodiment can generate abnormal frame information of the target data frame and generate an abnormal identification field based on the data frame byte length and data frame length threshold when it is determined that the data frame byte length does not match the data frame length threshold. It can also generate log record information corresponding to the target data frame based on the target data frame, the first target type, and the abnormal identification field. This allows for the generation of abnormal frame information and the abnormal identification field by combining the data frame byte length and the data frame length threshold. It enables instantaneous determination of the abnormal type based solely on the identification field without parsing log details, which improves the accuracy and reliability of determining abnormal information in the target data frame, enhances the intelligence and efficiency of viewing abnormal information in the target data frame, and achieves rapid identification and classification of abnormal information. Furthermore, it avoids tool failures caused by log format changes, and the unified structure of normal and abnormal logs facilitates subsequent overall data statistics. It also ensures that all log content is valid communication data, saving storage and bandwidth resources, improving the accuracy of log retrieval and analysis, further enhancing the accuracy and reliability of data transmission, and ultimately improving the efficiency and intelligence of data processing for bus communication data frames.

[0054] In another alternative embodiment, transmitting the data frame content to a second host machine includes: Determine the communication priority parameters of the bus communication entity of the second host machine, and based on the communication priority parameters of the second host machine, determine the transmission priority of each data frame to be transmitted included in the data frame content; The data transmission order is generated based on the transmission priority of each data frame to be transmitted; In accordance with the data transmission order, each data frame included in the data frame content is transmitted to the second host machine.

[0055] In this optional embodiment, the communication priority parameters of the bus communication entity of the second host machine may include one or more of hardware capability parameters, service priority parameters, and bus protocol restriction parameters; wherein, the hardware capability parameters may include maximum receive frame rate parameters, buffer capacity parameters, and CPU processing latency parameters; the service priority parameters may include data frame type priority parameters; and the bus protocol restriction parameters may include one or more of bus type parameters and priority configuration range parameters.

[0056] In this optional embodiment, the determination of the transmission priority of each data frame to be transmitted included in the data frame content based on the communication priority parameter of the second host machine may include: Based on the communication priority parameters of the second host machine, the priority level of each data frame to be transmitted included in the data frame content is determined, and the transmission priority of each data frame to be transmitted is determined according to the priority level of each data frame to be transmitted.

[0057] In this optional embodiment, optionally, for example, if the data frame type belongs to the "high priority frame type" preset by the second host machine (such as "CMD instruction frame"), it is directly assigned high priority; if the frame with timestamp and timeout threshold <100ms (such as real-time control instruction) is marked as "urgent", and the periodically reported frame (such as status frame once every 5 seconds) is marked as "medium" or "low", then the data frame has a lower priority.

[0058] In this optional embodiment, the generation of data transmission order based on the transmission priority of each data frame to be transmitted can be achieved by creating an independent queue for each priority level (urgent, high, medium, low). Data frames enter the corresponding queue according to their priority, thereby generating the data transmission order. High-priority queues are processed first, and low-priority queues are processed only when the high-priority queue is empty. For example, the urgent queue can store fault alarm frames, the high queue can store control command frames, the medium queue can store status reporting frames, and the low queue can store log synchronization frames.

[0059] In this optional embodiment, for example, transmitting each data frame to the second host computer in the order of data transmission can be done by the host computer taking data frames out of the scheduling queue in sequence, encapsulating them according to the bus protocol and sending them to the second host computer. For high-priority frames, wait for the second host computer to return a receipt confirmation frame. If it is not received within the timeout period, trigger a retransmission. For low-priority frames, use an unacknowledged method to improve transmission efficiency. Record the priority, sending time and transmission result of each frame in the transmission log so as to trace the transmission status later.

[0060] As can be seen, implementing this optional embodiment can determine the communication priority parameters of the bus communication entity of the second host machine and determine the transmission priority of each data frame to be transmitted included in the data frame content. It generates a data transmission order based on the transmission priority and transmits each data frame included in the data frame content to the second host machine. By classifying data frames by priority, higher-priority data frames can occupy bus resources first, reducing waiting time. This facilitates on-demand allocation of bus resources through real-time data transmission and transmission efficiency, avoiding response delays in high-priority services due to insufficient resources, improving overall transmission efficiency. It also reduces data loss in the second host machine due to receiver overload, ensuring the success and integrity of data reception by the second host machine, further improving the accuracy and reliability of data transmission. This, in turn, improves the efficiency of data processing for bus communication data frames and enhances the intelligence of data processing for bus communication data frames.

[0061] In yet another optional embodiment, the method further includes: Obtain the data transmission result of the target data frame, and generate the target log record based on the data transmission result; Extract the characteristic log information of the target log record, generate associated index information based on the characteristic log information, and perform data tracing operation on the data of the first and second machines based on the key index information to obtain the data tracing results.

[0062] In this optional embodiment, the data transmission result of the target data frame may optionally include one or more of the following: transmission status result, transmission timing result, and transmission error result; wherein, the transmission status result includes a transmission success result or a transmission failure result; the transmission timing result may include a sending timestamp, a receiving timestamp, and transmission time; and the transmission error result includes the reason for the transmission failure.

[0063] In this optional embodiment, the target log record may optionally be recorded according to a preset format, wherein the preset format includes [hh:mm:ss.xxx] RecvNet [index=nn,count=NN] frame type, length: data frame; where [hh:mm:ss.xxx] is a timestamp, representing hours, minutes, seconds, and milliseconds; RecvNet indicates the data direction of this frame; count indicates how many data frames are received at once; index indicates the frame index, from 1 to count; frame type indicates the type of this frame; length indicates the byte length of this data frame; and data frame indicates the hexadecimal byte content of this frame.

[0064] In this optional embodiment, the extraction of feature log information of the target log record may include: Extract the identification feature information of the target log record, and generate feature log information based on the identification feature information. The identification feature information may include one or more of the following: unique identifier feature information of data frame, link association feature information, and status feature information.

[0065] In this optional embodiment, the above-mentioned generation of associated index information based on feature log information may include: Based on the feature log information, determine the data frame index parameters, associate the full transmission log of the target data frame with the data frame index parameters, and determine the data transmission record corresponding to the target data frame based on the full transmission log. The data transmission record includes the transmission record of the target data frame to each receiving device. Based on the data transmission record, the transmission index information of the target data frame is determined, and associated index information is generated based on the data frame index parameters and the transmission index information. The associated index information may include the unique identifier information of the target data frame, the identifier information of the data receiving device, the identifier information of the transmission time, and the identifier information of the transmission status.

[0066] In this optional embodiment, the above-mentioned data tracing operation on the data of the first and second machines based on the key index information to obtain the data tracing result may include: Based on the key index information, the first data link of the first host machine and the second data link of the second host machine are determined. Based on the first data link and the second data link, the data tracing link is determined. Based on the data tracing link and the key index information, the data tracing operation is performed, and the associated multi-source data is spliced ​​together in chronological order to obtain the data tracing result.

[0067] As can be seen, implementing this optional embodiment can obtain the data transmission result of the target data frame and generate the target log record, extract the feature log information of the target log record and generate the associated index information, and then perform data tracing operations on the first and second machines to obtain the data tracing result. It can accurately locate the tracing path and obtain the data tracing result based on the feature log information and the associated index information, which is conducive to improving the accuracy and reliability of the data tracing result, as well as the intelligence and efficiency of the data tracing result. It can also determine the transmission and processing status of the target data frame through panoramic monitoring of communication and through the data tracing result, which is conducive to improving the efficiency and intelligence of data processing. It can also provide a precise basis for the long-term optimization of the system, promote the continuous improvement of communication capabilities, further improve the accuracy and reliability of data transmission, and thus improve the efficiency of data processing of bus communication data frames and the intelligence of data processing of bus communication data frames.

[0068] In yet another optional embodiment, before generating the associated index information based on the feature log information, the method further includes: Obtain the first clock parameter corresponding to the first bit machine, the second clock parameter corresponding to the second bit machine, and the third clock parameter corresponding to the intermediate entity; Determine the clock deviation values ​​of the first clock parameter, the second clock parameter, and the third clock parameter. Based on the clock deviation values, perform a clock compensation calibration operation on the feature log information to obtain the clock calibration result. Based on the clock calibration results, perform an update operation on the feature log information.

[0069] In this optional embodiment, the first clock parameter, the second clock parameter, and the third clock parameter may optionally include time feature parameters, wherein the time feature parameters may include one or more of the following: absolute timestamp parameters, clock source identifier parameters, and time precision parameters; furthermore, the first clock parameter, the second clock parameter, and the third clock parameter may be obtained through periodic active reporting, time-triggered acquisition, or hardware synchronization.

[0070] In this optional embodiment, the clock deviation value may optionally include a clock deviation value calculated based on a predetermined reference clock parameter; further, the predetermined reference clock parameter may be a third clock parameter corresponding to the intermediate entity.

[0071] In this optional embodiment, the above-mentioned clock compensation calibration operation on the feature log information based on the clock deviation value to obtain the clock calibration result may include: Based on the clock deviation value, determine the clock calibration parameter corresponding to the clock deviation value, and perform a clock compensation calibration operation that matches the clock calibration parameter on the clock deviation value corresponding to the feature log information to obtain the clock calibration result.

[0072] In this optional embodiment, after performing an update operation on the feature log information based on the clock calibration result, the clock parameters corresponding to the feature log information are matched with the pre-determined reference clock parameters.

[0073] As can be seen, implementing this optional embodiment can obtain the first clock parameters of the first machine, the second clock parameters of the second machine, and the third clock parameters of the intermediate entity, and determine the clock deviation value. Then, a clock compensation calibration operation is performed on the feature log information to obtain the clock calibration result. Based on the clock calibration result, an update operation is performed on the feature log information. This can unify the time base of multiple devices, solve the log time chaos problem caused by the asynchronous clocks of the first machine, the second machine, and the intermediate entity, and provide a reliable time basis for subsequent index association and data traceability. It ensures that the log timestamps of the same data frame remain consistent across the first machine, the intermediate entity, and the second machine, avoiding log association failures due to time deviations. Statistical analysis based on a unified time base can optimize the transmission strategy, further improve the accuracy and reliability of data transmission, and thus improve the efficiency of data processing of bus communication data frames, as well as the intelligence of data processing of bus communication data frames.

[0074] In yet another optional embodiment, the method further includes: Based on the target log records, determine the frame type field of each data frame content; Based on the frame type field of each data frame content, determine the corresponding classification database table for each data frame content; For each data frame content, store the data frame content in the corresponding category database table according to the category database table corresponding to the data frame content; The table name of the categorized database table matches the frame type field of each data frame content.

[0075] In this optional embodiment, the process of determining the frame type field of each data frame content based on the target log record may include: parsing the target log record to obtain a log parsing result, wherein the log parsing result includes the data frame service attribute parsing result; and determining the frame type field of each data frame content based on the log parsing result. Further, this field is typically contained in a fixed location within the data frame (such as a specific byte in the frame header) or in a structured field of the log record, and may include: service function types such as "Control Command Frame (CMD)," "Status Report Frame (STATUS)," "Fault Alarm Frame (ALARM)," and "Log Synchronization Frame (LOG)"; data format types such as "Standard Frame (STANDARD)," "Extended Frame (EXTENDED)," and "Remote Frame (REMOTE)" (applicable to bus protocols such as CAN); and priority association types such as "High Priority Frame (HIGH_PRI)" and "Low Priority Frame (LOW_PRI)" (linked with the transmission priority mechanism).

[0076] In this optional embodiment, the above-mentioned determination of the classification database table corresponding to each data frame content based on the frame type field of each data frame content may include: Based on the frame type field of each data frame content and the pre-determined database relationships, the corresponding category database table for each data frame content is determined; the pre-determined database relationships include the database corresponding to each frame type field.

[0077] In this optional embodiment, storing the data frame content in the corresponding category database table may include storing single data frames and batch data frames, followed by verification. Specifically, for a single data frame: matching the table name based on its frame type field (e.g., "ALARM" → "t_frame_alarm"), and calling the database insertion interface (e.g., SQL's INSERT statement) to write the converted data into the corresponding table; for batch data frames: grouping by frame type, and batch inserting frames of the same type into the corresponding table (e.g., batch writing 100 "CMD" frames into "t_frame_cmd") to improve storage efficiency.

[0078] As can be seen, implementing this optional embodiment can determine the frame type field of each data frame content and the corresponding classification database table based on the target log record, and store the data frame content pairs in the corresponding classification database table. This enables typed, specialized, and efficient storage of data frames, solving the problems of inefficient querying and complex management caused by traditional hybrid storage. It is beneficial to improve the intelligence and efficiency of data processing, as well as the accuracy and reliability of data processing. It can also improve the efficiency of data querying, and improve the convenience and reliability of data processing by optimizing the data storage structure. By supporting differentiated management through the separate table storage of different types of data frames, it is beneficial to improve data transmission and ensure data integrity and security, further improving the accuracy and reliability of data transmission. In turn, it is beneficial to improve the efficiency of data processing of bus communication data frames and the intelligence of data processing of bus communication data frames.

[0079] Example 3 Please see Figure 3 , Figure 3 This is a schematic diagram of the structure of a data processing device for communication data frames disclosed in an embodiment of the present invention. Figure 3 As shown, the data processing device for the communication data frame may include: The determination module 301 is used to determine the data flow direction information of the target data frame based on the first machine and the target data frame when the intermediate entity receives the target data frame sent by the first machine, and to determine the first target type based on the data flow direction information. The generation module 302 is used to generate log record information corresponding to the target data frame based on the target data frame and the first target type; The determination module 301 is also used to determine the second target type based on log record information and the target data frame; The generation module 302 is also used to generate data frame content based on the second target type; The transmission module 303 is used to transmit the data frame content to the second host machine.

[0080] It is evident that implementation Figure 3 The described device can determine the data flow direction information and the first target type based on the first host and the target data frame. It generates corresponding log information based on the target data frame and the first target type, determines the second target type based on the log information and the target data frame, generates data frame content, and transmits the data frame content to the second host. This clearly identifies the data receiving source and data flow direction, improving the intelligence and reliability of target data frame transmission. Furthermore, by using key elements in the log information, combined with flow identification, it can quickly locate the specific link of the data frame in the transmission link, improving data processing efficiency. It also solves the problems of chaotic traditional log formats and difficulties in cross-scenario integration through a unified log format template, improving the uniformity, accuracy, and reliability of data processing. Moreover, by using a fixed mapping logic between the second and first target types, it avoids data forwarding errors, ensuring that the target data frame from the first host is accurately delivered to the corresponding second host, further improving the accuracy and reliability of data transmission. This, in turn, improves the efficiency and intelligence of data processing for bus communication data frames.

[0081] In an optional embodiment, such as Figure 4 As shown, the determining module 301 is also used to determine the data frame byte length of the target data frame before the generating module 302 generates the log record information corresponding to the target data frame based on the target data frame and the first target type. The device also includes: The judgment module 304 is used to determine whether the data frame byte length matches the preset data frame length threshold; when it is determined that the data frame byte length matches the preset data frame length threshold, the generation module 302 is triggered to perform the operation of generating log record information corresponding to the target data frame based on the target data frame and the first target type.

[0082] It is evident that implementation Figure 4The described device can determine the data frame byte length of the target data frame and judge whether it matches the preset data frame length threshold. If it matches, it triggers the operation of generating corresponding log record information based on the target data frame and the first target type. It can remove the data that affects the target data frame to ensure that the final log only contains valid data that conforms to the protocol length specification, avoiding invalid data from occupying log storage space and interfering with subsequent parsing. This is beneficial to improving the efficiency and intelligence of subsequent data processing and data transmission. It can also ensure that the log content is all valid communication data, which saves storage and bandwidth resources, improves the accuracy of log retrieval and analysis, and further improves the accuracy and reliability of data transmission. In turn, it can improve the efficiency of data processing of bus communication data frames and the intelligence of data processing of bus communication data frames.

[0083] In another alternative embodiment, such as Figure 4 As shown, the generation module 302 is also used to generate abnormal frame information of the target data frame based on the data frame byte length and the preset data frame length threshold when the judgment module 304 determines that the data frame byte length does not match the preset data frame length threshold, and generate an abnormal identification field based on the abnormal frame information. The specific methods by which the generation module 302 generates log record information corresponding to the target data frame based on the target data frame and the first target type include: Based on the target data frame, the first target type, and the exception identifier field, generate the log record information corresponding to the target data frame.

[0084] It is evident that implementation Figure 4The described device can generate abnormal frame information and an abnormal identification field for the target data frame when it is determined that the data frame byte length does not match the data frame length threshold. It also generates log record information corresponding to the target data frame based on the target data frame, the first target type, and the abnormal identification field. This device can combine the data frame byte length and the data frame length threshold to generate abnormal frame information and the abnormal identification field, allowing for instantaneous determination of the abnormal type solely through the identification field without parsing log details. This improves the accuracy and reliability of determining abnormal information in the target data frame, enhances the intelligence and efficiency of viewing abnormal information, enables rapid identification and classification of abnormal information, avoids tool failures due to log format changes, and facilitates subsequent overall data statistics through the unified structure of normal and abnormal logs. Furthermore, it ensures that all log content is valid communication data, saving storage and bandwidth resources, improving the accuracy of log retrieval and analysis, further enhancing the accuracy and reliability of data transmission, and ultimately improving the efficiency and intelligence of bus communication data frame data processing.

[0085] In yet another alternative embodiment, such as Figure 4 As shown, the specific method by which the transmission module 303 transmits the data frame content to the second host machine includes: Determine the communication priority parameters of the bus communication entity of the second host machine, and based on the communication priority parameters of the second host machine, determine the transmission priority of each data frame to be transmitted included in the data frame content; The data transmission order is generated based on the transmission priority of each data frame to be transmitted; In accordance with the data transmission order, each data frame included in the data frame content is transmitted to the second host machine.

[0086] It is evident that implementation Figure 4The described apparatus can determine the communication priority parameters of the bus communication entity of the second host machine and determine the transmission priority of each data frame to be transmitted included in the data frame content. It generates a data transmission order based on the transmission priority and transmits each data frame included in the data frame content to the second host machine. By classifying data frames by priority, higher-priority data frames can occupy bus resources first, reducing waiting time. This facilitates on-demand allocation of bus resources through real-time data transmission and transmission efficiency, avoiding response delays in high-priority services due to insufficient resources, thus improving overall transmission efficiency. It also reduces data loss in the second host machine due to receiver overload, ensuring the success and integrity of data reception by the second host machine, further improving the accuracy and reliability of data transmission. This, in turn, improves the efficiency of data processing for bus communication data frames and enhances the intelligence of data processing for bus communication data frames.

[0087] In yet another alternative embodiment, such as Figure 4 As shown, the device also includes: The acquisition module 305 is used to acquire the data transmission result of the target data frame; The generation module 302 is also used to generate target log records based on the data transmission results; Extraction module 306 is used to extract characteristic log information of the target log record; The generation module 302 is also used to generate associated index information based on the feature log information, and based on the key index information; The traceability module 307 is used to perform data traceability operations on the data of the first and second machines to obtain the data traceability results.

[0088] It is evident that implementation Figure 4 The described device can acquire the data transmission results of the target data frame and generate target log records, extract feature log information from the target log records and generate associated index information, and then perform data tracing operations on the first and second machines to obtain data tracing results. It can accurately locate the tracing path and obtain data tracing results based on feature log information and associated index information, which helps improve the accuracy and reliability of the obtained data tracing results, as well as their intelligence and efficiency. Furthermore, it can determine the transmission and processing status of the target data frame through panoramic monitoring communication and data tracing results, which helps improve the efficiency and intelligence of data processing. It also provides accurate basis for long-term system optimization, promotes continuous improvement of communication capabilities, further improves the accuracy and reliability of data transmission, and thus helps improve the efficiency and intelligence of data processing for bus communication data frames.

[0089] In yet another alternative embodiment, such as Figure 4 As shown, the acquisition module 305 is also used to acquire the first clock parameter corresponding to the first bit machine, the second clock parameter corresponding to the second bit machine, and the third clock parameter corresponding to the intermediate entity before the generation module 302 generates the associated index information based on the feature log information. The determination module 301 is also used to determine the clock deviation values ​​of the first clock parameter, the second clock parameter, and the third clock parameter, and to perform a clock compensation calibration operation on the feature log information based on the clock deviation values ​​to obtain the clock calibration result; The device also includes: The update module 308 is used to perform update operations on the feature log information based on the clock calibration results.

[0090] It is evident that implementation Figure 4 The described device can acquire the first clock parameters of the first machine, the second clock parameters of the second machine, and the third clock parameters of the intermediate entity, and determine the clock deviation value. It then performs clock compensation calibration on the feature log information to obtain the clock calibration result. Based on the clock calibration result, it performs an update operation on the feature log information. This unifies the time base of multiple devices, solving the log time chaos problem caused by the asynchronous clocks of the first machine, the second machine, and the intermediate entity. It provides a reliable time basis for subsequent index association and data traceability, ensuring the continuity of log timestamps for the same data frame across the first machine, the intermediate entity, and the second machine, avoiding log association failures due to time deviations. Statistical analysis based on the unified time base can optimize transmission strategies, further improving the accuracy and reliability of data transmission. This, in turn, helps improve the efficiency of data processing for bus communication data frames and enhances the intelligence of data processing for bus communication data frames.

[0091] In yet another alternative embodiment, such as Figure 4 As shown, the determining module 301 is also used to determine the frame type field of each data frame content based on the target log record; and to determine the classification database table corresponding to each data frame content based on the frame type field of each data frame content. The device also includes: Storage module 309 is used to store the data frame content into the category database table corresponding to the data frame content; The table name of the categorized database table matches the frame type field of each data frame content.

[0092] It is evident that implementation Figure 4The described device can determine the frame type field of each data frame content and the corresponding classification database table based on the target log record, and store the data frame content pairs in the corresponding classification database table. This enables typed, specialized, and efficient storage of data frames, solving the problems of inefficient querying and complex management caused by traditional hybrid storage. It is beneficial to improve the intelligence and efficiency of data processing, as well as the accuracy and reliability of data processing. It can also improve the efficiency of data querying, and improve the convenience and reliability of data processing by optimizing the data storage structure. By supporting differentiated management through the separate table storage of different types of data frames, it is beneficial to improve data transmission and ensure data integrity and security, further improving the accuracy and reliability of data transmission, thereby improving the efficiency of data processing of bus communication data frames and enhancing the intelligence of data processing of bus communication data frames.

[0093] Example 4 Please see Figure 5 , Figure 5 This is a schematic diagram of the structure of another data processing device for communication data frames disclosed in an embodiment of the present invention. For example... Figure 5 As shown, the data processing device for the communication data frame may include: Memory 401 storing executable program code; Processor 402 coupled to memory 401; The processor 402 calls the executable program code stored in the memory 401 to execute some or all of the steps in the data processing of any communication data frame in Embodiment 1 of the present invention.

[0094] Example 5 This invention discloses a computer storage medium storing computer instructions. When these computer instructions are invoked, they are used to execute some or all of the steps in any of the data processing methods for communication data frames disclosed in Embodiment 1 of this invention.

[0095] The device embodiments described above are merely illustrative. The modules described as separate components may or may not be physically separate. The components shown as modules may or may not be physical modules; that is, they may be located in one place or distributed across multiple network modules. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0096] Through the detailed description of the above embodiments, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, including read-only memory (ROM), random access memory (RAM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), one-time programmable read-only memory (OTPROM), electrically-Erasable Programmable Read-Only Memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disc storage, disk storage, magnetic tape storage, or any other computer-readable medium that can be used to carry or store data.

[0097] Finally, it should be noted that the above embodiments are merely preferred embodiments of the present invention and are only used to illustrate the technical solutions of the present invention, not to limit them. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A data processing method for communication data frames, characterized in that, The method includes: When the intermediate entity receives the target data frame sent by the first host, it determines the data flow direction information of the target data frame based on the first host and the target data frame, and determines the first target type based on the data flow direction information; Based on the target data frame and the first target type, generate log recording information corresponding to the target data frame; Based on the log information and the target data frame, a second target type is determined, and based on the second target type, data frame content is generated and transmitted to the second host machine.

2. The data processing method for communication data frames according to claim 1, characterized in that, Before generating the log recording information corresponding to the target data frame based on the target data frame and the first target type, the method further includes: Determine the data frame byte length of the target data frame, and determine whether the data frame byte length matches a preset data frame length threshold; When it is determined that the length of the data frame matches the preset data frame length threshold, the operation of generating log recording information corresponding to the target data frame based on the target data frame and the first target type is triggered.

3. The data processing method for communication data frames according to claim 2, characterized in that, The method further includes: When it is determined that the length of the data frame does not match the preset data frame length threshold, abnormal frame information of the target data frame is generated based on the length of the data frame and the preset data frame length threshold, and an abnormal identification field is generated based on the abnormal frame information. The step of generating log record information corresponding to the target data frame based on the target data frame and the first target type includes: Based on the target data frame, the first target type, and the anomaly identifier field, generate log record information corresponding to the target data frame.

4. The data processing method for communication data frames according to claim 1, characterized in that, The step of transmitting the data frame content to the second host machine includes: Determine the communication priority parameters of the bus communication entity of the second host machine, and based on the communication priority parameters of the second host machine, determine the transmission priority of each data frame to be transmitted included in the data frame content; A data transmission order is generated based on the transmission priority of each of the data frames to be transmitted; According to the data transmission order, each data frame included in the data frame content is transmitted to the second host machine.

5. The data processing method for communication data frames according to claim 1, characterized in that, The method further includes: Obtain the data transmission result of the target data frame, and generate a target log record based on the data transmission result; Extract the characteristic log information of the target log record, generate associated index information based on the characteristic log information, and perform data tracing operation on the data of the first host machine and the second host machine based on the key index information to obtain the data tracing result.

6. The data processing method for communication data frames according to claim 5, characterized in that, Before generating the associated index information based on the feature log information, the method further includes: Obtain the first clock parameter corresponding to the first host machine, the second clock parameter corresponding to the second host machine, and the third clock parameter corresponding to the intermediate entity; Determine the clock deviation values ​​of the first clock parameter, the second clock parameter, and the third clock parameter; perform a clock compensation calibration operation on the feature log information based on the clock deviation values ​​to obtain a clock calibration result. Based on the clock calibration results, an update operation is performed on the feature log information.

7. The data processing method for communication data frames according to claim 5, characterized in that, The method further includes: Based on the target log records, determine the frame type field of each data frame content; Based on the frame type field of each data frame content, determine the classification database table corresponding to each data frame content; For each data frame content, the data frame content is stored in the corresponding classification database table according to the classification database table of the data frame content; The table name of the classification database table matches the frame type field of each data frame content.

8. A data processing apparatus for communication data frames, characterized in that, The device includes: The determination module is used to determine the data flow direction information of the target data frame based on the first host and the target data frame when the intermediate entity receives the target data frame sent by the first host, and to determine the first target type based on the data flow direction information. The generation module is used to generate log record information corresponding to the target data frame based on the target data frame and the first target type. The determining module is further configured to determine a second target type based on the log record information and the target data frame; The generation module is further configured to generate data frame content based on the second target type; The transmission module is used to transmit the data frame content to the second host machine.

9. A data processing apparatus for communication data frames, characterized in that, The device includes: Memory containing executable program code; A processor coupled to the memory; The processor calls the executable program code stored in the memory to execute the data processing method for communication data frames as described in any one of claims 1-7.

10. A computer storage medium, characterized in that, The computer storage medium stores computer instructions, which, when invoked, are used to execute the data processing method for communication data frames as described in any one of claims 1-7.

Images