Data processing method and system for time mark instruction
By adding time stamps and combining data blocks at the command sending end in the satellite system, and creating an archive area at the receiving end according to time-segmentation rules, the problems of out-of-order time stamp commands and large data volume processing are solved, achieving efficient and reliable data processing and querying, which is suitable for edge computing and embedded environments.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-11-07
- Publication Date
- 2026-03-10
AI Technical Summary
During satellite operation, the out-of-order timing instructions and the processing of large amounts of data pose challenges. Traditional methods are complex to deploy in resource-constrained environments, have high resource costs, rely on databases which affect performance, and have poor data controllability.
By adding timestamps and combining them to generate data blocks at the command sending end, and creating an archiving area at the receiving end according to the time sharding rules, the sequential archiving and querying of data blocks can be realized. The binary search method is used to improve query efficiency and avoid database dependencies.
It enables efficient and reliable time-stamped instruction processing in resource-constrained environments, reduces deployment complexity and resource overhead, and improves query efficiency and data controllability.
Smart Images
Figure CN121635963A_ABST
Abstract
Description
Technical Field
[0001] This disclosure belongs to the field of data transmission technology, and in particular relates to a data processing method and system for time stamp instructions. Background Technology
[0002] As a key type of satellite command, time-stamped commands encompass the execution time and command code information. During the satellite's on-orbit operation, there is a significant need for time-stamped commands.
[0003] Processing time-stamped instructions presents numerous challenges. Firstly, the time-stamped information is out of order each time it is added, and the sheer volume of time-stamped instruction data poses a significant challenge to processing. Secondly, traditional methods rely on a central database, making them unsuitable for constrained environments where a central database is unavailable. Furthermore, they suffer from complex deployment, high resource overhead, write performance affected by database transactions and locking mechanisms, dependence on database service availability, and poor data controllability. Summary of the Invention
[0004] To address the aforementioned issues, this disclosure provides a data processing method, system, electronic device, and storage medium for time-stamped instructions. This solution features low deployment complexity, eliminates the need for database installation, configuration, and maintenance, minimizes resource overhead, and boasts strong architectural resilience, making it suitable for resource-constrained environments such as edge computing and embedded systems.
[0005] To address the aforementioned technical problems, the first aspect of this invention proposes a data processing method for time stamp instructions, the method comprising: The instruction sending end receives a time stamp instruction. When the time stamp instruction meets the preset batch conditions, it adds a time stamp to each time stamp instruction, combines them to generate a data block, and sends it to the instruction receiving end. The instruction receiving end creates archive areas corresponding to different time ranges based on preset time segmentation rules; After receiving the data block, the instruction receiving end archives the time-stamped instructions in the data block to the archive area of the corresponding time range according to the time stamp.
[0006] According to a preferred embodiment of the present invention, the step of archiving the time stamp instructions in the data block to the archiving area of the corresponding time range according to the time stamp after receiving the data block includes: After receiving the data block, the data block is temporarily stored in the receive buffer area; The instruction receiving end periodically parses each of the received data blocks to obtain time-stamped instructions; The time-stamped instructions are sorted according to their time stamp and instruction sequence stamp, and then archived to the archive area corresponding to the time range.
[0007] According to a preferred embodiment of the present invention, the step of combining and generating data blocks and sending them to the instruction receiving end includes: The data block is generated by combining time-stamped instructions with added time stamps; A unique identifier sequence marker is added to the data block and sent to the instruction receiving end.
[0008] According to a preferred embodiment of the present invention, before the instruction receiving end periodically parses each of the received data blocks, the processing method further includes: Obtain the unique identifier sequence marker for each of the data blocks; The unique identifier sequence markers are determined to be consecutive. If the unique identifier sequence markers are not consecutive, the instruction receiving end sends the missing unique identifier sequence markers to the instruction sending end so that the instruction sending end retransmits the corresponding data block.
[0009] According to a preferred embodiment of the present invention, before sorting the time stamp instructions according to the time stamp and instruction sequence stamp, the data processing method further includes: The continuity of the instruction sequence markings of each time-marked instruction determines whether the time-marked instruction in the corresponding data block is missing; When a time stamp instruction is missing in a data block, the instruction receiving end sends a unique identifier sequence mark corresponding to the data block with the missing time stamp instruction to the instruction sending end, so that the instruction sending end can resend the corresponding data block.
[0010] According to a preferred embodiment of the present invention, the method further includes: When the instruction receiving end receives an instruction query request, it locates at least one archived area as the query area based on the time range queried in the instruction query request. Based on the binary search method, the time-stamped instruction corresponding to the instruction query request is queried within the query area and feedback is provided.
[0011] According to a preferred embodiment of the present invention, the instruction receiving end creates archive areas corresponding to different time ranges based on preset time segmentation rules, including: The instruction receiving end divides the time into different time slices based on the preset time slicing rules; When the system time enters a new time slice, an archive area corresponding to the new time slice is created.
[0012] To address the aforementioned technical problems, a second aspect of the present invention provides a data processing system for time-stamped instructions, comprising: an instruction sending end and an instruction receiving end, wherein the instruction sending end includes: The first data receiving module is used to receive time stamp instructions; The instruction combination module is used to add time stamps to each of the time stamp instructions and combine them to generate a data block when the time stamp instructions meet the preset batch conditions; The first data sending module is used to send the data block to the instruction receiving end; The instruction receiving end includes: The second data receiving module is used to receive the data block; The archive area creation module is used to create archive areas corresponding to different time ranges based on preset time segmentation rules; The data archiving module is used to archive the time stamp instructions in the data block to the archiving area of the corresponding time range according to the time stamp after receiving the data block.
[0013] According to a preferred embodiment of the present invention, the data archiving module further includes: a data caching unit, used to temporarily store the data block in a receiving buffer area after receiving the data block; The data archiving module is specifically used to periodically parse each of the received data blocks to obtain time-stamped instructions; sort the time-stamped instructions according to the time stamp and instruction sequence stamp of the time-stamped instructions, and archive them to the archiving area of the corresponding time range.
[0014] According to a preferred embodiment of the present invention, the instruction combination module is specifically used to combine time-stamped instructions with added time stamps to generate the data block; add a unique identifier sequence mark to the data block, and send it to the instruction receiving end.
[0015] According to a preferred embodiment of the present invention, the data archiving module further includes: a first missing query unit, configured to obtain unique identifier sequence markers for each data block; determine whether each unique identifier sequence marker is continuous; and when each unique identifier sequence marker is not continuous, invoke the second data sending module of the instruction receiving end to send the missing unique identifier sequence markers to the instruction sending end; The instruction sending end further includes a data retransmission module, used to retransmit the corresponding data block to the instruction receiving end when a missing unique identifier sequence marker is received.
[0016] According to a preferred embodiment of the present invention, the data archiving module further includes: a second missing query unit, configured to determine whether a time stamp instruction in the corresponding data block is missing based on the continuity of the instruction sequence markers of each time stamp instruction; when a time stamp instruction in the data block is missing, the second data sending module of the instruction receiving end is invoked to send a unique identifier sequence marker corresponding to the data block with the missing time stamp instruction to the instruction sending end; The instruction sending end further includes a data retransmission module, used to retransmit the corresponding data block to the instruction receiving end when the unique identifier sequence marker corresponding to the data block with missing time stamp instruction is received.
[0017] According to a preferred embodiment of the present invention, the instruction receiving end further includes: an instruction query module, configured to, upon receiving an instruction query request, locate at least one archived area as a query area based on the time range queried in the instruction query request; query the time-stamped instruction corresponding to the instruction query request within the query area based on a binary search method, and provide feedback.
[0018] According to a preferred embodiment of the present invention, the archive area creation module is specifically used to divide the system into different time slices based on the preset time slicing rules; when the system time enters a new time slice, an archive area corresponding to the new time slice is created.
[0019] Compared with existing technologies, this disclosure has the following advantages: The instruction sending end receives time-stamped instructions, adds time stamps when batch conditions are met, and combines them into data blocks before sending them to the instruction receiving end; the instruction receiving end creates archiving areas for different time ranges based on preset time sharding rules, and archives the time-stamped instructions to the corresponding areas according to the time stamps after receiving the data blocks. This solution converts random small data blocks into sequential append writing, resulting in high write performance; time-sharded archiving eliminates the need to scan the entire history when querying data for a specific time period, enabling rapid location and high query efficiency; furthermore, it has low deployment complexity, requires no database installation, configuration, or maintenance, has low resource overhead, and strong architectural resilience, making it suitable for resource-constrained environments such as edge computing and embedded systems.
[0020] Other features and advantages of this disclosure will be set forth in the description which follows, and will be apparent in part from the description, or may be learned by practicing the disclosure. The objects and other advantages of this disclosure may be realized and obtained by means of the structures pointed out in the description, claims and drawings. Attached Figure Description
[0021] To more clearly illustrate the technical solutions in the embodiments of this disclosure or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this disclosure. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0022] Figure 1 A schematic flowchart of a data processing method for time-stamped instructions according to an embodiment of the present disclosure is shown; Figure 2A second schematic flowchart of a data processing method for time-stamped instructions according to an embodiment of the present disclosure is shown; Figure 3 A third schematic flowchart of a data processing method for time-stamped instructions according to an embodiment of the present disclosure is shown; Figure 4 A schematic diagram of a data processing system architecture for time-stamped instructions according to an embodiment of the present disclosure is shown. Detailed Implementation
[0023] To make the objectives, technical solutions, and advantages of the embodiments of this disclosure clearer, the technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this disclosure, and not all embodiments. Based on the embodiments of this disclosure, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this disclosure.
[0024] The same reference numerals in the accompanying drawings denote the same or similar elements, components, or parts, and therefore, repeated descriptions of the same or similar elements, components, or parts may be omitted below. It should also be understood that although terms such as first, second, third, etc., indicating numbers may be used herein to describe various devices, elements, components, or parts, these devices, elements, components, or parts should not be limited by these terms. That is, these terms are only used to distinguish one from another. For example, a first device may also be referred to as a second device, without departing from the essential technical solution of the invention. Furthermore, the terms "and / or" and "and / or" refer to all combinations including the first or more of the listed items.
[0025] Please see Figure 1 , Figure 1 This is a schematic diagram of one of the data processing methods for time-stamped instructions provided by the present invention, as follows: Figure 1 As shown, the processing methods include: S11. The instruction sending end receives the time stamp instruction. When the time stamp instruction meets the preset batch conditions, it adds a time stamp to each time stamp instruction, combines them to generate a data block, and sends it to the instruction receiving end.
[0026] In this embodiment, the instruction sender can be a data acquisition end. The data acquisition end caches the time-stamped instruction obtained from the remote control locally, serializes the cached instruction and metadata into a self-describing data block, and assigns a globally unique block sequence number to the data block. Then, the data block file is uploaded to the satellite, i.e., the instruction receiver.
[0027] In this embodiment, the preset batch conditions can be time range batch conditions, instruction type batch conditions, sequence mark continuity batch conditions, time-stamped instruction quantity batch conditions, execution status batch conditions, data block integrity batch conditions, storage location batch conditions, etc. Specifically, the time range batch condition divides the batch processing time interval according to the instruction's time stamp (such as generation time, execution time). The instruction type batch condition classifies the batches according to the instruction's functional category (such as attitude control, data acquisition, communication). The sequence mark continuity batch condition checks the continuity of the instruction sequence marks and identifies missing or duplicate instruction batches.
[0028] In this embodiment, the self-describing data block is a structured data block. Instead of uploading scattered instructions, this solution serializes a batch of instructions into a custom-formatted binary file (i.e., a self-describing data block). This file contains a block header (metadata) and a data body.
[0029] Data block structure: [Magic Number]['v1.0'][Block Serial Number][Acquisition Terminal ID][Number of Commands N] [Timestamp 1][Serial Number 1][Command Content 1 Length][Command Content 1] [Timestamp 2][Serial Number 2][Command Content 2 Length][Command Content 2] ... [Timestamp N][Serial Number N][Instruction Content N Length][Instruction Content N].
[0030] In this embodiment, the serialization format of the self-describing data block includes: a block header magic number, protocol version, block sequence number, data acquisition terminal ID, number of instructions, and an instruction data body composed of "timestamp, instruction sequence number, and instruction content". The timestamp is the time stamp in this scheme. The timestamp in this scheme can be the system's period and time, or it can be the time difference relative to a certain reference time point (such as satellite startup time, the execution time of the previous instruction, etc.), or it can be a time slice where time is divided into multiple consecutive time periods (time slices) according to predefined time slicing rules, and each time slice is assigned a unique identifier.
[0031] In this embodiment, the instruction sending end is responsible for receiving time-stamped instructions. When the number or conditions of the received time-stamped instructions reach a preset batch standard, a timestamp is added to each time-stamped instruction. Subsequently, these tagged instructions are combined to form a data block and sent to the instruction receiving end. By batch processing and combining them into data blocks, the number of times scattered instructions are transmitted is reduced, and transmission overhead is lowered. At the same time, the timestamps provide a key basis for the accurate sorting and archiving of subsequent instructions at the receiving end, which helps to improve the overall instruction processing efficiency and accuracy.
[0032] S12. The instruction receiving end creates archive areas corresponding to different time ranges based on preset time slicing rules.
[0033] In this embodiment, the instruction receiving end creates multiple archive areas corresponding to different time ranges according to pre-set time slicing rules. By creating archive areas based on time slicing, it is not necessary to scan all historical data when querying data for a certain time period; it is only necessary to locate the archive area corresponding to the time range, which greatly improves query efficiency. It also facilitates data lifecycle management, such as backing up or deleting data by file (time slice).
[0034] In this embodiment, the preset time-slicing rules are pre-defined by the instruction receiving end, such as dividing the time axis according to fixed durations (e.g., hourly, daily) or dynamic events (e.g., satellite orbital period). Each time slice corresponds to an independent archive file, and the filename contains time information (e.g., "20250101_0000-0100.dat" represents instructions from 00:00 to 01:00 on January 1st). When the system time enters a new time slice, the software automatically creates a new archive file, and subsequently received instructions are appended to the corresponding file according to the timestamp.
[0035] Specifically, based on preset time-slicing rules, different time slices are obtained; when the system time enters a new time slice, an archive area corresponding to the new time slice is created. A time-slicing rule is predefined, and when the system time enters a new time slice, a new archive file is automatically created; all instructions within the scope of that time slice are appended to this file; the filename contains time-slice information.
[0036] S13. After receiving the data block, the instruction receiving end archives the time-stamped instructions in the data block to the archive area of the corresponding time range according to the time stamp.
[0037] In this embodiment, after the instruction receiving end acquires the data block, it accurately identifies the time range to which the instruction belongs based on the time stamp carried by the time stamp instruction within the data block, and then archives and stores it in the archive area of the corresponding time range. This allows the archived files to be arranged in chronological order, enabling quick location of the corresponding archive area when querying instructions for a specific time period. Specifically, a binary search method can be used to improve query speed, and it also facilitates data lifecycle management by time slice, enhancing data controllability.
[0038] In this embodiment, since time-stamped instructions are archived based on time stamps, if the arrival order of data blocks is disordered, the time-stamped instructions in the data blocks can be archived to the archiving area of the corresponding time slice. This ensures that the time-stamped instructions in data blocks arriving at the instruction receiving end at different times can be archived to the accurate position, guaranteeing that the satellite can work according to the accurate instruction stream.
[0039] The instruction sending end in this disclosure receives time-stamped instructions, adds time stamps when batch conditions are met, and combines them into data blocks before sending them to the instruction receiving end. The instruction receiving end creates archiving areas for different time ranges based on preset time sharding rules, and archives the time-stamped instructions to the corresponding areas according to the time stamps after receiving the data blocks. This solution converts random small data blocks into sequential append writing, resulting in high write performance; time-sharded archiving eliminates the need to scan the entire history when querying data for a specific time period, enabling rapid location and high query efficiency; furthermore, it has low deployment complexity, requires no database installation, configuration, or maintenance, has low resource overhead, and strong architectural resilience, making it suitable for resource-constrained environments such as edge computing and embedded systems.
[0040] Please see Figure 2 , Figure 2 This is a second schematic diagram of a data processing method for time stamp instructions provided by the present invention, as shown below. Figure 2 As shown, the processing method includes the following steps: S21. After receiving the data block, temporarily store the data block in the receive buffer area.
[0041] In this embodiment, after successfully receiving a data block, complex processing is not performed immediately. Instead, the data blocks are temporarily stored in a pre-defined receiving buffer area (a temporary disk directory). This scheme effectively isolates data reception from subsequent processing through a buffering mechanism, avoiding data loss or reception blockage due to processing delays. At the same time, it provides a stable data source for the background merging and sorting process, ensuring the continuity and reliability of the massive instruction processing flow.
[0042] S22. The instruction receiving end periodically parses each received data block to obtain time-stamped instructions.
[0043] In this embodiment, a periodic timing mechanism triggers the processing flow, actively scanning the data block files temporarily stored in the receive buffer area. The binary structure of each data block (including block header metadata and instruction data body) is parsed one by one to extract key time-stamped instruction information such as timestamps, instruction sequence numbers, and instruction content. By replacing real-time single-instruction processing with periodic batch parsing, the frequency of I / O operations and CPU resource consumption are significantly reduced, while ensuring that massive amounts of time-stamped instructions can continuously flow into subsequent processing flows in chronological order, balancing system efficiency and instruction processing integrity.
[0044] S23. Sort the time-stamped instructions according to their time stamp and instruction sequence stamp, and archive them to the archive area of the corresponding time range.
[0045] In this embodiment, the time range to which a time-stamped instruction belongs is first determined based on the timestamp inherent in the instruction. Simultaneously, the instructions are sorted according to their chronological order as indicated by the timestamps. Finally, the sorted instructions are stored in the archive area corresponding to the time range. This sorting and archiving method achieves dual orderliness in both time and sequence for instructions. It facilitates quick querying of instructions by time period, improving retrieval efficiency, while also ensuring the accuracy of the logical sequence of instruction execution within the same time period, enhancing the systematic nature and reliability of instruction management.
[0046] Specifically, the merge sorting process is a background service that periodically (e.g., every second) performs the following operations: 1) Collection: Reads all data block files from the buffer directory. 2) Parsing and Sorting: Parses each block and loads all instructions into memory. 3) Global Sorting: Sorts the instructions by timestamp. 4) Archiving: Appends the sorted instruction stream to the currently active archive file. 5) Cleanup: Moves processed data block files to the "Processed" directory or deletes them directly.
[0047] In this embodiment, to ensure that all data blocks are received, a unique identifier sequence mark (i.e., the globally unique sequence number in the above embodiment) can be obtained before periodically parsing each received data block. It is then determined whether each unique identifier sequence mark is consecutive. If each unique identifier sequence mark is not consecutive, the instruction receiving end sends the missing unique identifier sequence mark to the instruction sending end so that the instruction sending end can resend the corresponding data block.
[0048] In this embodiment, before periodically parsing data blocks, the instruction receiver first obtains the unique identifier sequence markers for each data block and checks their continuity. If a discontinuity is found, it reports the missing markers to the instruction sender, which then retransmits the corresponding data block accordingly. This scheme effectively detects data block reception, accurately locates missing data using unique identifier sequence markers, and promptly triggers the retransmission mechanism, ensuring the integrity and accuracy of data reception and avoiding instruction processing errors or system failures caused by missing data.
[0049] In this embodiment, to ensure that the data block is received completely, before sorting the time stamp instructions according to the time stamp and instruction sequence mark of the time stamp instructions, it can be determined whether the time stamp instructions in the corresponding data block are missing based on the continuity of the instruction sequence marks of each time stamp instruction; when the time stamp instructions in the data block are missing, the instruction receiving end sends the unique identifier sequence mark corresponding to the data block with missing time stamp instructions to the instruction sending end so that the instruction sending end can resend the corresponding data block.
[0050] In this embodiment, before sorting by time and sequence marker of the time-stamped instructions, the instruction receiver first checks whether the instruction sequence markers of each time-stamped instruction are consecutive, thereby determining whether any time-stamped instructions are missing within the corresponding data block. If a missing instruction is found, the receiver sends the unique identifier sequence marker of the data block containing the missing instruction to the sender, prompting the sender to retransmit the data block. This scheme, through the continuity check of instruction sequence markers, can quickly and accurately locate missing instructions in a data block, promptly triggering the retransmission mechanism, effectively ensuring the integrity of data block reception, avoiding subsequent processing errors due to missing instructions, and improving the reliability and stability of system data transmission.
[0051] Please see Figure 3 , Figure 3 This is a schematic diagram of the data processing method for time stamp instructions provided by the present invention, as shown in the third example. Figure 3 As shown, the processing method includes the following steps: S31. When the instruction receiving end receives an instruction query request, it locates at least one archived area as the query area based on the time range queried in the instruction query request.
[0052] In this embodiment, after receiving a query request, the command receiving end extracts the specified query time range from the request. Based on a preset rule for dividing archive areas by time, it quickly determines at least one archive area covering the time range and sets it as the target area for this query. By accurately locating the archive area through the time range, the query scope is significantly narrowed, avoiding full data scanning, effectively improving query efficiency, reducing system resource consumption, and making the command retrieval process faster and more accurate.
[0053] S32. Based on the binary search method, search for the time-stamped instruction corresponding to the instruction query request within the query area and provide feedback.
[0054] In this embodiment, within the located query area, the efficient binary search algorithm is used. Using the time stamp or sequence mark of the time-stamped instruction as the key index, the algorithm quickly locates the time-stamped instruction matching the query request within the ordered instruction data. Binary search reduces the search time complexity from linear to logarithmic, significantly improving query efficiency. It is particularly effective in providing fast and accurate results in large-scale time-stamped instruction data, reducing system response time.
[0055] Please see Figure 4 , Figure 4 The present invention provides a data processing system for time-stamped instructions, comprising: an instruction sending end and an instruction receiving end. The instruction sending end includes: a first data receiving module, an instruction combination module, and a first data sending module; the instruction receiving end includes: a second data receiving module, an archive area creation module, and a data archiving module.
[0056] In this embodiment, the first data receiving module is used to receive time stamp instructions.
[0057] In this embodiment, the instruction combination module is used to add time stamps to each time stamp instruction and combine them to generate a data block when the time stamp instructions meet the preset batch conditions.
[0058] In this embodiment, the first data sending module is used to send data blocks to the instruction receiving end; In this embodiment, the second data receiving module is used to receive data blocks.
[0059] In this embodiment, the archive area creation module is used to create archive areas corresponding to different time ranges based on preset time segmentation rules.
[0060] In this embodiment, the data archiving module is used to archive the time stamp instructions in the data block to the archiving area of the corresponding time range according to the time stamp after receiving the data block.
[0061] In this embodiment, the data archiving module further includes a data caching unit, used to temporarily store the data block in the receiving buffer area after receiving the data block.
[0062] In this embodiment, the data archiving module is specifically used to periodically parse each received data block to obtain time-stamped instructions; sort the time-stamped instructions according to the time stamp and instruction sequence stamp of the time-stamped instructions, and archive them to the archiving area of the corresponding time range.
[0063] In this embodiment, the instruction combination module is specifically used to combine time-stamped instructions with added time stamps to generate a data block; add a unique identifier sequence mark to the data block, and send it to the instruction receiving end.
[0064] In this embodiment, the data archiving module further includes: a first missing query unit, used to obtain the unique identifier sequence markers of each data block; determine whether each unique identifier sequence marker is continuous; and when each unique identifier sequence marker is not continuous, call the second data sending module of the instruction receiving end to send the missing unique identifier sequence markers to the instruction sending end.
[0065] In this embodiment, the instruction sending end further includes a data retransmission module, which is used to retransmit the corresponding data block to the instruction receiving end when a missing unique identifier sequence marker is received.
[0066] In this embodiment, according to a preferred embodiment of the present invention, the data archiving module further includes: a second missing query unit, used to determine whether a time stamp instruction in a corresponding data block is missing based on the continuity of the instruction sequence markers of each time stamp instruction; when a time stamp instruction in a data block is missing, the second data sending module of the instruction receiving end is invoked to send a unique identifier sequence marker corresponding to the data block with the missing time stamp instruction to the instruction sending end.
[0067] In this embodiment, the instruction sending end further includes a data retransmission module, which is used to retransmit the corresponding data block to the instruction receiving end when a unique identifier sequence marker corresponding to a data block with missing time stamp instruction is received.
[0068] In this embodiment, the instruction receiving end further includes: an instruction query module, which is used to locate at least one archived area as the query area based on the time range queried in the instruction query request when receiving the instruction query request; and to query the time-stamped instruction corresponding to the instruction query request in the query area based on the binary search method, and then provide feedback.
[0069] In this embodiment, the archive area creation module is specifically used to divide the system into different time slices based on preset time slicing rules; when the system time enters a new time slice, an archive area corresponding to the new time slice is created.
[0070] Although the present disclosure has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features; and such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present disclosure.
Claims
1. A data processing method of time-stamped instructions, characterized in that, The processing method comprises: The instruction sending end receives time mark instructions, adds time marks to each of the time mark instructions when the time mark instructions meet preset batch conditions, combines to generate data blocks, and sends the data blocks to an instruction receiving end; The instruction receiving end creates archiving areas corresponding to different time ranges based on a preset time slicing rule; The instruction receiving end archives time mark instructions in the data blocks to archiving areas corresponding to the time ranges according to the time marks after receiving the data blocks.
2. The data processing method according to claim 1, characterized in that, The instruction receiving end archives time mark instructions in the data blocks to archiving areas corresponding to the time ranges according to the time marks after receiving the data blocks. The instruction receiving end archives time mark instructions in the data blocks to archiving areas corresponding to the time ranges according to the time marks after receiving the data blocks. The instruction receiving end archives time mark instructions in the data blocks to archiving areas corresponding to the time ranges according to the time marks after receiving the data blocks. The instruction receiving end archives time mark instructions in the data blocks to archiving areas corresponding to the time ranges according to the time marks after receiving the data blocks.
3. The data processing method according to claim 2, characterized in that, The instruction receiving end archives time mark instructions in the data blocks to archiving areas corresponding to the time ranges according to the time marks after receiving the data blocks. The processing method further comprises: The instruction receiving end locates at least one archiving area as a query area according to a time range queried in an instruction query request after receiving the instruction query request; 4. The data processing method according to claim 3, characterized in that, The instruction receiving end queries time mark instructions corresponding to the instruction query request in the query area based on a binary search method and feeds back. The instruction receiving end creates archiving areas corresponding to different time ranges based on a preset time slicing rule, which comprises: The instruction receiving end divides different time slices based on the preset time slicing rule; 5. The data processing method according to claim 3, characterized in that, When system time enters a new time slice, the instruction receiving end creates an archiving area corresponding to the new time slice. The processing method further comprises: An instruction sending end and an instruction receiving end, the instruction sending end comprising:
6. The data processing method of claim 1, wherein, A first data receiving module for receiving time mark instructions; An instruction combining module for adding time marks to each of the time mark instructions when the time mark instructions meet preset batch conditions, and combining to generate data blocks; An instruction sending end and an instruction receiving end, the instruction sending end comprising:
7. The data processing method according to any one of claims 1 to 6, characterized in that, A first data receiving module for receiving time mark instructions; An instruction combining module for adding time marks to each of the time mark instructions when the time mark instructions meet preset batch conditions, and combining to generate data blocks; 8. A data processing system for time-stamping instructions, characterized in that The first data sending module is configured to send the data block to an instruction receiving end. The instruction receiving end comprises: The second data receiving module is configured to receive the data block. The archiving area creating module is configured to create archiving areas corresponding to different time ranges based on a preset time slicing rule. The data archiving module is configured to archive the time mark instruction in the data block to the archiving area corresponding to the time range according to the time mark after receiving the data block.
9. The data processing system of claim 8, wherein, The data archiving module further comprises a data buffering unit configured to temporarily store the data block in a receiving buffer area after receiving the data block. The data archiving module is specifically configured to periodically parse the time mark instruction in each received data block, sort the time mark instruction according to the time mark and the instruction sequence mark of the time mark instruction, and archive the time mark instruction to the archiving area corresponding to the time range.
10. The data processing system of claim 9, wherein, The instruction combination module is specifically configured to combine the time mark instruction added with the time mark to generate the data block, add a unique sequence mark to the data block, and send the data block to the instruction receiving end.
11. The data processing system of claim 10, wherein, The data archiving module further comprises a first missing query unit configured to obtain the unique sequence mark of each data block, determine whether the unique sequence marks are continuous, and call the second data sending module of the instruction receiving end to send the missing unique sequence mark to the instruction sending end when the unique sequence marks are not continuous. The instruction sending end further comprises a data re-sending module configured to re-send the corresponding data block to the instruction receiving end when the missing unique sequence mark is received.
12. The data processing system of claim 10, wherein, The data archiving module further comprises a second missing query unit configured to determine whether the time mark instruction in the data block is missing according to the continuity of the instruction sequence mark of each time mark instruction, and call the second data sending module of the instruction receiving end to send the unique sequence mark corresponding to the data block with missing time mark instruction to the instruction sending end when the time mark instruction in the data block is missing. The instruction sending end further comprises a data re-sending module configured to re-send the corresponding data block to the instruction receiving end when the unique sequence mark corresponding to the data block with missing time mark instruction is received.
13. The data processing system of claim 8, wherein, The instruction receiving end further comprises an instruction query module configured to, when receiving an instruction query request, locate at least one archiving area as a query area according to the time range queried in the instruction query request, query the time mark instruction corresponding to the instruction query request in the query area based on the binary search method, and feed back.
14. A data processing system according to any one of claims 8 to 13, wherein, The archiving area creating module is specifically configured to divide different time slices based on the preset time slicing rule, and create an archiving area corresponding to a new time slice when the system time enters the new time slice.