Method and device for ultra-low latency packet scheduling based on hardware-implemented mode

The hardware-implemented mode-based ultra-low-latency packet scheduling device addresses the delay issues in SDN by using FPGA-based NIC card processing for immediate mode changes, ensuring efficient and safe autonomous vehicle operations by prioritizing critical signals and reducing resource waste.

WO2024232600A1PCT designated stage expired Publication Date: 2024-11-14FOUND OF SOONGSIL UNIV IND COOP +1
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2024/005972
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-07-04
Filing Date
2024-05-03
Publication Date
2024-11-14

AI Technical Summary

Technical Problem

Existing software-defined networking (SDN) methods in autonomous vehicles face significant delays in network switching, which is critical for ultra-low latency requirements, especially in emergency situations, due to reliance on remote control and software-based processing.

Method used

A hardware-implemented mode-based ultra-low-latency packet scheduling device and method that processes packet processing modes in parallel using a Field Programmable Gate Array (FPGA) on the Network Interface Controller (NIC) card, allowing for immediate mode changes with minimal latency, including a mode management module that dynamically adjusts packet priorities and propagates changes to other switch devices.

Benefits of technology

This solution enables ultra-low-latency network switching with almost no mode change delay, ensuring safe and efficient autonomous driving by prioritizing critical signals and reducing resource waste through hardware-based parallel processing and real-time mode changes.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2024005972_14112024_PF_FP_ABST
    Figure KR2024005972_14112024_PF_FP_ABST
Patent Text Reader

Abstract

A device for ultra-low latency packet scheduling based on a hardware-implemented mode according to an embodiment of the present invention may comprise: an input interface module that receives packet streams from a plurality of input devices; a packet processing module that processes the packet streams received from the input interface module; a mode management module that changes and sets a mode related to the packet processing of the packet processing module in real time and requests that the packet processing mode changed and set in real time be propagated to other switching devices; an output determination module that sets and outputs the priority of the packets according to the packet processing mode changed and set in real time by the mode management module; an output queue module for storing the packets which had the priority set by the output determination module; a mode propagation module that propagates the corresponding mode to the other switching devices in response to the request from the mode management module; and an output interface module that outputs the packets stored in the output queue module to the corresponding output devices according to the priority.
Need to check novelty before this filing date? Find Prior Art

Description

Mode-based ultra-low-latency packet scheduling device and method using hardware implementation

[0001] The present invention relates to a packet scheduling device and method, and more particularly, to a mode-based ultra-low latency (ULL) packet scheduling device and method, and more particularly, to a hardware-implemented mode-based ultra-low latency packet scheduling device and method.

[0002] The present invention was supported by the group research of the Ministry of Science and ICT (Project number: 1711137721, Project number: 2021R1A4A1032252, Research project title: Embedded cluster computing and deep learning lightweight technology for low-cost and high-reliability autonomous vehicles, Project management agency: National Research Foundation of Korea, Project implementation agency: Soongsil University Industry-Academic Cooperation Foundation, Research period: 2021.06.01 ~ 2024.02.29) and the Information and Communication Broadcasting Innovation Talent Development (Project number: 1711174068, Project number: IITP-2024-RS-2022-00156360, Research project title: Regional Intelligence Innovation Talent Development, Project management agency: Information and Communications Technology Planning and Evaluation Institute, Project implementation agency: Soongsil University Industry-Academic Cooperation Foundation, Research period: 2022.07.01 ~ This is derived from research conducted as part of the (December 31, 2029) project. Meanwhile, the Korean government has no property interest in any aspect of the present invention.

[0003] With the recent advancements in electric and autonomous vehicle technology, vehicles are increasingly equipped with numerous sensors and various electronic control processors and drive processes. These vehicles are essentially a collection of electronic components, and signal exchange between nodes within the vehicle is also rapidly increasing. Naturally, the number of network switches connecting these nodes is also increasing. To support this, Automotive Ethernet-based networks are actively being developed and deployed.

[0004] Meanwhile, autonomous vehicles must analyze numerous sensor signals to determine optimal driving decisions and control the driving system. This requires rapid response to emergencies, such as obstacles encountered during driving. Therefore, network switches must rapidly transmit numerous sensor and driving signals. However, as the number of network switches and signals increases, signal transmission delays become a critical challenge. Furthermore, signal bandwidth and timing requirements can rapidly change depending on system conditions, such as changes in the vehicle's driving environment. Consequently, signal forwarding policies (forwarding rules) must also dynamically adapt accordingly.

[0005] Existing software-defined networking (SDN) approaches can be leveraged to manage dynamic signaling policies. However, while in-vehicle ultra-low latency (ULL)—at least on the order of microseconds—must be guaranteed, existing SDN approaches can introduce delays on the order of milliseconds, posing a problem.

[0006] In a software-defined network, network switches query a higher-level SDN controller for signaling mode, which then remotely controls the signaling mode to control the switching process. This means that software-defined networking cannot guarantee ultra-low latency (ULL) switching delay within a vehicle.

[0007] Accordingly, a network switching method is required in situations where ultra-low switching delay must be guaranteed, such as in autonomous vehicles.

[0008] The present invention provides a mode-based ultra-low latency packet scheduling device and a mode-based ultra-low latency packet scheduling method implemented in hardware.

[0009] In addition, the present invention provides a hardware-implemented mode-based ultra-low latency packet scheduling device and a hardware-implemented mode-based ultra-low latency packet scheduling method that are configured to perform parallel processing of a packet processing mode change of a network switch based on hardware, thereby enabling ultra-low latency mode change.

[0010] In addition, the present invention provides a hardware-implemented mode-based ultra-low latency packet scheduling device and a hardware-implemented mode-based ultra-low latency packet scheduling method that can implement a safe and smooth autonomous driving process by being configured to be able to change modes immediately with almost no mode change delay in an emergency situation such as an autonomous vehicle, and that has the effect of enabling efficient network switching with limited resources.

[0011] A hardware-implemented mode-based ultra-low-latency packet scheduling device according to one aspect of the disclosed invention may be configured to include: an input interface module for receiving a packet stream from a plurality of input devices; a packet processing module for processing a packet stream received from the input interface module; a mode management module for changing and setting a packet processing mode in real time based on a processing result of the packet stream by the packet processing module; an output decision module for setting and outputting a packet priority according to the packet processing mode changed in real time by the mode management module; an output queue module for storing packets for which a priority is set by the output decision module; and an output interface module for outputting packets stored in the output queue module to a corresponding output device according to a priority.

[0012] In addition, the packet processing module may be implemented as a logic circuit in an FPGA (field programmable gate array) on the NIC (network interface controller) card, and may be configured to simultaneously and in parallel parse and identify each field header of a packet stream input from the input interface module using a plurality of multiplexers provided in the FPGA.

[0013] Additionally, the mode management module may be configured to request that the packet processing mode set to be changed in real time be propagated to another switch device.

[0014] Additionally, the mode management module may be configured to further include a mode propagation module that propagates the mode to the other switch device at the request of the mode management module.

[0015] In addition, it may be configured to further include a control interface module that receives an OpenFlow or similar control message from an SDN (software defined network) control device and inputs it into the mode management module.

[0016] Additionally, the mode management module may be configured to operate according to an openflow message received from the SDN control device.

[0017] In addition, the packet processing module may be configured to include a lookup table memory in which a lookup table regarding a packet processing mode is stored; a flow behavior monitoring unit that identifies each field header to be parsed by referring to the lookup table stored in the lookup table memory, determines whether the behavior of the corresponding flow violates the current packet processing mode on the lookup table, and, if the determination result is violated, generates a violation message and outputs it in real time to the mode management module.

[0018] In addition, the flow behavior monitoring unit may be configured to match each of the parsed field headers with a header of the lookup table, extract overlapping candidate rules among packet processing candidate rules (forwarding rules) specified in each matched header, and determine a packet processing rule corresponding to the current flow processing among the extracted candidate rules.

[0019] Additionally, the flow behavior monitoring unit may be configured to determine that a violation of the current packet processing mode occurs when the flow generates more messages than the conditions of the current packet processing mode.

[0020] In addition, the above mode management module provides the guide time of the current mode. It can be configured to produce a mathematical formula that limits the arrival time of a packet.

[0021] In addition, the flow behavior monitoring unit In Guide time of the current mode for the th periodic message It is calculated according to the following mathematical formula, [Mathematical formula] Here, is the flow In is the arrival time of the second message, is the release jitter of each periodic message, is the flow is the current mode cycle in , and the above If the arrival time of the second message is less than the guide time, the message is determined to indicate an emergency mode behavior, or if the size of the message is greater than the size condition of the current mode, the message is determined to indicate an emergency mode behavior, and if it is determined to indicate an emergency mode behavior, it can be configured to determine a mode violation.

[0022] Also, the guide time of the current mode can be expressed not only by the above mathematical formula but also by any other mathematical formula that limits the arrival time of a packet.

[0023] In addition, the mode management module may be configured to include a shadow table memory in which a shadow table corresponding to a packet processing mode is stored; and a mode change handling unit that swaps the shadow table with a lookup table of the lookup table memory and stores the shadow table as a lookup table in the lookup table memory to change the packet processing mode corresponding to a violation message output in real time from the flow behavior monitoring unit by referring to the shadow table stored in the shadow table memory.

[0024] In addition, the mode management module may be configured to include a shadow table memory in which a shadow table including packet processing rules corresponding to packet processing modes is stored; a mode change handling unit that changes the packet processing mode corresponding to a violation message output in real time from the flow behavior monitoring unit by referring to the shadow table stored in the shadow table memory, and swaps the corresponding shadow table stored in the shadow table memory with a lookup table of the lookup table memory for mode change and stores the lookup table in the lookup table memory.

[0025] In addition, the mode change handling unit can be configured to, when the flow behavior monitoring unit determines a mode violation, identify a suitable change candidate mode in the flow behavior monitoring unit and change the current packet processing mode to the candidate mode.

[0026] Additionally, the output queue module may be configured to include a plurality of priority-based output queues in which packets are stored for each input device.

[0027] Additionally, the output interface module may be configured to include a plurality of output interface units that each output packet stored in the output queue of the output queue module to a corresponding output device.

[0028] A hardware-implemented mode-based ultra-low latency packet scheduling method according to another object of the present invention may be configured to include the steps of: allowing an input interface module provided in a network interface controller (NIC) card to receive a packet stream from a plurality of input devices; allowing a packet processing module implemented in a field programmable gate array (FPGA) on the NIC card to process the packet stream received from the input interface module; allowing a mode management module implemented in the FPGA on the NIC card to change and set a packet processing mode in real time based on a processing result of the packet stream by the packet processing module; allowing an output decision module implemented in the FPGA on the NIC card to set and output a packet priority according to the packet processing mode changed in real time by the mode management module, and to store the packet in an output queue module in a memory; and allowing an output interface module provided in the NIC card to output the packets stored in the output queue module to a corresponding output device according to the priorities.

[0029] In addition, the step of processing the packet stream input from the input interface module by the packet processing module implemented in the FPGA on the NIC card may be configured to simultaneously and in parallel parse and identify each field header of the packet stream input from the input interface module using a plurality of multiplexers provided in the FPGA.

[0030] Additionally, a mode management module implemented in an FPGA on a NIC card may be configured to request that the packet processing mode being set to be changed in real time be propagated to other switch devices.

[0031] Additionally, the mode propagation module provided on the NIC card may be configured to further include a step of propagating the corresponding mode to the other switch device according to a request from the mode management module.

[0032] In addition, the step of processing the packet stream input from the input interface module by the packet processing module implemented in the FPGA on the NIC card may be configured to identify each field header being parsed by referring to a lookup table stored in a lookup table memory, determine whether the behavior of the corresponding flow violates the current packet processing mode on the lookup table, and, if the result of the determination violates, generate a violation message and output it to the mode management module in real time.

[0033] In addition, the step of processing the packet stream input from the input interface module by the packet processing module implemented in the FPGA on the NIC card includes matching each of the parsed field headers with the header of the lookup table, extracting overlapping candidate rules from among the packet processing candidate rules specified in each matched header, determining a packet processing rule corresponding to the current flow processing from among the extracted candidate rules, and determining the guide time of the current mode. It can be configured to produce a mathematical formula that limits the arrival time of a packet.

[0034] In addition, the step of changing and setting the packet processing mode in real time based on the result of processing the packet stream of the packet processing module by the mode management module implemented in the FPGA on the NIC card may be configured to change the packet processing mode corresponding to the violation message output in real time from the flow behavior monitoring unit by referring to the shadow table stored in the shadow table memory, swapping the shadow table with the lookup table of the lookup table memory, and storing the shadow table as a lookup table in the lookup table memory.

[0035] In addition, the step of processing a packet stream received from the input interface module by the packet processing module implemented in the FPGA on the NIC card may be configured to determine that the current packet processing mode is violated if the flow generates more messages than the conditions of the current packet processing mode.

[0036] Additionally, the packet processing module flows In Guide time of the current mode for the th periodic message It is calculated according to the following mathematical formula, [Mathematical formula] Here, is the flow In is the arrival time of the second message, is the release jitter of each periodic message, is the flow The current mode cycle can be in .

[0037] Additionally, the packet processing module If the arrival time of the second message is less than the guide time, the message is determined to indicate an emergency mode behavior, if the size of the message is greater than the size condition of the current mode, the message is determined to indicate an emergency mode behavior, and if it is determined to indicate an emergency mode behavior, it can be configured to determine a mode violation.

[0038] Also, the guide time of the current mode can be expressed not only by the above mathematical formula but also by any other mathematical formula that limits the arrival time of a packet.

[0039] According to one aspect of the disclosed invention, a mode change of an ultra-low latency mode can be achieved by configuring a network switch to perform parallel processing of a packet processing mode change based on hardware.

[0040] In addition, according to an embodiment of the present invention, a safe and smooth autonomous driving process can be implemented by being configured to change modes immediately with almost no delay in changing modes in an emergency situation such as an autonomous vehicle, and efficient network switching can be performed with limited resources.

[0041] FIG. 1 is a block diagram illustrating the basic concept of a mode-based ultra-low delay packet scheduling device in a hardware implementation manner according to one embodiment of the present invention.

[0042] FIG. 2 is a block diagram of a mode-based ultra-low delay packet scheduling device in a hardware implementation manner according to one embodiment of the present invention.

[0043] Figure 3 is a schematic diagram of a packet processing process according to one embodiment of the present invention.

[0044] FIG. 4 is an example of signal processing for mode change according to one embodiment of the present invention.

[0045] Figure 5 is a contrast graph of the mode change delay of a single switch for slow pass.

[0046] Figure 6 is a contrast graph of the mode change delay of a single switch for fast pass.

[0047] Figure 7 is a contrast graph of the mode change delay of a single switch for a very fast pass.

[0048] Figure 8 is a contrast graph of the mode change delay of the triple switch for slow pass.

[0049] Figure 9 is a contrast graph of the mode change delay of the triple switch for the fast pass.

[0050] Figure 10 is a contrast graph of the mode change delay of the triple switch for the very fast pass.

[0051] Figure 11 is a contrast graph of the time from HI action detection to mode change for a fast pass.

[0052] Figure 12 is a contrast graph of the time until mode change after HI action detection for Berry Fast Pass.

[0053] FIG. 13 is a flowchart of a mode-based ultra-low delay packet scheduling method in a hardware implementation manner according to one embodiment of the present invention.

[0054] Throughout the specification, the same reference numerals denote the same components. This specification does not describe all elements of the embodiments, and general contents in the technical field to which the disclosed invention belongs or contents that overlap between the embodiments are omitted. The term '~unit' or '~module' used in the specification may be implemented in software or hardware, and depending on the embodiments, multiple '~units' or '~modules' may be implemented as a single component, or a single '~unit' or '~module' may include multiple components.

[0055] Also, when a part is said to "include" a component, this does not mean that it excludes other components unless otherwise specifically stated, but rather that it may include other components. As used herein, the term "part" or "module" refers to a unit that processes at least one function or operation, and may refer to, for example, software, an FPGA, or a hardware component. The function provided by the "part" or "module" may be performed separately by multiple components, or may be integrated with other additional components. The "part" or "module" in this specification is not necessarily limited to software or hardware, and may be configured to be on an addressable storage medium, or may be configured to play one or more processors.

[0056] Singular expressions include plural expressions unless the context clearly indicates otherwise. Identification numbers within each step are used for convenience of explanation and do not indicate the order of the steps. Unless the context clearly dictates a specific order, the steps may be performed in a different order than stated. The following describes the operational principles and embodiments of the disclosed invention with reference to the attached drawings.

[0057] FIG. 1 is a block diagram illustrating the basic concept of a mode-based ultra-low delay packet scheduling device in a hardware implementation manner according to one embodiment of the present invention.

[0058] Referring to FIG. 1, the configuration of a conventional SDN (software-defined network) is first illustrated, which comprises an SDN (software-defined network) control device (20) and an Ethernet switch (10) (10A). The Ethernet switch (10) is connected to numerous other Ethernet switches (10A), and the SDN control device (20) is configured to control the network switching of these Ethernet switches (10) (10A).

[0059] Ethernet switches (10) (10A) can be connected to each other in hundreds of thousands or millions to form a network, and in such cases, network management of the Ethernet switches (10) (10A) inevitably becomes difficult. Accordingly, the SDN control device (20) defines rules or policies for network switching using software, and the remote mode management unit (21) controls the switching of each Ethernet switch (10) (10A) to implement flexible and convenient network control. In this method, a packet processing process is performed through the slow path of Fig. 1, and a typical existing SDN process is understood to correspond thereto.

[0060] Meanwhile, as a more advanced method, the method using the Fast Path of Fig. 1 is a method that can perform switching more quickly by independently setting rules or policies for network switching within the Ethernet switch (10). In the method using the Fast Path, each Ethernet switch (10) (10A) does not depend on remote control of the SDN control device (20), and the Ethernet switch (10) is configured to independently set rules or policies for network switching so that packet processing can be performed more quickly. In the method using the Fast Path, the Ethernet switch (10) is configured so that a local mode management unit (11) configured as a software layer performs the packet processing process.

[0061] In the method using Fast Pass, a local mode management unit (11) based on a software switch analyzes packets to detect emergency situations, etc., and is configured to change the rules or policies for network switching in real time, and the Ethernet switch (10) is configured to immediately apply the changed rules or policies in real time. Accordingly, since the Ethernet switch (10) itself variably applies the rules or policies for network switching without remote detection or remote control of the SDN control device (20), the speed for changing the rules or policies can be drastically increased. In addition, the local mode management unit (11) is configured to propagate all real-time changed rules or policies to other Ethernet switches (10A) so that other Ethernet switches (10A) also immediately apply and link the changed rules or policies, thereby drastically increasing the efficiency of the overall network process.

[0062] However, the method using Fast Pass has a structural disadvantage in the packet processing process because the local mode management unit (11) is based on a software switch. Specifically, the method using Fast Pass has a problem in that, although it is necessary to quickly detect an emergency situation or determine the need for a change in rules or policies by analyzing the headers of packets input to the Ethernet switch (10), a significant delay occurs in the parsing and analysis of the continuous packet stream.

[0063] Accordingly, in the present invention, a network switching method using a very fast path was derived by improving the existing method using a fast pass.

[0064] In the present invention, a hardware switch-based data path mode management unit (12), rather than a software switch-based local mode management unit (11), is configured to process and analyze packet headers in parallel using hardware, and to change and apply rules or policies for network switching in real time. That is, according to an embodiment of the present invention, it is possible to quickly detect emergency situations through packet analysis or to quickly detect the need for changes to rules or policies.

[0065] Accordingly, the network switching method using the very fast pass according to the embodiment of the present invention significantly improves the delay in changing rules or policies for network switching that may occur within the Ethernet switch (10) itself.

[0066] In addition, the data path mode management unit (12) is configured to propagate all real-time changed rules or policies to other Ethernet switches (10A) so that the changed rules or policies are immediately applied and linked to other Ethernet switches (10A).

[0067] FIG. 2 is a block diagram of a mode-based ultra-low delay packet scheduling device in a hardware implementation manner according to one embodiment of the present invention.

[0068] Referring to FIG. 2, a hardware-implemented mode-based ultra-low-latency packet scheduling device (100) according to an embodiment of the present invention may include an input interface module (110), a packet processing module (120), a mode management module (130), an output decision module (140), an output queue module (150), a mode propagation module (160), an output interface module (170), and a control interface module (180).

[0069] The input interface module (110) may be configured to receive packet streams from a plurality of input devices. The input devices may be, but are not limited to, a lidar sensor, a radar sensor, a camera sensor, an ECU, a computing node, an MP3 player, etc. installed in a vehicle.

[0070] The input interface module (110) may be equipped with a NIC (network interface controller) card.

[0071] The packet processing module (120) may be configured to process a packet stream received from the input interface module (110). The packet processing module (120) may be configured to include a lookup table memory (121) and a flow behavior monitoring unit (122).

[0072] The lookup table memory (121) may be configured to store a lookup table regarding packet processing modes. Here, the packet processing modes may be configured as a current mode and an emergency mode.

[0073] When packets are scheduled based on their importance, the current mode can be LO mode and the emergency mode can be HI mode. For example, when packets are scheduled based on the criticality mode, the system mode can be configured in two modes, LO and HI. However, the current mode is not necessarily limited to LO mode, and the emergency mode is not necessarily limited to HI mode. LO mode can be a mode that normally switches and transmits signals in non-urgent situations, such as a signal related to the execution of an MP3 player. HI mode can be a mode that preferentially switches and transmits signals such as camera signals or braking signals in cases where braking is urgently required, such as when an obstacle is detected during autonomous driving.

[0074] Here, packet processing modes can be set to more than just the two described above, depending on the criticality of the signal. Furthermore, packet processing modes are not limited to classification based on criticality; any type of mode classification can be applied.

[0075] The lookup table can be configured to specify multiple packet processing candidate modes for each signal.

[0076] The lookup table memory (121) may be provided in a separate memory element on the NIC card.

[0077] The flow behavior monitoring unit (122) can be implemented as a logic circuit in an FPGA (field programmable gate array) on a NIC card.

[0078] Figure 3 is a schematic diagram of a packet processing process according to one embodiment of the present invention.

[0079] Referring to FIG. 3, the flow behavior monitoring unit (122) can be configured to parse a packet stream and identify each field header by referring to a lookup table stored in a lookup table memory (121).

[0080] Specifically, as illustrated in FIG. 3, the flow behavior monitoring unit (122) can be configured to simultaneously and in parallel parse and identify each field header of a packet stream input from an input interface module (110) using a plurality of multiplexers provided in the FPGA.

[0081] Because the FPGA's multiplexer parses all field headers within the packet stream simultaneously, packet processing speed is dramatically increased compared to the conventional software layer-based fast pass method.

[0082] And the flow behavior monitoring unit (122) can be configured to determine whether the behavior of the flow violates the current packet processing mode on the lookup table, and if so, to generate a violation message and output it in real time to the mode management module (130).

[0083] Here, a flow can be defined as a set of packets divided based on a shim-header in a single packet stream.

[0084] The flow behavior monitoring unit (122) can match each field header being parsed with a header of a lookup table, and extract overlapping candidate rules from among the packet processing candidate rules specified in each matched header. The flow behavior monitoring unit (122) can determine a packet processing rule corresponding to the current flow processing from among the extracted candidate rules. At this time, the flow behavior monitoring unit (122) can determine the packet processing rule corresponding to the current flow processing by determining which packet processing rule is most suitable for processing the current flow from among the extracted candidate rules, and determining the packet processing rule most suitable for processing the current flow as the packet processing rule corresponding to the current flow processing.

[0085] The flow behavior monitoring unit (122) may be configured to match each field header of each flow with the header of the lookup table in Phase 1 of FIG. 3, and to extract overlapping candidate rules from among packet processing candidate rules specified in each matched header in Phase 2 of FIG. 3. Here, the packet processing candidate rules may be viewed as a set of packet processing rules on which a specific header signal can operate.

[0086] In Fig. 3, header signals of aa, yy, and cc are extracted from each header field, and by referring to the lookup table for these, packet processing candidate rules 10, 20, and 30 for each header signal aa, packet processing candidate rule 20 for each header signal yy, and packet processing candidate rules 20, 30, and 40 for each header signal cc are extracted, respectively. At this time, among each packet processing candidate rule, the overlapping candidate rule is 20. Accordingly, the packet processing rule of the current input signals, that is, the signal processing rule or signal processing policy, can be detected as 20.

[0087] If there are multiple extracted candidate rules, the flow behavior monitoring unit (122) can determine a packet processing rule corresponding to the current flow processing from among the extracted candidate rules. For example, if candidate rules 20 and 30 are extracted in duplicate, and among them, the packet processing rule most suitable for processing the current flow is 20, the flow behavior monitoring unit (122) can determine candidate rule 20 as the packet processing rule corresponding to the current flow processing.

[0088] At this time, the flow behavior monitoring unit (122) may detect and determine whether a mode violation occurs by comparing the mode corresponding to packet processing rule 20 with the preset current packet processing mode. That is, if the current packet processing mode is the same as the preset current packet processing mode, the current packet processing mode is not a mode violation, but if it is different from the preset current packet processing mode, the current packet processing mode becomes a mode violation, and the current packet processing mode may be configured to be changed to a newly extracted candidate mode. That is, the current mode may be configured to be changed to a mode with higher criticality than the current mode.

[0089] In general, high criticality modes, such as vehicle driving control, are implemented in a predictable system, and low criticality modes, such as music output, are implemented in a separate system. In this case, since the implementation of each mode is performed in a separate system, cost and resource waste may be severe. However, the mode-based ultra-low latency packet scheduling device (100) implemented in hardware according to one embodiment can be implemented through a single shared system using mixed criticality (MC) rather than separate systems for the high criticality mode and the low criticality mode. However, the scheduling performed by the mode-based ultra-low latency packet scheduling device (100) implemented in hardware according to one embodiment is not limited to mixed criticality (MC) packet scheduling.

[0090] Determination of whether a mode has been violated can be made according to the following process.

[0091] The flow behavior monitoring unit (122) may be configured to determine that a flow generates more messages than the current packet processing mode conditions, thereby violating the current packet processing mode. For example, while listening to music in a vehicle and the music signal is primarily networked, if an obstacle suddenly occurs, camera hazard signals, lidar signals, radar signals, etc. may suddenly increase. In such a case, this may be determined to be a violation of the current packet processing mode.

[0092] Additionally, the flow behavior monitoring unit (122) can be configured to determine whether the current mode is violated based on the size of the message.

[0093] Specifically, the flow behavior monitoring unit (122) is a flow In Guide time of the current mode for the th periodic message It can be configured to be calculated according to the following mathematical formula 1.

[0094]

[0095]

[0096]

[0097] Here, is the flow In is the arrival time of the second message, is the release jitter of each periodic message, is the flow is the current mode cycle.

[0098] The flow behavior monitoring unit (122) If the arrival time of the th message is less than the guide time, the message is determined to indicate an emergency mode behavior, and if the size of the message is greater than the size condition of the current mode, the message is determined to indicate an emergency mode behavior. In this case, if the message is determined to indicate an emergency mode behavior, the message may be determined to be a mode violation.

[0099] At this time, the guide time of the current mode can be expressed not only by the above mathematical formula but also by any other mathematical formula that limits the arrival time of a packet.

[0100] Meanwhile, the mode management module (130) may be configured to change the packet processing mode in real time based on the processing result of the packet stream of the packet processing module (120). That is, it may be set to change in real time from a specific packet processing mode to a packet processing mode with higher priority, thereby prioritizing the switching of signals or messages with higher priority.

[0101] The mode management module (130) may be implemented as a logic circuit in an FPGA on a NIC card and may be implemented in a memory storage on the NIC card.

[0102] And the mode management module (130) can request the mode propagation module (160) to propagate the packet processing mode that is set to be changed in real time to other switch devices. Since network switches must be linked with the same packet processing mode to reduce the overall network transmission signal, they can be configured to immediately interwork through propagation and reception of the packet processing mode even if other network switches do not directly detect it.

[0103] The mode management module (130) may be configured to include a shadow table memory (131) and a mode change handling unit (132).

[0104] The shadow table memory (131) can be configured to store a shadow table corresponding to the packet processing mode.

[0105] The mode change handling unit (132) may be configured to change the packet processing mode corresponding to the violation message output in real time from the flow behavior monitoring unit (122) by referring to the shadow table stored in the shadow table memory (131), swap the shadow table with the lookup table of the lookup table memory (121), and store the shadow table as a lookup table in the lookup table memory (121).

[0106] The mode change handling unit (132) can be configured to change the candidate mode extracted from the flow behavior monitoring unit (122) to the current mode when the flow behavior monitoring unit (122) determines that a mode violation has occurred.

[0107] The output decision module (140) can be configured to output packets by setting their priority according to the packet processing mode that is changed in real time in the mode management module (130).

[0108] The output decision module (140) can be implemented as a logic circuit in an FPGA on a NIC card.

[0109] The output queue module (150) may be configured to store packets for which a priority has been set in the output decision module (140). The output queue module (150) may be provided in a memory device on a NIC card.

[0110] The output queue module (150) may be equipped with an output queue (151) for each input device. That is, if the input device is an MP3 player, a separate output queue (151) for the MP3 player may be equipped, and if the input device is a camera sensor, a separate output queue (151) for the camera sensor may be equipped.

[0111] The mode propagation module (160) may be configured to propagate the corresponding mode to other switch devices at the request of the mode management module (130). The mode propagation module (160) may propagate a mode propagation notification signal through a separate channel. When other switch devices receive the mode propagation notification signal, they may be configured to empty all output queues and perform network switching according to the newly propagated packet processing mode.

[0112] The mode propagation module (160) can be implemented as a logic circuit in an FPGA on a NIC card.

[0113] The output interface module (170) can be configured to output packets stored in the output queue module (150) to the corresponding output device according to priority.

[0114] The output interface module (170) may be provided on a NIC card.

[0115] The output interface module (170) may be configured to include a plurality of output interface units (171) that each output packet stored in the output queue of the output queue module (150) to a corresponding output device. Here, the output device may be a speaker, a brake driving device, a wheel driving device, an engine driving device, a wiper driving device, etc.

[0116] The control interface module (180) may be configured to receive an OpenFlow message from an SDN (software defined network) control device (not shown) and input it to the mode management module (130). Even though the SDN control device (not shown) does not normally participate in network switching, it may participate in changing or controlling the packet processing mode through an OpenFlow message when overall network switching control is required. The SDN control device (not shown) may also add or change a new packet processing mode and update the shadow table.

[0117] The mode management module (130) can be configured to operate according to an openflow message received from the SDN control device.

[0118] FIG. 4 is an example of signal processing for mode change according to one embodiment of the present invention.

[0119] In Fig. 4, a signal processing diagram in which the packet processing mode is changed is expressed as a clock unit signal.

[0120] Referring to Fig. 4, input signals In_1 and In_2 are input, and when A_2 is input from In_1, it can be seen that a packet processing mode violation is detected with just one clock signal, and the mode is changed to emergency mode with just one clock signal again. It can be seen that the mode change is made by ultra-low latency (ULL) switching.

[0121] Meanwhile, FIGS. 5 and 6 illustrate examples of mode change delays in a single switch and a triple switch.

[0122] FIG. 5 is a contrast graph of the mode change delay of a single switch for a slow pass, FIG. 6 is a contrast graph of the mode change delay of a single switch for a fast pass, FIG. 7 is a contrast graph of the mode change delay of a single switch for a very fast pass, FIG. 8 is a contrast graph of the mode change delay of a triple switch for a slow pass, FIG. 9 is a contrast graph of the mode change delay of a triple switch for a fast pass, and FIG. 10 is a contrast graph of the mode change delay of a triple switch for a very fast pass.

[0123] Figure 5 illustrates a conventional SDN based on slow path, and illustrates an example of the time at which mode change delay occurs depending on the number of switching rules. That is, as the number of rules increases, the delay increases from 20 ms to 50 ms.

[0124] Figure 6 shows that the mode change delay time increases rapidly from 200 μs to 800 μs in a software-based network switch based on Fast Pass. However, Figure 7 shows a hardware-based network switch based on Very Fast Pass, and shows that the mode change delay time remains almost constant at 2.2 μs even as the number of rules increases.

[0125] Likewise, in FIG. 8, it can be seen that it occurs from 40 ms to 100 ms depending on the number of rules, and in FIG. 9, it increases slightly from 2000 μs depending on the number of rules. However, in FIG. 10, it can be seen that it is maintained at 4.5 μs even if the number of rules changes. By following the very fast pass according to the present invention, not only is the time of the mode change delay itself significantly lower than other methods, but it can also be seen that the time of the mode change delay itself is maintained even when the number of rules increases due to mode propagation.

[0126] Figure 11 is a contrast graph of the time from HI action detection to mode change for a fast pass, and Figure 12 is a contrast graph of the time from HI action detection to mode change for a very fast pass.

[0127] Figure 11 shows the end-to-end message transmission time according to Fast Pass, and Figure 12 shows the end-to-end message transmission time according to Very Fast Pass. Each shows the end-to-end message transmission time when a mode change occurs, and when the HI behavior of the blue graph appears, it indicates that the mode change occurs immediately, transmission of messages in the current mode is stopped, and messages in the emergency mode are transmitted with priority for a much shorter time. In this case, Fast Pass detects the HI behavior in message 20 and the mode change occurs in message 121, but in Very Fast Pass, the mode change occurs immediately in message 21 as soon as the HI behavior is detected in message 20.

[0128] At least one component may be added or deleted in response to the performance of the components described above. Furthermore, those skilled in the art will readily understand that the relative positions of the components may be altered in response to the performance or structure of the system.

[0129] Figure 13 is a flowchart of a hardware-implemented, mode-based, ultra-low-latency packet scheduling method according to one embodiment of the present invention. This is merely a preferred embodiment for achieving the purpose of the present invention, and it is understood that certain components may be added or deleted as needed.

[0130] Referring to FIG. 13, an input interface module (110) equipped on a NIC (network interface controller) card can receive packet streams from multiple input devices (1001).

[0131] Next, a packet processing module (120) implemented in an FPGA (field programmable gate array) on a NIC card can process a packet stream received from an input interface module (110) (1002).

[0132] Here, the packet processing module (120) can be configured to simultaneously and in parallel parse and identify each field header of the packet stream received from the input interface module (110) using a plurality of multiplexers provided in the FPGA.

[0133] At this time, the packet processing module (120) can be configured to identify each field header by referring to a lookup table stored in a lookup table memory (121), determine whether the behavior of the corresponding flow violates the current packet processing mode on the lookup table, and, if the result of the determination is a violation, generate a violation message and output it in real time to the mode management module (130).

[0134] And the packet processing module (120) can be configured to match each field header with a header of a lookup table, extract overlapping candidate modes from among packet processing candidate modes specified in each matched header, and detect and determine whether a mode is violated by comparing the extracted candidate modes with the already set modes.

[0135] And the packet processing module (120) can be configured to determine that a violation of the current packet processing mode occurs when the flow generates more messages than the conditions of the current mode.

[0136] Meanwhile, the packet processing module (120) flows In Guide time of the current mode for the th periodic message It can be configured to be calculated according to the following mathematical formula 2.

[0137]

[0138]

[0139]

[0140] Here, is the flow In is the arrival time of the second message, is the release jitter of each periodic message, is the flow is the current mode cycle.

[0141] And the packet processing module (120) If the arrival time of the th message is less than the guide time, the message is judged to indicate an emergency mode behavior, if the size of the message is greater than the size condition of the current mode, the message is judged to indicate an emergency mode behavior, and if it is judged to indicate an emergency mode behavior, it can be configured to determine a mode violation.

[0142] At this time, the guide time of the current mode can be expressed not only by the above mathematical formula but also by any other mathematical formula that limits the arrival time of a packet.

[0143] Next, a mode management module (130) implemented in an FPGA on a NIC card changes and sets a packet processing mode in real time based on the processing result of the packet stream of the packet processing module (120) (1003).

[0144] At this time, the mode management module (130) may be configured to change the packet processing mode corresponding to the violation message output in real time from the flow behavior monitoring unit (122) by referring to the shadow table stored in the shadow table memory (131) and swap the shadow table with the lookup table of the lookup table memory (131) and store it as a lookup table in the lookup table memory (131).

[0145] Next, the output decision module (140) implemented in the FPGA on the NIC card sets the priority of packets in the packet stream processed by the packet processing module (120) and outputs the packet processing mode set in real time by the mode management module (130) and stores it in the output queue module (150) on the memory (1004).

[0146] Next, the output interface module (170) equipped on the NIC card outputs packets stored in the output queue module (150) to the corresponding output device according to priority (1005).

[0147] Next, the mode management module (130) implemented in the FPGA on the NIC card requests that the packet processing mode, which is changed in real time, be propagated to other switch devices (1006).

[0148] Next, the mode propagation module (160) equipped on the NIC card propagates the mode to another switch device according to the request of the mode management module (130) (1007).

[0149] The input interface module (110), the packet processing module (120), the mode management module (130), the output decision module (140), the output queue module (150), the mode propagation module (160), the output interface module (170), and the control interface module (180) may include any one of a plurality of processors and memories included in the hardware-implemented mode-based ultra-low-latency packet scheduling device (100). In addition, the control method of the hardware-implemented mode-based ultra-low-latency packet scheduling device (100) according to the embodiments of the present invention described so far and the embodiments to be described in the future may be implemented in the form of a program that can be driven by a processor.

[0150] Here, the program may include program commands, data files, and data structures, either singly or in combination. The program may be designed and produced using machine language code or high-level language code. The program may be specifically designed to implement a method for controlling the above-described hardware-implemented mode-based ultra-low-latency packet scheduling device (100), or may be implemented using various functions or definitions that are known and available to those skilled in the art in computer software. The program for implementing the above-described hardware-implemented mode-based ultra-low-latency packet scheduling device (100) control method may be recorded on a recording medium readable by a processor. In this case, the recording medium may be a memory.

[0151] The memory can store a program that performs the operations described above and the operations described below, and the memory can execute the stored program. In the case where there are multiple processors and memories, they can be integrated into a single chip or provided in physically separate locations. The memory can include volatile memory such as Static Random Access Memory (S-RAM) and Dynamic Random Access Memory (DRAP) for temporarily storing data. In addition, the memory can include non-volatile memory such as Read Only Memory (ROM), Erasable Programmable Read Only Memory (EPROM), and Electrically Erasable Programmable Read Only Memory (EEPROM) for long-term storage of control programs and control data. The processor can include various logic circuits and arithmetic circuits, process data according to a program provided from the memory, and generate control signals according to the processing results.

[0152] The disclosed embodiments have been described with reference to the attached drawings as described above. Those skilled in the art will understand that the present invention can be implemented in forms other than the disclosed embodiments without altering the technical spirit or essential features of the present invention. The disclosed embodiments are illustrative and should not be construed as limiting.

Claims

1. An input interface module that receives packet streams from multiple input devices; A packet processing module that processes a packet stream received from the above input interface module; A mode management module that changes and sets the packet processing mode in real time based on the processing result of the packet stream of the packet processing module; An output decision module that sets the priority of packets in a packet stream processed by the packet processing module and outputs a packet processing mode that is changed in real time by the mode management module; An output queue module in which packets with priorities set in the above output decision module are stored; and Includes an output interface module that outputs packets stored in the above output queue module to the corresponding output device according to priority, The above packet processing module, A hardware-implemented mode-based ultra-low latency packet scheduling device, implemented as a logic circuit in an FPGA (field programmable gate array) on a NIC (network interface controller) card, configured to simultaneously and in parallel parse and identify each field header of a packet stream input from the input interface module using a plurality of multiplexers provided in the FPGA.

2. In paragraph 1, The above mode management module, A hardware-implemented mode-based ultra-low latency packet scheduling device that requests that the above real-time changed packet processing mode be propagated to other switch devices.

3. In paragraph 2, A hardware-implemented mode-based ultra-low latency packet scheduling device further comprising a mode propagation module that propagates the mode to the other switch device according to a request from the mode management module.

4. In paragraph 1, A hardware-implemented mode-based ultra-low latency packet scheduling device further comprising a control interface module that receives an OpenFlow message from an SDN (software defined network) control device and inputs it into the mode management module.

5. In paragraph 4, The above mode management module, A hardware-implemented mode-based ultra-low latency packet scheduling device configured to operate according to an openflow message received from the above SDN control device.

6. In paragraph 1, The above packet processing module: A lookup table memory in which a lookup table regarding packet processing modes is stored; and A hardware-implemented mode-based ultra-low-latency packet scheduling device, comprising a flow behavior monitoring unit configured to identify each of the above-mentioned field headers being parsed by referring to a lookup table stored in the lookup table memory, determine whether the behavior of the corresponding flow violates the current packet processing mode on the lookup table, and, if so, generate a violation message and output it in real time to the mode management module.

7. In paragraph 6, The above flow behavior monitoring unit, Each of the above-mentioned field headers being parsed is matched with the header of the above-mentioned lookup table, and candidate rules that overlap with each other are extracted from among the packet processing candidate rules specified in each matched header, and a packet processing rule corresponding to the current flow processing is determined from among the extracted candidate rules. The above mode management module, Guide time of current mode A hardware-implemented mode-based ultra-low latency packet scheduling device configured to calculate a packet arrival time according to a mathematical formula that limits the arrival time of the packet.

8. In paragraph 7, The above mode management module, If the above flow generates more messages than the conditions of the current packet processing mode, it is judged as a violation of the current packet processing mode, Flow In Guide time of the current mode for the th periodic message It is calculated according to the following mathematical formula, [Mathematical formula] Here, is the flow In is the arrival time of the second message, is the release jitter of each periodic message, is the flow is the current mode cycle in , Above A hardware-implemented mode-based ultra-low-latency packet scheduling device configured to determine that if the arrival time of the th message is less than the guide time, the message indicates an emergency mode behavior, if the size of the message is greater than a size condition of the current mode, the message indicates an emergency mode behavior, and if it is determined that the message indicates an emergency mode behavior, a mode violation occurs.

9. In paragraph 6, The above mode management module: Shadow table memory where shadow tables corresponding to packet processing modes are stored; and A hardware-implemented mode-based ultra-low-latency packet scheduling device, comprising a mode change handling unit configured to swap the shadow table stored in the shadow table memory with the lookup table of the lookup table memory and store the shadow table as a lookup table in the lookup table memory to change the packet processing mode corresponding to the violation message output in real time from the flow behavior monitoring unit.

10. In paragraph 9, The above mode management module: Shadow table memory where shadow tables corresponding to packet processing modes are stored; and A hardware-implemented mode-based ultra-low-latency packet scheduling device, configured to include a mode change handling unit that changes a packet processing mode corresponding to a violation message output in real time from the flow behavior monitoring unit by referring to the shadow table stored in the shadow table memory, and swaps the corresponding shadow table stored in the shadow table memory with the lookup table of the lookup table memory for mode change and stores it as a lookup table in the lookup table memory.

11. In paragraph 10, The above mode change handling unit is, A hardware-implemented mode-based ultra-low-latency packet scheduling device configured to change a suitable change candidate mode identified by the flow behavior monitoring unit to a current packet processing mode when the flow behavior monitoring unit determines that a mode violation has occurred.

12. In paragraph 1, The above output queue module, A hardware-implemented mode-based ultra-low latency packet scheduling device, wherein an output queue is provided for each of the above input devices.

13. In paragraph 1, The above output interface module, A hardware-implemented mode-based ultra-low-latency packet scheduling device configured to include a plurality of output interface units that each output packet stored in the output queue of the above output queue module to a corresponding output device.

14. A step in which an input interface module equipped on a NIC (network interface controller) card receives a packet stream from multiple input devices; A step in which a packet processing module implemented in an FPGA (field programmable gate array) on the NIC card processes a packet stream received from the input interface module; A step of changing and setting a packet processing mode in real time based on the processing result of a packet stream of the packet processing module by a mode management module implemented in an FPGA on the NIC card; A step in which an output decision module implemented in an FPGA on the NIC card sets the priority of a packet in a packet stream processed by the packet processing module and outputs a packet processing mode set to be changed in real time by the mode management module and stores it in an output queue module on the memory; and The output interface module provided on the NIC card includes a step of outputting packets stored in the output queue module to the corresponding output device according to priority. The step of processing a packet stream received from the input interface module by a packet processing module implemented in the FPGA on the NIC card is as follows: A hardware-implemented mode-based ultra-low-latency packet scheduling method characterized in that it is configured to simultaneously and in parallel parse and identify each field header of a packet stream input from the input interface module using a plurality of multiplexers provided in the FPGA.

15. In paragraph 14, A hardware-implemented mode-based ultra-low latency packet scheduling method further comprising a step of requesting a mode management module implemented in an FPGA on the NIC card to propagate the packet processing mode set to be changed in real time to another switch device.

16. In paragraph 15, A hardware-implemented mode-based ultra-low latency packet scheduling method further comprising a step of a mode propagation module provided on the NIC card propagating the corresponding mode to the other switch device according to a request of the mode management module.

17. In paragraph 14, The step of processing a packet stream received from the input interface module by a packet processing module implemented in the FPGA on the NIC card is as follows: A hardware-implemented mode-based ultra-low-latency packet scheduling method characterized in that it is configured to identify each of the above-mentioned field headers to be parsed by referring to a lookup table stored in a lookup table memory, determine whether the behavior of the corresponding flow violates the current packet processing mode on the lookup table, and, if the result of the determination violates the current packet processing mode, generate a violation message and output it in real time to the mode management module.

18. In paragraph 17, The step of processing a packet stream received from the input interface module by a packet processing module implemented in the FPGA on the NIC card is as follows: Match each of the above-mentioned field headers to be parsed with the header of the above-mentioned lookup table, extract overlapping candidate rules from among the packet processing candidate rules specified in each matched header, and determine the packet processing rule corresponding to the current flow processing from among the extracted candidate rules. Guide time of current mode A hardware-implemented mode-based ultra-low-latency packet scheduling method characterized in that it is configured to calculate according to a mathematical formula that limits the arrival time of a packet.

19. In paragraph 18, The step of changing and setting the packet processing mode in real time based on the processing result of the packet stream of the packet processing module by the mode management module implemented in the FPGA on the NIC card is as follows: A hardware-implemented mode-based ultra-low-latency packet scheduling method characterized in that the shadow table is swapped with a lookup table of the lookup table memory and stored as a lookup table in the lookup table memory to change to a packet processing mode corresponding to a violation message output in real time from a flow behavior monitoring unit by referring to a shadow table stored in the shadow table memory.

20. In paragraph 18, The step of processing a packet stream received from the input interface module by a packet processing module implemented in the FPGA on the NIC card is as follows: If the above flow generates more messages than the conditions of the current packet processing mode, it is judged as a violation of the current packet processing mode, Flow In Guide time of the current mode for the th periodic message It is calculated according to the following mathematical formula, [Mathematical formula] Here, is the flow In is the arrival time of the second message, is the release jitter of each periodic message, is the flow is the current mode cycle in , Above A hardware-implemented mode-based ultra-low-latency packet scheduling method characterized in that if the arrival time of the th message is less than the guide time, the message is determined to indicate an emergency mode behavior, if the size of the message is greater than a size condition of the current mode, the message is determined to indicate an emergency mode behavior, and if it is determined to indicate an emergency mode behavior, a mode violation is determined.

Citation Information

Patent Citations

  • Switch implementation method and system

    CN105634986A

  • System and method for prioritizing and queuing traffic

    US20040085978A1

  • Dynamically switching streams of packets among dedicated and shared queues

    US20070248110A1

  • System for early packet steering and FIFO-based management with priority buffer support

    US6938097B1

  • Method and apparatus for throttling selected traffic flows

    US7346000B1