Signal processing device and vehicle control device including same
The described signal processing and vehicle control devices address the challenge of stable and rapid in-vehicle networking by employing a processor to select and activate a replacement network controller, using a network configuration interface and SDN, ensuring continuous data exchange despite failures.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- LG ELECTRONICS INC
- Filing Date
- 2024-12-24
- Publication Date
- 2026-07-02
AI Technical Summary
Existing vehicle signal processing systems face challenges in providing stable and rapid in-vehicle networking due to increasing data processing demands, potential external attacks, and limited resources, necessitating reliable and swift recovery mechanisms, especially in the event of network controller failures.
A signal processing device and vehicle control device that include a processor capable of selecting a candidate area signal processing device to replace a malfunctioning network controller, utilizing a network configuration interface and communication manager to ensure stable networking by executing echo response messages and network switches, and employing a Software Defined Network (SDN) for dynamic configuration.
Enables stable and rapid in-vehicle networking by allowing a replacement network controller to operate in case of failures, ensuring continuous and reliable data exchange among multiple signal processing devices, even in the event of network controller malfunctions.
Smart Images

Figure KR2024021072_02072026_PF_FP_ABST
Abstract
Description
Signal processing device and vehicle control device equipped with the same
[0001] The present disclosure relates to a server, and more specifically, to a signal processing device capable of reliably providing in-vehicle networking and a vehicle control device equipped with the same.
[0002] A vehicle is a device that moves the user in the desired direction. A typical example is an automobile.
[0003] Meanwhile, for the convenience of users of the vehicle, a vehicle signal processing device is installed inside the vehicle.
[0004] The signal processing unit inside the vehicle receives and processes sensor data from various internal sensor devices.
[0005] Meanwhile, due to Advanced Driver Assistance Systems (ADAS) or autonomous driving, the types and number of sensors installed in vehicles are increasing, leading to a trend of increasing data that needs to be processed.
[0006] Accordingly, multiple signal processing devices are required within the vehicle, and networking is required for data exchange among the multiple signal processing devices.
[0007] Meanwhile, various services running within the vehicle's signal processing unit may be forged or altered due to external attacks, etc.
[0008] Meanwhile, unlike IT domains, specific services running within a vehicle must guarantee stable operation and ensure a rapid response even if problems arise with certain functions. Furthermore, rapid recovery is required to ensure stable operation in the event of a problem.
[0009] Meanwhile, as the functions executed within the vehicle become more diverse and sophisticated, it may be difficult to expect sufficient resources from signal processing devices due to the limited embedded environment.
[0010] Therefore, research on stable networking of in-vehicle signal processing devices is necessary.
[0011] The problem that the present disclosure aims to solve is to provide a signal processing device capable of reliably providing in-vehicle networking and a vehicle control device equipped with the same.
[0012] Another problem that the present disclosure aims to solve is to provide a signal processing device capable of rapidly providing in-vehicle networking in the event of a malfunction of the signal processing device, and a vehicle control device equipped with the same.
[0013] Another problem that the present disclosure aims to solve is to provide a signal processing device and a vehicle control device equipped with the same, which can stably provide in-vehicle networking by having a replacement network controller in a candidate area operate when a network controller fails.
[0014] A signal processing device according to one embodiment of the present disclosure is a signal processing device that exchanges data with at least one area signal processing device, and includes a memory that stores an echo request message from the area signal processing device and a processor that controls the transmission of an echo response message corresponding to the echo request message. The processor executes a network controller, selects a candidate area signal processing device for replacement of the network controller based on resource information of a processor within each area signal processing device in the echo request message, and controls the transmission of an echo response message including information about the selected candidate area signal processing device.
[0015] Meanwhile, the processor can control the selected area signal processing device to transmit an echo response message containing information about the selected candidate area signal processing device and network information access key information.
[0016] Meanwhile, the processor can control the transmission of a first echo response message containing information about a selected candidate region signal processing device and network information access key information to a selected region signal processing device, and control the transmission of a second echo response message containing information about a selected candidate region signal processing device to an unselected region signal processing device.
[0017] Meanwhile, the processor can execute a network configuration interface that executes an application, receives a network configuration request from the application, and transmits network configuration data to the application.
[0018] Meanwhile, the network configuration interface is connected to an application running within the processor and a network controller, and after the operation of the network controller is stopped, it can be connected to the application and a network controller within a selected candidate area signal processing device.
[0019] Meanwhile, the processor can select a candidate region signal processing unit whenever an echo request message is received and control it to transmit an echo response message corresponding to the echo request message.
[0020] Meanwhile, the processor may not send an echo response message in the event of a network controller malfunction.
[0021] Meanwhile, the processor executes a network switch and a communication manager, and the communication manager connects a first port to a Software Defined Network (SDN) controller and connects a second port to a network switch, connects the first port to a third port and a fourth port, connects to a communication manager within a first area signal processing device through the third port, and connects to a communication manager within a second area signal processing device through the fourth port.
[0022] A vehicle control device according to one embodiment of the present disclosure comprises a central signal processing device including a network controller, a network switch, and a processor executing a communication manager, and at least one area signal processing device, wherein the central signal processing device controls the first area signal processing device to operate by replacing the network controller of the central signal processing device in the event of a malfunction of the network controller.
[0023] Meanwhile, the first area signal processing device can be controlled to operate by activating at least a portion of the network controller within the first area signal processing device when it is selected from among a plurality of area signal processing devices to replace the network controller of the central signal processing device in the event of an abnormality in the network controller of the central signal processing device.
[0024] Meanwhile, if the communication manager of the first area signal processing device does not receive an echo response message from the network controller of the central signal processing device within a certain period of time, it transmits an activation signal to the Software Defined Network (SDN) controller within the network controller of the first area signal processing device, and the SDN controller within the network controller of the first area signal processing device can be activated based on the activation signal.
[0025] Meanwhile, the communication manager of the first area signal processing device can connect the first port to a Software Defined Network (SDN) controller, connect the second port to a network switch, connect the first port to the third port and the fourth port, connect to the communication manager within the central signal processing device through the third port, and connect to the communication manager within the second area signal processing device through the fourth port.
[0026] Meanwhile, the first area signal processing device can transmit an echo request message containing resource information of the processor to the central signal processing device and receive an echo response message containing information about a selected candidate area signal processing device from the central signal processing device.
[0027] Meanwhile, the first area signal processing device transmits an echo request message containing resource information of a processor to the central signal processing device, and after receiving a first echo response message containing information about a selected candidate area signal processing device and network information access key information from the central signal processing device, if a subsequent echo response message is not received, it can control at least a part of the network controller to operate by activating it.
[0028] Meanwhile, the central signal processing unit may receive an echo request message from at least one area signal processing unit, select a candidate area signal processing unit for replacement of the network controller based on resource information of a processor within each area signal processing unit in the echo request message, and control the transmission of an echo response message containing information about the selected candidate area signal processing unit.
[0029] Meanwhile, the central signal processing unit can control the transmission of an echo response message containing information about the selected candidate area signal processing unit and network information access key information to the selected area signal processing unit.
[0030] Meanwhile, the central signal processing unit can control the transmission of a first echo response message containing information about the selected candidate area signal processing unit and network information access key information to the selected area signal processing unit, and control the transmission of a second echo response message containing information about the selected candidate area signal processing unit to the unselected area signal processing unit.
[0031] Meanwhile, the central signal processing unit can execute a network configuration interface that executes an application, receives a network configuration request from the application, and transmits network configuration data to the application.
[0032] Meanwhile, the network configuration interface within the central signal processing unit is connected to the application and network controller within the central signal processing unit, and after the operation of the network controller within the central signal processing unit is stopped, it can be connected to the application and the network controller within the selected candidate area signal processing unit.
[0033] Meanwhile, the central signal processing unit can select a candidate region signal processing unit whenever an echo request message is received and control it to transmit an echo response message corresponding to the echo request message.
[0034] Meanwhile, the central signal processing unit may not transmit an echo response message in the event of an abnormality in the network controller.
[0035] A signal processing device according to one embodiment of the present disclosure is a signal processing device that exchanges data with at least one area signal processing device, and includes a memory that stores an echo request message from the area signal processing device and a processor that controls the transmission of an echo response message corresponding to the echo request message. The processor executes a network controller, selects a candidate area signal processing device for replacement of the network controller based on resource information of a processor within each area signal processing device in the echo request message, and controls the transmission of an echo response message containing information about the selected candidate area signal processing device. Accordingly, stable in-vehicle networking can be provided. Furthermore, in-vehicle networking can be provided quickly in the event of a malfunction in the signal processing device.
[0036] Meanwhile, the processor can control the selected area signal processing unit to transmit an echo response message containing information about the selected candidate area signal processing unit and network information access key information. Accordingly, stable in-vehicle networking can be provided.
[0037] Meanwhile, the processor can control the transmission of a first echo response message containing information about a selected candidate region signal processing device and network information access key information to a selected region signal processing device, and control the transmission of a second echo response message containing information about a selected candidate region signal processing device to an unselected region signal processing device. Accordingly, stable in-vehicle networking can be provided.
[0038] Meanwhile, the processor can execute a network configuration interface that runs an application, receives a network configuration request from the application, and transmits network configuration data to the application. Accordingly, stable in-vehicle networking can be provided.
[0039] Meanwhile, the network configuration interface connects to an application running within the processor and a network controller, and after the network controller stops operating, it can connect to the application and the network controller within the selected candidate area signal processing unit. Accordingly, stable in-vehicle networking can be provided.
[0040] Meanwhile, the processor can select a candidate region signal processing unit whenever an echo request message is received and control it to transmit an echo response message corresponding to the echo request message. Accordingly, stable in-vehicle networking can be provided.
[0041] Meanwhile, the processor may not send an echo response message in the event of a network controller malfunction. As a result, stable in-vehicle networking can be provided.
[0042] Meanwhile, the processor executes a network switch and a communication manager, and the communication manager connects a first port to a Software Defined Network (SDN) controller and a second port to a network switch, and connects the first port to a third port and a fourth port, and connects to a communication manager within a first area signal processing unit through the third port and to a communication manager within a second area signal processing unit through the fourth port. Accordingly, stable in-vehicle networking can be provided.
[0043] A vehicle control device according to one embodiment of the present disclosure comprises a central signal processing device including a processor executing a network controller, a network switch, and a communication manager, and at least one area signal processing device. The central signal processing device controls the first area signal processing device to operate by replacing the network controller of the central signal processing device in the event of a failure of the network controller. Accordingly, stable in-vehicle networking can be provided. Furthermore, in the event of a failure of the signal processing device, in-vehicle networking can be provided quickly. In particular, if a failure occurs in the network controller, a replacement network controller in the candidate area operates to stably provide in-vehicle networking.
[0044] Meanwhile, the first area signal processing device can be controlled to activate and operate at least a portion of the network controller within the first area signal processing device when it is selected from among a plurality of area signal processing devices to replace the network controller of the central signal processing device in the event of a malfunction in the network controller of the central signal processing device. Accordingly, if a malfunction occurs in the network controller, the replacement network controller in the candidate area operates to stably provide in-vehicle networking.
[0045] Meanwhile, if the communication manager of the first area signal processing unit fails to receive an echo response message from the network controller of the central signal processing unit within a certain period of time, it transmits an activation signal to the Software Defined Network (SDN) controller within the network controller of the first area signal processing unit, and the SDN controller within the network controller of the first area signal processing unit can be activated based on the activation signal. Accordingly, if a failure occurs in the network controller, a replacement network controller in the candidate area operates to stably provide in-vehicle networking.
[0046] Meanwhile, the communication manager of the first area signal processing device can connect the first port to a Software Defined Network (SDN) controller, connect the second port to a network switch, connect the first port to the third port and the fourth port, connect to the communication manager within the central signal processing device through the third port, and connect to the communication manager within the second area signal processing device through the fourth port. Accordingly, if a failure occurs in the network controller, a replacement network controller in the candidate area operates to stably provide in-vehicle networking.
[0047] Meanwhile, the first area signal processing device transmits an echo request message containing processor resource information to the central signal processing device and receives an echo response message from the central signal processing device containing information about a selected candidate area signal processing device. Accordingly, stable in-vehicle networking can be provided.
[0048] Meanwhile, the first area signal processing unit transmits an echo request message containing processor resource information to the central signal processing unit, and after receiving a first echo response message containing information about a selected candidate area signal processing unit and network information access key information from the central signal processing unit, if a subsequent echo response message is not received, it can control at least a part of the network controller to operate by activating it. Accordingly, stable in-vehicle networking can be provided.
[0049] Meanwhile, the central signal processing unit receives an echo request message from at least one area signal processing unit, selects a candidate area signal processing unit for replacement of the network controller based on resource information of a processor within each area signal processing unit within the echo request message, and controls the transmission of an echo response message containing information about the selected candidate area signal processing unit. Accordingly, stable in-vehicle networking can be provided.
[0050] Meanwhile, the central signal processing unit can control the transmission of an echo response message containing information about the selected candidate area signal processing unit and network information access key information to the selected area signal processing unit. Accordingly, stable in-vehicle networking can be provided.
[0051] Meanwhile, the central signal processing unit can control the transmission of a first echo response message containing information about the selected candidate area signal processing unit and network information access key information to the selected area signal processing unit, and control the transmission of a second echo response message containing information about the selected candidate area signal processing unit to the unselected area signal processing unit.
[0052] Meanwhile, the central signal processing unit can execute a network configuration interface that runs an application, receives a network configuration request from the application, and transmits network configuration data to the application. Accordingly, stable in-vehicle networking can be provided.
[0053] Meanwhile, the network configuration interface within the central signal processing unit is connected to the application and network controller within the central signal processing unit, and after the operation of the network controller within the central signal processing unit is stopped, it can be connected to the application and the network controller within the selected candidate area signal processing unit. Accordingly, stable in-vehicle networking can be provided.
[0054] Meanwhile, the central signal processing unit can control the selection of a candidate area signal processing unit and the transmission of an echo response message corresponding to the echo request message whenever an echo request message is received. Accordingly, stable in-vehicle networking can be provided.
[0055] Meanwhile, the central signal processing unit may not transmit an echo response message in the event of a malfunction in the network controller. Accordingly, stable in-vehicle networking can be provided.
[0056] Figure 1 is a drawing illustrating a vehicle system including a vehicle and a server.
[0057] Figure 2 is a diagram illustrating the architecture of a vehicle signal processing system inside the vehicle of Figure 1.
[0058] FIG. 3a is a drawing illustrating an example of the arrangement of a vehicle display device inside a vehicle.
[0059] FIG. 3b is a drawing illustrating another example of the arrangement of a vehicle display device inside a vehicle.
[0060] Figure 4 is an example of an internal block diagram of the vehicle of Figure 1.
[0061] FIG. 5 is an example of a block diagram of a vehicle control device according to an embodiment of the present disclosure.
[0062] FIG. 6 is an example of an internal block diagram of a signal processing device according to an embodiment of the present disclosure.
[0063] FIGS. 7 to 9g are drawings referenced in the operation description of FIG. 6.
[0064] FIG. 10 is a flowchart illustrating an example of the operation of a vehicle control device according to an embodiment of the present disclosure.
[0065] FIG. 11 is a flowchart illustrating another example of the operation of a vehicle control device according to an embodiment of the present disclosure.
[0066] The present disclosure will be described in more detail below with reference to the drawings.
[0067] The suffixes "module" and "part" for components used in the following description are assigned solely for the ease of drafting this specification and do not inherently confer any particularly significant meaning or role. Accordingly, the terms "module" and "part" may be used interchangeably.
[0068] Figure 1 is a drawing illustrating a vehicle system including a vehicle and a server.
[0069] Referring to the drawing, the vehicle system (10) includes a vehicle (200) and a server (900) that exchanges vehicle (200) data.
[0070] The vehicle (200) is operated by a plurality of wheels (103FR, 103FL, 103RL,...) that rotate by a power source, and a steering wheel (150) for controlling the direction of travel of the vehicle (200).
[0071] Meanwhile, the vehicle (200) may further be equipped with a camera (195), etc., for acquiring an image of the front of the vehicle.
[0072] Meanwhile, the vehicle (200) may be equipped with a plurality of displays (180a, 180b) for displaying images, information, etc. inside.
[0073] In FIG. 1, a cluster display (180a) and an AVN (Audio Video Navigation) display (180b) are exemplified as multiple displays (180a, 180b). Other displays such as a HUD (Head Up Display) are also possible.
[0074] Meanwhile, the AVN (Audio Video Navigation) display (180b) may also be named the Center Information Display.
[0075] Meanwhile, the vehicle (200) described in this specification may be a concept that includes all of the following: a vehicle equipped with an engine as a power source, a hybrid vehicle equipped with an engine and an electric motor as a power source, an electric vehicle equipped with an electric motor as a power source, etc.
[0076] Figure 2 is a diagram illustrating the architecture of a vehicle signal processing system inside the vehicle of Figure 1.
[0077] Referring to the drawing, the architecture (300a) of the vehicle signal processing system inside the vehicle (200) can correspond to a zone-based architecture.
[0078] Accordingly, sensor devices and processors inside the vehicle may be placed in each of the multiple zones (Z1 to Z4), and a signal processing device (170a) including a vehicle communication gateway (GWDa) may be placed in the central area of the multiple zones (Z1 to Z4).
[0079] Meanwhile, the signal processing device (170a) may additionally include an autonomous driving control module (ACC), a cockpit control module (CPG), etc., in addition to the vehicle communication gateway (GWDa).
[0080] The vehicle communication gateway (GWDa) within the signal processing device (170a) may be a High Performance Computing (HPC) gateway.
[0081] That is, the signal processing device (170a) of FIG. 2 is an integrated HPC and can exchange data with an external communication module (not shown) or a processor (not shown) in a plurality of zones (Z1 to Z4).
[0082] FIG. 3a is a drawing illustrating an example of the arrangement of a vehicle display device inside a vehicle.
[0083] Referring to the drawing, the vehicle interior may be equipped with a cluster display (180a), an AVN (Audio Video Navigation) display (180b), a rear seat entertainment display (180c, 180d), a rearview mirror display (not shown), etc.
[0084] FIG. 3b is a drawing illustrating another example of the arrangement of a vehicle display device inside a vehicle.
[0085] A vehicle display device (100) according to an embodiment of the present disclosure may include a plurality of displays (180a to 180b) and a signal processing device (170) that performs signal processing for displaying images, information, etc. on the plurality of displays (180a to 180b) and outputs an image signal to at least one display (180a to 180b).
[0086] Among the plurality of displays (180a to 180b), the first display (180a) is a cluster display (180a) for displaying driving status, operation information, etc., and the second display (180b) may be an AVN (Audio Video Navigation) display (180b) for displaying vehicle operation information, navigation map, various entertainment information or video.
[0087] The signal processing device (170) has a processor (175) inside and can execute a first virtualization machine to a third virtualization machine (not shown) on a hypervisor (not shown) within the processor (175).
[0088] A second virtualization machine (not shown) operates for the first display (180a), and a third virtualization machine (not shown) can operate for the second display (180b).
[0089] Meanwhile, the first virtualization machine (not shown) within the processor (175) can be controlled to set up a shared memory (508) based on a hypervisor (505) for the same data transmission to the second virtualization machine (not shown) and the third virtualization machine (not shown). Accordingly, the same information or the same image can be synchronized and displayed on the first display (180a) and the second display (180b) within the vehicle.
[0090] Meanwhile, the first virtualization machine (not shown) within the processor (175) shares at least a portion of the data with the second virtualization machine (not shown) and the third virtualization machine (not shown) for data sharing processing. Accordingly, data can be shared and processed by multiple virtualization machines for multiple displays within the vehicle.
[0091] Meanwhile, the first virtualization machine (not shown) within the processor (175) can receive and process wheel speed sensor data of the vehicle and transmit the processed wheel speed sensor data to at least one of the second virtualization machine (not shown) or the third virtualization machine (not shown). Accordingly, the wheel speed sensor data of the vehicle can be shared with at least one virtualization machine, etc.
[0092] Meanwhile, the vehicle display device (100) according to the embodiment of the present disclosure may further include a rear seat entertainment display (180c) for displaying driving status information, simple navigation information, various entertainment information or images.
[0093] The signal processing device (170) can control the RSE display (180c) by running a fourth virtualization machine (not shown) in addition to the first to third virtualization machines (not shown) on a hypervisor (not shown) within the processor (175).
[0094] Accordingly, various displays (180a to 180c) can be controlled using a single signal processing device (170).
[0095] Meanwhile, some of the multiple displays (180a to 180c) operate under a Linux OS, and others can operate under a Web OS.
[0096] A signal processing device (170) according to an embodiment of the present disclosure can control displays (180a to 180c) operating under various operating systems (OS) to synchronize and display the same information or the same image.
[0097] Meanwhile, FIG. 3b illustrates that a vehicle speed indicator (212a) and a vehicle interior temperature indicator (213a) are displayed on a first display (180a), a home screen (222) including a plurality of applications, a vehicle speed indicator (212b), and a vehicle interior temperature indicator (213b) is displayed on a second display (180b), and a second home screen (222b) including a plurality of applications and a vehicle interior temperature indicator (213c) is displayed on a third display (180c).
[0098] Figure 4 is an example of an internal block diagram of the vehicle of Figure 1.
[0099] Referring to the drawings, a vehicle (200) according to an embodiment of the present disclosure may be equipped with a lamp drive unit (751), a steering drive unit (752), a brake drive unit (753), a power source drive unit (754), a suspension drive unit (756), an air conditioning drive unit (757), a window drive unit (758), a seat drive unit (761), and a signal processing device (170).
[0100] Meanwhile, the vehicle (200) may further be equipped with an ECU (770), a plurality of sensor devices (SN), and a plurality of communication modules (EMa~EMd).
[0101] Meanwhile, the vehicle (200) according to the embodiment of the present disclosure may further be equipped with a vehicle display device (100).
[0102] A vehicle display device (100) according to an embodiment of the present disclosure may include an input unit (110), a communication device (120) for communication with an external device, a plurality of communication modules (EMa~EMd) for internal communication, a memory (140), a signal processing device (170), a plurality of displays (180a~180c), an audio output unit (185), and a power supply unit (190).
[0103] Multiple communication modules (EMa~EMd) can be placed in each of the multiple zones (Z1~Z4) of FIG. 2, for example.
[0104] Meanwhile, the signal processing device (170) may have a communication switch (736b) inside for data communication with each communication module (EM1~EM4).
[0105] Each communication module (EM1~EM4) can perform data communication with a plurality of sensor devices (SN), ECU (770), or area signal processing device (170Z).
[0106] Meanwhile, a plurality of sensor devices (SN) may include a camera (195), lidar (196), radar (197), or position sensor (198).
[0107] The input unit (110) may be equipped with physical buttons, pads, etc. for button input, touch input, etc.
[0108] Meanwhile, the input unit (110) may be equipped with a microphone (not shown) for user voice input.
[0109] The communication device (120) can exchange data wirelessly with a mobile terminal (800) or a server (900).
[0110] In particular, the communication device (120) can wirelessly exchange data with the vehicle driver's mobile terminal. Various data communication methods are possible as wireless data communication methods, such as Bluetooth, WiFi, WiFi Direct, and APiX.
[0111] The communication device (120) can receive weather information, road traffic condition information, for example, TPEG (Transport Protocol Expert Group) information from a mobile terminal (800) or a server (900). To this end, the communication device (120) may be equipped with a mobile communication module (not shown).
[0112] Meanwhile, the communication device (120) can exchange data wirelessly with an adjacent vehicle.
[0113] For example, the communication device (120) can exchange vehicle messages wirelessly with an adjacent vehicle through V2X (Vehicle-to-everything) communication.
[0114] A plurality of communication modules (EM1~EM4) can receive sensor data, etc. from an ECU (770), a sensor device (SN), or a region signal processing device (170Z), and transmit the received sensor data to the signal processing device (170).
[0115] Here, the sensor data may include at least one of vehicle direction data, vehicle location data (GPS data), vehicle angle data, vehicle speed data, vehicle acceleration data, vehicle tilt data, vehicle forward / reverse data, battery data, fuel data, tire data, vehicle lamp data, vehicle interior temperature data, and vehicle interior humidity data.
[0116] Such sensor data can be obtained from a heading sensor, a yaw sensor, a gyro sensor, a position module, a vehicle forward / reverse sensor, a wheel sensor, a vehicle speed sensor, a vehicle body inclination sensor, a battery sensor, a fuel sensor, a tire sensor, a steering sensor based on steering wheel rotation, a vehicle interior temperature sensor, a vehicle interior humidity sensor, etc.
[0117] Meanwhile, the position module may include a GPS module or a position sensor (198) for receiving GPS information.
[0118] Meanwhile, at least one of the multiple communication modules (EM1 to EM4) can transmit location information data sensed from a GPS module or a location sensor (198) to a signal processing device (170).
[0119] Meanwhile, at least one of the plurality of communication modules (EM1 to EM4) can receive vehicle front image data, vehicle side image data, vehicle rear image data, and obstacle distance information around the vehicle from a camera (195), lidar (196), radar (197), etc., and transmit the received information to a signal processing device (170).
[0120] The memory (140) can store various data for the overall operation of the vehicle display device (100), such as a program for processing or controlling the signal processing device (170).
[0121] For example, memory (140) can store data regarding a hypervisor, a first virtualization machine to a third virtualization machine, for execution within a processor (175).
[0122] The audio output unit (185) converts an electrical signal from the signal processing device (170) into an audio signal and outputs it. To do this, a speaker or the like may be provided.
[0123] The power supply unit (190) can supply power necessary for the operation of each component under the control of the signal processing unit (170). In particular, the power supply unit (190) can receive power from a battery inside the vehicle, etc.
[0124] The signal processing device (170) controls the overall operation of each unit within the vehicle display device (100) or vehicle (200).
[0125] For example, the signal processing device (170) may include a processor (175) that performs signal processing for a vehicle display (180a, 180b).
[0126] The processor (175) can run a first virtualization machine to a third virtualization machine (not shown) on a hypervisor (not shown) within the processor (175).
[0127] Among the first to third virtual machines (not shown), the first virtual machine (not shown) may be named a Server Virtual Machine, and the second to third virtual machines (not shown) may be named a Guest Virtual Machine.
[0128] For example, a first virtualization machine (not shown) within a processor (175) can receive sensor data from a plurality of sensor devices, such as vehicle sensor data, location information data, camera image data, audio data, or touch input data, and process or modify it to output it.
[0129] In this way, by performing most of the data processing in the first virtualization machine (not shown), 1:N data sharing becomes possible.
[0130] As another example, the first virtualization machine (not shown) can directly receive and process CAN data, Ethernet data, audio data, radio data, USB data, and wireless communication data for the second virtualization machine to the third virtualization machine (not shown).
[0131] And, the first virtualization machine (not shown) can transmit the processed data to the second virtualization machine to the third virtualization machine (not shown).
[0132] Accordingly, among the first to third virtualization machines (not shown), only the first virtualization machine (not shown) receives sensor data, communication data, or external input data from a plurality of sensor devices and performs signal processing, thereby reducing the signal processing burden on other virtualization machines and enabling 1:N data communication, which enables synchronization when sharing data.
[0133] Meanwhile, the first virtualization machine (not shown) can control the sharing of the same data with the second virtualization machine (not shown) and the third virtualization machine (not shown) by writing data to the shared memory (508).
[0134] For example, the first virtualization machine (not shown) can record vehicle sensor data, the location information data, the camera image data, or the touch input data in a shared memory (508) and control the sharing of the same data with the second virtualization machine (not shown) and the third virtualization machine (not shown). Accordingly, data sharing in a 1:N manner becomes possible.
[0135] Ultimately, by performing most of the data processing on the first virtualization machine (not shown), 1:N data sharing becomes possible.
[0136] Meanwhile, the first virtualization machine (not shown) within the processor (175) can control the second virtualization machine (not shown) and the third virtualization machine (not shown) to set up a shared memory (508) based on the hypervisor (505) for the same data transmission.
[0137] Meanwhile, the signal processing device (170) can process various signals such as audio signals, video signals, and data signals. To this end, the signal processing device (170) can be implemented in the form of a System On Chip (SOC).
[0138] FIG. 5 is an example of a block diagram of a vehicle control device according to an embodiment of the present disclosure.
[0139] Referring to the drawings, a vehicle control device (1000) according to an embodiment of the present disclosure comprises a signal processing device (170) and a signal processing device (170Z1 to 170Z4) for a single area.
[0140] Meanwhile, the signal processing device (170) is equipped with a central processor (175) and a storage device (925).
[0141] Meanwhile, the signal processing device (170) may further include at least one neural processor (179).
[0142] Meanwhile, the vehicle control device (1000) according to the embodiment of the present disclosure may further include at least one display.
[0143] Meanwhile, the vehicle control device (1000) according to the embodiment of the present disclosure may further include the steering drive unit (752), brake drive unit (753), power source drive unit (754), ECU (770), or a plurality of sensor devices (SN), etc. of FIG. 4.
[0144] Meanwhile, the vehicle control device (1000) according to the embodiment of the present disclosure may further include the lamp driving unit (751), suspension driving unit (756), air conditioning driving unit (757), window driving unit (758), seat driving unit (761), or a plurality of communication modules (EMa~EMd), etc. of FIG. 4.
[0145] In the drawing, at least one display is exemplified as a cluster display (180a) and an AVN display (180b).
[0146] The signal processing device (170) at this time is a high-performance centralized signal processing and control device having a plurality of CPUs (175), GPUs (178), NPUs (179), etc., and can be named as a High Performance Computing (HPC) signal processing device or a central signal processing device.
[0147] Multiple area signal processing devices (170Z1~170Z4) and signal processing device (170) are connected by wired cables (CB1~CB4).
[0148] Meanwhile, multiple area signal processing devices (170Z1~170Z4) can be connected to each other by wired cables (CBa~CBd).
[0149] The wired cable (CBa~CBd) at this time may include a CAN communication cable, an Ethernet communication cable, or a PCI Express cable.
[0150] Meanwhile, the storage device (925) may be a large-capacity storage device (925).
[0151] Meanwhile, the signal processing device (170) according to an embodiment of the present disclosure may further include a graphics processor (178).
[0152] Meanwhile, the signal processing device (170) according to an embodiment of the present disclosure may have at least one central processor (175, 178, 177).
[0153] Meanwhile, sensor data can be transmitted from at least one of the multiple area signal processing devices (170Z1 to 170Z4) to the signal processing device (170). In particular, the sensor data can be stored in a storage device (925) within the signal processing device (170).
[0154] The sensor data at this time may include at least one of camera data, lidar data, radar data, vehicle direction data, vehicle position data (GPS data), vehicle angle data, vehicle speed data, vehicle acceleration data, vehicle tilt data, vehicle forward / reverse data, battery data, fuel data, tire data, vehicle lamp data, vehicle interior temperature data, and vehicle interior humidity data.
[0155] In the drawing, camera data from a camera (195a) and lidar data from a lidar sensor (196) are input to a first area signal processing device (170Z1), and the camera data and lidar data are transmitted to a signal processing device (170) via a second area signal processing device (170Z2) and a third area signal processing device (170Z3), etc.
[0156] Meanwhile, since the data reading or writing speed to the storage device (925) is faster than the network speed when sensor data is transmitted from at least one of the multiple area signal processing devices (170Z1~170Z4) to the signal processing device (170), it is desirable to perform multipath routing so that network bottlenecks do not occur.
[0157] To this end, the signal processing device (170) according to an embodiment of the present disclosure can perform multipath routing based on a Software Defined Network (SDN).
[0158] Accordingly, a stable network environment can be secured when reading or writing data to the storage device (925). Furthermore, since data can be transmitted to the storage device (925) using multiple paths, data can be transmitted by dynamically changing the network configuration.
[0159] Data communication between a plurality of area signal processing devices (170Z1~170Z4) and a signal processing device (170) within a vehicle control device (1000) according to an embodiment of the present disclosure is preferably Peripheral Component Interconnect Express communication for high-bandwidth, low-latency communication.
[0160] Meanwhile, the signal processing device (170) according to an embodiment of the present disclosure can receive an internal image from an internal camera (195i) and perform signal processing on the internal image.
[0161] Meanwhile, the signal processing device (170) according to the embodiment of the present disclosure can receive a front image from a front camera (195a) and perform signal processing on the front image.
[0162] FIG. 6 is an example of an internal block diagram of a signal processing device according to an embodiment of the present disclosure.
[0163] Referring to the drawings, a signal processing device (170) according to an embodiment of the present disclosure exchanges data with at least one area signal processing device (170z).
[0164] Meanwhile, the signal processing device (170) includes a memory (925) that stores an echo request message from the area signal processing device (170z), and a processor (175) that controls the transmission of an echo response message corresponding to the echo request message.
[0165] Meanwhile, the processor (175) also executes a network controller (740) for data exchange with a region signal processing device (170z).
[0166] At this time, the network controller (740) may be a hybrid network controller. For example, the network controller (740) may include or execute an SDN controller (745) and a switch manager (748).
[0167] Meanwhile, the processor (175) selects a candidate area signal processing unit (170z) for replacement of the network controller (740) based on resource information of the processor (175) within each area signal processing unit (170z) in the echo request message, and controls the transmission of an echo response message containing information about the selected candidate area signal processing unit. Accordingly, stable in-vehicle networking can be provided. Furthermore, in the event of a malfunction in the signal processing unit (170), in-vehicle networking can be provided quickly.
[0168] Meanwhile, the processor (175) may not send an echo response message in the event of an abnormality in the network controller (740).
[0169] For example, the processor (175) may not transmit an echo response message in the event of a malfunction in the network controller (740), and in response, the area signal processing device (170z) may replace the network controller (740) if an echo response message is not received within a predetermined time. Accordingly, stable in-vehicle networking can be provided.
[0170] Meanwhile, the processor (175) can control the selected area signal processing device (170z) to transmit an echo response message containing information about the selected candidate area signal processing device and network information access key information. Accordingly, stable in-vehicle networking can be provided.
[0171] Meanwhile, the processor (175) can execute at least one application (750).
[0172] At this time, the application (750) may be a streaming application such as an OTT (Over-the-top media service), a camera application for processing camera data, a lidar application for processing lidar data, a radar application for processing radar data, an ADAS application, or a vehicle autonomous driving application.
[0173] Meanwhile, the processor (175) can execute a network configuration interface (730) that receives a network configuration request from an application (750) and transmits network configuration data to the application (750). Accordingly, stable in-vehicle networking can be provided.
[0174] Meanwhile, the network configuration interface (730) is connected to an application (750) running within the processor (175) and a network controller (740), and after the operation of the network controller (740) is stopped, it can be connected to the application (750) and a network controller (745z) within a selected candidate area signal processing device (170z). Accordingly, stable in-vehicle networking can be provided.
[0175] Meanwhile, the processor (175) can run a network switch (710) and a communication manager (720). Accordingly, stable in-vehicle networking can be provided.
[0176] FIGS. 7 to 9g are drawings referenced in the operation description of FIG. 6.
[0177] First, FIG. 7 is an example of the operation of a vehicle control device (1000) according to one embodiment of the present disclosure.
[0178] Referring to the drawings, a vehicle control device (1000) according to one embodiment of the present disclosure includes a central signal processing device (170) and at least one area signal processing device (170z).
[0179] Meanwhile, the central signal processing unit (170) includes a memory (925) that stores an echo request message from the area signal processing unit (170z), and a processor (175) that controls the transmission of an echo response message corresponding to the echo request message.
[0180] Meanwhile, the processor (175) in the central signal processing unit (170) can execute the network controller (740), network switch (710), and communication manager (720).
[0181] Meanwhile, the processor (175) in the central signal processing unit (170) can execute a network controller (740), a network switch (710), a communication manager (720), a network configuration interface (730), and an application (750).
[0182] Meanwhile, the processor (175z) within the area signal processing device (170z) can execute a network controller (740z), a network switch (710z), a communication manager (720z), a network configuration interface (730z), and an application (750z).
[0183] Meanwhile, in normal mode, the processor (175) in the central signal processing unit (170) can run both the SDN controller (745) and the switch manager (748) in the network controller (740).
[0184] Meanwhile, in normal mode, the processor (175z) in the area signal processing unit (170z) can execute only the switch manager (748z) among the SDN controller (745z) and the switch manager (748z) in the network controller (740z).
[0185] Meanwhile, an application (750) within the central signal processing unit (170) can request network configuration information (PTa) from the SDN controller (745) within the network controller (740).
[0186] In response to this, the SDN controller (745) within the network controller (740) can transmit network configuration information (PTa) to the application (750).
[0187] Meanwhile, the SDN controller (745) in the network controller (740) in the central signal processing unit (170) can request switch configuration information (PTb) from the switch manager (748z) in the network controller (740z) in the area signal processing unit (170z).
[0188] In response to this, the switch manager (748z) in the network controller (740z) in the area signal processing unit (170z) can transmit switch configuration information (PTb) to the SDN controller (745) in the network controller (740) in the central signal processing unit (170).
[0189] Meanwhile, the switch manager (748z) in the network controller (740z) in the area signal processing device (170z) can request network switch information (PTc) from the network switch (710z).
[0190] In response to this, the network switch (710z) can transmit configuration network switch information (PTc) to the switch manager (748z) within the network controller (740z).
[0191] Next, FIG. 8 is another example of the operation of a vehicle control device (1000) according to one embodiment of the present disclosure.
[0192] Referring to the drawings, a vehicle control device (1000) according to one embodiment of the present disclosure includes a central signal processing device (170) and a plurality of area signal processing devices (170z1 to 170z4).
[0193] Meanwhile, the central signal processing unit (170) includes a memory (925) for storing echo request messages from a plurality of area signal processing units (170z1 to 170z4) and a processor (175) for controlling the transmission of an echo response message corresponding to the echo request message.
[0194] Meanwhile, the processor (175) in the central signal processing unit (170) can execute the network controller (740), network switch (710), and communication manager (720).
[0195] Meanwhile, the processor (175) in the central signal processing unit (170) can execute a network controller (740), a network switch (710), a communication manager (720), a service (752), etc., and execute or store network information (754), etc.
[0196] The service (752) at this time can correspond to the application (750) of FIG. 6 or FIG. 7.
[0197] Meanwhile, the gig processors (175z1 to 175z4) within the multiple area signal processing devices (170z1 to 170z4) can execute services (752z1 to 752z4) corresponding to network controllers (740z1 to 740z4), network switches (710z1 to 710z4), communication managers (720z1 to 720z4), and applications (750z).
[0198] Meanwhile, when the vehicle control device (1000) according to one embodiment of the present disclosure is first operated, the communication manager (720) of the central signal processing device (170) and the communication managers (720z1~720z4) of the plurality of area signal processing devices (170z1~170z4) are all connected for rapid communication.
[0199] Meanwhile, the network controller (740) within the central signal processing unit (170) is connected to the internal communication manager (720).
[0200] Meanwhile, network controllers (740z1 to 740z4) within multiple area signal processing devices (170z1 to 170z4) are connected to communication managers (720z1 to 720z4).
[0201] Next, the communication managers (720z1~720z4) within the multiple area signal processing devices (170z1~170z4) each begin communicating with the communication manager (720) within the central signal processing device (170).
[0202] Meanwhile, communication can be performed in the order of switch managers (748z1~748z4) within network controllers (740z1~740z4) within multiple area signal processing devices (170z1~170z4), communication managers (720z1~720z4) within multiple area signal processing devices (170z1~170z4), communication managers (720) within a central signal processing device (170), and network controllers (740) within a central signal processing device (170), thereby enabling software-defined network (SDN) operations. For example, software-defined network (SDN)-based routing can be performed.
[0203] In the drawing, an example is shown of an abnormality or default occurring in the network controller (740) within the central signal processing unit (170).
[0204] Specifically, an example is given of an abnormality or default occurring in the SDN controller (745) within the network controller (740) within the central signal processing unit (170).
[0205] Meanwhile, in the event of a malfunction in the network controller (740) within the central signal processing unit (170), the communication managers (720z1~720z4) within the multiple area signal processing units (170z1~170z4) can confirm that the connection between the network controller (740) within the central signal processing unit (170) and the communication manager (720) has been severed.
[0206] Next, if the connection between the network controller (740) and the communication manager (720) within the central signal processing unit (170) is disconnected, the SDN controller (745z1) within the network controller (740z1) within the first area signal processing unit (170z1) selected as the next network controller can be activated, and the connection between the SDN controller (745z1) and the communication manager (720z1) can be activated.
[0207] Next, the communication manager (720z1) in the first area signal processing device (170z1) can reset the location of the communication manager (720) in the central signal processing device (170) and the communication manager (720z2~720z4) in the second to fourth area signal processing devices (170z2~170z4) or perform communication preparation.
[0208] Meanwhile, the communication manager (720z1) in the first area signal processing device (170z1) can receive messages (PHb, Pha, Phac, Phad) from the communication manager (720) in the central signal processing device (170) and the communication managers (720z2~720z4) in the second to fourth area signal processing devices (170z2~170z4), respectively, after completing preparations for communication with the communication manager (720) in the central signal processing device (170) and the communication managers (720z2~720z4) in the second to fourth area signal processing devices (170z2~170z4).
[0209] Meanwhile, software-defined network (SDN) based routing can be performed based on the network controller (740z1) within the first area signal processing device (170z1).
[0210] Meanwhile, the processor (175) within the central signal processing unit (170) controls the transmission of a first echo response message containing information about a selected candidate area signal processing unit and network information access key information to a selected first area signal processing unit (170z1), and controls the transmission of a second echo response message containing a selected candidate area signal processing unit (170z2~170z4) to unselected area signal processing units (170z2~170z4), wherein the size of the first echo response message may differ from the size of the second echo response message. Accordingly, stable in-vehicle networking can be provided.
[0211] For example, the size of the first echo response message may be larger than the size of the second echo response message.
[0212] As another example, the size of the first echo response message may be smaller than the size of the second echo response message.
[0213] Meanwhile, the processor (175) within the central signal processing unit (170) can be controlled to select a candidate area signal processing unit (170z) and transmit an echo response message corresponding to the echo request message whenever an echo request message is received. Accordingly, stable in-vehicle networking can be provided.
[0214] Meanwhile, the first area signal processing unit (170z1), while running the network switch (710z1) and the communication manager (720z1), can control the SDN controller (745z1) within the network controller (740z1) to operate by activating it when replacing the network controller (740) of the central signal processing unit (170). Accordingly, stable in-vehicle networking can be provided.
[0215] Meanwhile, the first area signal processing device (170z1) transmits an echo request message containing resource information of the processor (175z1) to the central signal processing device (170), and receives an echo response message containing information about a selected candidate area signal processing device from the central signal processing device (170). Accordingly, stable in-vehicle networking can be provided.
[0216] Meanwhile, the first area signal processing device (170z1) transmits an echo request message containing resource information of the processor (175z1) to the central signal processing device (170), and after receiving a first echo response message containing information about a selected candidate area signal processing device and network information access key information from the central signal processing device (170), if a subsequent echo response message is not received, it can control at least a part of the network controller (740z1) to operate by activating it. Accordingly, stable in-vehicle networking can be provided.
[0217] Specifically, the first area signal processing unit (170z1) transmits an echo request message containing resource information of the processor (175z1) to the central signal processing unit (170), and after receiving a first echo response message containing information about a selected candidate area signal processing unit and network information access key information from the central signal processing unit (170), if a subsequent echo response message is not received, the SDN controller (745z1) within the network controller (740z1) can be activated and controlled to operate. Accordingly, stable in-vehicle networking can be provided.
[0218] Meanwhile, a processor (175) in a central signal processing unit (170) receives an echo request message from at least one area signal processing unit (170z) and, based on the resource information of the processor (175) in each area signal processing unit (170z) in the echo request message, can select the next network controller for replacing the network controller (740).
[0219] For example, the processor (175) within the central signal processing unit (170) can be controlled to select a candidate area signal processing unit among a plurality of area signal processing units when selecting the next network controller, and to transmit an echo response message containing information about the selected candidate area signal processing unit. Accordingly, stable in-vehicle networking can be provided.
[0220] Meanwhile, the processor (175) within the central signal processing unit (170) can be controlled to transmit an echo response message containing information about the selected candidate area signal processing unit and network information access key information to the selected first area signal processing unit (170z1). Accordingly, stable in-vehicle networking can be provided.
[0221] Meanwhile, the processor (175) within the central signal processing unit (170) can control the transmission of a first echo response message containing information about the selected candidate area signal processing unit and network information access key information to the selected first area signal processing unit (170z1).
[0222] Meanwhile, the processor (175) in the central signal processing unit (170) can control the transmission of a second echo response message, including the selected candidate region signal processing unit (170z), to the unselected region signal processing unit (170z).
[0223] At this time, the size of the first echo response message may be different from the size of the second echo response message.
[0224] Meanwhile, the processor (175) within the central signal processing unit (170) can execute a network configuration interface (730) that executes an application (750), receives a network configuration request from the application (750), and transmits network configuration data to the application (750). Accordingly, stable in-vehicle networking can be provided.
[0225] Meanwhile, the network configuration interface (730) within the processor (175) in the central signal processing unit (170) is connected to the application (750) and network controller (740) within the central signal processing unit (170), and after the operation of the network controller (740) within the central signal processing unit (170) is stopped, it can be connected to the application (750) and network controller (745z) within the selected candidate area signal processing unit (170z). Accordingly, stable in-vehicle networking can be provided.
[0226] Meanwhile, the processor (175) in the central signal processing unit (170) can select the next network controller whenever an echo request message is received.
[0227] That is, the processor (175) within the central signal processing unit (170) can select a candidate area signal processing unit (170z) corresponding to the next network controller and control it to transmit an echo response message corresponding to an echo request message. Accordingly, stable in-vehicle networking can be provided.
[0228] Meanwhile, the processor (175) in the central signal processing unit (170) may not transmit an echo response message in the event of an abnormality in the network controller (740).
[0229] For example, the processor (175) may not transmit an echo response message in the event of a malfunction in the network controller (740), and in response, the area signal processing device (170z) may replace the network controller (740) if an echo response message is not received within a predetermined time. Accordingly, stable in-vehicle networking can be provided.
[0230] FIGS. 9a and 9b are diagrams illustrating the pre-connection operation of a communication manager.
[0231] FIG. 9a illustrates an SDN controller (745) in a network controller (740) in a central signal processing unit (170) being in a normal operating state or a depleted state.
[0232] Referring to the drawing, when the SDN controller (745) in the network controller (740) in the central signal processing unit (170) is in a normal operating state or a de-operated state, the SDN controller (745) in the network controller (740) in the central signal processing unit (170) can be connected to the communication managers (720z1~720z2) in the plurality of area signal processing units (170z1~170z2) through the communication manager (720).
[0233] For example, a communication manager (720) within a central signal processing unit (170) may connect a first port (CTa) to an SDN controller (745), connect a second port (CTb) to a switch manager (748), and connect the first port (CTa) to a third port (CTc) and a fourth port (CTd) within the communication manager (720), respectively.
[0234] Meanwhile, the communication manager (720) in the central signal processing unit (170) can connect the third port (CTc) to the third port (CTcz1) in the communication manager (720z1) in the first area signal processing unit (170z1), and connect the fourth port (CTd) to the third port (CTcz2) in the communication manager (720z2) in the second area signal processing unit (170z2).
[0235] That is, the communication manager (720) in the central signal processing unit (170) can be connected to the communication manager (720z1) in the first area signal processing unit (170z1) through the third port (CTc) and to the communication manager (720z2) in the second area signal processing unit (170z2) through the fourth port (CTd).
[0236] Meanwhile, the third port (CTcz1) in the communication manager (720z1) within the first area signal processing device (170z1) can be connected to the second port (CTbz1) and connected to the switch manager (748z1).
[0237] Meanwhile, the third port (CTcz2) in the communication manager (720z2) within the second area signal processing device (170z2) can be connected to the second port (CTbz2) and connected to the switch manager (748z2).
[0238] FIG. 9b illustrates an abnormal state of the SDN controller (745) within the network controller (740) within the central signal processing unit (170).
[0239] Referring to the drawing, in the event of an abnormal state of the SDN controller (745) in the network controller (740) in the central signal processing unit (170), the switch manager (748) in the network controller (740) in the central signal processing unit (170) can be connected to the communication manager (720z1) in the first area signal processing unit (170z1) through the communication manager (720).
[0240] Meanwhile, in the event of an abnormal state of the SDN controller (745) within the network controller (740) within the central signal processing unit (170), the SDN controller (745z1) within the network controller (740z1) within the first area signal processing unit (170z1) may be activated.
[0241] For example, if the communication manager (720z1) in the first area signal processing unit (170z1) does not receive an echo response message from the network controller (740) in the central signal processing unit (170) within a certain time, it may transmit an activation signal to the SDN controller (745z1) in the network controller (740z1) in the first area signal processing unit (170z1).
[0242] Meanwhile, the SDN controller (745z1) within the network controller (740z1) within the first area signal processing device (170z1) can be activated based on an activation signal.
[0243] Meanwhile, the communication manager (720z1) within the first area signal processing device (170z1) can connect the first port (CTaz1) to the SDN controller (745z1), connect the second port (CTbz1) to the switch manager (748z1), and connect the first port (CTaz1) to the third port (CTcz1) and the fourth port (CTdz1), respectively.
[0244] Meanwhile, the communication manager (720z1) in the first area signal processing device (170z1) can connect the third port (CTcz1) to the third port (CTc) in the communication manager (720) in the central signal processing device (170), and connect the fourth port (CTdz1) in the communication manager (720z1) in the first area signal processing device (170z1) to the fourth port (CTdz2) in the communication manager (720z2) in the second area signal processing device (170z2).
[0245] That is, the communication manager (720z1) in the first area signal processing device (170z1) can be connected to the communication manager (720) in the central signal processing device (170) through the third port (CTcz1) and to the communication manager (720z2) in the second area signal processing device (170z2) through the fourth port (CTdz1).
[0246] Meanwhile, the third port (CTc) in the communication manager (720) within the central signal processing unit (170) can be connected to the second port (CTb) and connected to the switch manager (748).
[0247] Meanwhile, the fourth port (CTdz2) in the communication manager (720z2) within the second area signal processing device (170z2) can be connected to the second port (CTbz2) and connected to the switch manager (748z2).
[0248] Meanwhile, the SDN controller (745) and switch manager (748) within the central signal processing unit (170) can transmit messages to the communication manager (720) regardless of the destination of the message.
[0249] Meanwhile, the SDN controller (745z1) and switch manager (748z1, 748z2) within the multiple area signal processing devices (170z1~170z2) can transmit a message to the communication manager (720z1, 720z2) regardless of the destination of the message.
[0250] Meanwhile, information such as the location of the network controller to operate in case of an anomaly or default, and network information access keys, can be stored in the SDN information table within each communication manager (720, 720z1, 720z2).
[0251] Figure 9c illustrates an example of an SDN information table.
[0252] Referring to the drawing, the SDN information table can be stored in each communication manager (720, 720z1, 720z2) within the central signal processing unit (170) and the plurality of area signal processing units (170z1~170z2).
[0253] The SDN information table may include a fixed region (ARa) with a fixed value and a variable region (ARb) with a variable value.
[0254] Meanwhile, the fixed area (ARa) may include multiple port information, controller port information, switch manager port information, resource identifier, and location information.
[0255] Meanwhile, the variable area (ARb) may include current controller location information, next network controller location information, and network information access key information.
[0256] Meanwhile, the variable area (ARb) can be varied when changing from the SDN controller (745) in the central signal processing unit (170) to the SDN controller (745z1) in the network controller (740z1) in the first area signal processing unit (170z1).
[0257] Figure 9d illustrates an echo request message.
[0258] Referring to the drawing, the echo request message may include type information.
[0259] FIG. 9e illustrates an example of an echo request message of FIG. 9d.
[0260] Referring to the diagram, the echo request message may include a payload.
[0261] The echo request message can be transmitted from the switch manager (748z1~748z4) of each area signal processing unit (170z1~170z4) to the network controller (740) in the central signal processing unit (170).
[0262] The echo request message may include version information, type information, length information, ID information, processor usage information, and memory capacity information.
[0263] Figure 9f illustrates an echo response message.
[0264] Referring to the drawing, the echo response message may include type information.
[0265] Figure 9g illustrates an example of an echo response message of Figure 9f.
[0266] Referring to the drawing, the echo response message may include a payload.
[0267] The echo response message can be transmitted from the SD controller (745) in the network controller (740) in the central signal processing unit (170) to the switch manager (748z1~748z4) of each area signal processing unit (170z1~170z4).
[0268] The echo response message may include version information, type information, length information, ID information, next network controller information, and network information access key information.
[0269] Meanwhile, the following network controller information may include information about the selected candidate area signal processing device.
[0270] FIG. 10 is a flowchart illustrating an example of the operation of a vehicle control device according to an embodiment of the present disclosure.
[0271] Referring to the drawings, the switch manager (748z1~748z4) in the area signal processing device (170z1~170z4) in the vehicle control device (1000) according to the embodiment of the present disclosure transmits an echo request message (S1105).
[0272] In particular, the switch manager (748z1~748z4) within the plurality of area signal processing devices (170z1~170z4) can transmit an echo request message containing capacity information of the processor (175z1~175z4) and capacity information of the memory (925z1~925z4) to the central signal processing device (170).
[0273] Next, the SDN controller (745) in the network controller (740) in the central signal processing unit (170) receives an echo request message from each area signal processing unit (170z1~170z4) (S1110).
[0274] Meanwhile, the SDN controller (745) in the network controller (740) in the central signal processing unit (170) can extract information on the available capacity of the processor and the available capacity of the memory in the echo request message.
[0275] Meanwhile, the SDN controller (745) in the network controller (740) in the central signal processing unit (170) can determine whether there is one or more area signal processing units in which the processor's available capacity information exceeds a first threshold and the memory's available capacity information exceeds a second threshold (S1115).
[0276] At this time, the first reference value corresponds to the minimum available capacity of a processor for operating an SDN controller (745z) within a region signal processing device (170z), and the second reference value may correspond to the minimum available capacity of memory for operating an SDN controller (745z) within a region signal processing device (170z).
[0277] Meanwhile, the SDN controller (745) in the network controller (740) in the central signal processing unit (170) can determine whether there are two or more area signal processing units in which the memory capacity information exceeds the second threshold when there is one or more area signal processing units in which the processor capacity information exceeds the first threshold and the memory capacity information exceeds the second threshold (S1117).
[0278] Meanwhile, in step 1117 (S1117), the SDN controller (745) in the network controller (740) in the central signal processing unit (170) may select the area signal processing unit satisfying the condition as the signal processing unit where the next network controller is located, if there are not two or more area signal processing units where the processor's capacity information exceeds the first threshold and the memory's capacity information exceeds the second threshold, i.e., there is only one area signal processing unit (S1118).
[0279] Meanwhile, in step 1117 (S1117), the SDN controller (745) in the network controller (740) in the central signal processing unit (170) can calculate Equation 1 if there are two or more area signal processing units in which the processor's available capacity information exceeds the first threshold and the memory's available capacity information exceeds the second threshold (S1119).
[0280] [Mathematical Formula 1]
[0281] RST=(Zc-Cc) 2 +(Zm-Cm) 2
[0282] Here, Zc represents processor capacity information, Cc represents the first reference value, Zm represents memory capacity information, Cm represents the second reference value, and RSR may represent the calculation result.
[0283] Meanwhile, the SDN controller (745) in the network controller (740) in the central signal processing unit (170) can compare the calculation result (RST) of Equation 1 for each of the two or more area signal processing units (170z1~170z4) and select the area signal processing unit having the largest calculation result among them as the signal processing unit where the next network controller is located (S1121).
[0284] In step 1118 (S1118) and step 1121 (S1121), when the location of the next network controller is selected, the SDN controller (745) in the network controller (740) in the central signal processing unit (170) can set the corresponding area signal processing unit as the location of the next network controller (S1125).
[0285] Meanwhile, in step 1115 (S1115), if there is no area signal processing unit in which the processor (175) in the central signal processing unit (170) has processor capacity information exceeding the first threshold and memory capacity information exceeding the second threshold, the SDN controller (745) in the network controller (740) in the central signal processing unit (170) can calculate Equation 2 (S1127).
[0286] [Mathematical Formula 2]
[0287] RSB=(Zc-Cc)+(Zm-Cm)
[0288] Meanwhile, the SDN controller (745) in the network controller (740) in the central signal processing unit (170) can compare the calculation result (RSB) of Equation 2 for each area signal processing unit (170z1~170z4) and select the area signal processing unit having the largest calculation result among them as the signal processing unit where the next network controller is located (S1128).
[0289] In step 1128 (S1128), when the location of the next network controller is selected, the SDN controller (745) in the network controller (740) in the central signal processing unit (170) can set the location of the next network controller by adding an arbitrary constant (X) to the corresponding area signal processing unit (S1130).
[0290] At this time, any constant (X) is a value much larger than the number of the area signal processing device and can correspond to the resource shortage identifier in the fixed area (ARa) in the SDN information table of FIG. 9c.
[0291] Meanwhile, if the difference between the location of the next network controller and the location of the area signal processing unit corresponds to an arbitrary constant (X) at the time of operation of the next network controller, it is desirable to secure the available resources of the corresponding area signal processing unit.
[0292] Next, the SDN controller (745) in the network controller (740) in the central signal processing unit (170) can control the transmission of the next network controller's location information to all area signal processing units (170z1~170z4) by adding the next network controller's location information to the echo response message (S1135).
[0293] Next, the SDN controller (745) in the network controller (740) in the central signal processing unit (170) updates the SDN information table of FIG. 9c (S1138).
[0294] And, the processor (175) in the central signal processing unit (170) again performs step 1105 (S1105).
[0295] FIG. 11 is a flowchart illustrating another example of the operation of a vehicle control device according to an embodiment of the present disclosure.
[0296] Referring to the drawing, the communication manager (720) in the central signal processing unit (170) and the communication managers (720z1~720z4) in the area signal processing units (170z1~170z4) are connected to each other based on the SDN information table of FIG. 9c (S1205).
[0297] Next, the communication manager (720z1~720z4) within the area signal processing unit (170z1~170z4) is connected to the switch manager (748z1~748z4), and the communication manager (720) within the central signal processing unit (170) is connected to the SDN controller (745) within the network controller (740) (S1207).
[0298] Next, the switch manager (748z1~748z4) in each area signal processing unit (170z1~170z4) can send an echo request message to the communication manager (720) in the central signal processing unit (170) to the SDN controller (745) in the network controller (740) (S1209).
[0299] Next, the SDN controller (745) in the network controller (740) in the central signal processing unit (170) can select the next network controller based on available resource information and update the network information access key (S1211).
[0300] Next, the SDN controller (745) in the network controller (740) in the central signal processing unit (170) can send an echo response message to the communication manager (720z1~720z4) in all area signal processing units (170z1~170z4) (S1213).
[0301] At this time, the SDN controller (745) in the network controller (740) in the processor (175) in the central signal processing unit (170) can transmit an echo response message containing information about the selected candidate area signal processing unit (170z) and a network information access key to the selected first area signal processing unit (170z1).
[0302] Meanwhile, the communication manager (720z1~720z4) in the area signal processing unit (170z1~170z4) determines whether it receives an echo response message within a certain time from the network controller (740) in the processor (175) in the central signal processing unit (170) (S1215), and if applicable, updates the SDN information table of FIG. 9c (S1217).
[0303] Meanwhile, in step 1215 (S1215), the communication manager (720z1~720z4) within the area signal processing unit (170z1~170z4) may determine whether the difference between the location of the next network controller and the location within the network controller (740) within the processor (175) within the central signal processing unit (170) corresponds to 0 or any constant (X) if it does not receive an echo response message within a certain time (S1218), and if so, transmit an activation signal to the SDN controller (745z1) within the network controller (740z1) within the processor (175z1) within the first area signal processing unit (170z1) selected as the next network controller (S1220).
[0304] That is, the communication manager (720z1~720z4) within the area signal processing unit (170z1~170z4) can determine that the network controller (740) within the processor (175) is in an abnormal state if it does not receive an echo response message from the network controller (740) within the processor (175) within the central signal processing unit (170) within a certain period of time.
[0305] At this time, the communication manager (720z1) in the first area signal processing device (170z1) selected as the next network controller can transmit an activation signal to the SDN controller (745z1) in the network controller (740z1).
[0306] Meanwhile, based on the activation signal, the SDN controller (745z1) in the network controller (740z1) in the processor (175z1) in the first area signal processing device (170z1) can be activated.
[0307] Next, the SDN controller (745z1) in the network controller (740z1) in the processor (175z1) in the activated first area signal processing device (170z1) may request network settings for querying and modifying network information (S1222).
[0308] Next, the SDN controller (745z1) in the network controller (740z1) in the processor (175z1) in the first area signal processing device (170z1) determines whether the difference between the location of the next network controller and the location within corresponds to an arbitrary constant (X) (S1223), and if so, can transmit a resource acquisition request (S1225).
[0309] Meanwhile, in step 1218 (S1218), if the difference between the controller's position and my position does not correspond to 0 or any constant (X), at least one of the communication managers (720z1~720z4) in the area signal processing unit (170z1~170z4) determines whether the position of the next network controller is greater than any constant (X) (S1228), and if it is not, at least one of the communication managers (720z1~720z4) in the area signal processing unit (170z1~170z4) can set the position of the new network controller as the position of the next network controller (S1230).
[0310] Meanwhile, in step 1228 (S1228), if the position of the next network controller is greater than any constant (X), at least one of the communication managers (720z1~720z4) in the area signal processing device (170z1~170z4) can set the position of the new controller by subtracting any constant (X) from the position of the next network controller (S1232).
[0311] Next, the communication manager (720z1~720z4) within the area signal processing unit (170z1~170z4) updates the SDN information table and performs a connection with the new network controller (S1236).
[0312] Next, the communication manager (720z1~720z4) within the area signal processing device (170z1~170z4) can transmit an echo request message to the new network controller (740z1) as in step 1209 (S1209).
[0313] According to FIGS. 6 to 11, etc., a streaming application such as an OTT (Over-the-top media service) is executed in a processor (175) within a central signal processing unit (170), and data is transmitted to at least one area signal processing unit through an SDN controller (745) within a network controller (740) within the processor (175). In the event of a malfunction in the SDN controller (745), the SDN controller (745z) within the area signal processing unit, which is pre-configured as the next network controller, can be activated. Accordingly, if a malfunction occurs in the network controller, a replacement network controller in the candidate area operates to provide stable in-vehicle networking.
[0314] Similarly, a camera application for processing camera data, a lidar application for processing lidar data, a radar application for processing radar data, an ADAS application, or a vehicle autonomous driving application, etc., is executed in a processor (175) within a central signal processing unit (170), and data is transmitted to at least one area signal processing unit through an SDN controller (745) within a network controller (740) within the processor (175), and in the event of a failure of the SDN controller (745), the SDN controller (745z) within the area signal processing unit, which is pre-configured as the next network controller, can be activated. Accordingly, stable in-vehicle networking can be provided.
[0315] Although preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above. Various modifications are possible by those skilled in the art without departing from the essence of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical spirit or perspective of the present disclosure.
Claims
In a signal processing device that exchanges data with at least one area signal processing device, A memory for storing an echo request message from the above-mentioned area signal processing device; A processor that controls the transmission of an echo response message corresponding to the above echo request message; is included, The above processor is, A signal processing device that executes a network controller, selects a candidate region signal processing device for replacement of the network controller based on resource information of a processor within each region signal processing device in the echo request message, and controls the transmission of the echo response message containing information about the selected candidate region signal processing device. In paragraph 1, The above processor is, A signal processing device that controls the transmission of an echo response message containing information about the selected candidate region signal processing device and network information access key information, to a selected region signal processing device. In paragraph 1, The above processor is, Controls a selected area signal processing device to transmit a first echo response message containing information about the selected candidate area signal processing device and network information access key information, and Controls an unselected region signal processing device to transmit a second echo response message having information of the selected candidate region signal processing device, and A signal processing device in which the size of the first echo response message is different from the size of the second echo response message. In paragraph 1, The above processor is, A signal processing device that executes an application, receives a network configuration request from the application, and executes a network configuration interface that transmits network configuration data to the application. In paragraph 4, The above network configuration interface is, The application running within the above processor is connected to the above network controller, and A signal processing device that is connected to the network controller within the application and the selected candidate area signal processing device after the operation of the above network controller is interrupted. In paragraph 1, The above processor is, A signal processing device that, whenever the above-mentioned echo request message is received, selects the above-mentioned candidate region signal processing device and controls the transmission of the above-mentioned echo response message corresponding to the above-mentioned echo request message. In paragraph 1, The above processor is, A signal processing device that does not transmit the above-mentioned echo response message in the event of an abnormality in the network controller. In paragraph 1, The above processor is, Running network switches and communication managers, The above communication manager is, Connecting the first port to a Software Defined Network (SDN) controller and connecting the second port to the network switch, Connecting the above-mentioned first port to the third port and the fourth port, A signal processing device that connects to a communication manager within a first area signal processing device through the third port and connects to a communication manager within a second area signal processing device through the fourth port. A central signal processing unit including a processor that executes a network controller, a network switch, and a communication manager; Includes at least one region signal processing device; and The above central signal processing device is, A vehicle control device that controls the first area signal processing device to operate in place of the network controller of the central signal processing device in the event of a malfunction of the above network controller. In Paragraph 9, The above-mentioned first region signal processing device is, A vehicle control device that, in the event of a malfunction in the network controller of the central signal processing device, is selected from a plurality of area signal processing devices to replace the network controller of the central signal processing device, and controls the operation by activating at least a portion of the network controller within the first area signal processing device. In Paragraph 9, The communication manager of the above-mentioned first area signal processing device is, If an echo response message is not received from the network controller of the central signal processing device within a certain period of time, an activation signal is transmitted to a Software Defined Network (SDN) controller within the network controller in the first area signal processing device, and The SDN controller within the network controller in the first area signal processing device is a vehicle control device that is activated based on the activation signal. In Paragraph 9, The communication manager of the above-mentioned first area signal processing device is, Connecting the first port to a Software Defined Network (SDN) controller and connecting the second port to the network switch, Connecting the above-mentioned first port to the third port and the fourth port, A signal processing device that connects to a communication manager within the central signal processing device through the third port and connects to a communication manager within the second area signal processing device through the fourth port. In Paragraph 9, The above-mentioned first region signal processing device is, Transmits an echo request message containing resource information of the above processor to the central signal processing unit, and A vehicle control device that receives an echo response message containing information about a selected candidate region signal processing device from the above central signal processing device. In Paragraph 9, The above-mentioned first region signal processing device is, Transmits an echo request message containing resource information of the above processor to the central signal processing unit, and A vehicle control device that controls operation by activating at least a part of the network controller after receiving a first echo response message containing information about a selected candidate area signal processing device and network information access key information from the central signal processing device, and failing to receive a subsequent echo response message. In Paragraph 9, The above central signal processing device is, Receiving an echo request message from at least one area signal processing device, and A vehicle control device that selects a candidate area signal processing device for replacing the network controller based on resource information of a processor within each area signal processing device in the above-mentioned echo request message, and controls the transmission of an echo response message containing information about the selected candidate area signal processing device. In Paragraph 9, The above central signal processing device is, A vehicle control device that controls a selected area signal processing device to transmit an echo response message containing information about the selected candidate area signal processing device and network information access key information. In Paragraph 9, The above central signal processing device is, Controls a selected area signal processing device to transmit a first echo response message containing information about the selected candidate area signal processing device and network information access key information, and A vehicle control device that controls an unselected region signal processing device to transmit a second echo response message having information of the selected candidate region signal processing device. In Paragraph 9, The above central signal processing device is, A vehicle control device that executes a network setting interface that executes an application, receives a network setting request from the application, and transmits network setting data to the application. In Paragraph 18, The network configuration interface within the central signal processing unit is, Connected to the application and the network controller within the central signal processing unit, A vehicle control device that is connected to the application and the network controller within the selected candidate area signal processing unit after the operation of the network controller within the central signal processing unit is interrupted. In Paragraph 9, The above central signal processing device is, A vehicle control device that, whenever an echo request message is received, selects a candidate region signal processing device and controls it to transmit an echo response message corresponding to the echo request message.