Signal processing device and vehicle control device including same

Abstract

A signal processing device and a vehicle control device including same, according to an embodiment of the present disclosure, comprise: a first processor for exchanging data with an external zone signal processing device; a second processor for controlling a display; and a storage including a plurality of namespaces, wherein the first processor controls the zone signal processing device to access a shared area or a shared namespace in the storage, on the basis of transmission control protocol-based nonvolatile storage memory express (NVMe / TCP). Accordingly, it is possible to efficiently operate a large-capacity storage in a vehicle.

Description

Signal processing device and vehicle control device having the same

[0001] The present disclosure relates to a signal processing device and a vehicle control device having the same, and more particularly, to a signal processing device capable of efficiently operating a large-capacity storage device in a vehicle.

[0002] A vehicle is a device that allows the user to move in the desired direction. A representative example is an automobile.

[0003] Meanwhile, for the convenience of vehicle users, a vehicle signal processing device is installed inside the vehicle.

[0004] The signal processing device inside the vehicle receives and processes sensor data from various sensor devices inside the vehicle.

[0005] Meanwhile, the types and number of sensors installed in vehicles are exploding due to advanced driver assistance systems (ADAS) and autonomous driving, and the amount of data generated from vehicles is also exploding.

[0006] As such, the demand for large-capacity storage devices to store and manage the exploding data is increasing.

[0007] Meanwhile, mass storage devices are expensive and cannot be installed in multiple signal processing units within a vehicle. Therefore, efficient structures and operational methods for mass storage devices are needed.

[0008] The problem to be solved by the present disclosure is to provide a signal processing device capable of efficiently operating a large-capacity storage device in a vehicle and a vehicle control device equipped with the same.

[0009] Another challenge that the present disclosure seeks to address is to construct an efficient and scalable data storage device between nodes based on a high-bandwidth data communication method between computing nodes, and to provide a function that can respond to safety requirements required as a vehicle device.

[0010] Another problem that the present disclosure seeks to solve is to provide a signal processing device and a vehicle control device having the same that do not require a separate protocol when transmitting or receiving data by direct sharing of a storage device.

[0011] Another problem that the present disclosure seeks to solve is to provide a signal processing device and a vehicle control device equipped with the same that can reduce system complexity by separating data storage in a large-capacity storage device in a vehicle and data processing from the storage device.

[0012] Another problem that the present disclosure seeks to solve is to provide a signal processing device capable of improving efficient management and expandability of a data storage device and a vehicle control device having the same.

[0013] A signal processing device and a vehicle control device including the same according to one embodiment of the present disclosure include a first processor for exchanging data with an external area signal processing device, a second processor for controlling a display, and a storage device having a plurality of namespaces, wherein the first processor controls the area signal processing device to access a shared area or shared namespace within the storage device based on a non-volatile memory express (NVMe / TCP) based on a transmission control protocol.

[0014] Meanwhile, the first processor can exchange data with the area signal processing device through an external network switch.

[0015] Meanwhile, the first processor may act as a host for accessing a shared area or shared namespace within a storage device of the domain signal processing device.

[0016] Meanwhile, the first processor may operate as a host of a non-volatile memory express (NVMe / TCP) based on a transmission control protocol, and the second processor may operate as a client of a non-volatile memory express (NVMe / TCP) based on a transmission control protocol.

[0017] Meanwhile, a signal processing device and a vehicle control device including the same according to one embodiment of the present disclosure may further include a storage device and an external component high-speed connection (PCI Express) switch connected between the first processor or the second processor.

[0018] Meanwhile, the storage device may allocate some of the plurality of namespaces exclusively to the first processor or the second processor, and share another part of the plurality of namespaces, which is a shared namespace, with the first processor or the second processor or the area signal processing unit.

[0019] Meanwhile, the storage device can exchange data with the first processor or the second processor via remote direct memory access.

[0020] Meanwhile, the storage device may operate based on non-volatile memory express over fabrics (NVMeoF) based on remote direct memory access over external components high-speed connection (RDMA over PCI Express).

[0021] Meanwhile, the first processor or the second processor can execute NTB Transport on the external component high-speed connection bus, and execute remote direct memory access (RMDA) on the NTB Transport.

[0022] Meanwhile, the first processor or the second processor may run NTB Transport on the external component high-speed connection bus, and run NTB NetDev (NTB_NETDEV) on the NTB Transport, which acts as a synchronization channel for sharing file objects.

[0023] Meanwhile, the first processor or the second processor may run NTB Transport on the external component high-speed connection bus, and run NTB NetDev (NTB_NETDEV) on the NTB Transport, which acts as a synchronization channel for sharing file objects.

[0024] Meanwhile, the first processor or the second processor may execute NTB Transport on the external component high-speed connection bus, execute remote direct memory access (RMDA) and NTB NetDev on the NTB Transport, respectively, and transmit camera data or image data or sensor data through remote direct memory access, and transmit control data through NTB NetDev.

[0025] Meanwhile, the storage device may include a plurality of ports for connection with the first processor and the second processor, and a controller for processing commands through each of the plurality of ports.

[0026] Meanwhile, any one of the multiple namespaces within the storage device can store a lock table containing the path, name, and lock status of the file object.

[0027] Meanwhile, the storage device may allow access to the first processor, the second processor, or the area signal processing device when the lock state is in a released state.

[0028] Meanwhile, the first processor or the second processor can determine a fail operation of the storage device based on transmission of check data and reception of response data thereto when an abnormality occurs in the operation of an indicator of the storage device or an abnormality in the operation of an active signal, and can control the storage device to be reset when the failure of the storage device is determined.

[0029] Meanwhile, the first processor or the second processor can be controlled to operate in any one of a first boot mode in which the first processor, the second processor, and the storage device are powered off, a standby mode in which the first processor and the storage device are booted, and a second boot mode in which the second processor is powered off, and a third boot mode in which the first processor, the second processor, and the storage device are booted in a standby mode.

[0030] Meanwhile, the first processor or the second processor can exchange data, respectively, via an Infiniband card device.

[0031] Meanwhile, the first processor may receive camera data or sensor data from the area signal processing device, control the storage of the camera data or sensor data in the storage device, or perform data processing based on the camera data or sensor data.

[0032] Meanwhile, the second processor can control an image based on camera data from the area signal processing device to be displayed on the display.

[0033] A signal processing device and a vehicle control device having the same according to another embodiment of the present disclosure include a first processor for exchanging data with an external area signal processing device, a second processor for controlling a display, and a storage device having a plurality of namespaces, wherein the first processor operates based on a non-volatile memory express (NVMe / TCP) based on a transmission control protocol, and one of the plurality of namespaces in the storage device stores a lock table including a path, a name, and a lock status of a file object.

[0034] A signal processing device and a vehicle control device having the same according to another embodiment of the present disclosure include a first processor that exchanges data with an external area signal processing device, a second processor that controls a display, and a storage device having a plurality of namespaces, wherein the storage device exchanges data with the first processor or the second processor through remote direct memory access, and the first processor exchanges data with the area signal processing device based on a non-volatile memory express (NVMe / TCP) based on a transmission control protocol.

[0035] A signal processing device and a vehicle control device including the same according to one embodiment of the present disclosure include a first processor for exchanging data with an external area signal processing device, a second processor for controlling a display, and a storage device having a plurality of namespaces, wherein the first processor controls the area signal processing device to access a shared area or shared namespace within the storage device based on a non-volatile memory express (NVMe / TCP) based on transmission control protocol. Accordingly, a large-capacity storage device within the vehicle can be efficiently operated.

[0036] Meanwhile, the first processor can exchange data with the area signal processing unit via an external network switch. This allows for efficient operation of the vehicle's large-capacity storage device.

[0037] Meanwhile, the first processor can act as a host for accessing shared areas or shared namespaces within the storage device of the domain signal processing device. This allows for efficient operation of large-capacity storage devices within the vehicle. Furthermore, by separating data storage to and data processing from the storage device, system complexity can be reduced.

[0038] Meanwhile, the first processor can operate as a host for a non-volatile memory express (NVMe / TCP) based on the transmission control protocol, and the second processor can operate as a client for the non-volatile memory express (NVMe / TCP) based on the transmission control protocol. This allows for efficient operation of large-capacity storage devices within the vehicle.

[0039] Meanwhile, a signal processing device and a vehicle control device including the same according to one embodiment of the present disclosure may further include an external component high-speed connection (PCI Express) switch connected between a storage device and the first processor or the second processor. Accordingly, a large-capacity storage device within the vehicle can be efficiently operated.

[0040] Meanwhile, the storage device can allocate some of the multiple namespaces exclusively to the first processor or the second processor, and share other parts of the multiple namespaces, that is, shared namespaces, with the first processor, the second processor, or the area signal processing unit. This enables efficient operation of the large-capacity storage device within the vehicle.

[0041] Meanwhile, the storage device can exchange data with the first or second processor via remote direct memory access. This allows for efficient operation of large-capacity storage devices within the vehicle. Furthermore, based on high-bandwidth data communication methods between computing nodes, an efficient and scalable data storage device can be configured between nodes.

[0042] Meanwhile, the storage device can operate based on Non-Volatile Memory Express over Fabrics (NVMeoF), which is based on Remote Direct Memory Access over PCI Express (RDMA over PCI Express). This allows for efficient operation of large-capacity storage devices within the vehicle. Furthermore, direct sharing of the storage device eliminates the need for separate protocols for data transmission or reception.

[0043] Meanwhile, the first or second processor can execute the NTB Transport on the external component high-speed connection bus and perform remote direct memory access (RMDA) on the NTB Transport. This enables efficient operation of large-capacity storage devices within the vehicle. Furthermore, it can improve the efficient management and expandability of data storage devices.

[0044] Meanwhile, the first processor or the second processor can execute the NTB Transport on the external component high-speed connection bus, and execute the NTB NetDev (NTB_NETDEV), which acts as a synchronization channel for sharing file objects on the NTB Transport. This enables efficient operation of large-capacity storage devices within the vehicle.

[0045] Meanwhile, the first processor or the second processor can execute the NTB Transport on the external component high-speed connection bus, and execute the NTB NetDev (NTB_NETDEV), which acts as a synchronization channel for sharing file objects on the NTB Transport. This enables efficient operation of large-capacity storage devices within the vehicle.

[0046] Meanwhile, the first processor or the second processor may execute NTB Transport on the external component high-speed connection bus, execute remote direct memory access (RMDA) and NTB NetDev on the NTB Transport, respectively, and transmit camera data, image data, or sensor data through remote direct memory access, and transmit control data through NTB NetDev. Accordingly, it is possible to efficiently operate a large-capacity storage device in the vehicle.

[0047] Meanwhile, the storage device may include multiple ports for connection to the first processor and the second processor, and a controller for processing commands through each of the multiple ports. This allows for efficient operation of a large-capacity storage device within the vehicle.

[0048] Meanwhile, one of the multiple namespaces within the storage device can store a lock table containing the path, name, and lock status of the file object. This allows for efficient operation of the large-capacity storage device within the vehicle.

[0049] Meanwhile, the storage device can allow access to the first processor, the second processor, or the area signal processing device when the lock state is in the released state. This allows efficient operation of a large-capacity storage device within the vehicle.

[0050] Meanwhile, the first processor or the second processor can determine the fail operation of the storage device based on the transmission of check data and the reception of response data in response to an abnormal operation of the indicator or active signal of the storage device, and control the storage device to reset when the storage device is determined to be failed. Accordingly, it is possible to efficiently operate a large-capacity storage device in a vehicle. Furthermore, it is possible to provide a function that can respond to safety requirements required for a vehicle device.

[0051] Meanwhile, the first processor or the second processor can be controlled to operate in any one of the following: a first boot mode in which the first processor, the second processor, and the storage device are powered off, a standby mode in which the first processor and the storage device are powered off, a second boot mode in which the first processor and the storage device are powered off, and a third boot mode in which the first processor, the second processor, and the storage device are powered off. Accordingly, it is possible to efficiently operate a large-capacity storage device in a vehicle. Furthermore, it is possible to provide a function that can respond to safety requirements required as a vehicle device.

[0052] Meanwhile, the first processor and the second processor can exchange data via an Infiniband card device, respectively. This allows for efficient operation of the vehicle's large-capacity storage device.

[0053] Meanwhile, the first processor can receive camera data or sensor data from the area signal processing device, control the storage of the camera data or sensor data in a storage device, or perform data processing based on the camera data or sensor data. This enables efficient operation of the large-capacity storage device within the vehicle.

[0054] Meanwhile, the second processor can control the display of images based on camera data from the area signal processing unit. This allows for efficient use of the vehicle's large-capacity storage device.

[0055] A signal processing device and a vehicle control device having the same according to another embodiment of the present disclosure include a first processor for exchanging data with an external area signal processing device, a second processor for controlling a display, and a storage device having a plurality of namespaces, wherein the first processor operates based on a non-volatile memory express (NVMe / TCP) based on transmission control protocol, and one of the plurality of namespaces in the storage device stores a lock table including a path, name, and lock status of a file object. Accordingly, it is possible to efficiently operate a large-capacity storage device in a vehicle.

[0056] A signal processing device and a vehicle control device having the same according to another embodiment of the present disclosure include a first processor for exchanging data with an external area signal processing device, a second processor for controlling a display, and a storage device having a plurality of namespaces, thereby enabling efficient operation of a large-capacity storage device within a vehicle.

[0057] Figure 1 is a drawing showing an example of the exterior and interior of a vehicle.

[0058] Figures 2a to 2c are drawings illustrating various architectures of a vehicle communication gateway.

[0059] Figure 3a is a drawing showing an example of the arrangement of a vehicle display device inside a vehicle.

[0060] Figure 3b is a drawing showing another example of the arrangement of a vehicle display device inside a vehicle.

[0061] Fig. 4 is an example of an internal block diagram of the vehicle of Fig. 1.

[0062] Figures 5a to 5d are drawings showing various examples of vehicle control devices.

[0063] FIG. 6 is an example of a vehicle control device according to an embodiment of the present disclosure.

[0064] FIG. 7a is an example of an internal block diagram of a signal processing device related to the present disclosure.

[0065] FIG. 7b illustrates a vehicle control device related to the present disclosure.

[0066] FIG. 8A is an example of a block diagram of a vehicle control device according to an embodiment of the present disclosure.

[0067] FIG. 8b is an example of a block diagram of a vehicle control device according to an embodiment of the present disclosure.

[0068] FIG. 8c is an example of a block diagram of a vehicle control device according to an embodiment of the present disclosure.

[0069] Figures 9a to 10d are drawings referenced in the description of Figures 8a to 8c.

[0070] Fig. 11 is a flowchart showing an operation method of a signal processing device according to an embodiment of the present disclosure.

[0071] Hereinafter, the present disclosure will be described in more detail with reference to the drawings.

[0072] The suffixes "module" and "part" used in the following description are given solely for the convenience of writing this specification and do not impart any particularly significant meaning or role to the components themselves. Therefore, the terms "module" and "part" may be used interchangeably.

[0073] Figure 1 is a drawing showing an example of the exterior and interior of a vehicle.

[0074] Referring to the drawing, the vehicle (200) is operated by a plurality of wheels (103FR, 103FL, 103RL, etc.) that rotate by a power source and a steering wheel (150) for controlling the direction of travel of the vehicle (200).

[0075] Meanwhile, the vehicle (200) may further be equipped with a camera (195) for capturing images of the front of the vehicle.

[0076] Meanwhile, the vehicle (200) may be equipped with multiple displays (180a, 180b) for displaying images, information, etc. inside.

[0077] In Fig. 1, a cluster display (180a) and an AVN (Audio Video Navigation) display (180b) are exemplified as multiple displays (180a, 180b). In addition, a HUD (Head Up Display) is also possible.

[0078] Meanwhile, the AVN (Audio Video Navigation) display (180b) may also be named a center information display.

[0079] Meanwhile, the vehicle (200) described in this specification may be a concept that includes all of a vehicle equipped with an engine as a power source, a hybrid vehicle equipped with an engine and an electric motor as a power source, and an electric vehicle equipped with an electric motor as a power source.

[0080] Figures 2a to 2c are drawings illustrating various architectures of a vehicle communication gateway.

[0081] First, FIG. 2a is a drawing illustrating the first architecture of a vehicle communication gateway.

[0082] Referring to the drawing, the first architecture (300a) can correspond to a zone-based architecture.

[0083] Accordingly, sensor devices and processors inside the vehicle may be placed in each of the plurality of zones (Z1 to Z4), and a signal processing device (170a) including a vehicle communication gateway (GWDa) may be placed in the central area of ​​the plurality of zones (Z1 to Z4).

[0084] Meanwhile, the signal processing device (170a) may further include, in addition to the vehicle communication gateway (GWDa), an autonomous driving control module (ACC), a cockpit control module (CPG), etc.

[0085] The vehicle communication gateway (GWDa) within the signal processing device (170a) may be an HPC (High Performance Computing) gateway.

[0086] That is, the signal processing device (170a) of FIG. 2a is an integrated HPC and can exchange data with an external communication module (not shown) or a processor (not shown) within a plurality of zones (Z1 to Z4).

[0087] FIG. 2b is a diagram illustrating a second architecture of a vehicle communication gateway.

[0088] Referring to the drawing, the second architecture (300b) can correspond to a domain-integrated architecture.

[0089] Accordingly, a body chassis control module (BSG), a power control module (PTG), an ADAS control module (ADG), and a cockpit control module (CPG) are connected in parallel to the gateway (GWDb), and multiple processors (ECUs) can be electrically connected to each module (BSG, PTG, ADG, CPG).

[0090] Meanwhile, each processor (ECU) can be integrated and connected to a gateway (GWDb).

[0091] Meanwhile, the signal processing device (170) including the gateway (GWDb) of FIG. 2b operates as a domain-integrated signal processing device.

[0092] Figure 2c is a diagram illustrating the third architecture of a vehicle communication gateway.

[0093] Referring to the drawing, the third architecture (300c) can correspond to a distributed architecture.

[0094] Accordingly, a body chassis control module (BSG), a power control module (PTG), an ADAS control module (ADG), and a cockpit control module (CPG) are connected in parallel to the gateway (GWDc), and in particular, multiple processors (ECUs) within each control module can be connected in parallel to the gateway (GWDb).

[0095] Compared to Fig. 2b, the third architecture differs in that each processor (ECU) is directly connected to the gateway (GWDb) without being connected to other modules.

[0096] Meanwhile, the signal processing device (170) including the gateway (GWDc) of FIG. 2c operates as a distributed signal processing device.

[0097] Figure 3a is a drawing showing an example of the arrangement of a vehicle display device inside a vehicle.

[0098] Referring to the drawing, the interior of the vehicle may be equipped with a cluster display (180a), an AVN (Audio Video Navigation) display (180b), a rear seat entertainment display (180c, 180d), a room mirror display (not shown), etc.

[0099] Figure 3b is a drawing showing another example of the arrangement of a vehicle display device inside a vehicle.

[0100] A vehicle display device (100) according to an embodiment of the present disclosure may include a plurality of displays (180a to 180b), and a signal processing device (170) that performs signal processing for displaying images, information, etc. on the plurality of displays (180a to 180b).

[0101] Among the plurality of displays (180a to 180b), the first display (180a) may be a cluster display (180a) for displaying driving status, operation information, etc., and the second display (180b) may be an AVN (Audio Video Navigation) display (180b) for displaying vehicle driving information, a navigation map, various entertainment information, or images.

[0102] The signal processing device (170) has a processor (175) therein and can execute a first virtual machine to a third virtual machine (not shown) on a hypervisor (not shown) within the processor (175).

[0103] A second virtual machine (not shown) can operate for the first display (180a), and a third virtual machine (not shown) can operate for the second display (180b).

[0104] Meanwhile, the first virtual machine (not shown) within the processor (175) can control the shared memory (508) based on the hypervisor (505) to be set for the same data transmission to the second virtual machine (not shown) and the third virtual machine (not shown). Accordingly, the same information or the same image can be displayed in synchronization on the first display (180a) and the second display (180b) within the vehicle.

[0105] Meanwhile, the first virtual machine (not shown) within the processor (175) shares at least a portion of data with the second virtual machine (not shown) and the third virtual machine (not shown) for data sharing processing. Accordingly, data can be shared and processed among multiple virtual machines for multiple displays within the vehicle.

[0106] Meanwhile, a first virtual machine (not shown) within a processor (175) may receive and process vehicle wheel speed sensor data, and transmit the processed wheel speed sensor data to at least one of a second virtual machine (not shown) or a third virtual machine (not shown). Accordingly, the vehicle wheel speed sensor data may be shared with at least one virtual machine.

[0107] Meanwhile, the vehicle display device (100) according to the embodiment of the present disclosure may further include a rear seat entertainment display (180c) for displaying driving status information, simple navigation information, various entertainment information, or images.

[0108] The signal processing device (170) can control the RSE display (180c) by executing a fourth virtual machine (not shown) in addition to the first virtual machine to the third virtual machine (not shown) on a hypervisor (not shown) within the processor (175).

[0109] Accordingly, it is possible to control various displays (180a to 180c) using one signal processing device (170).

[0110] Meanwhile, some of the multiple displays (180a~180c) may operate under Linux OS, while others may operate under Web OS.

[0111] The signal processing device (170) according to the embodiment of the present disclosure can control the same information or the same image to be displayed in synchronization on displays (180a to 180c) operating under various operating systems (OS).

[0112] Meanwhile, in FIG. 3b, a vehicle speed indicator (212a) and a vehicle interior temperature indicator (213a) are displayed on a first display (180a), a home screen (222) including a plurality of applications and a vehicle speed indicator (212b) and a vehicle interior temperature indicator (213b) are displayed on a second display (180b), and a second home screen (222b) including a plurality of applications and a vehicle interior temperature indicator (213c) are displayed on a third display (180c).

[0113] Fig. 4 is an example of an internal block diagram of the vehicle of Fig. 1.

[0114] Referring to the drawings, a vehicle (200) according to an embodiment of the present disclosure may include a lamp driving unit (751), a steering driving unit (752), a brake driving unit (753), a power source driving unit (754), a suspension driving unit (756), an air conditioning driving unit (757), a window driving unit (758), a seat driving unit (761), and a signal processing device (170).

[0115] Meanwhile, the vehicle (200) may further include an ECU (770), multiple sensor devices (SN), and multiple communication modules (EMa to EMd).

[0116] Meanwhile, a vehicle (200) according to an embodiment of the present disclosure may further include a vehicle display device (100).

[0117] A vehicle display device (100) according to an embodiment of the present disclosure may include an input unit (110), a communication unit (120) for communication with an external device, a plurality of communication modules (EMa to EMd) for internal communication, a memory (140), a signal processing unit (170), a plurality of displays (180a to 180c), an audio output unit (185), and a power supply unit (190).

[0118] A plurality of communication modules (EMa to EMd) can be arranged, for example, in a plurality of zones (Z1 to Z4) of FIG. 2, respectively.

[0119] Meanwhile, the signal processing device (170) may have a communication switch (736b) for data communication with each communication module (EM1 to EM4) inside.

[0120] Each communication module (EM1 to EM4) can perform data communication with multiple sensor devices (SN) or ECUs (770) or area signal processing devices (170Z).

[0121] Meanwhile, the plurality of sensor devices (SN) may include a camera (195), a lidar (196), a radar (197), or a position sensor (198).

[0122] The input unit (110) may be equipped with physical buttons, pads, etc. for button input, touch input, etc.

[0123] Meanwhile, the input unit (110) may be equipped with a microphone (not shown) for user voice input.

[0124] The communication unit (120) can exchange data wirelessly with a mobile terminal (800) or a server (900).

[0125] In particular, the communication unit (120) can wirelessly exchange data with the vehicle driver's mobile terminal. Various data communication methods are possible, such as Bluetooth, WiFi, WiFi Direct, and APiX.

[0126] The communication unit (120) can receive weather information, road traffic information, for example, TPEG (Transport Protocol Expert Group) information, from a mobile terminal (800) or a server (900). To this end, the communication unit (120) may be equipped with a mobile communication module (not shown).

[0127] A plurality of communication modules (EM1 to EM4) can receive sensor data, etc. from an ECU (770), a sensor device (SN), or an area signal processing device (170Z), and transmit the received sensor data to the signal processing device (170).

[0128] Here, the sensor data may include at least one of vehicle direction data, vehicle location data (GPS data), vehicle angle data, vehicle speed data, vehicle acceleration data, vehicle inclination data, vehicle forward / backward data, battery data, fuel data, tire data, vehicle lamp data, vehicle interior temperature data, and vehicle interior humidity data.

[0129] Such sensor data can be obtained from a heading sensor, a yaw sensor, a gyro sensor, a position module, a vehicle forward / backward sensor, a wheel sensor, a vehicle speed sensor, a body tilt detection sensor, a battery sensor, a fuel sensor, a tire sensor, a steering sensor by steering wheel rotation, a vehicle interior temperature sensor, a vehicle interior humidity sensor, etc.

[0130] Meanwhile, the position module may include a GPS module or a position sensor (198) for receiving GPS information.

[0131] Meanwhile, at least one of the plurality of communication modules (EM1 to EM4) can transmit location information data sensed by a GPS module or location sensor (198) to a signal processing device (170).

[0132] Meanwhile, at least one of the plurality of communication modules (EM1 to EM4) can receive vehicle front image data, vehicle side image data, vehicle rear image data, vehicle surrounding obstacle distance information, etc. from a camera (195), lidar (196), radar (197), etc., and transmit the received information to a signal processing device (170).

[0133] The memory (140) can store various data for the overall operation of the vehicle display device (100), such as a program for processing or controlling the signal processing device (170).

[0134] For example, the memory (140) may store data regarding a hypervisor, a first virtual machine, a third virtual machine, or the like, for execution within the processor (175).

[0135] The audio output unit (185) converts an electric signal from the signal processing device (170) into an audio signal and outputs it. For this purpose, a speaker or the like may be provided.

[0136] The power supply unit (190) can supply power required for the operation of each component under the control of the signal processing device (170). In particular, the power supply unit (190) can receive power from a battery or the like inside the vehicle.

[0137] The signal processing device (170) controls the overall operation of each unit in the vehicle display device (100) or the vehicle (200).

[0138] For example, the signal processing device (170) may include a processor (175) that performs signal processing for a vehicle display (180a, 180b).

[0139] The processor (175) can execute a first virtual machine to a third virtual machine (not shown) on a hypervisor (not shown) within the processor (175).

[0140] Among the first virtual machine to the third virtual machine (not shown), the first virtual machine (not shown) may be named a server virtual machine, and the second virtual machine to the third virtual machine (not shown) may be named a guest virtual machine.

[0141] For example, a first virtual machine (not shown) within a processor (175) may receive, process, or output sensor data from a plurality of sensor devices, such as vehicle sensor data, location information data, camera image data, audio data, or touch input data.

[0142] In this way, by performing most of the data processing in the first virtual machine (not shown), data sharing in a 1:N manner becomes possible.

[0143] As another example, a first virtual machine (not shown) can directly receive and process CAN data, Ethernet data, audio data, radio data, USB data, and wireless communication data for a second virtual machine or a third virtual machine (not shown).

[0144] And, the first virtual machine (not shown) can transmit processed data to the second virtual machine or the third virtual machine (not shown).

[0145] Accordingly, among the first virtual machine to the third virtual machine (not shown), only the first virtual machine (not shown) receives sensor data, communication data, or external input data from multiple sensor devices and performs signal processing, thereby reducing the signal processing burden on other virtual machines, enabling 1:N data communication, and enabling synchronization when sharing data.

[0146] Meanwhile, the first virtual machine (not shown) can control the second virtual machine (not shown) and the third virtual machine (not shown) to share the same data by writing data to the shared memory (508).

[0147] For example, a first virtual machine (not shown) can record vehicle sensor data, the location information data, the camera image data, or the touch input data in shared memory (508) and control the same data to be shared with a second virtual machine (not shown) and a third virtual machine (not shown). Accordingly, data sharing in a 1:N manner becomes possible.

[0148] Ultimately, by performing most of the data processing on the first virtual machine (not shown), data sharing in a 1:N manner becomes possible.

[0149] Meanwhile, the first virtual machine (not shown) within the processor (175) can control the shared memory (508) based on the hypervisor (505) to be set for the same data transmission to the second virtual machine (not shown) and the third virtual machine (not shown).

[0150] Meanwhile, the signal processing device (170) can process various signals such as audio signals, video signals, and data signals. To this end, the signal processing device (170) can be implemented in the form of a system on chip (SOC).

[0151] Meanwhile, the signal processing device (170) of FIG. 4 may be the same as the signal processing device (170, 170a1, 170a2) of the vehicle control device of FIG. 5a or lower.

[0152] Figures 5a to 5d are drawings showing various examples of vehicle control devices.

[0153] FIG. 5a illustrates an example of a vehicle control device according to an embodiment of the present disclosure.

[0154] Referring to the drawing, a vehicle control device (800a) according to an embodiment of the present disclosure includes a signal processing device (170a1, 170a2) and a plurality of area signal processing devices (170Z1 to 170Z4).

[0155] Meanwhile, in the drawing, two signal processing devices (170a1, 170a2) are exemplified, but this is for backup purposes, etc., and one is also possible.

[0156] Meanwhile, the signal processing device (170a1, 170a2) may also be named an HPC (High Performance Computing) signal processing device.

[0157] Multiple area signal processing devices (170Z1 to 170Z4) are arranged in each area (Z1 to Z4) and can transmit sensor data to signal processing devices (170a1, 170a2).

[0158] The signal processing device (170a1, 170a2) receives data via a wire from multiple area signal processing devices (170Z1 to 170Z4) or a communication device (120).

[0159] In the drawing, data is exchanged based on wired communication between a signal processing device (170a1, 170a2) and multiple area signal processing devices (170Z1 to 170Z4), and the signal processing device (170a1, 170a2) and the server (400) exchange data based on wireless communication. However, data may be exchanged based on wireless communication between a communication device (120) and a server (400), and the signal processing device (170a1, 170a2) and the communication device (120) may exchange data based on wired communication.

[0160] Meanwhile, data received by the signal processing device (170a1, 170a2) may include camera data or sensor data.

[0161] For example, sensor data within a vehicle may include at least one of vehicle wheel speed data, vehicle direction data, vehicle location data (GPS data), vehicle angle data, vehicle speed data, vehicle acceleration data, vehicle inclination data, vehicle forward / backward data, battery data, fuel data, tire data, vehicle lamp data, vehicle interior temperature data, vehicle interior humidity data, vehicle exterior radar data, and vehicle exterior lidar data.

[0162] Meanwhile, camera data may include vehicle exterior camera data and vehicle interior camera data.

[0163] Meanwhile, the signal processing device (170a1, 170a2) can execute multiple virtual machines (820, 830, 840) based on safety standards.

[0164] In the drawing, it is illustrated that a processor (175) within a signal processing device (170a) executes a hypervisor (505) and, on the hypervisor (505), executes first to third virtual machines (820 to 840) according to an automotive safety integrity level (Automotive SIL; ASIL).

[0165] The first virtual machine (820) may be a virtual machine corresponding to Quality Management (QM), which is the lowest safety level in the Automotive Safety Integrity Level (ASIL) and is a non-enforceable level.

[0166] The first virtual machine (820) can execute an operating system (822), a container runtime (824) on the operating system (822), and containers (827, 829) on the container runtime (824).

[0167] The second virtual machine (830) may be a virtual machine corresponding to ASIL A or ASIL B, where the sum of severity, exposure, and controllability is 7 or 8 in the automotive safety integrity level (ASIL).

[0168] The second virtual machine (830) can execute an operating system (832), a container runtime (834) on the operating system (832), and containers (837, 839) on the container runtime (834).

[0169] The third virtual machine (840) may be a virtual machine corresponding to ASIL C or ASIL D, in which the sum of severity, exposure, and controllability is 9 or 10 in the automotive safety integrity level (ASIL).

[0170] Meanwhile, ASIL D can correspond to the grade that requires the highest safety level.

[0171] The third virtual machine (840) can run a safety operating system (842) and an application (845) on the operating system (842).

[0172] Meanwhile, the third virtual machine (840) may also execute a safety operating system (842), a container runtime (844) on the safety operating system (842), and a container (847) on the container runtime (844).

[0173] Meanwhile, unlike the drawing, the third virtual machine (840) can also be executed through a separate core rather than the processor (175). This will be described later with reference to FIG. 5b.

[0174] FIG. 5b illustrates another example of a vehicle control device according to an embodiment of the present disclosure.

[0175] Referring to the drawing, a vehicle control device (800b) according to an embodiment of the present disclosure includes a signal processing device (170a1, 170a2) and a plurality of area signal processing devices (170Z1 to 170Z4).

[0176] The vehicle control device (800b) of FIG. 5b is similar to the vehicle control device (800a) of FIG. 5a, but the signal processing device (170a1) has some differences from the signal processing device (170a1) of FIG. 5a.

[0177] To describe the difference, the signal processing device (170a1) may include a processor (175) and a second processor (177).

[0178] The processor (175) within the signal processing unit (170a1) executes a hypervisor (505), and executes first and second virtual machines (820 to 830) on the hypervisor (505) according to the automotive safety integrity level (Automotive SIL; ASIL).

[0179] The first virtual machine (820) can execute an operating system (822), a container runtime (824) on the operating system (822), and containers (827, 829) on the container runtime (824).

[0180] The second virtual machine (830) can execute an operating system (832), a container runtime (834) on the operating system (832), and containers (837, 839) on the container runtime (834).

[0181] Meanwhile, the second processor (177) within the signal processing device (170a1) can execute a third virtual machine (840).

[0182] The third virtual machine (840) can execute a safety operating system (842), an auto-execution (845) on the operating system (842), and an application (845) on the auto-execution (845). That is, unlike FIG. 5A, an auto-execution (846) on the operating system (842) can be executed.

[0183] Meanwhile, the third virtual machine (840) may, similarly to FIG. 5a, execute a safety operating system (842), a container runtime (844) on the safety operating system (842), and a container (847) on the container runtime (844).

[0184] Meanwhile, the third virtual machine (840) requiring a high level of security is preferably executed on a second processor (177), which is a different core or different processor, unlike the first and second virtual machines (820 to 830).

[0185] Meanwhile, in the signal processing devices (170a1, 170a2) of FIGS. 5a and 5b, when the first signal processing device (170a) malfunctions, the second signal processing device (170a2), which is a backup device, can operate.

[0186] Alternatively, it is also possible for the signal processing devices (170a1, 170a2) to operate simultaneously, with the first signal processing device (170a) operating as the main device and the second signal processing device (170a2) operating as the sub device. This will be described with reference to FIGS. 5c and 5d.

[0187] FIG. 5c illustrates another example of a vehicle control device according to an embodiment of the present disclosure.

[0188] Referring to the drawing, a vehicle control device (800c) according to an embodiment of the present disclosure includes a signal processing device (170a1, 170a2) and a plurality of area signal processing devices (170Z1 to 170Z4).

[0189] Meanwhile, in the drawing, two signal processing devices (170a1, 170a2) are exemplified, but this is for backup purposes, etc., and one is also possible.

[0190] Meanwhile, the signal processing device (170a1, 170a2) may also be named an HPC (High Performance Computing) signal processing device.

[0191] Multiple area signal processing devices (170Z1 to 170Z4) are arranged in each area (Z1 to Z4) and can transmit sensor data to signal processing devices (170a1, 170a2).

[0192] The signal processing device (170a1, 170a2) receives data via a wire from multiple area signal processing devices (170Z1 to 170Z4) or a communication device (120).

[0193] In the drawing, data is exchanged based on wired communication between a signal processing device (170a1, 170a2) and multiple area signal processing devices (170Z1 to 170Z4), and the signal processing device (170a1, 170a2) and the server (400) exchange data based on wireless communication. However, data may be exchanged based on wireless communication between a communication device (120) and a server (400), and the signal processing device (170a1, 170a2) and the communication device (120) may exchange data based on wired communication.

[0194] Meanwhile, data received by the signal processing device (170a1, 170a2) may include camera data or sensor data.

[0195] Meanwhile, among the signal processing devices (170a1, 170a2), the processor (175) in the first signal processing device (170a1) executes a hypervisor (505) and can execute a safety virtualization machine (860) and a non-safety virtualization machine (870) on the hypervisor (505), respectively.

[0196] Meanwhile, among the signal processing devices (170a1, 170a2), the processor (17b5) in the second signal processing device (170a2) executes the hypervisor (505b) and can execute only the safety virtualization machine (880) on the hypervisor (505).

[0197] In this way, since the processing for safety is separated between the first signal processing device (170a1) and the second signal processing device (170a2), it is possible to improve stability and processing speed.

[0198] Meanwhile, high-speed network communication can be performed between the first signal processing device (170a1) and the second signal processing device (170a2).

[0199] FIG. 5d illustrates another example of a vehicle control device according to an embodiment of the present disclosure.

[0200] Referring to the drawing, a vehicle control device (800d) according to an embodiment of the present disclosure includes a signal processing device (170a1, 170a2) and a plurality of area signal processing devices (170Z1 to 170Z4).

[0201] The vehicle control device (800d) of FIG. 5d is similar to the vehicle control device (800c) of FIG. 5c, but the second signal processing device (170a2) has some differences from the second signal processing device (170a2) of FIG. 5c.

[0202] The processor (17b5) in the second signal processing device (170a2) of FIG. 5d executes a hypervisor (505b) and can execute a safety virtualization machine (880) and a non-safety virtualization machine (890) on the hypervisor (505).

[0203] That is, unlike FIG. 5c, the difference is that the processor (17b5) within the second signal processing device (170a2) further executes a non-safety virtualization machine (890).

[0204] In this way, since the processing for safety and non-safety is separated into the first signal processing device (170a1) and the second signal processing device (170a2), it is possible to improve stability and processing speed.

[0205] FIG. 6 is an example of a block diagram of a vehicle control device according to an embodiment of the present disclosure.

[0206] Referring to the drawing, a vehicle control device (900) according to an embodiment of the present disclosure includes a plurality of area signal processing devices (170Z1 to 170Z4) and a signal processing device (170).

[0207] The signal processing device (170) at this time is a high-performance centralized signal processing and control device having multiple CPUs and GPUs, and may be called an HPC (High Performance Computing) signal processing device or a central signal processing device.

[0208] A plurality of area signal processing devices (170Z1 to 170Z4) and a signal processing device (170) are connected by wired cables (CB1 to CB4).

[0209] Meanwhile, multiple area signal processing devices (170Z1 to 170Z4) can be connected to each other with wired cables (CBa to CBd).

[0210] The wired cable (CBa~CBd) at this time may include a CAN communication cable, an Ethernet communication cable, or a PCI Express cable.

[0211] Meanwhile, a signal processing device (170) according to an embodiment of the present disclosure comprises at least one processor (175, 178, 177) and a large-capacity storage device (925).

[0212] For example, at least one processor may be a central processor.

[0213] Meanwhile, the signal processing device (170) according to the embodiment of the present disclosure may further include a graphics processor or a neural processor.

[0214] Meanwhile, sensor data may be transmitted from at least one of the multiple area signal processing devices (170Z1 to 170Z4) to the signal processing device (170). In particular, the sensor data may be stored in a storage device (925) within the signal processing device (170).

[0215] The sensor data at this time may include at least one of camera data, lidar data, radar data, vehicle direction data, vehicle location data (GPS data), vehicle angle data, vehicle speed data, vehicle acceleration data, vehicle inclination data, vehicle forward / backward data, battery data, fuel data, tire data, vehicle lamp data, vehicle interior temperature data, and vehicle interior humidity data.

[0216] In the drawing, it is exemplified that camera data from a camera (195a) and lidar data from a lidar sensor (196) are input to a first area signal processing device (170Z1), and the camera data and lidar data are transmitted to a signal processing device (170) via a second area signal processing device (170Z2), a third area signal processing device (170Z3), etc.

[0217] Meanwhile, since the data read speed or write speed to the storage device (925) is faster than the network speed when sensor data is transmitted from at least one of the plurality of area signal processing devices (170Z1 to 170Z4) to the signal processing device (170), it is preferable that multi-path routing be performed so that a network bottleneck does not occur.

[0218] To this end, the signal processing device (170) according to the embodiment of the present disclosure can perform multi-path routing based on a Software Defined Network (SDN). Accordingly, a stable network environment can be secured when reading or writing data from the storage device (925). Furthermore, since data can be transmitted to the storage device (925) using multiple paths, the network configuration can be dynamically changed to transmit data.

[0219] Data communication between a plurality of area signal processing devices (170Z1 to 170Z4) and a signal processing device (170) in a vehicle control device (900) according to an embodiment of the present disclosure is preferably Peripheral Component Interconnect Express communication for high-bandwidth, low-latency communication.

[0220] FIG. 7a is an example of an internal block diagram of a signal processing device related to the present disclosure.

[0221] Referring to the drawing, a signal processing device (1000) related to the present disclosure can perform optical cable-based data communication between two computing nodes (CNa, CNb).

[0222] The first computing node (CNa) is equipped with a hardware Infiniband card (ICDa), executes an Infiniband driver (IDRa) for the hardware Infiniband card (ICDa), and can execute an Infiniband core on the Infiniband driver (IDRa).

[0223] Meanwhile, the first computing node (CNa) runs a remote direct memory access (RMDA) provider (PRDa) on an InfiniBand core, runs an application programming interface (API) (RAIa) on the RMDA provider (PRDa), and runs an application on the RMDA API (RAIa).

[0224] Meanwhile, an application within the first computing node (CNa) can transfer large amounts of data to the counterpart node, the second computing node (CNb), using a user-level RMDA API (RAIa), such as rcopy.

[0225] The second computing node (CNb) is equipped with a hardware InfiniBand card (ICDb), executes an InfiniBand driver (IDRb) for the hardware InfiniBand card (ICDb), and can execute an InfiniBand core on the InfiniBand driver (IDRb).

[0226] Meanwhile, the second computing node (CNb) runs an RMDA provider (PRDb) on the InfiniBand core, runs an application programming interface (RAIb) on the RMDA provider (PRDb), and runs applications on the RMDA API (RAIb).

[0227] Meanwhile, an application within the second computing node (CNb) can transfer large amounts of data to the counterpart node, the first computing node (CNa), using a user-level RMDA API (RAIb), ​​such as rcopy.

[0228] In this way, the signal processing device (1000) related to the present disclosure can perform large-capacity data transmission or reception by combining InfiniBand and remote direct memory access.

[0229] However, since the signal processing device (1000) related to the present disclosure must use a non-flexible optical cable, problems such as space constraints or design constraints arise.

[0230] Accordingly, in the present disclosure, a Peripheral Component Interconnect Express method can be applied instead of InfiniBand between computing nodes or processors.

[0231] FIG. 7b illustrates a vehicle control device related to the present disclosure.

[0232] Referring to the drawings, a vehicle control device related to the present disclosure includes a storage device (170x), a plurality of computing nodes (CNa, CNb, CNc), and a host channel adapter (HCA) switch (HSa), which is a dedicated network adapter, for communication between the storage device (170x) and the plurality of computing nodes (CNa, CNb, CNc).

[0233] Meanwhile, the vehicle control device related to the present disclosure may further include a network switch (NSa) for communication between some (CNa) of the plurality of computing nodes (CNa, CNb, CNc) and a storage device (170x).

[0234] At this time, the multiple computing nodes (CNa, CNb, CNc) may be multiple processors or multiple signal processing devices.

[0235] Meanwhile, the storage device (170x) may be equipped with a host channel adapter (706) and a network interface card (703) corresponding to a host channel adapter switch (HSa) and a network switch (NSa), respectively.

[0236] Meanwhile, the storage device (170x) may be equipped with an internal processor (175), an external component high-speed connection (PCI Express) switch (702), and a plurality of storage memories (925a to 925c).

[0237] According to the configuration of the storage device (170x), the host channel adapter switch (HSa), the network switch (NSa), and the multiple computing nodes (CNa, CNb, CNc) of FIG. 7b, a separate TCP channel is required to share a file object existing in a shared area within the storage device (170x).

[0238] Accordingly, the present disclosure proposes a method for efficiently operating a large-capacity storage device without requiring a separate channel when sharing existing file objects in a shared area or shared namespace within the large-capacity storage device. This is described with reference to FIG. 8a.

[0239] FIG. 8a is an example of a block diagram of a vehicle control device according to one embodiment of the present disclosure.

[0240] Referring to the drawings, a vehicle control device according to one embodiment of the present disclosure includes a central signal processing device (170m), an area signal processing device (170Z1), and a network switch (NSm).

[0241] Meanwhile, a vehicle control device according to one embodiment of the present disclosure may include a plurality of area signal processing devices (170Z1, 170Z2).

[0242] Meanwhile, multiple area signal processing devices (170Z1, 170Z2) can exchange data with each signal processing device (170m) through a network switch (NSm).

[0243] For example, multiple area signal processing devices (170Z1, 170Z2) can transmit camera data, image data, or sensor data to a signal processing device (170m) via a network switch (NSm).

[0244] Meanwhile, multiple area signal processing devices (170Z1, 170Z2) can receive a control signal from a signal processing device (170m) through a network switch (NSm).

[0245] A signal processing device (170m) according to one embodiment of the present disclosure includes a first processor (CN1) that exchanges data with an external area signal processing device (170Z1), a second processor (CN2) that controls a display (180), and a storage device (925) having a plurality of namespaces.

[0246] Meanwhile, the first processor (CN1) controls the area signal processing unit (170Z1) to access a shared area or shared namespace (926) within the storage device (925) based on the non-volatile memory express (NVMe / TCP) based on the transmission control protocol. Accordingly, the large-capacity storage device (925) within the vehicle can be efficiently operated.

[0247] Meanwhile, the first processor (CN1) can exchange data with the area signal processing device (170Z1) via an external network switch (NSm). This enables efficient operation of the in-vehicle large-capacity storage device (925).

[0248] Meanwhile, the first processor (CN1) can operate as a host for accessing a shared area or shared namespace (926) within the storage device (925) of the area signal processing device (170Z1). Accordingly, the large-capacity storage device (925) within the vehicle can be efficiently operated. Furthermore, by separating data storage to the storage device (925) and data processing from the storage device (925), system complexity can be reduced.

[0249] Meanwhile, the first processor (CN1) can operate as a host of a non-volatile memory express (NVMe / TCP) based on a transmission control protocol, and the second processor (CN2) can operate as a client of a non-volatile memory express (NVMe / TCP) based on a transmission control protocol. Accordingly, the large-capacity storage device (925) in the vehicle can be efficiently operated.

[0250] Meanwhile, a signal processing device (170m) according to one embodiment of the present disclosure may further include an external component high-speed connection (PCI Express) switch (702) connected between a storage device (925) and a first processor (CN1) or a second processor (CN2). Accordingly, a large-capacity storage device (925) within a vehicle can be efficiently operated.

[0251] Meanwhile, the storage device (925) can allocate some of the plurality of namespaces exclusively to the first processor (CN1) or the second processor (CN2), and share another part of the plurality of namespaces, that is, a shared namespace (926), with the first processor (CN1) or the second processor (CN2) or the area signal processing device (170Z1). Accordingly, the large-capacity storage device (925) in the vehicle can be efficiently operated.

[0252] Meanwhile, the storage device (925) can exchange data with the first processor (CN1) or the second processor (CN2) via remote direct memory access (RDMA). Accordingly, the large-capacity storage device (925) within the vehicle can be efficiently operated. Furthermore, based on a high-bandwidth data communication method between computing nodes, an efficient and expandable data storage device (925) between nodes can be configured.

[0253] Meanwhile, the storage device (925) can operate based on non-volatile memory express over fabrics (NVMeoF) based on remote direct memory access over external components high-speed connection (RDMA over PCI Express). Accordingly, the large-capacity storage device (925) in the vehicle can be efficiently operated. In addition, the direct sharing of the storage device (925) eliminates the need for a separate protocol when transmitting or receiving data.

[0254] FIG. 8b is an example of a block diagram of a vehicle control device according to another embodiment of the present disclosure.

[0255] Referring to the drawings, a vehicle control device according to another embodiment of the present disclosure may include a central signal processing device (170mb), a plurality of area signal processing devices (170Z1, 170Z2), and a network switch (NSm), similar to FIG. 8a.

[0256] The operation of the multiple area signal processing devices (170Z1, 170Z2) and the network switch (NSm) may be the same as the description of Fig. 8a.

[0257] Meanwhile, the central signal processing unit (170mb) differs from FIG. 8a in that it does not have an external component high-speed connection (PCI Express) switch (702) inside.

[0258] In response to this, the storage device (925) may include a plurality of ports (not shown) for connection with the first processor (CN1) and the second processor (CN2), and a controller (not shown) for processing commands through the plurality of ports. Accordingly, the large-capacity storage device (925) within the vehicle can be efficiently operated.

[0259] A signal processing device (170mb) according to another embodiment of the present disclosure includes a first processor (CN1) that exchanges data with an external area signal processing device (170Z1), a second processor (CN2) that controls a display (180), and a storage device (925) having a plurality of namespaces.

[0260] Meanwhile, the first processor (CN1) controls the area signal processing unit (170Z1) to access a shared area or shared namespace (926) within the storage device (925) based on the non-volatile memory express (NVMe / TCP) based on the transmission control protocol. Accordingly, the large-capacity storage device (925) within the vehicle can be efficiently operated.

[0261] Meanwhile, the first processor (CN1) can exchange data with the area signal processing device (170Z1) via an external network switch (NSm). This enables efficient operation of the in-vehicle large-capacity storage device (925).

[0262] Meanwhile, the first processor (CN1) can operate as a host for accessing a shared area or shared namespace (926) within the storage device (925) of the area signal processing device (170Z1). Accordingly, the large-capacity storage device (925) within the vehicle can be efficiently operated. Furthermore, by separating data storage to the storage device (925) and data processing from the storage device (925), system complexity can be reduced.

[0263] Meanwhile, the first processor (CN1) can operate as a host of a non-volatile memory express (NVMe / TCP) based on a transmission control protocol, and the second processor (CN2) can operate as a client of a non-volatile memory express (NVMe / TCP) based on a transmission control protocol. Accordingly, the large-capacity storage device (925) in the vehicle can be efficiently operated.

[0264] Meanwhile, the storage device (925) can allocate some of the plurality of namespaces exclusively to the first processor (CN1) or the second processor (CN2), and share another part of the plurality of namespaces, that is, a shared namespace (926), with the first processor (CN1) or the second processor (CN2) or the area signal processing device (170Z1). Accordingly, the large-capacity storage device (925) in the vehicle can be efficiently operated.

[0265] Meanwhile, the storage device (925) can exchange data with the first processor (CN1) or the second processor (CN2) via remote direct memory access (RDMA). Accordingly, the large-capacity storage device (925) within the vehicle can be efficiently operated. Furthermore, based on a high-bandwidth data communication method between computing nodes, an efficient and expandable data storage device (925) between nodes can be configured.

[0266] Meanwhile, the storage device (925) can operate based on non-volatile memory express over fabrics (NVMeoF) based on remote direct memory access over external components high-speed connection (RDMA over PCI Express). Accordingly, the large-capacity storage device (925) in the vehicle can be efficiently operated. In addition, the direct sharing of the storage device (925) eliminates the need for a separate protocol when transmitting or receiving data.

[0267] FIG. 8c is an example of a block diagram of a vehicle control device according to another embodiment of the present disclosure.

[0268] Referring to the drawings, a vehicle control device according to another embodiment of the present disclosure may include a central signal processing device (170mc), a plurality of area signal processing devices (170Z1, 170Z2, 170Z3), and a network switch (NSm), similar to FIG. 8a.

[0269] Meanwhile, Fig. 8a illustrates multiple area signal processing devices, including a first area signal processing device (170Z1) and a second area signal processing device (70Z2), but Fig. 8c is different in that a third area signal processing device (170Z3) is additionally provided.

[0270] Meanwhile, the operation of the central signal processing unit (170mc) can correspond to the operation of the central signal processing unit (170m) of FIG. 8a.

[0271] Meanwhile, referring to FIGS. 8A to 8C, a plurality of area signal processing devices (170Z1, 170Z2) can access a shared area or shared namespace within a storage device (925) based on a non-volatile memory device express (NVMe / TCP) based on a transmission control protocol.

[0272] Meanwhile, the signal processing unit (170m, 170mb, 170mc) includes multiple computing nodes, such as multiple processors (CN1, Cn2), and the multiple computing nodes can access a shared area or shared namespace within the storage device (925) via an NVMeoF over external component high-speed connection bus (PCI Express Bus). At this time, a separate channel for synchronizing shared file objects is not required.

[0273] Figures 9a to 10d are drawings referenced in the description of Figures 8a to 8c.

[0274] FIG. 9a is a diagram illustrating operations between multiple processors within a signal processing device.

[0275] Referring to the drawing, the first processor (CN1) or the second processor (CN2) can execute NTB Transport on an external component high-speed connection bus (PCI Express Bus) and execute remote direct memory access (RMDA) on the NTB Transport. Accordingly, the large-capacity storage device (925) in the vehicle can be efficiently operated. Furthermore, the efficient management and expandability of the data storage device (925) can be improved.

[0276] Meanwhile, the first processor (CN1) or the second processor (CN2) can execute NTB Transport on an external component high-speed connection bus (PCI Express Bus) and execute NTB NetDev (NTB_NETDEV), which operates as a synchronization channel for sharing file objects, on the NTB Transport. Accordingly, the large-capacity storage device (925) in the vehicle can be efficiently operated.

[0277] Meanwhile, the first processor (CN1) or the second processor (CN2) can execute NTB Transport on an external component high-speed connection bus (PCI Express Bus) and execute NTB NetDev (NTB_NETDEV), which operates as a synchronization channel for sharing file objects, on the NTB Transport. Accordingly, the large-capacity storage device (925) in the vehicle can be efficiently operated.

[0278] Meanwhile, the first processor (CN1) or the second processor (CN2) may execute NTB Transport on an external component high-speed connection bus (PCI Express Bus), execute remote direct memory access (RMDA) and NTB NetDev (NTB_NETDEV) on the NTB Transport, transmit camera data, image data, or sensor data through remote direct memory access (RDMA), and transmit control data through NTB NetDev (NTB_NETDEV). Accordingly, it is possible to efficiently operate a large-capacity storage device (925) in the vehicle.

[0279] Specifically, the first processor (CN1) may execute an NTB Transport (913) and an NVMe storage (909) on an external component high-speed connection bus (911), execute a remote direct memory access (RMDA) (905) and an NTB NetDev (907) on the NTB Transport (913), and execute an NVMe Fabric host (903) on the remote direct memory access (RMDA) (905).

[0280] In addition, the second processor (CN2) can execute a file system (901).

[0281] Meanwhile, the second processor (CN2) can execute NTB Transport (933) on the external component high-speed connection bus (931), execute Remote Direct Memory Access (RMDA) (925) and NTB NetDev (927) on the NTB Transport (933), execute NVMe Fabric client (923) on the Remote Direct Memory Access (RMDA) (925), and execute NVMe device (922) on the NVMe Fabric host (923).

[0282] In addition, the second processor (CN2) can execute a file system (921).

[0283] Meanwhile, the Queue Pair of NTB Transport (913,933) can be implemented to distinguish between requests from RDMA (905,925) and requests from NTB NetDev (907,927).

[0284] Meanwhile, NVMe storage (909) is registered (enumerated) to the first processor (CN1) through the PCI Express switch (702), and the second processor (CN2) can access the NVMe storage (909) through the fabric configuration.

[0285] That is, like S905, it is possible to access NVMe storage (909) through the configuration of NVMe Fabric host (903) and NVMe Fabric client (923).

[0286] Next, as in S907, the network interface created by NTB NetDev (907, 927) can be used for the synchronization channel of file objects in the shared area or shared namespace (926) within the storage device (925).

[0287] For example, for sharing file objects in a shared area or shared namespace (926) within a storage device (925), it is desirable to use a synchronous file system such as GFS2 or OCFS.

[0288] Meanwhile, synchronous file systems such as GFS2 or OCFS require a separate synchronization channel, and thus the first processor (CN1) and the second processor (CN12) can run NTB NetDev (907) and NTB NetDev (927), respectively. Accordingly, a separate Ethernet channel is not required.

[0289] Figure 9b illustrates the connection between a network switch (NSm) and NTB NetDev (907) within the first processor (CN1).

[0290] Referring to the drawing, a plurality of area signal processing devices (170Z1, 170Z2) can connect to the NTB NetDev (907) within the first processor (CN1) based on the non-volatile memory express (NVMe / TCP) based on the transmission control protocol via a network switch (NSm) (S909).

[0291] Figure 9c illustrates the connection between a network switch (NSm) and a first processor (CN1).

[0292] Referring to the drawing, after step S909 of FIG. 9b, multiple area signal processing devices (170Z1, 170Z2) can access a shared area or shared namespace within a storage device (925) based on the NTB NetDev (907) within the first processor (CN1) (S911).

[0293] That is, the first processor (CN1) can operate as a host for accessing a shared area or shared namespace (926) within the storage device (925) of the area signal processing device (170Z1). Accordingly, the large-capacity storage device (925) within the vehicle can be efficiently operated. Furthermore, by separating data storage to the storage device (925) and data processing from the storage device (925), system complexity can be reduced.

[0294] Meanwhile, a large-capacity storage device (925) may have a shared area or shared namespace (926) that is simultaneously shared by multiple processors (CN1, CN2) or multiple area signal processing devices (170Z1, 170Z2).

[0295] Meanwhile, it is preferable that the shared area or shared namespace (926) be formatted by a shared file system such as GFS2. Furthermore, it is preferable to secure a separate synchronization channel for file object synchronization.

[0296] Meanwhile, in the embodiment of the present disclosure, the storage device (925) can implement synchronization of file objects using only a physical port without configuring a separate synchronization channel such as Ethernet.

[0297] Meanwhile, in the embodiment of the present disclosure, the storage device (925) can be physically connected to multiple internal processors (CN1, CN2) via a PCI Express bus.

[0298] Meanwhile, in the embodiment of the present disclosure, the storage device (925) may be provided with a plurality of namespaces, some of which may be shared simultaneously by a plurality of processors (CN1, CN2) or a plurality of area signal processing devices (170Z1, 170Z2).

[0299] Meanwhile, multiple area signal processing devices (170Z1, 170Z2) can access the storage device (925) via NVMeoF / TCP.

[0300] FIG. 10a illustrates connection with multiple processors (CN1, CN2) based on physical ports of a storage device (925).

[0301] Referring to the drawing, the storage device (925) may include a plurality of ports (PTa, PTb) for connection with the first processor (CN1) and the second processor (CN2), and a controller (927) for processing commands through the plurality of ports (PTa, PTb).

[0302] Meanwhile, the storage device (925) can store a lock table (928) including the path, name, and lock status of the file object.

[0303] In particular, any one of the multiple namespaces within the storage device (925) may store a lock table (928) containing the path, name, and lock status of the file object.

[0304] Meanwhile, the storage device (925) can store a shared file (929).

[0305] Meanwhile, the first processor (CN1) can execute an NVMe device driver (1005), execute a lock manager-based file system (915) on the NVMe device driver (1005), execute a virtual file system (1003) on the file system (915), and execute an application (1001) on the virtual file system (1003).

[0306] Meanwhile, the second processor (CN2) can execute an NVMe device driver (1015), execute a lock manager-based file system (935) on the NVMe device driver (1015), execute a virtual file system (1013) on the file system (935), and execute an application (1011) on the virtual file system (1013).

[0307] Figure 10b illustrates an example of the lock table (928) of Figure 10a.

[0308] Referring to the drawing, the lock table (928) may include the path of the file object, the file name, and the lock status. In this case, the path of the file object may be the full path.

[0309] Meanwhile, the lock status may include node information or released status information.

[0310] Node information at this time may be information about multiple processors (CN1, CN2) or multiple area signal processing devices (170Z1, 170Z2).

[0311] FIG. 10c illustrates an example of signal exchange between a controller (927) and a first processor (CN1) within a storage device (925).

[0312] Referring to the drawing, the controller (927) within the storage device (925) can receive an access request message (SSa) from the first processor (CN1) or the second processor (CN2) or the area signal processing device (170Z1) among the first processor (CN1).

[0313] In response to this, the controller (927) within the storage device (925) can check whether the lock status value within the lock table (928) is released.

[0314] Meanwhile, the controller (927) within the storage device (925) can allow access to the first processor (CN1) when the lock status is in the released state.

[0315] Next, the controller (927) within the storage device (925) can transmit an access permission message (SSb) to the first processor (CN1) to allow access to the first processor (CN1).

[0316] Meanwhile, the first processor (CN1) may perform a read or write operation on a file object in a shared area or shared namespace (926) within the storage device (925) based on receipt of an access permission message (SSb).

[0317] At this time, the lock status value in the lock table (928) can be changed to an identifier indicating the first processor (CN1), such as “node #1”.

[0318] That is, the first processor (CN1) that has acquired access rights can limit access to the corresponding file object from other devices by updating the lock status in the lock table (928).

[0319] For example, the first processor (CN1) that has acquired access rights can update the lock status in the lock table (928) and transmit an access restriction message (SSc) from another device to the corresponding file object.

[0320] Next, the first processor (CN1) can update (SSd) the lock status value when processing for the file object is completed.

[0321] For example, the first processor (CN1) can change the lock status value to released when processing for the file object is completed.

[0322] Accordingly, the first processor (CN1) or the second processor (CN2) or the area signal processing device (170Z1) may be able to access file objects within the shared area or shared namespace (926).

[0323] Meanwhile, the controller (927) within the storage device (925) can sequentially assign access rights to file objects within the shared area or shared namespace (926).

[0324] For example, a controller (927) within a storage device (925) can sequentially assign access rights to a first processor (CN1), a second processor (CN2), or an area signal processing device (170Z1).

[0325] Meanwhile, it is desirable for the first processor (CN1) to immediately return a release access since it does not need to process file objects within the shared area or shared namespace (926).

[0326] That is, since the first processor (CN1) does not need to process a file object within the shared area or shared namespace (926), it can transmit the access return message (SSe) to the controller (927) within the storage device (925).

[0327] Accordingly, efficient sharing of file objects within a shared area or shared namespace (926) becomes possible.

[0328] Figure 10d is a drawing referenced in the description of checking abnormal operation of a storage device (925).

[0329] Referring to the drawing, the signal processing device (170mc) may further include, in addition to the first processor (CN1), the second processor (CN2), and the storage device (925), an indicator (1025) for checking abnormal operation of the storage device (925).

[0330] Additionally, the signal processing device (170mc) may further include a system management bus (1022).

[0331] Meanwhile, the microcomputer (1020) can control the signal processing device (170mc) based on signals from the system management bus (1022) and indicator (1025).

[0332] In the drawing, the microcomputer (1020) is shown as being separately placed outside the signal processing device (170mc), but alternatively, it may be placed within the signal processing device (170mc).

[0333] For example, the microcomputer (1020) can determine a fail operation of the storage device (925) based on the transmission of check data and the reception of response data thereto when the indicator of the storage device (925) or the active signal of the storage device (925) is abnormal, and can control the storage device (925) to be reset when the failure of the storage device (925) is determined.

[0334] Accordingly, it becomes possible to efficiently operate a large-capacity storage device (925) within a vehicle. Furthermore, it becomes possible to provide functions that can meet the safety requirements required of a vehicle device.

[0335] Meanwhile, unlike the drawing, the first processor (CN1) or the second processor (CN2), rather than the microcomputer (1020), may control the signal processing device (170mc) based on signals from the system management bus (1022) and indicator (1025).

[0336] Fig. 11 is a flowchart showing an operation method of a signal processing device according to an embodiment of the present disclosure.

[0337] Referring to the drawing, an indicator (1025) in a signal processing device (170mc) according to an embodiment of the present disclosure can output an active signal or a deactive signal in response to the operation of a storage device (925).

[0338] Meanwhile, the microcomputer (1020) can determine whether the storage device (925) is in a deactive state based on a signal from the indicator (1025) (S1105), and if so, control to transmit check data to the system management bus (1022).

[0339] And, the microcomputer (1020) determines whether a response signal corresponding to check data is received from the system management bus (1022) (S1110), and if the response signal is received and it is determined to be an abnormal operation, it can determine whether the storage device (925) is in a fail operation (S1115).

[0340] In step 1115 (S1115), if the storage device (925) is determined to have failed, the microcomputer (1020) can control the storage device (925) to be reset (S1120).

[0341] Furthermore, the microcomputer (1020) can control to reset a signal processing device (170mc) including a storage device (925).

[0342] Accordingly, it becomes possible to efficiently operate a large-capacity storage device (925) within a vehicle. Furthermore, it becomes possible to provide functions that can meet the safety requirements required of a vehicle device.

[0343] Meanwhile, after the reset of the signal processing device (170mc), the first processor (CN1) or the second processor (CN2) can be controlled to operate in any one of the following: a first boot mode in which the first processor (CN1), the second processor (CN2), and the storage device (925) are powered off, a standby mode in which the first processor (CN1) and the storage device (925) are booted, and a third boot mode in which the second processor (CN2) is powered off, and a standby mode in which the first processor (CN1), the second processor (CN2), and the storage device (925) are booted.

[0344] Accordingly, it becomes possible to efficiently operate a large-capacity storage device (925) within a vehicle. Furthermore, it becomes possible to provide functions that can meet the safety requirements required of a vehicle device.

[0345] Referring to FIGS. 8A to 11, a first processor (CN1) within a signal processing device (170) according to an embodiment of the present disclosure may receive camera data or sensor data from a region signal processing device (170Z1), control the storage of the camera data or sensor data in a storage device (925), or perform data processing (related to vehicle driving) based on the camera data or sensor data. Accordingly, a large-capacity storage device (925) within a vehicle may be efficiently operated.

[0346] Meanwhile, the second processor (CN2) within the signal processing device (170) according to the embodiment of the present disclosure can control an image based on camera data from the area signal processing device (170Z1) to be displayed on the display (180). Accordingly, the large-capacity storage device (925) within the vehicle can be efficiently operated.

[0347] Although the preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above, and various modifications may be made by a person skilled in the art to which the present invention pertains without departing from the gist of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical idea or prospect of the present disclosure.

Claims

1. A first processor for exchanging data with an external area signal processing device; A second processor that controls the display; A storage device having multiple namespaces; The above first processor, A signal processing device that controls access by the area signal processing device to a shared area or shared namespace within the storage device based on non-volatile memory express (NVMe / TCP) based on transmission control protocol.

2. In paragraph 1, The above first processor, A signal processing device acting as a host for accessing the shared area or the shared namespace within the storage device of the above-mentioned area signal processing device.

3. In paragraph 1, The above first processor, It acts as a host for non-volatile memory express (NVMe / TCP) based on the above transmission control protocol, The second processor, A signal processing device that operates as a client of a non-volatile memory express (NVMe / TCP) based on the above transmission control protocol.

4. In paragraph 1, A signal processing device further comprising an external component high-speed connection (PCI Express) switch connected between the storage device and the first processor or the second processor.

5. In paragraph 1, The above storage device, Allocate some of the above multiple namespaces exclusively to the first processor or the second processor, A signal processing device that shares a shared namespace, which is another part of the plurality of namespaces, with the first processor, the second processor, or the area signal processing device.

6. In paragraph 1, The above storage device, A signal processing device that exchanges data with the first processor or the second processor through remote direct memory access.

7. In paragraph 1, The above storage device, A signal processing device operating based on non-volatile memory express over fabrics (NVMeoF) based on remote direct memory access over external component high-speed interconnect (RDMA over PCI Express).

8. In paragraph 1, The first processor or the second processor, A signal processing device that executes an NTB Transport on an external component high-speed connection bus and executes remote direct memory access (RMDA) on the NTB Transport.

9. In paragraph 1, The first processor or the second processor, A signal processing unit that runs NTB Transport on an external component high-speed connection bus, and runs NTB NetDev (NTB_NETDEV) that acts as a synchronization channel for sharing file objects on the NTB Transport.

10. In paragraph 1, The first processor or the second processor, A signal processing unit that runs NTB Transport on an external component high-speed connection bus, and runs NTB NetDev (NTB_NETDEV) that acts as a synchronization channel for sharing file objects on the NTB Transport.

11. In paragraph 1, The first processor or the second processor, On the external component high-speed connection bus, NTB Transport is run, and on the NTB Transport, remote direct memory access (RMDA) and NTB NetDev are run respectively. Through the above remote direct memory access, camera data or image data or sensor data is transmitted, A signal processing device that transmits control data through the above NTB NetDev.

12. In paragraph 1, The above storage device, A plurality of ports for connection with the first processor and the second processor; A signal processing device including a controller that processes commands through each of the plurality of ports.

13. In paragraph 1, A signal processing device, wherein one of a plurality of namespaces within the storage device stores a lock table including a path, name, and lock status of a file object.

14. In paragraph 13, The above storage device, A signal processing device that allows access of the first processor, the second processor, or the area signal processing device when the above lock state is a released state.

15. In paragraph 1, The first processor or the second processor, A signal processing device that determines the fail operation of the storage device based on the transmission of check data and the reception of response data thereto when the indicator of the storage device or the active signal of the storage device is abnormal, and controls the storage device to be reset when the storage device is determined to be failed.

16. In paragraph 1, The first processor or the second processor, In the power off state of the first processor, the second processor, and the storage device, a first boot mode is booted, A second boot mode that is booted when the first processor and the storage device are in a standby mode and the second processor is powered off, A signal processing device that controls the first processor, the second processor, and the storage device to operate in one of the third boot modes during the standby mode.

17. In paragraph 1, The above first processor, A signal processing device that receives camera data or sensor data from the above-mentioned area signal processing device, controls storage of the camera data or the sensor data in the storage device, or performs data processing based on the camera data or the sensor data.

18. A first processor for exchanging data with an external area signal processing device; A second processor that controls the display; A storage device having multiple namespaces; The above first processor, It operates based on non-volatile memory express (NVMe / TCP) based on transmission control protocol. A signal processing device, wherein one of a plurality of namespaces within the storage device stores a lock table including the path, name, and lock status of a file object.

19. A first processor for exchanging data with an external domain signal processing device; A second processor that controls the display; A storage device having multiple namespaces; The above storage device, Exchange data with the first processor or the second processor through remote direct memory access, The above first processor, A signal processing device that exchanges data with the area signal processing device based on non-volatile memory express (NVMe / TCP) based on transmission control protocol.

20. A vehicle control device having a signal processing device according to any one of claims 1 to 19.

Images