Signal processing device and vehicle display device including the same

Abstract

A signal processing device according to one embodiment of the present invention comprises: a processor that executes a hypervisor; the processor executes a plurality of virtual machines on the hypervisor; a first virtual machine of the plurality of virtual machines executes a plurality of micro-services corresponding to a first security level, and transmits result data of the first micro-service of the plurality of micro-services to a second virtual machine of the plurality of virtual machines corresponding to a second security level lower than the first security level or to a virtual machine in the second signal processing device. As a result, data processing can be efficiently performed based on the security level.

Description

Technical Field

[0001] The present invention relates to a signal processing device and a vehicle display device having the signal processing device, and more particularly, to a signal processing device capable of effectively performing data processing based on a safety level and a vehicle display device having the signal processing device. Background Art

[0002] A vehicle is a device that moves a seated user in a desired direction. Representatively, an automobile can be cited.

[0003] On the other hand, for the convenience of users of a vehicle, a vehicle signal processing device is mounted inside the vehicle.

[0004] The signal processing device inside the vehicle receives sensor data from various internal sensor devices and processes it.

[0005] On the other hand, due to vehicle driving assistance (ADAS) or autonomous driving, etc., the types and quantities of sensors installed in a vehicle increase, and thus the data to be processed tends to increase.

[0006] On the other hand, related to vehicle driving assistance (ADAS) or autonomous driving, etc., it is necessary to perform data processing according to the Automotive Safety Integrity Level (Automotive SIL; ASIL), and thus there is a problem that it is difficult to achieve effective data processing or effective signal processing in order to perform data processing based on a safety level. Summary of the Invention

[0007] Problems to be Solved by the Invention

[0008] The problem to be solved by the present invention is to provide a signal processing device capable of effectively performing data processing based on a safety level and a vehicle display device having the signal processing device.

[0009] Another problem to be solved by the present invention is to provide a signal processing device capable of effectively performing data processing using microservices and a vehicle display device having the signal processing device.

[0010] Technical Solutions for Solving the Problems

[0011] A signal processing device and a vehicle display device having the signal processing device according to an embodiment of the present invention include a processor that executes a management program; the processor executes a plurality of virtual machines on the management program; a first virtual machine among the plurality of virtual machines executes a plurality of microservices corresponding to a first safety level, and transmits result data of a first microservice among the plurality of microservices to a second virtual machine corresponding to a second safety level lower than or equal to the first safety level or a virtual machine in a second signal processing device.

[0012] On the other hand, in order to execute a first application corresponding to a first security level, a first virtual machine can distinguish and execute a plurality of microservices.

[0013] On the other hand, a second virtual machine can execute a second application corresponding to a second security level; the second application can be executed based on the result data of the first microservice.

[0014] On the other hand, the second virtual machine may not transmit the result data of the microservice executed by the second virtual machine or the result data of the application to the first virtual machine.

[0015] On the other hand, the first virtual machine among a plurality of virtual machines may not transmit the result data of the first microservice among the plurality of microservices to a virtual machine of a third security level higher than the first security level.

[0016] On the other hand, a part of the cores of the processor can execute the first virtual machine; another part of the cores of the processor can execute the second virtual machine.

[0017] On the other hand, the signal processing device according to an embodiment of the present invention may further include a second processor different from the processor; the second processor can execute an application or a virtual machine; the security level of the application or the virtual machine executed in the second processor can be higher than the first security level.

[0018] On the other hand, the second processor may not execute a hypervisor.

[0019] On the other hand, the processor can receive sensor data or camera data from a second signal processing device; the first virtual machine can execute a plurality of microservices corresponding to the first security level based on the sensor data or the camera data, and transmit the result data of the first microservice among the plurality of microservices to the second virtual machine corresponding to a second security level lower than or equal to the first security level.

[0020] On the other hand, the first virtual machine can execute a plurality of microservices corresponding to the first security level based on the sensor data or the camera data, and transmit the result data of the first microservice among the plurality of microservices to a virtual machine corresponding to a second security level lower than or equal to the first security level within the second signal processing device.

[0021] On the other hand, the first virtual machine among a plurality of virtual machines can execute each of a face detection microservice, an eye movement microservice, an eye tracking microservice, and an alert microservice based on the received camera data; and can transmit the result data of the eye tracking microservice to the second virtual machine corresponding to the second security level.

[0022] On the other hand, the second virtual machine can be controlled to execute an augmented reality microservice based on the result data of the gaze tracking microservice, and display the result data of the augmented reality microservice on a display.

[0023] On the other hand, the second virtual machine can execute a face recognition microservice based on the received camera data, and execute an additional microservice based on the result data of the face recognition microservice.

[0024] On the other hand, the second virtual machine can execute each of an occupant seating microservice, an occupant movement microservice, an occupant detection microservice, and a graphics provision microservice based on the received sensor data or camera data, and may not transmit the service result data of the occupant detection microservice to the first virtual machine.

[0025] On the other hand, in the case where the service result data of the occupant detection microservice is not received from the second virtual machine, the first virtual machine can execute each of an occupant seating microservice, an occupant movement microservice, an occupant detection microservice, and a warning microservice based on the received sensor data or camera data.

[0026] On the other hand, the first virtual machine can transmit the result data of the first microservice to a second virtual machine corresponding to a second security level lower than or equal to the first security level by using a shared memory.

[0027] On the other hand, the first virtual machine can transmit the result data of the first microservice to at least one virtual machine corresponding to a second security level lower than or equal to the first security level by using a shared memory.

[0028] On the other hand, a certain virtual machine among a plurality of virtual machines can execute a data path controller for transmitting the result data of the first microservice; the data path controller can transmit transmission available information to an agent of the first microservice based on the security level of the first microservice and the security level of a microservice or application program in the second virtual machine.

[0029] A signal processing device according to another embodiment of the present invention and a vehicle display device having the signal processing device include a processor that executes a hypervisor; the processor executes a first virtual machine corresponding to a first security level and a second virtual machine corresponding to a second security level lower than or equal to the first security level on the hypervisor; the first virtual machine executes a first application program, and transmits the result data or intermediate result data of the first application program to the second virtual machine or a virtual machine corresponding to the second security level in the second signal processing device.

[0030] On the other hand, the first virtual machine may execute a first application including a plurality of microservices and transmit result data of at least a part of the plurality of microservices to the second virtual machine or the second signal processing device.

[0031] Advantageous Effects of the Invention

[0032] A signal processing device according to an embodiment of the present invention and a vehicle display device having the signal processing device include a processor that executes a hypervisor; the processor executes a plurality of virtual machines on the hypervisor; a first virtual machine among the plurality of virtual machines executes a plurality of microservices corresponding to a first security level and transmits result data of a first microservice among the plurality of microservices to a second virtual machine corresponding to a second security level lower than or equal to the first security level or a virtual machine in the second signal processing device. Accordingly, data processing can be effectively performed based on the security level. Further, data processing can be effectively performed using microservices.

[0033] On the other hand, in order to execute a first application corresponding to the first security level, the first virtual machine may separately execute a plurality of microservices. Accordingly, data processing can be effectively performed based on the security level.

[0034] On the other hand, the second virtual machine may execute a second application corresponding to the second security level; the second application may be executed based on the result data of the first microservice. Accordingly, data processing can be effectively performed based on the security level.

[0035] On the other hand, the second virtual machine may not transmit result data of the microservices executed by the second virtual machine or result data of the application to the first virtual machine. Accordingly, data processing can be effectively performed based on the security level.

[0036] On the other hand, the first virtual machine among the plurality of virtual machines may not transmit result data of the first microservice among the plurality of microservices to a virtual machine of a third security level higher than the first security level. Accordingly, data processing can be effectively performed based on the security level.

[0037] On the other hand, a part of the cores of the processor may execute the first virtual machine; another part of the cores of the processor may execute the second virtual machine. Accordingly, data processing can be effectively performed based on the security level.

[0038] On the other hand, the signal processing device according to an embodiment of the present invention may further include a second processor different from the processor; the second processor may execute an application or a virtual machine; the security level of the application or the virtual machine executed in the second processor may be higher than the first security level. Accordingly, data processing can be effectively performed based on the security level.

[0039] On the other hand, the processor may receive sensor data or camera data from the second signal processing device; the first virtual machine may execute a plurality of microservices corresponding to the first security level based on the sensor data or camera data, and transmit the result data of the first microservice among the plurality of microservices to a second virtual machine corresponding to a second security level lower than or equal to the first security level. Thus, data processing can be effectively performed based on the security level.

[0040] On the other hand, the first virtual machine may execute a plurality of microservices corresponding to the first security level based on the sensor data or camera data, and transmit the result data of the first microservice among the plurality of microservices to a virtual machine corresponding to a second security level lower than or equal to the first security level within the second signal processing device. Thus, data processing can be effectively performed based on the security level.

[0041] On the other hand, the first virtual machine among the plurality of virtual machines may execute each of a face detection microservice, an eye movement microservice, an eye tracking microservice, and an alert microservice based on the received camera data; and may transmit the result data of the eye tracking microservice to a second virtual machine corresponding to the second security level. Thus, data processing can be effectively performed based on the security level.

[0042] On the other hand, the second virtual machine may be controlled to execute an augmented reality microservice based on the result data of the eye tracking microservice, and display the result data of the augmented reality microservice on a display. Thus, data processing can be effectively performed based on the security level.

[0043] On the other hand, the second virtual machine may execute a face recognition microservice based on the received camera data, and execute an additional microservice based on the result data of the face recognition microservice. Thus, data processing can be effectively performed based on the security level.

[0044] On the other hand, the second virtual machine may execute each of an occupant seating microservice, an occupant movement microservice, an occupant detection microservice, and a graphics provision microservice based on the received sensor data or camera data, and may not transmit the service result data of the occupant detection microservice to the first virtual machine. Thus, data processing can be effectively performed based on the security level.

[0045] On the other hand, in the case where the service result data of the passenger detection microservice is not received from the second virtual machine, the first virtual machine can execute each of the passenger seating microservice, the passenger movement microservice, the passenger detection microservice, and the warning microservice based on the received sensor data or camera data. Thereby, data processing can be effectively executed based on safety and the like.

[0046] On the other hand, the first virtual machine can use the shared memory to transmit the result data of the first microservice to a second virtual machine corresponding to a second security level lower than or equal to the first security level. Thereby, data processing can be effectively executed based on the security level.

[0047] On the other hand, the first virtual machine can use the shared memory to transmit the result data of the first microservice to at least one virtual machine corresponding to a second security level lower than or equal to the first security level. Thereby, data processing can be effectively executed based on the security level.

[0048] On the other hand, a certain virtual machine among a plurality of virtual machines can execute a data path controller for transmitting the result data of the first microservice; the data path controller can transmit transmission available information to an agent of the first microservice based on the security level of the first microservice and the security level of the microservice or application program in the second virtual machine. Thereby, data processing can be effectively executed based on the security level.

[0049] A signal processing device according to another embodiment of the present invention and a vehicle display device having the signal processing device may include a processor that executes a management program; the processor can execute a first virtual machine corresponding to a first security level and a second virtual machine corresponding to a second security level lower than or equal to the first security level on the management program; the first virtual machine can execute a first application program and transmit the result data or intermediate result data of the first application program to the second virtual machine or a virtual machine corresponding to the second security level in the second signal processing device. Thereby, data processing can be effectively executed based on the security level. Further, data processing can be effectively executed using microservices.

[0050] On the other hand, the first virtual machine can execute a first application program including a plurality of microservices and transmit the result data of at least a part of the plurality of microservices to the second virtual machine or the second signal processing device. Thereby, data processing can be effectively executed based on the security level. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] Figure 1 is a diagram showing an example of the outside and inside of a vehicle.

[0052] Figures 2 to 2 c is a diagram showing various architectures of a vehicle communication gateway.

[0053] Figure 3a This is a diagram showing an example of the configuration of a vehicle display device for the interior of a vehicle.

[0054] Figure 3b This is a diagram showing another example of the configuration of a vehicle display device for the interior of a vehicle.

[0055] Figure 4 is Figure 3b an example of the internal block diagram of the vehicle display device.

[0056] Figures 5a to 5d This is a diagram showing various examples of the vehicle display device.

[0057] Figure 6 This is an example of the block diagram of the vehicle display device according to an embodiment of the present invention.

[0058] Figures 7a to 7b This is a diagram for explaining the signal processing device related to the present invention.

[0059] Figures 8a to 8e This is a diagram showing various examples of executing microservices according to an embodiment of the present invention.

[0060] Figure 9 This is an example of the internal block diagram of the signal processing device according to an embodiment of the present invention.

[0061] Figure 10 This is an example of the internal block diagram of the signal processing device according to another embodiment of the present invention.

[0062] Figure 11 This is a flowchart showing the operation method of the signal processing device according to an embodiment of the present invention.

[0063] Figures 12 to 16b is for explaining Figures 9 to 11 the operation of Detailed Description of the Invention

[0064] Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

[0065] In the following description, the suffixes "module" and "section" for components are given only for the convenience of writing the specification, and do not have any particularly important meaning or function in themselves. Therefore, "module" and "section" can be used interchangeably.

[0066] Figure 1 This is a diagram showing an example of the exterior and interior of a vehicle.

[0067] Referring to the accompanying drawings, a vehicle 200 operates via a plurality of wheels 103FR, 103FL, 103RL, and a steering wheel 150. The plurality of wheels 103FR, 103FL, 103RL are rotated by a power source, and the steering wheel 150 is used to adjust the traveling direction of the vehicle 200.

[0068] On the other hand, the vehicle 200 may also have a camera 195 or the like for acquiring an image in front of the vehicle.

[0069] On the other hand, a plurality of displays 180a, 180b for displaying images, information, etc. may be provided inside the vehicle 200.

[0070] In Figure 1 as an example of the plurality of displays 180a, 180b, an instrument cluster display 180a and an AVN (AudioVideo Navigation) display 180b are illustrated. In addition to this, it may also be a HUD (Head UpDisplay), etc.

[0071] On the other hand, the AVN (Audio Video Navigation) display 180b may also be named a central information display.

[0072] On the other hand, the vehicle 200 described in this specification may conceptually cover a vehicle having an engine as a power source, a hybrid vehicle having an engine and an electric motor as a power source, an electric vehicle having an electric motor as a power source, etc.

[0073] Figures 2 to 2 c is a diagram showing various architectures of a vehicle communication gateway.

[0074] First, Figure 2 is a diagram showing a first architecture of a vehicle communication gateway.

[0075] Referring to the accompanying drawings, the first architecture 300a may correspond to a zone-based architecture.

[0076] Therefore, sensor devices and processors inside the vehicle may be respectively arranged in a plurality of zones Z1 to Z4, and a signal processing device 170a including a vehicle communication gateway GWDa may be arranged in the central area of the plurality of zones Z1 to Z4.

[0077] On the other hand, in addition to the vehicle communication gateway GWDa, the signal processing device 170a may also include an autonomous driving control module ACC and a cockpit control module CPG, etc.

[0078] The vehicle communication gateway GWDa within this signal processing device 170a can be an HPC (High Performance Computing) gateway.

[0079] That is, Figure 2 the signal processing device 170a can exchange data with an integrated communication module (not shown) for HPC and external devices or processors (not shown) within a plurality of zones Z1 to Z4.

[0080] Figure 3a It is a diagram showing an example of the configuration of a vehicle display device inside a vehicle.

[0081] Referring to the drawings, inside the vehicle, an instrument cluster display 180a, an AVN (Audio Video Navigation) display 180b, rear seat entertainment (Rear Seat Entertainment) displays 180c, 180d, a rearview mirror display (not shown), etc. can be installed.

[0082] Figure 3b It is a diagram showing another example of the configuration of a vehicle display device inside a vehicle.

[0083] The vehicle display device 100 according to an embodiment of the present invention can have a plurality of displays 180a to 180b and a signal processing device 170. The signal processing device 170 performs signal processing for displaying images, information, etc. on the plurality of displays 180a to 180b and outputs an image signal to at least one of the displays 180a to 180b.

[0084] The first display 180a among the plurality of displays 180a to 180b can be an instrument cluster display 180a for displaying driving status, operation information, etc., and the second display 180b can be an AVN (Audio Video Navigation) display 180b for displaying vehicle driving information, navigation maps, various entertainment information, or images.

[0085] The signal processing device 170 can be internally provided with a processor 175 and can execute a first virtual machine to a third virtual machine (not shown) on a hypervisor (not shown) within the processor 175.

[0086] The second virtual machine (not shown) can operate for the first display 180a, and the third virtual machine (not shown) can operate for the second display 180b.

[0087] On the other hand, a first virtual machine (not shown) within the processor 175 can be controlled to set the shared memory 508 based on the hypervisor 505 to transfer the same data to a second virtual machine (not shown) and a third virtual machine (not shown). Thereby, the same information or the same image can be synchronously displayed on the first display 180a and the second display 180b within the vehicle.

[0088] On the other hand, for data sharing processing, at least a part of the data is shared by a first virtual machine (not shown) within the processor 175 with a second virtual machine (not shown) and a third virtual machine (not shown). Thereby, the data processing can be shared among a plurality of virtual machines for a plurality of displays within the vehicle.

[0089] On the other hand, a first virtual machine (not shown) within the processor 175 can receive and process the vehicle wheel speed sensor data and transfer the processed vehicle wheel speed sensor data to at least one of a second virtual machine (not shown) and a third virtual machine (not shown). Thereby, the vehicle wheel speed sensor data can be shared with at least one virtual machine or the like.

[0090] On the other hand, the vehicle display device 100 according to an embodiment of the present invention may further include a Rear Seat Entertainment (RSE) display 180c for displaying driving state information, abbreviated navigation information, various entertainment information, or images.

[0091] In addition to the first virtual machine to the third virtual machine (not shown), the signal processing device 170 can also control the RSE display 180c by additionally executing a fourth virtual machine (not shown) on a hypervisor (not shown) within the processor 175.

[0092] Thereby, various displays 180a to 180c can be controlled by using one signal processing device 170.

[0093] On the other hand, a part of the plurality of displays 180a to 180c may operate based on the Linux operating system (OS), while another part may operate based on the Internet operating system (Web OS).

[0094] The signal processing device 170 according to an embodiment of the present invention can be controlled such that the displays 180a to 180c operating under various operating systems (OS) can also synchronously display the same information or the same image.

[0095] On the other hand, Figure 3bAn example is shown where a vehicle speed indicator 212a and a vehicle interior temperature indicator 213a are displayed on a first display 180a, a main screen 222 including a plurality of applications, a vehicle speed indicator 212b, and a vehicle interior temperature indicator 213b is displayed on a second display 180b, and a second main screen 222b including a plurality of applications and a vehicle interior temperature indicator 213c is displayed on a third display 180c.

[0096] Figure 4 is Figure 3b an example of an internal block diagram of a vehicle display device.

[0097] Referring to the accompanying drawings, a vehicle display device 100 according to an embodiment of the present invention may include an input unit 110, a communication unit 120 for communicating with an external device, a plurality of communication modules EMa to EMd for internal communication, a memory 140, a signal processing device 170, a plurality of displays 180a to 180c, an audio output unit 185, and a power supply unit 190.

[0098] The plurality of communication modules EMa to EMd may be respectively arranged in Figure 2 a plurality of regions Z1 to Z4.

[0099] On the other hand, a communication switch 736b for data communication with each of the communication modules EM1 to EM4 may be provided inside the signal processing device 170.

[0100] Each of the communication modules EM1 to EM4 may perform data communication with a plurality of sensor devices SN, an ECU (Electronic Control Unit), or a regional signal processing device 170Z.

[0101] On the other hand, the plurality of sensor devices SN may include a camera 195, a lidar 196, a radar 197, or a position sensor 198.

[0102] The input unit 110 may be provided with physical buttons, a tablet, etc. for button input, touch input, etc.

[0103] On the other hand, the input unit 110 may be provided with a microphone (not shown) for user voice input.

[0104] The communication unit 120 may exchange data with a mobile terminal 800 or a server 900 in a wireless manner.

[0105] In particular, the communication unit 120 can exchange data with the mobile terminal of the vehicle driver in a wireless manner. As the wireless data communication method, various data communication methods such as Bluetooth, WiFi (Wireless Fidelity), WiFi Direct, and APiX can be adopted.

[0106] The communication unit 120 can receive weather information and road traffic condition information, such as TPEG (Transport Protocol Expert Group) information, from the mobile terminal 800 or the server 900. To this end, the communication unit 120 can include a mobile communication module (not shown).

[0107] A plurality of communication modules EM1 to EM4 can receive sensor data, etc. from the ECU 770, the sensor device SN, or the area signal processing device 170Z, and transmit the received sensor data to the signal processing device 170.

[0108] Here, the sensor data can include at least one of vehicle direction data, vehicle position data (GPS data), vehicle angle data, vehicle speed data, vehicle acceleration data, vehicle tilt data, vehicle forward / backward data, battery data, fuel data, tire data, headlight data, vehicle interior temperature data, and vehicle interior humidity data.

[0109] Such sensor data can be obtained from a heading sensor, a yaw sensor, a gyro sensor, a position module, a vehicle forward / backward sensor, a wheel sensor, a vehicle speed sensor, a vehicle body tilt sensing sensor, a battery sensor, a fuel sensor, a tire sensor, a steering sensor based on the rotation of the steering wheel, a vehicle interior temperature sensor, and a vehicle interior humidity sensor, etc.

[0110] On the other hand, the positioning module can include a GPS module for receiving GPS (Global Positioning System) information or a position sensor 198.

[0111] On the other hand, at least one of the plurality of communication modules EM1 to EM4 can transmit the position information data detected by the GPS module or the position sensor 198 to the signal processing device 170.

[0112] On the other hand, at least one of the plurality of communication modules EM1 to EM4 can receive vehicle front image data, vehicle side image data, vehicle rear image data, vehicle surrounding obstacle distance information, etc. from the camera 195, lidar 196, radar 197, etc., and transmit the received information to the signal processing device 170.

[0113] The memory 140 can store programs for the processing or control of the signal processing device 170, various data for the overall operation of the vehicle display device 100.

[0114] For example, the memory 140 can store data on management programs, the first virtual machine to the third virtual machine to be executed within the processor 175.

[0115] The audio output unit 185 converts the electrical signal from the signal processing device 170 into an audio signal and outputs it. For this purpose, a speaker or the like can be provided.

[0116] The power supply unit 190 can supply the power required for the operation of each component according to the control of the signal processing device 170. In particular, the power supply unit 190 can receive power from a battery or the like inside the vehicle.

[0117] The signal processing device 170 controls the overall operation of each unit within the vehicle display device 100.

[0118] For example, the signal processing device 170 can include a processor 175 that performs signal processing for the vehicle displays 180a, 180b.

[0119] The processor 175 can execute the first virtual machine to the third virtual machine (not shown) on a management program (not shown) within the processor 175.

[0120] The first virtual machine (not shown) among the first virtual machine to the third virtual machine (not shown) can be named the Server Virtual Machine, and the second virtual machine to the third virtual machine (not shown) can be named the Guest Virtual Machine.

[0121] For example, the first virtual machine (not shown) within the processor 175 can receive sensor data from a plurality of sensor devices, such as vehicle sensor data, position information data, camera image data, audio data, or touch input data, and output it after processing or processing.

[0122] As described above, by performing most of the data processing in the first virtual machine (not shown), 1:N data sharing can be achieved.

[0123] As another example, a first virtual machine (not shown) can directly receive and process CAN (Controller Area Network) data, Ethernet data, audio data, radio data, USB data, and wireless communication data for second to third virtual machines (not shown).

[0124] In addition, the first virtual machine (not shown) can transmit the processed data to the second to third virtual machines (not shown).

[0125] Thus, only the first virtual machine (not shown) among the first to third virtual machines (not shown) can receive sensor data, communication data, or external input data from a plurality of sensor devices and perform signal processing, which can reduce the signal processing burden on other virtual machines and enable 1:N data communication, thereby enabling synchronization during data sharing.

[0126] On the other hand, the first virtual machine (not shown) can be controlled to store data in the shared memory 508 and share the same data with the second virtual machine (not shown) and the third virtual machine (not shown).

[0127] For example, the first virtual machine (not shown) can be controlled to record vehicle sensor data, the position information data, the camera image data, or the touch input data in the shared memory 508 and share the same data with the second virtual machine (not shown) and the third virtual machine (not shown). Thus, 1:N data sharing can be achieved.

[0128] Finally, by performing most of the data processing in the first virtual machine (not shown), 1:N data sharing can be achieved.

[0129] On the other hand, the first virtual machine (not shown) within the processor 175 can be controlled to set the shared memory 508 based on the hypervisor 505 to transmit the same data to the second virtual machine (not shown) and the third virtual machine (not shown).

[0130] On the other hand, the signal processing device 170 can process various signals such as audio signals, image signals, and data signals. For this purpose, the signal processing device 170 can be implemented in the form of a system on chip (SOC).

[0131] On the other hand, Figure 4 the signal processing device 170 within the display device 100 of Figure 5a is the same as the signal processing devices 170, 170a1, and 170a2 of the vehicle display device in and subsequent figures.

[0132] Figures 5a to 5d This is a diagram showing various examples of a vehicle display device.

[0133] Figure 5a This is an example of a vehicle display device according to an embodiment of the present invention.

[0134] Referring to the accompanying drawings, a vehicle display device 800a according to an embodiment of the present invention includes signal processing devices 170a1, 170a2, and a plurality of area signal processing devices 170Z1 to 170Z4.

[0135] On the other hand, in the drawings, two signal processing devices 170a1 and 170a2 are illustrated, but this is for backup or the like, and there may be one signal processing device.

[0136] On the other hand, the signal processing devices 170a1 and 170a2 may be named HPC (High Performance Computing) signal processing devices.

[0137] The plurality of area signal processing devices 170Z1 to 170Z4 may be arranged in respective areas Z1 to Z4 and transmit sensor data to the signal processing devices 170a1 and 170a2.

[0138] The signal processing devices 170a1 and 170a2 receive data from the plurality of area signal processing devices 170Z1 to 170Z4 or the communication device 120 in a wired manner.

[0139] Although in the drawings it is illustrated that data is exchanged between the signal processing devices 170a1 and 170a2 and the plurality of area signal processing devices 170Z1 to 170Z4 based on wired communication, and data is exchanged between the signal processing devices 170a1 and 170a2 and the server 400 based on wireless communication, data may be exchanged between the communication device 120 and the server 400 based on wireless communication, while data is exchanged between the signal processing devices 170a1 and 170a2 and the communication device 120 based on wired communication.

[0140] On the other hand, the data received by the signal processing devices 170a1 and 170a2 may include camera data or sensor data.

[0141] For example, the sensor data inside the vehicle may include at least one of wheel speed data, vehicle direction data, vehicle position data (GPS data), vehicle angle data, vehicle speed data, vehicle acceleration data, vehicle inclination data, vehicle forward / backward data, battery data, fuel data, tire data, headlight data, vehicle interior temperature data, vehicle interior humidity data, vehicle external radar data, and vehicle external lidar data.

[0142] On the other hand, the camera data may include vehicle external camera data and vehicle internal camera data.

[0143] On the other hand, the signal processing devices 170a1 and 170a2 may execute a plurality of virtual machines 820, 830, and 840 according to the safety level.

[0144] In the drawings, an example is shown in which the processor 175 in the signal processing device 170a executes the hypervisor 505, and on the hypervisor 505, the first to third virtual machines 820 to 840 are executed according to the Automotive Safety Integrity Level (Automotive SIL; ASIL).

[0145] The first virtual machine 820 may be a virtual machine corresponding to QM (Quality Management), which is the lowest safety level in the Automotive Safety Integrity Level (ASIL) and has no mandatory level.

[0146] The first virtual machine 820 may execute the operating system 822, the container runtime 824 on the operating system 822, and the containers 827 and 829 on the container runtime 824.

[0147] The second virtual machine 820 may be a virtual machine corresponding to ASIL A or ASIL B, where the sum of the severity, exposure, and controllability in the Automotive Safety Integrity Level (ASIL) is 7 or 8.

[0148] The second virtual machine 820 may execute the operating system 832, the container runtime 834 on the operating system 832, and the containers 837 and 839 on the container runtime 834.

[0149] The third virtual machine 840 may be a virtual machine corresponding to ASIL C or ASIL D, where the sum of the severity, exposure, and controllability in the Automotive Safety Integrity Level (ASIL) is 9 or 10.

[0150] On the other hand, ASIL D may correspond to the level that requires the highest safety level.

[0151] The third virtual machine 840 may execute the secure operating system 842 and the application 845 on the operating system 842.

[0152] On the other hand, the third virtual machine 840 can also execute the secure operating system 842, the container runtime 844 on the secure operating system 842, and the containers 847 on the container runtime 844.

[0153] On the other hand, differently from the drawings, the third virtual machine 840 can also be executed by an additional core instead of the processor 175. This will be described later with reference to Figure 5b for explanation.

[0154] Figure 5b Another example of the vehicle display device according to an embodiment of the present invention is shown.

[0155] Referring to the drawings, the vehicle display device 800b according to an embodiment of the present invention includes signal processing devices 170a1, 170a2, and a plurality of regional signal processing devices 170Z1 to 170Z4.

[0156] Although Figure 5b the vehicle display device 800b is similar to Figure 5a the vehicle display device 800a, there are some differences between the signal processing device 170a1 and Figure 5a the signal processing device 170a1.

[0157] Centering on this difference for explanation, the signal processing device 170a1 may include a processor 175 and a second processor 177.

[0158] The processor 175 in the signal processing device 170a1 executes the hypervisor 505 and executes the first virtual machine to the second virtual machines 820 to 830 according to the Automotive Safety Integrity Level (Automotive SIL; ASIL) on the hypervisor 505.

[0159] The first virtual machine 820 can execute the operating system 822, the container runtime 824 on the operating system 822, and the containers 827, 829 on the container runtime 824.

[0160] The second virtual machine 820 can execute the operating system 832, the container runtime 834 on the operating system 832, and the containers 837, 839 on the container runtime 834.

[0161] On the other hand, the second processor 177 in the signal processing device 170a1 can execute the third virtual machine 840.

[0162] The third virtual machine 840 can execute a secure operating system 842, AUTOSAR (Automotive Open System Architecture) 845 on the operating system 842, and an application 845 on AUTOSAR 845. That is, different from Figure 5a it can also execute AUTOSAR 846 on the operating system 842.

[0163] On the other hand, the third virtual machine 840 can also execute, similar to Figure 5a the secure operating system 842, a container runtime 844 on the secure operating system 842, and a container 847 on the container runtime 844.

[0164] On the other hand, preferably, different from the first to second virtual machines 820-830, the third virtual machine 840 with a high security level is executed on another core or a second processor 177 as another processor.

[0165] On the other hand, in Figure 5a and Figure 5b among the signal processing devices 170a1, 170a2, when the first signal processing device 170a is abnormal, the second signal processing device 170a2 for backup can operate.

[0166] Differently, it can also be that the signal processing devices 170a1, 170a2 operate simultaneously, and the first signal processing device 170a among them operates mainly, while the second signal processing device 170a2 operates as an auxiliary. For this, refer to Figure 5c and Figure 5d for description.

[0167] Figure 5c Another example of the vehicle display device according to the embodiment of the present invention is shown.

[0168] Referring to the drawings, the vehicle display device 800c according to the embodiment of the present invention includes signal processing devices 170a1, 170a2 and a plurality of regional signal processing devices 170Z1-170Z4.

[0169] On the other hand, two signal processing devices 170a1, 170a2 are exemplified in the drawings, but this is for backup and the like, and it can also be one signal processing device.

[0170] On the other hand, the signal processing devices 170a1, 170a2 can also be named HPC (High Performance Computing) signal processing devices.

[0171] A plurality of area signal processing devices 170Z1 to 170Z4 can be arranged in each area Z1 to Z4 and transmit sensor data to signal processing devices 170a1 and 170a2.

[0172] The signal processing devices 170a1 and 170a2 receive data from a plurality of area signal processing devices 170Z1 to 170Z4 or the communication device 120 in a wired manner.

[0173] Although it is illustrated in the drawings that data is exchanged between the signal processing devices 170a1 and 170a2 and a plurality of area signal processing devices 170Z1 to 170Z4 based on wired communication, and data is exchanged between the signal processing devices 170a1 and 170a2 and the server 400 based on wireless communication, data can be exchanged between the communication device 120 and the server 400 based on wireless communication, while data is exchanged between the signal processing devices 170a1 and 170a2 and the communication device 120 based on wired communication.

[0174] On the other hand, the data received by the signal processing devices 170a1 and 170a2 may include camera data or sensor data.

[0175] On the other hand, a processor 175 in the first signal processing device 170a1 among the signal processing devices 170a1 and 170a2 may execute a management program 505, and a safety virtual machine 860 and a non-safety virtual machine 870 may be respectively executed on the management program 505.

[0176] On the other hand, a processor 175b in the second signal processing device 170a2 among the signal processing devices 170a1 and 170a2 may execute a management program 505b, and only a safety virtual machine 880 may be executed on the management program 505.

[0177] According to this method, the processing for safety is divided between the first signal processing device 170a1 and the second signal processing device 170a2, so the stability and processing speed can be improved.

[0178] On the other hand, high-speed network communication can be performed between the first signal processing device 170a1 and the second signal processing device 170a2.

[0179] Figure 5d Another example of a vehicle display device according to an embodiment of the present invention is shown.

[0180] Referring to the drawings, a vehicle display device 800d according to an embodiment of the present invention includes signal processing devices 170a1 and 170a2 and a plurality of area signal processing devices 170Z1 to 170Z4.

[0181] Figure 5d The vehicle display device 800d and Figure 5c the vehicle display device 800c are similar, but the second signal processing device 170a2 and Figure 5c the second signal processing device 170a2 have some differences.

[0182] Figure 5d In the second signal processing device 170a2, the processor 175b can execute the management program 505b, and respectively execute the safety virtual machine 880 and the non-safety virtual machine 890 on the management program 505.

[0183] That is, the difference is that, different from Figure 5c the second signal processing device 170a2, the processor 175b in the second signal processing device 170a2 also executes the non-safety virtual machine 890.

[0184] According to this method, the safety and non-safety processing are respectively processed by the first signal processing device 170a1 and the second signal processing device 170a2, so the stability and processing speed can be improved.

[0185] Figure 6 is an example of the block diagram of the vehicle display device according to an embodiment of the present invention.

[0186] Referring to the accompanying drawings, the vehicle display device 900 according to an embodiment of the present invention includes a signal processing device 170 and at least one display.

[0187] In the drawings, as at least one display, an instrument cluster display 180a and an AVN display 180b are exemplified.

[0188] On the other hand, the vehicle display device 900 may also be provided with a plurality of area signal processing devices 170Z1 to 170Z4.

[0189] At this time, the signal processing device 170 can be used as a high-performance central centralized signal processing and control device having a plurality of CPUs 175, GPUs 178, NPUs 179, etc., and is named as an HPC (High Performance Computing) signal processing device or a central signal processing device.

[0190] The plurality of area signal processing devices 170Z1 to 170Z4 and the signal processing device 170 are connected by wired cables CB1 to CB4.

[0191] On the other hand, the plurality of regional signal processing devices 170Z1 to 170Z4 can be connected to each other using wired cables CBa to CBd, respectively.

[0192] The wired cables CBa to CBd at this time can include CAN communication cables, Ethernet communication cables, or PCI Express (Peripheral Component Interconnect Express) cables.

[0193] On the other hand, the signal processing device 170 according to an embodiment of the present invention can be provided with at least one processor 175, 178, 177 and a large-capacity storage device 925.

[0194] For example, the signal processing device 170 according to an embodiment of the present invention can include a central processor 175, 177, a graphics processor 178, and a neural processor 179.

[0195] On the other hand, sensor data can be transmitted from at least one of the plurality of regional signal processing devices 170Z1 to 170Z4 to the signal processing device 170. In particular, the sensor data can be stored in the storage device 925 within the signal processing device 170.

[0196] The sensor data at this time can include at least one type of data among camera data, lidar data, radar data, vehicle direction data, vehicle position data (GPS data), vehicle angle data, vehicle speed data, vehicle acceleration data, vehicle tilt data, vehicle forward / backward data, battery data, fuel data, tire data, headlight data, vehicle interior temperature data, and vehicle interior humidity data.

[0197] In the drawings, an example is shown in which camera data from the camera 195a and lidar data from the lidar sensor 196 are input to the first regional signal processing device 170Z1, and the camera data and lidar data are transmitted to the signal processing device 170 via the second regional signal processing device 170Z2 and the third regional signal processing device 170Z3, etc.

[0198] On the other hand, since the read / write data speed of the storage device 925 is faster than the network speed when transmitting sensor data from at least one of the plurality of regional signal processing devices 170Z1 to 170Z4 to the signal processing device 170, it is preferable to perform multi-path routing to prevent a network bottleneck phenomenon.

[0199] For this reason, the signal processing device 170 according to an embodiment of the present invention may perform multi-path routing based on Software Defined Network (SDN). Thereby, a stable network environment during data read / write of the storage device 925 can be ensured. Further, since multiple paths can be used to transfer data to the storage device 925, data can be transferred by dynamically changing the network configuration.

[0200] For high-frequency band and low-latency communication, data communication between the plurality of regional signal processing devices 170Z1 to 170Z4 and the signal processing device 170 in the vehicle display device 900 according to an embodiment of the present invention is preferably Peripheral Component Interconnect Express communication.

[0201] Figure 7a and Figure 7b is a diagram for explaining a signal processing device related to the present invention.

[0202] Figure 7a An example in which an application based on camera data or the like is executed in the signal processing device is shown.

[0203] Referring to the drawings, the signal processing device 170x related to the present invention can be controlled to execute a Driver Monitoring Systems (DMS) application 785 based on camera data from the in-vehicle camera 195i, sensor data from the pressure sensor SNp, and sensor data from the gas sensor SNc, and output a warning sound to the audio output unit 185 based on the result data.

[0204] Figure 7b is for explaining Figure 7a the operation of

[0205] Referring to the drawings, the signal processing device 170x related to the present invention may include a processor 175x, and the processor 175x may execute a hypervisor 505.

[0206] On the other hand, the processor 175x related to the present invention executes a plurality of virtual machines 520x, 530x, 540x on the hypervisor 505. Among the plurality of virtual machines 520x, 530x, 540x, the second virtual machine 530x can execute the driver monitoring system DMS application 785 based on the camera data from the in-vehicle camera 195i, the sensor data from the pressure sensor SNp, and the sensor data from the gas sensor SNc, and execute the Lane Keep Assist System (LKAS) application 787 based on the external vehicle camera data.

[0207] On the other hand, among the plurality of virtual machines 520x, 530x, 540x, the third virtual machine 540x can execute the Forward Collision Warning (FCW) application 789 based on the external vehicle camera data.

[0208] On the other hand, as Figure 7a and Figure 7b shown, when the driver monitoring system DMS application 785 and the lane keeping assist system 787 are executed within the second virtual machine 530x, there is a problem that the workload of the second virtual machine 530x is quite large.

[0209] In particular, in order to execute the driver monitoring system DMS application 785, it is necessary to receive and process the camera data from the in-vehicle camera 195i, the sensor data from the pressure sensor SNp, and the sensor data from the gas sensor SNc. Therefore, there is a problem that the workload of the second virtual machine 530x is quite large.

[0210] On the other hand, when executing the forward collision warning FCW application 789, the third virtual machine 540x is executed in a virtual machine separate from the lane keeping assist system 787 that commonly uses the external vehicle camera data. Therefore, there is a problem that the workload is executed inefficiently.

[0211] Therefore, in the present invention, a solution is proposed to share the intermediate result data of the application program when executing similar application programs.

[0212] To this end, the signal processing device 170 of the embodiment of the present invention separates the application program into a plurality of microservices, and executes other microservices based on the results of the microservices, thereby effectively sharing the workload.

[0213] For example, the signal processing device 170 according to an embodiment of the present invention can be controlled such that a first microservice among a plurality of microservices is executed in a first virtual machine, and a second microservice is executed in a second virtual machine, and the result of the first microservice is shared using a shared memory 508 or the like, so that the second microservice is executed based on the result data of the first virtual machine. Thereby, data processing can be effectively executed.

[0214] On the other hand, the signal processing device 170 according to an embodiment of the present invention can execute a plurality of virtual machines by distinguishing each security level.

[0215] On the other hand, the signal processing device 170 according to an embodiment of the present invention can execute an application program or a microservice by distinguishing each security level.

[0216] Thereby, related to vehicle driving assistance (ADAS) or autonomous driving, etc., data processing can be stably executed according to the Automotive Safety Integrity Level (Automotive SIL; ASIL).

[0217] Figures 8a to 8e It is a diagram showing various examples of executing microservices according to an embodiment of the present invention.

[0218] Figure 8a An example is shown in which a plurality of microservices corresponding to ASIL B are executed based on camera data from an internal camera 195i.

[0219] Referring to the drawings, the signal processing device 170 according to an embodiment of the present invention can execute a driver monitoring system DMS application program 905 corresponding to ASIL B.

[0220] For example, the signal processing device 170 according to an embodiment of the present invention can separate the driver monitoring system DMS application program 905 into a plurality of microservices and execute them.

[0221] In the drawings, as a plurality of microservices for the driver monitoring system DMS application program 905, a face detection microservice 910b, an eye movement microservice 915b, an eye tracking microservice 920b, and an alert microservice 930b are illustrated.

[0222] That is, for the driver monitoring system DMS application program 905 corresponding to ASIL B, the signal processing device 170 according to an embodiment of the present invention can execute each of the face detection microservice 910b, the eye movement microservice 915b, the eye tracking microservice 920b, and the alert microservice 930b as a plurality of microservices.

[0223] On the other hand, the face detection microservice 910b is executed based on the camera data from the internal camera 195i, and the result data of the face detection microservice 910b is transmitted to the eye movement microservice 915b.

[0224] On the other hand, the eye movement microservice 915b is executed based on the result data of the face detection microservice 910b, and the result data of the eye movement microservice 915b is transmitted to the gaze tracking microservice 920b.

[0225] On the other hand, the gaze tracking microservice 920b is executed based on the result data of the eye movement microservice 915b, and the result data of the gaze tracking microservice 920b is transmitted to the warning microservice 930b.

[0226] On the other hand, the warning microservice 930b can be executed based on the result data of the gaze tracking microservice 920b, and the result data can be input to the audio output unit 185 so that a warning sound can be output from the audio output unit 185.

[0227] On the other hand, for the driver monitoring system DMS application 905 corresponding to ASIL B, the signal processing device 170 of the embodiment of the present invention can further execute each of the second face detection microservice 910c and the head movement microservice 915c.

[0228] The second face detection microservice 910c is executed based on the camera data from the internal camera 195i, and the result data of the second face detection microservice 910c is transmitted to the head movement microservice 915c.

[0229] On the other hand, the head movement microservice 915c is executed based on the result data of the second face detection microservice 910c, and the result data of the head movement microservice 915c is transmitted to the gaze tracking microservice 920b.

[0230] On the other hand, the gaze tracking microservice 920b can be executed based on the result data of the head movement microservice 915c and the result data of the eye movement microservice 915b, and the result data of the gaze tracking microservice 920b is transmitted to the warning microservice 930b.

[0231] On the other hand, the signal processing device 170 of the embodiment of the present invention can further execute a plurality of microservices that are not related to ASIL B, for example, corresponding to QM (Quality Management).

[0232] In the drawings, as a plurality of microservices not related to ASIL B, each of the third face detection microservice 910a, the face recognition microservice 915a, and the personal use microservice 920a can be executed.

[0233] Figure 8bAn example of executing a plurality of microservices corresponding to ASIL B and a microservice corresponding to QM based on camera data from the in-vehicle camera 195i is illustrated.

[0234] Referring to the accompanying drawings, Figure 8a Similarly, the signal processing device 170 according to an embodiment of the present invention may execute a driver monitoring system DMS application 905 corresponding to ASIL B.

[0235] For example, for the driver monitoring system DMS application 905 corresponding to ASIL B, the signal processing device 170 according to an embodiment of the present invention may execute each of a face detection microservice 910b, an eye movement microservice 915b, a gaze tracking microservice 920b, and a warning microservice 930b as a plurality of microservices.

[0236] On the other hand, for the driver monitoring system DMS application 905 corresponding to ASIL B, the signal processing device 170 according to an embodiment of the present invention may further execute each of a second face detection microservice 910c and a head movement microservice 915c.

[0237] On the other hand, as a plurality of microservices independent of ASIL B, the signal processing device 170 according to an embodiment of the present invention may execute each of a third face detection microservice 910a, a face recognition microservice 915a, and a personal use microservice 920a.

[0238] On the other hand, as a microservice corresponding to QM, the signal processing device 170 according to an embodiment of the present invention may execute an augmented reality microservice 930c as an example of a graphics providing microservice.

[0239] At this time, the signal processing device 170 according to an embodiment of the present invention may transmit result data of the gaze tracking microservice 920b among the microservices in the application 905 corresponding to ASIL B to the augmented reality microservice 930c corresponding to QM with a lower safety level.

[0240] Thereby, the augmented reality microservice 930c corresponding to QM may be executed based on the result data of the gaze tracking microservice 920b, and the result data of the augmented reality microservice 930c may be transmitted to and displayed on the display 180.

[0241] Figure 8c An example of executing a plurality of microservices corresponding to QM is illustrated.

[0242] Referring to the accompanying drawings, the signal processing device 170 according to an embodiment of the present invention may execute a passenger monitoring application 940 corresponding to QM.

[0243] For example, the signal processing device 170 according to an embodiment of the present invention may separate the occupant monitoring application 940 into a plurality of microservices and execute them.

[0244] In the drawings, as a plurality of microservices for the occupant monitoring application 940, the occupant seating (press detection) microservice 950b, the occupant movement microservice 955b, the occupant detection microservice 960b, and the graphic providing microservice 965b are illustrated.

[0245] That is, for the occupant monitoring application 940 corresponding to QM, the signal processing device 170 according to an embodiment of the present invention may execute each of the occupant seating microservice 950b, the occupant movement microservice 955b, the occupant detection microservice 960b, and the graphic providing microservice 965b as a plurality of microservices.

[0246] On the other hand, the occupant seating microservice 950b is executed based on the sensor data from the pressure sensor SNp, and the result data of the occupant seating microservice 950b is transmitted to the occupant movement microservice 955b.

[0247] On the other hand, the occupant movement microservice 955b is executed based on the result data of the occupant seating microservice 950b, and the result data of the occupant movement microservice 955b is transmitted to the occupant detection microservice 960b.

[0248] On the other hand, the occupant detection microservice 960b is executed based on the result data of the occupant movement microservice 955b, and the result data of the occupant detection microservice 960b is transmitted to the graphic providing microservice 965b.

[0249] On the other hand, the graphic providing microservice 965b may be executed based on the result data of the occupant detection microservice 960b, and the result data of the graphic providing microservice 965b is transmitted to the display 180 and displayed.

[0250] On the other hand, for the occupant monitoring application 940 corresponding to QM, the signal processing device 170 according to an embodiment of the present invention may further execute a gas detection (CO2 detection) microservice 950c.

[0251] The gas detection (CO2 detection) microservice 950c is executed based on the sensor data from the gas sensor SNc, and the result data of the gas detection (CO2 detection) microservice 950c is transmitted to the occupant movement microservice 955b.

[0252] On the other hand, the occupant movement microservice 955b is executed based on the result data of the gas detection (co2 detection) microservice 950c, and the result data of the occupant movement microservice 955b is transmitted to the occupant detection microservice 960b.

[0253] On the other hand, the signal processing device 170 according to an embodiment of the present invention may further execute a plurality of microservices independent of the occupant monitoring application 940.

[0254] Illustrated in the drawings as a plurality of microservices independent of the occupant monitoring application 940, the signal processing device 170 executes each of the face detection microservice 910a, the face recognition microservice 915a, and the personal microservice 920a based on camera data from the in-vehicle camera 195i.

[0255] Figure 8d Illustrated are a plurality of microservices corresponding to ASIL B and a microservice corresponding to QM.

[0256] Referring to the drawings, Figure 8c Similarly, the signal processing device 170 according to an embodiment of the present invention may execute the occupant monitoring application 940 corresponding to QM.

[0257] For example, for the occupant monitoring application 940 corresponding to QM, the signal processing device 170 according to an embodiment of the present invention may execute each of the occupant seating microservice 950b, the occupant movement microservice 955b, the occupant detection microservice 960b, and the graphics providing microservice 965b as a plurality of microservices.

[0258] On the other hand, for the occupant monitoring application 940 corresponding to QM, the signal processing device 170 according to an embodiment of the present invention may further execute the gas detection (co2 detection) microservice 950c.

[0259] On the other hand, as a plurality of microservices independent of the occupant monitoring application 940, the signal processing device 170 according to an embodiment of the present invention may execute each of the face detection microservice 910a, the face recognition microservice 915a, and the personal microservice 920a.

[0260] On the other hand, the signal processing device 170 according to an embodiment of the present invention may further execute the occupant monitoring application 945 corresponding to ASIL B.

[0261] Illustrated in the drawings as a plurality of microservices for the occupant monitoring application 945 corresponding to ASIL B are the occupant seating microservice 950d, the occupant movement microservice 955d, the occupant detection microservice 960d, and the warning microservice 965d.

[0262] On the other hand, the occupant seating microservice 950d is executed based on the sensor data from the pressure sensor SNp, and the result data of the occupant seating microservice 950d is transmitted to the occupant movement microservice 955d.

[0263] On the other hand, the occupant movement microservice 955d is executed based on the result data from the occupant seating microservice 950d, and the result data of the occupant movement microservice 955d is transmitted to the occupant detection microservice 960d.

[0264] On the other hand, the occupant detection microservice 960d is executed based on the result data of the occupant movement microservice 955d, and the result data of the occupant detection microservice 960d is transmitted to the warning microservice 965d.

[0265] On the other hand, the warning microservice 965d can be executed based on the result data of the occupant detection microservice 960d, and the result data of the warning microservice 965d can be transmitted to and output by the audio output unit 185.

[0266] On the other hand, for the occupant monitoring application 945 corresponding to ASIL B, the signal processing device 170 according to an embodiment of the present invention can further execute a gas detection (co2 detection) microservice 950e.

[0267] On the other hand, the gas detection (co2 detection) microservice 950e can be executed based on the sensor data from the gas sensor SNc, and the result data of the gas detection (co2 detection) microservice 950e can be transmitted to the occupant movement microservice 955d.

[0268] On the other hand, the signal processing device 170 according to an embodiment of the present invention may not transmit the result data of the occupant detection microservice 960b in the microservices within the occupant monitoring application 940 corresponding to QM to the warning microservice 965d within the occupant monitoring application 945 corresponding to ASIL B.

[0269] That is, since the safety level of the occupant detection microservice 960b within the occupant monitoring application 940 corresponding to QM is lower than the safety level of the warning microservice 965d within the occupant monitoring application 945 corresponding to ASIL B, the signal processing device 170 according to an embodiment of the present invention cannot transmit the result data of the occupant detection microservice 960b to the warning microservice 965d within the occupant monitoring application 945 corresponding to ASIL B. Thus, the respective safety levels can be maintained.

[0270] Figure 8eIllustrates another example of executing a plurality of microservices corresponding to ASIL B and a microservice corresponding to QM based on camera data from the internal camera 195i.

[0271] Referring to the accompanying drawings, Figure 8b Similarly, the signal processing apparatus 170 according to an embodiment of the present invention may execute a driver monitoring system DMS application 985 corresponding to ASIL B.

[0272] The driver monitoring system DMS application 985 Figure 8b is similar to the driver monitoring system DMS application 905 of , but there is a difference that the second face detection microservice 910c is not executed.

[0273] For example, for the driver monitoring system DMS application 985 corresponding to ASIL B, the signal processing apparatus 170 according to an embodiment of the present invention may execute each of a face detection microservice 910b, an eye movement microservice 915b, a head movement microservice 915c, a gaze tracking microservice 920b, and a warning microservice 930b as a plurality of microservices.

[0274] On the other hand, the head movement microservice 915c is executed based on the result data of the face detection microservice 910b, and the result data of the head movement microservice 915c is transmitted to the gaze tracking microservice 920b.

[0275] On the other hand, as a plurality of microservices independent of ASIL B, the signal processing apparatus 170 according to an embodiment of the present invention may execute each of a third face detection microservice 910a, a face recognition microservice 915a, and a personal use microservice 920a.

[0276] On the other hand, as a microservice corresponding to QM, the signal processing apparatus 170 according to an embodiment of the present invention may execute an augmented reality microservice 930c.

[0277] At this time, the signal processing apparatus 170 according to an embodiment of the present invention may transmit the result data of the gaze tracking microservice 920b among the microservices in the application 985 corresponding to ASIL B to the augmented reality microservice 930c corresponding to QM with a lower safety level.

[0278] Thereby, the augmented reality microservice 930c corresponding to QM can be executed based on the result data of the gaze tracking microservice 920b, and the result data of the augmented reality microservice 930c can be transmitted to the display 180 and displayed.

[0279] Figure 9 is an example of an internal block diagram of the signal processing apparatus according to an embodiment of the present invention.

[0280] Referring to the accompanying drawings, the signal processing device 170 within the system 1000 according to an embodiment of the present invention includes a processor 175 that executes a hypervisor 505.

[0281] On the other hand, the processor 175 may correspond to Figure 6 a central processing unit CPU.

[0282] On the other hand, the processor 175 may have a plurality of processor cores.

[0283] In the accompanying drawings, a plurality of processor cores are illustrated as operating based on a safety level of ASIL B, but various changes may be made differently.

[0284] For example, a part of the plurality of processor cores may operate based on a safety level of ASIL B, and another part may operate based on a safety level of QM.

[0285] On the other hand, in order to execute an application program or the like of ASIL D, which is the highest safety level, the signal processing device 170 according to an embodiment of the present invention may further include a second processor 177 having M cores or an MCU.

[0286] On the other hand, the processor 175 executes a plurality of virtual machines 810 to 830 on the hypervisor 505.

[0287] On the other hand, the first virtual machine 830 among the plurality of virtual machines 810 to 830 executes a plurality of microservices 910b, 915b, 920b, 930b corresponding to a first safety level such as ASIL B.

[0288] On the other hand, the first virtual machine 830 among the plurality of virtual machines 810 to 830 transmits the result data of the first microservice 920b among the plurality of microservices to the second virtual machine 820 corresponding to a second safety level below the first safety level or a virtual machine within the second signal processing device 170Z. Thereby, data processing can be effectively executed based on the safety level. Further, data processing can be effectively executed using microservices.

[0289] On the other hand, in order to execute a first application program corresponding to the first safety level, the first virtual machine 830 may execute the plurality of microservices separately.

[0290] That is, in order to execute the driver monitoring system (DMS) application 905 corresponding to the first safety level such as ASIL B, the first virtual machine 830 among the plurality of virtual machines 810 to 830 can separately execute the face detection microservice 910b, the eye movement microservice 915b, the gaze tracking microservice 920b, and the warning microservice 930b as the plurality of microservices.

[0291] On the other hand, the second virtual machine 820 can execute a second application corresponding to the second safety level, and the second application can be executed based on the result data of the first microservice 920b.

[0292] For example, as Figure 8b shown, the second virtual machine 820 among the plurality of virtual machines 810 to 830 can execute the augmented reality microservice 930c as the microservice corresponding to QM of the second safety level.

[0293] On the other hand, as Figure 8b shown, the second virtual machine 820 among the plurality of virtual machines 810 to 830 can further execute the hot face recognition microservice 915a as the microservice corresponding to QM of the second safety level.

[0294] On the other hand, the second virtual machine 820 among the plurality of virtual machines 810 to 830 can execute the augmented reality microservice 930c as the microservice corresponding to QM.

[0295] On the other hand, the first virtual machine 830 can transmit the result data of the gaze tracking microservice 920b in the microservices within the application 905 corresponding to ASIL B to the augmented reality microservice 930c corresponding to QM with a lower safety level.

[0296] That is, as Figure 8b shown, the first virtual machine 830 can transmit the result data of the gaze tracking microservice 920b in the microservices within the application 905 corresponding to ASIL B to the augmented reality microservice 930c in the second virtual machine 820 with a lower safety level.

[0297] Specifically, the first virtual machine 830 can execute each of the face detection microservice 910b, the eye movement microservice 915b, the gaze tracking microservice 920b, and the warning microservice 930b based on the received camera data, and transmit the result data of the gaze tracking microservice 920b to the second virtual machine 820 corresponding to the second safety level.

[0298] On the other hand, as Figure 8bAs shown, the second virtual machine 820 can be controlled to execute the augmented reality microservice 930c based on the result data of the gaze tracking microservice 920b, and display the result data of the augmented reality microservice 930c on the display 180.

[0299] As described above, there is no need to execute an additional gaze tracking microservice 920b or the like within the second virtual machine 820, so data processing can be effectively performed based on the security level.

[0300] On the other hand, the first virtual machine 830 can use the shared memory 508 to transmit the result data of the first microservice 920b to at least one virtual machine corresponding to a second security level below the first security level.

[0301] On the other hand, the first virtual machine 830 can use the shared memory 508 to transmit the result data of the first microservice 920b to the second virtual machine 820 corresponding to a second security level below the first security level.

[0302] On the other hand, the first virtual machine 830 can use the shared memory within the hypervisor 505 to transmit the result data of the gaze tracking microservice 920b to the augmented reality microservice 930c within the second virtual machine 820.

[0303] As described above, when using the shared memory 508 to transmit the result data, it is possible to transmit 1:n result data.

[0304] On the other hand, the second virtual machine 820 may not transmit the result data of the microservice executed by the second virtual machine 820 or the result data of the application to the first virtual machine 830.

[0305] That is, the second virtual machine 820 may not transmit data to the first virtual machine 830 with a higher security level.

[0306] For example, the result data of the face recognition microservice 915a within the second virtual machine 820 is not transmitted to the first virtual machine 830. Thus, the security level of each virtual machine can be maintained.

[0307] On the other hand, the first virtual machine 830 among the plurality of virtual machines 810 to 830 may not transmit the result data of the first microservice 920b among the plurality of microservices to a virtual machine with a third security level higher than the first security level.

[0308] For example, when the third virtual machine 810 among a plurality of virtual machines 810 to 830 has a third safety level higher than the first safety level and being ASIL D, the first virtual machine 830 may not transmit the result data of the first microservice 920b among the plurality of microservices to the third virtual machine 810 or the fourth virtual machine 840 having the third safety level higher than the first safety level. Thereby, the safety levels of the respective virtual machines can be maintained.

[0309] On the other hand, a part of the cores of the processor 175 may execute the first virtual machine 830, and another part of the cores of the processor 175 may execute the second virtual machine 820.

[0310] In the drawings, it is illustrated that a part of the cores of the processor 175 executes the first virtual machine 830 corresponding to ASIL B of the first safety level, and another part of the cores of the processor 175 executes the second virtual machine 820 corresponding to QM of the second safety level. Thereby, data processing can be effectively executed based on the safety level.

[0311] On the other hand, the second processor 177 may execute an application or a virtual machine of ASIL D which is the highest safety level.

[0312] On the other hand, the safety level of the application or the virtual machine executed in the second processor 177 may be higher than the first safety level. Thereby, data processing can be effectively executed based on the safety level.

[0313] On the other hand, as Figure 8d shown, the second virtual machine 820 may execute a face recognition microservice 915a based on the received camera data, and may execute a personal microservice 920a as an additional microservice based on the result data of the face recognition microservice.

[0314] On the other hand, as Figure 8d shown, for the occupant monitoring application 940 corresponding to QM, the second virtual machine 820 may execute each of an occupant seating microservice 950b, an occupant movement microservice 955b, an occupant detection microservice 960b, and a graphics providing microservice 965b based on the received sensor data or camera data, and may not transmit the service result data of the occupant detection microservice 960b to the first virtual machine 830.

[0315] On the other hand, in the case of not receiving the service result data of the occupant detection microservice 960b from the second virtual machine 820, as Figure 8dAs shown, for the occupant monitoring application 945 corresponding to ASIL B, the first virtual machine 830 executes each of the occupant seating microservice 950d, the occupant movement microservice 955d, the occupant detection microservice 960d, and the warning microservice 965d based on the received sensor data or camera data. Thus, data processing can be effectively performed based on the safety level.

[0316] On the other hand, the first virtual machine 830 in the signal processing device 170 of another embodiment of the present invention executes the first application program and transmits the result data or intermediate result data of the first application program to the second virtual machine 820 or the virtual machine corresponding to the second safety level in the second signal processing device 170Z. Thus, data processing can be effectively performed based on the safety level. Further, data processing can be effectively performed using microservices.

[0317] On the other hand, the first virtual machine 830 may execute a first application program including a plurality of microservices and transmit the result data of at least a part of the plurality of microservices to the second virtual machine 820 or the second signal processing device 170Z.

[0318] Figure 10 is an example of an internal block diagram of a signal processing device according to another embodiment of the present invention.

[0319] Referring to the drawings, the signal processing device 170 in the system 1000b according to another embodiment of the present invention can transmit data to the second signal processing device 170 or receive data from the second signal processing device 170.

[0320] Centering on the difference from Figure 9 the second signal processing device 170z may be a regional signal processing device.

[0321] The second signal processing device 170z includes a processor 175z that executes a hypervisor 505z.

[0322] On the other hand, the processor 175z in the second signal processing device 170z may have a plurality of processor cores.

[0323] On the other hand, in order to execute an application program or the like of ASIL D, which is the highest safety level, the second signal processing device 170z may further include an additional processor 177z having M cores or an MCU.

[0324] On the other hand, the processor 175z may execute at least one virtual machine 830z on the hypervisor 505.

[0325] On the other hand, the additional processor 177z can execute the virtual machine 840z corresponding to ASIL D, which is the highest safety level, on the M core.

[0326] On the other hand, the camera data from the internal camera 195i can be transmitted to the signal processing device 170 or the second signal processing device 170z.

[0327] In the attached drawings, the virtual machine 830z in the processor 175z executes a video streaming application 9993 based on camera data.

[0328] On the other hand, the processor 175 in the signal processing device 170 can receive sensor data or camera data from the second signal processing device 170Z.

[0329] On the other hand, the first virtual machine 830 in the signal processing device 170 can execute a plurality of microservices corresponding to the first safety level based on the sensor data or camera data, as Figure 8b shown, the result data of the first microservice 920b among the plurality of microservices can be transmitted to the second virtual machine 820 corresponding to the second safety level below the first safety level.

[0330] On the other hand, the first virtual machine 830 in the signal processing device 170 can execute a plurality of microservices corresponding to the first safety level based on the sensor data or camera data, and the result data of the first microservice 920b among the plurality of microservices can be transmitted to the virtual machine corresponding to the second safety level lower than or equal to the first safety level in the second signal processing device 170Z.

[0331] For example, the first virtual machine 830 in the signal processing device 170 can transmit the result data of the gaze tracking microservice 920b to the virtual machine 830z corresponding to ASIL B, which is the same safety level, in the second signal processing device 170Z.

[0332] Thus, the virtual machine 830z in the second signal processing device 170Z does not need to execute the gaze tracking microservice 920b separately, so data processing can be effectively performed based on the safety level.

[0333] Figure 11 It is a flowchart showing the operation method of the signal processing device according to an embodiment of the present invention.

[0334] Referring to the attached drawings, in order to execute the application program, the processor 175 in the signal processing device 170 according to an embodiment of the present invention can execute a plurality of microservices (S1110).

[0335] The processor 175 confirms the safety level of the microservice (S1115).

[0336] For example, the processor 175 can confirm whether the security level of the microservice is ASIL D, ASIL C, ASIL B, ASIL A, or QM. ASIL D can be the highest security level, and QM can be the lowest security level.

[0337] Next, the processor 175 can determine whether the security level of the result data of the executed microservice is higher than the security level of the receiving microservice (S1120). If so, it approves the transmission of the result data (S1125).

[0338] Thus, the result data of the executed microservice can be transmitted to the receiving microservice.

[0339] On the other hand, in step 1120 (S1120), if the security level of the result data of the executed microservice is lower than the security level of the receiving microservice, the processor 175 rejects the transmission of the result data (S1127).

[0340] Therefore, the transmission of the result data cannot be executed.

[0341] On the other hand, to transmit the result data of the executed microservice, the processor 175 determines whether there is a microservice with a higher security level than the executed microservice (S1130). If so, it can re-execute from step 1120 (S1120). Thus, the sharing of the result data can be executed.

[0342] Figures 12 to 16b is the figure referred to in the Figures 9 to 11 actions described.

[0343] Figure 12 is a figure showing the transmissible information for each security level of the microservice.

[0344] Referring to the attached drawings, when the security level of the transmitted microservice is QM, the result data can only be transmitted when the security level of the receiving microservice is QM, and cannot be transmitted when it is ASIL A, ASIL B, ASIL C, or ASIL D.

[0345] On the other hand, when the security level of the transmitted microservice is ASIL A, the result data can only be transmitted when the security level of the receiving microservice is QM or ASIL A, and cannot be transmitted when it is ASIL B, ASIL C, or ASIL D.

[0346] On the other hand, when the security level of the transmitting microservice is ASIL B, the result data can only be transmitted when the security level of the receiving microservice is QM, ASIL A, or ASIL B, and cannot be transmitted when the security level is ASIL C or ASIL D.

[0347] On the other hand, when the security level of the transmitting microservice is ASIL C, the result data can only be transmitted when the security level of the receiving microservice is QM, ASIL A, ASIL B, or ASIL C, and cannot be transmitted when the security level is ASIL D.

[0348] On the other hand, when the security level of the transmitting microservice is ASIL D, the result data can be transmitted when the security level of the receiving microservice is QM, ASIL A, ASIL B, ASIL C, or ASIL D.

[0349] Figure 13 A diagram illustrating an example of a data control scheme for transmitting the result data of a microservice.

[0350] Referring to the accompanying drawings, the processor 175 in the signal processing device 170 can execute the main node MN, the working node WN, the coordinator ORC, and the data control manager 1330 for data transmission.

[0351] The gateway 1309 executed in the main node MN can receive data and transmit it to the node agent 1316, the middleware 1313, etc. in the working node WN.

[0352] Alternatively, the gateway 1309 executed in the main node MN can receive data and transmit it to the API server 1319 in the coordinator ORC.

[0353] On the other hand, the API server 1319 in the coordinator ORC can transmit data to the application controller 1334 and the data access controller 1336 in the data control manager 1330.

[0354] On the other hand, the API server 1319 in the coordinator ORC can transmit data to the coordinator client 1325 and the container runtime 1327.

[0355] On the other hand, the data control manager 1330 can have or execute a data path controller 1332 and can exchange data with agents 1320a, 1320b, 1320c, etc. in a plurality of vehicle applications.

[0356] On the other hand, the data path controller 1332 can act for the transmission of the result data.

[0357] For example, for the transmission of the result data of the first microservice 920b, the data path controller 1332 may transmit transferable information to the proxy of the first microservice 920b based on the security level of the first microservice 920b and the security level of the microservices or applications within the second virtual machine 820.

[0358] On the other hand, one of the plurality of virtual machines 810 to 830 executes the data path controller 1332 for transmitting the result data of the first microservice 920b, whereby data processing can be effectively executed based on the security level.

[0359] Regarding this, reference is made to Figure 14a etc. for description.

[0360] Figure 14a An example of the proxy action attached to the gaze tracking microservice 920b as the first microservice is illustrated.

[0361] Referring to the accompanying drawings, similarly to Figure 8b the signal processing device 170 according to an embodiment of the present invention may execute a plurality of microservices corresponding to ASIL B and a microservice corresponding to QM based on the camera data from the internal camera 195i.

[0362] For example, for the driver monitoring system DMS application 905 corresponding to ASIL B, the signal processing device 170 according to an embodiment of the present invention may execute each of the face detection microservice 910b, the eye movement microservice 915b, the gaze tracking microservice 920b, and the warning microservice 930b as a plurality of microservices.

[0363] On the other hand, the signal processing device 170 according to an embodiment of the present invention may execute the augmented reality microservice 930c as a microservice corresponding to QM, and the augmented reality microservice 930c is an example of a graphics providing microservice.

[0364] On the other hand, in order to transmit the result data of the gaze tracking microservice 920b in the microservices within the application 905 corresponding to ASIL B to the augmented reality microservice 930c corresponding to QM with a lower security level, the signal processing device 170 according to an embodiment of the present invention may execute the proxy 1410 attached to the gaze tracking microservice 920b.

[0365] The proxy 1410 attached to the gaze tracking microservice 920b may exchange data with Figure 13 the data control manager 1330.

[0366] For example, the proxy 1410 attached to the gaze tracking microservice 920b transmits a data transfer availability confirmation request to the application controller 1334, data access controller 1336, data path controller 1332, resource 1337, and data path controller 1332 in the rule table 1335 within the data control manager 1330.

[0367] Correspondingly, the data path controller 1332 confirms the security level of the gaze tracking microservice 920b as the transmitting microservice and the security level of the augmented reality microservice 930c as the receiving microservice through the rule table 1335.

[0368] Moreover, the data path controller 1332 transmits data transfer available information or transfer unavailable information to the proxy 1410 based on the respective security level confirmation results.

[0369] At this time, since the security level of the transmitting microservice is higher than that of the receiving microservice, the data path controller 1332 transmits data transfer available information to the proxy 1410.

[0370] On the other hand, the proxy 1410 attached to the gaze tracking microservice 920b transmits the result data of the gaze tracking microservice 920b to the augmented reality microservice 930c based on the data transfer available information. Thus, data processing can be effectively performed based on the security level.

[0371] Figure 14b Another example of the proxy operation attached to the gaze tracking microservice 960b as the first microservice is illustrated.

[0372] Referring to the accompanying drawings, similarly to Figure 8d the signal processing device 170 according to an embodiment of the present invention can execute a plurality of microservices corresponding to ASIL B and microservices corresponding to QM based on camera data from the internal camera 195i.

[0373] For example, for the occupant monitoring application 940 corresponding to QM, the signal processing device 170 according to an embodiment of the present invention can execute each of the occupant seating microservice 950b, occupant movement microservice 955b, occupant detection microservice 960b, and graphics providing microservice 965b as a plurality of microservices.

[0374] On the other hand, the signal processing device 170 according to an embodiment of the present invention can execute each of the occupant seating microservice 950d, occupant movement microservice 955d, occupant detection microservice 960d, and warning microservice 965d as a plurality of microservices for the occupant monitoring application 945 corresponding to ASIL B.

[0375] On the other hand, in order to transmit the result data of the passenger detection microservice 960b in the microservices within the passenger monitoring application 940 corresponding to QM to the warning microservice 965d corresponding to ASIL B with a higher safety level, the signal processing device 170 according to an embodiment of the present invention may execute a proxy 1450 attached to the passenger detection microservice 960b.

[0376] The proxy 1450 attached to the passenger detection microservice 960b may exchange data with Figure 13 the data control manager 1330.

[0377] For example, the proxy 1450 attached to the passenger detection microservice 960b transmits a data transfer availability confirmation request to the data path controller 1332 among the application controller 1334, data access controller 1336, data path controller 1332, resource 1337, and rule table 1335 within the data control manager 1330.

[0378] Correspondingly, the data path controller 1332 confirms the safety level of the passenger detection microservice 960b as the transmission microservice and the safety level of the warning microservice 965d as the receiving microservice through the rule table 1335.

[0379] And the data path controller 1332 transmits data transfer available information or transfer unavailable information to the proxy 1450 according to the respective safety level confirmation results.

[0380] At this time, since the safety level of the transmission microservice is lower than the safety level of the receiving microservice, the data path controller 1332 transmits data transfer unavailable information to the proxy 1450.

[0381] On the other hand, the proxy 1450 attached to the passenger detection microservice 960b does not transmit the result data of the passenger detection microservice 960b to the warning microservice 965d based on the data transfer unavailable information. Thus, each safety level can be maintained.

[0382] Figures 15a to 15e It is a diagram Figure 13 referred to in the operation of the coordinator ORC described.

[0383] Figure 15a It illustrates a case where the redundant coordinators 1510a and 1510b each operate automatically when transmitting input data.

[0384] The first redundant coordinator 1510a may transmit input data to service A within the first service 1515a through the first path and transmit input data to the redundant service A' within the first service 1515a through the second path. Thus, even when a certain path is abnormal, the input data can be stably transmitted.

[0385] Next, the second redundancy coordinator 1510b can transmit the input data from the first service 1515a to service B within the second service 1515b through the third path, and transmit the input data from the first service 1515a to the redundant service B' within the second service 1515b through the fourth path. Thus, even when a certain path is abnormal, the input data can be stably transmitted.

[0386] On the other hand, when transmitting Figure 8b , Figure 8e , Figure 14a , the result data can adopt the Figure 15a method.

[0387] Figure 15b is Figure 15a an example of the internal block diagram of the second redundancy coordinator 1510b.

[0388] Referring to the attached drawings, the second redundancy coordinator 1510b can have a redundancy comparison selector 1511 and a redundancy scheduler 1512.

[0389] For example, the redundancy comparison selector 1511 can select the input data of the first path among the input data of the first path and the input data of the second path.

[0390] Next, the redundancy scheduler 1512 can separate and output the input data of the third path and the input data of the fourth path based on the selected input data of the first path. Thus, even when a certain path is abnormal, the input data can be stably transmitted.

[0391] On the other hand, when transmitting Figure 8b , Figure 8e , Figure 14a , the result data can adopt the Figure 15b method.

[0392] Figure 15c is a diagram illustrating multi-version redundant service orchestration.

[0393] Referring to the attached drawings, in order to transmit input data to service A 1535, the first redundancy coordinator 1530a can transmit the input data to services A-1, A-2, A-3, A'-1, A'-2, A'-3 through the first path to the sixth path. Thus, even when a certain path is abnormal, the input data can be stably transmitted.

[0394] Next, in order to transmit the input data from Service A1535 to the second service B1545, the second redundancy coordinator 1530b can transmit the input data to services B-1, B-2, B-3, B'-1, B'-2, B'-3 through the seventh path to the twelfth path. Thus, even if a certain path is abnormal, the input data can be stably transmitted.

[0395] On the other hand, when transmitting Figure 8b , Figure 8e , Figure 14a of the result data, the method of Figure 15b can be adopted.

[0396] On the other hand, Figures 15a to 15c Service A or B can be Application A or B, or microservices A or B within the application.

[0397] Figure 15d is a diagram illustrating the multi-version redundant service orchestration.

[0398] Referring to the attached drawings, the input data can be transmitted to the first microservice through the first service coordinator 1550a, the result data of the first microservice can be transmitted to the second microservice through the second service coordinator 1550b, and the result data of the second microservice can be output as the result data of Service A through the third service coordinator 1550c.

[0399] On the other hand, the second service coordinator 1550b can transmit the result data of the first microservice to the third microservice within Service B, which is another service.

[0400] Thus, the third microservice within Service B can operate based on the result data of the first microservice, and the result data of the third microservice can be output as the result data of Service B through the fourth service coordinator 1550d.

[0401] On the other hand, the third service coordinator 1550c can transmit the result data of the second microservice to the fourth microservice within Service C, which is another service.

[0402] Thus, the fourth microservice within Service C can operate based on the result data of the second microservice, and the result data of the fourth microservice can be output as the result data of Service C through the fifth service coordinator 1550e.

[0403] That is, when the security level of Service A is higher than or equal to the security levels of Service B or Service C, as shown in the figure, the result data can be multiplexed and transmitted. Thus, effective data processing and utilization can be achieved, and the load can be reduced.

[0404] Figure 15e Illustrates the transmission of input data using the service coordinator.

[0405] Referring to the accompanying drawings, the service coordinator 1570a can transmit input data to a plurality of services A in the first working node 1577a through the first path and the second path, and transmit input data to a plurality of services A in the second working node 1577b through the third path and the fourth path.

[0406] On the other hand, a plurality of services A in the first working node 1577a each output result data, and a plurality of services A in the second working node 1577b each output result data. Due to this parallel path structure, rapid services and the like can be executed.

[0407] On the other hand, when transmitting Figure 8b , Figure 8e , Figure 14a the result data, the Figure 15e method can be adopted.

[0408] Figures 16a to 16b Illustrates the configuration or design of microservices based on the usage purpose.

[0409] Figure 16a Is a diagram illustrating the execution of microservices in the central signal processing device among the regional signal processing device and the central signal processing device.

[0410] Referring to the accompanying drawings, the regional signal processing device 170z can operate at the safety level of ASIl C.

[0411] On the other hand, the central signal processing device 170 can operate at the safety level of ASIl C.

[0412] The central signal processing device 170 can execute the obstacle avoidance planner microservice 1610 based on the camera data from the front camera.

[0413] In particular, the graphics processor 178 in the central signal processing device 170 can execute the obstacle avoidance planner microservice 1610 corresponding to the safety level of ASIl C based on the camera data from the front camera.

[0414] Figure 16b Is a diagram illustrating the transmission of the result data of the microservices executed in the central signal processing device to the regional signal processing device among the regional signal processing device and the central signal processing device.

[0415] Referring to the accompanying drawings, the result data of the obstacle avoidance planner microservice 1610 in the central signal processing device 170 can be transmitted to the obstacle velocity limiter microservice 1615 in the area signal processing device 170z of the same safety level.

[0416] Next, the result data of the obstacle velocity limiter microservice 1615 can be transmitted to the obstacle stop planner microservice 1618 of the same safety level.

[0417] Thus, in the case of an emergency stop due to an obstacle ahead, the obstacle stop planner microservice 1618 can quickly stop the vehicle.

[0418] As described above, since the result data of the microservice is transmitted to the receiving microservice whose safety level is lower than the safety level of the transmitting microservice, rapid and effective data processing and corresponding actions can be performed.

[0419] As above, the preferred embodiments of the present invention have been illustrated and described, but the present invention is not limited to the above specific embodiments. Without departing from the gist of the present invention claimed in the claims, those skilled in the art can make various modifications, and such modified embodiments should not be separately understood without departing from the technical idea or prospect of the present invention.

Claims

1. A signal processing device, wherein, it includes a processor that executes a hypervisor; the processor executes a plurality of virtual machines on the hypervisor; a first virtual machine among the plurality of virtual machines executes a plurality of microservices corresponding to a first security level, and transmits result data of a first microservice among the plurality of microservices to a second virtual machine corresponding to a second security level lower than or equal to the first security level or a virtual machine in a second signal processing device.

2. The signal processing device according to claim 1, wherein, in order to execute a first application program corresponding to the first security level, the first virtual machine differentiates and executes the plurality of microservices.

3. The signal processing device according to claim 1, wherein, the second virtual machine executes a second application program corresponding to the second security level; the second application program is executed based on the result data of the first microservice.

4. The signal processing device according to claim 1, wherein, the second virtual machine does not transmit result data of microservices executed by the second virtual machine or result data of application programs to the first virtual machine.

5. The signal processing device according to claim 1, wherein, a first virtual machine among the plurality of virtual machines does not transmit result data of a first microservice among the plurality of microservices to a virtual machine of a third security level higher than the first security level.

6. The signal processing device according to claim 1, wherein, a part of the cores of the processor executes the first virtual machine; another part of the cores of the processor executes the second virtual machine.

7. The signal processing device according to claim 1, wherein, it further includes a second processor different from the processor; the second processor executes an application program or a virtual machine; the security level of the application program or the virtual machine executed in the second processor is higher than the first security level.

8. The signal processing device according to claim 7, wherein, the second processor does not execute the hypervisor.

9. The signal processing device according to claim 1, wherein, the processor receives sensor data or camera data from the second signal processing device; the first virtual machine executes a plurality of microservices corresponding to a first security level based on the sensor data or the camera data, and transmits result data of the first microservice among the plurality of microservices to a second virtual machine corresponding to a second security level lower than or equal to the first security level.

10. The signal processing device according to claim 1, wherein, the first virtual machine executes a plurality of microservices corresponding to a first security level based on sensor data or camera data, and transmits result data of the first microservice among the plurality of microservices to a virtual machine corresponding to a second security level lower than or equal to the first security level in the second signal processing device.

11. The signal processing device according to claim 1, wherein, The first virtual machine among a plurality of the virtual machines executes each of a face detection microservice, an eye movement microservice, a gaze tracking microservice, and a warning microservice based on received camera data, and transmits result data of the gaze tracking microservice to a second virtual machine corresponding to the second security level.

12. The signal processing apparatus according to claim 11, wherein the second virtual machine is controlled to execute an augmented reality microservice based on the result data of the gaze tracking microservice, and display the result data of the augmented reality microservice on a display.

13. The signal processing apparatus according to claim 1, wherein the second virtual machine executes a face recognition microservice based on received camera data, and executes an additional microservice based on the result data of the face recognition microservice.

14. The signal processing apparatus according to claim 1, wherein the second virtual machine executes each of an occupant seating microservice, an occupant movement microservice, an occupant detection microservice, and a graphics providing microservice based on received sensor data or camera data, and does not transmit service result data of the occupant detection microservice to the first virtual machine.

15. The signal processing apparatus according to claim 1, wherein in a case where service result data of the occupant detection microservice is not received from the second virtual machine, the first virtual machine executes each of an occupant seating microservice, an occupant movement microservice, an occupant detection microservice, and a warning microservice based on received sensor data or camera data.

16. The signal processing apparatus according to claim 1, wherein the first virtual machine transmits result data of the first microservice to a second virtual machine corresponding to a second security level lower than or equal to the first security level by using a shared memory.

17. The signal processing apparatus according to claim 1, wherein a certain virtual machine among a plurality of the virtual machines executes a data path controller for transmitting result data of the first microservice; the data path controller transmits transmission available information to an agent of the first microservice based on a security level of the first microservice and a security level of a microservice or an application program in the second virtual machine.

18. A signal processing apparatus, wherein it includes a processor that executes a hypervisor; the processor executes a first virtual machine corresponding to a first security level and a second virtual machine corresponding to a second security level lower than or equal to the first security level on the hypervisor; the first virtual machine executes a first application program, and transmits result data or intermediate result data of the first application program to the second virtual machine or a virtual machine corresponding to the second security level in a second signal processing apparatus.

19. The signal processing apparatus according to claim 18, wherein the first virtual machine executes the first application program including a plurality of microservices, and transmits result data of at least a part of the plurality of microservices to the second virtual machine or the second signal processing apparatus.

20. A display device for a vehicle, wherein, including: at least one display; and A signal processing device that outputs an image signal to the display; The signal processing device includes the signal processing devices of claims 1 to 19.

Images