Signal processing device, and vehicle display device comprising same

Abstract

A signal processing device according to an embodiment of the present disclosure comprises: a communication unit for wirelessly exchanging data with a region signal processing device; and a processor. The processor: determines the presence or absence of a wireless delay on the basis of wireless data received or transmitted from the communication unit; and controls, on the basis of the determined result, a wireless mode with the region signal processing device to be variable. Accordingly, wireless data transmission between the signal processing devices can be stably performed.

Description

Signal processing device and vehicle display device equipped with the same

[0001] The present disclosure relates to a server, and more specifically, to a signal processing device capable of reliably performing wireless data transmission between signal processing devices and a vehicle display device equipped with the same.

[0002] A vehicle is a device that moves the user in the desired direction. A typical example is an automobile.

[0003] Meanwhile, for the convenience of users of the vehicle, a vehicle signal processing device is installed inside the vehicle.

[0004] The signal processing unit inside the vehicle receives and processes sensor data from various internal sensor devices.

[0005] Meanwhile, due to Advanced Driver Assistance Systems (ADAS) or autonomous driving, the types and number of sensors installed in vehicles are increasing, leading to a trend of increasing data that needs to be processed.

[0006] Meanwhile, the vehicle display device displays an image processed by a signal processing device within the vehicle.

[0007] Meanwhile, when transmitting video signals based on wireless communication within a vehicle, the wireless network environment may vary due to factors such as the movement of the vehicle.

[0008] The problem that the present disclosure aims to solve is to provide a signal processing device capable of reliably performing wireless data transmission between signal processing devices and a vehicle display device equipped with the same.

[0009] Another problem that the present disclosure aims to solve is to provide a signal processing device capable of varying the wireless mode according to the transmission speed of wireless data, and a vehicle display device equipped with the same.

[0010] Another problem that the present disclosure aims to solve is to provide a signal processing device capable of varying a wireless mode corresponding to a wireless network environment around a vehicle based on driving information of the vehicle, and a vehicle display device equipped with the same.

[0011] A signal processing device according to one embodiment of the present disclosure includes a communication unit that exchanges data wirelessly with a region signal processing device, and a processor that determines whether there is a wireless delay based on wireless data received or transmitted from the communication unit, and controls the wireless mode with the region signal processing device to vary based on the determination result.

[0012] Meanwhile, the processor can control the transmission speed of wireless data of the communication unit to execute a graphic transmission mode when the transmission speed is between a first reference level and a second reference level higher than the first reference level, and to execute a video transmission mode with a larger amount of data transmission than the graphic transmission mode when the transmission speed of wireless data of the communication unit is above the second reference level.

[0013] Meanwhile, the processor executes multiple virtualization machines, and when executing the graphics transmission mode, the graphics stack, resource cache control, and distributed rendering control can be executed only in the first virtualization machine among the multiple virtualization machines.

[0014] Meanwhile, the processor runs multiple virtualization machines, and when running video transmission mode, it can run a video framework and distributed decoding control only on the first virtualization machine among the multiple virtualization machines.

[0015] Meanwhile, the communications unit can receive or transmit wireless data wirelessly, or receive or transmit wired data wiredly.

[0016] Meanwhile, the processor can control the transmission of data by selecting a wireless or wired method based on the priority order or transmission conditions of the data to be transmitted.

[0017] Meanwhile, the processor can run a display window manager that manages the wireless transmission of multimedia data as an area signal processing device.

[0018] Meanwhile, the display window manager can control the size or dimensions of a window to be displayed on a display connected to an area signal processing device, or manage the transmission target of the window to be displayed.

[0019] Meanwhile, the processor can transmit the vehicle's driving path to an external server, receive surrounding vehicle information from the server, receive information from the server regarding sections where the transmission speed of the wireless network or wireless data decreases based on the vehicle's driving information, and control the wireless mode or the frequency channel within the wireless mode to vary based on the information.

[0020] Meanwhile, the processor can control the wireless mode with the area signal processing device to vary based on wireless network information around the vehicle.

[0021] Meanwhile, the processor can control the compression of frame data and transmission of the compressed frame data when the wireless mode is the first mode, and the transmission of command data and resource ID information for rendering when the wireless mode is the second mode.

[0022] Meanwhile, the processor can compress frame data and control the transmission of the compressed frame data when transmitting the home screen or navigation screen.

[0023] Meanwhile, the processor can control the transmission of rendering data and command data when transmitting the game screen.

[0024] Meanwhile, the processor can control the transmission of rendering data and command data when the wireless mode is the first mode, and the transmission of cache information when the wireless mode is the second mode.

[0025] Meanwhile, the processor can control the transmission of decoded stream data when the wireless mode is the first mode during stream data transmission, and transmit encoded stream data when the wireless mode is the second mode.

[0026] Meanwhile, the signal processing device further includes a graphics processor, and the processor executes a plurality of virtualization machines, and among the plurality of virtualization machines, the first virtualization machine can execute a graphics device driver for the graphics processor.

[0027] Meanwhile, the signal processing device further includes a video decoder, and the processor executes a plurality of virtualization machines, and among the plurality of virtualization machines, the first virtualization machine can execute a video decoder driver for the video decoder.

[0028] A vehicle display device according to one embodiment of the present disclosure comprises a central signal processing device, a region signal processing device that wirelessly exchanges data with the central signal processing device, and a display that displays an image based on a video signal output from the region signal processing device, wherein the central signal processing device comprises a signal processing device according to any one of claims 1 to 16.

[0029] Meanwhile, the area signal processing device includes a processor, and the processor within the area signal processing device can execute a distributed rendering client control client.

[0030] A signal processing device according to one embodiment of the present disclosure includes a communication unit that exchanges data wirelessly with a region signal processing device, and a processor that determines whether there is a wireless delay based on wireless data received or transmitted from the communication unit, and controls the wireless mode with the region signal processing device to vary based on the determination result. Accordingly, wireless data transmission between signal processing devices can be performed stably.

[0031] Meanwhile, the processor can control the transmission speed of wireless data from the communication unit to execute a graphic transmission mode when the transmission speed is between a first reference level and a second reference level higher than the first reference level, and to execute a video transmission mode with a larger data transmission amount than the graphic transmission mode when the transmission speed of wireless data from the communication unit is above the second reference level. Accordingly, stable wireless data transmission between signal processing devices can be performed. In particular, stable wireless data transmission between signal processing devices can be performed by varying the wireless mode according to the transmission speed of wireless data.

[0032] Meanwhile, the processor executes multiple virtualization machines, and when executing the graphics transmission mode, the graphics stack, resource cache control, and distributed rendering control can be executed only in the first virtualization machine among the multiple virtualization machines. Accordingly, wireless data transmission between signal processing devices can be performed reliably.

[0033] Meanwhile, the processor executes multiple virtualization machines, and when executing the video transmission mode, the video framework and distributed decoding control can be executed only in the first virtualization machine among the multiple virtualization machines. Accordingly, wireless data transmission between signal processing devices can be performed reliably.

[0034] Meanwhile, the communication unit can receive or transmit wireless data wirelessly, or receive or transmit wired data wiredly. Accordingly, wireless data transmission between signal processing devices can be performed reliably.

[0035] Meanwhile, the processor can control the transmission of data by selecting a wireless or wired method based on the priority of the data to be transmitted or transmission conditions. Accordingly, data transmission between signal processing devices can be performed reliably.

[0036] Meanwhile, the processor can execute a display window manager that manages the wireless transmission of multimedia data to area signal processing units. Accordingly, stable wireless data transmission between signal processing units becomes possible.

[0037] Meanwhile, the display window manager can control the size or dimensions of a window to be displayed on a display connected to an area signal processing device, or manage the transmission targets of the window to be displayed. Accordingly, stable wireless data transmission between signal processing devices becomes possible.

[0038] Meanwhile, the processor transmits the vehicle's driving path to an external server, receives surrounding vehicle information from the server, and, based on the vehicle's driving information, receives information from the server regarding sections where the transmission speed of the wireless network or wireless data decreases. Based on this information, the processor can control the variable wireless mode or the variable frequency channel within the wireless mode. Accordingly, stable wireless data transmission between signal processing devices can be performed. In particular, based on the vehicle's driving information, the wireless mode can be varied according to the wireless network environment around the vehicle, thereby enabling stable wireless data transmission between signal processing devices.

[0039] Meanwhile, the processor can control the wireless mode with the area signal processing unit to vary based on wireless network information around the vehicle. Accordingly, stable wireless data transmission between the signal processing units becomes possible.

[0040] Meanwhile, the processor can control the compression of frame data and transmission of the compressed frame data when the wireless mode is the first mode, and the transmission of command data and resource ID information for rendering when the wireless mode is the second mode. Accordingly, stable wireless data transmission between signal processing devices can be performed.

[0041] Meanwhile, the processor can control the transmission of frame data and the compressed frame data when transmitting a home screen or navigation screen. Accordingly, stable wireless data transmission between signal processing devices becomes possible.

[0042] Meanwhile, the processor can control the transmission of rendering data and command data when transmitting the game screen. Accordingly, stable wireless data transmission between signal processing devices becomes possible.

[0043] Meanwhile, the processor can be controlled to transmit rendering data and command data when the wireless mode is the first mode, and to transmit cache information when the wireless mode is the second mode. Accordingly, stable wireless data transmission between signal processing devices can be performed.

[0044] Meanwhile, the processor can control the transmission of decoded stream data when the wireless mode is the first mode, and the transmission of encoded stream data when the wireless mode is the second mode, when transmitting stream data. Accordingly, stable wireless data transmission between signal processing devices can be performed.

[0045] Meanwhile, the signal processing device further includes a graphics processor, and the processor executes a plurality of virtualization machines, and among the plurality of virtualization machines, the first virtualization machine can execute a graphics device driver for the graphics processor. Accordingly, wireless data transmission between signal processing devices can be performed reliably.

[0046] Meanwhile, the signal processing device further includes a video decoder, and the processor executes a plurality of virtualization machines, and among the plurality of virtualization machines, the first virtualization machine can execute a video decoder driver for the video decoder. Accordingly, wireless data transmission between signal processing devices can be performed reliably.

[0047] A vehicle display device according to one embodiment of the present disclosure comprises a central signal processing device, a region signal processing device that wirelessly exchanges data with the central signal processing device, and a display that displays an image based on a video signal output from the region signal processing device, wherein the central signal processing device comprises a signal processing device according to any one of claims 1 to 16. Accordingly, wireless data transmission between signal processing devices can be performed stably.

[0048] Meanwhile, the area signal processing device includes a processor, and the processor within the area signal processing device can execute a distributed rendering client control client. Accordingly, wireless data transmission between signal processing devices can be performed reliably.

[0049] Figure 1 is a drawing illustrating a vehicle system including a vehicle and a server.

[0050] Figure 2 is a diagram illustrating the architecture of a vehicle signal processing system inside the vehicle of Figure 1.

[0051] FIG. 3a is a drawing illustrating an example of the arrangement of a vehicle display device inside a vehicle.

[0052] FIG. 3b is a drawing illustrating another example of the arrangement of a vehicle display device inside a vehicle.

[0053] Figure 4 is an example of an internal block diagram of the vehicle of Figure 1.

[0054] FIG. 5 is an example of a block diagram of a vehicle display device according to an embodiment of the present disclosure.

[0055] FIG. 6 is an example of an internal block diagram of a vehicle display device according to an embodiment of the present disclosure.

[0056] FIGS. 7 to 18 are drawings referenced in the description of FIG. 6.

[0057] The present disclosure will be described in more detail below with reference to the drawings.

[0058] The suffixes "module" and "part" for components used in the following description are assigned solely for the ease of drafting this specification and do not inherently confer any particularly significant meaning or role. Accordingly, the terms "module" and "part" may be used interchangeably.

[0059] Figure 1 is a drawing illustrating a vehicle system including a vehicle and a server.

[0060] Referring to the drawing, the vehicle system (10) includes a vehicle (200) and a server (900) that exchanges vehicle (200) data.

[0061] The vehicle (200) is operated by a plurality of wheels (103FR, 103FL, 103RL,...) that rotate by a power source, and a steering wheel (150) for controlling the direction of travel of the vehicle (200).

[0062] Meanwhile, the vehicle (200) may further be equipped with a camera (195), etc., for acquiring an image of the front of the vehicle.

[0063] Meanwhile, the vehicle (200) may be equipped with a plurality of displays (180a, 180b) for displaying images, information, etc. inside.

[0064] In FIG. 1, a cluster display (180a) and an AVN (Audio Video Navigation) display (180b) are exemplified as multiple displays (180a, 180b). Other displays such as a HUD (Head Up Display) are also possible.

[0065] Meanwhile, the AVN (Audio Video Navigation) display (180b) may also be named the Center Information Display.

[0066] Meanwhile, the vehicle (200) described in this specification may be a concept that includes all of the following: a vehicle equipped with an engine as a power source, a hybrid vehicle equipped with an engine and an electric motor as a power source, an electric vehicle equipped with an electric motor as a power source, etc.

[0067] Meanwhile, a server (900) according to one embodiment of the present disclosure receives event data and image data related to the event data from a vehicle, and calculates a driving score related to the event data based on the event data or the image data. Accordingly, wireless data transmission between signal processing devices can be performed stably.

[0068] Various operations of the server (900) according to one embodiment of the present disclosure will be described later with reference to FIG. 6 and below.

[0069] Figure 2 is a diagram illustrating the architecture of a vehicle signal processing system inside the vehicle of Figure 1.

[0070] Referring to the drawing, the architecture (300a) of the vehicle signal processing system inside the vehicle (200) can correspond to a zone-based architecture.

[0071] Accordingly, sensor devices and processors inside the vehicle may be placed in each of the multiple zones (Z1 to Z4), and a signal processing device (170a) including a vehicle communication gateway (GWDa) may be placed in the central area of ​​the multiple zones (Z1 to Z4).

[0072] Meanwhile, the signal processing device (170a) may additionally include an autonomous driving control module (ACC), a cockpit control module (CPG), etc., in addition to the vehicle communication gateway (GWDa).

[0073] The vehicle communication gateway (GWDa) within the signal processing device (170a) may be a High Performance Computing (HPC) gateway.

[0074] That is, the signal processing device (170a) of FIG. 2 is an integrated HPC and can exchange data with an external communication module (not shown) or a processor (not shown) in a plurality of zones (Z1 to Z4).

[0075] FIG. 3a is a drawing illustrating an example of the arrangement of a vehicle display device inside a vehicle.

[0076] Referring to the drawing, the vehicle interior may be equipped with a cluster display (180a), an AVN (Audio Video Navigation) display (180b), a rear seat entertainment display (180c, 180d), a rearview mirror display (not shown), etc.

[0077] FIG. 3b is a drawing illustrating another example of the arrangement of a vehicle display device inside a vehicle.

[0078] A vehicle display device (100) according to an embodiment of the present disclosure may include a plurality of displays (180a to 180d) and a signal processing device (170) that performs signal processing for displaying images, information, etc. on the plurality of displays (180a to 180d) and outputs an image signal to at least one display (180a to 180d).

[0079] Among the plurality of displays (180a to 180d), the first display (180a) is a cluster display (180a) for displaying driving status, operation information, etc., and the second display (180b) may be an AVN (Audio Video Navigation) display (180b) for displaying vehicle operation information, navigation map, various entertainment information or video.

[0080] Meanwhile, among the multiple displays (180a to 180d), the third display (180c) may be the first RSE display, and the fourth display (180d) may be the second RSE display.

[0081] The signal processing device (170) has a processor (175) inside and can execute a first virtualization machine to a third virtualization machine (not shown) on a hypervisor (not shown) within the processor (175).

[0082] A second virtualization machine (not shown) operates for the first display (180a), and a third virtualization machine (not shown) can operate for the second display (180b).

[0083] Meanwhile, the first virtualization machine (not shown) within the processor (175) can be controlled to set up a shared memory (508) based on a hypervisor (505) for the same data transmission to the second virtualization machine (not shown) and the third virtualization machine (not shown). Accordingly, the same information or the same image can be synchronized and displayed on the first display (180a) and the second display (180b) within the vehicle.

[0084] Meanwhile, the first virtualization machine (not shown) within the processor (175) shares at least a portion of the data with the second virtualization machine (not shown) and the third virtualization machine (not shown) for data sharing processing. Accordingly, data can be shared and processed by multiple virtualization machines for multiple displays within the vehicle.

[0085] Meanwhile, the first virtualization machine (not shown) within the processor (175) can receive and process wheel speed sensor data of the vehicle and transmit the processed wheel speed sensor data to at least one of the second virtualization machine (not shown) or the third virtualization machine (not shown). Accordingly, the wheel speed sensor data of the vehicle can be shared with at least one virtualization machine, etc.

[0086] Meanwhile, a vehicle display device (100) according to an embodiment of the present disclosure may further include a first rear seat entertainment display (180c) and a second rear seat entertainment display (180d) for displaying driving status information, simple navigation information, various entertainment information or images.

[0087] The signal processing device (170) can control the first RSE display (180c) or the second RSE display (180d) by running a fourth virtualization machine (not shown) in addition to the first to third virtualization machines (not shown) on a hypervisor (not shown) within the processor (175).

[0088] Accordingly, various displays (180a to 180d) can be controlled using a single signal processing device (170).

[0089] Meanwhile, some of the multiple displays (180a to 180d) operate under a Linux OS, and others can operate under a Web OS.

[0090] A signal processing device (170) according to an embodiment of the present disclosure can control displays (180a to 180d) operating under various operating systems (OS) to synchronize and display the same information or the same image.

[0091] Meanwhile, FIG. 3b illustrates that a vehicle speed indicator (212a) and a vehicle interior temperature indicator (213a) are displayed on a first display (180a), a home screen (222) including a plurality of applications, a vehicle speed indicator (212b), and a vehicle interior temperature indicator (213b) is displayed on a second display (180b), a second home screen (222b) including a plurality of applications and a vehicle interior temperature indicator (213c) is displayed on a third display (180c), and a third home screen (222d) is displayed on a fourth display (180d).

[0092] Figure 4 is an example of an internal block diagram of the vehicle of Figure 1.

[0093] Referring to the drawings, a vehicle (200) according to an embodiment of the present disclosure may be equipped with a lamp drive unit (751), a steering drive unit (752), a brake drive unit (753), a power source drive unit (754), a suspension drive unit (756), an air conditioning drive unit (757), a window drive unit (758), a seat drive unit (761), and a signal processing device (170).

[0094] Meanwhile, the vehicle (200) may further be equipped with an ECU (770), a plurality of sensor devices (SN), and a plurality of communication modules (EMa~EMd).

[0095] Meanwhile, the vehicle (200) according to the embodiment of the present disclosure may further be equipped with a vehicle display device (100).

[0096] A vehicle display device (100) according to an embodiment of the present disclosure may include an input unit (110), a communication device (120) for communication with an external device, a plurality of communication modules (EMa~EMd) for internal communication, a memory (140), a signal processing device (170), a plurality of displays (180a~180d), an audio output unit (185), and a power supply unit (190).

[0097] Multiple communication modules (EMa~EMd) can be placed in each of the multiple zones (Z1~Z4) of FIG. 2, for example.

[0098] Meanwhile, the signal processing device (170) may have a communication switch (736b) inside for data communication with each communication module (EM1~EM4).

[0099] Each communication module (EM1~EM4) can perform data communication with a plurality of sensor devices (SN), ECU (770), or area signal processing device (170Z).

[0100] Meanwhile, a plurality of sensor devices (SN) may include a camera (195), lidar (196), radar (197), or position sensor (198).

[0101] The input unit (110) may be equipped with physical buttons, pads, etc. for button input, touch input, etc.

[0102] Meanwhile, the input unit (110) may be equipped with a microphone (not shown) for user voice input.

[0103] The communication device (120) can exchange data wirelessly with a mobile terminal (800) or a server (900).

[0104] In particular, the communication device (120) can wirelessly exchange data with the vehicle driver's mobile terminal. Various data communication methods are possible as wireless data communication methods, such as Bluetooth, WiFi, WiFi Direct, and APiX.

[0105] The communication device (120) can receive weather information, road traffic condition information, for example, TPEG (Transport Protocol Expert Group) information from a mobile terminal (800) or a server (900). To this end, the communication device (120) may be equipped with a mobile communication module (not shown).

[0106] Meanwhile, the communication device (120) can exchange data wirelessly with an adjacent vehicle.

[0107] For example, the communication device (120) can exchange vehicle messages wirelessly with an adjacent vehicle through V2X (Vehicle-to-everything) communication.

[0108] A plurality of communication modules (EM1~EM4) can receive sensor data, etc. from an ECU (770), a sensor device (SN), or a region signal processing device (170Z), and transmit the received sensor data to the signal processing device (170).

[0109] Here, the sensor data may include at least one of vehicle direction data, vehicle location data (GPS data), vehicle angle data, vehicle speed data, vehicle acceleration data, vehicle tilt data, vehicle forward / reverse data, battery data, fuel data, tire data, vehicle lamp data, vehicle interior temperature data, and vehicle interior humidity data.

[0110] Such sensor data can be obtained from a heading sensor, a yaw sensor, a gyro sensor, a position module, a vehicle forward / reverse sensor, a wheel sensor, a vehicle speed sensor, a vehicle body inclination sensor, a battery sensor, a fuel sensor, a tire sensor, a steering sensor based on steering wheel rotation, a vehicle interior temperature sensor, a vehicle interior humidity sensor, etc.

[0111] Meanwhile, the position module may include a GPS module or a position sensor (198) for receiving GPS information.

[0112] Meanwhile, at least one of the multiple communication modules (EM1 to EM4) can transmit location information data sensed from a GPS module or a location sensor (198) to a signal processing device (170).

[0113] Meanwhile, at least one of the plurality of communication modules (EM1 to EM4) can receive vehicle front image data, vehicle side image data, vehicle rear image data, and obstacle distance information around the vehicle from a camera (195), lidar (196), radar (197), etc., and transmit the received information to a signal processing device (170).

[0114] The memory (140) can store various data for the overall operation of the vehicle display device (100), such as a program for processing or controlling the signal processing device (170).

[0115] For example, memory (140) can store data regarding a hypervisor, a first virtualization machine to a third virtualization machine, for execution within a processor (175).

[0116] The audio output unit (185) converts an electrical signal from the signal processing device (170) into an audio signal and outputs it. To do this, a speaker or the like may be provided.

[0117] The power supply unit (190) can supply power necessary for the operation of each component under the control of the signal processing unit (170). In particular, the power supply unit (190) can receive power from a battery inside the vehicle, etc.

[0118] The signal processing device (170) controls the overall operation of each unit within the vehicle display device (100) or vehicle (200).

[0119] For example, the signal processing device (170) may include a processor (175) that performs signal processing for a vehicle display (180a, 180b).

[0120] The processor (175) can run a first virtualization machine to a third virtualization machine (not shown) on a hypervisor (not shown) within the processor (175).

[0121] Among the first to third virtual machines (not shown), the first virtual machine (not shown) may be named a Server Virtual Machine, and the second to third virtual machines (not shown) may be named a Guest Virtual Machine.

[0122] For example, a first virtualization machine (not shown) within a processor (175) can receive sensor data from a plurality of sensor devices, such as vehicle sensor data, location information data, camera image data, audio data, or touch input data, and process or modify it to output it.

[0123] In this way, by performing most of the data processing in the first virtualization machine (not shown), 1:N data sharing becomes possible.

[0124] As another example, the first virtualization machine (not shown) can directly receive and process CAN data, Ethernet data, audio data, radio data, USB data, and wireless communication data for the second virtualization machine to the third virtualization machine (not shown).

[0125] And, the first virtualization machine (not shown) can transmit the processed data to the second virtualization machine to the third virtualization machine (not shown).

[0126] Accordingly, among the first to third virtualization machines (not shown), only the first virtualization machine (not shown) receives sensor data, communication data, or external input data from a plurality of sensor devices and performs signal processing, thereby reducing the signal processing burden on other virtualization machines and enabling 1:N data communication, which enables synchronization when sharing data.

[0127] Meanwhile, the first virtualization machine (not shown) can control the sharing of the same data with the second virtualization machine (not shown) and the third virtualization machine (not shown) by writing data to the shared memory (508).

[0128] For example, the first virtualization machine (not shown) can record vehicle sensor data, the location information data, the camera image data, or the touch input data in a shared memory (508) and control the sharing of the same data with the second virtualization machine (not shown) and the third virtualization machine (not shown). Accordingly, data sharing in a 1:N manner becomes possible.

[0129] Ultimately, by performing most of the data processing on the first virtualization machine (not shown), 1:N data sharing becomes possible.

[0130] Meanwhile, the first virtualization machine (not shown) within the processor (175) can control the second virtualization machine (not shown) and the third virtualization machine (not shown) to set up a shared memory (508) based on the hypervisor (505) for the same data transmission.

[0131] Meanwhile, the signal processing device (170) can process various signals such as audio signals, video signals, and data signals. To this end, the signal processing device (170) can be implemented in the form of a System On Chip (SOC).

[0132] FIG. 5 is an example of a block diagram of a vehicle display device according to an embodiment of the present disclosure.

[0133] Referring to the drawings, a vehicle display device (900) according to an embodiment of the present disclosure comprises a signal processing device (170) having at least one neural processor (179) and a central processor (175) that controls the neural processor (179).

[0134] Meanwhile, the vehicle display device (900) according to the embodiment of the present disclosure may further include at least one display.

[0135] Meanwhile, the vehicle display device (900) according to the embodiment of the present disclosure may further include the steering drive unit (752), brake drive unit (753), power source drive unit (754), ECU (770), or a plurality of sensor devices (SN), etc. of FIG. 4.

[0136] Meanwhile, the vehicle display device (900) according to the embodiment of the present disclosure may further include the lamp driving unit (751), suspension driving unit (756), air conditioning driving unit (757), window driving unit (758), seat driving unit (761), or a plurality of communication modules (EMa~EMd), etc. of FIG. 4.

[0137] In the drawing, at least one display is exemplified as a cluster display (180a) and an AVN display (180b).

[0138] Meanwhile, the vehicle display device (900) may further include a plurality of area signal processing devices (170Z1 to 170Z4).

[0139] The signal processing device (170) at this time is a high-performance centralized signal processing and control device having a plurality of CPUs (175), GPUs (178), NPUs (179), etc., and can be named as a High Performance Computing (HPC) signal processing device or a central signal processing device.

[0140] Data can be exchanged between the multiple area signal processing devices (170Z1~170Z4) and the signal processing device (170) using a wireless communication method.

[0141] To this end, the signal processing device (170) may be equipped with a communication unit (172 of 6) that exchanges data wirelessly with at least one of a plurality of area signal processing devices (170Z1 to 170Z4).

[0142] Accordingly, a plurality of area signal processing devices (170Z1 to 170Z4) may be equipped with a communication unit (172Z1 to 172Z4 of 6) that exchanges data wirelessly with the signal processing device (170).

[0143] Meanwhile, multiple area signal processing devices (170Z1~170Z4) can be connected to each other by wired cables (CBa~CBd).

[0144] The wired cable (CBa~CBd) at this time may include a CAN communication cable, an Ethernet communication cable, or a PCI Express cable.

[0145] Meanwhile, the signal processing device (170) according to the embodiment of the present disclosure may further include a large-capacity storage device (925).

[0146] Meanwhile, the signal processing device (170) according to an embodiment of the present disclosure may further include a graphics processor (178).

[0147] Meanwhile, the signal processing device (170) according to an embodiment of the present disclosure may have at least one central processor (175, 178, 177).

[0148] Meanwhile, sensor data can be transmitted from at least one of the multiple area signal processing devices (170Z1 to 170Z4) to the signal processing device (170). In particular, the sensor data can be stored in a storage device (925) within the signal processing device (170).

[0149] The sensor data at this time may include at least one of camera data, lidar data, radar data, vehicle direction data, vehicle position data (GPS data), vehicle angle data, vehicle speed data, vehicle acceleration data, vehicle tilt data, vehicle forward / reverse data, battery data, fuel data, tire data, vehicle lamp data, vehicle interior temperature data, and vehicle interior humidity data.

[0150] In the drawing, camera data from a camera (195a) and lidar data from a lidar sensor (196) are input to a first area signal processing device (170Z1), and the camera data and lidar data are transmitted to a signal processing device (170) via a second area signal processing device (170Z2) and a third area signal processing device (170Z3), etc.

[0151] Meanwhile, since the data reading or writing speed to the storage device (925) is faster than the network speed when sensor data is transmitted from at least one of the multiple area signal processing devices (170Z1~170Z4) to the signal processing device (170), it is desirable to perform multipath routing so that network bottlenecks do not occur.

[0152] To this end, the signal processing device (170) according to an embodiment of the present disclosure can perform multipath routing based on a Software Defined Network (SDN). Accordingly, a stable network environment can be secured when reading or writing data of the storage device (925). Furthermore, since data can be transmitted to the storage device (925) using multiple paths, data can be transmitted by dynamically changing the network configuration.

[0153] Data communication between a plurality of area signal processing devices (170Z1~170Z4) and a signal processing device (170) within a vehicle display device (900) according to an embodiment of the present disclosure is preferably Peripheral Component Interconnect Express communication for high-bandwidth, low-latency communication.

[0154] Meanwhile, the signal processing device (170) according to an embodiment of the present disclosure can receive an internal image from an internal camera (195i) and perform signal processing on the internal image.

[0155] Meanwhile, the signal processing device (170) according to the embodiment of the present disclosure can receive a front image from a front camera (195a) and perform signal processing on the front image.

[0156] Meanwhile, the first area signal processing device (170z1) can transmit a video signal to the third display (180c), which is a network display.

[0157] Meanwhile, the second area signal processing device (170z2) can transmit a video signal to the fourth display (180d), which is a network display.

[0158] FIG. 6 is an example of an internal block diagram of a vehicle display device according to an embodiment of the present disclosure.

[0159] Referring to the drawings, a vehicle display device (100) according to an embodiment of the present disclosure comprises a central signal processing device (170) and at least one area signal processing device (170z) that exchanges data wirelessly with the central signal processing device (170).

[0160] In the drawings, a first area signal processing device (170z1) and a second area signal processing device (170z2) are illustrated as examples of at least one area signal processing device (170z).

[0161] Meanwhile, the first area signal processing device (170z1) can transmit an image signal to the third display (180c). In response, the third display (180c) can display an image based on the image signal output from the first area signal processing device (170z1).

[0162] Meanwhile, the second area signal processing device (170z2) can transmit an image signal to the fourth display (180d). In response, the fourth display (180d) can display an image based on the image signal output from the second area signal processing device (170z2).

[0163] Meanwhile, data is exchanged between the central signal processing unit (170) and the area signal processing units (170z1, 170z2) via wireless communication.

[0164] For example, the wireless communication method between the central signal processing unit (170) and the area signal processing unit (170z1, 170z2) may be a communication method based on the IEEE 802.11 communication standard. That is, the wireless communication method between the central signal processing unit (170) and the area signal processing unit (170z1, 170z2) may be a communication method based on the Wi-Fi communication standard.

[0165] A signal processing device (170) according to one embodiment of the present disclosure includes a communication unit (172) that exchanges data wirelessly with a region signal processing device (170z), and a processor (175) that determines whether there is a wireless delay based on wireless data received or transmitted from the communication unit (172), and controls the wireless mode with the region signal processing device (170z) to vary based on the determination result. Accordingly, wireless data transmission between the signal processing device (170) and the region signal processing devices (170z1, 170z2) can be performed stably.

[0166] Meanwhile, the processor (175) can control the transmission speed of wireless data of the communication unit (172) to execute a graphic transmission mode when the transmission speed is between a first reference level and a second reference level higher than the first reference level, and to execute a video transmission mode with a larger amount of data transmission than the graphic transmission mode when the transmission speed of wireless data of the communication unit (172) is above the second reference level.

[0167] Accordingly, wireless data transmission between the signal processing device (170) and the area signal processing device (170z1, 170z2) can be performed stably. In particular, by varying the wireless mode according to the wireless data transmission speed, wireless data transmission between the signal processing device (170) and the area signal processing device (170z1, 170z2) can be performed stably.

[0168] Meanwhile, the first area signal processing device (170z1) is equipped with a processor (175z1) that processes data. In particular, the processor (175z1) can process multimedia data received wirelessly from the central signal processing device (170).

[0169] The multimedia data at this time may be graphic data, video data, audio data, camera data, etc.

[0170] Meanwhile, the second area signal processing device (170z2) is equipped with a processor (175z1) that processes data. In particular, the processor (175z1) can process multimedia data received wirelessly from the central signal processing device (170).

[0171] Meanwhile, the processor (175z1) in the first area signal processing device (170z1) can execute a distributed rendering client control client.

[0172] Meanwhile, the processor (175z2) in the second area signal processing device (170z2) can execute a distributed rendering client control client.

[0173] Meanwhile, the processor (175) within the signal processing unit (170) can execute a graphics stack, resource cache control, and distributed rendering control when the graphics transmission mode is executed. Accordingly, wireless data transmission between the signal processing unit (170) and the area signal processing units (170z1, 170z2) can be performed reliably.

[0174] Meanwhile, the processor (175) within the signal processing unit (170) can execute a plurality of virtualization machines (520, 530) and, when executing the video transmission mode, execute a video framework and a distributed decoding control. Accordingly, wireless data transmission between the signal processing unit (170) and the area signal processing units (170z1, 170z2) can be performed reliably.

[0175] Meanwhile, the communication unit (172) within the signal processing unit (170) can receive or transmit wired data to the area signal processing unit (170z1, 170z2) in addition to the wireless method using a wired method.

[0176] At this time, the processor (175) within the signal processing device (170) can control the transmission of data by selecting a wireless method or a wired method based on the priority order or transmission conditions of the data to be transmitted. Accordingly, data transmission between the signal processing device (170) and the area signal processing devices (170z1, 170z2) can be performed stably.

[0177] Meanwhile, the processor (175) within the signal processing device (170) can run a display window manager (612) that manages the wireless transmission of multimedia data to the area signal processing device (170z1 or 170z2).

[0178] Meanwhile, the display window manager (612) can control the size or dimensions of a window to be displayed on a display (180c, 180d) connected to an area signal processing device (170z1 or 170z2), or manage the transmission target of the window to be displayed. Accordingly, wireless data transmission between the signal processing device (170) and the area signal processing device (170z1, 170z2) can be performed reliably.

[0179] Meanwhile, the processor (175) within the signal processing device (170) can transmit the driving path of the vehicle to an external server (900) and receive surrounding vehicle information from the server (900).

[0180] Meanwhile, the processor (175) in the signal processing device (170) receives information from the server (900) regarding the section where the transmission speed of the wireless network or wireless data decreases based on the vehicle's driving information, and can control the wireless mode to vary or the frequency channel within the wireless mode to vary based on the information.

[0181] Accordingly, wireless data transmission between the signal processing device (170) and the area signal processing device (170z1, 170z2) can be performed stably. In particular, based on the driving information of the vehicle, the wireless mode can be varied according to the wireless network environment around the vehicle, thereby enabling stable wireless data transmission between the signal processing device (170) and the area signal processing device (170z1, 170z2).

[0182] Meanwhile, the processor (175) within the signal processing unit (170) can control the wireless mode with the area signal processing unit (170z1 or 170z2) to vary based on wireless network information around the vehicle. Accordingly, wireless data transmission between the signal processing unit (170) and the area signal processing unit (170z1, 170z2) can be performed stably.

[0183] Meanwhile, the processor (175) within the signal processing device (170) can be controlled to compress frame data and transmit the compressed frame data when the wireless mode is the first mode, and to transmit command data and resource ID information for rendering when the wireless mode is the second mode. Accordingly, wireless data transmission between the signal processing device (170) and the area signal processing devices (170z1, 170z2) can be performed reliably.

[0184] Meanwhile, the processor (175) within the signal processing device (170) can control the compression of frame data and the transmission of the compressed frame data when transmitting a home screen or a navigation screen. Accordingly, wireless data transmission between the signal processing device (170) and the area signal processing devices (170z1, 170z2) can be performed reliably.

[0185] Meanwhile, the processor (175) within the signal processing device (170) can control the transmission of rendering data and command data when transmitting the game screen. Accordingly, stable wireless data transmission between the signal processing device (170) and the area signal processing devices (170z1, 170z2) can be performed.

[0186] Meanwhile, the processor (175) within the signal processing device (170) can be controlled to transmit rendering data and command data when the wireless mode is the first mode, and to transmit cache information when the wireless mode is the second mode. Accordingly, wireless data transmission between the signal processing device (170) and the area signal processing devices (170z1, 170z2) can be performed reliably.

[0187] Meanwhile, the processor (175) within the signal processing device (170) can control the transmission of decoded stream data when the wireless mode is the first mode during stream data transmission, and transmit encoded stream data when the wireless mode is the second mode. Accordingly, stable wireless data transmission between the signal processing device (170) and the area signal processing devices (170z1, 170z2) can be performed.

[0188] FIGS. 7 to 18 are drawings referenced in the description of FIG. 6.

[0189] Figure 7 illustrates a wireless network environment around a vehicle.

[0190] Referring to the drawing, the first vehicle (200a) is equipped with an access point device for wireless communication, and can support wireless communication within the wireless communication area of ​​the first area (Ara) by means of the access point device.

[0191] Meanwhile, the second vehicle (200b) is equipped with an access point device for wireless communication and can support wireless communication within the wireless communication area of ​​the second area (Arb) by means of the access point device.

[0192] Meanwhile, the third vehicle (200c) is equipped with an access point device for wireless communication and can support wireless communication within the wireless communication area of ​​the third area (Arc) by means of the access point device.

[0193] As shown in the drawing, the overlapping area where the wireless communication areas provided by multiple vehicles (200a, 200b, 200c) overlap may increase due to traffic congestion, etc.

[0194] That is, as traffic congestion worsens, the overlapping area where the wireless communication areas provided by multiple vehicles (200a, 200b, 200c) overlap may increase.

[0195] Meanwhile, although not shown in the drawing, access point devices, etc. placed in buildings, etc., around multiple vehicles (200a, 200b, 200c) provide a wireless communication area, and such wireless communication area may overlap with the wireless communication areas (Ara, Arb, Arc) provided by the multiple vehicles (200a, 200b, 200c).

[0196] At this time, as traffic congestion worsens, the overlapping area between the wireless communication area provided by buildings, etc., around multiple vehicles (200a, 200b, 200c) and the wireless communication area (Ara, Arb, Arc) provided by multiple vehicles (200a, 200b, 200c) may increase.

[0197] Accordingly, in the present disclosure, in order to stably perform wireless data transmission between a signal processing device (170) and a region signal processing device (170z1, 170z2), the signal processing device (170) determines whether there is a wireless delay based on wireless data received or transmitted wirelessly, and based on the result of the determination, controls the wireless mode with the region signal processing device (170z1 or 170z2) to vary.

[0198] Accordingly, wireless data transmission between the signal processing device (170) and the area signal processing device (170z1, 170z2) can be performed reliably.

[0199] For example, meanwhile, the signal processing device (170) can control the transmission speed of wireless data of the communication unit (172) to execute a graphic transmission mode when the transmission speed is between a first reference level and a second reference level higher than the first reference level, and to execute a video transmission mode with a larger amount of data transmission than the graphic transmission mode when the transmission speed of wireless data of the communication unit (172) is above the second reference level. Accordingly, wireless data transmission between the signal processing device (170) and the area signal processing device (170z1, 170z2) can be performed stably.

[0200] Meanwhile, the processor (175) within the signal processing device (170) can receive wireless channel information of another vehicle approaching the vehicle (100) in advance when the vehicle (100) is driving, and control the frequency channel to be changed to a wireless channel different from the wireless channel of the vehicle before wireless interference occurs. Accordingly, interference during wireless communication can be minimized.

[0201] Meanwhile, the processor (175) within the signal processing device (170) can be controlled to operate on an optimal wireless channel based on information or data received in advance before driving, when the occurrence of inevitable interference due to the vehicle (100) is predicted. Accordingly, wireless data transmission between the signal processing device (170) and the area signal processing devices (170z1, 170z2) can be performed stably.

[0202] Figure 8 is a diagram illustrating the transmission of information between a server and multiple vehicles.

[0203] Referring to the drawing, the server (900) may be equipped with a processor (975) and a communication unit (not shown).

[0204] A processor (975) in the server (900) can receive information from a plurality of vehicles (200, 200mA, 200mb, 200mc, 200md) through a communication unit (not shown).

[0205] For example, a processor (975) within a server (900) can receive current location information (Psi), driving destination information, driving path information, radio frequency channel information (CHi), etc. of a plurality of vehicles (200, 200mA, 200mb, 200mc, 200md).

[0206] Meanwhile, the processor (975) in the server (900) can perform vehicle network traffic processing (812) based on various information of multiple vehicles (200, 200mA, 200mb, 200mc, 200md).

[0207] Meanwhile, the processor (975) in the server (900) can transmit information about sections where the transmission speed of a wireless network or wireless data on a vehicle driving path decreases to each vehicle (200, 200mA, 200mb, 200mc, 200md) based on various information of a plurality of vehicles (200, 200mA, 200mb, 200mc, 200md).

[0208] For example, a processor (975) within a server (900) can transmit information (NTa) about a section where the transmission speed of a wireless network or wireless data on a vehicle driving path decreases, based on information of a plurality of vehicles (200mA, 200mb, 200mc, 200md).

[0209] Meanwhile, the signal processing device (170) in the vehicle (200) can transmit the vehicle's driving path information (NTa) to an external server (900) through a communication device (120) including a mobile communication module.

[0210] Meanwhile, a signal processing device (170) in a vehicle (200) can receive information (NTa) about a section where the transmission speed of a wireless network or wireless data on a vehicle driving path decreases, through a communication device (120) including a mobile communication module.

[0211] And, the processor (175) in the signal processing device (170) can control the wireless mode or the frequency channel within the wireless mode based on information (NTa) about the section where the transmission speed of the received wireless network or wireless data is reduced.

[0212] For example, a processor (175) within a signal processing device (170) can control the wireless mode or the frequency channel within the wireless mode based on information (NTa) about the section where the transmission speed of the received wireless network or wireless data decreases and information (CHi) about the wireless frequency channel.

[0213] As another example, the processor (175) in the signal processing device (170) can change the wireless data transmission method based on information (NTa) about the section where the transmission speed of the received wireless network or wireless data is reduced.

[0214] Specifically, the processor (175) in the signal processing device (170) can execute a graphics transmission mode based on information (NTa) about the section where the transmission speed of the received wireless network or wireless data decreases while executing a video transmission mode.

[0215] Accordingly, wireless data transmission between the signal processing device (170) and the area signal processing device (170z1, 170z2) can be performed stably. In particular, by varying the wireless mode according to the wireless data transmission speed, wireless data transmission between the signal processing device (170) and the area signal processing device (170z1, 170z2) can be performed stably.

[0216] FIGS. 9a and 9b illustrate an example of the operation of a vehicle display device related to the present disclosure.

[0217] First, FIG. 9a is an example of an internal block diagram of a vehicle display device (1000x) related to the present disclosure.

[0218] Referring to the drawings, a vehicle display device (1000x) related to the present disclosure may have a central signal processing device (170) having a graphics processor (178) and a region signal processing device (170z) having a graphics processor (178z).

[0219] The central signal processing unit (170) can run a hypervisor (505) and run a plurality of virtualization machines (520x, 530x) on the hypervisor (505).

[0220] Among the plurality of virtualization machines (520x, 530x), the first virtualization machine (520x) can execute an OS kernel (521), a graphics stack (523), a display data sender (529) for transmitting display data to an area signal processing device (170z), an application (528), etc.

[0221] The second virtualization machine (530x) can execute an OS kernel (531), a graphics stack (533), a display data sender (539) for transmitting display data to a region signal processing unit (170z), an application (538), etc.

[0222] The area signal processing unit (170z) executes the area controller (580x), and the area controller (580x) can execute the OS kernel (581), the graphics stack (583), the display data receiver (586) for receiving display data from the central signal processing unit (170), etc.

[0223] The area signal processing device (170z) can process the display data received from the display data receiver (586) and output a video signal to the third display (180c), etc.

[0224] Figure 9b is a drawing referenced in the description of Figure 9a.

[0225] Referring to the drawing, the first virtualization machine (520x) in the central signal processing unit (170) renders display data into a frame buffer (S910).

[0226] Next, the first virtualization machine (520x) in the central signal processing unit (170) compresses the display data stored in the frame buffer for transmission to the area signal processing unit (170z) (S920).

[0227] Next, the first virtual machine (520x) in the central signal processing unit (170) controls the transmission of compressed display data to the area signal processing unit (170z) via a wireless network (S920).

[0228] Next, the area controller (580x) within the area signal processing unit (170z) receives compressed display data via a wireless network (S925).

[0229] Next, the area controller (580x) in the area signal processing device (170z) decodes the compressed display data (S930).

[0230] Next, the area controller (580x) in the area signal processing device (170z) outputs the decoded display data (S925).

[0231] Between steps 910 to 925 (S910~S925), a transmission delay occurs due to compression, decoding, and wireless transmission of display data.

[0232] FIGS. 9c to 9d illustrate other examples of the operation of a vehicle display device related to the present disclosure.

[0233] First, FIG. 9c is another example of an internal block diagram of a vehicle display device (1000y) related to the present disclosure.

[0234] Referring to the drawings, a vehicle display device (1000y) related to the present disclosure may have a central signal processing device (170) having a video decoder (176) and a region signal processing device (170z) having a video decoder (176z).

[0235] The central signal processing unit (170) can run a hypervisor (505) and run a plurality of virtualization machines (520y, 530y) on the hypervisor (505).

[0236] Among the plurality of virtualization machines (520y, 530y), the first virtualization machine (520y) can execute an OS kernel (521), a video framework (522), a display data sender (529) for transmitting display data to a region signal processing device (170z), an application (528), etc.

[0237] The second virtualization machine (530y) can run an OS kernel (531), a video framework (532), a display data sender (539) for transmitting display data to a region signal processing device (170z), an application (538), etc.

[0238] The area signal processing unit (170z) executes the area controller (580y), and the area controller (580y) can execute the OS kernel (581), the graphics stack (583), the display data receiver (586) for receiving display data from the central signal processing unit (170), etc.

[0239] The area signal processing device (170z) can process the display data received from the display data receiver (586) and output a video signal to the third display (180c), etc.

[0240] Figure 9d is a drawing referenced in the description of Figure 9c.

[0241] Referring to the drawing, the first virtualization machine (520y) in the central signal processing unit (170) decodes the received stream data and outputs the stream data (S955).

[0242] Next, the first virtualization machine (520y) in the central signal processing unit (170) compresses the stream data stored in the frame buffer for transmission to the area signal processing unit (170z) (S960).

[0243] Next, the first virtualization machine (520y) in the central signal processing unit (170) controls the transmission of compressed stream data to the area signal processing unit (170z) via a wireless network (S965).

[0244] Next, the area controller (580y) in the area signal processing device (170z) receives compressed stream data via a wireless network (S970).

[0245] Next, the area controller (580y) in the area signal processing device (170z) decodes the compressed stream data (S975).

[0246] Next, the area controller (580y) in the area signal processing device (170z) outputs the decoded stream data (S980).

[0247] Between steps 955 to 980 (S955~S980), transmission delay occurs due to compression, decoding, and wireless transmission of stream data.

[0248] As shown in FIGS. 9a to 9d, since compression and decoding are performed for the transmission of display data and stream data, a significant delay occurs.

[0249] Accordingly, the present disclosure proposes a method for stably transmitting data without transmission delay. This is described with reference to FIG. 10 and below.

[0250] FIGS. 10 and 11 illustrate an example of the operation of a vehicle display device according to an embodiment of the present disclosure.

[0251] First, FIG. 10 is an example of an internal block diagram of a vehicle display device according to an embodiment of the present disclosure.

[0252] Referring to the drawings, a vehicle display device (1000) according to an embodiment of the present disclosure may have a central signal processing device (170) having a graphics processor (178) and a region signal processing device (170z) having a graphics processor (178z).

[0253] Meanwhile, the central signal processing unit (170) may further include a storage unit (925).

[0254] Meanwhile, the area signal processing device (170z) may further include a storage device (925z).

[0255] A processor (175) within a central signal processing unit (170) can run a hypervisor (505) and run a plurality of virtualization machines (520, 530) on the hypervisor (505).

[0256] Among the plurality of virtualization machines (520, 530), the first virtualization machine (520) can execute an OS kernel (521), a graphics stack (523), a resource cache control (534), a distributed rendering control (525) for data transmission to a region signal processing device (170z), a virtual graphics backend (527), etc.

[0257] In particular, the processor (175) within the signal processing unit (170) executes a plurality of virtualization machines (520, 530), and when executing the graphics transmission mode, the graphics stack (523), resource cache control (534), and distributed rendering control (534) can be executed only in the first virtualization machine (520) among the plurality of virtualization machines (520, 530). Accordingly, wireless data transmission between the signal processing unit (170) and the area signal processing unit (170z) can be performed reliably.

[0258] The second virtualization machine (530) can run an OS kernel (531), a virtual front-end driver (534), an application (538), etc.

[0259] The area signal processing unit (170z) executes the area controller (580), and the area controller (580) can execute the OS kernel (581), the graphics stack (583), the resource cache control (585), the distributed rendering control (587) for receiving data from the central signal processing unit (170), etc.

[0260] The area signal processing device (170z) can process the data received from the distributed rendering control (587) and output a video signal to the third display (180c), etc.

[0261] Figure 11 is a drawing referenced in the description of Figure 10.

[0262] Referring to the drawing, the first virtualization machine (520) in the central signal processing unit (170) controls the transmission of command data for rendering resources wirelessly (S1110).

[0263] Next, the area controller (580) in the area signal processing device (170z) checks the received rendering resource (S1115).

[0264] Next, the area controller (580) within the area signal processing device (170z) acquires a resource stored in the storage device (925z) (S1120) and renders the resource based on the acquired resource (S1125).

[0265] Next, the area controller (580) within the area signal processing device (170z) renders the frame buffer based on the rendered resources (S1130).

[0266] Next, the area controller (580) in the area signal processing device (170z) outputs display data in the frame buffer (S1135).

[0267] Between steps 1110 to 1135 (S1110 to S1135), compression, decoding, etc. are omitted by transmitting command data rather than display data, so wireless transmission delay is significantly reduced, unlike in FIGS. 9a to 9b. Accordingly, wireless data transmission between the signal processing device (170) and the area signal processing device (170z) can be performed stably.

[0268] FIG. 12 is another example of an internal block diagram of a vehicle display device according to an embodiment of the present disclosure.

[0269] Referring to the drawings, a vehicle display device (1000b) according to an embodiment of the present disclosure may include a central signal processing device (170) having a video decoder (176) and a region signal processing device (170z) having a video decoder (176z).

[0270] Meanwhile, the central signal processing unit (170) may further include a storage unit (925).

[0271] Meanwhile, the area signal processing device (170z) may further include a storage device (925z).

[0272] A processor (175) within a central signal processing unit (170) can run a hypervisor (505) and run a plurality of virtualization machines (520, 530) on the hypervisor (505).

[0273] Among the plurality of virtualization machines (520, 530), the first virtualization machine (520) can execute an OS kernel (521), a video framework (522), a distributed decoding control (526) for data transmission to a region signal processing device (170z), a virtual video backend (528), etc.

[0274] In particular, the processor (175) within the signal processing device (170) executes a plurality of virtualization machines (520, 530), and when executing the video transmission mode, the video framework (522) and distributed decoding control (526) can be executed only in the first virtualization machine (520) among the plurality of virtualization machines (520, 530). Accordingly, wireless data transmission between the signal processing device (170) and the area signal processing device (170z) can be performed reliably.

[0275] The second virtualization machine (530) can run an OS kernel (531), a virtual front-end driver (533), an application (538), etc.

[0276] The area signal processing unit (170z) executes the area controller (580), and the area controller (580) can execute the OS kernel (581), the graphics stack (586), the resource cache control (585), the distributed decoding control (588) for receiving data from the central signal processing unit (170), etc.

[0277] The area signal processing device (170z) can process the data received from the distributed decoding control (588) and output a video signal to the third display (180c), etc.

[0278] Figure 13 is a drawing referenced in the description of Figure 12.

[0279] Referring to the drawing, the first virtualization machine (520) in the central signal processing unit (170) receives encoded stream data (S1310).

[0280] Next, the first virtualization machine (520) in the central signal processing unit (170) controls the stream data to be transmitted over a wireless network (S1315).

[0281] Next, the area controller (580) within the area signal processing unit (170z) decodes stream data received via a wireless network (S1320).

[0282] Next, the area controller (580) in the area signal processing unit (170z) renders the frame buffer based on the decoded stream data (S1325).

[0283] Next, the area controller (580) in the area signal processing device (170z) outputs stream data in the frame buffer (S1330).

[0284] Between steps 1310 to 1330 (S1310 to S1330), when transmitting stream data, the compressed stream data is transmitted wirelessly as is without decoding, so unlike FIGS. 9c to 9d, the wireless transmission delay is reduced. Accordingly, wireless data transmission between the signal processing device (170) and the area signal processing device (170z) can be performed stably.

[0285] FIG. 14 is a drawing referenced in the description of the first virtualization machine, etc. of FIG. 10.

[0286] Referring to the drawing, the first virtualization machine (520) can run an OS kernel (521), a graphics stack (1469), a distributed rendering control server (1430) for transmitting data to a region signal processing unit (170z), a system resource load balancer (1452), and a display window manager (1454).

[0287] Meanwhile, the display window manager (1454) can control the size or dimensions of a window to be displayed on a display (180c or 180d) connected to the area signal processing device (170z), or manage the transmission target of the window to be displayed.

[0288] Meanwhile, the signal processing device (170) further includes a graphics processor (178), and among the plurality of virtualization machines (520, 530), the first virtualization machine (520) can execute a graphics device driver (1462) for the graphics processor (178).

[0289] In particular, the OS kernel (521) in the first virtualization machine (520) can execute a graphics device driver (1462) for a graphics processor (178).

[0290] Meanwhile, the OS kernel (521) in the first virtualization machine (520) can further execute a backend virtual interface (1463) for interfacing with a virtual interface (1481) in the hypervisor (505).

[0291] Meanwhile, the OS kernel (521) in the first virtualization machine (520) can further execute a file system (1464) for resource exchange with the distributed rendering control server (1430).

[0292] Meanwhile, the distributed rendering control server (1430) can execute a context management control (1431) for context management, a resource cache control (1432) for resource cache control, a renderer (1437) for rendering, a virtual display (1435) within the context, a resource (1434) within the context, etc.

[0293] Meanwhile, the distributed rendering control server (1430) can control the transmission of a rendering command (1457) or a resource (1459) wirelessly to the area signal processing device (170z) for a network display (180c or 180d) connected to the area signal processing device (170z).

[0294] The second virtualization machine (530) can run an OS kernel (531), a graphics stack (533), an HMI application (538a), etc.

[0295] Meanwhile, the OS kernel (531) in the second virtualization machine (530) can execute a virtual graphics processor front-end driver (1483) for interfacing with a virtual interface (1481) in the hypervisor (505).

[0296] Meanwhile, the signal processing device (170) corresponds to the distributed rendering control server (1430) within, and the area signal processing device (170z) can execute the distributed rendering control client (1410).

[0297] A processor (175z) within a region signal processing unit (170z) runs a region controller (580) or a virtualization machine, and the region controller (580) or the virtualization machine can run a distributed rendering control client (1410).

[0298] Meanwhile, the area controller (580) or virtualization machine within the area signal processing device (170z) can further execute an OS kernel (581) and a graphics stack (583).

[0299] Meanwhile, the area controller (580) or the OS kernel (581) within the virtualization machine can run a file system (1402) for exchanging resources (1403) with the distributed rendering control client (1410).

[0300] Meanwhile, the distributed rendering control client (1410) can execute a context management control (1413) for context management, a resource cache control (1411) for resource cache control, a renderer (1412) for rendering, a virtual display (1416) in the first context (1415), a resource (1417) in the first context (1415), a virtual display (1420) in the second context (1418), a frame buffer (1421) in the second context (1418), etc.

[0301] FIG. 15 is a drawing referenced in the description of the first virtualization machine, etc. of FIG. 12.

[0302] Referring to the drawing, the first virtualization machine (520) can run an OS kernel (521), a video framework (522), a decoding control server (1470) for data transmission to a region signal processing unit (170z), and a virtual video backend (1467).

[0303] Meanwhile, the signal processing device (170) further includes a video decoder (176), and among the plurality of virtualization machines (520, 530), the first virtualization machine (520) can execute a video decoder driver (1472) for the video decoder (176).

[0304] In particular, the OS kernel (521) in the first virtualization machine (520) can execute a video decoder driver (1472) for the video decoder (176).

[0305] Meanwhile, the OS kernel (521) in the first virtualization machine (520) can further execute a backend virtual interface (1465) for interfacing with a virtual interface (1481) in the hypervisor (505).

[0306] Meanwhile, the backend virtual interface (1465) can exchange data with the video decoder (1475) in the decoding control server (1470) through the virtual video backend (1467).

[0307] Meanwhile, the decoding control server (1470) can execute a context management control (1471) for context management, a video decoder (1475), a decoded frame (1477) within the context (1473m1478), resources (1474), etc.

[0308] Meanwhile, the decoding control server (1470) can control the transmission of an encoded stream (1487) or a decoded frame (1489) wirelessly to the area signal processing device (170z) for a network display (180c or 180d) connected to the area signal processing device (170z).

[0309] The second virtualization machine (530) can run an OS kernel (531), a graphics stack (533), an HMI application (538a), etc.

[0310] Meanwhile, the OS kernel (531) in the second virtualization machine (530) can execute a virtual graphics processor front-end driver (1483) for interfacing with a virtual interface (1481) in the hypervisor (505).

[0311] Meanwhile, the signal processing device (170) corresponds to the decoding control server (1470) within, and the area signal processing device (170z) can execute the decoding control server (1410v).

[0312] A processor (175z) within a region signal processing device (170z) runs a region controller (580) or a virtualization machine, and the region controller (580) or the virtualization machine can run a decoding control server (1410v).

[0313] Meanwhile, the area controller (580) or virtualization machine within the area signal processing device (170z) can further execute an OS kernel (581) and a video stack (1406).

[0314] Meanwhile, the decoding control server (1410v) in the area signal processing device (170z) can execute a context management control (1413) for context management, a resource cache control (1411) for resource cache control, a renderer (1412) for rendering, a video decoder (1414), an encoded stream (1423) in the first context (1415), an encoded stream (1424) in the second context (1418), etc.

[0315] FIG. 16 is a drawing referenced in the description of the operation of the display window manager (1454) of FIG. 14.

[0316] Referring to the drawing, the display window manager (1454) can execute a plurality of window handles (1491, 1493, 1494) and window property controls (1492).

[0317] The first window handle (1491) in the display window manager (1454) can receive size or size information of a window to be displayed on a display (180c or 180d) connected to the area signal processing device (170z) from the window handle (1498) in the distributed rendering control client (1410).

[0318] Meanwhile, the first window handle (1491) in the display window manager (1454) can transmit the size or size information of the received window to the window attribute control (1492).

[0319] Meanwhile, the window characteristic control (1492) can set the window of the image to be transmitted based on the size or size information of the received window.

[0320] For example, the window characteristic control (1492) can set multiple windows of an image to be transmitted based on the size or size information of the received window, and transmit the multiple window setting information to the second window handle (1493) and the third window handle (1494), respectively.

[0321] Meanwhile, the second window handle (1493) and the third window handle (1494) can each transmit display window information created based on configuration information to the first display window (1496) and the second display window (1497) within the distributed rendering control server (1430).

[0322] FIG. 17a is a drawing referenced in the description of the operation of the distributed rendering control server (1430) of FIG. 14.

[0323] Referring to the drawing, the distributed rendering control server (1430) can perform data processing in response to resource allocation requests and usage requests, such as those for a graphics processor, received from a virtualization machine (520 or 530).

[0324] To this end, the distributed rendering control server (1430) can execute a context management control (1431) for context management, a resource cache control (1432) for resource cache control, a renderer (1437) for rendering, a virtual display (1715) in the first context (1711), a resource (1713) in the first context (1711), a virtual display (1735) in the second context (1721), a frame butter (1723) in the second context (1721), etc.

[0325] Meanwhile, the renderer (1437) can transmit rendered graphic data to the graphics stack (1437).

[0326] Meanwhile, the distributed rendering control server (1430) can determine whether to transmit resources (1459) for display output depending on the position of the output display.

[0327] Meanwhile, the distributed rendering control server (1430) can create contexts (1711, 1721) according to individual rendering contexts and manage resources based thereon.

[0328] Meanwhile, the distributed rendering control server (1430) can control the transmission of resources (1459) and rendering commands (1457) as needed for displays processed by individual area signal processing devices (170z).

[0329] Meanwhile, the distributed rendering control server (1430) can store rendering resources in the file system (1464) when necessary through the resource cache control (1432).

[0330] FIG. 17b is a drawing referenced in the description of the operation of the distributed rendering control client (1410) of FIG. 14.

[0331] Referring to the drawing, the distributed rendering control client (1410) can manage the rendering context (1711, 1721) in the area signal processing unit (170z) or perform display processing.

[0332] Meanwhile, the distributed rendering control client (1410) can receive resources (1459) and commands (1457) wirelessly from the distributed rendering control server (1430) and render them.

[0333] To this end, the distributed rendering control client (1410) can execute a context management control (1413) for context management, a resource cache control (1411) for resource cache control, a renderer (1412) for rendering, a virtual display (1416) in the first context (1415), a resource (1417) in the first context (1415), a virtual display (1420) in the second context (1418), a frame buffer (1421) in the second context (1418), etc.

[0334] Meanwhile, the distributed rendering control client (1410) can store and use the resource (1459) associated with the context when necessary.

[0335] Meanwhile, the distributed rendering control client (1410) can store rendering resources in the file system (1402) when necessary through the resource cache control (1411).

[0336] Meanwhile, the renderer (1412) can transmit rendered graphic data to the graphics stack (583).

[0337] FIG. 17c is a diagram referenced in the description of the operation of the resource cache control of FIG. 14.

[0338] Referring to the drawing, the distributed rendering control server (1430) and the distributed rendering control client (1410) each execute resource cache control (1432, 1411).

[0339] Below, the operation of the distributed rendering control client (1410) is explained with reference to the resource cache control (1411).

[0340] Meanwhile, the resource cache control (1411) can control the storage of rendering resources in a storage device (925z) or file system (1402) upon internal request.

[0341] Meanwhile, the resource cache control (1411) can control the reading of resources and rendering and displaying them via the storage device (925z) or file system (1402) without retransmitting the resources when changing the transmission mode or wireless mode using the stored resources.

[0342] Meanwhile, the resource cache control (1411) can control the unique values ​​of the resource rendering context and generated resource data (1743, 1744, 1745) to be stored together as metadata (1743). By doing so, each resource (1743, 1744, 1745) can be distinguished.

[0343] To this end, the resource cache control (1411) can execute a database (1741) that exchanges data with the context management control (1413).

[0344] FIG. 18 is a drawing referenced in the description of the operation of the system resource load balancer (1452) of FIG. 14.

[0345] Referring to the drawing, the system resource load balancer (1452) can receive surrounding vehicle information or wireless network information around the vehicle from the server (900).

[0346] Meanwhile, the system resource load balancer (1452) determines whether load balancing of system resources is necessary based on surrounding vehicle information or wireless network information around the vehicle from the server (900), and if necessary, can request this from other internal components.

[0347] For example, the system resource load balancer (1452) can determine whether there is a wireless delay based on surrounding vehicle information or wireless network information around the vehicle from the server (900), and based on the result of the determination, control the wireless mode with the area signal processing device (170z1 or 170z2) to vary.

[0348] As another example, the system resource load balancer (1452) can control the transmission speed of wireless data to run a graphic transmission mode when the transmission speed of wireless data is between a first reference level and a second reference level higher than the first reference level, and to run a video transmission mode with a larger amount of data transmission than the graphic transmission mode when the transmission speed of wireless data of the communication unit (172) is above the second reference level.

[0349] As another example, the system resource load balancer (1452) receives surrounding vehicle information from the server (900), receives information from the server (900) about the section where the transmission speed of the wireless network or wireless data is reduced based on the vehicle's driving information, and can control the wireless mode to vary or the frequency channel within the wireless mode to vary based on the information.

[0350] Accordingly, wireless data transmission between the signal processing device (170) and the area signal processing device (170z) can be performed reliably. In particular, based on the driving information of the vehicle, the wireless mode can be varied according to the wireless network environment around the vehicle, thereby enabling reliably performing wireless data transmission between the signal processing device (170) and the area signal processing device (170z).

[0351] Meanwhile, the system resource load balancer (1452) can change the transmission mode or wireless mode to the area signal processing device (170z) according to the system load balance policy.

[0352] Although preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above. Various modifications are possible by those skilled in the art without departing from the essence of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical spirit or perspective of the present disclosure.

Claims

1. In a signal processing device within a vehicle, A communication unit that exchanges data wirelessly with a region signal processing unit; A signal processing device comprising: a processor that determines whether there is a wireless delay based on wireless data received or transmitted from the communication unit, and controls the wireless mode with the area signal processing device to vary based on the determination result.

2. In Paragraph 1, The above processor is, When the transmission speed of the wireless data of the above communication unit is between a first reference level and a second reference level higher than the first reference level, a graphic transmission mode is executed, and A signal processing device that controls the execution of a video transmission mode with a larger amount of data transmission than a graphic transmission mode when the transmission speed of the wireless data of the above communication unit is above the second reference level.

3. In Paragraph 2, The above processor is, Running multiple virtualization machines, A signal processing device that, when executing the above-mentioned graphics transmission mode, executes a graphics stack, resource cache control, and distributed rendering control only on the first virtualization machine among the plurality of virtualization machines.

4. In Paragraph 2, The above processor is, Running multiple virtualization machines, A signal processing device that, when executing the above video transmission mode, executes a video framework and distributed decoding control only on the first virtual machine among the plurality of virtual machines.

5. In Paragraph 1, The above communication unit is, Receive or transmit the above wireless data wirelessly, A signal processing device that receives or transmits wired data in a wired manner.

6. In Paragraph 5, The above processor is, A signal processing device that controls the transmission of data by selecting the wireless method or the wired method based on the priority order or transmission conditions of the data to be transmitted.

7. In Paragraph 1, The above processor is, A signal processing device that executes a display window manager for managing the transmission of multimedia data wirelessly to the above-mentioned area signal processing device.

8. In Paragraph 7, The above display window manager is, A signal processing device that controls the size or dimensions of a window to be displayed on a display connected to the above-mentioned area signal processing device, or manages the transmission target of the window to be displayed.

9. In Paragraph 1, The above processor is, Transmits the driving path of the above vehicle to an external server, receives surrounding vehicle information from the server, and A signal processing device that receives information from a server regarding a section where the transmission speed of a wireless network or the wireless data decreases based on driving information of the vehicle, and controls the wireless mode to vary or the frequency channel within the wireless mode to vary based on the information.

10. In Paragraph 1, The above processor is, A signal processing device that controls the wireless mode with the area signal processing device to vary based on wireless network information around the vehicle.

11. In Paragraph 1, The above processor is, When the above wireless mode is the first mode, frame data is compressed, and the compressed frame data is transmitted, and A signal processing device that controls the transmission of command data and resource ID information for rendering when the above wireless mode is a second mode.

12. In Paragraph 1, The above processor is, A signal processing device that compresses frame data and controls the transmission of compressed frame data when transmitting a home screen or navigation screen.

13. In Paragraph 1, The above processor is, When the above wireless mode is the first mode, rendering data and command data are transmitted, and A signal processing device that controls the transmission of cache information when the above wireless mode is a second mode.

14. In Paragraph 1, The above processor is, When transmitting stream data, When the above wireless mode is the first mode, decoded stream data is transmitted, and A signal processing device that controls the transmission of encoded stream data when the above wireless mode is a second mode.

15. In Paragraph 1, Includes additional graphics processors, The above processor is, Running multiple virtualization machines, The first virtual machine among the plurality of virtualization machines is a signal processing device that executes a graphics device driver for the graphics processor.

16. In Paragraph 1, It further includes a video decoder, The above processor is, Running multiple virtualization machines, A signal processing device in which the first virtual machine among the plurality of virtualization machines above executes a video decoder driver for the video decoder.

17. Central signal processing unit; Area signal processing device that exchanges data wirelessly with the above central signal processing device; A display that displays an image based on an image signal output from the area signal processing device; The above central signal processing device is a vehicle display device comprising a signal processing device according to any one of claims 1 to 16.

18. In Paragraph 17, The above-mentioned area signal processing device is, Includes a processor, The processor within the above-mentioned area signal processing device, A vehicle display device that runs a distributed rendering client control client.

Images