Signal processing apparatus and vehicle display apparatus including same

Abstract

A signal processing apparatus according to an embodiment of the present disclosure includes a processor that controls at least one display connected to a network port, in which the processor performs control so as to transmit graphic image related data or image data to the display. Therefore, an image can be stably displayed on the network display.

Description

Technical Field

[0001] The present disclosure relates to a signal processing device and a vehicle display device having the same, and in particular to a signal processing device capable of stably displaying images on a network display and a vehicle display device having the same. Background Art

[0002] A vehicle is a machine that allows a user to move in a desired direction. A typical example of a vehicle is a car.

[0003] In addition, for the convenience of a user who uses a vehicle, a signal processing device for a vehicle is installed in the vehicle.

[0004] Furthermore, the number of displays placed inside the vehicle is increasing in consideration of passengers inside the vehicle.

[0005] Furthermore, there is an increasing trend towards installing additional displays in the vehicle interior.

[0006] When the number of displays placed inside a vehicle increases or an additional display is installed, the signal processing load of the signal processing device increases, and further, when an image signal is transmitted based on SerDes, there are disadvantages such as unstable image signal transmission. Summary of the invention

[0007] Technical issues

[0008] An object of the present disclosure is to provide a signal processing device capable of stably displaying an image on a network display and a vehicle display apparatus having the signal processing device.

[0009] Another object of the present invention is to provide a signal processing device capable of stably displaying an image when a display is added, and a vehicle display apparatus having the signal processing device.

[0010] Means of solving the problem

[0011] According to one aspect of the present disclosure, the above and other purposes can be achieved by providing a signal processing device and a vehicle display device having the signal processing device, wherein the signal processing device includes a processor configured to control at least one display connected to a network port, wherein the processor is configured to transmit graphic image related data or image data to the display.

[0012] The processor may be configured to transmit the graphics image related data to the display in response to enabling transmission of the graphics image related data, and to transmit the image data to the display in response to not being able to transmit the graphics image related data.

[0013] The processor may include: a gateway manager configured to perform network management on the display connected to a network; and a window manager configured to manage settings of an image displayed on the display.

[0014] The processor may be configured to transmit the graphic image related data or the image data to the display via Ethernet communication.

[0015] The processor may be configured to execute a plurality of virtual machines on a virtual machine monitor, wherein a first virtual machine of the plurality of virtual machines may be configured to transmit the graphic image related data or the image data to the display.

[0016] The first virtual machine may be configured to execute a gateway manager configured to perform network management on the display connected to the network and a window manager configured to manage settings of an image displayed on the display.

[0017] The first virtual machine may be configured to transmit the graphic image related data or the image data to the plurality of displays in response to the plurality of displays being connected to the network.

[0018] The first virtual machine may be configured to output the second image data to a dashboard display connected to a display port.

[0019] A second virtual machine among the plurality of virtual machines may be configured to transmit image source data to the first virtual machine, and the first virtual machine may be configured to transmit the graphic image related data or the image data based on the image source data to the display.

[0020] The first virtual machine may be configured to receive information about a second display additionally connected to the network, and transmit the graphic image related data or the image data to the second display.

[0021] In response to the display and the second display having different resolutions, the first virtual machine may be configured to make the size or resolution of the graphic image-related data or the image data transmitted to the display and the second display different.

[0022] The graphic image related data may include graphic variable data and drawing command data.

[0023] The transmitted graphic variable data may include address information data indicated by pointer data in a memory of the signal processing device.

[0024] The first virtual machine may be configured to synchronize a memory corresponding to the processor and a memory corresponding to the display in response to the graphics variable data including pointer data.

[0025] The first virtual machine may be configured to transmit differential data of previous data and current data stored in the memory corresponding to the processor to the memory corresponding to the display.

[0026] In response to a first address region indicated by first pointer data in a memory at least partially overlapping with a second address region indicated by second pointer data in a previously synchronized memory during memory synchronization, the first virtual machine may be configured to generate third pointer data corresponding to a third address region including the overlapping region, the first address region, and the second address region, and to transmit graphics image-related data including the generated third pointer data.

[0027] The first virtual machine may be configured to transmit graphic image related data or image data to the display connected to the local signal processing device.

[0028] According to another embodiment of the present disclosure, a signal processing device and a vehicle display device having the signal processing device include a processor, which is configured to control at least one display connected to a network port, wherein the processor is configured to transmit graphic image related data or image data to the display, and output second image data to a dashboard display connected to the display port.

[0029] Effects of the present disclosure

[0030] A signal processing device and a vehicle display device having the signal processing device according to an embodiment of the present disclosure include a processor configured to control at least one display connected to a network port, wherein the processor is configured to transmit graphic image related data or image data to the display. Therefore, an image can be stably displayed on the network display.

[0031] The processor may be configured to transmit the graphic image related data to the display in response to being able to transmit the graphic image related data, and transmit the image data to the display in response to being unable to transmit the graphic image related data. Therefore, the image can be stably displayed on the network display.

[0032] The processor may include: a gateway manager configured to perform network management on the display connected to the network; and a window manager configured to manage settings of an image displayed on the display. Therefore, an image can be stably displayed on the network display.

[0033] The processor may be configured to transmit the graphic image related data or the image data to the display via Ethernet communication. Therefore, the image can be stably displayed on the network display.

[0034] The processor may be configured to execute multiple virtual machines on a virtual machine monitor, wherein a first virtual machine among the multiple virtual machines may be configured to transmit the graphic image related data or the image data to the display. Therefore, an image may be stably displayed on the network display.

[0035] The first virtual machine may be configured to execute a gateway manager and a window manager, wherein the gateway manager is configured to perform network management on the display connected to the network, and the window manager is configured to manage settings of an image displayed on the display. Therefore, an image can be stably displayed on the network display.

[0036] The first virtual machine may be configured to transmit the graphic image related data or the image data to the multiple displays in response to the multiple displays being connected to the network. Therefore, the image can be stably displayed on the network display. In particular, when a display is added, the image can be stably displayed.

[0037] The first virtual machine may be configured to output the second image data to the dashboard display connected to the display port. Therefore, the image may be stably displayed on the dashboard display connected to the display port.

[0038] The second virtual machine among the plurality of virtual machines may be configured to transmit the image source data to the first virtual machine, and the first virtual machine may be configured to transmit the graphic image related data or the image data based on the image source data to the display. Therefore, the image can be stably displayed on the network display.

[0039] The first virtual machine may be configured to receive information about a second display additionally connected to the network, and transmit the graphic image related data or the image data to the second display. Therefore, when a display is added, the image can also be stably displayed.

[0040] In response to the display and the second display having different resolutions, the first virtual machine can be configured to make the size or resolution of the graphic image related data or the image data transmitted to the display and the second display different. Therefore, the image can be stably displayed on the network display.

[0041] The graphic image related data may include graphic variable data and drawing command data. Therefore, the image can be stably displayed on the network display.

[0042] The transmitted graphic variable data may include address information data indicated by pointer data in the memory of the signal processing device. Therefore, images can be stably displayed on the network display.

[0043] The first virtual machine may be configured to synchronize a memory corresponding to the processor and a memory corresponding to the display in response to the graphic variable data including the pointer data. Therefore, an image may be stably displayed on the network display.

[0044] The first virtual machine may be configured to transfer differential data between previous data and current data stored in the memory corresponding to the processor to the memory corresponding to the display. Therefore, an image may be stably displayed on the network display.

[0045] In response to a first address region indicated by first pointer data in a memory at least partially overlapping with a second address region indicated by second pointer data in a previously synchronized memory during memory synchronization, the first virtual machine may be configured to generate third pointer data corresponding to a third address region including the overlapping region, the first address region, and the second address region, and transmit graphic image related data including the generated third pointer data. Thus, an image may be stably displayed on a network display.

[0046] The first virtual machine may be configured to transmit the graphic image related data or the image data to the display connected to the regional signal processing device. Therefore, the image can be stably displayed on the network display.

[0047] A signal processing device and a vehicle display device having the signal processing device according to another embodiment of the present disclosure include a processor configured to control at least one display connected to a network port, wherein the processor is configured to transmit graphic image related data or image data to the display, and output second image data to a dashboard display connected to the display port. Therefore, images can be stably displayed on the network display and the dashboard display connected to the display port, respectively. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] Figure 1 are diagrams showing examples of the exterior and interior of a vehicle;

[0049] Figure 2 to Figure 2 c is a diagram showing various architectures of a vehicle communication gateway;

[0050] Figure 3a is a diagram showing an example of a vehicle display device in a vehicle;

[0051] Figure 3b is a diagram showing another example of a vehicle display device in a vehicle;

[0052] Figure 4 It is shown Figure 3b An internal block diagram of an example of a vehicle display device;

[0053] Figure 5a to Figure 5d are diagrams illustrating various examples of vehicle display devices;

[0054] Figure 6 is a block diagram showing an example of a vehicle display device according to one embodiment of the present disclosure;

[0055] Figure 7a and Figure 7b is a diagram mentioned in the description of the signal processing device related to the present disclosure;

[0056] Figure 8a An example of a signal processing device according to an embodiment of the present disclosure is shown;

[0057] Figure 8b Another example of a signal processing device according to an embodiment of the present disclosure is shown;

[0058] Fig. 9 is a block diagram of another example of a vehicle display device according to an embodiment of the present disclosure;

[0059] Figures 10a to 11 is Fig. 9 Figures mentioned in the description;

[0060] Fig.12 is a flowchart showing an operating method of a vehicle display device according to one embodiment of the present disclosure;

[0061] Figures 13a to 16e is Fig. 9 or Fig.12 the diagrams mentioned in the description of the operations in;

[0062] Fig.17 is a block diagram showing an example of a data transmission device and a data receiving device for transmitting graphic image related data according to an embodiment of the present disclosure;

[0063] Fig.18a is a flowchart illustrating an operation method of a data transmission device according to an embodiment of the present disclosure; and

[0064] Figures 18b to 20d Is a description Fig.18a FIG. 1 is a diagram of various examples of operating methods of a data transmission device. DETAILED DESCRIPTION

[0065] The present disclosure will be described in detail below with reference to the accompanying drawings.

[0066] Regarding constituent elements used in the following description, the suffixes "module" and "unit" are given only in consideration of the ease of specification preparation, and do not have or serve different meanings. Therefore, the suffixes "module" and "unit" may be used interchangeably.

[0067] Figure 1 are diagrams showing examples of the exterior and interior of a vehicle.

[0068] , the vehicle 200 is moved by a plurality of wheels 103FR, 103FL, 103RL, . . . rotated by a power source and a steering wheel 150 configured to adjust a forward direction of the vehicle 200 .

[0069] In addition, the vehicle 200 may be provided with a camera 195 configured to acquire an image in front of the vehicle.

[0070] Furthermore, a plurality of displays 180 a and 180 b configured to display images and information may also be provided in the vehicle 200 .

[0071] exist Figure 1 In FIG. 1 , a dashboard display 180 a and an audio video navigation (AVN) display 180 b are shown as multiple displays 180 a and 180 b. In addition, a head-up display (HUD) may also be used.

[0072] Furthermore, the audio video navigation (AVN) display 180b may also be referred to as a center information display.

[0073] Furthermore, the vehicle 200 described in this specification may be a concept that includes all vehicles using an engine as a power source, a hybrid vehicle using an engine and an electric motor as power sources, and an electric vehicle using an electric motor as a power source.

[0074] Figure 2 to Figure 2 c is a diagram showing various architectures of a vehicle communication gateway.

[0075] first, Figure 2 is a diagram illustrating a first architecture of a vehicle communication gateway.

[0076] refer to Figure 2 , the first architecture 300a may correspond to a region-based architecture.

[0077] Therefore, the vehicle interior sensor device and the processor may be installed in each of the plurality of zones Z1 to Z4, and the signal processing device 170a including the vehicle communication gateway GWDa may be disposed at the center of the plurality of zones Z1 to Z4.

[0078] In addition, in addition to the vehicle communication gateway GWDa, the signal processing device 170a may also include an autonomous driving control module ACC, a cockpit control module CPG, and the like.

[0079] The vehicle communication gateway GWDa in the signal processing device 170a may be a high performance computing (HPC) gateway.

[0080] That is, as an integrated HPC gateway, Figure 2 The signal processing device 170a may exchange data with an external communication module (not shown) or a processor (not shown) in a plurality of zones Z1 to Z4.

[0081] Figure 3a is a diagram showing an example of a vehicle display device in a vehicle.

[0082] Referring to the drawings, an instrument panel display 180a, an audio video navigation (AVN) display 180b, rear seat entertainment displays 180c and 180d, and a rearview mirror display (not shown) may be installed in a vehicle.

[0083] Figure 3b is a diagram showing another example of a vehicle display device in a vehicle.

[0084] According to one embodiment of the present disclosure, a vehicle display device 100 may include multiple displays 180a and 180b and a signal processing device 170, which is configured to perform signal processing to display images and information on the multiple displays 180a and 180b, and output image signals to at least one of the displays 180a and 180b.

[0085] The first display 180a, as one of the multiple displays 180a and 180b, may be a dashboard display 180a configured to display driving status and operation information, and the second display 180b may be an audio video navigation (AVN) display 180b configured to display vehicle driving information, a navigation map, various entertainment information or images.

[0086] The signal processing device 170 may have a processor 175 provided therein, and first to third virtual machines (not shown) may be executed by a hypervisor 505 in the processor 175 .

[0087] A second virtual machine (not shown) may be operated for the first display 180 a , and a third virtual machine (not shown) may be operated for the second display 180 b .

[0088] In addition, the first virtual machine (not shown) in the processor 175 can be configured to set a shared memory 508 based on the virtual machine monitor 505 for transmitting the same data to the second virtual machine (not shown) and the third virtual machine (not shown). Therefore, the first display 180a and the second display 180b in the vehicle can display the same information or the same image in a synchronized state.

[0089] In addition, the first virtual machine (not shown) in the processor 175 shares at least some data with the second virtual machine (not shown) and the third virtual machine (not shown) for data segmentation processing. Therefore, multiple virtual machines for multiple displays in the vehicle can segment and process data.

[0090] In addition, the first virtual machine (not shown) in the processor 175 can receive and process the wheel speed sensor data of the vehicle, and can transmit the processed wheel speed sensor data to at least one of the second virtual machine (not shown) or the third virtual machine (not shown). Therefore, at least one virtual machine can share the wheel speed sensor data of the vehicle.

[0091] In addition, the vehicle display device 100 according to one embodiment of the present disclosure may further include a rear seat entertainment (RSE) display 180c configured to display driving status information, simple navigation information, various entertainment information or images.

[0092] In addition to the first to third virtual machines (not shown), the signal processing device 170 may further execute a fourth virtual machine (not shown) on the virtual machine monitor 505 in the processor 175 to control the RSE display 180 c .

[0093] Therefore, a single signal processing device 170 may be used to control the various displays 180 a to 180 c .

[0094] Furthermore, some of the plurality of displays 180a to 180c may operate based on a Linux operating system (OS), while other displays may operate based on a Web operating system (OS).

[0095] The signal processing device 170 according to one embodiment of the present disclosure may be configured to display the same information or the same image in a synchronized state on the displays 180 a to 180 c to operate under various operating systems.

[0096] also, Figure 3b An example is shown in which a vehicle speed indicator 212a and a vehicle interior temperature indicator 213a are displayed on a first display 180a, a main screen 222 including a plurality of applications, a vehicle speed indicator 212b, and a vehicle interior temperature indicator 213b is displayed on a second display 180b, and a second main screen 222b including a plurality of applications and a vehicle interior temperature indicator 213c is displayed on a third display 180c.

[0097] Figure 4 It is shown Figure 3b An internal block diagram of an example of a vehicle display device.

[0098] Reference Figure 4 According to an embodiment of the present disclosure, a vehicle display device 100 may include an input device 110, a transceiver 120 for communicating with an external device, a plurality of communication modules EMa to EMd for internal communication, a memory 140, a signal processing device 170, a plurality of displays 180a to 180c, an audio output device 185, and a power supply 190.

[0099] exist Figure 2 In the embodiment, a plurality of communication modules EMa to EMd may be respectively disposed in a plurality of zones Z1 to Z4.

[0100] In addition, the signal processing device 170 may be provided with a communication switch 736 b for performing data communication with each of the communication modules EM1 to EM4 .

[0101] Each of the communication modules EM1 to EM4 can perform data communication with a plurality of sensor devices SN or the ECU 770 .

[0102] In addition, the plurality of sensor devices SN may include a camera 195 , a lidar sensor 196 , a radar sensor 197 , or a position sensor 198 .

[0103] The input device 110 may include a physical button or a pad for button input or touch input.

[0104] Furthermore, the input device 110 may include a microphone (not shown) for user voice input.

[0105] The transceiver 120 may wirelessly exchange data with the mobile terminal 800 or the server 900 .

[0106] Specifically, the transceiver 120 may wirelessly exchange data with a mobile terminal of a vehicle driver. Any of various data communication schemes such as Bluetooth, Wi-Fi, WIFI Direct, and APIX may be used as a wireless data communication scheme.

[0107] The transceiver 120 may receive weather information and road traffic status information, such as Transport Protocol Experts Group (TPEG) information, from the mobile terminal 800 or the server 900. To this end, the transceiver 120 may include a mobile communication module (not shown).

[0108] The plurality of communication modules EM1 to EM4 may receive sensor data or the like from an electronic control unit (ECU) 770 or a sensor device SN or a regional signal processing device 170Z, and may transmit the received sensor data to the signal processing device 170 .

[0109] Here, the sensor data may include at least one of vehicle direction data, vehicle position data (Global Positioning System (GPS) data), vehicle angle data, vehicle speed data, vehicle acceleration data, vehicle inclination data, vehicle forward / backward movement data, battery data, fuel data, tire data, vehicle light data, vehicle interior temperature data, or vehicle interior humidity data.

[0110] The sensor data may be obtained from a heading sensor, a yaw sensor, a gyroscope sensor, a position sensor, a vehicle forward / backward movement sensor, a wheel sensor, a vehicle speed sensor, a vehicle body inclination sensor, a battery sensor, a fuel sensor, a tire sensor, a steering sensor based on steering wheel rotation, a vehicle interior temperature sensor, or a vehicle interior humidity sensor.

[0111] Additionally, the location module may include a GPS module or location sensor 198 configured to receive GPS information.

[0112] Furthermore, at least one of the plurality of communication modules EM1 to EM4 may transmit location information data sensed by the GPS module or the location sensor 198 to the signal processing device 170 .

[0113] In addition, at least one of the multiple communication modules EM1 to EM4 can receive the vehicle's front image data, vehicle side image data, vehicle rear image data and vehicle surrounding obstacle distance information from a camera 195, a lidar sensor 196 or a radar sensor 197, and can transmit the received information to the signal processing device 170.

[0114] The memory 140 may store various data required for the overall operation of the vehicle display apparatus 100 , such as a program for processing or control of the signal processing device 170 .

[0115] For example, the memory 140 may store data regarding a virtual machine monitor and first to third virtual machines executed by the virtual machine monitor in the processor 175 .

[0116] The audio output device 185 may convert the electric signal from the signal processing device 170 into an audio signal and may output the audio signal. To this end, the audio output device 185 may include a speaker.

[0117] The power supply 190 may supply power required for operating components under the control of the signal processing device 170. In particular, the power supply 190 may receive power from a battery in the vehicle.

[0118] The signal processing device 170 may control the overall operation of each device in the vehicle display apparatus 100 .

[0119] For example, the signal processing device 170 may include a processor 175 configured to perform signal processing on the vehicle displays 180a and 180b.

[0120] The processor 175 may execute first to third virtual machines (not shown) on the virtual machine monitor 505 in the processor 175 .

[0121] Among the first to third virtual machines (not shown), the first virtual machine (not shown) may be referred to as a server virtual machine, and the second virtual machine (not shown) and the third virtual machine (not shown) may be referred to as client virtual machines.

[0122] For example, a first virtual machine (not shown) in processor 175 may receive sensor data, such as vehicle sensor data, location information data, camera image data, audio data, or touch input data, from a plurality of sensor devices, and may process and output the received sensor data.

[0123] As described above, the first virtual machine (not shown) can process most of the data, thereby achieving 1:N data sharing.

[0124] In another example, the first virtual machine (not shown) may directly receive and process CAN data, Ethernet data, audio data, radio data, USB data, and wireless communication data for the second virtual machine and the third virtual machine (not shown).

[0125] In addition, the first virtual machine (not shown) may transmit the processed data to the second virtual machine and the third virtual machine (not shown).

[0126] Therefore, among the first virtual machine to the third virtual machine (not shown), only the first virtual machine (not shown) can receive sensor data, communication data or external input data from multiple sensor devices, and can perform signal processing, thereby reducing the load on signal processing of other virtual machines, and realizing 1:N data communication, and thus synchronization when sharing data can be achieved.

[0127] Furthermore, the first virtual machine (not shown) may be configured to write data in the shared memory 508, whereby the second virtual machine (not shown) and the third virtual machine (not shown) share the same data.

[0128] For example, the first virtual machine (not shown) can be configured to write vehicle sensor data, location information data, camera image data, or touch input data into the shared memory 508, so that the second virtual machine (not shown) and the third virtual machine (not shown) share the same data. Therefore, 1:N data sharing can be achieved.

[0129] Finally, the first virtual machine (not shown) can process most of the data, thereby achieving 1:N data sharing.

[0130] Furthermore, the first virtual machine (not shown) in the processor 175 may be configured to set the shared memory 508 based on the virtual machine monitor 505 so as to transfer the same data to the second virtual machine (not shown) and the third virtual machine (not shown).

[0131] In addition, the signal processing device 170 may process various signals such as an audio signal, an image signal, and a data signal. To this end, the signal processing device 170 may be implemented in the form of a system on chip (SOC).

[0132] also, Figure 4 The signal processing device 170 in the display device 100 can be connected with Figure 5a The signal processing devices 170 , 170 a 1 and 170 a 2 of the vehicle display devices in the subsequent figures are the same.

[0133] Figure 5a to Figure 5d are diagrams showing various examples of vehicle display devices.

[0134] Figure 5a is a diagram showing an example of a vehicle display device according to one embodiment of the present disclosure.

[0135] Reference Figure 5a , a vehicle display apparatus 800 a according to one embodiment of the present disclosure includes signal processing devices 170 a 1 and 170 a 2 and a plurality of regional signal processing devices 170 Z1 to 170 Z4 .

[0136] Furthermore, the figure shows two signal processing devices 170a1 and 170a2 which are provided for backup or the like, and one signal processing device is also possible.

[0137] Furthermore, the signal processing devices 170a1 and 170a2 may be referred to as high performance computing (HPC) signal processing devices.

[0138] The plurality of zone signal processing devices 170Z1 to 170Z4 may be located in the corresponding zones Z1 to Z4 and may transmit the sensor data to the signal processing devices 170a1 and 170a2.

[0139] The signal processing devices 170a1 and 170a2 may receive data from the plurality of regional signal processing devices 170Z1 to 170Z4 or the communication device 120 through wires.

[0140] In the accompanying drawings, an example is shown in which the signal processing devices 170a1 and 170a2 exchange data with multiple regional signal processing devices 170Z1 to 170Z4 based on wired communication, and the signal processing devices 170a1 and 170a2 exchange data with the server 400 based on wireless communication, but the communication device 120 can exchange data with the server 400 based on wireless communication, and the signal processing devices 170a1 and 170a2 can exchange data with the communication device 120 based on wired communication.

[0141] In addition, the data received by the signal processing devices 170a1 and 170a2 may include camera data or sensor data.

[0142] For example, the vehicle internal sensor data may include at least one of vehicle wheel speed data, vehicle direction data, vehicle position data (Global Positioning System (GPS) data), vehicle angle data, vehicle speed data, vehicle acceleration data, vehicle inclination data, vehicle forward / backward movement data, battery data, fuel data, tire data, vehicle light data, vehicle internal temperature data, vehicle internal humidity data, external vehicle radar data, or external vehicle lidar data.

[0143] Additionally, the camera data may include external vehicle camera data and internal vehicle camera data.

[0144] In addition, the signal processing devices 170a1 and 170a2 may execute a plurality of virtual machines 820, 830, and 840 based on security levels.

[0145] In the accompanying drawings, an example is shown in which the processor 175 in the signal processing device 170a is configured to execute a hypervisor 505, and is configured to execute a first virtual machine 820 to a third virtual machine 840 on the hypervisor 505 according to an automotive safety integrity level (ASIL).

[0146] The first virtual machine 820 may be a virtual machine corresponding to quality management (QM), which is the lowest risk level without mandatory ASIL.

[0147] The first virtual machine 820 may execute an operating system 822 , a container runtime 824 on the operating system 822 , and containers 827 and 829 on the container runtime 824 .

[0148] The second virtual machine 820 may be a virtual machine corresponding to ASIL A or ASIL B, where the combination of severity, exposure, and controllability values ​​is 7 or 8.

[0149] The second virtual machine 820 may execute an operating system 832 , a container runtime 834 on the operating system 832 , and containers 837 and 839 on the container runtime 834 .

[0150] The third virtual machine 840 may be a virtual machine corresponding to ASIL C or ASIL D, where the combination of severity, exposure, and controllability values ​​is 9 or 10.

[0151] Furthermore, ASIL D may correspond to a level requiring the highest level of safety.

[0152] The third virtual machine 840 may execute an operating system 842 and execute an application 845 on the secure operating system 842 .

[0153] In addition, the third virtual machine 840 can also execute the secure operating system 842, the container runtime 844 on the secure operating system 842, and the container 847 on the container runtime 844.

[0154] In addition, unlike the figure, the third virtual machine 840 can also be executed by a separate core instead of being executed by the processor 175, which will be referred to below. Figure 5b Give a description.

[0155] Figure 5b is a diagram showing another example of a vehicle display device according to one embodiment of the present disclosure.

[0156] Reference Figure 5b , a vehicle display apparatus 800 b according to one embodiment of the present disclosure includes signal processing devices 170 a 1 and 170 a 2 and a plurality of regional signal processing devices 170 Z1 to 170 Z4 .

[0157] Figure 5b The vehicle display device 800b is similar to Figure 5a The vehicle display device 800a is different in that Figure 5b The signal processing device 170a1 is partially different from Figure 5a signal processing device 170a1.

[0158] The following description will focus on the differences, wherein the signal processing device 170 a may include a processor 175 and a second processor 177 .

[0159] The processor 175 in the signal processing device 170 a 1 is configured to execute the virtual machine monitor 505 , and execute the first virtual machine 820 and the second virtual machine 830 on the virtual machine monitor 505 according to the ASIL.

[0160] The first virtual machine 820 may execute an operating system 822 , a container runtime 824 on the operating system 822 , and containers 827 and 829 on the container runtime 824 .

[0161] The second virtual machine 820 may execute an operating system 832 , a container runtime 834 on the operating system 832 , and containers 837 and 839 on the container runtime 834 .

[0162] In addition, the second processor 177 in the signal processing device 170 a 1 may execute the third virtual machine 840 .

[0163] The third virtual machine 840 can execute the secure operating system 842, the AUTOSAR 845 on the operating system 842, and the application 845 on the AUTOSAR 845. Figure 5a Differently, the third virtual machine 840 can also execute AUTOSAR 846 on the operating system 842 .

[0164] In addition, similar to Figure 5a , the third virtual machine 840 can also execute a secure operating system 842, a container runtime 844 on the secure operating system 842, and a container 847 on the container runtime 844.

[0165] Furthermore, unlike the first virtual machine 820 and the second virtual machine 830, the third virtual machine 840 requiring a high security level is ideally executed by the second processor 177 which is a different core or a different processor.

[0166] In addition, Figure 5a and Figure 5bOf the signal processing devices 170a1 and 170a2, if there is an abnormality in the first signal processing device 170a, the second signal processing device 170a may operate, which is provided for backup purposes.

[0167] Different from this example, the signal processing devices 170a1 and 170a2 may be operated simultaneously, wherein the first signal processing device 170a may be operated as a master device, and the second signal processing device 170a2 may be operated as a slave device, which will be referred to below. Figure 5c and 5d Give a description.

[0168] Figure 5c is a diagram showing still another example of the vehicle display device according to one embodiment of the present disclosure.

[0169] Reference Figure 5c , a vehicle display apparatus 800 c according to one embodiment of the present disclosure includes signal processing devices 170 a 1 and 170 a 2 and a plurality of regional signal processing devices 170 Z1 to 170 Z4 .

[0170] Furthermore, the figure shows two signal processing devices 170a1 and 170a2 which are provided for backup or the like, and one signal processing device is also possible.

[0171] Furthermore, the signal processing devices 170a1 and 170a2 may be referred to as high performance computing (HPC) signal processing devices.

[0172] The plurality of zone signal processing devices 170Z1 to 170Z4 may be located in the corresponding zones Z1 to Z4 and may transmit the sensor data to the signal processing devices 170a1 and 170a2.

[0173] The signal processing devices 170a1 and 170a2 may receive data from the plurality of regional signal processing devices 170Z1 to 170Z4 or the communication device 120 through wires.

[0174] In the accompanying drawings, an example is shown in which the signal processing devices 170a1 and 170a2 exchange data with multiple regional signal processing devices 170Z1 to 170Z4 based on wired communication, and the signal processing devices 170a1 and 170a2 exchange data with the server 400 based on wireless communication, but the communication device 120 can exchange data with the server 400 based on wireless communication, and the signal processing devices 170a1 and 170a2 exchange data with the communication device 120 based on wired communication.

[0175] In addition, the data received by the signal processing devices 170a1 and 170a2 may include camera data or sensor data.

[0176] Furthermore, the processor 175 in the first signal processing device 170 a 1 of the signal processing devices 170 a 1 and 170 a 2 may execute the virtual machine monitor 505 , and may execute each of the secure virtual machine 860 and the non-secure virtual machine 870 on the virtual machine monitor 505 .

[0177] In addition, the processor 175 b in the second signal processing device 170 a 2 of the signal processing devices 170 a 1 and 170 a 2 may execute the virtual machine monitor 505 b , and may execute only the secure virtual machine 880 on the virtual machine monitor 505 .

[0178] In this method, the secure virtual machine and the non-secure virtual machine may be processed by the first signal processing device 170a1 and the second signal processing device 170a2, respectively, thereby improving stability and processing speed.

[0179] In addition, high-speed network communication can be performed between the first signal processing device 170a1 and the second signal processing device 170a2.

[0180] Figure 5d is a diagram showing still another example of the vehicle display device according to one embodiment of the present disclosure.

[0181] Reference Figure 5d , a vehicle display apparatus 800d according to one embodiment of the present disclosure includes signal processing devices 170a1 and 170a2 and a plurality of regional signal processing devices 170Z1 to 170Z4.

[0182] Figure 5d The vehicle display device 800d is similar to Figure 5c The vehicle display device 800c is different in that Figure 5d The second signal processing device 170a2 is partially different from Figure 5c The second signal processing device 170a2.

[0183] Figure 5d The processor 175 b in the second signal processing device 170 a 2 may execute the virtual machine monitor 505 b , and may execute each of the secure virtual machine 880 and the non-secure virtual machine 890 on the virtual machine monitor 505 .

[0184] That is to say, Figure 5c The difference is that the processor 175b in the second signal processing device 170a2 is also configured to execute the non-secure virtual machine 890.

[0185] In this method, the secure virtual machine and the non-secure virtual machine may be processed by the first signal processing device 170a1 and the second signal processing device 170a2, respectively, thereby improving stability and processing speed.

[0186] Figure 6 is an exemplary block diagram of a vehicle display device according to an embodiment of the present disclosure.

[0187] Reference Figure 6 , a vehicle display apparatus 900 according to an embodiment of the present disclosure includes a signal processing device 170 and at least one display.

[0188] In the drawing, as the at least one display, a dashboard display 180a, an AVN display 180b, and network displays 180c and 180d are shown.

[0189] Additionally, a dashboard display 180a and an AVN display 180b may be connected to the display ports.

[0190] In addition, the network displays 180c and 180d can be connected to the vehicle network through the network port. Here, the network can be an Ethernet network based on Ethernet communication.

[0191] Although the network displays 180 c and 180 d are connected to the third and fourth zone signal processing devices 170Z3 and 170Z4 in the drawing, they may be connected to other zone signal processing devices or directly connected to the signal processing device 170 .

[0192] In addition, the vehicle display apparatus 900 may further include a plurality of regional signal processing devices 170Z1 to 170Z4.

[0193] In this case, the signal processing device 170 is a high-performance centralized signal processing and control device including multiple CPUs 175, GPUs 178, NPUs 179, etc., and can be called a high-performance computing (HPC) signal processing device or a central signal processing device.

[0194] The plurality of zone signal processing devices 170Z1 to 170Z4 and the signal processing device 170 may be connected via wired cables CB1 to CB4.

[0195] Furthermore, the plurality of zone signal processing devices 170Z1 to 170Z4 may be connected via wired cables CBa to CBd.

[0196] In this case, the wired cables CBa to CBd may include a CAN communication cable or an Ethernet communication cable or a PCI Express cable.

[0197] In addition, the signal processing device 170 according to one embodiment of the present disclosure may include at least one processor 175 , a processor 178 , and a processor 177 , and a storage device 925 having a large capacity.

[0198] For example, the signal processing device 170 according to one embodiment of the present disclosure may include central processors 175 and 177 , a graphics processor 178 , and a neural processor 179 .

[0199] In addition, the sensor data may be transmitted from at least one of the plurality of regional signal processing devices 170Z1 to 170Z4 to the signal processing device 170. Specifically, the sensor data may be stored in the storage device 925 in the signal processing device 170.

[0200] In this case, the sensor data may include at least one of camera data, lidar data, radar data, vehicle direction data, vehicle position data (Global Positioning System (GPS) data), vehicle angle data, vehicle speed data, vehicle acceleration data, vehicle inclination data, vehicle forward / backward movement data, battery data, fuel data, tire data, vehicle light data, vehicle interior temperature data, or vehicle interior humidity data.

[0201] In the figure, an example is shown in which camera data from camera 195a and lidar data from lidar sensor 196 are input to the first area signal processing device 170Z1, and the camera data and lidar data are transmitted to the signal processing device 170 via the second area signal processing device 170Z2 and the third area signal processing device 170Z3, etc.

[0202] In addition, when sensor data is transmitted from at least one of the multiple regional signal processing devices 170Z1 to 170Z4 to the signal processing device 170, the data writing speed or the data reading speed of writing data to and reading data from the storage device 925 is faster than the network speed, so that multipath routing is preferably performed to avoid bottlenecks in the network.

[0203] To this end, the signal processing device 170 according to an embodiment of the present disclosure can perform multipath routing based on a software defined network (SDN). Therefore, a stable network environment for data writing and reading operations can be ensured. In addition, data can be transmitted to the storage device 925 by using multiple paths, so that data can be transmitted by dynamically changing the network configuration.

[0204] It is desirable that data communication between the plurality of zone signal processing devices 170Z1 to 170Z4 and the signal processing device 170 in the vehicle display apparatus 900 according to one embodiment of the present disclosure is PCI Express communication in order to provide high-frequency band and low-latency communication.

[0205] Figure 7a and Figure 7b It is a diagram mentioned in the description of the signal processing device related to the present disclosure.

[0206] Figure 7a A display device including a signal processing apparatus related to the present disclosure is shown.

[0207] Referring to the drawings, a signal processing device 170 x related to the present disclosure may be configured to execute or include an ADAS processor ACC and a cockpit processor CPG.

[0208] To this end, the signal processing device 170x receives camera data from the plurality of cameras 195a to 195d and 195f through SerDes communication VBb.

[0209] The signal processing device 170x receives camera data from some cameras 195e and sensor data from the lidar 197 or radar 196 via Ethernet communication VBa.

[0210] The signal processing device 170 x is configured to transmit the image signal to the plurality of displays 180 a to 180 c and 180 m through SerDes communication VBb.

[0211] Figure 7b It is shown Figure 8a Diagram of SerDes communication.

[0212] Referring to the drawings, the signal processing device 170 x in the first circuit board BDx may be configured to transmit the serial-converted signal to the second circuit board BDy via the connector 672 through the SerDes communication module 671 .

[0213] The SerDes communication module 674 in the second circuit board BDy can convert the input serial signal into a parallel signal, and transmit the converted signal to the display 184X via a communication method such as I2C.

[0214] In the case of SerDes communication, as the number of displays increases or the resolution increases, bandwidth and the like are limited, and thus it is difficult to transmit relative image signals.

[0215] Furthermore, SerDes communication has the problem of difficulty in transmitting image signals to an attached display.

[0216] Therefore, the present disclosure proposes a method for transmitting an image signal to a display via Ethernet communication in addition to SerDes communication. Figure 8a Describe this.

[0217] Figure 8a An example of a signal processing device according to an embodiment of the present disclosure is shown.

[0218] Referring to the figure, the signal processing device 170 in the vehicle display apparatus 800a according to one embodiment of the present disclosure may be configured to execute or include an ADAS processor ACC that receives camera data and performs signal processing and a cockpit processor CPG that outputs an image signal.

[0219] To this end, the signal processing device 170 includes a processor 175 that receives camera data and performs signal processing or outputs an image signal.

[0220] For example, an ADAS processor ACC or a cockpit processor CPG that outputs an image signal may be executed within the processor 175 .

[0221] In addition, the signal processing device 170 receives camera data from the plurality of cameras 195a to 195e through Ethernet communication VBa.

[0222] For example, the signal processing device 170 may be configured to receive camera data from some cameras 195a to 195c of the plurality of cameras 195a to 195e via the first regional signal processing device 170Z1 through Ethernet communication VBa.

[0223] The signal processing device 170 may be configured to receive camera data from other cameras 195d and 195e among the plurality of cameras 195a to 195e via the second regional signal processing device 170Z2 through Ethernet communication VBa.

[0224] The signal processing device 170 may be configured to receive camera data from a camera 195f via SerDes communication VBb.

[0225] The signal processing device 170 may be configured to receive sensor data from the lidar 197 or the radar 196 via the second regional signal processing device 170Z2 through Ethernet communication VBa.

[0226] The signal processing device 170 is configured to transmit the image signal to the plurality of displays 180 a to 180 c through SerDes communication VBb.

[0227] The signal processing device 170 is configured to transmit the image signal to the display 180m connected to the network port through the Ethernet communication VBa.

[0228] At this time, the processor 175 in the signal processing device 170 controls the transmission of graphic image related data or video data to the display 180m in consideration of the Ethernet communication network state.

[0229] For example, the processor 175 may be configured to transmit the graphic image related data when the graphic image related data can be transmitted to the display 180m, and transmit the video data when the graphic image related data cannot be transmitted to the display 180m. Therefore, the image can be stably displayed on the network display 180m.

[0230] As another example, the processor 175 may be configured to transmit image data to the display 180m when video data can be transmitted, and transmit graphic image related data to the display 180m when video data cannot be transmitted. Therefore, an image can be stably displayed on the network display 180m.

[0231] Figure 8b Another example of a signal processing device according to an embodiment of the present disclosure is shown.

[0232] Referring to the figure, the signal processing device 170 in the vehicle display apparatus 800b according to one embodiment of the present disclosure may execute or include an ADAS processor ACC that receives camera data and performs signal processing and a cockpit processor CPG that outputs an image signal.

[0233] For example, the processor 175 in the signal processing device 170 may execute an ADAS processor ACC or a cockpit processor CPG that outputs an image signal.

[0234] The signal processing device 170 may be configured to transmit the image signal to the plurality of network displays 180 d to 180 i through Ethernet communication VBa.

[0235] For example, the signal processing device 170 may transmit an image signal to some displays 180d to 1805f of the plurality of network displays 180d to 180i via the first area signal processing device 170Z1 through Ethernet communication VBa.

[0236] The signal processing device 170 may be configured to receive camera data from a certain camera 195mb via the third area signal processing device 170Z3 and the second area signal processing device 170Z2 through Ethernet communication VBa.

[0237] The signal processing device 170 may be configured to receive camera data from another camera 195ma via SerDes communication VBb.

[0238] The signal processing device 170 is configured to transmit the image signal to the plurality of displays 180 a to 180 c through SerDes communication VBb.

[0239] The signal processing device 170 may be configured to transmit the graphic image related data or the image data to the plurality of network displays 180d to 180i connected to the Ethernet network port. Therefore, the image may be stably displayed on the network display.

[0240] Fig. 9 is a block diagram illustrating another example of a vehicle display device according to one embodiment of the present disclosure.

[0241] 1. Referring to the drawing, a vehicle display apparatus 1100 according to one embodiment of the present disclosure includes a signal processing device 170 and at least one display 180ha connected to a network port NTa.

[0242] The vehicle display apparatus 1100 may further include a plurality of regional signal processing devices 170z1 to 170z4.

[0243] The signal processing device 170 includes a processor ( Figure 6 175).

[0244] The processor 175 is configured to transmit graphic image related data or image data to the display 180ha.

[0245] Specifically, the processor 175 may be configured to transmit the graphic image related data or image data to the display 180ha via Ethernet communication.

[0246] For example, the processor 175 may be configured to transmit the graphic image related data to the display 180ha if the graphic image related data can be transmitted, and transmit the image data to the display 180ha if the graphic image related data cannot be transmitted. Therefore, the image can be stably displayed on the network display 180ha.

[0247] As another example, the processor 175 may be configured to transmit image data to the display 180ha if the image data can be transmitted, and to transmit graphic image related data to the display 180ha if the image data cannot be transmitted. Therefore, an image can be stably displayed on the network display 180ha.

[0248] Furthermore, the graphic image related data may include graphic variable data and drawing command data.

[0249] The transmitted graphic variable data may include address information data indicated by pointer data in the memory of the signal processing device 170 .

[0250] The signal processing device 170 may be configured to synchronize a memory corresponding to the processor 175 and a memory corresponding to the display 180ha when the graphic variable data includes pointer data.

[0251] The signal processing device 170 may be configured to transmit data regarding a difference between previous data and current data stored in a memory corresponding to the processor 175 to a memory corresponding to the display 180ha.

[0252] When a first address region in the memory indicated by first pointer data at least partially overlaps with a second address region in the memory indicated by previously synchronized second pointer data during memory synchronization, the signal processing device 170 may be configured to generate third pointer data corresponding to a third address region including the overlapping region, the first address region, and the second address region, and transmit graphic image related data including the generated third pointer data.

[0253] The signal processing device 170 may be configured to transmit image data to the instrument panel display 180a connected to the display port DTa without transmitting graphic image related data. Therefore, an image can be stably displayed on the instrument panel display 180a which does not support Ethernet communication.

[0254] The signal processing device 170 may be configured to transmit image data to the AVN display 180b connected to the display port DTa without transmitting graphic image related data. Therefore, images can be stably displayed on the AVN display 180b that does not support Ethernet communication.

[0255] Furthermore, the figure shows a network display connected to each area in addition to the first network display 180ha directly connected to the signal processing device 170.

[0256] The second network display 180hb and the third network display 180hc may be connected to the signal processing device 170 via the second area signal processing device 170z2.

[0257] The fourth network display 180hd may be connected to the signal processing device 170 via the third area signal processing device 170z3.

[0258] The fifth network display 180he and the sixth network display 180hf may be connected to the signal processing device 170 via the third area signal processing device 170z3.

[0259] In addition, the processor 175 in the signal processing device 170 may include a gateway manager 772 and a window manager 774, wherein the gateway manager 772 performs network management for at least one display 180ha to 180hf connected to the network, and the window manager 774 manages settings of an image displayed on at least one display 180ha to 180hf.

[0260] For example, the gateway manager 772 may assign a network address of at least one display 180ha to 180hf connected to the network.

[0261] Additionally, when new network displays are added, the gateway manager 772 can assign new network addresses.

[0262] The window manager 774 may be configured to set the size or resolution of the graphic image related data or the image data based on the resolution or size of the at least one display 180ha to 180hf connected to the network.

[0263] For example, when the first network display 180ha and the second network display 180hb connected to the network have different resolutions or sizes, the window manager 774 can be configured to make the size or resolution of the graphic image related data or image data different. Therefore, an image suitable for the network display can be stably displayed.

[0264] In addition, the processor 175 in the signal processing device 170 may further include a virtual display generator 776 configured to generate content corresponding to the network display.

[0265] In particular, the virtual display generator 776 may be configured to generate content corresponding to characteristics of the network display.

[0266] In addition, the processor 170 in the signal processing device 170 may be configured to execute a virtual machine monitor ( Fig.10a 505) and execute multiple virtual machines on the virtual machine monitor ( Fig.10a 810 and 850 in FIG. ... Fig.10a Describe this.

[0267] Figures 10a to 11 is Fig. 9 The figure mentioned in the description.

[0268] first, Fig.10a is a diagram showing an example of image data transmission.

[0269] Referring to this figure, the processor 175 in the signal processing device 170 may be configured to execute virtual machines 810 and 850 on the virtual machine monitor 505 .

[0270] Furthermore, among the plurality of virtual machines 810 and 850, the first virtual machine 810 may be configured to transmit graphic image related data or image data to the display 180hd.

[0271] In this figure, as an example, the first virtual machine 810 is configured to transmit image data to the display 180hd.

[0272] Furthermore, the first virtual machine 810 may be configured to execute a gateway manager 825 that performs network management for the display 180hd connected to the network, and a window manager 842 that manages settings of an image displayed on the display 180hd.

[0273] When the plurality of displays 180hd and 180n are connected to the network, the first virtual machine 810 may be configured to transmit graphic image related data or image data to the plurality of displays 180hd and 180n.

[0274] The figure shows that the first virtual machine 810 is configured to transmit image data to each of the plurality of displays 180hd and 180n.

[0275] Furthermore, the second virtual machine 850 of the plurality of virtual machines may be configured to transmit image source data to the first virtual machine 810, and the first virtual machine 810 may be configured to transmit graphic image related data or image data based on the image source data to the display 180hd.

[0276] When the second display 180n in the figure is additionally connected, the first virtual machine 810 may be configured to receive information about the second display 180n additionally connected to the network and transmit graphic image related data or image data to the second display 180n.

[0277] Specifically, the gateway manager 825 in the first virtual machine 810 may be configured to identify the added second display 180 n and transmit settings of the identified second display 180 n to the window manager 842 in the first virtual machine 810 .

[0278] The window manager 842 may be configured to generate a virtual window for the second display 180 n , and request and receive an application or data required for content creation, etc. from the cloud.

[0279] The windows manager 842 may be configured to compress and transmit image data for the second display 180n.

[0280] In addition, when the display 180hd and the second display 180n have different resolutions, the first virtual machine 810 can be configured to transmit data related to graphic images or image data having different sizes or resolutions to the display 180hd and the second display 180n. Therefore, the image can be stably displayed on the network display 180hd.

[0281] also, Fig.10a The image data in may be a captured image.

[0282] The second virtual machine 850 may be configured to execute the encoder 852 and the video capturing server 855 , and the video capturing server 855 in the second virtual machine 850 may be configured to transmit the captured image data to the first virtual machine 810 .

[0283] In response, the video capture client 823 in the first virtual machine 810 receives the captured image data, and the window manager 842 in the application 840 in the first virtual machine 810 can output image data corresponding to the window created in the window generator 841 for the first display 180hd or the second display 180n.

[0284] Additionally, the encoder 845 in the first virtual machine 810 may compress the image data and transmit it to the Ethernet driver 811 in the virtual machine monitor 505 .

[0285] The Ethernet driver 811 within the virtual machine monitor 505 may be configured to transmit the compressed image data to the first network display 180hd connected to the first area signal processing device 170z1 through Ethernet communication. Therefore, the compressed image data may be stably transmitted to the first network display 180hd, and therefore, the image may be stably displayed on the first network display 180hd.

[0286] The Ethernet driver 811 within the virtual machine monitor 505 may be configured to transmit the compressed image data to the second network display 180n connected to the n-th area signal processing device 170zn through Ethernet communication. Therefore, the compressed image data may be stably transmitted to the second network display 180n, and therefore, the image may be stably displayed on the second network display 180n.

[0287] The first virtual machine 810 may be configured to output separate second image data instead of graphic image related data to the dashboard display 180a connected to the display port DTa. Therefore, an image may be stably displayed on the dashboard display 180a connected to the display port DTa.

[0288] When the graphic variable data includes pointer data, the first virtual machine 810 may be configured to synchronize the memory corresponding to the processor 175 and the memory corresponding to the display 180hd. Therefore, an image may be stably displayed on the network display 180hd.

[0289] The first virtual machine 810 may be configured to transmit data regarding a difference between previous data and current data stored in a memory corresponding to the processor 175 to a memory corresponding to the display 180hd. Therefore, an image may be stably displayed on the network display 180hd.

[0290] When the first address area indicated by the first pointer data in the memory at least partially overlaps with the second address area indicated by the synchronized second pointer data in the memory during memory synchronization, the first virtual machine 810 can be configured to generate third pointer data corresponding to a third address area including the overlapping area, the first address area, and the second address area, and transmit graphic image related data including the generated third pointer data. Therefore, an image can be stably displayed on the network display 180hd.

[0291] The first virtual machine 810 may be configured to transmit graphic image related data or image data to the display 180hd connected to the regional signal processing device 170z. Therefore, an image may be stably displayed on the network display 180hd.

[0292] Fig.10b is a diagram showing another example of image data transmission.

[0293] Referring to the figure, the virtio-gpu front end 852 in the second virtual machine 850 may be configured to transmit image data to the virtio-gpu back end 812 in the first virtual machine 810 .

[0294] The command renderer 832 in the application 844 in the first virtual machine 810 may be configured to transmit the received image data to the window manager 842 .

[0295] The window manager 842 in the first virtual machine 810 may output image data corresponding to a window created for the first display 180hd or the second display 180n.

[0296] Next, the encoder 845 in the application 844 in the first virtual machine 810 may encode the image data output from the window manager 842 and send it to the Ethernet driver 811 in the virtual machine monitor 505 .

[0297] The Ethernet driver 811 in the virtual machine monitor 505 may be configured to transmit the compressed image data to the second network display 180n connected to the n-th area signal processing device 170zn through Ethernet communication. Therefore, the compressed image data may be stably transmitted to the second network display 180n, and therefore, the image may be stably displayed on the second network display 180n.

[0298] Fig.10c is a diagram showing an example of transmitting graphic image related data.

[0299] Referring to the figure, the virtio-gpu front end 852 in the second virtual machine 850 may be configured to transmit image data to the virtio-gpu back end 812 in the first virtual machine 810 .

[0300] The command renderer 832 in the application 844 in the first virtual machine 810 may be configured to transmit the received image data to the window manager 842 .

[0301] The window manager 842 in the first virtual machine 810 may output image data corresponding to a window created for the first display 180hd or the second display 180n.

[0302] Image data output from the window manager 842 is input to the command generator 836 via the window 841 or the like, and the command generator 836 may convert the image data into graphic image related data.

[0303] At this time, the graphic image related data may include graphic variable data and drawing command data.

[0304] The graphic image related data output from the command generator 836 may be transmitted to the Ethernet driver 811 in the virtual machine monitor 505 via the command network agent in the first virtual machine 810 .

[0305] The Ethernet driver 811 in the virtual machine monitor 505 may be configured to transmit the graphic image related data to the first network display 180hd connected to the first area signal processing device 170z1 through Ethernet communication.

[0306] The Ethernet driver 811b and the command receiver 832b in the first network display 180hd receive the graphic image related data and convert it into image data through the display framework 842b, the openGL ES 847b, the GPU driver 813b and the display driver 812b.

[0307] Therefore, graphic image related data can be stably transmitted to the first network display 180hd, and thus, an image can be stably displayed on the first network display 180hd.

[0308] Fig.10d 2 is a diagram showing the separate transmission of image data and graphic image related data.

[0309] Refer to this figure, as shown in Fig.10b As in FIG. 1 , the first virtual machine 810 may be configured to transmit image data to the second network display 180 n .

[0310] Therefore, the compressed image data may be stably transmitted to the second network display 180n, and thus, the image may be stably displayed on the second network display 180n.

[0311] As in Fig.10c As in FIG. 1 , the first virtual machine 810 may be configured to transmit the graphic image related data to the first network display 180hd.

[0312] Therefore, graphic image related data can be stably transmitted to the first network display 180hd, and thus, an image can be stably displayed on the first network display 180hd.

[0313] Fig.10e is a diagram showing another example of transmission of graphic image related data.

[0314] Referring to the figure, the virtio-gpu front end 852 in the second virtual machine 850 may be configured to transmit image data to the virtio-gpu back end 812 in the first virtual machine 810 .

[0315] The command renderer 832 in the application 844 in the first virtual machine 810 may be configured to transmit the received image data to the window manager 842 .

[0316] The window manager 842 in the first virtual machine 810 may output image data corresponding to a window created for the first display 180hd or the second display 180n.

[0317] Image data output from the window manager 842 is input to the command generator 836 via the window 841 or the like, and the command generator 836 may convert the image data into graphic image related data.

[0318] The graphic image related data output from the command generator 836 may be transmitted to the Ethernet driver 811 in the virtual machine monitor 505 via the command network agent in the first virtual machine 810 .

[0319] The Ethernet driver 811 in the virtual machine monitor 505 may be configured to transmit the graphic image related data to the second network display 180n connected to the nth zone signal processing device 170zn through Ethernet communication.

[0320] Therefore, graphic image related data can be stably transmitted to the second network display 180n, and thus, an image can be stably displayed on the second network display 180n.

[0321] Fig.11 is a block diagram illustrating another example of a vehicle display device according to one embodiment of the present disclosure.

[0322] Referring to the drawing, a vehicle display apparatus 1200 according to one embodiment of the present disclosure may include a signal processing device 170 and a network display 180z.

[0323] The signal processing device 170 may be configured to execute a plurality of virtual machines 810 and 850 .

[0324] The virtio-gpu front end 852 in the second virtual machine 850 may be configured to transmit the image data to the virtio-gpu back end 812 in the first virtual machine 810 .

[0325] The command renderer 832 in the application 844 in the first virtual machine 810 may be configured to transmit the received image data to the window manager 842 .

[0326] The window manager 842 in the first virtual machine 810 may output image data corresponding to the window created for the network display 180z.

[0327] Image data output from the window manager 842 is input to the command generator 836 via the window 841 or the like, and the command generator 836 may convert the image data into graphic image related data.

[0328] The graphic image related data output from the command generator 836 may be transmitted to the Ethernet driver 811 in the virtual machine monitor 505 via the command network agent 838 in the first virtual machine 810 .

[0329] The Ethernet driver 811 in the virtual machine monitor 505 may be configured to transmit the graphic image related data to the network display 180z connected to the network port via the Ethernet switch ESH through Ethernet communication.

[0330] The Ethernet driver 811b and the command receiver 832b in the network display 180z receive the graphic image related data through the display framework 842b, the openGL ES 847b, the GPU driver 813b and the display driver 812b and convert it into image data.

[0331] Therefore, graphic image related data can be stably transmitted to the network display 180z, and therefore, images can be stably displayed on the network display 180z.

[0332] Image data other than graphical image related data may also be transmitted to the network display 180z.

[0333] For example, the virtio-gpu front end 852 in the second virtual machine 850 may transmit image data to the virtio-gpu back end 812 in the first virtual machine 810 .

[0334] The command renderer 832 in the application 844 in the first virtual machine 810 may be configured to transmit the received image data to the window manager 842 .

[0335] The window manager 842 in the first virtual machine 810 may output image data corresponding to the window created for the network display 180z.

[0336] Next, the encoder 845 in the first virtual machine 810 may encode the image data output from the window manager 842 and transmit it to the Ethernet driver 811 in the virtual machine monitor 505 .

[0337] The Ethernet driver 811 in the virtual machine monitor 505 may be configured to transmit the compressed image data to the network display 180z connected to the network terminal through Ethernet communication.

[0338] Therefore, the compressed image data can be stably transmitted to the network display 180z, and thus, the image can be stably displayed on the network display 180z.

[0339] Furthermore, the signal processing device 170 may be configured to transmit the graphic image related data to the network display 180z if the graphic image related data can be transmitted, and to transmit the image data to the network display 180z if the graphic image related data cannot be transmitted.

[0340] For example, the signal processing device 170 may determine whether the command receiver 832b of the network display 180z can execute the display framework 842b, openGL ES 847b, etc., and if so, determine that the graphic image related data can be transmitted to the network display 180z.

[0341] If the command receiver 832b of the network display 180z cannot execute the display framework 842b, the openGL ES 847b, etc., the signal processing device 170 may determine that the graphic image related data may be transmitted to the network display 180z.

[0342] The signal processing device 170 may be configured to transmit the image data to the network display 180z if the image data is transmittable, and transmit the graphic image related data to the network display 180z if the image data is not transmittable. Therefore, the image may be stably displayed on the network display 180hd.

[0343] Meanwhile, the signal processing device 170 may check a network status, such as a network bandwidth or a network speed, during Ethernet communication, and determine that image data can be transmitted if the bandwidth is equal to or greater than a reference value or the network speed is equal to or greater than a reference speed.

[0344] The signal processing device 170 may check a network status, such as a network bandwidth or a network speed, during Ethernet communication, and determine that the image data cannot be transmitted if the bandwidth is less than a reference value or the network speed is lower than a reference speed.

[0345] Fig.12 The flowchart is a flowchart showing an operating method of a vehicle display device according to an embodiment of the present disclosure.

[0346] Referring to the drawing, a vehicle display device according to one embodiment of the present disclosure may operate to ensure safety when a safety requirement specification displayed on a display changes.

[0347] First, the signal processing device 170 is configured to transmit screen data for a network display connected to a regional signal processing device 170z (S1010).

[0348] In response, the regional signal processing device 170z receives the screen data (S1011), and the network display connected to the regional signal processing device 170z displays an image based on the screen data (S1013).

[0349] The signal processing device 170 performs a security requirement change according to the security requirement change ( S1015 ), and is configured to transmit the security requirement and the resource ( S1020 ).

[0350] In response thereto, the regional signal processing device 170z receives the security requirements and resources (S1021) and updates the security requirements and resources.

[0351] Subsequently, the signal processing device 170 is configured to transmit security data ( S1025 ).

[0352] In response, the regional signal processing device 170z receives the security data (S1021) and monitors the screen data and the security data to check whether an error exists (S1027).

[0353] If there is an error, the regional signal processing device 170z recovers the security-related error (S1029), synthesizes the screen data and the security data (S1030), and displays the synthesized image on the network display (S1035).

[0354] Therefore, the composite image without error can be stably displayed on the network display.

[0355] Screen data can be based on Figures 10a to 10e The compressed image data transmission method described in the embodiment of the present invention is transmitted, and the security data can be transmitted according to Figures 10a to 10e The graphic image related image data transmission method described in is transmitted.

[0356] That is, the network display can also display the graphic image related data on the compressed image data. Therefore, the security data can be stably displayed while the image is stably displayed.

[0357] Fig.13a is a diagram showing a vehicle display device.

[0358] Referring to the drawing, the vehicle display apparatus 1000 may include a first central signal processing device 170a1, a second central signal processing device 170a2, first to fourth regional signal processing devices 170z1 to 170z4, and a network display 180b.

[0359] In the figure, the network display 180b is connected to the second area signal processing device 170z2.

[0360] The first central signal processing device 170a1 is configured to generate and transmit Fig.12 The screen data IGa in the network display 180b can be configured to receive the screen data via the second area signal processing device 170z2.

[0361] Fig.13b Screen 1305 is shown without security data.

[0362] Referring to the drawing, the first central signal processing device 170a1 may be configured to transmit screen data Iga corresponding to the screen 1305 without security data to the network display 180b via the second regional signal processing device 170z2.

[0363] At this time, the screen data IGa without security data can be Figures 10a to 10eThe data is transmitted using any one of the compressed image data transmission methods or graphic image related data transmission methods described in.

[0364] Therefore, the network display 180b can stably display the screen 1305 without security data.

[0365] Fig.13c A screen 1310 to which security data ICb is added is shown.

[0366] Referring to the drawing, the safety data ICb may be data related to fastening a seat belt.

[0367] Referring to the drawing, the first central signal processing device 170a1 may be configured to transmit the screen data IGa and the security data ICb of the screen 1305 without security data to the network display 180b via the second regional signal processing device 170z2.

[0368] At this time, the screen data IGa without security data can be Figures 10a to 10e The data is transmitted using any one of the compressed image data transmission methods or graphic image related data transmission methods described in.

[0369] Can be based on Figures 10a to 10e The security data ICb is transmitted using any of the graphic image related data transmission methods described in .

[0370] Therefore, the web display 180b can stably display the screen 1310 to which the security data ICb is added by synthesizing the screen data IGa and the security data ICb.

[0371] Fig.14a is a flow chart illustrating secure data transfer and display.

[0372] Referring to the figure, the signal processing device 170 starts an operation for displaying an image on the display 180 (S1405), is configured to generate a screen transfer request (S1407), and is configured to transfer screen data to the regional signal processing device 170z (S1409).

[0373] In response, the regional signal processing device 170z receives the screen data (S1409), and is configured to transmit it to the network display 180 connected to the regional signal processing device 170z (S1410). Therefore, the network display 180 displays an image based on the screen data.

[0374] Subsequently, the signal processing device 170 receives a screen change request when a security-related screen change is required (S1411), is configured to generate security data corresponding to the security requirement change (S1413), and transmits the security data to the regional signal processing device 170z (S1415).

[0375] At this time, coordinate information, image information, etc. of the security data may be transmitted to the regional signal processing device 170z.

[0376] In response, the regional signal processing device 170z may update the security requirements based on the security data (S1417).

[0377] When a first safety condition occurs ( S1421 ), the signal processing device 170 is configured to generate first safety condition information ( S1423 ) and transmit first related data to the regional signal processing device 170z ( S1425 ).

[0378] In response, the regional signal processing device 170z may perform monitoring while transmitting the first relevant data to the network display 180 (S1429).

[0379] Therefore, the security data based on the first correlation data can be stably displayed on the network display 180 .

[0380] Next, when a second safety situation occurs ( S1431 ), the signal processing device 170 is configured to generate second safety situation information ( S1433 ) and transmit second related data to the regional signal processing device 170z ( S1435 ).

[0381] In response, the regional signal processing device 170z may control to perform error recovery when an error is recognized while receiving and monitoring the second correlation data (S1437).

[0382] Next, when a third safety situation occurs ( S1441 ), the signal processing device 170 is configured to generate third safety situation information ( S1443 ), and is configured to transmit third related data to the regional signal processing device 170z ( S1445 ).

[0383] In response, the regional signal processing device 170z may perform monitoring while transmitting the third related data to the network display 180 (S1449).

[0384] Therefore, the security data based on the third related data can be stably displayed on the network display 180 .

[0385] Fig.14b and Fig.14c is a diagram showing a display of secure data movement.

[0386] Fig.14b Safety data is shown displayed on the instrument panel display 180a and no safety data is displayed on the passenger seat display 180P.

[0387] Referring to the drawing, the vehicle display apparatus 1000 may include central signal processing devices 170a and 170b, a plurality of regional signal processing devices 170z1 to 170z4, a dashboard display 180a, and a passenger seat display 180P.

[0388] The first central signal processing device 170a may be configured to transmit the screen data IGa and the security data ICa, ICb, ICm, and ICbn to the instrument panel display 180a, which is a network display, via the second regional signal processing device 170z2.

[0389] Therefore, the instrument panel display 180a can display an image based on the screen data IGa, and display a security icon or the like based on the security data ICa, ICb, ICm, and ICbn.

[0390] Safety icons and the like are not displayed on the passenger seat display 180P.

[0391] Fig.14c An example is shown where at least some of the safety data is moved to the passenger seat display 180P.

[0392] Referring to the drawing, the first central signal processing device 170a may be configured to transmit at least some of the safety data ICa and ICb among the safety data ICa, ICb, ICm, and ICbn to the passenger seat display 180P as a network display via the first regional signal processing device 170z1.

[0393] Therefore, at least some of the data ICa and ICb among the data ICa, ICb, ICm, and ICbn may be displayed on the passenger seat display 180P.

[0394] Fig.15a are diagrams showing various examples of transmitting graphic image related data.

[0395] Referring to the figure, when the security level is Sm1>Sm2>Sm3>Sm4>Sm5, the first central signal processing device 170a in the vehicle display device 1000 can be configured to transmit the graphic data Sm1 corresponding to the first security level to the dashboard display 180a via the first regional signal processing device 170z1 and the second regional signal processing device 170z2.

[0396] In addition, the first central signal processing device 170a may be configured to transmit graphic data Sm2 corresponding to the second security level to the instrument panel display 180a via the second regional signal processing device 170z2.

[0397] Furthermore, the first central signal processing device 170a may be configured to transmit graphic data Sm3 corresponding to the third security level to the instrument panel display 180a via the second regional signal processing device 170z2.

[0398] The first central signal processing device 170a may be configured to transmit graphic data Sm4 corresponding to the fourth security level to the instrument panel display 180a via the first regional signal processing device 170z1 and the second regional signal processing device 170z2.

[0399] Furthermore, the first central signal processing device 170a may be configured to transmit graphic data Sm5 corresponding to the fifth security level to the instrument panel display 180a via the third regional signal processing device 170z3, the fourth regional signal processing device 170z4, and the second regional signal processing device 170z2.

[0400] Fig.15b Shows about Fig.15a Graphical data displayed on a monitor.

[0401] Referring to the drawing, graphic data Sm1 corresponding to a first security level and graphic data Sm2 corresponding to a second security level may be displayed as a security graphic 1510 on a dashboard display 180 a .

[0402] Graphic data Sm3 corresponding to the third safety level may be displayed as a speed graph 1520 on the instrument panel display 180 a .

[0403] Graphic data Sm4 corresponding to the fourth safety level and graphic data Sm5 corresponding to the fifth safety level may be displayed as a road graphic 1530 on the instrument panel display 180 a .

[0404] The safety graphic 1510 may correspond to safety graphic data, the speed graphic 1520 may correspond to non-safety low-capacity graphic data, and the road graphic 1530 may correspond to non-safety large-capacity graphic data.

[0405] Fig.15c It is shown Fig.15a and Fig.15b A diagram of the security levels of multiple pieces of graphic data in .

[0406] Referring to the drawing, graphic data Sm1 corresponding to a first security level and graphic data Sm2 corresponding to a second security level may correspond to security graphic data.

[0407] The graphic data Sm3 corresponding to the third security level may correspond to non-secure low-capacity graphic data.

[0408] The graphic data Sm4 corresponding to the fourth security level and the graphic data Sm5 corresponding to the fifth security level may correspond to the non-secure large-capacity graphic data.

[0409] Fig.15d 1 is a diagram showing combinations of first graphic data Sm1 to fifth graphic data Sm5.

[0410] Referring to the figure, graphic data Sm3 corresponding to the third security level can be set on graphic data Sm4 corresponding to the fourth security level and graphic data Sm5 corresponding to the fifth security level, and graphic data Sm1 corresponding to the first security level can be set on graphic data Sm3 corresponding to the third security level.

[0411] Alternatively, graphic data Sm3 corresponding to the third security level may be set on graphic data Sm4 corresponding to the fourth security level and graphic data Sm5 corresponding to the fifth security level, and graphic data Sm2 corresponding to the second security level may be set on graphic data Sm3 corresponding to the third security level.

[0412] Figures 16a to 16e This is a diagram mentioned in the description of data transmission between the secure area and the non-secure area.

[0413] Fig.16a It is shown that among a plurality of frame data, odd-numbered frame data is transmitted through path A, and even-numbered frame data is transmitted through path B.

[0414] Referring to the drawing, when transmitting graphic image related data or image data, the signal processing device 170 may separate paths of odd-numbered frame data and even-numbered frame data.

[0415] Fig.16b It is shown that one frame data is divided into a plurality of areas, and the paths are separated according to the bandwidth of each path or the like.

[0416] Referring to the figure, the signal processing device 170 may divide the frame data into a plurality of regions, for example, a plurality of block regions, and separate transmission paths for the divided regions when transmitting graphic image related data or image data.

[0417] Fig.16c Single path transmission and multipath transmission during data transmission are shown.

[0418] Referring to the figure, transmission is performed through multiple paths from the source to N2, transmission is performed through a single path from N2 to N10, and transmission is performed through multiple paths from N10 to the destination.

[0419] As shown in the figure, the signal processing device 170 can set the optimal path in consideration of bandwidth, speed, etc. during multi-path transmission.

[0420] Fig.16d is a diagram showing an example of multi-path selection.

[0421] Referring to the figure, a first path may be a path from a source, N1, N2, N10 to a destination.

[0422] The second path may be a path from the source, N7, N8, N9, N2, N10, N11 to the destination.

[0423] A composite path may be a path combining a first path and a second path.

[0424] The signal processing device 170 may synthesize the first path, the second path, etc., and transmit the graphic image related data or the image data through the synthesized path. Therefore, efficient data transmission may be performed.

[0425] Fig.16e is a diagram showing an example of a path change.

[0426] Referring to the figure, a first path may be a path from a source, N1, N2, N10 to a destination.

[0427] The second path may be a path from the source, N1, N2, N10, N3 to the destination.

[0428] In particular, when the bandwidth between N10 and the destination is less than a predetermined value or the speed is less than a predetermined speed on the first path, the path can be reset, and a path from N10, N3 to the destination (such as a second path) can be searched and transmission performed.

[0429] That is, the signal processing device 170 may be configured to transmit the graphic image related data or the image data through the second path which is reset in consideration of the bandwidth or speed during the transmission of the first path. Therefore, efficient data transmission may be performed.

[0430] Will refer to Fig.17 The following figures describe the transmission of graphic image related data.

[0431] Figures 17 to 20d The data transmission device 2100 shown may be the above-mentioned signal processing device 170 , and the data receiving device 2600 may be the network display 180 .

[0432] Fig.17 1 is an internal block diagram showing an example of a data transmission device and a data receiving device for transmitting graphic image related data according to an embodiment of the present disclosure.

[0433] Referring to the figure, Fig.17 The data transmission device 2100 may include a memory 2160 , a memory cache manager 2510 , a command distributor 2515 , a graphics processor 2520 , a compiler 2532 , a compressor 2534 , and a transmitter 2536 .

[0434] When a user input signal is input through a user input unit (not shown) of the data transmission device 2100 , the processor (not shown) may be configured to receive the user input signal and generate a drawing command to draw a graphic image.

[0435] Therefore, the command distributor 2515 is configured to transmit the drawing command to the graphics processor 2520, and the graphics processor 2520 may be configured to generate a graphic image based on the drawing command. Then, the generated graphic image may be transmitted to a display (not shown) for display.

[0436] When a user input signal is input in a state synchronized with the data receiving device, the command distributor 2515 may be configured to transmit a drawing command to the memory cache manager 2510 .

[0437] The memory cache manager 2510 configured to manage memory may include a memory cache 2512 for managing graphic variable data in the memory 2160 and a history cache 2514 for managing history data in the memory 2160 .

[0438] The memory cache 2512 may be configured to temporarily store the graphics variable data according to the received drawing command, and then record the graphics variable data in a predetermined address area in the memory. In particular, if the graphics variable data is pointer data, the memory cache 2512 may manage the address area data in the memory.

[0439] The history cache 2514 may be configured to temporarily store history data for each object and then store the history data in memory when there are multiple objects in a graphics image to be drawn.

[0440] The memory cache manager 2510 may be configured to transfer the received graphics image related data and the graphics variable data stored in the memory 2160 to the compiler 2532 for sharing the graphics image with the data receiving device.

[0441] Although not shown in the drawings, when the graphic processor 2520 is configured to generate a graphic image based on a drawing command, the graphic variable data or the history data stored in the memory 2160 may be used.

[0442] The compiler (command compiler) 2532 may synthesize the graphic variable data and the graphic image related data. The synthesized graphic image related data may be compressed by the compressor 2534 and transmitted to the data receiving device 2600 via the transmitter 2536.

[0443] Fig.17 The data receiving device 2600 may include a memory 2660 , an address converter 2610 , a renderer 2615 , a graphics processor 2620 , a parser 2632 , a decompressor 2634 , and a receiver (transmitter) 2636 .

[0444] The receiver 2636 receives the compressed graphic image related data from the transmitter 2536. The decompressor 2634 decompresses the compressed graphic image related data received from the transmitter 2536, and the parser (command parser) 2632 can extract the graphic variable data and the graphic image related data from the decompressed graphic image related data.

[0445] The extracted graphic variable data and graphic image related data are transmitted to the address converter 2610, and the graphic image related data are transmitted to the renderer 2615 for graphic display, and the graphic variable data are transmitted to the memory 2660. Then, the graphic processor 2620 is configured to generate a graphic image based on the graphic image related data and the graphic variable data. Then, the generated graphic image can be transmitted to the display of the image display device and displayed on the display.

[0446] Through this process, the data transmission device 2100 and the data reception device 2600 synchronized with each other can share the same graphic image. In particular, the graphic image about the video can be shared in real time.

[0447] Here, in order to improve data transmission efficiency, graphic image related data used to generate a graphic image and graphic variable data necessary for generating the graphic image are transmitted instead of the graphic image data itself, thereby achieving efficient data transmission.

[0448] Fig.18a is a flowchart showing an operation method of a data transmission device according to an embodiment of the present disclosure, and Figures 18b to 20d is describing Fig.18a Various examples of the operation method of the data transmission device are referred to in the drawings.

[0449] First, the data transmission device 2100 may be configured to receive an input signal ( S2610 ).

[0450] For example, the data transmission device 2100 may receive a touch input as an example of a user input.

[0451] As another example, the data transmission device 2100 may receive various inputs such as voice input, key input, and gesture input.

[0452] The received user input signal may be transmitted to a processor (not shown) in the data transmission device 2100 .

[0453] Next, graphic image related data corresponding to the input signal is generated (S2620).

[0454] The processor (not shown) in the data transmission device 2100 may be configured to generate graphic image related data corresponding to the user input signal.

[0455] For example, when there is a touch input, a processor (not shown) in the data transmission device 2100 may generate a graphic image of a car moving left or right.

[0456] At this time, the graphic image can be generated in such a manner that the processor is configured to generate a drawing command for drawing the graphic image in response to a user input signal, and the graphic processor 2520 is configured to generate the graphic image using the generated drawing command and the graphic variable data stored in the memory 2160.

[0457] Next, the generated graphic image related data is transmitted to an external data receiving device (S2630).

[0458] In order to share the graphics image, the memory cache manager 2510 may be configured to transfer the received graphics image related data and the graphics variable data stored in the memory 2160 to the compiler 2532 .

[0459] Then, the compiler (command compiler) 2532 may synthesize the graphic variable data and the graphic image related data. The synthesized graphic image related data may be compressed by the compressor 2534 and transmitted to the data receiving device 2600 through the transmitter 2536.

[0460] Next, a graphic image corresponding to the generated graphic image related data is displayed (S2640).

[0461] The data transmission device 2100 may display a graphic image processed by the graphic processor 2520 corresponding to the generated graphic image related data on a display (not shown).

[0462] The data receiving device 2600 may display a graphic image processed in the graphic processor 2620 corresponding to the received graphic image related data on a display.

[0463] Therefore, the sharing of the graphic images between the two devices can be performed simply. In addition, the graphic images can be shared in real time.

[0464] Fig.19a An example is shown in which the graphic image related data 2820a including the graphic image related data and the graphic variable data is transmitted from the data transmission device 2100 to the data reception device 2600.

[0465] Here, the graphic image related data may be data (operation code data) corresponding to the function Func1(), and the graphic variable data may be data corresponding to variables a and b.

[0466] The graphics processor 2520 may use the graphics image related data and the graphics variable data to perform a drawing function 2810a.

[0467] The data receiving device 2600 may extract the graphic image related data Func1() and the graphic variable data a and b from the received graphic image related data 2820b, and use them to execute the drawing function 2810b in the graphic processor 2620 within the image display device.

[0468] If the graphic variable data in the graphic image related data is pointer data, you can apply Fig.18b Flowchart of the process.

[0469] refer to Fig.18b , the processor of the data transmission device 2100 determines whether the graphic variable data includes pointer data (S2710), and if so, performs memory synchronization.

[0470] The processor of the data transmission device 2100 is configured to generate differential memory data, which is the difference between the current memory data and the previous memory data (S2720). Then, the transmitter 2536 of the data transmission device 2100 is configured to transmit the differential memory data to the data receiving device (S2730).

[0471] When the graphic variable data includes pointer data, the pointer data indicates data of the corresponding address area, rather than current data stored in the memory, and therefore it is necessary to perform memory synchronization between the data transmitting device and the data receiving device.

[0472] During memory synchronization, sharing all current memory data stored in the memory increases the amount of data to be transferred, and therefore differential memory data, which is the difference between the previous memory data and the current memory data, is preferably transferred.

[0473] Fig.19b It is shown that: when the graphic variable data includes pointer data ptr indicating a predetermined address area 2835a in the memory 2160, synchronization is performed between the memory 2160 of the data transmission device 2100 and the memory 2660 of the data receiving device 2600, and then the graphic image related data 2840a including the graphic image related data and the graphic variable data is transmitted from the data transmission device 2100 to the data receiving device 2600.

[0474] Here, the graphic image related data may be data (operation code data) corresponding to the function Func2(), and the graphic variable data may be data corresponding to the variables char* and ptr.

[0475] Since the pointer data ptr indicates the predetermined address area 2835a, the transmitted graphic variable data may be address information data of the predetermined address area 2835a. Therefore, the data amount of the transmitted graphic variable data may be reduced.

[0476] The graphics processor 2520 may use the graphics image related data and the graphics variable data to perform a drawing function 2830a.

[0477] Memory synchronization may mean matching a data value in each address region in the memory 2160 of the data transmission device 2100 with a data value in each address region in the memory 2660 of the data reception device 2600 .

[0478] Specifically, memory synchronization may mean matching a data value in an address region 2835a indicated by pointer data ptr in the memory 2160 of the data transmission device 2100 with a data value in an address region 2835b indicated by pointer data ptr′ in the memory 2660 of the data reception device 2600 .

[0479] In this memory synchronization, by transmitting the data value in the address area 2835a indicated by the pointer data ptr before other graphic variable data, the accuracy of memory access of the pointer data received thereafter is improved.

[0480] After synchronizing the memory 2160 with the memory 2660 of the data transmission device 2100, the data receiving device 2600 extracts the graphic image related data Func2() and the graphic variable data char* and ptr from the received graphic image related data 2840b, and the graphic processor 2620 in the image display device can use the extracted data to execute the drawing function 2830b.

[0481] The data receiving device 2600 may be configured to generate pointer data ptr′ using a data value in the address region 2835a indicated by the pointer data ptr received from the data transmission device 2100 and use a data value of the address region 2835b corresponding to the pointer data ptr′.

[0482] The data receiving device 2600 can manage the pointer data ptr from the data transmission device 2100 and the pointer data ptr′ generated by itself, or the data of the address area corresponding to the pointer data ptr′ and the data of the address area corresponding to the pointer data ptr′ generated by itself in the hash table 2837 .

[0483] As reference Fig.19b As described, in memory synchronization, in order to match the data value in the address area 2835a indicated by the pointer data ptr in the memory 2160 of the data transmission device 2100 with the data value in the address area 2835b indicated by the pointer data ptr' in the memory 2660 of the data receiving device 2600, differential data can be sent, which is the difference between the previous memory data and the current memory data.

[0484] Fig.19c Transmission of differential data from the memory during memory synchronization is shown.

[0485] refer to Fig.19c , the processor may calculate differential data 2859a, which is the difference between the data value of the address area 2857a corresponding to the previous pointer data ptr_prev in the memory 2160 and the data value of the address area 2855a corresponding to the current pointer data ptr in the memory 2160, and the transmitter 2536 may be configured to send the calculated differential data 2859a to the data receiving device 2600. As a result, data transmission efficiency is improved during memory synchronization.

[0486] The data receiving device 2600 may be configured to generate ptr′ of pointer data corresponding to the differential data 2859a received from the data transmission device 2100 and use a data value of the address area 2856b corresponding to the ptr′ of the pointer data.

[0487] Fig.19d A memory synchronization method is shown in the case where an address area in a memory overlaps with a plurality of pointer data during memory synchronization.

[0488] Referring to the figure, when a first address region 2865a indicated by first pointer data ptr in a memory and a second address region 2867a indicated by second pointer data ptr2 in a previously synchronized memory at least partially overlap during memory synchronization, the processor may be configured to generate a third pointer data ptr3 corresponding to a third address region 2870a including an overlapping region 2869a, the first address region 2865a, and the second address region 2867a.

[0489] Regarding the generation of the third pointer data, the processor may be configured to generate command data regarding the generation of the pointer data for controlling the memory 2160 .

[0490] The transmitter 2536 may be configured to transmit command data regarding generation of the third pointer data to the data receiving device 2600 .

[0491] That is, the graphic image related data transmitted to the data receiving device 2600 may further include command data regarding memory control in addition to the graphic variable data and the graphic command data.

[0492] The command data regarding memory control is data used to control the memory 2160 of the data transmission device 2100 or the memory 2600 of the data receiving device 2160, and in addition to generating command data, it can also include deletion command data, differential command data (diff), XOR operation command data and history record command data.

[0493] Generate command data may include memory start address, size and variable data, delete command data may include memory start address, differential command data (diff) may include memory start address, offset, size and differential data, XOR command data may include memory start address, offset, size and XOR data, and history record command data may include memory start address, offset, size and history index.

[0494] In addition, the transmitter 2536 may also transmit the graphic variable data related to the generated third pointer data ptr3 to the data receiving device 2600 .

[0495] Since the third pointer data ptr3 indicates the predetermined address area 2870a, the graphic variable data transmitted from the transmitter 2536 may be address information data of the predetermined address area 2870a. Therefore, the data amount of the transmitted graphic variable data may be reduced.

[0496] The data receiving device 2600 may be configured to generate pointer data ptr3 ′ by using a data value in the address region 2870 a indicated by the third pointer data ptr3 received from the data transmission device 2100 , and may use a data value of the address region 2866 b corresponding to the pointer data ptr3 ′.

[0497] Specifically, during memory synchronization, the data receiving apparatus 2600 may improve the accuracy of memory synchronization by using pointer data ptr3 ′ corresponding to the third pointer data ptr3 instead of pointer data ptr′ corresponding to the first pointer data ptr.

[0498] Figures 20a to 20d is a diagram describing various example references to memory synchronization techniques.

[0499] first, Fig.20a An example of previous data 2910 and current data 2920 of a memory is shown. The difference is represented as B for the previous data and C for the current data.

[0500] Therefore, the processor can compare the previous data 2910 and the current data 2920 in units of integers (int) or bytes, detect differences, and append a header to generate differential data. The header may include location information, size information, etc. of the portion where the difference exists. Since data usually changes in a certain step, the header may further include the step.

[0501] Fig.20a An example of such differential data 2930 is shown.

[0502] The differential data 2930 may include position information (offset) indicating a position where no difference occurs, the size of a portion where a difference occurs or the number of consecutive times a difference occurs, a step where a difference occurs, an occurrence count of a difference, and data after a change according to the difference.

[0503] In the drawing, since the eleventh value B has been changed to C in the previous data 2910 and the current data 2920, the differential data 2930 has an offset of "10", a size of "1", a stride of "1", a count of "1", and changed data of "C".

[0504] Next, Fig.20b Another example of previous data 2940 and current data 2950 of the memory is shown. Fig.20a In the same manner, the differential data 2960 has an offset of "1", a size of "1", a step size of "2", a count of "5", and changed data of "BDDBB".

[0505] like Fig.20a and Fig.20bAs shown, when generating differential data, when detecting the difference by comparing the previous data with the current data in units of integers (int) or bytes, the differential data may become larger than the original data. In this case, the XOR result value can be generated as the differential data by using an XOR operator.

[0506] Fig.20c It is shown that the previous data 2970 of the memory is "ABCDEFG" and the current data 2980 is "CBDEEGG".

[0507] like Fig.20a and Fig.20b As shown, if the previous data is compared with the current data in units of integers (int) or bytes when generating differential data, a difference such as the shaded portion appears. Since the interval of such a difference is not constant, the differential data may eventually become larger than the original data.

[0508] In this case, it may be more efficient to use the XOR operator to generate the differential data.

[0509] Fig.20d A method of generating differential data using an XOR operator is shown.

[0510] Fig.20d It is shown that the previous data 2915 of the memory is "10101010" and the current data 2916 is "11101110." When the XOR operation is performed, the same bits become 0, so when the compression algorithm is applied later, the efficiency can be improved.

[0511] Therefore, the differential data 2917 according to the XOR operation may be "11101110", and during data transmission, the compressed data 2918 of "11101110" may be transmitted.

[0512] Obviously, although the preferred embodiments have been shown and described above, the present disclosure is not limited to the above specific embodiments, and various modifications and changes may be made by those skilled in the art without departing from the spirit of the appended claims. Therefore, it is intended that these modifications and changes should not be understood independently of the technical spirit or prospect of the present disclosure.

Claims

1. A signal processing device, comprising a processor, wherein the processor is configured to control at least one display connected to a network port, in, The processor is configured to transmit graphic image related data or image data to the display.

2. The signal processing device according to claim 1, wherein: The processor is configured to transmit the graphic image related data to the display in response to enabling transmission of the graphic image related data, and to transmit the image data to the display in response to not being able to transmit the graphic image related data.

3. The signal processing device according to claim 1, wherein: The processor comprises: a gateway manager configured to perform network management on the display connected to the network; and A window manager is configured to manage settings of an image displayed on the display.

4. The signal processing device according to claim 1, wherein: The processor is configured to transmit the graphic image related data or the image data to the display via Ethernet communication.

5. The signal processing device according to claim 1, wherein: The processor is configured to execute a plurality of virtual machines on a virtual machine monitor, The first virtual machine among the plurality of virtual machines is configured to transmit the graphic image related data or the image data to the display.

6. The signal processing device according to claim 5, wherein: The first virtual machine is configured to execute a gateway manager configured to perform network management on the display connected to the network and a window manager configured to manage settings of an image displayed on the display.

7. The signal processing device according to claim 5, wherein: The first virtual machine is configured to transmit the graphic image related data or the image data to the plurality of displays in response to the plurality of displays being connected to the network.

8. The signal processing device according to claim 5, wherein: The first virtual machine is configured to output the second image data to a dashboard display connected to a display port.

9. The signal processing device according to claim 5, wherein: A second virtual machine among the plurality of virtual machines is configured to transmit the image source data to the first virtual machine, and The first virtual machine is configured to transmit the graphic image related data or the image data based on the image source data to the display.

10. The signal processing device according to claim 5, wherein: The first virtual machine is configured to receive information about a second display additionally connected to the network, and transmit the graphic image related data or the image data to the second display.

11. The signal processing device according to claim 10, wherein: In response to the display and the second display having different resolutions, the first virtual machine is configured to make the size or resolution of the graphic image-related data or the image data transmitted to the display and the second display different.

12. The signal processing device according to claim 5, wherein: The graphic image related data includes graphic variable data and drawing command data.

13. The signal processing device according to claim 12, wherein: The transmitted graphic variable data includes address information data indicated by pointer data in the memory of the signal processing device.

14. The signal processing device according to claim 12, wherein: The first virtual machine is configured to synchronize a memory corresponding to the processor and a memory corresponding to the display in response to the graphics variable data including pointer data.

15. The signal processing device according to claim 12, wherein: The first virtual machine is configured to transmit differential data of previous data and current data stored in the memory corresponding to the processor to the memory corresponding to the display.

16. The signal processing device according to claim 14, wherein: In response to a first address region in a memory indicated by first pointer data at least partially overlapping with a second address region in a previously synchronized memory indicated by second pointer data during memory synchronization, the first virtual machine is configured to generate third pointer data corresponding to a third address region including the overlapping region, the first address region, and the second address region, and to transmit graphics image related data including the generated third pointer data.

17. The signal processing device according to claim 5, wherein: The first virtual machine is configured to transmit graphic image related data or image data to the display connected to the local signal processing device.

18. A signal processing device, the signal processing device comprising a processor, the processor configured to control at least one display connected to a network port, in, The processor is configured to transmit the graphical image related data or image data to the display and output second image data to a dashboard display connected to a display port.

19. A vehicle display device, comprising: at least one display; as well as a signal processing device configured to output an image signal to the display, Wherein, the signal processing device comprises the signal processing device according to claims 1 to 18.

Images