Signal processing device and vehicle display device including the same

By using the coordinated work of the server virtual machine and the customer virtual machine in the vehicle display device, the problem of image display delay and resolution mismatch between multiple displays is solved, and efficient image synchronization and resolution matching is achieved.

CN120435703APending Publication Date: 2025-08-05LG ELECTRONICS INC
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202280102764.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2022-10-21
Publication Date
2025-08-05

AI Technical Summary

Technical Problem

As the number of displays in the vehicle display device increases, the complexity of signal processing increases, resulting in the problem of mismatch between image display delay and resolution, especially when the image is moved and copied between multiple displays, the delay is significantly increased.

Method used

A signal processing device that runs a server virtual machine and multiple customer virtual machines in the processor is adopted. Through the coordinated work between shared memory and virtual machines, the encoding, decoding and display of image data is realized to ensure synchronization and resolution matching.

Benefits of technology

It effectively reduces the image display delay between multiple displays, realizes synchronous display and image output that matches resolution, and improves the efficiency of vehicle display devices.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120435703A_ABST
    Figure CN120435703A_ABST
Patent Text Reader

Abstract

The invention relates to a signal processing device and a vehicle display device having the same. A signal processing apparatus according to an embodiment of the present invention includes a processor that performs signal processing, the processor running a server virtual machine and a plurality of guest virtual machines on a hypervisor in the processor, first to second guest virtual machines among the plurality of guest virtual machines operating for first to second displays, respectively, the server virtual machine is controlled to encode the processed image data and store the image data in the shared memory, and the first guest virtual machine is controlled to receive and decode the encoded image data stored in the shared memory and store the decoded image data in the shared memory. The second guest virtual machine is controlled to receive the decoded video data stored in the shared memory and to display at least a portion of the decoded video data on the second display. As a result, it is possible to reduce the delay during image display between the plurality of displays.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a signal processing device and a vehicle display device having the same, and more particularly to a signal processing device capable of reducing delays in image display between multiple displays and a vehicle display device having the same. Background Art

[0002] A vehicle is a device that allows a user to move in a desired direction, and a representative example is a car.

[0003] On the other hand, for the convenience of users of vehicles, a vehicle display device is mounted inside the vehicle.

[0004] For example, a display is placed in an instrument cluster, etc., and displays various information. Meanwhile, in order to display vehicle driving information, various displays such as AVN (Audio Video Navigation) displays are being installed in vehicles in addition to instrument clusters.

[0005] As described above, there is a problem that as the number of displays in a vehicle display device increases, signal processing for the displays becomes complicated.

[0006] In particular, when each of a plurality of displays uses its own signal processing device to perform image movement display or image copy display, there is a problem that the image processing load and delay increase significantly. Summary of the Invention

[0007] Problems to be solved by the invention

[0008] An object of the present invention is to provide a signal processing device capable of reducing a delay in image display between a plurality of displays, and a vehicle display device including the signal processing device.

[0009] On the other hand, another object of the present invention is to provide a signal processing device capable of reducing a delay in displaying moving images between a plurality of displays, and a vehicle display device having the signal processing device.

[0010] On the other hand, another object of the present invention is to provide a signal processing device capable of reducing a delay when displaying images copied between a plurality of displays, and a vehicle display device having the signal processing device.

[0011] On the other hand, another object of the present invention is to provide a signal processing device capable of reducing delay in image display between a plurality of displays even if a plurality of virtual machines have different operating systems, and a vehicle display device having the signal processing device.

[0012] On the other hand, another object of the present invention is to provide a signal processing device capable of displaying images corresponding to the resolutions of a plurality of displays with reduced delay, and a vehicle display device including the signal processing device.

[0013] Technical solutions to the problem

[0014] A signal processing device according to an embodiment of the present invention for achieving the above-mentioned purpose includes a processor that performs signal processing for a plurality of displays installed on a vehicle, the processor running a server virtual machine and a plurality of client virtual machines on a hypervisor within the processor, a first client virtual machine and a second client virtual machine among the plurality of client virtual machines acting as a first display and a second display, respectively, the server virtual machine is controlled to encode the processed image data and store it in a shared memory, the first client virtual machine is controlled to receive and decode the encoded image data stored in the shared memory and store the decoded image data in the shared memory, and the second client virtual machine is controlled to receive the decoded image data stored in the shared memory and display at least a portion of the decoded image data on a second display.

[0015] On the other hand, the first client virtual machine can be controlled to receive and decode the encoded image data stored in the shared memory, and display at least a portion of the decoded image data on the first display.

[0016] On the other hand, the first client virtual machine can be controlled to display a first image on the first display at a first time point, and the second client virtual machine can be controlled to display a second image corresponding to the first image on the second display at a second time point after the first time point.

[0017] On the other hand, the first client virtual machine can be controlled to display the first image on the first display at the first time point and the second time point after the first time point, and the second client virtual machine can be controlled to display the second image corresponding to the first image on the second display at the second time point.

[0018] On the other hand, the second guest virtual machine can be controlled to output the scaled second image to the second display based on the size or output resolution of the second display or the operating system.

[0019] On the other hand, a third guest virtual machine among the plurality of guest virtual machines operates for a third display. The third guest virtual machine can be controlled to receive the decoded image data stored in the shared memory and display at least a portion of the decoded image data on the third display.

[0020] On the other hand, the second guest virtual machine and the third guest virtual machine may share a portion of the shared memory where the decoded image data is stored.

[0021] On the other hand, the first client virtual machine can be controlled to display a first image on a first display at a first time point, the second client virtual machine can be controlled to display a second image corresponding to the first image on a second display at a second time point after the first time point, and the third client virtual machine can be controlled to display a third image corresponding to the first image on a third display at a third time point after the second time point.

[0022] On the other hand, the first client virtual machine can be controlled to display a first image on the first display at a first time point, a second time point after the first time point, and a third time point after the second time point. The second client virtual machine can be controlled to display a second image corresponding to the first image on the second display at the second time point and the third time point. The third client virtual machine can be controlled to display a third image corresponding to the first image on the third display at the third time point.

[0023] A signal processing device according to another embodiment of the present invention for achieving the above-mentioned purpose includes a processor that performs signal processing for a plurality of displays installed on a vehicle, the processor running a server virtual machine and a plurality of client virtual machines on a hypervisor within the processor, a first client virtual machine and a second client virtual machine among the plurality of client virtual machines acting as a first display and a second display, respectively, the server virtual machine is controlled to encode the processed image data and store it in a shared memory, the first client virtual machine receives the encoded image data stored in the shared memory and transmits a decoding request to the server virtual machine, the server virtual machine is controlled to decode the encoded image data based on the decoding request and store the decoded image data in the shared memory, the first client virtual machine is controlled to receive the decoded image data stored in the shared memory and display at least a portion of the decoded image data on the first display.

[0024] On the other hand, the second guest virtual machine can be controlled to receive the decoded image data stored in the shared memory and display at least a portion of the decoded image data on the second display.

[0025] On the other hand, the first client virtual machine can be controlled to display a first image on the first display at a first time point, and the second client virtual machine can be controlled to display a second image corresponding to the first image on the second display at a second time point after the first time point.

[0026] On the other hand, the first client virtual machine can be controlled to display the first image on the first display at the first time point and the second time point after the first time point, and the second client virtual machine can be controlled to display the second image corresponding to the first image on the second display at the second time point.

[0027] On the other hand, the second guest virtual machine can be controlled to output the scaled second image to the second display based on the size or output resolution of the second display or the operating system.

[0028] On the other hand, a third guest virtual machine among the plurality of guest virtual machines operates for a third display. The third guest virtual machine can be controlled to receive the decoded image data stored in the shared memory and display at least a portion of the decoded image data on the third display.

[0029] On the other hand, the first client virtual machine can be controlled to display a first image on a first display at a first time point, the second client virtual machine can be controlled to display a second image corresponding to the first image on a second display at a second time point after the first time point, and the third client virtual machine can be controlled to display a third image corresponding to the first image on a third display at a third time point after the second time point.

[0030] On the other hand, the first client virtual machine can be controlled to display a first image on the first display at a first time point, a second time point after the first time point, and a third time point after the second time point. The second client virtual machine can be controlled to display a second image corresponding to the first image on the second display at the second time point and the third time point. The third client virtual machine can be controlled to display a third image corresponding to the first image on the third display at the third time point.

[0031] A vehicle display device according to one embodiment of the present invention includes: a plurality of displays; and a signal processing device, including a processor for performing signal processing for the plurality of displays, the signal processing device including a processor for performing signal processing for the plurality of displays installed on the vehicle, the processor running a server virtual machine and a plurality of client virtual machines on a hypervisor within the processor, a first client virtual machine and a second client virtual machine among the plurality of client virtual machines acting for the first display and the second display, respectively, the server virtual machine being controlled to encode processed image data and store it in a shared memory, the first client virtual machine being controlled to receive and decode the encoded image data stored in the shared memory and store the decoded image data in the shared memory, the second client virtual machine being controlled to receive the decoded image data stored in the shared memory and display at least a portion of the decoded image data on the second display.

[0032] Effects of the Invention

[0033] A signal processing device according to one embodiment of the present invention includes a processor that performs signal processing for a plurality of displays installed on a vehicle. The processor runs a server virtual machine and a plurality of client virtual machines on a hypervisor within the processor. A first client virtual machine and a second client virtual machine of the plurality of client virtual machines operate for a first display and a second display, respectively. The server virtual machine is controlled to encode processed image data and store it in a shared memory. The first client virtual machine is controlled to receive and decode the encoded image data stored in the shared memory and store the decoded image data in the shared memory. The second client virtual machine is controlled to receive the decoded image data stored in the shared memory and display at least a portion of the decoded image data on a second display. This reduces delays in image display between the plurality of displays.

[0034] On the other hand, the first guest virtual machine can be controlled to receive and decode the encoded image data stored in the shared memory, and display at least a portion of the decoded image data on the first display. This can reduce latency in image display between the multiple displays. Furthermore, images corresponding to the resolutions of the multiple displays can be displayed with reduced latency.

[0035] On the other hand, the first guest virtual machine can be controlled to display a first image on a first display at a first time point, and the second guest virtual machine can be controlled to display a second image corresponding to the first image on a second display at a second time point after the first time point. This can reduce the delay when images are moved and displayed between multiple displays.

[0036] On the other hand, the first guest virtual machine can be controlled to display a first image on a first display at a first time point and a second time point after the first time point, and the second guest virtual machine can be controlled to display a second image corresponding to the first image on a second display at a second time point. This can reduce the delay when copying and displaying images between multiple displays.

[0037] On the other hand, the second guest virtual machine can be controlled to output the scaled second image to the second display based on the size or output resolution of the second display or the operating system, thereby displaying images corresponding to the resolutions of the multiple displays with reduced latency.

[0038] On the other hand, a third guest virtual machine among the plurality of guest virtual machines operates for a third display. The third guest virtual machine can be controlled to receive the decoded image data stored in the shared memory and display at least a portion of the decoded image data on the third display.

[0039] On the other hand, the second guest virtual machine and the third guest virtual machine can share a portion of the shared memory area storing the decoded image data, thereby reducing the delay in image display between the multiple displays.

[0040] On the other hand, the first guest virtual machine can be controlled to display a first image on a first display at a first time point, the second guest virtual machine can be controlled to display a second image corresponding to the first image on a second display at a second time point after the first time point, and the third guest virtual machine can be controlled to display a third image corresponding to the first image on a third display at a third time point after the second time point. This can reduce the delay when images are moved and displayed between multiple displays.

[0041] On the other hand, the first guest virtual machine can be controlled to display a first image on a first display at a first time point, a second time point after the first time point, and a third time point after the second time point. The second guest virtual machine can be controlled to display a second image corresponding to the first image on a second display at the second time point and the third time point. The third guest virtual machine can be controlled to display a third image corresponding to the first image on a third display at the third time point. This can reduce the delay when copying and displaying images between multiple displays.

[0042] A signal processing device according to another embodiment of the present invention includes a processor that performs signal processing for a plurality of displays installed on a vehicle. The processor runs a server virtual machine and a plurality of client virtual machines on a hypervisor within the processor. A first client virtual machine and a second client virtual machine of the plurality of client virtual machines operate for a first display and a second display, respectively. The server virtual machine is controlled to encode processed image data and store it in a shared memory. The first client virtual machine receives the encoded image data stored in the shared memory and transmits a decoding request to the server virtual machine. The server virtual machine is controlled to decode the encoded image data based on the decoding request and store the decoded image data in the shared memory. The first client virtual machine is controlled to receive the decoded image data stored in the shared memory and display at least a portion of the decoded image data on the first display. This reduces the delay in image display between the plurality of displays.

[0043] On the other hand, the second guest virtual machine can be controlled to receive the decoded image data stored in the shared memory and display at least a portion of the decoded image data on the second display. This reduces image display latency between the multiple displays. Furthermore, images corresponding to the resolutions of the multiple displays can be displayed with reduced latency.

[0044] On the other hand, the first guest virtual machine can be controlled to display a first image on a first display at a first time point, and the second guest virtual machine can be controlled to display a second image corresponding to the first image on a second display at a second time point after the first time point. This can reduce the delay when images are moved and displayed between multiple displays.

[0045] On the other hand, the first guest virtual machine can be controlled to display a first image on a first display at a first time point and a second time point after the first time point, and the second guest virtual machine can be controlled to display a second image corresponding to the first image on a second display at a second time point. This can reduce the delay when copying and displaying images between multiple displays.

[0046] On the other hand, the second guest virtual machine can be controlled to output the scaled second image to the second display based on the size or output resolution of the second display or the operating system, thereby displaying images corresponding to the resolutions of the multiple displays with reduced latency.

[0047] On the other hand, a third guest virtual machine among the plurality of guest virtual machines operates as a third display. The third guest virtual machine can be controlled to receive decoded image data stored in the shared memory and display at least a portion of the decoded image data on the third display. This can reduce delays in image display between the plurality of displays.

[0048] On the other hand, the first guest virtual machine can be controlled to display a first image on a first display at a first time point, the second guest virtual machine can be controlled to display a second image corresponding to the first image on a second display at a second time point after the first time point, and the third guest virtual machine can be controlled to display a third image corresponding to the first image on a third display at a third time point after the second time point. This can reduce the delay when images are moved and displayed between multiple displays.

[0049] On the other hand, the first guest virtual machine can be controlled to display a first image on a first display at a first time point, a second time point after the first time point, and a third time point after the second time point. The second guest virtual machine can be controlled to display a second image corresponding to the first image on a second display at the second time point and the third time point. The third guest virtual machine can be controlled to display a third image corresponding to the first image on a third display at the third time point. This can reduce the delay when copying and displaying images between multiple displays.

[0050] A vehicle display device according to one embodiment of the present invention includes: a plurality of displays; and a signal processing device including a processor for performing signal processing for the plurality of displays, the signal processing device including the processor for performing signal processing for the plurality of displays installed in the vehicle, the processor running a server virtual machine and a plurality of client virtual machines on a hypervisor within the processor, a first client virtual machine and a second client virtual machine of the plurality of client virtual machines operating for the first display and the second display, respectively, the server virtual machine being controlled to encode processed image data and store it in a shared memory, the first client virtual machine being controlled to receive and decode the encoded image data stored in the shared memory and store the decoded image data in the shared memory, and the second client virtual machine being controlled to receive the decoded image data stored in the shared memory and display at least a portion of the decoded image data on a second display. Thus, it is possible to reduce delays in image display between the plurality of displays. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] Figure 1a It is a diagram showing an example of the vehicle exterior and the vehicle interior.

[0052] Figure 1b This is a diagram showing another example of the vehicle interior.

[0053] Figure 2 1 is a diagram showing the appearance of a vehicle display device according to an embodiment of the present invention.

[0054] Figure 3 Illustrated Figure 2 An example of an internal block diagram of a vehicle display device.

[0055] Figure 4 This is a diagram showing a system driven by a signal processing device related to the present invention.

[0056] Figure 5 This is a diagram showing an example of a system driven by the signal processing device according to the embodiment of the present invention.

[0057] Figure 6 This is a diagram showing another example of a system driven by the signal processing device according to the embodiment of the present invention.

[0058] Figure 7 This is a diagram showing another example of a system driven by the signal processing device according to the embodiment of the present invention.

[0059] Figures 8 to 9b It is explaining Figure 5 Refer to the figure when using .

[0060] Figure 10 This is a diagram showing the appearance of a vehicle display device according to another embodiment of the present invention.

[0061] Figure 11 This is a diagram illustrating another example of a system driven by the signal processing device according to the embodiment of the present invention.

[0062] Figures 12a to 12c This is an example of an internal block diagram of a vehicle display device according to the present invention.

[0063] Figure 13a This is an example of an internal block diagram of a vehicle display device according to an embodiment of the present invention.

[0064] Figure 13b This is an example of an internal block diagram of a vehicle display device according to another embodiment of the present invention.

[0065] Figures 14a to 16 It is explaining Figure 13a The diagram to refer to when performing the action.

[0066] Figure 17a This is an example of an operating method of a signal processing device according to an embodiment of the present invention.

[0067] Figure 17b This is another example of the operating method of the signal processing device according to one embodiment of the present invention.

[0068] Figure 18 This is another example of the operating method of the signal processing device according to one embodiment of the present invention.

[0069] Figures 19a to 19e It is explaining Figures 17a to 18 The diagram to refer to when performing the action.

[0070] Figure 20 This is another example of the operating method of the signal processing device according to one embodiment of the present invention.

[0071] Figures 21a to 21f It is explaining Figure 20 The diagram to refer to when performing the action.

[0072] Figure 22 This is another example of the operating method of the signal processing device according to one embodiment of the present invention.

[0073] Figures 23a to 23b It is explaining Figure 22 The diagram to refer to when performing the action. DETAILED DESCRIPTION

[0074] Hereinafter, the present invention will be described in more detail with reference to the accompanying drawings.

[0075] The suffixes "module" and "unit" used in the following description of the components are only given to facilitate the preparation of this specification and do not themselves have any particularly important meaning or function. Therefore, the above "module" and "unit" can be used interchangeably.

[0076] Figure 1a It is a diagram showing an example of the vehicle exterior and the vehicle interior.

[0077] , the vehicle 200 is moved by a plurality of wheels 103FR, 103FL, 103RL, ... and a steering wheel 150 . The plurality of wheels 103FR, 103FL, 103RL, ... are rotated by a power source, and the steering wheel 150 is used to adjust the traveling direction of the vehicle 200 .

[0078] On the other hand, the vehicle 200 may further include a camera 195 for acquiring images in front of the vehicle.

[0079] Meanwhile, a plurality of displays 180 a and 180 b for displaying images, information, and the like may be provided inside the vehicle 200 .

[0080] exist Figure 1a In the figure, as the plurality of displays 180a and 180b, an instrument cluster display 180a and an AVN (Audio Video Navigation) display 180b are exemplified. In addition, a HUD (Head Up Display) or the like may be used.

[0081] On the other hand, the AVN (Audio Video Navigation) display 180b may also be named a center information display (Center Information Display).

[0082] On the other hand, the vehicle 200 described in this specification may conceptually encompass a vehicle having an engine as a power source, a hybrid vehicle having an engine and an electric motor as power sources, an electric vehicle having an electric motor as a power source, and the like.

[0083] Figure 1b This is a diagram showing another example of the vehicle interior.

[0084] 1 , an instrument cluster display 180 a , an AVN (Audio Video Navigation) display 180 b , rear seat entertainment (Rear Seat Entertainment) displays 180 c and 180 d , a rearview mirror display (not shown), and the like may be installed inside the vehicle.

[0085] The embodiment of the present invention proposes a solution in which a vehicle display device 100 having a plurality of displays 180a to 180d can reduce the delay in displaying images between the plurality of displays. Figure 5 The following figures illustrate this.

[0086] Figure 2 1 is a diagram showing the appearance of a vehicle display device according to an embodiment of the present invention.

[0087] The vehicle display device 100 according to the embodiment of the present invention may include a plurality of displays 180 a - 180 b and a signal processing device 170 that performs signal processing for displaying images, information, etc. on the plurality of displays 180 a - 180 b .

[0088] Among the multiple displays 180a~180b, the first display 180a can be an instrument cluster display 180a for displaying driving status, action information, etc., and the second display 180b can be an AVN (Audio Video Navigation) display 180b for displaying vehicle driving information, navigation maps, various entertainment information or images.

[0089] The signal processing device 170 may be internally provided with a processor 175 , and may run first to third virtual machines 520 to 540 on a hypervisor 505 within the processor 175 .

[0090] The second virtual machine 530 may operate for the first display 180 a , and the third virtual machine 540 may operate for the second display 180 b .

[0091] On the other hand, the first virtual machine 520 in the processor 175 can be controlled to set up a shared memory 508 based on the hypervisor 505 in order to transmit the same data to the second virtual machine 530 and the third virtual machine 540. This allows the first display 180a and the second display 180b in the vehicle to display the same information or the same image in synchronization.

[0092] On the other hand, first virtual machine 520 in processor 175 shares at least part of data with second virtual machine 530 and third virtual machine 540 for data sharing processing. This allows data processing to be shared among multiple virtual machines for multiple displays in the vehicle.

[0093] On the other hand, the first virtual machine 520 in the processor 175 can receive and process the wheel speed sensor data of the vehicle, and transmit the processed wheel speed sensor data to at least one of the second virtual machine 530 and the third virtual machine 540. In this way, the wheel speed sensor data of the vehicle can be shared with at least one virtual machine, etc.

[0094] On the other hand, the vehicle display device 100 according to the embodiment of the present invention may further include a rear seat entertainment (Rear Seat Entertainment) display 180c for displaying driving status information, brief navigation information, various entertainment information or images.

[0095] In addition to the first to third virtual machines 520 to 540 , the signal processing device 170 may also control an RSE (Rear Seat Entertainment) display 180 c by running a fourth virtual machine (not shown) on the hypervisor 505 within the processor 175 .

[0096] Thus, one signal processing device 170 can be used to control various displays 180 a to 180 c .

[0097] On the other hand, some of the plurality of displays 180 a to 180 c may operate based on a Linux OS (operating system), while other parts may operate based on an Internet OS.

[0098] In the signal processing device 170 of the embodiment of the present invention, when a touch input occurs on any of the multiple displays 180a-180b or 180a-180c operating under various operating systems (OS), control can be performed to quickly and accurately process the touch input.

[0099] On the other hand, Figure 2 In the figure, it is illustrated that a vehicle speed indicator 212a and an in-vehicle temperature indicator 213a are displayed on the first display 180a, a main screen 222 including a plurality of applications, a vehicle speed indicator 212b and an in-vehicle temperature indicator 213b is displayed on the second display 180b, and a second main screen 222b including a plurality of applications and an in-vehicle temperature indicator 213c is displayed on the third display 180c.

[0100] Figure 3 An example of an internal block diagram of a vehicle display device according to an embodiment of the present invention is illustrated.

[0101] 1 , a vehicle display device 100 according to an embodiment of the present invention may include an input unit 110 , a communication unit 120 , an interface 130 , a memory 140 , a signal processing device 170 , a plurality of displays 180 a - 180 c , an audio output unit 185 , and a power supply unit 190 .

[0102] The input unit 110 may be provided with physical keys, a tablet, etc. for key input, touch input, etc.

[0103] On the other hand, the input unit 110 may be provided with a touch sensor (not shown) for sensing a touch input to the displays 180 a , 180 b , and 180 c .

[0104] On the other hand, the input unit 110 may be provided with a microphone (not shown) for the user to input voice.

[0105] The communication unit 120 may exchange data with the mobile terminal 800 or the server 900 in a wireless manner.

[0106] In particular, the communication unit 120 can exchange data with the vehicle driver's mobile terminal wirelessly. Various wireless data communication methods can be used, such as Bluetooth, WiFi (Wireless Fidelity), WiFi Direct, and ApiX (Automotive Pixel Link).

[0107] The communication unit 120 may receive weather information and road traffic status information, such as TPEG (Transport Protocol Expert Group) information, from the mobile terminal 800 or the server 900. To this end, the communication unit 120 may include a mobile communication module (not shown).

[0108] The interface 130 can receive sensor information and the like from an ECU (electronic control unit) 770 or a sensor device 760 , and transmit the received information to the signal processing device 170 .

[0109] Here, the sensor information may include at least one of vehicle direction information, vehicle position information (GPS information), vehicle angle information, vehicle speed information, vehicle acceleration information, vehicle inclination information, vehicle forward / backward information, battery information, fuel information, tire information, headlight information, in-vehicle temperature information, and in-vehicle humidity information.

[0110] Such sensor information may be obtained from a heading sensor, a yaw sensor, a gyro sensor, a positioning module, a vehicle forward / backward sensor, a wheel sensor, a vehicle speed sensor, a vehicle body tilt detection sensor, a battery sensor, a fuel sensor, a tire sensor, a steering sensor based on steering wheel rotation, an in-vehicle temperature sensor, an in-vehicle humidity sensor, etc. On the other hand, the positioning module may include a GPS module for receiving GPS information.

[0111] On the other hand, the interface 130 can receive vehicle front image data, vehicle side image data, vehicle rear image data, vehicle surrounding obstacle distance information, etc. from the camera 195 or the laser radar (not shown), and transmit the received information to the signal processing device 170.

[0112] The memory 140 can store various data used for the overall operation of the vehicle display device 100 , such as programs used for processing or control of the signal processing device 170 .

[0113] For example, the memory 140 may store data regarding a hypervisor and first to third virtual machines for running within the processor 175 .

[0114] The audio output unit 185 converts the electric signal from the signal processing device 170 into an audio signal and outputs the audio signal. For this purpose, a speaker or the like may be provided.

[0115] The power supply unit 190 can supply power required for the operation of each component under the control of the signal processing device 170. In particular, the power supply unit 190 can receive power from a battery or the like inside the vehicle.

[0116] The signal processing device 170 controls the overall operation of each unit in the vehicle display device 100 .

[0117] For example, a processor 175 may be included that performs signal processing for the vehicle displays 180a, 180b.

[0118] The processor 175 can be a hypervisor within the processor 175 ( Figure 5 505) and runs the first virtual machine 520 to the third virtual machine 540.

[0119] On the other hand, the processor 175 can also run a traditional virtual machine that receives and processes Ethernet data. Figure 5 As shown, a traditional virtual machine may run on a first virtual machine 520 within the processor 175 .

[0120] The first virtual machine to the third virtual machine ( Figure 5 The first virtual machine 520 in 520-540) is named as a server virtual machine (Server Virtual Maschine), and the second virtual machine 530 to the third virtual machine 540 can be named as a client virtual machine (Guest Virtual Maschine).

[0121] At this time, the second virtual machine 530 may operate for the first display 180 a , and the third virtual machine 540 may operate for the second display 180 b .

[0122] For example, the first virtual machine 520 within the processor 175 can receive vehicle sensor data, location information data, camera image data, audio data, or touch input data, and process or edit it before outputting it. By distinguishing between data processed exclusively in the traditional virtual machine and data processed in the first virtual machine 520, data processing can be performed efficiently. In particular, by performing the majority of data processing in the first virtual machine 520, data sharing can be achieved in a 1:N manner.

[0123] As another example, the first virtual machine 520 may directly receive and process CAN communication data, audio data, radio broadcast data, USB data, and wireless communication data for the second virtual machine 530 and the third virtual machine 540 .

[0124] Furthermore, the first virtual machine 520 may transmit the processed data to the second virtual machine 530 and the third virtual machine 540 .

[0125] Thus, among the first virtual machine 520 to the third virtual machine 540, only the first virtual machine 520 receives communication data, external input data and performs signal processing, thereby reducing the signal processing burden of other virtual machines and enabling 1:N data communication, thereby enabling synchronization when sharing data.

[0126] On the other hand, the first virtual machine 520 stores a portion of the data in a first shared memory (not shown) for transmission to the second virtual machine 530, and stores another portion of the data in the first shared memory (not shown) for transmission to the third virtual machine. The second virtual machine 530 and the third virtual machine 540 are controlled to process the transmitted data and store the processed data in the second shared memory (not shown). This reduces the delay in displaying images between multiple displays.

[0127] The data at this time may be any one of image data, audio data, navigation data, or voice recognition data.

[0128] On the other hand, the first virtual machine 520 can be controlled to process another part of the data and record the processed data in the second shared memory (not shown). In other words, in addition to the second virtual machine 530 and the third virtual machine, the first virtual machine 520 can also perform additional data processing.

[0129] On the other hand, when the fourth virtual machine 550 acting as the third display 180c is running in the processor 175, the first virtual machine 520 can record another part of the data in the first shared memory (not shown), and the fourth virtual machine 550 can be controlled to process each received data and record the processed data in the second shared memory (not shown).

[0130] On the other hand, the first virtual machine 520 may generate command queues for distributing data processing in the second virtual machine 530 to the third virtual machine 540. This allows data to be shared and processed among a plurality of virtual machines.

[0131] On the other hand, when the second virtual machine 530 to the third virtual machine 540 share the same data, the first virtual machine 520 in the processor 175 can generate a same command queue, thereby synchronizing and sharing the same data.

[0132] On the other hand, the first virtual machine 520 may generate a command queue corresponding to the number of virtual machines for distributed processing of data.

[0133] On the other hand, the first virtual machine 520 may be controlled to transmit at least a portion of the data to at least one of the second virtual machine 530 and the third virtual machine 540 for data distribution processing.

[0134] For example, the first virtual machine 520 may allocate a first shared memory (not shown) for transmitting at least a portion of the data to at least one of the second virtual machine 530 and the third virtual machine 540, and the image data processed in the second virtual machine 530 or the third virtual machine 540 may be recorded in the second shared memory (not shown).

[0135] On the other hand, the first virtual machine 520 may be controlled to record data in the shared memory 508 and share the same data with the second virtual machine 530 and the third virtual machine 540 .

[0136] For example, the first virtual machine 520 may be controlled to record radio broadcast data or wireless communication data in the shared memory 508 and share the same data with the second virtual machine 530 and the third virtual machine 540. In this way, 1:N data sharing can be achieved.

[0137] As a result, by executing most of the data processing in the first virtual machine 520 , data sharing in a 1:N manner can be achieved.

[0138] On the other hand, the first virtual machine 520 in the processor 175 may be controlled so that the shared memory 508 based on the hypervisor 505 is set in order to transfer the same data to the second virtual machine 530 and the third virtual machine 540 .

[0139] That is, the first virtual machine 520 in the processor 175 can synchronize the same data using the shared memory 508 based on the hypervisor 505 and transmit it to the second virtual machine 530 and the third virtual machine 540. This allows the same image to be synchronously displayed on the multiple displays 180a-180b in the vehicle.

[0140] On the other hand, the signal processing device 170 can process various signals such as audio signals, image signals, data signals, etc. To this end, the signal processing device 170 can be implemented in the form of a system on chip (SOC).

[0141] Figure 4 This is a diagram showing a system driven by a signal processing device related to the present invention.

[0142] With reference to the accompanying drawings, Figure 4 This is a diagram illustrating the use of virtual machines for the instrument cluster display 180 a and the AVN display 180 b .

[0143] Figure 4 The system 400 driven in the signal processing device exemplifies a case where an instrument cluster virtual machine 430 and an AVN virtual machine 440 are run on a hypervisor 405 in the processor 175 .

[0144] on the other hand, Figure 4 The system 400 driven in the signal processing device exemplifies a situation where a legacy virtual machine 410 is also run on a hypervisor 405 within the processor 175 .

[0145] The legacy virtual machine 410 has an interface 412 for data communication with the memory 140 and an interface 413 for Ethernet communication.

[0146] On the other hand, the instrument cluster virtual machine 430 may have an interface 431 for CAN communication, an interface 432 for communicating with the interface 412 of the legacy virtual machine 410 , and an interface 433 for communicating with the interface 413 of the legacy virtual machine 410 .

[0147] On the other hand, the AVN virtual machine 440 may have an interface 441 for input and output of audio data, radio broadcast data, USB data, and wireless communication data, an interface 442 for communicating with the interface 412 of the legacy virtual machine 410, and an interface 443 for communicating with the interface 413 of the legacy virtual machine 410.

[0148] According to such a system 400 , CAN communication data is input and output only in the instrument cluster virtual machine 430 , and therefore there is a disadvantage that the CAN communication data cannot be used in the AVN virtual machine 440 .

[0149] In addition, according to Figure 4In the system 400 , audio data, radio broadcast data, USB data, and wireless communication data are input and output only in the AVN virtual machine 440 , so there is a disadvantage that the above data cannot be used in the instrument cluster virtual machine 430 .

[0150] On the other hand, there is a disadvantage in that the instrument cluster virtual machine 430 and the instrument cluster virtual machine 430 need to have separate interfaces 431 , 432 , 441 , and 442 respectively in order to input and output memory data and Ethernet communication data in the legacy virtual machine 410 .

[0151] Therefore, the present invention proposes a method for improving Figure 4 That is, with Figure 4 Differently, virtual machines are divided into server virtual machines and client virtual machines. Various storage data, communication data, etc. are input and output in the server virtual machine, but not in the client virtual machine. Figure 5 The following figures illustrate this.

[0152] Figure 5 This is a diagram showing an example of a system driven by the signal processing device according to the embodiment of the present invention.

[0153] With reference to the accompanying drawings, Figure 5 The system 500 illustrates a scenario in which a first virtual machine 520 as a server virtual machine, a second virtual machine 530 as a client virtual machine, and a third virtual machine 540 as a client virtual machine are run on a hypervisor 505 in a processor 175 in a signal processing device 170 .

[0154] The second virtual machine 530 may be a virtual machine for the instrument cluster display 180 a , and the third virtual machine 540 may be a virtual machine for the AVN display 180 b .

[0155] That is, the second virtual machine 530 and the third virtual machine 540 may operate for image rendering of the instrument cluster display 180 a and the AVN display 180 b , respectively.

[0156] On the other hand, the example Figure 5 In the system 500 driven by the signal processing device 170 , a legacy virtual machine 510 is also run on the hypervisor 505 in the processor 175 .

[0157] The legacy virtual machine 510 has an interface 511 for data communication with the memory 140 and Ethernet communication.

[0158] In the drawings, the case where the interface 511 is a physical device driver is illustrated, but various modifications are possible.

[0159] On the other hand, the legacy virtual machine 510 may further include an interface (virtio-backend interface) 512 for performing data communication with the second virtual machine 530 to the third virtual machine 540 .

[0160] The first virtual machine 520 may have an interface 521 for input and output of audio data, radio broadcast data, USB data, and wireless communication data, and an input and output server interface 522 for data communication with a client virtual machine.

[0161] That is, the first virtual machine 520 as a server virtual machine can provide I / O that is difficult to virtualize to a plurality of client virtual machines, such as the second virtual machine 530 to the third virtual machine 540, through standard virtualization technology (VirtIO).

[0162] On the other hand, the first virtual machine 520 as a server virtual machine controls radio broadcast data, audio data, etc. at a supervisor level and provides them to a plurality of client virtual machines, such as the second virtual machine 530 to the third virtual machine 540 .

[0163] On the other hand, the first virtual machine 520 as a server virtual machine can process vehicle data, sensor data, vehicle surrounding information, etc., and provide the processed data or information to multiple client virtual machines, such as the second virtual machine 530 to the third virtual machine 540, etc.

[0164] On the other hand, the first virtual machine 520 can provide services (Supervisory Services) such as vehicle data processing and audio routing management.

[0165] Next, the second virtual machine 530 may include an input / output client interface 532 for performing data communication with the first virtual machine 520 and APIs 533 for controlling the input / output client interface 532 .

[0166] In addition, the second virtual machine 530 may have an interface (virtio-backend interface) for performing data communication with the traditional virtual machine 510 .

[0167] The second virtual machine 530 may receive memory data based on communication with the memory 140 or Ethernet data based on Ethernet communication from the interface (virtio-backend interface) 512 of the legacy virtual machine 510 through the interface (virtio-backend interface).

[0168] Next, the third virtual machine 540 may include an input / output client interface 542 for performing data communication with the first virtual machine 520 and APIs 543 for controlling the input / output client interface 542 .

[0169] In addition, the third virtual machine 540 may have an interface (virtio-backend interface) for performing data communication with the traditional virtual machine 510 .

[0170] The third virtual machine 540 may receive memory data based on communication with the memory 140 or Ethernet data based on Ethernet communication from the interface (virtio-backend interface) 512 of the legacy virtual machine 510 through the interface (virtio-backend interface).

[0171] On the other hand, Figure 5 Differently, a legacy virtual machine 510 may also be set within the first virtual machine 520 .

[0172] According to such system 500, although CAN communication data is input and output only in first virtual machine 520, it can be provided to multiple client virtual machines, such as second virtual machine 530, third virtual machine 540, etc., through data processing performed by first virtual machine 520. Therefore, 1:N data communication based on processing by first virtual machine 520 can be achieved.

[0173] In addition, according to Figure 5 In system 500, although audio data, radio broadcast data, USB data, and wireless communication data are input and output only in first virtual machine 520, data processing performed in first virtual machine 520 can be provided to multiple client virtual machines, such as second virtual machine 530, third virtual machine 540, and so on. Thus, 1:N data communication based on processing by first virtual machine 520 can be achieved.

[0174] In addition, according to Figure 5In the system 500, the touch input (Touch) of the first display 180a or the second display 180b is input only to the first virtual machine 520, and is not input to the second virtual machine 530 to the third virtual machine 540. Information regarding the touch input (Touch) can be transmitted to the second virtual machine 530 or the third virtual machine 540.

[0175] This allows for quick and accurate processing of touch inputs. Furthermore, even if the number of virtual machines being driven increases, quick and accurate processing of touch inputs can be achieved.

[0176] On the other hand, Figure 5 In the system 500 , the second virtual machine 530 to the third virtual machine 540 may operate based on different OSs.

[0177] For example, the second virtual machine 540 may operate based on the Linux OS, and the third virtual machine 540 may operate based on the Internet OS.

[0178] Even if the second virtual machine 530 to the third virtual machine 540 operate under different operating systems, the first virtual machine 520 can configure the shared memory 508 using the hypervisor 505 for data sharing. Thus, even if the second virtual machine 530 to the third virtual machine 540 operate under different operating systems (OS), they can synchronize and share the same data or the same image. As a result, the same data or the same image can be displayed synchronously on the multiple displays 180a and 180b.

[0179] On the other hand, even if the second virtual machine 530 to the third virtual machine 540 operate based on different operating systems, the first virtual machine 520 transmits information regarding touch input to the second virtual machine 530 or the third virtual machine 540. Thus, even if the second virtual machine 530 to the third virtual machine 540 operate based on different operating systems (OS), touch input processing can be performed quickly and accurately.

[0180] On the other hand, the first virtual machine 520 can have a display manager 527, a display layer server 529 and an overlay generator 523, the display manager 527 is used to control the overlay displayed on the first display 180a and the second display 180b through the second virtual machine 530 to the third virtual machine 540, and the overlay generator 523 generates an overlay (virtual overlay).

[0181] The display layer server 529 may receive the first overlay layer provided by the second virtual machine 530 and the second overlay layer provided by the third virtual machine 540 .

[0182] On the other hand, the display layer server 529 may transmit the overlay layer (virtual overlay) generated by the overlay layer generator 523 to at least one of the second virtual machine 530 and the third virtual machine 540 .

[0183] On the other hand, the display manager 527 in the first virtual machine 520 may receive the first overlay layer provided by the second virtual machine 530 and the second overlay layer provided by the third virtual machine 540 through the display layer server 529 .

[0184] Furthermore, the display manager 527 in the first virtual machine 520 may control the transmission of an overlay layer (virtual overlay) different from the first overlay layer or the second overlay layer to at least one of the second virtual machine 530 and the third virtual machine 540 via the display layer server 529 .

[0185] Correspondingly, the second virtual machine 530 may be controlled to synthesize the first overlay layer and the overlay layer (virtual overlay) and display them on the first display 180 a .

[0186] In addition, the third virtual machine 540 may be controlled to synthesize the second overlay layer and the overlay layer (virtual overlay) and display them on the second display 180 b.

[0187] On the other hand, the first virtual machine 520 may be provided with an input manager 524 for receiving input signals from the outside. The input signal may be an input signal from a predetermined button (such as a start button) in the vehicle, a touch input signal, or a voice input signal.

[0188] For example, the input manager 524 within the first virtual machine 520 may receive touch input from the first display 180 a or the second display 180 b .

[0189] On the other hand, the first virtual machine 520 may be provided with a touch server 528 that transmits touch input (Touch) information related to the touch input from the first display 180 a or the second display 180 b to the second virtual machine 530 or the third virtual machine 540 .

[0190] For example, when there is a touch input corresponding to the first display 180 a , the touch server 528 within the first virtual machine 520 may transmit information about the touch input (Touch) to the second virtual machine 530 .

[0191] On the other hand, the touch server 528 in the first virtual machine 520 may also receive touch input from the first display 180 a or the second display 180 b .

[0192] Figure 6 This is a diagram showing another example of a system driven by the signal processing device according to the embodiment of the present invention.

[0193] With reference to the accompanying drawings, according to Figure 6 The system 500b is driven by the processor 175 in the signal processing device 170, and the processor 175 in the signal processing device 170 runs the first virtual machine 520 to the third virtual machine 540 on the hypervisor 505 in the processor 175. The first virtual machine 520 in the processor 175 is controlled to set a shared memory 508 based on the hypervisor 505 in order to transmit data to the second virtual machine 530 and the third virtual machine 540.

[0194] For example, information regarding touch input can be exemplified as data. This information is then transmitted to the second virtual machine 530 or the third virtual machine 540, ultimately enabling prompt and accurate processing of touch input to the first display 180a or the second display 180b. Furthermore, even if the number of virtual machines being driven increases, prompt and accurate processing of touch input is possible.

[0195] As another example, image data may be exemplified as the data, thereby allowing the image to be displayed on the first display 180a or the second display 180b.

[0196] On the other hand, when the shared memory 508 shares the same image data, the same image may be displayed synchronously on the plurality of displays 180 a - 180 b in the vehicle.

[0197] As another example, the data may include CAN communication data, audio data, radio broadcast data, USB data, wireless communication data, position information data, etc. Thus, information about the corresponding data may be displayed on the first display 180a or the second display 180b.

[0198] On the other hand, although Figure 6 Although not shown, the traditional virtual machine 510 can transmit memory data from the memory 140 or Ethernet data based on Ethernet communication to the second virtual machine 530 and the third virtual machine 540 using the shared memory 508 based on the hypervisor 505. As a result, information corresponding to the memory data or Ethernet data can be displayed on the first display 180a or the second display 180b.

[0199] On the other hand, Figure 5 Similarly, the first virtual machine within the system 500, Figure 6 The first virtual machine 520 within the system 500b may have a display manager 527 , a display layer server 529 , an overlay generator 523 , an input manager 524 , and a touch server 528 .

[0200] On the other hand, Figure 5 Differently, Figure 6 The input / output server interface 522 in the first virtual machine 520 in the system 500 b may include a display layer server 529 and a touch server 528 .

[0201] Due to the actions of the display manager 527, display layer server 529, input manager 524, overlay generator 523, touch server 528 and Figure 5 The same, so the description thereof is omitted.

[0202] on the other hand, Figure 6 The first virtual machine 520 may also have a system manager for controlling the entire system, a vehicle information manager for managing vehicle information, an audio manager for controlling audio, a radio manager for controlling radio broadcasting, and the like.

[0203] on the other hand, Figure 6 The input and output server interface 522 within the first virtual machine 520 within the system 500b may also include a GNSS (Global Navigation Satellite System) server for input and output of GPS information, a Bluetooth server for Bluetooth input and output, a Wireless Fidelity server for Wireless Fidelity input and output, a camera server for camera data input and output, and the like.

[0204] Figure 7 This is a diagram showing another example of a system driven by the signal processing device according to the embodiment of the present invention.

[0205] Referring to the accompanying drawings, Figure 7 The system 500c driven by the processor 175 in the signal processing device 170 is Figure 6 The system 500b is almost similar.

[0206] That is, with Figure 6 Similarly, Figure 7 The processor 175 runs the first virtual machine 520 to the third virtual machine 540 on the hypervisor 505 within the processor 175 .

[0207] However, with Figure 6 Differently, in Figure 7 In the embodiment, the display layer server 529 and the touch server 528 can be set outside the input / output server interface 522 in the first virtual machine 520 and run.

[0208] In addition, with Figure 6 Differently, a GNSS server for GPS information input and output, a Bluetooth server for Bluetooth input and output, a wireless fidelity server for wireless fidelity input and output, a camera server for camera data input and output, etc. can be set up outside the input and output server interface 522 in the first virtual machine 520 and run.

[0209] That is, the display manager 527 , the display layer server 529 , the overlay generator 523 , the input manager 524 , and the touch server 528 may be provided within the first virtual machine 520 and run.

[0210] Due to the actions of the display manager 527, display layer server 529, overlay generator 523, input manager 524, touch server 528 and Figure 5 The same, so the description thereof is omitted.

[0211] Figures 8 to 9b It is explaining Figure 5 Refer to the figure when using .

[0212] first, Figure 8 An example is provided of running the first virtual machine 520 to the third virtual machine 540 on the hypervisor 505 within the processor 175 within the system 500 of an embodiment of the present invention, wherein the first virtual machine 520 within the processor 175 is controlled to be set with a shared memory 508 based on the hypervisor 505 in order to transmit the same data to the second virtual machine 530 and the third virtual machine 540.

[0213] This allows the same image to be displayed synchronously on the plurality of displays 180 a to 180 b in the vehicle.

[0214] On the other hand, high-speed data communication can be performed between a plurality of virtual machines. Furthermore, even if a plurality of virtual machines are driven by different operating systems, high-speed data communication can be performed.

[0215] On the other hand, when the first virtual machine 520 in the processor 175 transmits data processed by the first virtual machine 520 to other virtual machines, it is not necessary to allocate a number of memories corresponding to the number of virtual machines, but to use a single shared memory 508. Thus, it is possible to implement 1:N data communication using the shared memory 508, rather than 1:1 data communication between virtual machines.

[0216] On the other hand, the first virtual machine 520 within the processor 175 may include an input / output server interface 522 and a security manager 526 .

[0217] On the other hand, the second virtual machine 530 and the third virtual machine 540 may include input / output client interfaces 532 and 542, respectively. Thus, high-speed data communication between multiple virtual machines can be performed using the input / output server interface 522 and the input / output client interfaces 532 and 542.

[0218] The I / O server interface 522 in the first virtual machine 520 may receive the same data transfer request from the I / O client interfaces 532 and 542 in the second virtual machine 530 and the third virtual machine 540 , and based on the request, transfer the shared data to the shared memory 508 via the security manager 526 .

[0219] Figure 9a A more detailed diagram for shared data transfer is illustrated.

[0220] 1 , for shared data transfer, the I / O server interface 522 in the first virtual machine 520 transmits a request for allocation of the shared memory 508 to the security manager 526 ( S1 ).

[0221] Next, the security manager 526 may use the hypervisor 505 to allocate the shared memory 508 ( S2 ) and record the shared data in the shared memory 508 .

[0222] On the other hand, after allocating the shared memory 508 , the I / O client interfaces 532 and 542 may transmit a connection request to the I / O server interface 522 ( S3 ).

[0223] On the other hand, after allocating the shared memory 508, the I / O server interface 522 transmits information about the shared memory 508 including key data to the I / O client interfaces 532 and 542 (S4). The key data in this case may be private key data.

[0224] That is, on the other hand, after the shared memory 508 is set, the first virtual machine 520 in the processor 175 may transmit information about the shared memory 508 to the second virtual machine 530 and the third virtual machine 540 .

[0225] Next, in order to distribute processing control among virtual machines, the input / output server interface 522 in the first virtual machine 520 may be controlled to generate a command queue for instructions or event processing that is not related to data processing ( S5 ).

[0226] The figure illustrates a case where a command queue is generated in the command queue buffer 504 within the hypervisor 505 under the control of the I / O server interface 522. However, the present invention is not limited thereto and may be generated in the first virtual machine 520 under the control of the I / O server interface 522 instead of the hypervisor 505.

[0227] Next, each of the input / output client interfaces 532 and 542 may receive the generated command queue or information about the command queue by accessing the command queue buffer 504 ( S6 ).

[0228] For example, when the instructions transmitted to the respective input / output client interfaces 532 and 542 are the same, the generated command queues may be the same.

[0229] As another example, when the commands transmitted to the respective I / O client interfaces 532 and 542 are different from each other, different command queues may be transmitted to the respective I / O client interfaces 532 and 542 .

[0230] Next, each of the input / output client interfaces 532 and 542 may access the shared memory 508 based on the received key data ( S5 ), and copy or read the shared data from the shared memory 508 ( S7 ).

[0231] In particular, when each input / output client interface 532 , 542 receives the same shared data, the input / output client interface 532 , 542 can access the shared memory 508 ( S5 ) based on the same command queue and the same key data, and copy or read the shared data from the shared memory 508 .

[0232] Thus, the second virtual machine 530 and the third virtual machine 540 can access the shared memory 508 and, as a result, can share shared data.

[0233] For example, when the shared data is image data, the second virtual machine 530 and the third virtual machine 540 share the image data, and ultimately the multiple displays 180 a - 180 b in the vehicle can synchronously display the same shared image.

[0234] Figure 9b Illustrated using Figure 9a The system 500 displays the image data received by the second virtual machine 530 through the shared memory 508 on the first display 180a, and displays the image data received by the third virtual machine 540 through the shared memory 508 on the second display 180b.

[0235] exist Figure 9b, a case is illustrated in which an image 905 a displayed on the first display 180 a and an image 905 b displayed on the second display 180 b are synchronized, and the same images 905 a and 905 b are respectively displayed at a time point T1 .

[0236] Specifically, the image data processed by the first virtual machine 520 within the processor 175 is transmitted to the second virtual machine 530 and the third virtual machine 540 via the shared memory 508. Based on the image data, the first image 905a displayed on the first display 180a and the second image 905b displayed on the second display 180b can be identical. This allows the multiple displays 180a-180b within the vehicle to display the same image in sync.

[0237] Figure 10 This is a diagram showing the appearance of a vehicle display device according to another embodiment of the present invention.

[0238] Referring to the accompanying drawings, a vehicle display device 100 according to another embodiment of the present invention may include a plurality of displays 180a, 180b, and 180m extending from the main passenger seat to the front passenger seat, and a signal processing device 170 that performs signal processing for displaying images, information, etc. on the plurality of displays 180a, 180b, and 180m.

[0239] In this case, the plurality of displays 180a, 180b, and 180m may be arranged within a single frame.

[0240] For example, the plurality of displays 180a, 180b, 180m may be one display 170t implemented in a seamless manner.

[0241] Among the plurality of displays 180a, 180b, 180m, the first display 180a may be an instrument cluster display, the second display 180b may be an AVN display, and the third display 180m may be a passenger display.

[0242] The signal processing device 170 may be internally provided with a processor 175 , and may run a server virtual machine 520 and first to third client virtual machines 530 to 550 on a hypervisor 505 within the processor 175 .

[0243] The first guest virtual machine 530 may act for the first display 180 a , the second guest virtual machine 540 may act for the second display 180 b , and the third guest virtual machine 550 may act for the third display 180 m .

[0244] Figure 11 This is a diagram illustrating another example of a system driven by the signal processing device according to the embodiment of the present invention.

[0245] With reference to the accompanying drawings, according to Figure 11 In the system 500d, the processor 175 in the signal processing device 170 of the embodiment of the present invention drives the hypervisor 505, and runs the server virtual machine 520, the first client virtual machine 530, the second client virtual machine 540, and the third client virtual machine 550 on the hypervisor 505.

[0246] On the other hand, the server virtual machine 520 of an embodiment of the present invention can change the layer order or display area of the overlay layer, and can transmit information about the changed overlay layer or the changed overlay layer to the first client virtual machine 530 or the second client virtual machine 540 or the third client virtual machine 550 so that the changed overlay layer is displayed on the first display 180a or the second display 180b or the third display 180m.

[0247] On the other hand, the first guest virtual machine 530, the second guest virtual machine 540, or the third guest virtual machine 550 can be controlled to synthesize the changed overlay layer on each physical overlay layer and display the synthesized overlay layer on the first display 180a, the second display 180b, or the third display 180m.

[0248] On the other hand, the server virtual machine 520 may have a display manager 527 including an overlay controller 527 a that controls an overlay, a layer controller 527 b that controls a layer, and a composition controller 527 c that controls construction or sequence of layers.

[0249] On the other hand, the input-output server interface 522 within the server virtual machine 520 may have a front-end interface VEa, which transmits instructions for constructing an overlay layer to the first client virtual machine 530 to the second client virtual machine 540, or receives instructions for constructing an overlay layer from the first client virtual machine 530 to the second client virtual machine 540.

[0250] On the other hand, the input / output client interface 532 in the first client virtual machine 530 may have a front-end interface VEb, which receives instructions for overlay construction from the server virtual machine 520 or transmits instructions for overlay construction to the server virtual machine 520 .

[0251] On the other hand, the first guest virtual machine 530 may include a window manager 537 for controlling windows for generating or displaying an overlay image, and a compositor 538 for compositing an overlay or a window generated by the first guest virtual machine 530 .

[0252] On the other hand, the input / output client interface 542 in the second client virtual machine 540 may have a front-end interface VEc, which receives instructions for overlay construction from the server virtual machine 520 or transmits instructions for overlay construction to the server virtual machine 520 .

[0253] On the other hand, the second guest virtual machine 540 may include a window manager 547 for controlling windows for generating or displaying an overlay image, and a compositor 548 for compositing an overlay or a window generated by the second guest virtual machine 540 .

[0254] On the other hand, the input / output client interface 552 in the third client virtual machine 550 may have a front-end interface VEd, which receives instructions for overlay construction from the server virtual machine 520 or transmits instructions for overlay construction to the server virtual machine 520 .

[0255] On the other hand, the third guest virtual machine 550 may include a window manager 557 for controlling windows for generating or displaying an overlay image, and a compositor 558 for compositing an overlay or a window generated in the third guest virtual machine 550 .

[0256] On the other hand, the server virtual machine 520 and the first to third client virtual machines 530 to 550 can utilize the shared memory 508 to transmit or receive respective overlay layer or image data.

[0257] On the other hand, the server virtual machine 520 can change the configuration of the layers displayed on the first display 180a, the second display 180b, or the third display 180c at runtime.

[0258] On the other hand, the server virtual machine 520 can control the generated overlay or image to move and display on the first display 180a, the second display 180b, or the third display 180c. In this way, the generated overlay or image can be easily moved.

[0259] Figures 12a to 12c It is a diagram for explaining the operation of the vehicle display device according to the present invention.

[0260] first, Figure 12a This is an example of an internal block diagram of a vehicle display device according to the present invention.

[0261] 1. Referring to the drawings, a vehicle display device 100x according to the present invention may include a first display 180a, a second display 180b, and a third display 180m, and may include signal processing devices 170xa, 170xb, and 170xc for driving the respective displays.

[0262] For example, in order to move the image displayed on the first display 180a to the second display 180b and the third display 180m for display, the image data encoded in the first signal processing device 170xa needs to be transmitted to the second signal processing device 170xb and the third signal processing device 170xc via a cable, and the second signal processing device 170xb and the third signal processing device 170xc need to respectively decode the encoded image data and perform image display based on the decoded image data.

[0263] Therefore, when each of the plurality of displays 180a, 180b, and 180m uses its own signal processing device 170xa, 170xb, and 170xc to perform image movement display or image copy display, there is a problem that the image processing amount and delay increase significantly.

[0264] Figures 12b to 12c It is explaining Figure 12a Refer to the figure when using .

[0265] Figure 12b The example shows a case where the image IMGx is divided into three areas IMGxa, IMGxb, and IMGxc in the first signal processing device 170xa.

[0266] For example, in Figure 12a In order to display the three areas IMGxa, IMGxb, and IMGxc on multiple displays 180a, 180b, and 180m, the first signal processing device 170xa can encode two areas MGxb and IMGxc of the three areas IMGxa, IMGxb, and IMGxc, and transmit them to the second signal processing device 170xb and the third signal processing device 170xc via a cable.

[0267] Furthermore, the second signal processing device 170xb and the third signal processing device 170xc can each receive the encoded image data of the corresponding regions in the two regions MGxb and IMGxc and perform decoding, respectively. As described above, when the respective signal processing devices 170xa, 170xb, and 170xc are used for image shifting or image copying, the image processing load and delay increase significantly.

[0268] Figure 12c It is an example of Figure 12a FIG. 1 is a diagram showing a situation in which camera data is processed in a vehicle display device 100x.

[0269] 1 , the first signal processing device 170xa includes an encoder 1210 that receives and encodes camera data, a transmitter 1212 that transmits the encoded camera data, and a decoder 1216 that decodes the encoded camera data.

[0270] The decoder 1216 performs three decoding operations for the first display 180a, the second signal processing device 170xb, and the third signal processing device 170xc, and outputs three decoded camera data Dtx, Dty, and Dtz, respectively.

[0271] For example, the first decoded camera data Dtx and the second decoded camera data Dty are output to the second signal processing device 170xb and the third signal processing device 170xc, respectively, and the third decoded camera data Dtz is displayed on the first display 180a.

[0272] The second signal processing device 170xa includes a receiver 1232 for receiving camera data and a decoder 1224 for decoding the camera data.

[0273] On the other hand, the decoder 1224 receives the first decoded camera data Dtx from the first signal processing device 170xa, processes it, and displays it on the second display 180b.

[0274] The third signal processing device 170 xc includes a receiver 1232 for receiving camera data and a decoder 1234 for decoding the camera data.

[0275] On the other hand, the decoder 1234 receives the third decoded camera data Dty from the first signal processing device 170xa, processes it, and displays it on the third display 180c.

[0276] according to Figure 12c , the same camera data is decoded three times and three decoded camera data Dtx, Dty, and Dtz are output respectively, so there is a problem of greatly increased image processing amount and delay. In this regard, the present invention proposes a solution that can reduce the delay when displaying images between multiple displays. In this regard, refer to Figure 13a The following figures illustrate this.

[0277] Figure 13a This is an example of an internal block diagram of a vehicle display device according to an embodiment of the present invention.

[0278] 1 , a vehicle display device 100 m according to an embodiment of the present invention includes at least one camera 195 and a signal processing device 170 for performing signal processing on image data and the like from the camera.

[0279] The signal processing device 170 according to one embodiment of the present invention includes a processor 175 for performing signal processing for a plurality of displays 180 a and 180 b mounted on a vehicle.

[0280] The processor 175 of one embodiment of the present invention runs a server virtual machine 520 and a plurality of client virtual machines 530 - 540 on a hypervisor 505 within the processor 175 .

[0281] The first guest virtual machine 530 and the second guest virtual machine 540 among the plurality of guest virtual machines 530 - 550 operate on the first display 180 a and the second display 180 b , respectively.

[0282] The server virtual machine 520 is controlled to encode the processed image data and store it in the shared memory 508 .

[0283] The first client virtual machine 530 is controlled to receive and decode the encoded image data stored in the shared memory 508 , and store the decoded image data in the shared memory 508 .

[0284] The second guest virtual machine 540 receives the decoded image data stored in the shared memory 508 and displays at least a portion of the decoded image data on the second display 180b. This reduces the delay in image display between the multiple displays 180a and 180b.

[0285] On the other hand, the first guest virtual machine 530 controls the receiving and decoding of the encoded image data stored in the shared memory 508, and displays at least a portion of the decoded image data on the first display 180a. This reduces the delay in image display between the plurality of displays 180a and 180b. Furthermore, images corresponding to the respective resolutions of the plurality of displays 180a and 180b can be displayed with reduced latency.

[0286] On the other hand, image data can be camera data, radar data, lidar data, streaming data, etc.

[0287] For example, the server virtual machine 520 has a receiving unit 1305 for receiving camera data from the camera 195 and can run a playback application 1318 and a control channel 1311 .

[0288] The server virtual machine 520 may store the encoded camera data in the shared memory 508 through the control channel 1311 and may transmit a control message to the shared memory 508 .

[0289] For example, the control channel 1311 may transmit control messages related to bitrate, latency negotiation, buffer sharing, or time stamp (eg, frame forced drop) to the shared memory 508 .

[0290] The first client virtual machine 530 can run a playback application 1328 and a control channel 1321. The control channel 1321 can act similarly to the control channel 1311.

[0291] For example, the first client virtual machine 530 may receive the encoded camera data through the control channel 1321 and may decode the encoded camera data through the decoder 1324 within the playback application 1328 .

[0292] Furthermore, the first client virtual machine 530 may store the decoded camera data in the shared memory 508 through the control channel 1321 , and may transmit a control message to the shared memory 508 .

[0293] The second guest virtual machine 540 can run a playback application 1338 and a control channel 1331. The control channel 1331 can act similarly to the control channel 1311.

[0294] For example, the second guest virtual machine 540 is controlled to receive the decoded camera data via the control channel 1331, receive the decoded camera data via the playback application 1338, and display the decoded camera data on the second display 180b. This reduces the delay in image display between the multiple displays 180a and 180b.

[0295] Figure 13b This is an example of an internal block diagram of a vehicle display device according to another embodiment of the present invention.

[0296] With reference to the accompanying drawings, Figure 13b The signal processing device 170 and Figure 13a The signal processing device is similar to that of FIG. 5 , but the difference is that the hypervisor 505 and the shared memory 508 are set in the server virtual machine 520 . Other actions can be performed in the same manner.

[0297] Figures 14a to 16 It is explaining Figure 13a The diagram to refer to when performing the action.

[0298] Figure 14a The example shows a case where a first display 180a among a plurality of displays 180a, 180b, and 180m in the vehicle 200 displays an image 180t based on camera data.

[0299] As described above, the image 180t based on the camera data only displays the lower portion of the vehicle, particularly the tire portion, on the multiple displays 180a, 180b, and 180m. This makes it difficult to recognize the external situation based on the camera data.

[0300] Figure 14b The example shows a case where a plurality of displays 180 a , 180 b , and 180 m in the vehicle 200 all display an image 180 t based on camera data.

[0301] As described above, since the plurality of displays 180 a , 180 b , and 180 m all display the image 180 t based on the camera data, it is possible to improve recognition of external conditions based on the camera data.

[0302] To this end, preferably, the signal processing device 170 of an embodiment of the present invention is as follows: Figure 13a or Figure 13b Move like that.

[0303] On the other hand, to control the operation of the third display 180m, the signal processing device 170 according to an embodiment of the present invention may be controlled to receive the decoded image data stored in the shared memory 508 and display at least a portion of the decoded image data on the third display 180m.

[0304] On the other hand, the second guest virtual machine 540 and the third guest virtual machine 550 can share a portion of the area storing the decoded image data in the shared memory 508. This can reduce the delay in image display between the plurality of displays 180a and 180b.

[0305] Figure 14c FIG. 5 is a diagram illustrating a situation in which the first client virtual machine 530 decodes camera data divided into three areas.

[0306] Referring to the accompanying drawings, the server virtual machine 520 in the signal processing device 170 can be controlled to receive camera data, encode it through the encoder 1310, and store the encoded camera data in the shared memory 508.

[0307] The first client virtual machine 530 may receive and decode the encoded camera data from the shared memory 508 , and store the decoded camera data in the shared memory 508 .

[0308] Furthermore, the first client virtual machine 530 may be controlled to display the camera data IMGa of the first region in the decoded camera data on the first display 180 a .

[0309] Next, the second client virtual machine 540 may be controlled to receive the decoded camera data from the shared memory 508 , display the camera data IMGb of the second region in the decoded camera data on the second display 180 b , and display the camera data IMGc of the third region on the third display 180 m .

[0310] As mentioned above, the same camera data is decoded once, etc., so Figure 12c Compared with other technologies, the image processing volume and delay are greatly reduced.

[0311] On the other hand, Figure 14c Differently, a third client virtual machine 550 may also be run in the signal processing device 170 .

[0312] Thus, the second client virtual machine 540 can be controlled to receive the decoded camera data from the shared memory 508, and display the camera data IMGb of the second area in the decoded camera data on the second display 180b, and the third client virtual machine 550 can be controlled to display the camera data IMGc of the third area on the third display 180m.

[0313] Figure 14d Various images displayed on the first to third displays 180a, 180b, and 180 are illustrated.

[0314] Figure 14d (a) illustrates a situation where a camera image 1402, a surround view image 1404, and an application screen image 1406 are displayed on the first to third displays 180a, 180b, and 180, respectively.

[0315] The first to third client virtual machines 530 - 550 may perform signal processing to display respective images 1402 , 1404 , 1406 .

[0316] Figure 14d (b) illustrates a situation where camera images 1412 , 1414 , and 1416 are displayed on the first to third displays 180 a , 180 b , and 180 , respectively.

[0317] The first to third client virtual machines 530 - 550 may perform signal processing to display camera images 1412 , 1414 , and 1416 , respectively.

[0318] Figure 14d (c) illustrates a situation where a camera image 1422 , a camera image 1424 , and an application screen image 1426 are displayed on the first to third displays 180 a , 180 b , and 180 , respectively.

[0319] The first to third client virtual machines 530 - 550 may perform signal processing to display respective images 1422 , 1424 , 1426 .

[0320] On the other hand, Figure 14d As shown in (c), when image copying and displaying is performed between multiple displays 180a and 180b, the first client virtual machine 530 is controlled to receive and decode the encoded camera data stored in the shared memory 508, and store the decoded camera data in the shared memory 508, and the second client virtual machine 540 is controlled to receive the decoded camera data stored in the shared memory 508, and display the decoded camera data on the second display 180b.

[0321] That is, the first guest virtual machine 530 can be controlled to display the camera image 1422 on the first display 180a at a first time point and a second time point after the first time point, and the second guest virtual machine 540 can be controlled to display the camera image 1424 corresponding to the camera image 1422 on the second display 180b at the second time point. This can reduce the delay when copying and displaying images between the multiple displays 180a and 180b.

[0322] On the other hand, the second client virtual machine 540 may be controlled to output the scaled second image to the second display 180 b based on the size or output resolution or operating system of the second display 180 b .

[0323] That is, the second guest virtual machine 540 can be controlled to output the scaled camera image 1424 to the second display 180b based on the size or output resolution or operating system of the second display 180b. In this way, images corresponding to the resolutions of the multiple displays 180a and 180b can be displayed with reduced latency.

[0324] On the other hand, Figure 14d As shown in (b), when performing image copying and display between multiple displays 180a, 180b, and 180m, the first client virtual machine 530 can be controlled to receive and decode the encoded camera data stored in the shared memory 508, and store the decoded camera data in the shared memory 508; the second client virtual machine 540 can be controlled to receive the decoded camera data stored in the shared memory 508, and display the decoded camera data on the second display 180b; the third client virtual machine 550 can be controlled to receive the decoded camera data stored in the shared memory 508, and display the decoded camera data on the third display 180m.

[0325] That is, the first guest virtual machine 530 can be controlled to display the camera image 1412 on the first display 180a at a first time point, a second time point after the first time point, and a third time point after the second time point. The second guest virtual machine 540 can be controlled to display the camera image 1414 corresponding to the camera image 1412 on the second display 180b at the second time point and the third time point. The third guest virtual machine 550 can be controlled to display the camera image 1416 corresponding to the camera image 1412 on the third display 180c at the third time point. This can reduce the delay in the image duplication and display between the multiple displays 180a, 180b, and 180m.

[0326] On the other hand, the second client virtual machine 540 may be controlled to output the scaled second image to the second display 180 b based on the size or output resolution or operating system of the second display 180 b .

[0327] That is, the second guest virtual machine 540 can be controlled to output the scaled camera image 1414 to the second display 180b based on the size or output resolution or operating system of the second display 180b. In this way, images corresponding to the resolutions of the multiple displays 180a and 180b can be displayed with reduced latency.

[0328] On the other hand, the third client virtual machine 550 may be controlled to output the scaled third image to the third display 180 m based on the size or output resolution or operating system of the third display 180 m .

[0329] That is, the third guest virtual machine 550 can be controlled to output the scaled camera image 1416 to the third display 180m based on the size or output resolution of the third display 180m or the operating system. This allows images corresponding to the resolutions of the multiple displays 180a, 180b, and 180m to be displayed with reduced latency.

[0330] Figure 15a is with Figure 12a The diagram also illustrates a case where three signal processing devices 170xa, 170xb, and 170xc are used for three displays 180a, 180b, and 180m.

[0331] Referring to the accompanying drawings, the camera data from the camera 195 is received, and the three signal processing devices 170xa, 170xb, and 170xc respectively perform decoding and display the camera images 1510, 1512, and 1514, respectively, so the image processing amount and delay are greatly increased.

[0332] Figure 15b is with Figure 14dFIG. 10( b ) illustrates a case where three client virtual machines 530 , 540 , and 550 in one signal processing device 170 are used for three displays 180 a , 180 b , and 180 m .

[0333] Referring to the drawings, the server virtual machine 520 may receive camera data from the camera 195 and store the encoded camera data in the shared memory 508 .

[0334] Furthermore, the first client virtual machine 530 among the three client virtual machines 530 , 540 , and 550 may receive and decode the encoded camera data from the shared memory 508 , and store the decoded camera data in the shared memory 508 .

[0335] Furthermore, the first client virtual machine 530 can be controlled to receive the decoded camera data and display the camera image 1412 .

[0336] Furthermore, the remaining two guest virtual machines 540 and 550 can be controlled to receive decoded camera data from the shared memory 508 and respectively display camera images 1414 and 1416. This can significantly reduce the image processing load and delay when copying and displaying images between the multiple displays 180a, 180b, and 180m.

[0337] Figure 15c This is a diagram for reference in order to explain image movement between the plurality of displays 180a, 180b, and 180m.

[0338] Referring to the accompanying drawings, Figure 15c As shown in (a), the first client virtual machine 530 in the signal processing device 170 according to an embodiment of the present invention can be controlled to display the camera image 1520 on the first display 180a among the three displays 180a, 180b, and 180m.

[0339] For camera image movement, such as Figure 15c As shown in (b), the first guest virtual machine 530 and the second guest virtual machine 540 in the signal processing device 170 according to an embodiment of the present invention can be controlled to respectively display a portion of the camera image 1521.

[0340] Then, if Figure 15c As shown in (c), the second client virtual machine 540 in the signal processing device 170 according to an embodiment of the present invention can be controlled to display the camera image 1522 on the second display 180b.

[0341] To this end, the first client virtual machine 530 may receive the encoded camera data controlled by the server virtual machine 520 from the shared memory 508 and decode the camera data.

[0342] Furthermore, the first client virtual machine 530 may store the decoded camera data in the shared memory 508 , and the second client virtual machine 540 may be controlled to receive the decoded camera data stored in the shared memory 508 and display the camera image 1522 .

[0343] That is, the first guest virtual machine 530 can be controlled to display the camera image 1520 on the first display 180a at a first time point, and the second guest virtual machine 540 can be controlled to display the camera image 1522 corresponding to the camera image 1520 on the second display 180b at a second time point after the first time point. This can reduce the delay when the images are moved and displayed between the multiple displays 180a and 180b, and achieve seamless display.

[0344] On the other hand, the image displayed on the first display 180 a may be moved to the third display 180 m for display.

[0345] For example, the first guest virtual machine 530 can be controlled to display a first image on the first display 180a at a first time point, and the third guest virtual machine 550 can be controlled to display a second image corresponding to the first image on the third display 180m at a second time point after the first time point. This can reduce the delay when images are moved and displayed between the multiple displays 180a and 180b.

[0346] On the other hand, the image displayed on the first display 180 a may be sequentially moved to the second display 180 b and the third display 180 m for display.

[0347] For example, the first guest virtual machine 530 can be controlled to display a first image on the first display 180a at a first time point, the second guest virtual machine 540 can be controlled to display a second image corresponding to the first image on the second display 180b at a second time point after the first time point, and the third guest virtual machine 550 can be controlled to display a third image corresponding to the first image on the third display 180m at a third time point after the second time point. This can reduce the delay when images are moved and displayed between the multiple displays 180a and 180b.

[0348] On the other hand, Figures 13a to 15c In the description of FIG. 5 , it is described that the first client virtual machine 530 decodes the encoded image data, but differently, the server virtual machine 520 can also decode the encoded image data.

[0349] In another embodiment of the present invention, a server virtual machine 520 within a signal processing device 170 is controlled to encode processed image data and store it in a shared memory 508. A first client virtual machine 530 is controlled to receive the encoded image data stored in the shared memory 508 and transmit a decoding request to the server virtual machine 520. The server virtual machine 520 decodes the encoded image data based on the decoding request and stores the decoded image data in the shared memory 508. The first client virtual machine 530 is controlled to receive the decoded image data stored in the shared memory 508 and display at least a portion of the decoded image data on the first display 180a. This reduces the delay in image display between the multiple displays 180a and 180b.

[0350] Meanwhile, the second guest virtual machine 540 can be controlled to receive the decoded image data stored in the shared memory 508 and display at least a portion of the decoded image data on the second display 180b. This reduces the delay in image display between the plurality of displays 180a and 180b. Furthermore, images corresponding to the respective resolutions of the plurality of displays 180a and 180b can be displayed with reduced latency.

[0351] The difference of the signal processing device 170 of another embodiment of the present invention is that the server virtual machine 520 decodes the encoded image data. Other image copying, image movement, etc. can be performed according to the Figures 13a to 15c Follow the instructions in .

[0352] Regarding the description of how the server virtual machine 520 decodes the encoded image data, please refer to Figure 16 and subsequent figures to describe.

[0353] Figure 16 It is to illustrate Figure 14d Refer to the figure for the image display of (b).

[0354] 1 . Referring to the drawings, a vehicle display device 100 m according to an embodiment of the present invention includes at least one camera 195 and a signal processing device 170 that processes camera data and the like from the camera.

[0355] The signal processing device 170 according to an embodiment of the present invention includes a processor 175 for performing signal processing for a plurality of displays 180 a and 180 b mounted on a vehicle and a shared memory 508 .

[0356] The processor 175 of one embodiment of the present invention runs a server virtual machine 520 and a plurality of client virtual machines 530 - 540 on a hypervisor 505 within the processor 175 .

[0357] The encoder 1310 in the server virtual machine 520 receives the camera data and encodes the received camera data. The transmitting unit 1312 in the server virtual machine 520 transmits the encoded camera data to the shared memory 508 .

[0358] The decoder 1310 in the server virtual machine 520 decodes the encoded camera data, and the transmitting unit 1312 in the server virtual machine 520 transmits the decoded camera data to the shared memory 508 .

[0359] On the other hand, the camera data decoded in the server virtual machine 520 can be passed to the player application 1318 and Figure 15b As shown, the camera image 1520 can be displayed on the first display 180a.

[0360] The receiving unit 1325 in the first client virtual machine 530 may receive the encoded camera data stored in the shared memory 508 , and the decoder 1324 may decode the encoded camera data.

[0361] Alternatively, the decoder 1324 within the first client virtual machine 530 may receive the decoded camera data stored in the shared memory 508, and the decoded camera data may be passed to the player application 1328 and displayed on the second display 180b as shown in FIG. Figure 15b The camera image 1522 is displayed as shown.

[0362] The receiving unit 1335 in the second guest virtual machine 540 may receive the encoded camera data stored in the shared memory 508 , and the decoder 1334 may decode the encoded camera data.

[0363] Alternatively, the decoder 1334 within the second client virtual machine 540 may receive the decoded camera data stored in the shared memory 508, and the decoded camera data may be passed to the player application 1338 and displayed on the third display 180m. Figure 15b The camera image 1524 is displayed as shown.

[0364] On the other hand, Figure 16 Differently, the player application 1318 may be executed in the first client virtual machine 530 instead of the server virtual machine 520 and displayed on the first display 180a. Figure 15b The camera image 1520 is displayed as shown.

[0365] At the same time, the player application 1328 can be run in the second client virtual machine 540 instead of the first client virtual machine 530 and displayed on the second display 180b. Figure 15b The camera image 1522 is displayed as shown.

[0366] In addition, the player application 1338 may be run in the third client virtual machine 550 instead of the second client virtual machine 540 and displayed on the third display 180m. Figure 15b The camera image 1524 is displayed as shown.

[0367] Figure 17a This is an example of an operating method of a signal processing device according to an embodiment of the present invention.

[0368] 17. Referring to the drawing, the server virtual machine 520 in the signal processing device 170 receives camera data from the camera 195 (S1710).

[0369] Next, the encoder 1310 in the server virtual machine 520 encodes the camera data ( S1712 ), and the transmitting unit 1312 in the server virtual machine 520 transmits the encoded camera data to the shared memory 508 ( S1715 ).

[0370] On the other hand, the receiving unit 1325 in the first guest virtual machine 530 receives the encoded camera data from the shared memory 508 ( S1716 ).

[0371] Furthermore, the first client virtual machine 530 transmits a decoding request for the encoded camera data ( S1718 ), and correspondingly, the server virtual machine 520 receives the decoding request.

[0372] Next, the decoder 1316 in the server virtual machine 520 extracts a display timing parameter (S1719).

[0373] Next, the decoder 1316 in the server virtual machine 520 determines whether the encoded camera data has been decoded ( S1720 ). If it has been decoded, the decoded camera data is selected from the decoded data cache ( S1722 ).

[0374] On the other hand, in step 1720 ( S1720 ), if the encoded camera data has not been decoded, the decoder 1316 in the server virtual machine 520 generates a decoding instance ( S1723 ) and performs decoding based on the decoding instance ( S1725 ).

[0375] Next, it is determined whether the player application in the server virtual machine 520 is running (S1727). If it is running, the decoder 1316 in the server virtual machine 520 can transmit the decoded camera data to the player application 1318 (S1729).

[0376] On the other hand, if the player application in the server virtual machine 520 is not running, the decoded camera data is transmitted to the first client virtual machine 530 (S1730), and correspondingly, the first client virtual machine 530 can receive the decoded camera data (S1729).

[0377] according to Figure 17a The camera data decoded in the server virtual machine 520 can be played and displayed by the player application 1318, or can be transmitted to the first client virtual machine 530 and played and displayed by the player application 1328.

[0378] Figure 17b This is another example of the operating method of the signal processing device according to one embodiment of the present invention.

[0379] Referring to the drawing, the receiving unit 1325 in the first guest virtual machine 530 receives the encoded camera data from the shared memory 508 ( S1756 ).

[0380] Furthermore, the first client virtual machine 530 transmits a decoding request for the encoded camera data ( S1758 ), and correspondingly, the server virtual machine 520 receives the decoding request.

[0381] Next, the decoder 1316 in the server virtual machine 520 performs decoding ( S1763 ) and stores the decoded camera data in a decoded data buffer ( S1765 ).

[0382] Next, the decoder 1316 in the server virtual machine 520 transmits the decoded camera data stored in the decoded data buffer to the shared memory 508 ( S1768 ).

[0383] Correspondingly, the first client virtual machine 530 receives the decoded camera data through the shared memory 508 ( S1769 ).

[0384] On the other hand, the server virtual machine 520 determines whether there is an additional client virtual machine that needs to be transmitted ( S1770 ). If so, the encoder 1310 in the server virtual machine 520 encodes the camera data stored in the decoded data buffer ( S1771 ).

[0385] Then, the transmitting unit 1312 in the server virtual machine 520 transmits the encoded camera data to the shared memory 508 ( S1773 ).

[0386] Correspondingly, the receiving unit 1335 of the second guest virtual machine 540 receives the encoded camera data through the shared memory 508 ( S1775 ).

[0387] Furthermore, the second client virtual machine 540 transmits a decoding request to the server virtual machine 520 ( S1777 ).

[0388] Correspondingly, the server virtual machine 520 may receive the decoding request and extract a display timing parameter (S1779).

[0389] Next, the decoder 1316 in the server virtual machine 520 selects the decoded camera data from the decoded data buffer and transmits the decoded camera data to the shared memory 508 ( S1781 ).

[0390] Correspondingly, the second guest virtual machine 540 receives the decoded camera data from the shared memory 508 ( S1783 ).

[0391] according to Figure 17b Since the camera data decoded in the server virtual machine 520 is transmitted to the first client virtual machine 530 and the second client virtual machine 540, the same camera image can be displayed on the first display 180a and the second display 180b.

[0392] Figure 18 This is another example of the operating method of the signal processing device according to one embodiment of the present invention.

[0393] Referring to the drawing, the encoder 1310 in the server virtual machine 520 sets an encoding bit rate ( S1805 ).

[0394] Next, the encoder 1310 in the server virtual machine 520 receives the camera data and encodes the received camera data based on the set encoding bit rate ( S1810 ).

[0395] The transmitting unit 1312 in the server virtual machine 520 transmits the encoded camera data to the shared memory 508 ( S1815 ).

[0396] The receiving unit 1325 in the first guest virtual machine 530 receives the encoded camera data from the shared memory 508 ( S1816 ).

[0397] Furthermore, the first client virtual machine 530 transmits a decoding request for the encoded camera data ( S1818 ), and correspondingly, the server virtual machine 520 receives the decoding request.

[0398] Next, the decoder 1316 in the server virtual machine 520 performs decoding ( S1823 ) and transmits the decoded camera data to the shared memory 508 ( S1842 ).

[0399] Correspondingly, the first client virtual machine 530 receives the decoded camera data through the shared memory 508 ( S1843 ), and outputs a camera image based on the camera data on the first display 180 a ( S1845 ).

[0400] On the other hand, the first guest virtual machine 530 receives the image copy input through touch input or the like ( S1847 ), and transmits the copy input ( S1849 ).

[0401] Correspondingly, the server virtual machine 520 receives the copy input ( S1850 ), and transmits a player application execution request to the second client virtual machine 540 ( S1852 ).

[0402] Correspondingly, the second client virtual machine 540 receives the player application execution request and executes the player application ( S1853 ).

[0403] Next, the second guest virtual machine 540 sets the size or output resolution of the second display 180 b or the window size corresponding to the operating system ( S1855 ).

[0404] Furthermore, the second guest virtual machine 540 receives the decoded camera data through the shared memory 508 ( S1857 ), and outputs a camera image based on the camera data on the second display 180 b according to the set window size ( S1859 ).

[0405] In particular, the second client virtual machine 540 can be controlled to output the scaled camera image to the second display 180b based on the size or output resolution or operating system of the second display 180b. In this way, images corresponding to the resolution of each display can be displayed with reduced latency.

[0406] On the other hand, the server virtual machine 520 calculates an appropriate bit rate according to the resources of the camera data ( S1856 ).

[0407] Based on the calculated bit rate, the encoder 1310 in the server virtual machine 520 may reset the encoding bit rate ( S1805 ).

[0408] Figures 19a to 19e It is explaining Figures 17a to 18 The diagram to refer to when performing the action.

[0409] Figure 19a 1 is a diagram showing an example of image reproduction in the vehicle display device 100 x according to the present invention.

[0410] like Figure 19aAs shown in (a), the signal processing device 170x related to the present invention can be controlled to display the first image 1910 on the first display 180a, and then when the image copy input is generated, as shown in FIG. Figure 19a As shown in (b), a first image 1910 is displayed on the first display 180a, and a copied image 1912 is displayed on the third display 180m.

[0411] At this time, if the output resolution of the third display 180m is greater than the output resolution of the first display 180a, then Figure 19a As shown in (b), a blank space is generated in a portion of the third display 180m.

[0412] Therefore, the signal processing device 100 of the embodiment of the present invention performs scaling and the like according to the output resolution of the third display 180m when copying an image. Figure 19b Provide explanation.

[0413] Figure 19b 1 is a diagram showing an example of image reproduction in the vehicle display device 100 m according to the embodiment of the present invention.

[0414] like Figure 19b As shown in (a), the signal processing device 170 of the embodiment of the present invention can be controlled to display the first image 1910 on the first display 180a, and then when the image copy input is generated, as shown in FIG. Figure 19b As shown in (b), the first image 1910 is displayed on the first display 180a, and the copied image 1922 is displayed on the third display 180m.

[0415] At this time, if the output resolution of the third display 180m is greater than the output resolution of the first display 180a, then Figure 19a As shown in (b), the signal processing device 170 controls to perform scaling corresponding to the output resolution of the third display 180m so as to avoid blanking in part of the third display 180m. Thus, image copying is performed corresponding to the output resolution of the third display 180m.

[0416] Figure 19c 100 y is a diagram showing another example of image reproduction in the vehicle display device 100 y according to the present invention.

[0417] like Figure 19c As shown in (a), the signal processing device 170y related to the present invention can be controlled to display the first image 1910 on the first display 180a, and then when the image copy input is generated, as shown in FIG. Figure 19c As shown in (b), the first image 1910 is displayed on the first display 180a, and the copied image 1914 is displayed on the third display 180m.

[0418] At this time, if the output resolution of the third display 180m is smaller than the output resolution of the first display 180a, then Figure 19c As shown in (b), only a portion of the first image 1910 is displayed on the third display 180m, and the other portion is not displayed.

[0419] Therefore, the signal processing device 100 of the embodiment of the present invention performs scaling and the like according to the output resolution of the third display 180m when copying an image. Figure 19d Provide explanation.

[0420] Figure 19d This is a diagram showing another example of image reproduction in the vehicle display device 100m according to the embodiment of the present invention.

[0421] like Figure 19d As shown in (a), the signal processing device 170 of the embodiment of the present invention can be controlled to display the first image 1910 on the first display 180a, and then when the image copy input is generated, as shown in FIG. Figure 19d As shown in (b), the first image 1910 is displayed on the first display 180a, and the copied image 1922 is displayed on the third display 180m.

[0422] At this time, if the output resolution of the third display 180m is smaller than the output resolution of the first display 180a, then Figure 19c As shown in (b), the signal processing device 170 controls to perform scaling corresponding to the output resolution of the third display 180m, so that the entire area of the first image 1910 is displayed on the third display 180m without being cropped. In this way, image replication is performed corresponding to the output resolution of the third display 180m.

[0423] Figure 19e This is a diagram illustrating how image copying is sequentially performed in the vehicle display device 100m according to the embodiment of the present invention.

[0424] like Figure 19e As shown in (a), the signal processing device 170 of the embodiment of the present invention can display the first image 1910 on the first display 180a at a first time point, and then, when an image copy input is generated, as shown in FIG. Figure 19e As shown in (b), at a second time point after the first time point, the first image 1910 is displayed on the first display 180a, and the copied image 1922 is displayed on the third display 180m.

[0425] On the other hand, Figure 19eAs shown in (b), the signal processing device 170 of the embodiment of the present invention can display the first image 1910 on the first display 180a and the copied image 1922 on the third display 180m at the second time point, and then, when the image copy input is generated, as shown in FIG. Figure 19e As shown in (c), at a third time point after the second time point, the first image 1910 is displayed on the first display 180a, the copied image 1922 is displayed on the third display 180m, and the copied image 1924 is displayed on the RSE display 180c. In this way, image copying can be performed sequentially.

[0426] Figure 20 This is another example of the operating method of the signal processing device according to one embodiment of the present invention.

[0427] Referring to the drawing, the encoder 1310 in the server virtual machine 520 sets an encoding bit rate ( S2005 ).

[0428] Next, the encoder 1310 in the server virtual machine 520 receives the camera data and encodes the received camera data based on the set encoding bit rate ( S2010 ).

[0429] The transmitting unit 1312 in the server virtual machine 520 transmits the encoded camera data to the shared memory 508 ( S2025 ).

[0430] The receiving unit 1325 in the first guest virtual machine 530 receives the encoded camera data from the shared memory 508 ( S2026 ).

[0431] Furthermore, the first client virtual machine 530 transmits a decoding request for the encoded camera data ( S2028 ), and correspondingly, the server virtual machine 520 receives the decoding request.

[0432] Next, the decoder 1316 in the server virtual machine 520 performs decoding ( S2040 ) and transmits the decoded camera data to the shared memory 508 ( S2042 ).

[0433] Correspondingly, the first client virtual machine 530 receives the decoded camera data through the shared memory 508 ( S2043 ), and outputs a camera image based on the camera data on the first display 180 a ( S2045 ).

[0434] On the other hand, the first client virtual machine 530 receives image movement input through touch input or the like ( S2047 ), and transmits the movement input ( S2049 ).

[0435] Correspondingly, the server virtual machine 520 receives the movement input ( S2050 ), and transmits a player application execution request to the second client virtual machine 540 ( S2052 ).

[0436] Correspondingly, the second client virtual machine 540 receives the player application execution request and executes the player application ( S2053 ).

[0437] Next, the second guest virtual machine 540 sets the size or output resolution of the second display 180 b or the window size corresponding to the operating system ( S2055 ).

[0438] Furthermore, the second guest virtual machine 540 receives the decoded camera data through the shared memory 508 ( S2057 ), and outputs a camera image based on the camera data on the second display 180 b according to the set window size ( S2059 ).

[0439] In particular, the second client virtual machine 540 can be controlled to output the scaled camera image to the second display 180b based on the size or output resolution or operating system of the second display 180b. In this way, images corresponding to the resolution of each display can be displayed with reduced latency.

[0440] On the other hand, the server virtual machine 520 calculates an appropriate bit rate according to the resources of the camera data ( S2056 ).

[0441] Based on the calculated bit rate, the encoder 1310 in the server virtual machine 520 may reset the encoding bit rate ( S2005 ).

[0442] Figures 21a to 21e It is explaining Figure 20 The diagram to refer to when performing the action.

[0443] Figure 21a 1 is a diagram showing an example of image movement in the vehicle display device 100 x according to the present invention.

[0444] like Figure 21a As shown in (a), the signal processing device 170x related to the present invention can be controlled to display a first image 1910 on the first display 180a, and then display a moving image 1912 on the third display 180m when an image movement input is generated.

[0445] At this time, if the output resolution of the third display 180m is greater than the output resolution of the first display 180a, then Figure 21a As shown in (b), a blank space is generated in a portion of the third display 180m.

[0446] Therefore, the signal processing device 100 of the embodiment of the present invention performs scaling and the like according to the output resolution of the third display 180m when the image moves. Figure 21b Provide explanation.

[0447] Figures 21a to 21f It is an explanation Figure 20 The diagram to refer to when performing the action.

[0448] Figure 21b 1 is a diagram showing an example of image movement in the vehicle display device 100 m according to the embodiment of the present invention.

[0449] like Figure 21b As shown in (a), the signal processing device 170 of the embodiment of the present invention can be controlled to display the first image 1910 on the first display 180a, and then when an image movement input is generated, as shown in FIG. Figure 21b As shown in (b), a moving image 1922 is displayed on the third display 180m.

[0450] At this time, if the output resolution of the third display 180m is greater than the output resolution of the first display 180a, then Figure 21a As shown in (b), the signal processing device 170 controls to perform scaling corresponding to the output resolution of the third display 180m so as to avoid blanking in a portion of the third display 180m. Thus, image movement is performed corresponding to the output resolution of the third display 180m.

[0451] Figure 21c 100 y is a diagram showing another example of image movement in the vehicle display device 100 y according to the present invention.

[0452] like Figure 21c As shown in (a), the signal processing device 170y related to the present invention can be controlled to display the first image 1910 on the first display 180a, and then when the image movement input is generated, as shown in FIG. Figure 21c As shown in (b), a moving image 1914 is displayed on the third display 180m.

[0453] At this time, if the output resolution of the third display 180m is smaller than the output resolution of the first display 180a, then Figure 21c As shown in (b), only a portion of the first image 1910 is displayed on the third display 180m, and the other portion is not displayed.

[0454] Therefore, the signal processing device 100 of the embodiment of the present invention performs scaling and the like according to the output resolution of the third display 180m when the image moves. Figure 21d Provide explanation.

[0455] Figure 21d This is a diagram showing another example of image movement in the vehicle display device 100m according to the embodiment of the present invention.

[0456] like Figure 21d As shown in (a), the signal processing device 170 of the embodiment of the present invention can be controlled to display the first image 1910 on the first display 180a, and then when an image movement input is generated, as shown in FIG. Figure 21d As shown in (b), a moving image 1922 is displayed on the third display 180m.

[0457] At this time, if the output resolution of the third display 180m is smaller than the output resolution of the first display 180a, then Figure 21c As shown in (b), the signal processing device 170 controls to perform scaling corresponding to the output resolution of the third display 180m, so that the entire area of the first image 1910 is displayed on the third display 180m without being cropped. In this way, the image is shifted according to the output resolution of the third display 180m.

[0458] Figure 21e This is a diagram illustrating a situation where the resolution of an image and a display do not match in the vehicle display device 100 x according to the present invention.

[0459] like Figure 21e As shown in (a), when the first display 180a displays the first image 1910 and the second display 180b displays the second image 1940, the second image 1940 may be inconsistent with the output resolution of the second display 180b, resulting in blank space.

[0460] On the other hand, in order to solve Figure 21e (a) resolution is inconsistent and the image is exchanged for display, such as Figure 21e As shown in (b), the second image 1942 can be displayed on the first display 180a, and the first image 1952 can be displayed on the second display 180b. However, the output resolution of the second image 1942 may be inconsistent with that of the first display 180a, resulting in blank space.

[0461] Figure 21f This is a diagram illustrating a case where the resolutions of an image and a display are consistent in the vehicle display device 100 m according to the embodiment of the present invention.

[0462] Referring to the accompanying drawings, Figure 21f As shown in (a), when the first display 180a displays the first image 1910 and the second display 180b displays the second image 1940, the second image 1940 may be inconsistent with the output resolution of the second display 180b, resulting in blank space.

[0463] Therefore, in order to solve Figure 21f The resolution of (a) is inconsistent, the vehicle display device 100m of the embodiment of the present invention can be controlled to replace the displayed image, and considering the output resolution of the display, a part of the second image 1950 is displayed on the first display 180a, and the remaining part Arm is displayed on the second display 180b.

[0464] That is, the second guest virtual machine 540 may be controlled to receive the decoded image data stored in the shared memory 508 and display at least a portion of the decoded image data on the second display 180 b .

[0465] On the other hand, the second display 180b can also display the first image 1955. In this way, both the first image and the second image can be displayed on a plurality of displays.

[0466] Figure 22 This is another example of the operating method of the signal processing device according to one embodiment of the present invention.

[0467] Referring to the drawing, the encoder 1310 in the server virtual machine 520 sets an encoding bit rate ( S2205 ).

[0468] Next, the encoder 1310 in the server virtual machine 520 receives the camera data and encodes the received camera data based on the set encoding bit rate ( S2210 ).

[0469] The transmitting unit 1312 in the server virtual machine 520 transmits the encoded camera data to the shared memory 508 ( S2215 ).

[0470] The receiving unit 1325 in the first guest virtual machine 530 receives the encoded camera data from the shared memory 508 ( S2216 ).

[0471] Furthermore, the first client virtual machine 530 transmits a decoding request for the encoded camera data ( S2218 ), and correspondingly, the server virtual machine 520 receives the decoding request.

[0472] Next, the decoder 1316 in the server virtual machine 520 performs decoding ( S2220 ).

[0473] On the other hand, the first client virtual machine 530 sets a window size corresponding to the output resolution of the first display 180 a ( S2222 ), and transmits a screen zoom request to the server virtual machine 520 according to the window size ( S2224 ).

[0474] Correspondingly, the server virtual machine 520 receives the screen zoom request ( S2225 ).

[0475] Next, the server virtual machine 520 enlarges the decoded camera data and transmits the enlarged decoded camera data to the shared memory 508 ( S2242 ).

[0476] Correspondingly, the first client virtual machine 530 may be controlled to receive the enlarged decoded camera data from the shared memory 508 and display the image on the first display 180 a ( S2245 ).

[0477] On the other hand, the second client virtual machine 540 sets a window size corresponding to the output resolution of the second display 180 b ( S2226 ), and transmits a screen request to the server virtual machine 520 according to the window size.

[0478] The second client virtual machine 540 can be controlled to receive the decoded camera data from the shared memory 508 (S2244), and display the image on the second display 180b (S2247). Figure 21e The images 1950 and 1955 of (b) may be displayed on the first display 180a and the second display 180b, respectively.

[0479] Figures 23a to 23b It is explaining Figure 22 The diagram to refer to when performing the action.

[0480] Figure 23a 1 is a diagram showing an example of image display on a vehicle display device 100 x according to the present invention.

[0481] The signal processing device 170x related to the present invention can be controlled to Figure 23a The first image 2310 in (a) is displayed on the first display 180a as a partially cropped image 2312, or as an image 2314 with a changed aspect ratio as on the second display 180b.

[0482] Therefore, the signal processing apparatus 100 according to the embodiment of the present invention performs image magnification, scaling, etc. in consideration of the resolution of the image and the output resolution of each display.

[0483] Figure 23b 1 is a diagram showing an example of image display on the vehicle display device 100 m according to the embodiment of the present invention.

[0484] The signal processing device 170 of the embodiment of the present invention can be controlled to Figure 23bThe first image 2310 in (a) is displayed on a portion of the first display 180a and the second display 180b, and the second image 2324 can be controlled to be displayed on the remaining area of the second display 180b. In this way, the image is displayed across the plurality of displays 180a and 180b, so that part of the image can be controlled not to be deleted.

[0485] On the other hand, the preferred embodiments of the present invention are described above with reference to the accompanying drawings, but the present invention is not limited to the specific embodiments described above. A person skilled in the art can perform various modified implementations thereof without departing from the technical idea of the present invention for protection in the scope of the rights, and such modified implementations should not be understood separately from the technical idea or prospects of the present invention.

Claims

1. A signal processing device comprising a processor that performs signal processing for a plurality of displays mounted on a vehicle, wherein: The processor runs a server virtual machine and a plurality of client virtual machines on a hypervisor within the processor, The first and second guest virtual machines in the plurality of guest virtual machines respectively operate on the first and second displays, The server virtual machine is controlled to encode the processed image data and store it in the shared memory, The first client virtual machine is controlled to receive and decode the encoded image data stored in the shared memory, and store the decoded image data in the shared memory, The second client virtual machine is controlled to receive the decoded image data stored in the shared memory and display at least a portion of the decoded image data on the second display.

2. The signal processing device according to claim 1, wherein The first client virtual machine is controlled to receive and decode the encoded image data stored in the shared memory, and display at least a portion of the decoded image data on a first display.

3. The signal processing device according to claim 2, wherein: The first client virtual machine is controlled to display a first image on the first display at a first time point, The second client virtual machine is controlled to display a second image corresponding to the first image on the second display at a second time point after the first time point.

4. The signal processing device according to claim 2, wherein: The first client virtual machine is controlled to display a first image on the first display at a first time point and a second time point after the first time point, The second client virtual machine is controlled to display a second image corresponding to the first image on the second display at the second time point.

5. The signal processing device according to claim 3 or 4, wherein: The second client virtual machine is controlled to output the scaled second image to the second display based on the size or output resolution or operating system of the second display. The signal processing device according to claim 1 , wherein: A third guest virtual machine among the plurality of guest virtual machines is a third display action, The third client virtual machine is controlled to receive the decoded image data stored in the shared memory and display at least a portion of the decoded image data on the third display.

7. The signal processing device according to claim 6, wherein: The second guest virtual machine and the third guest virtual machine share a portion of the shared memory where the decoded image data is stored.

8. The signal processing device according to claim 6, wherein: The first client virtual machine is controlled to display a first image on the first display at a first time point, The second client virtual machine is controlled to display a second image corresponding to the first image on the second display at a second time point after the first time point, The third client virtual machine is controlled to display a third image corresponding to the first image on the third display at a third time point after the second time point.

9. The signal processing device according to claim 6, wherein: The first client virtual machine is controlled to display a first image on the first display at a first time point, a second time point after the first time point, and a third time point after the second time point. The second client virtual machine is controlled to display a second image corresponding to the first image on the second display at the second time point and the third time point, The third client virtual machine is controlled to display a third image corresponding to the first image on the second display at the third time point.

10. A signal processing device comprising a processor that performs signal processing for a plurality of displays mounted on a vehicle, wherein: The processor runs a server virtual machine and a plurality of client virtual machines on a hypervisor within the processor, The first and second guest virtual machines in the plurality of guest virtual machines respectively operate on the first and second displays, The server virtual machine is controlled to encode the processed image data and store it in the shared memory, The first client virtual machine receives the encoded image data stored in the shared memory and transmits a decoding request to the server virtual machine. The server virtual machine is controlled to decode the encoded image data based on the decoding request and store the decoded image data in the shared memory, The first client virtual machine is controlled to receive the decoded image data stored in the shared memory and display at least a portion of the decoded image data on the first display. The signal processing device according to claim 10 , wherein: The second client virtual machine is controlled to receive the decoded image data stored in the shared memory and display at least a portion of the decoded image data on the second display.

12. The signal processing device according to claim 11, wherein: The first client virtual machine is controlled to display a first image on the first display at a first time point, The second client virtual machine is controlled to display a second image corresponding to the first image on the second display at a second time point after the first time point.

13. The signal processing device according to claim 11, wherein: The first client virtual machine is controlled to display a first image on the first display at a first time point and a second time point after the first time point, The second client virtual machine is controlled to display a second image corresponding to the first image on the second display at the second time point.

14. The signal processing device according to claim 12 or 13, wherein: The second client virtual machine is controlled to output the scaled second image to the second display based on the size or output resolution or operating system of the second display.

15. The signal processing device according to claim 11, wherein: A third guest virtual machine among the plurality of guest virtual machines is a third display action, The third client virtual machine is controlled to receive the decoded image data stored in the shared memory and display at least a portion of the decoded image data on the third display. The signal processing device according to claim 15 , wherein: The first client virtual machine is controlled to display a first image on the first display at a first time point, The second client virtual machine is controlled to display a second image corresponding to the first image on the second display at a second time point after the first time point, The third client virtual machine is controlled to display a third image corresponding to the first image on the third display at a third time point after the second time point.

17. The signal processing device according to claim 15, wherein: The first client virtual machine is controlled to display a first image on the first display at a first time point, a second time point after the first time point, and a third time point after the second time point. The second client virtual machine is controlled to display a second image corresponding to the first image on the second display at the second time point and the third time point, The third client virtual machine is controlled to display a third image corresponding to the first image on the second display at the third time point.

18. A display device for a vehicle, characterized in that: include: multiple displays; as well as a signal processing device comprising a processor that performs signal processing for a plurality of said displays; The signal processing device includes the signal processing device according to any one of claims 1 to 17.

Citation Information

Patent Citations

  • Method and system for redirecting video to server for decoding in virtualized environment

    CN107809671A

  • Vehicle-mounted data sharing system and method and nonvolatile storage medium

    CN113836102A

  • Signal processing device and vehicle display device including the same

    CN115195621A