Signal processing apparatus and vehicle display apparatus equipped with same

Abstract

The present disclosure relates to a signal processing apparatus, and a vehicle display apparatus equipped with same. The signal processing apparatus, according to one embodiment of the present disclosure, comprises a processor for performing signal processing for a display mounted in a vehicle, wherein the processor executes a hypervisor and executes a first virtualization machine to a third virtualization machine on the hypervisor, wherein the second virtualization machine operates for a first display, the first virtualization machine operates for a second display, the first virtualization machine or the hypervisor executes a display manager for controlling an image displayed on the first display or the second display, and an audio manager for controlling sound corresponding to the image displayed on the first display or the second display, wherein the audio manager performs control to assign audio signals corresponding to each of a plurality of speakers in the vehicle. Accordingly, it is possible to stably output sound corresponding to an image.

Description

Signal processing device and vehicle display device having the same

[0001] The present disclosure relates to a signal processing device and a vehicle display device having the same, and more specifically, to a signal processing device capable of stably outputting sound corresponding to an image, and a vehicle display device having the same.

[0002] A vehicle is a device that allows the user to move in the desired direction. A representative example is an automobile.

[0003] Meanwhile, for the convenience of vehicle users, vehicle display devices are being installed inside vehicles.

[0004] For example, displays are placed in clusters and other areas to display various types of information. Meanwhile, vehicles are increasingly equipped with various displays, such as Audio Video Navigation (AVN) displays, separate from the cluster to display driving information and other information.

[0005] In this way, as the number of displays within a vehicle display device increases, there is a problem that signal processing for the displays becomes more complex.

[0006] Meanwhile, when displaying images on multiple displays, there is a problem that audio signal processing becomes more complex along with image signal processing.

[0007] The problem to be solved by the present disclosure is to provide a signal processing device capable of stably outputting sound corresponding to an image, and a vehicle display device having the same.

[0008] Meanwhile, another problem of the present disclosure is to provide a signal processing device capable of stably outputting sound corresponding to an image even when the number of virtual machines increases, and a vehicle display device having the same.

[0009] Meanwhile, another problem of the present disclosure is to provide a signal processing device capable of stably outputting sound corresponding to an image even when the operating systems of multiple virtual machines are different, and a vehicle display device having the same.

[0010] According to one embodiment of the present disclosure for the above-described problem, a signal processing device and a vehicle display device having the same include a processor that performs signal processing for a display mounted on a vehicle, wherein the processor executes a hypervisor, and executes a first virtual machine to a third virtual machine on the hypervisor, the second virtual machine operating for the first display, and the third virtual machine operating for the second display, and the first virtual machine or the hypervisor executes a display manager for controlling an image displayed on the first display or the second display, and an audio manager for controlling a sound corresponding to an image displayed on the first display or the second display, and the audio manager controls to allocate audio signals corresponding to each of a plurality of speakers in the vehicle.

[0011] Meanwhile, the audio manager can control to assign a first audio signal to a first speaker when a first image is displayed on a first display, and to assign a second audio signal to a second speaker when a second image is displayed on a second display.

[0012] Meanwhile, the audio manager can assign a first audio signal on which noise cancellation is not performed to the first speaker, and assign a second audio signal on which noise cancellation is performed to the second speaker.

[0013] Meanwhile, the audio manager can control to assign audio signals without noise cancellation to some of the multiple speakers and to assign audio signals with noise cancellation to other speakers.

[0014] Meanwhile, the audio manager can control to assign audio signals including safety driving information to some of the plurality of speakers and to assign audio signals not including safety driving information to other speakers.

[0015] Meanwhile, the audio manager can control to assign a first audio signal to a first speaker when a first image is displayed on a first display, to assign a second audio signal to a second speaker when a second image is displayed on a second display, and to assign a third audio signal to a third speaker when a third image is displayed on a third display.

[0016] Meanwhile, the audio manager can control to assign the second audio signal to the third speaker and to assign the third audio signal to the second speaker when the third image is displayed on the second display and the second image is displayed on the third display.

[0017] Meanwhile, the audio manager can control the display of a first image on a first display, the display of a second image on a second display, the allocation of a first audio signal corresponding to the second image to a second speaker, and the allocation of a second audio signal corresponding to the third image to a third speaker when displaying a third image on a third display.

[0018] Meanwhile, the audio manager can control to assign the first audio signal to the third speaker and the second audio signal to the second speaker when the third image is displayed on the second display and the second image is displayed on the third display.

[0019] Meanwhile, the audio manager can control the hypervisor-based shared memory to be set up for transmission of the same audio signal to the second virtual machine and the third virtual machine.

[0020] Meanwhile, the audio manager transmits the first audio data to the hypervisor-based shared memory, and the second virtual machine and the third virtual machine can each receive the first audio data within the shared memory so that the same sound is output from the speakers they each manage.

[0021] Meanwhile, the second virtual machine and the third virtual machine can be driven by different operating systems.

[0022] Meanwhile, the audio manager can manage audio signals within the second virtual machine and audio signals within the third virtual machine in an integrated manner or control audio focus.

[0023] Meanwhile, the first virtual machine or hypervisor may further run an audio server that determines the output path of the audio signal.

[0024] Meanwhile, the hypervisor can send graphic signals to the graphic processor, send overlay signals to the overlay processor, or send audio signals to the audio processor.

[0025] Meanwhile, the first virtual machine or hypervisor may further execute a window manager that sets the location and properties of the window based on the Windows information loaded at boot time.

[0026] A signal processing device and a vehicle display device having the same according to another embodiment of the present disclosure include a processor that performs signal processing for a display mounted on a vehicle, the processor executing a hypervisor, the hypervisor executing a display manager for controlling an image displayed on a first display or a second display, and an audio manager for controlling a sound corresponding to an image displayed on the first display or the second display, and the audio manager controlling to allocate audio signals corresponding to each of a plurality of speakers in the vehicle.

[0027] Meanwhile, the audio manager can control to assign audio signals without noise cancellation to some of the multiple speakers and to assign audio signals with noise cancellation to other speakers.

[0028] Meanwhile, the audio manager can control to assign audio signals including safety driving information to some of the plurality of speakers and to assign audio signals not including safety driving information to other speakers.

[0029] Meanwhile, the audio manager transmits the first audio data to a hypervisor-based shared memory, and multiple virtual machines running on the processor can each receive the first audio data within the shared memory so that the same sound is output from the speakers they each manage.

[0030] Meanwhile, multiple virtual machines can be driven by different operating systems.

[0031] Meanwhile, the audio manager can manage each audio signal within multiple virtual machines or control audio focus.

[0032] A signal processing device and a vehicle display device having the same according to one embodiment of the present disclosure include a processor that performs signal processing for a display mounted on a vehicle, wherein the processor executes a hypervisor, and executes a first virtual machine to a third virtual machine on the hypervisor, wherein the second virtual machine operates for the first display, and the third virtual machine operates for the second display, and the first virtual machine or the hypervisor executes a display manager for controlling an image displayed on the first display or the second display, and an audio manager for controlling a sound corresponding to the image displayed on the first display or the second display, and the audio manager controls the allocation of corresponding audio signals to each of a plurality of speakers in the vehicle. Accordingly, it is possible to stably output a sound corresponding to an image. In particular, even if the number of virtual machines increases, it is possible to stably output a sound corresponding to an image.

[0033] Meanwhile, the audio manager can control the allocation of a first audio signal to a first speaker when a first image is displayed on a first display, and the allocation of a second audio signal to a second speaker when a second image is displayed on a second display. Accordingly, sound corresponding to the image can be stably output.

[0034] Meanwhile, the audio manager can assign a first audio signal, without noise cancellation, to the first speaker, and a second audio signal, with noise cancellation, to the second speaker. This allows for stable output of sound corresponding to the image.

[0035] Meanwhile, the audio manager can control the allocation of audio signals without noise cancellation to some of the multiple speakers, and audio signals with noise cancellation to others. This allows for stable output of sound corresponding to the video.

[0036] Meanwhile, the audio manager can control the allocation of audio signals containing safety driving information to some of the multiple speakers, and audio signals not containing safety driving information to other speakers. This allows for stable output of sound corresponding to the video.

[0037] Meanwhile, the audio manager can control the allocation of a first audio signal to a first speaker when a first image is displayed on a first display, a second audio signal to a second speaker when a second image is displayed on a second display, and a third audio signal to a third speaker when a third image is displayed on a third display. Accordingly, sound corresponding to the image can be stably output.

[0038] Meanwhile, the audio manager can control the allocation of the second audio signal to the third speaker and the third audio signal to the second speaker when a third image is displayed on the second display and the second image is displayed on the third display. This enables stable output of sound corresponding to the image.

[0039] Meanwhile, the audio manager can control the display of a first image on a first display, assign a first audio signal corresponding to the second image to a second speaker when displaying a second image on a second display, and assign a second audio signal corresponding to the third image to a third speaker when displaying a third image on a third display. Accordingly, sound corresponding to the image can be output stably.

[0040] Meanwhile, the audio manager can control the assignment of the first audio signal to the third speaker and the second audio signal to the second speaker when a third image is displayed on the second display and a second image is displayed on the third display. This enables stable output of sound corresponding to the image.

[0041] Meanwhile, the audio manager can control the establishment of hypervisor-based shared memory for the transmission of identical audio signals to the second and third virtual machines. This enables stable output of sound corresponding to the video.

[0042] Meanwhile, the audio manager transmits the first audio data to the hypervisor-based shared memory, and the second and third virtual machines can each receive the first audio data within the shared memory so that the same sound is output from the speakers they each manage. This enables stable output of sound corresponding to the video.

[0043] Meanwhile, the second and third virtual machines can be powered by different operating systems. This allows for stable audio output corresponding to the video, even if the operating systems of multiple virtual machines differ.

[0044] Meanwhile, the audio manager can integrate and manage audio signals within the second virtual machine and the third virtual machine, or control audio focus. This allows for stable sound output corresponding to video, even when multiple virtual machines have different operating systems.

[0045] Meanwhile, the first virtual machine or hypervisor can further execute an audio server that determines the output path of the audio signal. This enables stable output of sound corresponding to the video.

[0046] Meanwhile, the hypervisor can send graphics signals to the graphics processor, overlay signals to the overlay processor, or audio signals to the audio processor. This allows for stable sound output corresponding to the image.

[0047] Meanwhile, the first virtual machine or hypervisor can further execute a window manager that sets the position and properties of windows based on the Windows information loaded at boot time. This enables stable sound output corresponding to the video.

[0048] A signal processing device and a vehicle display device having the same according to another embodiment of the present disclosure include a processor that performs signal processing for a display mounted on a vehicle, wherein the processor executes a hypervisor, and the hypervisor executes a display manager for controlling an image displayed on a first display or a second display, and an audio manager for controlling a sound corresponding to an image displayed on the first display or the second display, and the audio manager controls the allocation of corresponding audio signals to each of a plurality of speakers within the vehicle. Accordingly, the sound corresponding to the image can be stably output. In particular, even if the number of virtual machines increases, the sound corresponding to the image can be stably output.

[0049] Meanwhile, the audio manager can control the allocation of audio signals without noise cancellation to some of the multiple speakers, and audio signals with noise cancellation to others. This allows for stable output of sound corresponding to the video.

[0050] Meanwhile, the audio manager can control the allocation of audio signals containing safety driving information to some of the multiple speakers, and audio signals not containing safety driving information to other speakers. This allows for stable output of sound corresponding to the video.

[0051] Meanwhile, the audio manager transmits the first audio data to a hypervisor-based shared memory, and multiple virtual machines running on the processor can each receive the first audio data within the shared memory, ensuring that the same sound is output from the speakers they each manage. This enables stable output of sound corresponding to the video.

[0052] Meanwhile, multiple virtual machines can run different operating systems. This allows for stable audio output corresponding to video, even if the operating systems of multiple virtual machines differ.

[0053] Meanwhile, the audio manager can manage individual audio signals within multiple virtual machines or control audio focus. This enables stable sound output corresponding to video.

[0054] Figure 1a is a drawing showing an example of the exterior and interior of a vehicle.

[0055] Figure 1b is a drawing showing another example of the interior of a vehicle.

[0056] FIG. 2 is a drawing illustrating the appearance of a vehicle display device according to an embodiment of the present disclosure.

[0057] FIG. 3 illustrates an example of an internal block diagram of the vehicle display device of FIG. 2.

[0058] FIG. 4 is a diagram illustrating a system driven by a signal processing device related to the present disclosure.

[0059] FIG. 5 is a diagram illustrating an example of a system driven by a signal processing device according to an embodiment of the present disclosure.

[0060] FIG. 6 is a diagram illustrating another example of a system driven by a signal processing device according to an embodiment of the present disclosure.

[0061] FIG. 7 is a diagram illustrating another example of a system driven by a signal processing device according to an embodiment of the present disclosure.

[0062] Figures 8 to 9b are drawings referenced in the description of Figure 5.

[0063] Fig. 10 is an example of an internal block diagram of a vehicle display device related to the present disclosure.

[0064] FIG. 11 is an example of an internal block diagram of a vehicle display device according to an embodiment of the present disclosure.

[0065] FIG. 12A is a drawing illustrating an example of display of an overlay in a system driven by a signal processing device according to an embodiment of the present disclosure.

[0066] FIG. 12b is a diagram illustrating an example of an overlay display and audio output in a system driven by a signal processing device according to an embodiment of the present disclosure.

[0067] Figure 13 is a drawing showing multiple speakers within a vehicle.

[0068] FIG. 14 is an example of an operation method of a signal processing device according to an embodiment of the present disclosure.

[0069] Figures 15a to 19 are drawings referred to in the description of Figure 14.

[0070] Hereinafter, the present disclosure will be described in more detail with reference to the drawings.

[0071] The suffixes "module" and "part" used in the following description are given solely for the convenience of writing this specification and do not impart any particularly significant meaning or role to the components themselves. Therefore, the terms "module" and "part" may be used interchangeably.

[0072] Figure 1a is a drawing showing an example of the exterior and interior of a vehicle.

[0073] Referring to the drawing, the vehicle (200) is operated by a plurality of wheels (103FR, 103FL, 103RL, etc.) that rotate by a power source and a steering wheel (150) for controlling the direction of travel of the vehicle (200).

[0074] Meanwhile, the vehicle (200) may further be equipped with a camera (195) for capturing images of the front of the vehicle.

[0075] Meanwhile, the vehicle (200) may be equipped with multiple displays (180a, 180b) for displaying images, information, etc. inside.

[0076] In Fig. 1a, a cluster display (180a) and an AVN (Audio Video Navigation) display (180b) are exemplified as multiple displays (180a, 180b). In addition, a HUD (Head Up Display) and the like are also possible.

[0077] Meanwhile, the AVN (Audio Video Navigation) display (180b) may also be named a center information display.

[0078] An embodiment of the present disclosure proposes a method for efficiently performing image signal processing and audio signal processing in a vehicle display device (100) equipped with multiple displays (180a, 180b) to output stable images and sounds. This will be described with reference to FIG. 11 and below.

[0079] Meanwhile, the vehicle (200) described in this specification may be a concept that includes all of a vehicle equipped with an engine as a power source, a hybrid vehicle equipped with an engine and an electric motor as a power source, and an electric vehicle equipped with an electric motor as a power source.

[0080] Figure 1b is a drawing showing another example of the interior of a vehicle.

[0081] Referring to the drawing, the interior of the vehicle may be equipped with a cluster display (180a), an AVN (Audio Video Navigation) display (180b), a rear seat entertainment display (180c, 180d), a room mirror display (not shown), etc.

[0082] An embodiment of the present disclosure proposes a method for stably outputting sound corresponding to an image in a vehicle display device (100) equipped with multiple displays (180a to 180d). This will be described with reference to FIG. 5 and below.

[0083] FIG. 2 is a drawing illustrating the appearance of a vehicle display device according to an embodiment of the present disclosure.

[0084] A vehicle display device (100) according to an embodiment of the present disclosure may include a plurality of displays (180a to 180b), and a signal processing device (170) that performs signal processing for displaying images, information, etc. on the plurality of displays (180a to 180b).

[0085] Among the plurality of displays (180a to 180b), the first display (180a) may be a cluster display (180a) for displaying driving status, operation information, etc., and the second display (180b) may be an AVN (Audio Video Navigation) display (180b) for displaying vehicle driving information, a navigation map, various entertainment information, or images.

[0086] The signal processing device (170) has a processor (175) inside and can execute a first virtual machine to a third virtual machine (520 to 540) on a hypervisor (505) within the processor (175).

[0087] The second virtualization machine (530) can operate for the first display (180a), and the third virtualization machine (540) can operate for the second display (180b).

[0088] Meanwhile, the first virtual machine (520) within the processor (175) can control the shared memory (508) based on the hypervisor (505) to be set for the same data transmission to the second virtual machine (530) and the third virtual machine (540). Accordingly, the same information or the same image can be displayed in synchronization on the first display (180a) and the second display (180b) within the vehicle.

[0089] Meanwhile, the first virtual machine (520) within the processor (175) shares at least a portion of data with the second virtual machine (530) and the third virtual machine (540) for data sharing processing. Accordingly, data can be shared and processed among multiple virtual machines for multiple displays within the vehicle.

[0090] Meanwhile, the first virtual machine (520) within the processor (175) can receive and process the vehicle's wheel speed sensor data, and transmit the processed wheel speed sensor data to at least one of the second virtual machine (530) and the third virtual machine (540). Accordingly, the vehicle's wheel speed sensor data can be shared with at least one virtual machine, etc.

[0091] Meanwhile, the vehicle display device (100) according to the embodiment of the present disclosure may further include a rear seat entertainment display (180c) for displaying driving status information, simple navigation information, various entertainment information, or images.

[0092] The signal processing device (170) can control the RSE display (180c) by executing a fourth virtual machine (not shown) in addition to the first virtual machine to the third virtual machine (520 to 540) on the hypervisor (505) within the processor (175).

[0093] Accordingly, it is possible to control various displays (180a to 180c) using one signal processing device (170).

[0094] Meanwhile, some of the multiple displays (180a~180c) may operate under Linux OS, while others may operate under Web OS.

[0095] A signal processing device (170) according to an embodiment of the present disclosure can control a touch input to be processed quickly and accurately when a touch input is received from one of a plurality of displays (180a to 180b or 180a to 180c) operating under various operating systems (OS).

[0096] Meanwhile, in FIG. 2, a vehicle speed indicator (212a) and a vehicle interior temperature indicator (213a) are displayed on a first display (180a), a home screen (222) including a plurality of applications and a vehicle speed indicator (212b) and a vehicle interior temperature indicator (213b) are displayed on a second display (180b), and a second home screen (222b) including a plurality of applications and a vehicle interior temperature indicator (213c) are displayed on a third display (180c).

[0097] FIG. 3 illustrates an example of an internal block diagram of a vehicle display device according to an embodiment of the present disclosure.

[0098] Referring to the drawings, a vehicle display device (100) according to an embodiment of the present disclosure may include an input unit (110), a communication unit (120), an interface (130), a memory (140), a signal processing unit (170), a plurality of displays (180a to 180c), an audio output unit (185), and a power supply unit (190).

[0099] The input unit (110) may be equipped with physical buttons, pads, etc. for button input, touch input, etc.

[0100] Meanwhile, the input unit (110) may be equipped with a touch sensor (not shown) for sensing touch input of the display (180a, 180b, 180c).

[0101] Meanwhile, the input unit (110) may be equipped with a microphone (not shown) for user voice input.

[0102] The communication unit (120) can exchange data wirelessly with a mobile terminal (800) or a server (900).

[0103] In particular, the communication unit (120) can wirelessly exchange data with the vehicle driver's mobile terminal. Various data communication methods are possible, such as Bluetooth, WiFi, WiFi Direct, and APiX.

[0104] The communication unit (120) can receive weather information, road traffic information, for example, TPEG (Transport Protocol Expert Group) information, from a mobile terminal (800) or a server (900). To this end, the communication unit (120) may be equipped with a mobile communication module (not shown).

[0105] The interface (130) can receive sensor information, etc. from the ECU (770) or sensor device (760) and transmit the received information to the signal processing device (170).

[0106] Here, the sensor information may include at least one of vehicle direction information, vehicle location information (GPS information), vehicle angle information, vehicle speed information, vehicle acceleration information, vehicle inclination information, vehicle forward / backward information, battery information, fuel information, tire information, vehicle lamp information, vehicle interior temperature information, and vehicle interior humidity information.

[0107] Such sensor information may be obtained from a heading sensor, a yaw sensor, a gyro sensor, a position module, a vehicle forward / backward sensor, a wheel sensor, a vehicle speed sensor, a body tilt detection sensor, a battery sensor, a fuel sensor, a tire sensor, a steering sensor based on steering wheel rotation, a vehicle internal temperature sensor, a vehicle internal humidity sensor, etc. Meanwhile, the position module may include a GPS module for receiving GPS information.

[0108] Meanwhile, the interface (130) can receive vehicle front image data, vehicle side image data, vehicle rear image data, vehicle surrounding obstacle distance information, etc. from a camera (195) or a rider (not shown), and transmit the received information to a signal processing device (170).

[0109] The memory (140) can store various data for the overall operation of the vehicle display device (100), such as a program for processing or controlling the signal processing device (170).

[0110] For example, the memory (140) may store data regarding a hypervisor, a first virtual machine, a third virtual machine, or the like, for execution within the processor (175).

[0111] The audio output unit (185) converts an electric signal from the signal processing device (170) into an audio signal and outputs it. For this purpose, a speaker or the like may be provided.

[0112] The power supply unit (190) can supply power required for the operation of each component under the control of the signal processing device (170). In particular, the power supply unit (190) can receive power from a battery or the like inside the vehicle.

[0113] The signal processing device (170) controls the overall operation of each unit within the vehicle display device (100).

[0114] For example, it may include a processor (175) that performs signal processing for a vehicle display (180a, 180b).

[0115] The processor (175) can execute the first virtual machine to the third virtual machine (520 to 540) on the hypervisor (505 in FIG. 5) within the processor (175).

[0116] Meanwhile, the processor (175) may further execute a legacy virtualization machine that receives and processes Ethernet data. For example, the legacy virtualization machine may be executed in the first virtualization machine (520) within the processor (175), as illustrated in FIG. 5.

[0117] Among the first virtualization machine to the third virtualization machine (520 to 540 in FIG. 5), the first virtualization machine (520) may be named a server virtualization machine (Server Virtual Maschine), and the second virtualization machine to the third virtualization machine (530 to 540) may be named a guest virtualization machine (Guest Virtual Maschine).

[0118] At this time, the second virtualization machine (530) can operate for the first display (180a), and the third virtualization machine (540) can operate for the second display (180b).

[0119] For example, the first virtual machine (520) within the processor (175) can receive, process, or process vehicle sensor data, location information data, camera image data, audio data, or touch input data, and output them. By distinguishing between data processed only in the legacy virtual machine and data processed in the first virtual machine (520), data processing can be performed efficiently. In particular, by performing most of the data processing in the first virtual machine (520), data sharing in a 1:N manner becomes possible.

[0120] As another example, the first virtual machine (520) can directly receive and process CAN communication data, audio data, radio data, USB data, and wireless communication data for the second virtual machine to the third virtual machine (530 to 540).

[0121] And, the first virtual machine (520) can transmit processed data to the second virtual machine or the third virtual machine (530 to 540).

[0122] Accordingly, among the first virtual machine to the third virtual machine (520 to 540), only the first virtual machine (520) receives communication data and external input data and performs signal processing, thereby reducing the signal processing burden on other virtual machines, enabling 1:N data communication, and enabling synchronization when sharing data.

[0123] Meanwhile, the first virtualization machine (520) records a portion of the data in the first shared memory (not shown) so that it is transferred to the second virtualization machine (530), and records another portion of the data in the first shared memory (not shown) so that it is transferred to the third virtualization machine. The second virtualization machine (530) and the third virtualization machine (540) each process the received data and control the processed data to be recorded in the second shared memory (not shown). Accordingly, it is possible to stably output sound corresponding to the image.

[0124] The data at this time may be any one of video data, audio data, navigation data, or voice recognition data.

[0125] Meanwhile, the first virtual machine (520) can process another portion of the data and control the processing to be recorded in the second shared memory (not shown). That is, in addition to the second virtual machine (530) and the third virtual machine, the first virtual machine (520) can perform data processing.

[0126] Meanwhile, when a fourth virtualization machine (550) operating for a third display (180c) is executed within the processor (175), the first virtualization machine (520) can record another part of the data into the first shared memory (not shown), and the fourth virtualization machine (550) can control the data received to be processed and recorded into the second shared memory (not shown).

[0127] Meanwhile, the first virtual machine (520) can create separate command queues for distributed processing of data in the second virtual machine, third virtual machine (530, 540). Accordingly, data can be shared and processed across multiple virtual machines.

[0128] Meanwhile, the first virtual machine (520) within the processor (175) can generate one identical command queue when sharing the same data with the second virtual machine to the third virtual machine (530, 540). Accordingly, the same data can be synchronized and shared.

[0129] Meanwhile, the first virtual machine (520) can create a command queue corresponding to the number of virtual machines for distributed processing of data.

[0130] Meanwhile, the first virtual machine (520) can control at least a portion of the data to be transmitted to at least one of the second virtual machine (530) or the third virtual machine (540) for data distribution processing.

[0131] For example, the first virtual machine (520) allocates a first shared memory (not shown) for transmitting at least a portion of data to at least one of the second virtual machine (530) or the third virtual machine (540), and image data processed in the second virtual machine (530) or the third virtual machine (540) can be recorded in the second shared memory (not shown).

[0132] Meanwhile, the first virtual machine (520) can control the second virtual machine (530) and the third virtual machine (540) to share the same data by writing data to the shared memory (508).

[0133] For example, the first virtual machine (520) can record radio data or wireless communication data in the shared memory (508) and control the second virtual machine (530) and the third virtual machine (540) to share the same data. Accordingly, sharing of data in a 1:N manner becomes possible.

[0134] Ultimately, by performing most of the data processing on the first virtual machine (520), data sharing in a 1:N manner becomes possible.

[0135] Meanwhile, the first virtual machine (520) within the processor (175) can control the shared memory (508) based on the hypervisor (505) to be set for the same data transfer to the second virtual machine (530) and the third virtual machine (540).

[0136] That is, the first virtual machine (520) within the processor (175) can synchronize and transmit the same data to the second virtual machine (530) and the third virtual machine (540) using the shared memory (508) based on the hypervisor (505). Accordingly, the same image can be synchronized and displayed on multiple displays (180a to 180b) within the vehicle.

[0137] Meanwhile, the signal processing device (170) can process various signals such as audio signals, video signals, and data signals. To this end, the signal processing device (170) can be implemented in the form of a system on chip (SOC).

[0138] FIG. 4 is a diagram illustrating a system driven by a signal processing device related to the present disclosure.

[0139] Referring to the drawings, FIG. 4 is a drawing illustrating that virtual machines are used for each of the cluster display (180a) and the AVN display (180b).

[0140] The system (400) driven by the signal processing device of FIG. 4 exemplifies that a cluster virtualization machine (430) and an AVN virtualization machine (440) are executed on a hypervisor (405) within a processor (175).

[0141] Meanwhile, the system (400) driven by the signal processing device of FIG. 4 exemplifies that a legacy virtualization machine (410) is also executed on a hypervisor (405) within the processor (175).

[0142] The legacy virtualization machine (410) has an interface (412) for data communication with memory (140) and an interface (413) for Ethernet communication.

[0143] Meanwhile, the cluster virtualization machine (430) may be equipped with an interface (431) for CAN communication, an interface (432) for communication with an interface (412) of a legacy virtualization machine (410), and an interface (433) for communication with an interface (413) of a legacy virtualization machine (410).

[0144] Meanwhile, the AVN virtualization machine (440) may be equipped with an interface (441) for input / output of audio data, radio data, USB data, and wireless communication data, an interface (442) for communication with an interface (412) of a legacy virtualization machine (410), and an interface (443) for communication with an interface (413) of a legacy virtualization machine (410).

[0145] According to this system (400), CAN communication data is input / output only in the cluster virtualization machine (430), so there is a disadvantage in that CAN communication data cannot be utilized in the AVN virtualization machine (440).

[0146] In addition, according to the system (400) of FIG. 4, audio data, radio data, USB data, and wireless communication data are input / output only in the AVN virtualization machine (440), so there is a disadvantage in that such data cannot be utilized in the cluster virtualization machine (430).

[0147] Meanwhile, there is a disadvantage in that the cluster virtualization machine (430) and the cluster virtualization machine (430) must each have separate interfaces (431, 432, 441, 442) for memory data and Ethernet communication data input / output from the legacy virtualization machine (410).

[0148] Accordingly, this disclosure proposes a method for improving the system of FIG. 4. That is, unlike FIG. 4, the virtual machine is divided into a server virtual machine and a guest virtual machine, and various memory data, communication data, etc. are input / output from the server virtual machine, rather than from the guest virtual machine. This is described with reference to FIG. 5 and below.

[0149] FIG. 5 is a diagram illustrating an example of a system driven by a signal processing device according to an embodiment of the present disclosure.

[0150] Referring to the drawing, the system (500) of FIG. 5 exemplifies that a first virtual machine (520), which is a server virtualization machine, a second virtual machine (530), which is a guest virtualization machine, and a third virtual machine (540), which is a guest virtualization machine, are executed on a hypervisor (505) within a processor (175) within a signal processing device (170).

[0151] The second virtualization machine (530) may be a virtualization machine for a cluster display (180a), and the third virtualization machine (540) may be a virtualization machine for an AVN display (180b).

[0152] That is, the second virtualization machine (530) and the third virtualization machine (540) can operate for image rendering of the cluster display (180a) and AVN display (180b), respectively.

[0153] Meanwhile, the system (500) driven by the signal processing device (170) of FIG. 5 exemplifies that a legacy virtualization machine (510) is also executed on a hypervisor (505) within the processor (175).

[0154] The legacy virtualization machine (510) has an interface (511) for data communication with memory (140) and Ethernet communication.

[0155] In the drawing, the interface (511) is illustrated as a physical device driver, but various modifications are possible.

[0156] Meanwhile, the legacy virtualization machine (510) may further include an interface (virtio-backend interface) (512) for data communication with the second and third virtualization machines (530, 540).

[0157] The first virtual machine (520) may be equipped with an interface (521) for input / output of audio data, radio data, USB data, and wireless communication data, and an input / output server interface (522) for data communication with a guest virtual machine.

[0158] That is, the first virtualization machine (520), which is a server virtualization machine, can provide I / Os that are difficult to virtualize by standard virtualization technology (VirtIO) to a number of guest virtualization machines, for example, the second and third virtualization machines (530, 540).

[0159] Meanwhile, the first virtual machine (520), which is a server virtualization machine, can control radio data, audio data, etc. at the supervisor level and provide them to a number of guest virtualization machines, for example, the second to third virtualization machines (530, 540).

[0160] Meanwhile, the first virtual machine (520), which is a server virtualization machine, processes vehicle data, sensor data, vehicle surrounding information, etc., and can provide the processed data or information, etc. to a plurality of guest virtualization machines, for example, the second to third virtualization machines (530, 540).

[0161] Meanwhile, the first virtual machine (520) can provide services (Supervisory Services), such as processing of vehicle data and management of audio routing.

[0162] Next, the second virtual machine (530) may be equipped with an input / output client interface (532) for data communication with the first virtual machine (520) and APIs (533) for controlling the input / output client interface (532).

[0163] Additionally, the second virtualization machine (530) may be equipped with an interface (virtio-backend interface) for data communication with the legacy virtualization machine (510).

[0164] The second virtualization machine (530) can receive memory data through communication with memory (140) or Ethernet data through Ethernet communication from the interface (virtio-backend interface) (512) of the legacy virtualization machine (510) through the interface (virtio-backend interface).

[0165] Next, the third virtual machine (540) may be equipped with an input / output client interface (542) for data communication with the first virtual machine (520) and APIs (543) for controlling the input / output client interface (542).

[0166] Additionally, the third virtualization machine (540) may be equipped with an interface (virtio-backend interface) for data communication with the legacy virtualization machine (510).

[0167] The third virtualization machine (540) can receive memory data through communication with memory (140) or Ethernet data through Ethernet communication from the interface (virtio-backend interface) (512) of the legacy virtualization machine (510) through the interface (virtio-backend interface).

[0168] Meanwhile, unlike FIG. 5, the legacy virtualization machine (510) may also be provided within the first virtualization machine (520).

[0169] According to this system (500), CAN communication data is input / output only in the first virtual machine (520), but through data processing in the first virtual machine (520), it can be provided to a plurality of guest virtual machines, for example, the second to third virtual machines (530, 540). Therefore, 1:N data communication through processing in the first virtual machine (520) becomes possible.

[0170] In addition, according to the system (500) of FIG. 5, audio data, radio data, USB data, and wireless communication data are input and output only in the first virtual machine (520), but can be provided to multiple guest virtual machines, for example, second and third virtual machines (530, 540), through data processing in the first virtual machine (520). Therefore, 1:N data communication through processing in the first virtual machine (520) becomes possible.

[0171] In addition, according to the system (500) of FIG. 5, a touch input (Touch) for the first display (180a) or the second display (180b) is input only to the first virtual machine (520), and is not input to the second or third virtual machines (530, 540). Information about the touch input (Touch) is transmitted to the second virtual machine (530) or the third virtual machine (540).

[0172] Accordingly, touch input processing can be performed quickly and accurately. Furthermore, even as the number of running virtual machines increases, touch input processing can be performed quickly and accurately.

[0173] Meanwhile, in the system (500) of FIG. 5, the second and third virtual machines (530, 540) can operate based on different OSs.

[0174] For example, the second virtual machine (540) may operate under a Linux OS, and the third virtual machine (540) may operate under a web OS.

[0175] The first virtual machine (520) and the second to third virtual machines (530, 540) can set up a shared memory (508) based on a hypervisor (505) for data sharing even if they operate under different OS bases.

[0176] Accordingly, the second and third virtual machines (530, 540) can synchronize and share the same data or images even when operating under different operating systems (OS). Consequently, the same data or images can be synchronized and displayed on multiple displays (180a, 180b).

[0177] Meanwhile, the first virtual machine (520) transmits information about the touch input (Touch) to the second virtual machine (530) or the third virtual machine (540), even if the second and third virtual machines (530, 540) operate under different operating systems (OS). Accordingly, the second and third virtual machines (530, 540) can quickly and accurately process the touch input (Touch), even if they operate under different operating systems (OS).

[0178] Meanwhile, the first virtual machine (520) can execute a display manager (527) for controlling images or overlays displayed on the first display (180a) and the second display (180b) through the second to third virtual machines (530, 540).

[0179] Meanwhile, the first virtual machine (520) can execute a display layer server (529) and a virtual overlay generator (523) that creates a virtual overlay.

[0180] The display layer server (529) can receive a first overlay provided by a second virtualization machine (530) and a second overlay provided by a third virtualization machine (540).

[0181] Meanwhile, the display layer server (529) can transmit the virtual overlay generated by the virtual overlay generator (523) to at least one of the second virtualization machine (530) or the third virtualization machine (540).

[0182] Meanwhile, the display manager (527) within the first virtualization machine (520) can receive the first overlay provided by the second virtualization machine (530) and the second overlay provided by the third virtualization machine (540) through the display layer server (529).

[0183] In addition, the display manager (527) within the first virtualization machine (520) can control to transmit a virtual overlay separate from the first overlay or the second overlay to at least one of the second virtualization machine (530) or the third virtualization machine (540) through the display layer server (529).

[0184] In response to this, the second virtual machine (530) can control the synthesis of the first overlay and the virtual overlay to be displayed on the first display (180a).

[0185] Additionally, the third virtual machine (540) can control the second overlay and the virtual overlay to be synthesized and displayed on the second display (180b).

[0186] Meanwhile, the first virtual machine (520) may be equipped with an input manager (524) that receives an input signal from the outside. The input signal at this time may be an input signal of a predetermined button (such as a start button) within the vehicle, a touch input signal, or a voice input signal.

[0187] For example, the input manager (524) within the first virtual machine (520) can receive touch input from the first display (180a) or the second display (180b).

[0188] Meanwhile, the first virtual machine (520) may be equipped with a touch server (528) that transmits information about a touch input (Touch) related to a touch input from the first display (180a) or the second display (180b) to the second virtual machine (530) or the third virtual machine (540).

[0189] For example, when there is a touch input corresponding to the first display (180a), the touch server (528) within the first virtual machine (520) can transmit information about the touch input (Touch) to the second virtual machine (530).

[0190] Meanwhile, the touch server (528) within the first virtual machine (520) may receive touch input from the first display (180a) or the second display (180b).

[0191] Meanwhile, the first virtual machine (520) can execute an audio manager (525) for controlling sound corresponding to an image displayed on the first display (180a) or the second display (180b).

[0192] For example, the audio manager (525) can be controlled to process an audio signal corresponding to an image displayed on the first display (180a) or the second display (180b).

[0193] Meanwhile, the audio manager (525) controls the allocation of audio signals corresponding to each of the multiple speakers within the vehicle. Accordingly, sound corresponding to the image can be stably output.

[0194] Meanwhile, the audio manager (525) can control the allocation of a first audio signal to a first speaker when a first image is displayed on a first display (180a), and the allocation of a second audio signal to a second speaker when a second image is displayed on a second display (180b). Accordingly, sound corresponding to the image can be stably output.

[0195] FIG. 6 is a diagram illustrating another example of a system driven by a signal processing device according to an embodiment of the present disclosure.

[0196] Referring to the drawing, according to the system (500b) driven by the processor (175) in the signal processing device (170) of FIG. 6, the processor (175) in the signal processing device (170) executes the first virtual machine to the third virtual machine (520 to 540) on the hypervisor (505) in the processor (175), and the first virtual machine (520) in the processor (175) controls the setting of the shared memory (508) based on the hypervisor (505) for data transmission to the second virtual machine (530) and the third virtual machine (540).

[0197] For example, information about a touch input (Touch) can be exemplified as data. Accordingly, information about the touch input (Touch) is transmitted to the second virtual machine (530) or the third virtual machine (540), and ultimately, processing of the touch input (Touch) for the first display (180a) or the second display (180b) can be performed quickly and accurately. In addition, even if the number of virtual machines being operated increases, processing of the touch input (Touch) can be performed quickly and accurately.

[0198] As another example, image data may be exemplified as data. Accordingly, an image can be displayed on the first display (180a) or the second display (180b).

[0199] Meanwhile, when the same image data is shared in the shared memory (508), the same image can be displayed in synchronization on multiple displays (180a to 180b) within the vehicle.

[0200] As another example, data may include CAN communication data, audio data, radio data, USB data, wireless communication data, location information data, etc. Accordingly, information about the corresponding data can be displayed on the first display (180a) or the second display (180b).

[0201] Meanwhile, although not shown in FIG. 6, the legacy virtualization machine (510) can transmit memory data from the memory (140) or Ethernet data via Ethernet communication to the second virtualization machine (530) and the third virtualization machine (540) using the shared memory (508) based on the hypervisor (505). Accordingly, information corresponding to the memory data or Ethernet data can be displayed on the first display (180a) or the second display (180b).

[0202] Meanwhile, the first virtual machine (520) in the system (500b) of FIG. 6 may be equipped with a display manager (527), a display layer server (529), a virtual overlay generator (523), an input manager (524), and a touch server (528), similar to the first virtual machine in the system (500) of FIG. 5.

[0203] Meanwhile, the input / output server interface (522) in the first virtual machine (520) in the system (500b) of FIG. 6 may be equipped with a display layer server (529) and a touch server (528), unlike FIG. 5.

[0204] The operations of the display manager (527), display layer server (529), input manager (524), virtual overlay generator (523), touch server (528), and audio manager (525) are the same as in Fig. 5, so their description is omitted.

[0205] Meanwhile, the first virtual machine (520) of FIG. 6 may further include a system manager for overall system control, a vehicle information manager for vehicle information management, a radio manager for radio control, etc.

[0206] Meanwhile, the input / output server interface (522) in the first virtual machine (520) in the system (500b) of FIG. 6 may further include a GNSS server for input / output of GPS information, a Bluetooth server for Bluetooth input / output, a WiFi server for WiFi input / output, a camera server for camera data input / output, etc.

[0207] FIG. 7 is a diagram illustrating another example of a system driven by a signal processing device according to an embodiment of the present disclosure.

[0208] Referring to the drawing, the system (500c) driven by the processor (175) in the signal processing device (170) of FIG. 7 is almost similar to the system (500b) of FIG. 6.

[0209] That is, as in FIG. 6, the processor (175) of FIG. 7 executes the first virtual machine to the third virtual machine (520 to 540) on the hypervisor (505) within the processor (175).

[0210] However, in FIG. 7, unlike FIG. 6, the display layer server (529) and the touch server (528) can be provided and executed within the first virtual machine (520) outside the input / output server interface (522).

[0211] In addition, unlike FIG. 6, a GNSS server for input / output of GPS information, a Bluetooth server for Bluetooth input / output, a WiFi server for WiFi input / output, a camera server for camera data input / output, etc. may be provided and executed within the first virtual machine (520) outside of the input / output server interface (522).

[0212] That is, within the first virtual machine (520), a display manager (527), a display layer server (529), a virtual overlay generator (523), an input manager (524), and a touch server (528) can be provided and executed.

[0213] The operations of the display manager (527), display layer server (529), virtual overlay generator (523), input manager (524), touch server (528), and audio manager (525) are the same as in Fig. 5, so their description is omitted.

[0214] Figures 8 to 9b are drawings referenced in the description of Figure 5.

[0215] First, FIG. 8 illustrates a process of executing a first virtual machine to a third virtual machine (520 to 540) on a hypervisor (505) within a processor (175) within a system (500) according to an embodiment of the present disclosure, and controlling the first virtual machine (520) within the processor (175) to set a shared memory (508) based on the hypervisor (505) for the same data transfer to a second virtual machine (530) and a third virtual machine (540).

[0216] Accordingly, the same image can be displayed in synchronization on multiple displays (180a to 180b) within the vehicle.

[0217] Meanwhile, high-speed data communication between multiple virtual machines becomes possible. Furthermore, high-speed data communication is possible even when multiple virtual machines are running different operating systems.

[0218] Meanwhile, when the first virtual machine (520) within the processor (175) transmits data processed in the first virtual machine (520) to another virtual machine, it can utilize a single shared memory (508) rather than allocating a number of memory corresponding to the number of virtual machines. Accordingly, rather than a 1:1 data communication between virtual machines, a 1:N data communication is possible using the shared memory (508).

[0219] Meanwhile, the first virtual machine (520) within the processor (175) may include an input / output server interface (522) and a security manager (526).

[0220] Meanwhile, the second virtual machine (530) and the third virtual machine (540) may each include input / output client interfaces (532, 542). Accordingly, high-speed data communication between multiple virtual machines can be performed using the input / output server interface (522) and the input / output client interfaces (532, 542).

[0221] The input / output server interface (522) within the first virtual machine (520) can receive the same data transmission request from each input / output client interface (532, 542) within the second virtual machine (530) and the third virtual machine (540), and based on this, can transmit the shared data to the shared memory (508) through the security manager (526).

[0222] Figure 9a illustrates a more detailed diagram of shared data transmission.

[0223] Referring to the drawing, for shared data transmission, the input / output server interface (522) within the first virtual machine (520) transmits a request for allocation of shared memory (508) to the security manager (526) (S1).

[0224] Next, the security manager (526) can allocate shared memory (508) using the hypervisor (505) (S2) and record shared data in the shared memory (508).

[0225] Meanwhile, the input / output client interface (532, 542) can transmit a connection request to the input / output server interface (522) after allocating shared memory (508) (S3).

[0226] Meanwhile, after allocating shared memory (508), the input / output server interface (522) transmits information about the shared memory (508) containing key data to the input / output client interfaces (532, 542) (S4). The key data at this time may be private key data.

[0227] That is, on the one hand, the first virtual machine (520) within the processor (175) can transmit information about the shared memory (508) to the second virtual machine (530) and the third virtual machine (540) after setting up the shared memory (508).

[0228] Next, the input / output server interface (522) within the first virtual machine (520) controls the creation of a command queue for command or event processing, separate from data, for distributed processing control between virtual machines (S5).

[0229] In the drawing, it is illustrated that a command queue is created in a command queue buffer (504) within a hypervisor (505) under the control of an input / output server interface (522). However, this is not limited to this, and it is also possible for a command queue to be created within a first virtual machine (520) rather than within the hypervisor (505) under the control of an input / output server interface (522).

[0230] Next, each input / output client interface (532, 542) accesses the command queue buffer (504) to receive information about the generated command queue or command queues (S6).

[0231] For example, if the commands to each input / output client interface (532, 542) are the same, the generated command queues may be the same.

[0232] As another example, if the commands to each input / output client interface (532, 542) are different, different command queues may be delivered to each input / output client interface (532, 542).

[0233] Next, each input / output client interface (532, 542) can access the shared memory (508) based on the received key data (S5) and copy or read the shared data from the shared memory (508) (S7).

[0234] In particular, when each input / output client interface (532, 542) receives the same shared data, the input / output client interface (532, 542) can access the shared memory (508) based on the same command queue and the same key data (S5) and copy or read the shared data from the shared memory (508).

[0235] Accordingly, the shared memory (508) becomes accessible to the second virtual machine (530) and the third virtual machine (540), and ultimately, shared data can be shared.

[0236] For example, if the shared data is image data, the image data is shared between the second virtual machine (530) and the third virtual machine (540), and ultimately, the same shared image can be displayed in synchronization on multiple displays (180a to 180b) within the vehicle.

[0237] FIG. 9b illustrates that, by the system (500) of FIG. 9a, a second virtualization machine (530) displays image data received through shared memory (508) on a first display (180a), and a third virtualization machine (540) displays image data received through shared memory (508) on a second display (180b).

[0238] In Fig. 9b, synchronization is performed between an image (905a) displayed on a first display (180a) and an image (905b) displayed on a second display (180b), so that at time T1, the same images (905a, 905b) are displayed respectively.

[0239] That is, the image data processed in the first virtualization machine (520) within the processor (175) is transmitted to the second virtualization machine (530) and the third virtualization machine (540) via the shared memory (508), and based on the image data, the first image (905a) displayed on the first display (180a) and the second image (905b) displayed on the second display (180b) may be identical to each other. Accordingly, the same image can be displayed in synchronization on multiple displays (180a to 180b) within the vehicle.

[0240] Fig. 10 is an example of an internal block diagram of a vehicle display device related to the present disclosure.

[0241] Referring to the drawing, a vehicle display device (100x) related to the present disclosure includes a signal processing device (170), a display (180), and an audio output unit (185).

[0242] The signal processing device (170) may include a processor (175) corresponding to a CPU, a graphics processor (175g), an overlay processor (175v), and an audio processor (175u).

[0243] The processor (175) executes a hypervisor (505x) and can execute an operating system (1000x) on the hypervisor (505x).

[0244] Within the hypervisor (505x), a graphics driver (1002) for driving a graphics processor (175g), a display backend driver (1004) for driving a graphics processor (175g) or an overlay processor (175v), and an audio backend driver (1006) for driving an audio processor (175u) may be executed.

[0245] Meanwhile, within the operating system (1000x), an application (1028), a window system (1026) related to the application (1028), a rendering library (1024), an audio flinger (1034), a display front-end driver (1022) corresponding to the display back-end driver (1004), an audio focus manager (1036), and an audio front-end driver (1032) corresponding to the audio back-end driver (1006) may be executed.

[0246] According to the vehicle display device (100x) of FIG. 10, a 2D, 3D rendering request of the operating system (1000x) is transmitted to the graphics processor (175g) through the hypervisor (505x), and the operating system (1000x) is mapped to the overlay processor (175v), which is a specific hardware overlay, through the hypervisor (505x).

[0247] According to the vehicle display device (100x) of Fig. 10, there is a disadvantage in that as many overlay processors (175v) as the number of displays are required, the overlay mapping is fixed, and further, the size and position (x, y, z) of the overlay are fixed.

[0248] Additionally, according to the vehicle display device (100x) of FIG. 10, the sound output path of the application is fixed and is fixedly mapped to a specific audio device, i.e., a specific speaker, so that the sound output becomes global or fixed.

[0249] On the other hand, when there are multiple operating systems (1000x), there is a disadvantage in that audio focus cannot be managed in an integrated manner between different virtual machines, so audio output can only be dedicated to a specific virtual machine.

[0250] Accordingly, this disclosure proposes a method for stably outputting sound corresponding to an image. In particular, the method can stably output sound corresponding to an image even when the number of virtual machines increases, and furthermore, can stably output sound corresponding to an image even when the operating systems of multiple virtual machines differ. This is described with reference to FIG. 11 and below.

[0251] FIG. 11 is an example of an internal block diagram of a vehicle display device according to an embodiment of the present disclosure.

[0252] Referring to the drawing, a vehicle display device (100) according to an embodiment of the present disclosure includes a signal processing device (170), a display (180), and an audio output unit (185).

[0253] The audio output unit (185) may be equipped with multiple speakers (1311 to 1317 in FIG. 13).

[0254] Meanwhile, the signal processing device (170) has a processor (175) corresponding to the CPU.

[0255] Meanwhile, the signal processing device (170) may further include a graphics processor (175g), an overlay processor (175v), and an audio processor (175u).

[0256] The processor (175) executes a hypervisor (505) and can execute an operating system (1000) on the hypervisor (505).

[0257] Meanwhile, the hypervisor (505) executes a display manager (527) for controlling images displayed on the first display (180a) or the second display (180b), and an audio manager (525) for controlling sounds corresponding to images displayed on the first display (180a) or the second display (180b).

[0258] Meanwhile, the hypervisor (505) can further execute a window manager (1008) for controlling the window of an image displayed on the first display (180a) or the second display (180b), and a seat audio provider (1009) for providing seat audio information to the audio manager (525).

[0259] Meanwhile, the hypervisor (505) can further execute a graphics driver (1002) for driving a graphics processor (175g), a virtual GPU backend driver (1004) for the graphics driver (1002), a window system (1005) for an overlay processor (175v), a window (1007) for the window system (1005), a native window (1013) for previews, etc., an audio server (1011) for driving an audio processor (175u), and an audio backend driver (1006) for the audio server (1011).

[0260] Meanwhile, the operating system (1000) can execute a virtual GPU front-end driver (1023) corresponding to a virtual GPU back-end driver (1004), a virtual display (1025) corresponding to a window (1007), and an audio monitor and controller (1039) corresponding to an audio manager (525).

[0261] Meanwhile, the operating system (1000) can execute an application (1028), a window system (1026) related to the application (1028), a rendering library (1024), an audio flinger (1034), an audio focus manager (1036), and an audio front-end driver (1032) corresponding to the audio back-end driver (1006).

[0262] According to the vehicle display device (100) of FIG. 11, a 2D or 3D rendering request of an operating system (1000) is transmitted to a graphics processor (175g) through a hypervisor (505), and the operating system (1000) is mapped to an overlay processor (175v), which is a specific hardware overlay, through the hypervisor (505).

[0263] According to the vehicle display device (100) of FIG. 10, a 2D or 3D rendering request of an application (1028) can be transmitted to a graphics processor (175g) through a hypervisor (505).

[0264] Meanwhile, the operating system (1000) can recognize the virtual display (1025) through the virtual GPU backend driver (1004) or the virtual GPU frontend driver (1022).

[0265] Accordingly, the virtual display (1025) is mapped to a window (1007) within the hypervisor (505).

[0266] Meanwhile, control of the virtual display (1025) within the operating system (1000) can be replaced with control of the window (1007) within the hypervisor (505).

[0267] Accordingly, the constraints of the overlay processor (175v) due to the addition of a display are freed, and the size or position (x, y, z) of the virtual display (1025) can be changed like a window.

[0268] Furthermore, composition and animation support between application screens and native screens within the hypervisor (505) becomes possible.

[0269] Meanwhile, the hypervisor (505) can transmit a graphic signal to a graphic processor (175g), an overlay signal to an overlay processor (175v), or an audio signal to an audio processor (175u).

[0270] Meanwhile, the display manager (527) can manage the creation or removal of a virtual display (1025).

[0271] Meanwhile, the virtual GPU backend driver (1004) can relay 2D or 3D rendering requests and perform creation of a virtual display (1025) or creation of a window (1007).

[0272] Meanwhile, the window manager (1008) can perform property setting or management of a native window (1013) on a hypervisor (505) and a window (1007) of a virtual display.

[0273] Meanwhile, the window manager (1008) can set the location and properties of the window based on the window information loaded at boot time.

[0274] Meanwhile, Windows (1007) can provide an Android screen, a Linux screen, a QNX screen, etc.

[0275] Meanwhile, the audio server (1011) can integrate audio within the operating system (1000) within the hypervisor (505).

[0276] For example, the audio server (1011) can determine the audio output path.

[0277] As another example, the audio server (1011) can dynamically change the mapping between the audio processor (175u) and the speakers within the audio output unit (185).

[0278] Meanwhile, the audio manager (521) can receive information such as audio playback status and focus management status within the virtual machine.

[0279] Meanwhile, the audio manager (521) can remotely control the audio focus within the virtual machine.

[0280] In particular, the audio manager (521) can manage audio focus within all virtual machines and hypervisors (505) in an integrated manner.

[0281] For example, the audio manager (521) can determine the audio output path.

[0282] As another example, the audio manager (521) can dynamically change the mapping between the audio processor (175u) and the speakers within the audio output unit (185).

[0283] Meanwhile, the audio manager (525) within the hypervisor (505) can be controlled to process an audio signal corresponding to an image displayed on the first display (180a) or the second display (180b).

[0284] Meanwhile, the audio manager (525) within the hypervisor (505) controls the allocation of audio signals corresponding to each of the multiple speakers within the vehicle. Accordingly, sound corresponding to the image can be stably output.

[0285] Meanwhile, the audio manager (525) within the hypervisor (505) can control the allocation of a first audio signal to a first speaker when a first image is displayed on a first display (180a), and the allocation of a second audio signal to a second speaker when a second image is displayed on a second display (180b). Accordingly, sound corresponding to the image can be stably output.

[0286] Meanwhile, the audio manager (525) within the hypervisor (505) can assign a first audio signal, on which noise cancellation is not performed, to the first speaker, and a second audio signal, on which noise cancellation is performed, to the second speaker. Accordingly, sound corresponding to the image can be stably output.

[0287] Meanwhile, the audio manager (525) within the hypervisor (505) can control the allocation of audio signals without noise cancellation to some of the multiple speakers, and audio signals with noise cancellation to other speakers. Accordingly, sound corresponding to the image can be stably output.

[0288] Meanwhile, the audio manager (525) within the hypervisor (505) can control the allocation of audio signals containing safety driving information to some of the multiple speakers, and audio signals not containing safety driving information to other speakers. Accordingly, sound corresponding to the image can be stably output.

[0289] Meanwhile, the audio manager (525) within the hypervisor (505) can control the allocation of a first audio signal to a first speaker when a first image is displayed on a first display (180a), a second audio signal to a second speaker when a second image is displayed on a second display (180b), and a third audio signal to a third speaker (1313) when a third image is displayed on a third display (180c). Accordingly, it is possible to stably output sound corresponding to an image.

[0290] Meanwhile, the audio manager (525) within the hypervisor (505) can control the shared memory (508) based on the hypervisor (505) to be set for transmission of the same audio signal to the second virtual machine (530) and the third virtual machine (540). Accordingly, sound corresponding to the image can be stably output.

[0291] Meanwhile, the audio manager (525) within the hypervisor (505) transmits the first audio data to the shared memory (508) based on the hypervisor (505), and the second virtual machine (530) and the third virtual machine (540) can each receive the first audio data within the shared memory (508) so that the same sound is output from the speakers they each manage. Accordingly, it is possible to stably output sound corresponding to the image.

[0292] Meanwhile, if the second virtual machine (530) and the third virtual machine (540) are driven by different operating systems, the audio manager (525) within the hypervisor (505) can manage audio signals within the second virtual machine (530) and audio signals within the third virtual machine (540) in an integrated manner or control audio focus. Accordingly, even if the operating systems of multiple virtual machines are different, sound corresponding to the video can be stably output.

[0293] FIG. 12A is a drawing illustrating an example of display of an overlay in a system driven by a signal processing device according to an embodiment of the present disclosure.

[0294] Referring to the drawing, a processor (175) in a signal processing device (170) according to an embodiment of the present disclosure drives a hypervisor (505) and executes a first virtual machine (520), a second virtual machine (530), and a third virtual machine (540) on the hypervisor (505).

[0295] Meanwhile, the first virtual machine (520) according to the embodiment of the present disclosure executes a display manager (527) and an audio manager (521).

[0296] Meanwhile, the display manager (527) may execute or be equipped with an overlay controller (527a) that controls the overlay, a layer controller (527b) that controls the layer, and a composition controller (527c) that controls the configuration or order of the layer.

[0297] Meanwhile, the audio manager (521) may execute or be equipped with a path controller (1102) that controls the path of an audio signal and a layer controller (1103) that controls a layer of an audio signal.

[0298] Meanwhile, the audio manager (525) can be controlled to process an audio signal corresponding to an image displayed on the first display (180a) or the second display (180b).

[0299] Meanwhile, the audio manager (525) controls the allocation of audio signals corresponding to each of the multiple speakers within the vehicle. Accordingly, sound corresponding to the image can be stably output.

[0300] Meanwhile, the audio manager (525) can control the allocation of a first audio signal to a first speaker when a first image is displayed on a first display (180a), and the allocation of a second audio signal to a second speaker when a second image is displayed on a second display (180b). Accordingly, sound corresponding to the image can be stably output.

[0301] Meanwhile, the audio manager (525) can assign a first audio signal, on which noise cancellation is not performed, to the first speaker, and a second audio signal, on which noise cancellation is performed, to the second speaker. Accordingly, sound corresponding to the image can be stably output.

[0302] Meanwhile, the audio manager (525) can control the allocation of audio signals without noise cancellation to some of the multiple speakers, and audio signals with noise cancellation to other speakers. Accordingly, sound corresponding to the image can be stably output.

[0303] Meanwhile, the audio manager (525) can control the allocation of audio signals containing safety driving information to some of the multiple speakers, and audio signals not containing safety driving information to other speakers. Accordingly, sound corresponding to the image can be stably output.

[0304] Meanwhile, the audio manager (525) can control the allocation of a first audio signal to a first speaker when a first image is displayed on a first display (180a), a second audio signal to a second speaker when a second image is displayed on a second display (180b), and a third audio signal to a third speaker (1313) when a third image is displayed on a third display (180c). Accordingly, it is possible to stably output sound corresponding to an image.

[0305] Meanwhile, the audio manager (525) can control the setting of a shared memory (508) based on the hypervisor (505) for transmission of the same audio signal to the second virtual machine (530) and the third virtual machine (540). Accordingly, sound corresponding to the image can be stably output.

[0306] Meanwhile, the audio manager (525) transmits the first audio data to the shared memory (508) based on the hypervisor (505), and the second virtual machine (530) and the third virtual machine (540) can each receive the first audio data within the shared memory (508) so that the same sound is output from the speakers they each manage. Accordingly, it is possible to stably output sound corresponding to the image.

[0307] Meanwhile, if the second virtual machine (530) and the third virtual machine (540) are driven by different operating systems, the audio manager (525) can manage audio signals within the second virtual machine (530) and the third virtual machine (540) in an integrated manner or control audio focus. Accordingly, even if the operating systems of multiple virtual machines are different, sound corresponding to the video can be stably output.

[0308] Meanwhile, the input / output server interface (522) within the first virtualization machine (520) may execute or be equipped with a front interface (VEa) that transmits a command to configure a virtual overlay to the second virtualization machine (530)(530) to the third virtualization machine (540)(540), or receives a command to configure a virtual overlay from the second virtualization machine (530)(530) to the third virtualization machine (540)(540).

[0309] Meanwhile, the first virtualization machine (520) according to the embodiment of the present disclosure may change the layer order or display area of ​​a virtual overlay, and transmit the changed virtual overlay or information about the changed virtual overlay to the second virtualization machine (530) or the third virtualization machine (540) so that the changed virtual overlay is displayed on the first display (180a) or the second display (180b).

[0310] Meanwhile, the second virtualization machine (530) or the third virtualization machine (540) can control the synthesis of a variable virtual overlay onto each physical overlay and display the synthesized overlay on the first display (180a) or the second display (180b). Accordingly, the synthesized overlay can be displayed on the display.

[0311] Meanwhile, the first virtualization machine (520) according to another embodiment of the present disclosure generates a virtual overlay and transmits the virtual overlay to the second virtualization machine (530) or the third virtualization machine (540), and the second virtualization machine (530) or the third virtualization machine (540) according to another embodiment of the present disclosure can control the first display (180a) or the second display (180b) to change the layer order of the virtual overlay or vary the display area when displaying the virtual overlay.

[0312] Meanwhile, the input / output server interface (522) within the first virtualization machine (520) may be provided with a front interface (VEa) that transmits a command to configure a virtual overlay to the second virtualization machine (530) to the third virtualization machine (540), or receives a command to configure a virtual overlay from the second virtualization machine (530) to the third virtualization machine (540).

[0313] Meanwhile, the input / output client interface (532) within the second virtualization machine (530) may be provided with a front interface (VEb) that receives a command for configuring a virtual overlay from the first virtualization machine (520) or transmits a command for configuring a virtual overlay to the first virtualization machine (520).

[0314] Meanwhile, the second virtualization machine (530) may be equipped with a window manager (537) for controlling the window of an image to create or display an overlay, and a compositor (538) for compositing overlays created or windows created in the second virtualization machine (530).

[0315] Meanwhile, the input / output client interface (542) within the third virtualization machine (540) may be provided with a front interface (VEc) that receives a command for configuring a virtual overlay from the first virtualization machine (520) or transmits a command for configuring a virtual overlay to the first virtualization machine (520).

[0316] Meanwhile, the third virtualization machine (540) may be equipped with a window manager (547) for controlling the window of an image to create or display an overlay, and a compositor (548) for compositing overlays created or windows created in the third virtualization machine (540).

[0317] Meanwhile, the first virtual machine (520) to the third virtual machine (540) can transmit or receive each virtual overlay or each audio signal using the shared memory (508), as described in the description of FIG. 8, FIG. 9a, and FIG. 9b.

[0318] For example, the first virtual machine (520) can transmit the first virtual overlay or the first audio signal generated in the first virtual machine (520) to the second virtual machine (530) to the third virtual machine (540) using the shared memory (508).

[0319] Meanwhile, the first virtual machine (520) can receive each virtual overlay or audio signal generated from the second virtual machine (530) to the third virtual machine (540) using the shared memory (508).

[0320] Meanwhile, the first virtual machine (520) can set the order for multiple virtual overlays and transmit information about the set order to the second virtual machine (530) to the third virtual machine (540) using shared memory (508).

[0321] Meanwhile, the first virtual machine (520) can perform layer order variation or display area variation of a plurality of virtual overlays, and transmit order variation information or area variation information to the second virtual machine (530) to the third virtual machine (540) using the shared memory (508).

[0322] Accordingly, it is possible to display a virtual overlay with a variable order or display area on the first display (180a) or the second display (180b).

[0323] In particular, by using the first virtual machine (520), which is a server virtualization machine, to perform order variation or display area variation, etc., control over overlays displayed on multiple displays can be efficiently performed.

[0324] In addition, by using the first virtual machine (520), which is a server virtualization machine, to control the entire overlay, rapid and accurate display is possible.

[0325] Meanwhile, the second virtualization machine (530) to the third virtualization machine (540) can each create a virtual overlay, and the first virtualization machine (520) can set the order or display area of ​​the virtual overlays created in the first virtualization machine (520) to the third virtualization machine (540). Accordingly, control of the order or display area for the virtual overlays becomes possible.

[0326] Meanwhile, the first virtual machine (520) can change the order of the overlay or the display area of ​​the virtual overlays generated in the second virtual machine (530) to the third virtual machine (540), respectively. Accordingly, the order or display area of ​​the virtual overlay can be changed.

[0327] Meanwhile, the first virtual machine (520) can change the configuration of the layers displayed on the first display (180a) or the second display (180b) during runtime. Accordingly, the configuration of the layers displayed during runtime can be changed.

[0328] Meanwhile, the first virtual machine (520) can create a virtual overlay that is displayed on both the first display (180) and the second display (180b). Accordingly, the created virtual overlay can be easily displayed.

[0329] Meanwhile, the first virtual machine (520) can control the generated virtual overlay to be moved and displayed on the first display (180a) or the second display (180b). Accordingly, the movement of the generated virtual overlay can be easily performed.

[0330] Meanwhile, the first virtual machine (520) can control the audio signal corresponding to the generated virtual overlay to be moved and output from the speaker corresponding to the first display (180a) or the second display (180b). Accordingly, the sound corresponding to the movement of the generated virtual overlay can be stably output.

[0331] In Fig. 11, a virtual overlay (OVL1) generated in a second virtualization machine (530) is placed on a virtual overlay (VOLm1) generated in a first virtualization machine (520), and the overlay synthesized in a synthesizer (538) is displayed on a first display (180a). Accordingly, efficient resource management becomes possible.

[0332] Meanwhile, in FIG. 11, a virtual overlay (OVL2) generated in a third virtualization machine (540) is placed on a virtual overlay (VOLm1) generated in a first virtualization machine (520), and the overlay synthesized in a synthesizer (548) is displayed on a second display (180b). Accordingly, efficient resource management becomes possible.

[0333] FIG. 12b is a diagram illustrating an example of an overlay display and audio output in a system driven by a signal processing device according to an embodiment of the present disclosure.

[0334] Referring to the drawing, a processor (175) within a signal processing device (170) can execute a hypervisor (505) and execute a first operating system (1000a) and a second operating system (1000b) on the hypervisor (505).

[0335] Meanwhile, the first image (1210) and the second image (1220) running on the first operating system (1000a) can be displayed on the first display (180a) and the second display (180b), respectively.

[0336] Meanwhile, a third image (1230) running on a second operating system (1000b) can be displayed on a third display (180c).

[0337] Meanwhile, the hypervisor (505) can execute a first window (VSa), a second window (VSb), and a third window (VSc) corresponding to the first image (1210), the second image (1220), and the third image (1230), respectively, and can execute a first audio stream (ASa), a second audio stream (ASb), and a third audio stream (ASc) corresponding to the first window (VSa), the second window (VSb), and the third window (VSc), respectively.

[0338] Meanwhile, the display manager (527) within the hypervisor (505) controls the first window (VSa), the second window (VSb), and the third window (VSc), and the audio manager (521) within the hypervisor (505) can control the first audio stream (ASa), the second audio stream (ASb), and the third audio stream (ASc).

[0339] Meanwhile, the display manager (527) within the hypervisor (505) can map the first window (VSa), the second window (VSb), and the third window (VSc) to the first hardware overlay (1211), the second hardware overlay (1212), and the third hardware overlay (1213) within the signal processing device (170), respectively.

[0340] Meanwhile, the audio manager (521) within the hypervisor (505) can map the first audio stream (ASa), the second audio stream (ASb), and the third audio stream (ASc) to the first speaker (1311), the second speaker (1312), and the third speaker (1313), respectively.

[0341] Meanwhile, when the second image (1220) displayed on the second display (180b) and the third image (1230) displayed on the third display (180c) are switched, the display manager (527) within the hypervisor (505) can map the third window (VSc) and the second window (VSb) to the second hardware overlay (1212) and the third hardware overlay (1213), respectively.

[0342] Meanwhile, when the second image (1220) displayed on the second display (180b) and the third image (1230) displayed on the third display (180c) are switched, the audio manager (521) within the hypervisor (505) can map the third audio stream (ASc) and the second audio stream (ASb) to the second speaker (1312) and the third speaker (1313), respectively. Accordingly, the mapping between speakers can be dynamically changed.

[0343] Meanwhile, the first hardware overlay (1211), the second hardware overlay (1212), and the third hardware overlay (1213) in FIG. 12 may correspond to the overlays in the overlay processor (175v) in FIG. 11.

[0344] Figure 13 is a drawing showing a plurality of speakers (1311 to 1317) in a vehicle.

[0345] Referring to the drawing, a plurality of speakers (1311 to 1317) may be arranged inside the vehicle (200).

[0346] The first speaker (1311) corresponds to the cluster display (180a), and the second speaker (1312) corresponds to the AVN display (180b).

[0347] Meanwhile, the third speaker (1313) can correspond to the passenger seat display or AVN display (180b).

[0348] Meanwhile, the fourth speaker (1314) can correspond to the RSE display on the left rear, and the fifth speaker (1315) can correspond to the RSE display (180c) on the right rear.

[0349] Alternatively, the fourth speaker (1314) may correspond to the cluster display (180a), and the fifth speaker (1315) may correspond to the passenger seat display or AVN display (180b).

[0350] Meanwhile, the sixth speaker (1316) can correspond to the RSE display on the left rear, and the seventh speaker (1317) can correspond to the RSE display (180c) on the right rear.

[0351] The first table (TBa) to the fourth table (TBb) in the drawing can be provided from the seat audio provider (1009) of FIG. 11 to the audio manager (525).

[0352] For example, the first table (TBa) corresponding to the setting information of the first speaker (1311) may include information on non-application of noise canceling, application of safe driving notification, application of audio ducking, channel information when sound is output such as 5.1 channels, audio language information such as Korean, and equalizer type information such as classic.

[0353] Meanwhile, the second table (TBb) corresponding to the setting information of the third speaker (1312) may include noise canceling application information, safe driving notification application information, audio ducking application information, channel information when outputting sound such as 5.1 channels, audio language information such as Korean, and equalizer type information such as jazz.

[0354] Meanwhile, the third table (TBc) corresponding to the setting information of the fourth speaker (1314) and the sixth speaker (1316) may include noise canceling application information, safe driving notification non-application information, audio ducking non-application information, channel information when sound is output such as 7.1 channels, audio language information such as dubbing, and equalizer type information such as rock.

[0355] Meanwhile, the fourth table (TBd) corresponding to the setting information of the fifth speaker (1315) and the seventh speaker (1317) may include noise canceling application information, safe driving notification non-application information, audio ducking non-application information, channel information when sound is output such as 7.1 channels, audio language information such as English, and equalizer type information such as jazz.

[0356] Meanwhile, the audio manager (525) can control to allocate audio signals on which noise cancellation is not performed to some (1311) of the plurality of speakers (1311 to 1317) based on the plurality of table information (TBa to TBd) received, and to allocate audio signals on which noise cancellation is performed to other some (1313 to 1317).

[0357] For example, the audio manager (525) can assign a first audio signal, on which noise cancellation is not performed, to the first speaker (1311), and a second audio signal, on which noise cancellation is performed, to the second speaker (1312). Accordingly, it is possible to stably output sound corresponding to the seat.

[0358] As another example, the audio manager (525) may assign a first audio signal, on which noise cancellation is not performed, to the first speaker (1311), and a third audio signal, on which noise cancellation is performed, to the third speaker (1313). Accordingly, it is possible to stably output sound corresponding to the seat.

[0359] Meanwhile, the audio manager (525) can control to allocate audio signals including safe driving information to some of the plurality of speakers (1311 to 1317) and to allocate audio signals not including safe driving information to other speakers.

[0360] For example, the audio manager (525) can control to allocate an audio signal including safety driving information to the first speaker (1311) or the third speaker (1313) among the plurality of speakers (1311 to 1317), and to allocate an audio signal not including safety driving information to the fourth to seventh speakers (1314 to 1317). Accordingly, it is possible to stably output a sound corresponding to the seat.

[0361] Meanwhile, the audio manager (525) can assign a first audio signal to a first speaker (1311) when displaying a first image on a first display (180a), and can assign a second audio signal to a second speaker (1312) when displaying a second image on a second display (180b).

[0362] For example, when displaying a cluster image on the first display (180a), the audio manager (525) can assign a first audio signal corresponding to the cluster image to the first speaker (1311), and when displaying a navigation image on the second display (180b), the audio manager (525) can assign a second audio signal corresponding to the navigation image to the second speaker (1312). Accordingly, it is possible to stably output a sound corresponding to the image.

[0363] Meanwhile, the audio manager (525) can assign a third audio signal to the fifth speaker (1315) or the seventh speaker (1317) when displaying a third image on the third display (180c).

[0364] For example, when a game image or streaming image is displayed on the RSE display (180c) on the right rear, the audio manager (525) can assign an audio signal corresponding to the game image or streaming image to the fifth speaker (1315) or the seventh speaker (1317). Accordingly, the sound corresponding to the image can be stably output.

[0365] Meanwhile, the audio manager (525) can display a first image on the first display (180a) and, when displaying a second image on the second display (180b), assign a first audio signal corresponding to the second image to the second speaker (1312).

[0366] For example, when a cluster image is displayed on the first display (180a) and a navigation image is displayed on the second display (180b), the audio manager (525) can assign a first audio signal corresponding to the navigation image to the second speaker (1312).

[0367] That is, if there is no audio signal corresponding to the cluster image, the audio signal may not be assigned to the first speaker (1311). Accordingly, it is possible to stably output sound corresponding to the image.

[0368] Meanwhile, when a third image is displayed on the third display (180ㅊ), the audio manager (525) can assign a second audio signal corresponding to the third image to the fifth speaker (1315) or the seventh speaker (1317). Accordingly, it is possible to stably output sound corresponding to the image.

[0369] Meanwhile, the audio manager (525) can dynamically change the settings for multiple speakers according to the passenger settings.

[0370] For example, the first to fourth tables (TBa to TBd) in the drawing may correspond to setting information for each passenger, rather than setting information for each speaker according to seat position.

[0371] Specifically, the first to fourth tables (TBa to TBd) can correspond to setting information for the first to fourth passengers, respectively.

[0372] Specifically, the signal processing device (170) can determine the passenger based on the identification information when identification information is received from a mobile terminal based on a wireless communication method such as Bluetooth.

[0373] In addition, the audio manager (525) within the signal processing device (170) can control the application of noise canceling, safe driving notification, audio ducking, sound output, audio language, or equalizer, respectively, based on the passenger-specific tables (TBa to TBd) corresponding to the identified passenger. Accordingly, audio settings can be dynamically changed and applied.

[0374] FIG. 14 is an example of an operation method of a signal processing device according to an embodiment of the present disclosure.

[0375] Referring to the drawing, the audio manager (525) within the signal processing device (170) receives a display change input of an image to be displayed (S1412) and determines an audio output location based on the change input (S1413).

[0376] For example, when the audio manager (525) in the signal processing device (170) receives a change input from the first image being displayed on the second display (180a) to the third display (180c), the audio manager (525) can change the output location of the audio signal corresponding to the first image from the first speaker (1311) to the fifth speaker (1315) based on the third table (TBc).

[0377] And, the audio manager (525) in the signal processing device (170) receives audio setting information for each seat (S1414) and receives setting information for each passenger (S1416).

[0378] And, the audio manager (525) within the signal processing device (170) can change the audio language (S1418), select an audio output system (S1420), and change the equalizer (S1422).

[0379] For example, when the audio manager (525) within the signal processing device (170) receives a change input from the first image being displayed on the second display (180a) to the third display (180c), the audio manager (525) can change the audio language from Korean to English and change the equalizer from the classical setting to the jazz setting based on the third table (TBc).

[0380] Meanwhile, the audio manager (525) within the signal processing device (170) determines whether a safe driving notification is necessary (S1424), and if so, receives ADAS information and mixes the ADAS information into the audio signal (S1425).

[0381] For example, when the audio manager (525) within the signal processing device (170) receives a change input from the third image being displayed on the third display (180c) to the second display (180b), it receives ADAS information related to safe driving notification information based on the second table (TBb). The ADAS information at this time may include distance information from the vehicle ahead or speed information of the vehicle.

[0382] In addition, the audio manager (525) in the signal processing device (170) can control an audio signal corresponding to a third image mixed with distance information from the front vehicle or speed information of the vehicle to be output from the third speaker (1313).

[0383] At this time, the audio manager (525) in the signal processing device (170) can control the audio signal corresponding to the third image to be smaller than the existing sound volume through audio ducking.

[0384] Meanwhile, the audio manager (525) in the signal processing device (170) determines whether external noise blocking is necessary if there is no need for a safe driving notification (S1426), and applies noise reduction if applicable (S1427).

[0385] And, the audio manager (525) within the signal processing device (170) completes audio routing and settings (S1428).

[0386] Figures 15a to 19 are drawings referred to in the description of Figure 14.

[0387] Figure 15a is a drawing explaining a layout change.

[0388] Referring to the drawing, the window manager (1008) within the signal processing device (170) can load the display and window initial configuration for each virtual machine (S1510).

[0389] Next, the virtual GPU driver (1023) can create a virtual display (1025) for each predefined virtualization machine (520-540) after booting (S1513).

[0390] Next, the virtual GPU driver (1023) can create a window (1007) on the hypervisor (505) corresponding to the virtual display (1025) (S1514).

[0391] Next, the generated window (1007) can be registered in the window manager (1008) (S1515).

[0392] Next, the window manager (1008) can set the created window according to a preset configuration (S1516).

[0393] Next, the display manager (527) can request the window manager (1008) to change the position and size of the display (S1517).

[0394] Next, the window manager (1008) can change the properties of the window (1007) responsible for the display (S1519).

[0395] This allows you to initialize the screen configuration and change the layout.

[0396] Figure 15b is a drawing explaining the addition of a dynamic screen.

[0397] Referring to the drawing, the window manager (1008) within the signal processing device (170) can load the display and window initial configuration for each virtual machine (520-540) (S1520).

[0398] Next, the display manager (527) can transmit dynamically generated display information to the virtual GPU driver (1023) (S1521).

[0399] Next, the display manager (527) can create a new virtual display (1025) in the virtual machine (S1523).

[0400] Next, the display manager (527) can create a window (1007) corresponding to the new virtual display (1025) (S1525).

[0401] Next, the created window (1007) is registered in the window manager (1008) (S1527).

[0402] Next, the window manager (1008) can set the created window (1007) according to a preset configuration (S1529).

[0403] Figure 15c is a diagram illustrating an audio configuration.

[0404] Referring to the drawing, the audio manager (525) within the signal processing device (170) can load the mapping settings between the display and speaker of each seat (S1530).

[0405] For example, the audio manager (525) within the signal processing device (170) can load information about a table (TBm) that maps a display, an audio processor, and a speaker.

[0406] As another example, the audio manager (525) within the signal processing device (170) can load mapping information between the displays (180a, 180b, 180c) of each seat and the multiple tables (TBa to TBd) of FIG. 13.

[0407] Next, when the display display of the image output from the virtual machine changes, the display manager (527) can notify the audio manager (525) of the location of the changed display (S1532).

[0408] Next, the audio manager (525) can select a speaker corresponding to the display to be changed and transmit it to the audio server (1011) (S1533).

[0409] Next, the audio manager (525) selects the speaker to output and transmits it to the audio processor (175u) (S1535).

[0410] Next, the virtual machine (520) can transmit an audio signal to an audio server (1011) (S1537), and the audio server (1011) can transmit the audio signal to an audio processor (175u) (S1538).

[0411] Accordingly, the audio signal processed by the audio processor (175u) can be transmitted to the selected speaker, and the corresponding sound is output from the speaker corresponding to the changed display.

[0412] Figure 15d is a drawing explaining audio focus.

[0413] Referring to the drawing, the audio controller (1592) within the second virtual machine (530) transmits an audio signal to the application (1591) (S1540).

[0414] Next, the audio controller (1592) within the second virtual machine (530) can transmit the audio focus status to the audio manager (525) (S1541).

[0415] Next, a second application (1595) within a second virtual machine (530) may request focus from a second audio controller (1594) for audio playback (S1542).

[0416] Next, the second audio controller (1594) can request audio focus based on the hypervisor (505) from the audio manager (525) (S1543).

[0417] Meanwhile, the audio manager (525) can determine whether to allow an audio focus request based on an application with audio focus and an audio policy.

[0418] Next, the audio manager (525) can request hypervisor (505)-based audio focus recovery to the audio controller (1592) (S1545).

[0419] Next, the audio controller (1592) can transmit an audio playback stop command to the application (1591) (S1546). Accordingly, audio playback in the application (1591) can be stopped.

[0420] Next, the audio manager (525) can grant audio focus based on the hypervisor (505) to the second audio controller (1594) (S1547).

[0421] Next, the second audio controller (1594) can control the second application (1595) to perform audio playback based on the given audio focus (S1548).

[0422] Accordingly, audio playback can be performed in the second application (1595).

[0423] Next, the second audio controller (1594) can transmit the audio focus status to the audio manager (525) (S1549). Accordingly, audio focus control can be performed.

[0424] Figure 15e is a diagram illustrating audio setting control.

[0425] Referring to the drawing, the audio server (1011) loads audio settings for each seat (S1550).

[0426] For example, the audio server (1011) can load settings for each table (TBa to TBd) of FIG. 13.

[0427] Next, the display manager (527) can transmit the location information of the virtual display (1025) to the audio manager (525) (S1552).

[0428] Next, the audio manager (525) can transmit the location information of the virtual display (1025) to the audio server (1011) (S1553).

[0429] Next, the audio manager (525) can receive seat audio information from the seat audio provider (1009) (S1554).

[0430] Next, the audio manager (525) can transmit setup audio information corresponding to the seat audio information to the audio server (1011) (S1555).

[0431] Additionally, the audio manager (525) can transmit seat-based configuration audio information to the virtual machine (520).

[0432] Accordingly, the virtual machine (520) can play an audio signal based on the seat-based setting audio information.

[0433] Accordingly, the virtual machine (520) can selectively perform noise canceling, as in FIG. 13, or selectively provide safe driving information, etc.

[0434] Figure 16a is a drawing illustrating an example of screen configuration at boot time.

[0435] Referring to the drawing, a processor (175) within a signal processing device (170) can execute a hypervisor (505) and execute a first operating system (1000a) and a second operating system (1000b) on the hypervisor (505).

[0436] Meanwhile, the first image (1610) and the second image (1620) running on the first operating system (1000a) can be displayed on the first display (180a) and the second display (180b), respectively.

[0437] Meanwhile, a third image (1630) running on a second operating system (1000b) can be displayed on a third display (180c).

[0438] Meanwhile, the hypervisor (505) can execute a first window (VSa), a second window (VSb), and a third window (VSc), which correspond to the first image (1610), the second image (1620), and the third image (1630), respectively.

[0439] In particular, the window manager (1008) within the hypervisor (505) can control the first window (VSa), the second window (VSb), and the third window (VSc).

[0440] Meanwhile, the window manager (1008) within the hypervisor (505) can map the first window (VSa), the second window (VSb), and the third window (VSc) to the first hardware overlay (1211), the second hardware overlay (1212), and the third hardware overlay (1213) within the signal processing device (170), respectively.

[0441] Meanwhile, the virtual GPU driver (1023) can create a preset virtual display (1025) and window (1007) at boot time.

[0442] The window manager (1008) can set the location and properties of each window based on display information or window information loaded at boot time.

[0443] Figure 16b is a drawing illustrating another example of screen configuration at boot time.

[0444] Referring to the drawing, a processor (175) within a signal processing device (170) can execute a hypervisor (505) and execute a first operating system (1000a) and a second operating system (1000b) on the hypervisor (505).

[0445] Meanwhile, a third image (1630) running on a second operating system (1000b) can be displayed on a third display (180c).

[0446] Meanwhile, the hypervisor (505) can execute the first image (1615) and the second image (1625).

[0447] Meanwhile, the hypervisor (505) can execute a first window (VSa), a second window (VSb), and a third window (VSc), which correspond to the first image (1615), the second image (1625), and the third image (1630), respectively.

[0448] In particular, the window manager (1008) within the hypervisor (505) can control the first window (VSa), the second window (VSb), and the third window (VSc).

[0449] Meanwhile, the window manager (1008) within the hypervisor (505) can map the first window (VSa), the second window (VSb), and the third window (VSc) to the first hardware overlay (1211), the second hardware overlay (1212), and the third hardware overlay (1213) within the signal processing device (170), respectively.

[0450] Meanwhile, the virtual GPU driver (1023) can create a preset virtual display (1025) and window (1007) at boot time.

[0451] Meanwhile, the native window (1013) within the hypervisor (505) can configure a display screen such as the first image (1615) and the second image (1625).

[0452] The window manager (1008) can set the location and properties of each window based on display information or window information loaded at boot time.

[0453] Figure 16c is a drawing illustrating an example of screen change.

[0454] Referring to the drawing, the signal processing device (170) can control the first image (1610), the second image (1620), and the third image (1630) to be displayed on the cluster display (180a), the AVN display (180b), and the passenger seat display, respectively, as shown in (a) of FIG. 16c.

[0455] Meanwhile, the signal processing device (170) can control the first audio signal, the second audio signal, and the third audio signal corresponding to the first image (1610), the second image (1620), and the third image (1630) to be input to the first speaker (1311), the second speaker (1312), and the third speaker (1313), respectively.

[0456] Accordingly, the first speaker (1311), the second speaker (1312), and the third speaker (1313) can output the first sound, the second sound, and the third sound corresponding to the first image (1610), the second image (1620), and the third image (1630), respectively.

[0457] Meanwhile, the signal processing device (170) can exchange the display of the second image (1620) and the third image (1630) based on the input signal.

[0458] That is, the signal processing device (170) can control the first image (1610), the third image (1630), and the second image (1620) to be displayed on the cluster display (180a), the AVN display (180b), and the passenger seat display, respectively, based on the input signal.

[0459] In response to this, the signal processing device (170) can control the first audio signal, the third audio signal, and the second audio signal corresponding to the first image (1610), the third image (1630), and the second image (1620) to be input to the first speaker (1311), the second speaker (1312), and the third speaker (1313), respectively.

[0460] Accordingly, the first speaker (1311), the second speaker (1312), and the third speaker (1313) can output the first sound, the third sound, and the second sound corresponding to the first image (1610), the third image (1630), and the second image (1620), respectively.

[0461] Figure 16d is a drawing illustrating another example of screen change.

[0462] Referring to the drawing, the signal processing device (170) can control the first image (1610), the second image (1620), and the third image (1630) to be displayed on the cluster display (180a), the AVN display (180b), and the passenger seat display, respectively, as shown in (a) of FIG. 16d.

[0463] Meanwhile, the signal processing device (170) can control the enlargement of the second image (1620) based on the first input signal, as shown in (b) of Fig. 16d, so that a part (1615) and another part (1625) of the enlarged image are displayed on the AVN display (180b) and the passenger seat display, respectively.

[0464] Meanwhile, the signal processing device (170) can control the first audio signal, the second audio signal, and the third audio signal corresponding to the first image (1610), a portion of the enlarged image (1615), and another portion of the enlarged image (1625), respectively, to be input to the first speaker (1311), the second speaker (1312), and the third speaker (1313), respectively.

[0465] Accordingly, the first speaker (1311), the second speaker (1312), and the third speaker (1313) can output the first sound, the second sound, and the third sound corresponding to the first image (1610), a portion of the enlarged image (1615), and another portion of the enlarged image (1625), respectively.

[0466] Meanwhile, the signal processing device (170) can control the second image (1620) to be enlarged based on the second input signal, as shown in (c) of Fig. 16d, so that a part (1615) and another part (1625) of the enlarged image are displayed on the cluster display (180a) and the AVN display (180b), respectively.

[0467] Meanwhile, the signal processing device (170) can control audio signals corresponding to a part of the enlarged image (1615), another part of the enlarged image (1625), and a third image (1630) to be input to the first speaker (1311), the second speaker (1312), and the third speaker (1313), respectively.

[0468] Accordingly, the first speaker (1311), the second speaker (1312), and the third speaker (1313) can output the first sound, the second sound, and the third sound corresponding to a part of the enlarged image (1615), another part of the enlarged image (1625), and the third image (1630), respectively.

[0469] Figure 16e is a drawing illustrating another example of screen change.

[0470] Referring to the drawing, the signal processing device (170) can control the display of the first image (1610), the second image (1620), the third image (1640), and the fourth image (1650) on the cluster display (180a), the AVN display, the left RSE display, and the right RSE display, respectively, as shown in (a) of FIG. 16e.

[0471] Meanwhile, the signal processing device (170) can control the sound corresponding to the second image (1620) to be output from the second speaker (1312) and the second speaker (1313), the sound corresponding to the third image (1640) to be output from the fourth speaker (1314) and the sixth speaker (1316), and the sound corresponding to the fourth image (1650) to be output from the fifth speaker (1315) and the seventh speaker (1317).

[0472] Meanwhile, the signal processing device (170) can control the display of a preview image including the first to fourth images on the right RSE display based on an input signal, etc., as shown in (b) of FIG. 16e.

[0473] Meanwhile, the signal processing device (170) can control the second image (1620) and the fourth image (1650) to be displayed interchangeably based on an input signal, etc.

[0474] That is, the signal processing device (170) can control the display of the first image (1610), the fourth image (1650), the third image (1640), and the second image (1670) on the cluster display (180a), the AVN display, the left RSE display, and the right RSE display, respectively, based on an input signal, etc., as shown in (c) of FIG. 16e.

[0475] In response to this, the signal processing device (170) can control the sound corresponding to the fourth image (1650) to be output from the second speaker (1312) and the second speaker (1313), and the sound corresponding to the second image (1650) to be output from the fifth speaker (1315) and the seventh speaker (1317).

[0476] Figure 17a is a drawing illustrating an example of a preview image display.

[0477] Referring to the drawing, a processor (175) within a signal processing device (170) can execute a hypervisor (505) and execute a first operating system (1000a) and a second operating system (1000b) on the hypervisor (505).

[0478] Meanwhile, the first image (1610) and the second image (1620) running on the first operating system (1000a) can be displayed on the first display (180a) and the second display (180b), respectively.

[0479] Meanwhile, a third image (1650) running on a second operating system (1000b) can be displayed on a third display (180c).

[0480] Meanwhile, the hypervisor (505) can execute a first window (VSa), a second window (VSb), and a third window (VSc), which correspond to the first image (1610), the second image (1620), and the third image (1650), respectively.

[0481] In particular, the display manager (527) or window manager (1008) within the hypervisor (505) can control the first window (VSa), the second window (VSb), and the third window (VSc).

[0482] Meanwhile, the display manager (527) or window manager (1008) within the hypervisor (505) can map the first window (VSa), the second window (VSb), and the third window (VSc) to the first hardware overlay (1211), the second hardware overlay (1212), and the third hardware overlay (1213) within the signal processing device (170), respectively.

[0483] Meanwhile, the window manager (1008) can map preview images (1710) for multiple images (1712, 1714, 1716, 1718) to the third hardware overlay (1213) based on the input signal.

[0484] And, the window manager (1008) can control the preview image (1710) to be displayed on the third display (180c).

[0485] Figure 17b is a drawing illustrating an example of changing the display position of an image based on a preview image.

[0486] Referring to the drawing, a processor (175) within a signal processing device (170) can execute a hypervisor (505) and execute a first operating system (1000a) and a second operating system (1000b) on the hypervisor (505).

[0487] Meanwhile, a third image (1650) running on a second operating system (1000b) can be displayed on a third display (180c).

[0488] Meanwhile, the hypervisor (505) can execute the first image (1615) and the second image (1625).

[0489] Meanwhile, the hypervisor (505) can execute a first window (VSa), a second window (VSb), and a third window (VSc), which correspond to the first image (1615), the second image (1625), and the third image (1650), respectively.

[0490] In particular, the display manager (527) within the hypervisor (505) can control the first window (VSa), the second window (VSb), and the third window (VSc).

[0491] Meanwhile, the display manager (527) within the hypervisor (505) can map the first window (VSa), the second window (VSb), and the third window (VSc) to the first hardware overlay (1211), the second hardware overlay (1212), and the third hardware overlay (1213) within the signal processing device (170), respectively.

[0492] Meanwhile, the audio manager (521) within the hypervisor (505) can map the first audio stream (ASa), the second audio stream (ASb), and the third audio stream (ASc) to the first speaker (1311), the second speaker (1312), and the third speaker (1313), respectively.

[0493] Meanwhile, when the second image (1220) displayed on the second display (180b) and the third image (1230) displayed on the third display (180c) are switched based on an input signal, etc., the display manager (527) within the hypervisor (505) can map the third window (VSc) and the second window (VSb) to the second hardware overlay (1212) and the third hardware overlay (1213), respectively.

[0494] Meanwhile, when the second image (1220) displayed on the second display (180b) and the third image (1230) displayed on the third display (180c) are switched based on input signals, etc., the audio manager (521) within the hypervisor (505) can map the third audio stream (ASc) and the second audio stream (ASb) to the second speaker (1312) and the third speaker (1313), respectively. Accordingly, the mapping between speakers can be dynamically changed.

[0495] Figure 18 is a drawing explaining dynamic screen configuration changes.

[0496] Referring to the drawing, the display manager (527) can request the creation of a preview window (1509) (S1810).

[0497] Next, the preview window (1509) within the hypervisor can copy or clone each display window (S1812).

[0498] Next, the generated window (1007) can be registered in the window manager (1008) (S1814).

[0499] Next, the window manager (1008) can set the generated preview window according to a preset configuration (S1816).

[0500] Next, based on the input signal, one of multiple images within the preview window can be selected.

[0501] Next, the preview window (1509) within the hypervisor can request a display configuration change to the window manager (1008) based on the selection of any image within the preview window (S1817).

[0502] Next, the window manager (1008) can dynamically change the properties of the window (S1819). Accordingly, dynamic screen configuration changes can be performed.

[0503] Figure 19 is a drawing illustrating the creation of a virtual display operation and the screen output or screen removal of the entire display.

[0504] First, (a) of FIG. 19 illustrates that a first image (1610), a second image (1620), a third image (1640), and a fourth image (1650) are displayed on the cluster display (180a), the AVN display (180b), the left RSE display, and the right RSE display, respectively.

[0505] Meanwhile, the signal processing device (170) can control the display of the same screen on the left RSE display of the cluster display (180a) and the AVN display (180b), as shown in (b) of FIG. 19, based on the input signal.

[0506] At this time, the signal processing device (170) can create a virtual display (1025) for simultaneous output to three displays and assign the virtual display to the first operating system.

[0507] Meanwhile, in response to simultaneous output to three displays, the signal processing device (170) can control the audio signals to be assigned to some of the plurality of speakers (1311 to 1314, 1316), and the audio signals corresponding to the fourth image (1650) to other speakers (1315, 1317), so that each sound is output.

[0508] Meanwhile, the signal processing device (170) can control the display of the same screen on the cluster display (180a), the AVN display (180b), the left RSE display, and the right RSE display, based on the second input signal, as shown in (c) of FIG. 19.

[0509] At this time, the signal processing device (170) can create two virtual displays (1025) for simultaneous output to four displays and assign the two virtual displays to the first operating system.

[0510] Meanwhile, in response to simultaneous output to four displays, the signal processing device (170) can control audio signals to be assigned to each of the plurality of speakers (1311 to 1317) so that each sound is output.

[0511] Although the preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above, and various modifications may be made by a person skilled in the art to which the present invention pertains without departing from the gist of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical idea or prospect of the present disclosure.

Claims

1. A signal processing device including a processor that performs signal processing for a display mounted on a vehicle, The above processor, Running a hypervisor, and running a first virtual machine to a third virtual machine on the hypervisor, The second virtual machine operates for the first display, and the third virtual machine operates for the second display. The first virtual machine or the hypervisor, Execute a display manager for controlling an image displayed on the first display or the second display, and an audio manager for controlling a sound corresponding to the image displayed on the first display or the second display, The above audio manager, A signal processing device that controls the allocation of audio signals corresponding to each of multiple speakers in a vehicle.

2. In paragraph 1, The above audio manager, When displaying a first image on the first display, assign a first audio signal to the first speaker, A signal processing device that controls the allocation of a second audio signal to a second speaker when a second image is displayed on the second display.

3. In paragraph 1, The above audio manager, Assign the first audio signal for which noise cancellation is not performed to the first speaker, A signal processing device that assigns a second audio signal on which the above noise canceling is performed to a second speaker.

4. In paragraph 1, The above audio manager, A signal processing device that controls to allocate audio signals on which noise cancellation is not performed to some of the plurality of speakers and to allocate audio signals on which noise cancellation is performed to other some of the speakers.

5. In paragraph 1, The above audio manager, A signal processing device that controls to assign audio signals including safe driving information to some of the plurality of speakers and to assign audio signals not including the safe driving information to other speakers.

6. In paragraph 1, The above audio manager, When displaying a first image on the first display, assign a first audio signal to the first speaker, When displaying a second image on the second display, assign a second audio signal to the second speaker, A signal processing device that controls the allocation of a third audio signal to a third speaker when a third image is displayed on a third display.

7. In paragraph 6, The above audio manager, A signal processing device that, when the third image is displayed on the second display and the second image is displayed on the third display, assigns the second audio signal to the third speaker and controls the assignment of the third audio signal to the second speaker.

8. In paragraph 1, The above audio manager, When displaying a first image on the first display and displaying a second image on the second display, assigning a first audio signal corresponding to the second image to a second speaker; A signal processing device that controls, when a third image is displayed on a third display, to assign a second audio signal corresponding to the third image to a third speaker.

9. In paragraph 8, The above audio manager, A signal processing device that controls to assign the first audio signal to the third speaker and to assign the second audio signal to the second speaker when the third image is displayed on the second display and the second image is displayed on the third display.

10. In paragraph 1, The above audio manager, A signal processing device that controls the setting of the hypervisor-based shared memory for transmission of the same audio signal to the second virtual machine and the third virtual machine.

11. In paragraph 1, The above audio manager, Transmitting first audio data to the shared memory based on the hypervisor, The second virtual machine and the third virtual machine, A signal processing device that receives the first audio data within the shared memory so that the same sound is output from each managed speaker.

12. In paragraph 1, The second virtual machine and the third virtual machine are driven by different operating systems, The above audio manager, A signal processing device that integrates and manages audio signals within the second virtual machine and audio signals within the third virtual machine or controls audio focus.

13. In paragraph 1, The first virtual machine or the hypervisor, A signal processing device that further executes an audio server that determines the output path of an audio signal.

14. In paragraph 1, The first virtual machine or the hypervisor, A signal processing device that further executes a window manager that sets the location and properties of a window based on the window information loaded at boot time.

15. A signal processing device including a processor that performs signal processing for a display mounted on a vehicle, The above processor, Run the hypervisor, The above hypervisor, Execute a display manager for controlling images displayed on a first display or a second display, and an audio manager for controlling sounds corresponding to the images displayed on the first display or the second display, The above audio manager, A signal processing device that controls the allocation of audio signals corresponding to each of multiple speakers in a vehicle.

16. In paragraph 15, The above audio manager, A signal processing device that controls to allocate audio signals on which noise cancellation is not performed to some of the plurality of speakers and to allocate audio signals on which noise cancellation is performed to other some of the speakers.

17. In paragraph 15, The above audio manager, A signal processing device that controls to assign audio signals including safe driving information to some of the plurality of speakers and to assign audio signals not including the safe driving information to other speakers.

18. In paragraph 1, The above audio manager, Transmitting first audio data to the shared memory based on the hypervisor, A signal processing device in which a plurality of virtual machines running on the processor each receive the first audio data in the shared memory so that the same sound is output from the speakers each manages.

19. In paragraph 18, The above multiple virtual machines are driven by different operating systems, The above audio manager, A signal processing device that integrates and manages each audio signal within the plurality of virtual machines or controls audio focus.

20. First display; Second display; A signal processing device including a processor that performs signal processing for the first display or the second display; The above signal processing device, A vehicle display device characterized by including a signal processing device according to any one of claims 1 to 19.

Images