Signal processing device and vehicle display device having the same.
By running virtual machines with different operating systems on a virtual monitor and using shared memory to transfer data, the problem of poor overlay display in vehicle display devices was solved, achieving seamless overlay display and data synchronization.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-04-08
- Publication Date
- 2026-04-03
AI Technical Summary
In the prior art, vehicle display devices have problems such as being unable to display overlays based on different operating systems quickly and seamlessly, difficulty in displaying multiple overlays simultaneously, and difficulty in performing organic actions.
By running virtual machines based on different operating systems on a virtual monitor through a signal processing device, the second overlay layer is displayed overlapping in a portion of the first overlay layer. Data is transmitted through the shared memory within the virtual monitor to achieve synchronous display of overlay layers from different operating systems.
It enables seamless display and data sharing across different operating systems, improving the efficiency and stability of display devices.
Smart Images

Figure CN115195621B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a signal processing apparatus and a vehicle display device having the same, and more specifically, to a signal processing apparatus capable of displaying overlays based on different operating systems together and a vehicle display device having the same. Background Technology
[0002] A vehicle is a device that moves in the direction desired by the user. An example of a vehicle is a car.
[0003] On the other hand, for the convenience of vehicle users, a vehicle display device is installed inside the vehicle.
[0004] For example, display devices can be configured on instrument displays, AVN (Audio Video Navigation) displays, etc., to display various information such as vehicle driving information and map information.
[0005] On the other hand, in vehicle display devices, in order to display a variety of information, an operating system is driven within a signal processing device, and an overlay layer corresponding to the information is generated by an application running on the operating system and provided to the instrument display or AVN (Audio Video Navigation) display, etc.
[0006] On the other hand, based on recent development trends, there are sometimes situations where, while generating and displaying an overlay based on a first operating system in a vehicle display device, it is necessary to run a second operating system that is different from the first operating system in order to drive new applications, etc.
[0007] In this regard, U.S. Patent Publication No. 10019274 (hereinafter referred to as "Prior Document") discloses a technique for displaying a host operating system-based menu in a host operating system and a guest operating system.
[0008] However, according to existing literature, since the first overlay, which is based on a guest operating system and runs on the host operating system, is replaced by a second overlay and displayed via screen transitions during the display of the first overlay, there is a drawback that the overlay cannot be displayed quickly and seamlessly. Furthermore, it is difficult to display the first and second overlays together. Moreover, organic actions cannot be performed when displaying the first and second overlays. Summary of the Invention
[0009] The purpose of this invention is to provide a signal processing device capable of displaying overlays based on different operating systems together, and a vehicle display device having the same.
[0010] On the other hand, an object of the present invention is to provide a signal processing device capable of seamlessly displaying overlays based on different operating systems, and a vehicle display device having the same.
[0011] On the other hand, an object of the present invention is to provide a signal processing apparatus capable of efficiently transmitting or sharing data by running a virtual machine on a virtual monitor, and a display device for a vehicle having the same.
[0012] A vehicle display device according to an embodiment of the present invention for achieving the above-mentioned objective includes: a display, mounted in a vehicle; and a signal processing device for outputting an image signal to the display; the signal processing device is controlled to overlay a second overlay based on a second operating system onto at least a portion of the first overlay area while outputting a first overlay based on a first operating system.
[0013] On the other hand, the signal processing device can be controlled to perform harmonic processing on at least a portion of the first overlay layer and to overlay and display the second overlay layer based on the second operating system in the harmonic processing area.
[0014] On the other hand, the signal processing device can be controlled to run a virtual monitor, generate a first overlay layer based on a first operating system on the virtual monitor, generate a second overlay layer based on a second operating system on the virtual monitor, and display the second overlay layer based on the second operating system overlapping at least a portion of the first overlay layer.
[0015] On the other hand, the signal processing device may include a processor that runs a virtual monitor, the processor being controlled to generate a first overlay layer based on a first operating system on the virtual monitor, generate a second overlay layer based on a second operating system on the virtual monitor, and overlay the second overlay layer based on the second operating system on at least a portion of the first overlay layer.
[0016] On the other hand, the signal processing device can be controlled to overlay a second overlay based on a second operating system onto any one of the plurality of first overlays while outputting a plurality of first overlays based on a first operating system.
[0017] On the other hand, the first overlay layer may include at least one application based on the first operating system, and the second overlay layer may include at least one application based on the second operating system.
[0018] On the other hand, the first overlay may include a menu and a plurality of application items based on the first operating system, and the second overlay may include at least one application item based on the second operating system.
[0019] On the other hand, the signal processing device can be controlled to output an overlay including the screen of the first application based on the second operating system when a first application project based on the second operating system is selected.
[0020] On the other hand, when an application viewing item within the first overlay layer is selected during the output of the first overlay layer based on the first operating system, the signal processing device can control the display to overlay a second overlay layer, which includes a plurality of application items based on the second operating system, onto a portion of the first overlay layer.
[0021] On the other hand, if the first application item is selected among a plurality of application items, the signal processing device can be controlled to display an overlay layer related to the first application in a portion of the first overlay layer.
[0022] On the other hand, when an application viewing item within the first overlay layer is selected during the output of the first overlay layer based on the first operating system, the signal processing device can control the display of the second overlay layer, which includes a plurality of application items based on the second operating system, overlaid in the first overlay layer area. When the first application item among the plurality of application items is selected, the signal processing device can control the display of an overlay layer related to the first application in a portion of the first overlay layer.
[0023] On the other hand, when outputting a first overlay layer including a plurality of application items based on a first operating system, and selecting a first application item based on a second operating system from among the plurality of application items, the signal processing device can control the display to overlay a second overlay layer including the first application screen based on the second operating system onto at least a portion of the area within the first overlay layer.
[0024] On the other hand, the signal processing device can be controlled to include preview information or messages based on the second operating system in a portion of the first overlay based on the first operating system. When preview information or messages are selected, the signal processing device can be controlled to display a second overlay including a screen corresponding to the preview information or messages.
[0025] On the other hand, the signal processing device can be controlled to overlay a second overlay, including a screen corresponding to preview information or messages based on the second operating system, onto at least a portion of the area of the first overlay.
[0026] On the other hand, the signal processing apparatus may include a processor that performs signal processing for a display, the processor may run a server virtual machine based on a first operating system and a client virtual machine for the display based on a second operating system on a virtual monitor within the processor.
[0027] On the other hand, the server virtual machine can output a first overlay based on a first operating system, and the client virtual machine controls the display of a second overlay based on a second operating system overlaid on at least a portion of the first overlay.
[0028] On the other hand, the processor can transmit the first overlay from the server virtual machine to the guest virtual machine through the interface.
[0029] On the other hand, the processor can run a virtual monitor and transmit the first overlay from the server virtual machine to the guest virtual machine via shared memory within the virtual monitor.
[0030] An embodiment of the signal processing apparatus of the present invention includes a processor that outputs image signals to a display installed in a vehicle. The processor is controlled to overlay a second overlay based on a second operating system onto at least a portion of the first overlay while outputting a first overlay based on a first operating system.
[0031] On the other hand, the processor can be controlled to run a virtual monitor, generate a first overlay based on a first operating system on the virtual monitor, generate a second overlay based on a second operating system on the virtual monitor, and display the second overlay based on the second operating system overlapping at least a portion of the first overlay.
[0032] An embodiment of the present invention provides a vehicle display device comprising: a display mounted in a vehicle; and a signal processing device that outputs an image signal to the display. The signal processing device is configured to overlay a second overlay based on a second operating system onto at least a portion of the first overlay while outputting a first overlay based on a first operating system. This enables the simultaneous display of overlays based on different operating systems. Furthermore, it enables seamless display of overlays based on different operating systems.
[0033] On the other hand, the signal processing device can be controlled to perform harmonic processing on at least a portion of the first overlay layer, and to overlay and display a second overlay layer based on the second operating system in the harmonic processed area. This allows overlay layers based on different operating systems to be displayed together.
[0034] On the other hand, the signal processing device can be controlled to run a virtual monitor, generate a first overlay layer based on a first operating system on the virtual monitor, generate a second overlay layer based on a second operating system on the virtual monitor, and display the second overlay layer based on the second operating system overlapping at least a portion of the first overlay layer. Thus, overlay layers based on different operating systems can be displayed together.
[0035] On the other hand, the signal processing device may include a processor running a virtual monitor, the processor controlling the generation of a first overlay layer based on a first operating system on the virtual monitor, the generation of a second overlay layer based on a second operating system on the virtual monitor, and the overlay layer based on the second operating system overlapping at least a portion of the first overlay layer. This enables the display of overlay layers based on different operating systems together.
[0036] On the other hand, the signal processing device can be controlled to overlay a second overlay based on a second operating system onto any one of the plurality of first overlays while outputting a plurality of first overlays based on a first operating system. This allows overlays based on different operating systems to be displayed together.
[0037] On the other hand, the first overlay may include at least one application based on a first operating system, and the second overlay may include at least one application based on a second operating system. This allows applications based on different operating systems to be displayed together.
[0038] On the other hand, the first overlay may include a menu and a plurality of application items based on a first operating system, and the second overlay may include at least one application item based on a second operating system. Thus, it is possible to display a plurality of application items based on different operating systems together.
[0039] On the other hand, the signal processing device can be controlled to output an overlay including the screen of the first application based on the second operating system when a first application based on the second operating system is selected. This allows for the rapid display of overlays based on different operating systems.
[0040] On the other hand, if an application viewing item within the first overlay layer is selected during the output of the first overlay layer based on the first operating system, the signal processing device can control the display to overlay a second overlay layer, which includes a plurality of application items based on the second operating system, onto a portion of the first overlay layer. This allows overlay layers based on different operating systems to be displayed together.
[0041] On the other hand, when a first application item is selected from a plurality of application items, the signal processing device can be controlled to display an overlay related to the first application in a portion of the first overlay. This allows for the rapid display of overlays based on different operating systems.
[0042] On the other hand, when an application viewing item within the first overlay layer is selected during the output of the first overlay layer based on the first operating system, the signal processing device can control the display to overlay a second overlay layer including a plurality of application items based on the second operating system onto the first overlay layer area. Conversely, when a first application item among the plurality of application items is selected, the signal processing device can control the display to show an overlay layer related to the first application within a portion of the first overlay layer. This allows for the rapid display of overlay layers based on different operating systems.
[0043] On the other hand, when outputting a first overlay layer including a plurality of application items based on a first operating system, and selecting a first application item based on a second operating system from among the plurality of application items, the signal processing device can control the display to overlay a second overlay layer including the first application screen based on the second operating system onto at least a portion of the first overlay layer. This allows overlay layers based on different operating systems to be displayed together.
[0044] On the other hand, the signal processing device can be controlled to include preview information or messages based on a second operating system in a portion of the first overlay based on a first operating system. When preview information or messages are selected, the signal processing device can be controlled to display a second overlay including the screen corresponding to the preview information or messages. Thus, overlays based on different operating systems can be displayed quickly.
[0045] On the other hand, the signal processing device can be controlled to overlay a second overlay, including a screen corresponding to preview information or messages based on a second operating system, onto at least a portion of the first overlay. This enables the rapid display of overlays based on different operating systems.
[0046] On the other hand, the signal processing apparatus may include a processor that performs signal processing for a display. The processor may run a server virtual machine based on a first operating system and a client virtual machine that operates for a display based on a second operating system on a virtual monitor within the processor. This enables the stable operation of virtual machines based on different operating systems.
[0047] On the other hand, the server virtual machine can output a first overlay based on a first operating system, and the guest virtual machine controls the display of a second overlay based on a second operating system overlaid on at least a portion of the first overlay. Thus, it is possible to display overlays based on different operating systems together.
[0048] On the other hand, the processor can transmit the first overlay from the server virtual machine to the guest virtual machine via an interface. This allows overlays based on different operating systems to be displayed together.
[0049] On the other hand, the processor can run a virtual monitor and transfer the first overlay from the server virtual machine to the guest virtual machine via shared memory within the virtual monitor. This allows for efficient data transfer or sharing by running virtual machines on the virtual monitor.
[0050] One embodiment of the signal processing apparatus of the present invention includes a processor that outputs image signals to a display installed in a vehicle. The processor is controlled to overlay a second overlay based on a second operating system onto at least a portion of the first overlay while outputting a first overlay based on a first operating system. This allows overlays based on different operating systems to be displayed together. Furthermore, it enables seamless display of overlays based on different operating systems.
[0051] On the other hand, the processor can be controlled to run a virtual monitor, generate a first overlay based on a first operating system on the virtual monitor, generate a second overlay based on a second operating system on the virtual monitor, and display the second overlay based on the second operating system overlapping at least a portion of the first overlay. Thus, overlays based on different operating systems can be displayed together. Attached Figure Description
[0052] Figure 1A This is a diagram showing an example of the exterior and interior of a vehicle.
[0053] Figure 1B This is another example showing the interior of a vehicle.
[0054] Figure 2 This is a diagram showing the appearance of a vehicle display device according to an embodiment of the present invention.
[0055] Figure 3 Show Figure 2 An example of an internal block diagram of a vehicle display device.
[0056] Figures 4A to 4B This figure is used as a reference when explaining the operation of the vehicle display device related to the present invention.
[0057] Figure 5 This is a diagram illustrating an example of a system driven in a vehicle display device according to an embodiment of the present invention.
[0058] Figures 6A to 6C The figure illustrates various examples of a system driven in a vehicle display device according to an embodiment of the present invention.
[0059] Figures 7A to 9C It is explaining Figures 5 to 6C The diagram is used as a reference.
[0060] Figure 10 This is a diagram illustrating an example of a system driven in the signal processing apparatus of the present invention.
[0061] Figure 11 This is a diagram illustrating another example of a system driven in the signal processing apparatus of the present invention.
[0062] Figure 12 This is a diagram illustrating yet another example of a system driven in the signal processing apparatus of the present invention.
[0063] Figures 13 to 14B It is explaining Figure 10 The diagram is used as a reference. Detailed Implementation
[0064] The present invention will now be described in more detail with reference to the accompanying drawings.
[0065] The suffixes “module” and “section” used for structural elements in the following description are assigned only for ease of writing and do not have any particularly important meaning or function. Therefore, the terms “module” and “section” can be used interchangeably.
[0066] Figure 1A This is a diagram showing an example of the exterior and interior of a vehicle.
[0067] Referring to the attached diagram, the vehicle 200 is driven by a plurality of wheels (103FR, 103FL, 103RL...) and a steering wheel 150. The plurality of wheels (103FR, 103FL, 103RL...) are rotated by a power source, while the steering wheel 150 is used to adjust the direction of travel of the vehicle 200.
[0068] On the other hand, the vehicle 200 may also be equipped with a camera 195 for acquiring images of the front of the vehicle.
[0069] On the other hand, multiple displays 180a, 180b for displaying images, information, etc. can be installed inside the vehicle 200.
[0070] exist Figure 1A In this example, as multiple displays 180a and 180b, an instrument display 180a and an AVN (Audio Video Navigation) display 180b are provided. In addition, a head-up display, etc., can also be provided.
[0071] Alternatively, the AVN (Audio Video Navigation) display 180b can also be named the Center Information Display.
[0072] In an embodiment of the present invention, a technique is provided for displaying overlays based on different operating systems together in a vehicle display device 100 having displays 180a and 180b. This will be referred to later. Figure 5 Please provide an explanation.
[0073] On the other hand, the vehicle 200 described in this specification can be a concept that includes a vehicle equipped with an engine as a power source, a hybrid vehicle equipped with both an engine and an electric motor as a power source, and an electric vehicle equipped with an electric motor as a power source.
[0074] Figure 1B This is another example showing the interior of a vehicle.
[0075] Referring to the attached diagram, the vehicle interior may be equipped with an instrument display 180a, an AVN (Audio Video Navigation) display 180b, a rear seat entertainment display 180c, 180d, and a vehicle interior mirror display (not shown).
[0076] Embodiments of the present invention disclose a technique for displaying overlays based on different operating systems simultaneously in a vehicle display device 100 having a plurality of displays 180a-180d. This will be referred to later. Figure 5 Please provide an explanation.
[0077] Figure 2 This is a diagram showing the appearance of a vehicle display device according to an embodiment of the present invention.
[0078] The vehicle display device 100 of this embodiment may include: displays 180a to 180b; and a signal processing device 170, which performs signal processing for displaying images, information, etc. on the displays 180a to 180b.
[0079] In the displays 180a to 180b, the first display 180a may be an instrument display 180a for displaying driving status, operating information, etc., and the second display 180b may be an AVN (Audio Video Navigation) display 180b for displaying vehicle operating information, navigation maps, various entertainment information or images.
[0080] On the other hand, a processor 175 is provided inside the signal processing device 170, and a virtual monitor 505 (see reference) can run within the processor 175. Figure 5 ).
[0081] On the other hand, the processor 175 within the signal processing device 170 can run the first virtual machine to the third virtual machine 520 to 540 (see reference) on the virtual monitor 505. Figure 10 ).
[0082] The second virtual machine 530 can act for the first monitor 180a, and the third virtual machine 540 can act for the second monitor 180b.
[0083] On the other hand, the first virtual machine 520 within the processor 175 can be controlled to configure the shared memory 508 based on the virtual monitor 505. Figure 13 This allows the same data to be transmitted to the second virtual machine 530 and the third virtual machine 540. Consequently, the same information or the same image can be displayed synchronously on the first display 180a and the second display 180b within the vehicle.
[0084] On the other hand, the first virtual machine 520 within the processor 175 shares at least a portion of the data with the second virtual machine 530 and the third virtual machine 540 for data sharing processing. Thus, data can be shared and processed by a plurality of virtual machines used for a plurality of displays within the vehicle.
[0085] On the other hand, the first virtual machine 520 within the processor 175 can receive and process wheel speed sensor data, and then transmit the processed wheel speed sensor data to at least one of the second virtual machine 530 or the third virtual machine 540. Thus, wheel speed sensor data can be shared with at least one virtual machine, etc.
[0086] On the other hand, the vehicle display device 100 of the present invention may also be provided with a rear seat entertainment display 180c for displaying driving status information, simple navigation information, various entertainment information or images.
[0087] In addition to the first to third virtual machines 520 to 540, the signal processing device 170 can also control the RSE (backseat entertainment) display 180c by running a fourth virtual machine (not shown) on the virtual monitor 505 within the processor 175.
[0088] Therefore, a variety of displays 180a to 180c can be controlled by a single signal processing device 170.
[0089] On the other hand, some of the plurality of displays 180a to 180c may operate based on a first operating system OS, while others may operate based on a second operating system OS that is different from the first operating system OS.
[0090] For example, among the multiple displays 180a to 180c, some can operate based on QNX OS or Linux OS, while others can operate based on Android OS or web OS.
[0091] When touch input is present on any of the plurality of displays 180a-180b or 180a-180c operating under various operating systems, the signal processing device 170 of this embodiment can be controlled to perform processing for the touch input quickly and accurately.
[0092] On the other hand, Figure 2 The example illustrates a scenario where a vehicle speed indicator 212a and an interior temperature indicator 213a are displayed on a first display 180a, a main screen 222 including multiple applications, the vehicle speed indicator 212b, and the interior temperature indicator 213b is displayed on a second display 180b, and a second main screen 222b including multiple applications and the interior temperature indicator 213c is displayed on a third display 180c.
[0093] Figure 3 An example of an internal block diagram of a vehicle display device according to an embodiment of the present invention is shown.
[0094] Referring to the accompanying drawings, the vehicle display device 100 of the present invention may include an input unit 110, a communication unit 120, an interface 130, a memory 140, a signal processing device 170, a plurality of displays 180a to 180c, an audio output unit 185, and a power supply unit 190.
[0095] The input unit 110 may be a physical button, touchpad, or the like for key input, touch input, etc.
[0096] On the other hand, the input unit 110 may be provided with a touch sensor (not shown) for sensing touch input from the displays 180a, 180b, and 180c.
[0097] On the other hand, the input unit 110 may be equipped with a microphone (not shown) for user voice input.
[0098] The communication unit 120 can exchange data wirelessly with the mobile terminal 800 or the server 900.
[0099] In particular, the communication unit 120 can exchange data wirelessly with the vehicle driver's mobile terminal. Various wireless data communication methods can be used, such as Bluetooth, WiFi (Wireless-Fidelity), WiFiDirect, and APiX.
[0100] The communication unit 120 can receive weather information and road traffic information from the mobile terminal 800 or the server 900, such as TPEG (Transport Protocol Expert Group) information. For this purpose, the communication unit 120 may be equipped with a mobile communication module (not shown).
[0101] Interface 130 can receive sensor information from ECU (electronic control unit) 770 or sensor device 760 and transmit the received information to signal processing device 170.
[0102] Here, the sensor information may include at least one of the following: vehicle direction information, vehicle position information (GPS information), vehicle angle information, vehicle speed information, vehicle acceleration information, vehicle tilt information, vehicle forward / reverse information, battery information, fuel information, tire information, headlight information, vehicle interior temperature information, and vehicle interior humidity information.
[0103] This sensor information can be obtained from heading sensors, yaw sensors, gyroscope sensors, position modules, vehicle forward / reverse sensors, wheel sensors, vehicle speed sensors, vehicle tilt sensors, battery sensors, fuel sensors, tire sensors, steering wheel rotation-based sensors, interior temperature sensors, and interior humidity sensors. On the other hand, the position module can include a GPS module for receiving GPS (Global Positioning System) information.
[0104] On the other hand, interface 130 can receive frontal image data, side image data, rear image data, and distance information of obstacles around the vehicle from camera 195 or lidar (not shown), and transmit the received information to signal processing device 170.
[0105] The memory 140 can store programs for processing or controlling the signal processing device 170, as well as various data for the entire operation of the vehicle display device 100.
[0106] For example, memory 140 may store data about a virtual monitor, a first virtual machine, to a third virtual machine for use within processor 175.
[0107] The audio output unit 185 converts the electrical signal from the signal processing device 170 into an audio signal and outputs it. For this purpose, a speaker or the like can be provided.
[0108] The power supply unit 190 can supply the power required for the operation of each structural element through the control of the signal processing device 170. In particular, the power supply unit 190 can receive power from the battery or the like inside the vehicle.
[0109] The signal processing device 170 controls the entire operation of each unit within the vehicle display device 100.
[0110] For example, it may include a processor 175 that performs signal processing for vehicle displays 180a, 180b.
[0111] Processor 175 can have a virtual monitor 505 within processor 175 (see reference). Figure 10 Run the first to the third virtual machines 520 to 540 on the machine.
[0112] On the other hand, processor 175 can also run traditional virtual machines that receive and process Ethernet data. For example, such as Figure 10 As shown, a traditional virtual machine can run on the first virtual machine 520 within processor 175.
[0113] You can refer to the first to third virtual machines, 520-540. Figure 10 The first virtual machine 520 is named the Server Virtual Machine, and the second to third virtual machines 530 to 540 can be named the Guest Virtual Machines.
[0114] At this time, the first guest virtual machine, which is the second virtual machine 530, can act for the first display 180a, and the second guest virtual machine, which is the third virtual machine 540, can act for the second display 180b.
[0115] For example, the first virtual machine 520 within the processor 175 can receive vehicle sensor data, location information data, camera image data, audio data, or touch input data, and output it after processing or manipulation. By distinguishing between data processed only in a conventional virtual machine and data processed in the first virtual machine 520, data processing can be performed efficiently. In particular, by performing most of the data processing in the first virtual machine 520, 1:N data sharing can be achieved.
[0116] As another example, the first virtual machine 520 can directly receive and process CAN (Controller Area Network) communication data, audio data, radio broadcast data, USB (Universal Serial Bus) data, and wireless communication data for the second to third virtual machines 530 to 540.
[0117] Furthermore, the first virtual machine 520 can transmit the processed data to the second virtual machine to the third virtual machine 530 to 540.
[0118] Therefore, among the first to third virtual machines 520 to 540, only the first virtual machine 520 receives communication data, external input data and performs signal processing, thereby reducing the signal processing burden of other virtual machines and enabling 1:N data communication, thus enabling synchronization during data sharing.
[0119] On the other hand, the first virtual machine 520 records a portion of the data in a first shared memory (not shown) for transmission to the second virtual machine 530, and records another portion of the data in the first shared memory (not shown) for transmission to the third virtual machine 540. The second virtual machine 530 and the third virtual machine 540 are controlled to process the received data respectively, and record the processed data in the second shared memory (not shown). Thus, it is possible to display overlays based on different operating systems together.
[0120] The data at this time can be any of the following: image data, audio data, navigation data, or speech recognition data.
[0121] On the other hand, the first virtual machine 520 can be controlled to process another portion of the data and record the processed data to a second shared memory (not shown). That is, in addition to the second virtual machine 530 and the third virtual machine, the first virtual machine 520 can additionally perform data processing.
[0122] On the other hand, when a fourth virtual machine 550, which operates for the third display 180c, is running in the processor 175, the first virtual machine 520 can record another portion of the data in the first shared memory (not shown), and the fourth virtual machine 550 can be controlled to process the received data and store the processed data in the second shared memory (not shown).
[0123] On the other hand, the first virtual machine 520 can generate various command queues for distributed data processing in the second to third virtual machines 530 and 540. This allows data processing to be distributed among multiple virtual machines.
[0124] On the other hand, when the second to third virtual machines 530 and 540 share the same data, the first virtual machine 520 within the processor 175 can generate the same command queue. Thus, the same data can be synchronized and shared.
[0125] On the other hand, the first virtual machine 520 can generate a number of command queues corresponding to the number of virtual machines used for distributed processing of data.
[0126] On the other hand, the first virtual machine 520 can be controlled to transmit at least a portion of the data to at least one of the second virtual machine 530 or the third virtual machine 540 for distributed data processing.
[0127] For example, the first virtual machine 520 may allocate a first shared memory (not shown) for transmitting at least a portion of data to at least one of the second virtual machine 530 or the third virtual machine 540, wherein image data processed by the second virtual machine 530 or the third virtual machine 540 may be recorded in the second shared memory (not shown).
[0128] On the other hand, the first virtual machine 520 can be controlled to record data in the shared memory 508 and share the same data with the second virtual machine 530 and the third virtual machine 540.
[0129] For example, the first virtual machine 520 can be controlled to record radio broadcast data or wireless communication data in the shared memory 508 and share the same data with the second virtual machine 530 and the third virtual machine 540. This enables 1:N data sharing.
[0130] As a result, by performing most of the data processing on the first virtual machine 520, 1:N data sharing can be achieved.
[0131] On the other hand, the first virtual machine 520 within the processor 175 can be controlled to set up a shared memory 508 based on the virtual monitor 505 in order to transfer the same data to the second virtual machine 530 and the third virtual machine 540.
[0132] That is, the first virtual machine 520 within the processor 175 can utilize the shared memory 508 based on the virtual monitor 505 to synchronize the same data and transmit it to the second virtual machine 530 and the third virtual machine 540. Thus, the same image can be simultaneously displayed on multiple displays 180a-180b within the vehicle.
[0133] On the other hand, the signal processing device 170 can process various signals such as audio signals, image signals, and data signals. Therefore, the signal processing device 170 can be implemented as a system-on-chip (SOC).
[0134] Figures 4A to 4B This figure is used as a reference when explaining the operation of the vehicle display device related to the present invention.
[0135] Figure 4A An example is given of a signal processing device in a vehicle display device related to the present invention, in which a second overlay layer OVLaxb is output via a screen transition while the first overlay layer OVLxa is being output.
[0136] Referring to the accompanying drawings, the signal processing device in the vehicle display device related to the present invention can output a first overlay layer OVLxa corresponding to a first application running on a first operating system at a first time point.
[0137] The first overlay layer OVLxa may include: a first menu area MUx, including multiple application viewing items, etc.; a map area Arax, displaying a map based on the vehicle's movement; an external device display area Arbx, displaying information about connected electronic devices; a radio broadcast display area Arcx, displaying radio broadcast information; and a second menu area Ardx, including settings items and time items, etc.
[0138] On the other hand, the signal processing device in the vehicle display device related to the present invention can output a second overlay layer OVLxb corresponding to a second application running on a second operating system at a second time point after the first time point.
[0139] The second overlay layer OVLxb may include: a map area MPx, displaying a map based on the vehicle's movement; and an information area Wex, including weather information such as external temperature and application information that provides streaming services.
[0140] Figure 4B This shows the output. Figure 4A A diagram of the system consisting of the first superposition layer OVLxa and the second superposition layer OVLxb.
[0141] Referring to the accompanying drawings, in a system 400x driven by a signal processing device 175x within a vehicle display device related to the present invention, a virtual monitor 505x runs within the processor 175x, a first operating system OSh runs on the virtual monitor 505x, and a first application APxa runs on the first operating system OSh.
[0142] Furthermore, based on the operation of the first application APxa, the first overlay layer OVLxa corresponding to the first application APxa running on the first operating system Osh can be output.
[0143] On the other hand, in the system 400x driven by the signal processing device 175x in the vehicle display device related to the present invention, a virtual monitor 505x runs in the processor 175x, a second operating system OSg different from the first operating system Osh runs on the virtual monitor 505x, and a second application APxb runs on the second operating system OSg.
[0144] Furthermore, based on the operation of the second application APxb, a second overlay layer OVLxb corresponding to the second application APxb running on the second operating system OSg can be output.
[0145] On the other hand, such as Figure 4A As shown, during the process of displaying the first overlay layer OVLxa on the AVN display 180b, in the case where a second overlay layer OVLxb corresponding to the second application running on the second operating system is output to the AVN display 180b instead of the first overlay layer OVLxa, the signal processing device 175x in the vehicle display device related to the present invention needs to generate and output the first overlay layer OVLxa corresponding to the first application APxa running on the first operating system OSh at a first time point based on the operation of the first application APxa, and generate and output the second overlay layer OVLxb corresponding to the second application APxb running on the second operating system OSg at a second time point after the first time point based on the operation of the second application APxb.
[0146] Therefore, according to Figure 4A and Figure 4B When displaying a second overlay OVLxb after displaying a first overlay OVLxa based on a different operating system, there is a drawback that it is difficult to display the overlay quickly and seamlessly.
[0147] Furthermore, there is a drawback that it is difficult to display the first overlay layer OVLxa and the second overlay layer OVLxb together. Additionally, there is a drawback that it is difficult to perform organic operations when displaying the first overlay layer OVLxa and the second overlay layer OVLxb.
[0148] In this regard, embodiments of the present invention provide a technical solution for displaying overlays based on different operating systems together. In particular, a technical solution is provided that enables seamless display of overlays based on different operating systems. This will be referred to later. Figure 5 Please provide an explanation.
[0149] Figure 5 This is a diagram illustrating an example of a system driven in a vehicle display device according to an embodiment of the present invention.
[0150] Referring to the accompanying drawings, in the system 600 running the signal processing device 170 within the vehicle display device 100 of this embodiment of the invention, a virtual monitor 505 runs within the processor 175, a first operating system OSh runs on the virtual monitor 505, a first application APa runs on the first operating system OSh, a second operating system OSg, which is different from the first operating system OSh, runs on the virtual monitor 505, and a second application APb runs on the second operating system OSg.
[0151] On the other hand, the signal processing device 170 within the vehicle display device 100 of this embodiment is controlled to display, during the output of a first overlay layer OVLa based on a first operating system Osh, a second overlay layer OVLb based on a second operating system OSg in an overlapping manner in at least a portion of the area of the first overlay layer OVLa. Thus, overlay layers based on different operating systems can be displayed together on the display 180b. Furthermore, overlay layers based on different operating systems can be displayed seamlessly.
[0152] On the other hand, in order to achieve seamless operation based on a single operating environment between the first operating system Osh and the second operating system OSg, the signal processing device 170 can perform setpoint synchronization, notification information synchronization, and other functions between the first operating system Osh and the second operating system OSg.
[0153] On the other hand, setting synchronization can include synchronizing the list of installed applications, screen brightness, and language between the first operating system Osh and the second operating system OSg.
[0154] On the other hand, the signal processing device 170 can be controlled to perform specific information sharing between the first operating system Osh and the second operating system OSg.
[0155] At this point, specific information sharing can be controlled to include sharing vehicle information such as vehicle model, license plate number, speed information, and sensor information, as well as power status information and driver information.
[0156] On the other hand, the signal processing device 170 can be controlled to run the virtual monitor 505, generate a first overlay layer OVLa based on the first operating system Osh on the virtual monitor 505, generate a second overlay layer OVLb based on the second operating system OSg on the virtual monitor 505, and overlay the second overlay layer OVLb based on the second operating system OSg on at least a portion of the first overlay layer OVLa. Thus, overlay layers based on different operating systems can be displayed together.
[0157] On the other hand, the signal processing device 170 includes a processor 175 that runs a virtual monitor 505. The processor 175 can be controlled to generate a first overlay layer OVLa based on a first operating system Osh on the virtual monitor 505, generate a second overlay layer OVLb based on a second operating system OSg on the virtual monitor 505, and overlay the second overlay layer OVLb based on the second operating system OSg on at least a portion of the first overlay layer OVLa. Thus, overlay layers based on different operating systems can be displayed together.
[0158] On the other hand, the signal processing device 170 includes a processor 175 that performs signal processing for the display 180b. The processor 175 can run a server virtual machine 520 based on a first operating system Osh on a virtual monitor 505 within the processor 175, and a guest virtual machine 540 that operates for the display 180b based on a second operating system OSg. Thus, virtual machines based on different operating systems can be run stably.
[0159] The accompanying diagram illustrates a scenario where server virtual machine 520 runs on a first operating system OSh, and guest virtual machine 540 runs on a second operating system OSg.
[0160] On the other hand, the server virtual machine 520 can run a microcomputer manager 582 for controlling the microcomputer in the vehicle, a virtual machine controller 584 for controlling the virtual machine, and an application 583 based on the first operating system Osh.
[0161] On the other hand, the guest virtual machine 540 can be connected with the following... Figure 10 The second guest virtual machine corresponds to 540.
[0162] On the other hand, the guest virtual machine 540 can run a hardware abstraction layer (HAL) 589 for processing vehicle data or audio data, a virtual machine manager 588 for managing virtual machines, and applications 587 based on a second operating system OSg.
[0163] On the other hand, the server virtual machine 520 can output a first overlay OVLa based on the first operating system Osh, and the guest virtual machine 540 can output a second overlay OVLb based on the second operating system OSg, which are then overlaid on at least a portion of the first overlay OVLa. This allows overlays based on different operating systems to be displayed together.
[0164] On the other hand, the processor 175 can transmit the first overlay OVLa from the server virtual machine 520 to the guest virtual machine 540 via interface 586. This enables the display of overlays based on different operating systems together.
[0165] On the other hand, interface 586 can be used for data transfer between server virtual machine 520 and guest virtual machine 540, etc.
[0166] On the other hand, the first operating system Osh can be QNX OS or Linux OS, and the second operating system OSg can be Android OS or web OS.
[0167] Figures 6A to 6C The figures illustrate various examples of a system driven by a display device for a vehicle according to an embodiment of the present invention.
[0168] First, refer to Figure 6A In another embodiment of the present invention, in the system 600b running the signal processing device 170 in the vehicle display device 100, a virtual monitor 505 runs in the processor 175, a first operating system OSh runs on the virtual monitor 505, a first application APa runs on the first operating system OSh, a second operating system OSg, which is different from the first operating system OSh, runs on the virtual monitor 505, and a second application APb runs on the second operating system OSg.
[0169] On the other hand, with Figure 5 Similar to System 600, in Figure 6A In system 600b, processor 175 in signal processing device 170 runs a first application APa on first operating system Osh, generates and outputs a first overlay layer OVLa corresponding to the first application APa, and runs a second application APb on second operating system OSg, generates and outputs a second overlay layer OVLb corresponding to the second application APb.
[0170] In particular, the processor 175 can transmit the first overlay layer OVLa from the first application APa to the second overlay layer OVLb from the second application APb via the interface 586.
[0171] Therefore, the signal processing device 170 can be controlled to overlay and display a second overlay layer OVLb based on a second operating system OSg on at least a portion of the first overlay layer OVLa while outputting a first overlay layer OVLa based on the first operating system Osh.
[0172] Next, refer to Figure 6B In a system 600c where the signal processing device 170 operates within a vehicle display device 100 according to another embodiment of the present invention, and... Figure 6A Similarly, a virtual monitor 505 runs within the processor 175, on which a first operating system OSh runs, a first application APa runs, and a second operating system OSg, which is different from the first operating system OSh, runs on the virtual monitor 505, and a second application APb runs on the second operating system OSg.
[0173] and Figure 5 Similar to System 600, in Figure 6B In system 600c, the processor 175 in the signal processing device 170 runs a first application APa on the first operating system Osh, generates and outputs a first overlay layer OVLa corresponding to the first application APa, and runs a second application APb on the second operating system OSg, generates and outputs a second overlay layer OVLb corresponding to the second application APb.
[0174] On the other hand, the signal processing device 170 includes a processor 175 that performs signal processing for the display 180b. The processor 175 can run a server virtual machine 520 based on a first operating system Osh on a virtual monitor 505 within the processor 175, and a client virtual machine 540 that operates for the display 180b based on a second operating system OSg. Thus, virtual machines based on different operating systems can be run stably.
[0175] On the other hand, processor 175 can run virtual monitor 505 and transmit the first overlay OVLa from server virtual machine 520 to guest virtual machine 540 via shared memory 508 within virtual monitor 505.
[0176] Therefore, data can be efficiently transferred or shared by running virtual machines on the virtual monitor 505.
[0177] Ultimately, the signal processing device 170 can be controlled to overlay a second overlay layer OVLb based on the second operating system OSg onto at least a portion of the first overlay layer OVLa while outputting the first overlay layer OVLa based on the first operating system Osh.
[0178] Next, refer to Figure 6C In a system 600d operating within the signal processing device 170 of a vehicle display device 100 according to another embodiment of the present invention, and... Figure 6C Similarly, system 600c runs a server virtual machine 520 based on the first operating system Osh on a virtual monitor 505 within processor 175, and a guest virtual machine 540 for operation of a monitor 180b based on the second operating system OSg.
[0179] On the other hand, the server virtual machine 520 can run a first application APa based on the first operating system Osh, and output a first overlay layer OVLa through the first application APa.
[0180] On the other hand, the guest virtual machine 540 can run a second application APb based on the second operating system OSg, and output a second overlay layer OVLb through the second application APb.
[0181] On the other hand, in order to overlay the second overlay layer OVLb onto at least a portion of the first overlay layer OVLa, the guest virtual machine 540 can also run the first application APaa in addition to the second application APb based on the second operating system OSg.
[0182] The signal processing device 170 can be controlled to perform harmonic processing on at least a portion of the first overlay layer OVLa using a first application APaa based on the second operating system OSg, and to overlay and display the second overlay layer OVLb based on the second operating system OSg in the harmonic processing area. This enables the display of overlay layers based on different operating systems together.
[0183] On the other hand, the signal processing device 170 can be controlled to overlay a second overlay layer OVLb based on the second operating system OSg onto any one of the plurality of first overlay layers OVLa1, OVLa2, and OVLa3 while outputting a plurality of first overlay layers OVLa1, OVLa2, and OVLa3 based on the first operating system Osh. This allows overlay layers based on different operating systems to be displayed together. For this, refer to... Figure 7A Please provide an explanation.
[0184] Figure 7A This diagram is used as a reference when explaining the harmonic blending of the first and second superposition layers. Figures 7B to 7D It is explaining Figure 7A The diagram is used as a reference.
[0185] Referring to the attached diagram, Figure 7A Example (a) illustrates a plurality of first overlays OVLa1, OVLa2, OVLa3 based on the first operating system Osh.
[0186] On the other hand, the signal processing device 170 can generate and output a plurality of first overlay layers OVLa1, OVLa2, and OVLa3 based on the first operating system Osh during the first period.
[0187] Figure 7A The left region OVLa1 of the first stacked layers OVLa1, OVLa2, and OVLa3 can be connected with Figure 7B The first menu area MU corresponds to, Figure 7AThe right region of the first stacked layers OVLa1, OVLa2, and OVLa3, OVLa2, can be connected with... Figure 7B The second menu area corresponds to Ard. Figure 7A The central region OVLa3 of the first stacked layers OVLa1, OVLa2, and OVLa3 may include Figure 7B The map area is Ara, the external device display area is Arb, and the radio broadcast display area is Arc.
[0188] On the other hand, when it is necessary to display a second overlay layer OVLb based on the second operating system OSg, depending on the input signal, the signal processing device 170 can generate and output the second overlay layer OVLb based on the second operating system OSg after the first period.
[0189] At this time, as Figure 7A (b) The signal processing device 170 can be controlled to perform harmonic processing on the central region OVLa3 of the first overlay layers OVLa1, OVLa2, and OVLa3, and overlay display the second overlay layer OVLb based on the second operating system OSg in the harmonic processing region OVLa3b.
[0190] In particular, the signal processing device 170 can be controlled to perform alpha blending processing on the central region OVLa3 of the first overlay layers OVLa1, OVLa2, and OVLa3, and to overlay and display the second overlay layer OVLb based on the second operating system OSg in the blended region. This allows overlay layers based on different operating systems to be displayed together.
[0191] Figure 7B The example illustrates the scenario where, while outputting the first overlay OVLan based on the first operating system Osh, a second overlay OVLbn based on the second operating system OSg is output.
[0192] Referring to the accompanying drawings, the signal processing device 170 can generate and output a first overlay layer OVLan based on the first operating system Osh at a first time point. Consequently, the first overlay layer OVLan is displayed on the AVN display 180b.
[0193] On the other hand, the first overlay layer OVLa may include: a first menu area MU, including a plurality of application viewing items 810, etc.; a map area Ara, displaying a map based on the vehicle's movement; an external device display area Arb, displaying information about the connected electronic device; a radio broadcast display area Arc, displaying radio broadcast information; and a second menu area Ard, including settings items and time items, etc.
[0194] On the other hand, if an application viewing item 810 within the first overlay layer OVLan is selected during the output of the first overlay layer OVLan based on the first operating system Osh, the signal processing device 170 can control the display of the second overlay layer OVLbn, which includes a plurality of application items based on the second operating system OSg, overlaid on a portion of the area within the first overlay layer OVLa.
[0195] Specifically, when multiple application viewing items 810 are selected in the first menu area MU, the signal processing device 170 can be controlled to perform harmonic processing on the map area Ara, the external device display area Arb, and the radio broadcast display area Arc, which are part of the first overlay layer OVLa, and overlay display the second overlay layer OVLbn based on the second operating system OSg in the harmonic processed area.
[0196] At this point, the first menu area MU is displayed as is on the left side of the second overlay layer OVLbn, and the second menu area Ard is displayed as is on the right side of the second overlay layer OVLbn. This allows overlays based on different operating systems to be displayed together.
[0197] On the other hand, the second overlay layer OVLbn based on the second operating system OSg can be an application screen that includes a plurality of application items.
[0198] On the other hand, if a map-related application item 820 is selected from among a plurality of application items in the second overlay layer OVLbn based on the second operating system OSg, the signal processing device 170 can be controlled to generate and display a third overlay layer OVLc based on the second operating system OSg.
[0199] The accompanying drawings illustrate a scenario where the third overlay layer OVLc is displayed while also overlapping the first menu area MU and the second menu area Ard, but it can also be displayed differently.
[0200] On the other hand, Figure 7B In this context, some of the multiple application projects can be application projects based on the first operating system Osh, and another part of the multiple application projects can be application projects based on the second operating system OSg. In this case, the map-related application project 820 can be an application project based on the second operating system OSg.
[0201] Figure 7C The example illustrates a scenario where, while outputting a first overlay OVLan based on a first operating system Osh, a second overlay OVLbp based on a second operating system OSg is output.
[0202] Referring to the accompanying drawings, the signal processing device 170 can generate and output a first overlay layer OVLan based on the first operating system Osh at a first time point. Consequently, the first overlay layer OVLan is displayed on the AVN display 180b.
[0203] On the other hand, the first overlay layer OVLa may include: a first menu area MU, including a plurality of application viewing items 810, etc.; a map area Ara, displaying a map based on the vehicle's movement; an external device display area Arb, displaying information about the connected electronic device; a radio broadcast display area Arc, displaying radio broadcast information; and a second menu area Ard, including settings items and time items, etc.
[0204] On the other hand, when multiple application viewing items 810 are selected within the first menu area MU, and... Figure 7C In contrast, the signal processing device 170 can be controlled to overlay the second overlay layer OVLbp based on the second operating system OSg onto the entire area of the first overlay layer OVLa.
[0205] On the other hand, the second overlay layer OVLbp based on the second operating system OSg can be an application screen that includes a plurality of application items.
[0206] On the other hand, when the first application item 825 among a plurality of application items is selected, the signal processing device 170 can be controlled to display the overlay layer OVLbo related to the first application in a portion of the first overlay layer OVLan. This allows for the rapid display of overlay layers based on different operating systems.
[0207] For example, if a map-related application item 825 is selected from among a plurality of application items in the second overlay layer OVLbp based on the second operating system OSg, the signal processing device 170 can be controlled to generate and display a third overlay layer OVLbo based on the second operating system OSg.
[0208] In the attached diagram, when displaying the third overlay layer OVLbo, the first menu area MU can be displayed to the left of the third overlay layer OVLbo, and the second menu area Ard can be displayed to the right of the third overlay layer OVLbo.
[0209] That is, the third overlay layer OVLbo, based on the second operating system OSg, can be overlaid on the map area Ara, the external device display area Arb, and the radio broadcast display area Arc, which are all part of the first overlay layer OVLa, with the first overlay layer OVLa as the reference. Thus, it is possible to display overlay layers based on different operating systems together.
[0210] On the other hand, Figure 7C In this context, some of the multiple application projects can be application projects based on the first operating system Osh, and another part of the multiple application projects can be application projects based on the second operating system OSg. In this case, the map-related application project 825 can be an application project based on the second operating system OSg.
[0211] and Figure 7B Similarly, Figure 7D This example illustrates the scenario where, while outputting the first overlay OVLan based on the first operating system Osh, a second overlay OVLbn based on the second operating system OSg is also output.
[0212] Referring to the accompanying drawings, the signal processing device 170 can generate and output a first overlay layer OVLan based on the first operating system Osh at a first time point. Consequently, the first overlay layer OVLan is displayed on the AVN display 180b.
[0213] On the other hand, when multiple application viewing items 810 are selected in the first menu area MU, the signal processing device 170 can be controlled to perform harmonic processing on the map area Ara, the external device display area Arb, and the radio broadcast display area Arc, which are part of the first overlay layer OVLa, and to overlay and display the second overlay layer OVLbn based on the second operating system OSg in the harmonic processing area.
[0214] At this point, the first menu area MU is displayed as is on the left side of the second overlay layer OVLbn, and the second menu area Ard is displayed as is on the right side of the second overlay layer OVLbn. This allows overlays based on different operating systems to be displayed together.
[0215] On the other hand, the second overlay layer OVLbn based on the second operating system OSg can be an application screen that includes a plurality of application items.
[0216] On the other hand, if the application item 820 concerning the map is selected among the multiple application items in the second overlay layer OVLbn based on the second operating system OSg, the signal processing device 170 can be controlled to generate and display the third overlay layer OVLsc based on the second operating system OSg.
[0217] The accompanying diagram illustrates how, when displaying the third overlay OVLsc, it is overlaid on the map area Ara, the external device display area Arb, the radio broadcast display area Arc, and the second menu area Ard.
[0218] That is, the signal processing device 170 can be controlled to overlay the third overlay layer OVLsc based on the second operating system OSg onto the map area Ara, the external device display area Arb, the radio broadcast display area Arc, and the second menu area Ard, with the first overlay layer OVLan as a reference.
[0219] Therefore, the first menu area MU, including multiple application view items 810, can be displayed as is on the left side of the third overlay OVLsc based on the second operating system OSg. This allows overlays based on different operating systems to be displayed together.
[0220] Ultimately, according to Figure 7D When outputting the first overlay layer OVLan based on the first operating system Osh, if application viewing item 810 is selected within the first overlay layer OVLan, the signal processing device 170 can control the display to overlay at least a portion of the area within the first overlay layer OVLan, including a plurality of application items based on the second operating system OSg. If the first application item 820 is selected among the plurality of application items, the signal processing device 170 can control the display to show the overlay layer OVLc related to the first application within a portion of the area within the first overlay layer OVLan. This allows for the rapid display of overlay layers based on different operating systems.
[0221] On the other hand, Figure 7D In this context, some of the multiple application projects can be application projects based on the first operating system Osh, and another part of the multiple application projects can be application projects based on the second operating system OSg. In this case, the map-related application project 820 can be an application project based on the second operating system OSg.
[0222] Figure 7E This example illustrates a scenario where at least one application based on the first operating system Osh and at least one application based on the second operating system OSg are displayed together.
[0223] Referring to the accompanying drawings, the signal processing device 170 can be controlled to run a virtual monitor 505, generate a first overlay layer OVLam based on a first operating system Osh on the virtual monitor 505, generate a second overlay layer OVLbm based on a second operating system OSg on the virtual monitor 505, and overlay and display the second overlay layer OVLbm based on the second operating system OSg in at least a portion of the area of the first overlay layer OVLam.
[0224] On the other hand, the first overlay layer OVLam may include at least one application project based on the first operating system Osh, and the second overlay layer OVLbm may include at least one application project based on the second operating system OSg.
[0225] The accompanying drawings illustrate a scenario where multiple application items within a first overlay layer OVLam are configured on the upper and left sides, which constitute a first region, and multiple application items within a second overlay layer OVLbm are configured on the lower and right sides, which constitute a second region.
[0226] On the other hand, the signal processing device 170 can be controlled to perform transparent blending processing on a second region that is part of the first overlay layer OVLam, and to overlay and display the second overlay layer OVLbm based on the second operating system OSg in the region that has been blended to be transparent. This allows application items OVLt based on different operating systems to be displayed together.
[0227] Figure 8A This is a diagram illustrating how menus and multiple application items based on different operating systems can be displayed together.
[0228] Referring to the attached figures, the signal processing device 170 generates a first overlay layer (overlay layer #1) based on the first operating system Osh, and generates a second overlay layer (overlay layer #2) based on the second operating system OSg.
[0229] The accompanying drawings illustrate a scenario where the first overlay (overlay #1) includes a menu 1010 and a plurality of application items based on the first operating system Osh, and the second overlay (overlay #2) includes a first application screen 1020 based on the second operating system OSg.
[0230] On the other hand, the signal processing device 170 can be controlled to perform alpha harmonic processing on a portion of the first overlay (overlay #1), generate a third overlay (overlay #3) including an application item 1040 based on the second operating system OSg in the harmonic processing area, and display it on the display 180b.
[0231] The accompanying diagram illustrates a scenario where the third overlay (overlay #3) includes a menu 1010 based on the first operating system Osh and a plurality of application items, as well as an application list 1010m containing a first application item 1040 based on the second operating system OSg. This allows application items based on different operating systems to be displayed together.
[0232] On the other hand, when displaying applications based on different operating systems together, if the first application 1040 based on the second operating system OSg is selected, the signal processing device 170 can be controlled to perform alpha harmonic processing on a portion of the first overlay (overlay #1) and output a fourth overlay (overlay #4) including the first application screen 1060 based on the second operating system OSg in the harmonic processing area. This allows for the rapid display of overlays based on different operating systems.
[0233] On the other hand, when running a first application based on the second operating system OSg, the signal processing device 170 transmits the first application information based on the second operating system OSg to the first operating system Osh and runs it through the first operating system Osh.
[0234] On the other hand, in order to achieve setting synchronization, the signal processing device 170 can transmit the setting information of the first operating system Osh to the second operating system OSg, and use the matching setting information to set the second operating system OSg.
[0235] On the other hand, in order to achieve reminder synchronization, the signal processing device 170 can display the reminder of the second operating system OSg through the reminder system of the first operating system Osh, and then perform subsequent actions such as reminder display and reminder clearing.
[0236] Figure 8B The example illustrates a scenario where menus based on the same operating system and multiple application items are displayed together.
[0237] Referring to the accompanying drawings, the signal processing device 170 generates a first overlay layer (overlay layer #1) and a second overlay layer (overlay layer #2) based on the first operating system Osh.
[0238] The accompanying diagram illustrates a scenario where the first overlay (overlay #1) includes a menu 1010b and a plurality of application items, and the second overlay (overlay #2) includes a first application screen 1020b.
[0239] On the other hand, the signal processing device 170 can be controlled to perform alpha harmonic processing on a portion of the first overlay (overlay #1), generate a third overlay (overlay #3) including the application item 1040b in the harmonic processing area, and display it on the display 180b.
[0240] The accompanying diagram illustrates a scenario where the third overlay (overlay #3) has an application list 1010ma that includes a menu 1010, a plurality of application items, and a first application item 1040. This allows application items based on the same operating system to be displayed together.
[0241] On the other hand, when displaying applications based on the same operating system together, if the first application 1040 is selected, the signal processing device 170 can be controlled to perform alpha harmonic processing on a portion of the first overlay (overlay #1) and output a fourth overlay (overlay #4) including the first application screen 1060b in the harmonic processing area. This allows for the rapid display of overlays based on the same operating system.
[0242] On the other hand, during the output of a first overlay layer OVLbp including a plurality of application items based on the first operating system Osh, if a first application item based on the second operating system OSg is selected among the plurality of application items, the signal processing device 170 can control the display to overlay a second overlay layer OVLbe including the first application screen based on the second operating system OSg onto at least a portion of the area within the first overlay layer OVLbe. To this end, Figure 9A Please provide an explanation.
[0243] Figure 9A An example is given of a scenario in which a second overlay layer OVLbe is overlaid on at least a portion of a first overlay layer OVLae by screen transition from a first overlay layer OVLbp, which includes a plurality of application items based on the first operating system Osh.
[0244] Referring to the attached diagram, the first operating system Osh can be QNX OS or Linux OS, and the first overlay layer OVLbp can include a plurality of application projects based on QNX OS or Linux OS.
[0245] When a first application project among a plurality of application projects based on QNX OS or Linux OS is selected, the signal processing device 170 can be controlled to generate a second overlay layer OVLbe that includes the first application screen based on a second operating system OSg, and to overlay the generated second overlay layer OVLbe onto the central region of at least a portion of the area within the first overlay layer OVLae. This allows overlay layers based on different operating systems to be displayed together.
[0246] At this point, the second operating system OSg can be Android, web OS, or iOS.
[0247] On the other hand, the first application item can correspond to the app store item, and the first application screen can correspond to the messenger application screen.
[0248] On the other hand, when the second overlay layer OVLbe overlaps the central region, which is at least a part of the area within the first overlay layer OVLae, and is displayed on the display 180b, if the installation item for the messenger application is selected, the signal processing device 170 can receive and install the messenger application.
[0249] After installation is complete, Figure 9A As shown in (c), the signal processing device 170 can be controlled to display an overlay OVLbf containing a plurality of application items based on the first operating system Osh, with the addition of a messenger application item 910.
[0250] On the other hand, the signal processing device 170 can be controlled to include preview information or messages based on the second operating system OSg in a portion of the first overlay based on the first operating system Osh, and to display a second overlay including the screen corresponding to the preview information or message when the preview information or message is selected.
[0251] On the other hand, the signal processing device 170 can be controlled to overlay a second overlay layer OVLb, which includes a screen corresponding to preview information or messages based on the second operating system OSg, onto at least a portion of the area of the first overlay layer OVLa. For this purpose, see [reference needed]. Figure 9B and Figure 9C Please provide an explanation.
[0252] Figure 9B An example is shown where a message is displayed in a portion 925 of the first overlay OVLan1 based on the first operating system Osh.
[0253] The message at this time is based on the second operating system OSg, which can be overlaid on a portion of area 925 of the first overlay layer OVLan1 based on the first operating system Osh.
[0254] On the other hand, if the information displayed in a portion of area 925 is selected, such as Figure 9B (b) The signal processing device 170 can be controlled to display the application item 928 corresponding to the message in a portion of the first overlay OVLan2 based on the first operating system Osh. Therefore, it is possible to display overlays based on different operating systems together.
[0255] On the other hand, the application project 928 corresponding to the message can be an application project based on the second operating system OSg.
[0256] On the other hand, such as Figure 9B(c) When application item 928 is selected, the signal processing device 170 can be controlled to display the message application screen OVLbn3 based on the second operating system OSg in a part of the first overlay layer OVLan3 based on the first operating system Osh.
[0257] The accompanying diagram illustrates a scenario where a first menu area MU based on the first operating system Osh is displayed on the left side of the messaging application screen OVLbn3, and a second menu area Ard based on the first operating system Osh is displayed on the right side of the messaging application screen OVLbn3. This allows overlays based on different operating systems to be displayed together.
[0258] and Figure 9B Similarly, Figure 9C The example illustrates a scenario where message preview item 928 is displayed in a portion of the first overlay OVLan1 based on the first operating system Osh.
[0259] On the other hand, if message preview item 928 is selected, such as Figure 9C As shown in (b), the signal processing device 170 can be controlled to display the application item 928 corresponding to the message in a portion of the first overlay OVLan2 based on the first operating system Osh. This allows overlays based on different operating systems to be displayed together.
[0260] On the other hand, the application project 928 corresponding to the message can be an application project based on the second operating system OSg.
[0261] On the other hand, if application item 928 is selected, such as Figure 9C As shown in (c), the signal processing device 170 can be controlled to display a message application screen OVLbn3 based on the second operating system OSg in a portion of the first overlay layer OVLan3 based on the first operating system Osh.
[0262] The accompanying diagram illustrates a scenario where a first menu area MU based on the first operating system Osh is displayed on the left side of the messaging application screen OVLbn3, and a second menu area Ard based on the first operating system Osh is displayed on the right side of the messaging application screen OVLbn3. This allows overlays based on different operating systems to be displayed together.
[0263] Figure 10 This is a diagram illustrating an example of a system driven in the signal processing apparatus of the present invention.
[0264] Referring to the attached diagram, Figure 10System 500 illustrates a scenario where a first virtual machine 520, a second virtual machine 530, and a third virtual machine 540, acting as server virtual machines, run on a virtual monitor 505 within a processor 175 in a signal processing device 170.
[0265] The second virtual machine 530 may be a virtual machine for the instrument display 180a, and the third virtual machine 540 may be a virtual machine for the AVN display 180b.
[0266] That is, the second virtual machine 530 and the third virtual machine 540 can operate separately for image rendering of the instrument display 180a and the AVN display 180b.
[0267] On the other hand, examples were given in Figure 10 In the system 500 driven by the signal processing device 170, a legacy virtual machine 510 is also running on the virtual monitor 505 within the processor 175.
[0268] The traditional virtual machine 510 is provided with an interface 511 for data communication with the memory 140 and for communication with Ethernet.
[0269] The accompanying diagram illustrates the scenario where interface 511 is a physical device driver (physical D / D), but various modifications are possible.
[0270] On the other hand, the traditional virtual machine 510 can also be configured with an interface 512 (virtio-backend interface) for data communication with the second to third virtual machines 530 and 540.
[0271] The first virtual machine 520 may be configured with: an interface 521 for input / output of audio data, radio broadcast data, universal serial bus data, and wireless communication data; and an input / output (I / O) server interface 522 for data communication with the guest virtual machine.
[0272] That is, the first virtual machine 520, which is a server virtual machine, can provide difficult-to-virtualize I / O to multiple guest virtual machines, such as the second to third virtual machines 530, 540, etc., through standard virtualization technology (VirtIO).
[0273] On the other hand, the first virtual machine 520, which is a server virtual machine, controls radio broadcast data, audio data, etc. at the supervisor level and provides them to multiple guest virtual machines, such as the second to third virtual machines 530, 540, etc.
[0274] On the other hand, the first virtual machine 520, which is a server virtual machine, can process vehicle data, sensor data, vehicle surrounding information, etc., and provide the processed data or information to a plurality of client virtual machines, such as the second to third virtual machines 530, 540, etc.
[0275] On the other hand, the first virtual machine 520 can provide supervisory services such as vehicle data processing and audio routing management.
[0276] Next, the second virtual machine 530 may be configured with: an input / output client interface 532 for data communication with the first virtual machine 520; and APIs 533 for controlling the input / output client interface 532.
[0277] In addition, the second virtual machine 530 may be configured with an interface (virtio-backend interface) for data communication with the traditional virtual machine 510.
[0278] The second virtual machine 530 can receive memory data based on communication with memory 140 or Ethernet data based on Ethernet communication from the interface (virtio-backend interface) 512 of the traditional virtual machine 510 via the interface (virtio-backend interface).
[0279] Next, the third virtual machine 540 may be configured with: an input / output client interface 542 for data communication with the first virtual machine 520; and APIs 543 for controlling the input / output client interface 542.
[0280] Additionally, the third virtual machine 540 may be configured with an interface (virtio-backend interface) for data communication with the traditional virtual machine 510.
[0281] The third virtual machine 540 can receive memory data based on communication with memory 140 or Ethernet data based on Ethernet communication from the interface (virtio-backend interface) 512 of the traditional virtual machine 510 via the interface (virtio-backend interface).
[0282] On the other hand, with Figure 10 In contrast, the traditional virtual machine 510 can also be set up within the first virtual machine 520.
[0283] According to such a system 500, although CAN communication data is only input and output to the first virtual machine 520, it can be provided to a plurality of client virtual machines, such as the second to third virtual machines 530, 540, etc., through data processing performed on the first virtual machine 520. Therefore, 1:N data communication based on the processing of the first virtual machine 520 can be realized.
[0284] In addition, according to Figure 10 Although audio data, radio broadcast data, universal serial bus data, and wireless communication data in system 500 are only input and output to the first virtual machine 520, they can be provided to multiple guest virtual machines, such as the second to third virtual machines 530, 540, etc., through data processing performed in the first virtual machine 520. Therefore, 1:N data communication based on the processing of the first virtual machine 520 can be realized.
[0285] In addition, according to Figure 10 In system 500, touch input on the first display 180a or the second display 180b is only input to the first virtual machine 520 and is not input to the second to third virtual machines 530 and 540. Information related to touch input is transmitted to the second virtual machine 530 or the third virtual machine 540.
[0286] This enables rapid and accurate processing of touch input. Furthermore, even with an increased number of driven virtual machines, the processing of touch input remains fast and accurate.
[0287] On the other hand, Figure 10 In system 500, the second virtual machine to the third virtual machine 530 and 540 can be based on different OS actions.
[0288] For example, the second virtual machine 540 can be based on Linux OS operations, and the third virtual machine 540 can be based on web OS operations.
[0289] Even if the second to third virtual machines 530 and 540 operate on different OSes, the first virtual machine 520 can still configure a shared memory 508 based on the virtual monitor 505 for data sharing (see reference). Figure 11 Therefore, even if the second to third virtual machines 530 and 540 operate on different operating systems, they can synchronize and share the same data or images. Ultimately, the same data or images can be displayed synchronously on multiple displays 180a and 180b.
[0290] On the other hand, even if the second to third virtual machines 530 and 540 operate on different OSes, the first virtual machine 520 will still transmit touch input information to the second to third virtual machines 530 and 540. Thus, even if the second virtual machine 530 and the third virtual machine 540 operate on different operating systems, they can quickly and accurately perform touch input processing.
[0291] On the other hand, the first virtual machine 520 may be configured with: a display manager 527 for controlling the overlay displayed on the first display 180a and the second display 180b through the second virtual machine to the third virtual machine 530, 540; a display layer server 529; and a virtual overlay generator 523 for generating virtual overlays.
[0292] The display layer server 529 can receive a first overlay provided by a second virtual machine 530 and a second overlay provided by a third virtual machine 540.
[0293] On the other hand, the display layer server 529 can transmit the virtual overlay generated by the virtual overlay generator 523 to at least one of the second virtual machine 530 or the third virtual machine 540.
[0294] On the other hand, the display manager 527 in the first virtual machine 520 can receive the first overlay provided by the second virtual machine 530 and the second overlay provided by the third virtual machine 540 through the display layer server 529.
[0295] Furthermore, the display manager 527 within the first virtual machine 520 can be controlled to transmit the virtual overlay separately from the first overlay or the second overlay to at least one of the second virtual machine 530 or the third virtual machine 540 via the display layer server 529.
[0296] Correspondingly, the second virtual machine 530 can be controlled to combine the first overlay and the virtual overlay and display them on the first display 180a.
[0297] Additionally, the third virtual machine 540 can be controlled to combine the second overlay and the virtual overlay and display them on the second display 180b.
[0298] On the other hand, the first virtual machine 520 may be equipped with an input manager 524 that receives input signals from the outside. These input signals can be input signals from designated buttons inside the vehicle (such as the start button), touch input signals, or voice input signals.
[0299] For example, the input manager 524 within the first virtual machine 520 can receive touch input from the first display 180a or the second display 180b.
[0300] On the other hand, the first virtual machine 520 may be equipped with a touch server 528, which transmits touch input information related to touch input from the first display 180a or the second display 180b to the second virtual machine 530 or the third virtual machine 540.
[0301] For example, when there is touch input corresponding to the first display 180a, the touch server 528 in the first virtual machine 520 can transmit information about the touch input to the second virtual machine 530.
[0302] On the other hand, the touch server 528 within the first virtual machine 520 can also receive touch input from the first display 180a or the second display 180b.
[0303] Figure 11 This is a diagram illustrating another example of a system driven in the signal processing apparatus of the present invention.
[0304] Referring to the attached diagram, according to Figure 11 The system 500b is driven in the processor 175 within the signal processing device 170. The processor 175 within the signal processing device 170 runs a first virtual machine to a third virtual machine 520 to 540 on a virtual monitor 505 within the processor 175. The first virtual machine 520 within the processor 175 is controlled to set up a shared memory 508 based on the virtual monitor 505 in order to transmit data to the second virtual machine 530 and the third virtual machine 540.
[0305] For example, information about touch input can be provided as data. This information is then transmitted to the second virtual machine 530 or the third virtual machine 540, ultimately enabling rapid and accurate processing of touch input to the first display 180a or the second display 180b. Furthermore, even with an increased number of driven virtual machines, rapid and accurate processing of touch input remains achievable.
[0306] As another example, image data can be used as data. Thus, the image can be displayed on either the first display 180a or the second display 180b.
[0307] On the other hand, when the same image data is shared in the shared memory 508, the same image can also be displayed synchronously on multiple displays 180a to 180b inside the vehicle.
[0308] As another example, the data could include CAN communication data, audio data, radio broadcast data, Universal Serial Bus data, wireless communication data, location information data, etc. Therefore, information about the corresponding data can be displayed on the first display 180a or the second display 180b.
[0309] On the other hand, although Figure 11 Although not explicitly labeled, the conventional virtual machine 510 can utilize the shared memory 508 based on the virtual monitor 505 to transmit memory data from the memory 140 or Ethernet data via Ethernet communication to the second virtual machine 530 and the third virtual machine 540. Consequently, information corresponding to the memory data or Ethernet data can be displayed on the first display 180a or the second display 180b.
[0310] On the other hand, with Figure 10 The first virtual machine within the system's 500 is similar. Figure 11 The first virtual machine 520 within the system 500b can be configured with a display manager 527, a display layer server 529, a virtual overlay generator 523, an input manager 524, and a touch server 528.
[0311] On the other hand, with Figure 10 Differently, Figure 11 The input / output server interface 522 within the first virtual machine 520 of the system 500b can be configured with a display layer server 529 and a touch server 528.
[0312] Due to the actions of display manager 527, display layer server 529, input manager 524, virtual overlay generator 523, and touch server 528... Figure 10 Since they are the same, the description of them is omitted.
[0313] on the other hand, Figure 11The first virtual machine 520 can also be configured with a system manager for overall system control, a vehicle information manager for vehicle information management, an audio manager for audio control, and a radio manager for radio broadcast control.
[0314] on the other hand, Figure 11 The input / output server interface 522 within the first virtual machine 520 of system 500b may also include: a GNSS (Global Navigation Satellite System) server for input / output of GPS information, a Bluetooth server for input / output of Bluetooth, a Wi-Fi server for input / output of wireless high fidelity (Wi-Fi), a camera server for input / output of camera data, etc.
[0315] Figure 12 This is a diagram illustrating yet another example of a system driven in the signal processing apparatus of the present invention.
[0316] Referring to the attached diagram, in Figure 12 The signal processing unit 170 contains a processor 175 that drives the system 500c, which is almost identical to... Figure 11 The system is similar to 500b.
[0317] That is, with Figure 11 Similarly, Figure 12 The processor 175 runs the first virtual machine to the third virtual machine 520 to 540 on the virtual monitor 505 within the processor 175.
[0318] However, with Figure 11 In different ways, Figure 12 In this configuration, the display layer server 529 and the touch server 528 can be configured within the first virtual machine 520 and run outside the input / output server interface 522.
[0319] In addition, with Figure 11 In contrast, GNSS servers for GPS information input / output, Bluetooth servers for Bluetooth input / output, Wi-Fi servers for wireless high-fidelity (Wi-Fi) input / output, and camera servers for camera data input / output can be set up outside the input / output server interface 522 within the first virtual machine 520 and run thereon.
[0320] That is, the display manager 527, display layer server 529, virtual overlay generator 523, input manager 524, and touch server 528 can be set up and run within the first virtual machine 520.
[0321] Due to the actions of display manager 527, display layer server 529, virtual overlay generator 523, input manager 524, and touch server 528... Figure 10 Since they are the same, the description of them is omitted.
[0322] Figures 13 to 14B It is explaining Figure 10 The diagram is used as a reference.
[0323] first, Figure 13 An example is given of a first virtual machine to a third virtual machine 520 to 540 running on a virtual monitor 505 within a processor 175 in a system 500 of the present invention, wherein the first virtual machine 520 within the processor 175 is controlled to set up a shared memory 508 based on the virtual monitor 505 in order to transmit the same data to the second virtual machine 530 and the third virtual machine 540.
[0324] Therefore, the same image can be displayed simultaneously on multiple displays 180a-180b inside the vehicle.
[0325] On the other hand, it is capable of performing high-speed data communication between multiple virtual machines. Furthermore, it is capable of performing high-speed data communication even if multiple virtual machines are driven by different operating systems.
[0326] On the other hand, when the first virtual machine 520 within the processor 175 transmits data processed by the first virtual machine 520 to other virtual machines, a shared memory 508 can be used instead of a memory quantity corresponding to the number of virtual machines. Thus, the shared memory 508 can be used to achieve 1:N data communication, rather than 1:1 data communication between virtual machines.
[0327] On the other hand, the first virtual machine 520 within the processor 175 may include an input / output server interface 522 and a security manager 526.
[0328] On the other hand, the second virtual machine 530 and the third virtual machine 540 may each include input / output client interfaces 532 and 542, respectively. Thus, high-speed data communication between a plurality of virtual machines can be performed using the input / output server interface 522 and the input / output client interfaces 532 and 542.
[0329] The input / output server interface 522 in the first virtual machine 520 receives the same data transmission request from the input / output client interfaces 532 and 542 in the second virtual machine 530 and the third virtual machine 540, and based on this, transmits the shared data to the shared memory 508 through the security manager 526.
[0330] Figure 14A A more detailed diagram illustrating the transfer of shared data is provided.
[0331] Referring to the accompanying drawings, in order to share data transmission, the input / output server interface 522 in the first virtual machine 520 transmits an allocation request for shared memory 508 to the security manager 526 (step S1).
[0332] Next, the security manager 526 can use the virtual monitor 505 to allocate shared memory 508 (step S2) and record shared data in shared memory 508.
[0333] On the other hand, after allocating the shared memory 508, the input / output client interfaces 532 and 542 can send a connection request to the input / output server interface 522 (step S3).
[0334] On the other hand, after allocating the shared memory 508, the input / output server interface 522 transmits information about the shared memory 508, including key data, to the input / output client interfaces 532 and 542 (step S4). The key data at this time can be private key data.
[0335] That is, on the other hand, after the shared memory 508 is set, the first virtual machine 520 in the processor 175 can transmit information about the shared memory 508 to the second virtual machine 530 and the third virtual machine 540.
[0336] Next, in order to control distributed processing among virtual machines, the input / output server interface 522 within the first virtual machine 520 can be controlled to generate a command queue for processing instructions or events separately from data (step S5).
[0337] The accompanying diagram illustrates a scenario where a command queue is generated in the command queue buffer 504 within the virtual monitor 505 under the control of the input / output server interface 522. However, it is not limited to this; the command queue can also be generated within the first virtual machine 520 under the control of the input / output server interface 522, instead of the virtual monitor 505.
[0338] Next, each input / output client interface 532, 542 can receive the generated command queue or information about the command queue by accessing the command queue buffer 504 (step S6).
[0339] For example, if the instructions sent to each input / output client interface 532 and 542 are the same, the generated command queues can be the same.
[0340] As another example, when the instructions sent to the various input / output client interfaces 532 and 542 are different from each other, the different command queues can be sent to the various input / output client interfaces 532 and 542.
[0341] Next, each input / output client interface 532, 542 can approach the shared memory 508 based on the received key data (step S5), and copy or read shared data from the shared memory 508 (step S7).
[0342] In particular, when each input / output client interface 532, 542 receives the same shared data, the input / output client interfaces 532, 542 can approach the shared memory 508 (step S5) based on the same command queue and the same key data, and copy or read the shared data from the shared memory 508.
[0343] Thus, the second virtual machine 530 and the third virtual machine 540 can access the shared memory 508 and ultimately share data.
[0344] For example, when the shared data is image data, the second virtual machine 530 and the third virtual machine 540 share the image data, and can eventually display the same shared image synchronously on multiple displays 180a-180b in the vehicle.
[0345] Figure 14B Examples are provided by Figure 14A The system 500 displays the image data received by the second virtual machine 530 through the shared memory 508 on the first display 180a, and displays the image data received by the third virtual machine 540 through the shared memory 508 on the second display 180b.
[0346] exist Figure 14B The example illustrates a scenario where an image 905a displayed on a first display 180a and an image 905b displayed on a second display 180b are synchronized, so that the same images 905a and 905b are displayed at time point T1.
[0347] That is, the image data processed by the first virtual machine 520 within the processor 175 is transferred to the second virtual machine 530 and the third virtual machine 540 via shared memory 508, and the first image 905a displayed on the first display 180a and the second image 905b displayed on the second display 180b can be identical to each other. Thus, the same image can be displayed synchronously on a plurality of displays 180a to 180b within the vehicle.
[0348] On the other hand, the preferred embodiments of the present invention have been described above with reference to the accompanying drawings. However, the present invention is not limited to the specific embodiments described above. Without departing from the technical concept of the present invention as claimed in the claims, those skilled in the art can make various modifications. Such modifications should not be understood separately from the technical concept or prospect of the present invention.
Claims
1. A display device for a vehicle, characterized in that, include: Display, installed in the vehicle; as well as The signal processing device outputs image signals to the display. The signal processing device includes a processor that runs a virtual monitor. The processor generates a first overlay layer based on a first operating system on the virtual monitor, and generates a second overlay layer based on a second operating system on the virtual monitor. The signal processing device controls the display, when a first item within the first overlay layer is selected during the output of the first overlay layer based on the first operating system, to overlay the second overlay layer based on the second operating system onto at least a portion of the first overlay layer. The second overlay layer corresponds to the first project and includes a first application project based on the second operating system. The signal processing device is controlled as follows: If the first application item is selected, the first application screen based on the second operating system is displayed. A first menu area and a second menu area based on the first operating system are displayed on both sides of the first application screen.
2. The vehicle display device according to claim 1, characterized in that, The signal processing device controls the operation to perform harmonic processing on at least a portion of the first overlay layer, and to overlay and display a second overlay layer based on the second operating system in the harmonic processing area.
3. The vehicle display device according to claim 1, characterized in that, The signal processing device is controlled as follows: During the output of a plurality of first overlays based on the first operating system, a second overlay based on the second operating system is overlaid on any one of the plurality of first overlays.
4. The vehicle display device according to claim 1, characterized in that, The first overlay layer includes at least one application based on the first operating system. The second overlay layer includes at least one application based on the second operating system.
5. The vehicle display device according to claim 1, characterized in that, The first overlay layer includes a menu and a plurality of application items based on the first operating system. The second overlay layer includes at least one application based on the second operating system.
6. The vehicle display device according to claim 1, characterized in that, When an application viewing item within the first overlay layer is selected during the output of the first overlay layer based on the first operating system, the signal processing device controls the display to overlay a second overlay layer, which includes a plurality of application items based on the second operating system, onto a portion of the first overlay layer.
7. The vehicle display device according to claim 6, characterized in that, When the first application project is selected from the plurality of said application projects The signal processing device is controlled as follows: An overlay related to the first application is displayed in a portion of the area within the first overlay.
8. The vehicle display device according to claim 1, characterized in that, When an application viewing item within the first overlay layer is selected during the output of the first overlay layer based on the first operating system, the signal processing device controls the display to overlay a second overlay layer, including a plurality of application items based on the second operating system, across the entire area within the first overlay layer. When the first application item is selected from the plurality of application items, the signal processing device controls itself to display an overlay layer related to the first application in a portion of the first overlay layer.
9. The vehicle display device according to claim 1, characterized in that, In the process of outputting a first overlay that includes a plurality of application items based on the first operating system, if the first application item based on the second operating system is selected from the plurality of application items, The signal processing device is controlled as follows: A second overlay, including the first application screen based on the second operating system, is displayed over at least a portion of the first overlay.
10. The vehicle display device according to claim 1, characterized in that, The signal processing device controls the inclusion of preview information or messages based on the second operating system in a portion of a first overlay layer based on the first operating system. When the preview information or message is selected, the signal processing device controls the display to show the second overlay layer, which includes the screen corresponding to the preview information or message.
11. The vehicle display device according to claim 10, characterized in that, The signal processing device is controlled as follows: The second overlay, which includes a screen corresponding to the preview information or message based on the second operating system, is displayed over at least a portion of the first overlay.
12. The vehicle display device according to claim 1, characterized in that, The processor runs a server virtual machine based on the first operating system and a client virtual machine that operates for the display based on the second operating system on the virtual monitor.
13. The vehicle display device according to claim 12, characterized in that, The server virtual machine outputs a first overlay layer based on a first operating system. The client virtual machine control is to overlay a second overlay based on the second operating system onto at least a portion of the area of the first overlay.
14. The vehicle display device according to claim 13, characterized in that, The processor transmits the first overlay from the server virtual machine to the client virtual machine via an interface.
15. The vehicle display device according to claim 13, characterized in that, The processor transmits the first overlay from the server virtual machine to the client virtual machine via shared memory within the virtual monitor.
Citation Information
Patent Citations
Menu bar integration in desktop virtualization environments
US10019274B2
Bicycle
US530540A
Information processing apparatus and display control method
CN103279255A
Device and method for for displaying multimode application on vehicle-mounted air conditioner screen
CN111708587A
Separate operating systems for dashboard display
US20200219469A1