Vehicle-mounted three-screen heterogeneous system ai wallpaper generation and synchronization method and device

Abstract

The AI wallpaper generation and synchronization method and device of the vehicle-mounted three-screen heterogeneous system take the prompt word of the voice input of the user as the basis, transport the prompt word to the cloud text-to-image AI after enhancement processing, generate three AI pictures with unified style and respectively adapted to each display screen by the cloud text-to-image AI, and set the instrument screen, the central control screen and the entertainment screen as the wallpaper with the corresponding AI picture as the background after the user confirms. It can be seen that the AI wallpaper generation and synchronization method and device of the vehicle-mounted three-screen heterogeneous system can simultaneously set the wallpaper of the central control screen, the entertainment screen and the instrument screen, the style of the wallpaper of the three display screens is unified, and the wallpaper is generated by the cloud text-to-image AI according to the voice prompt of the user; and the respective rate and the length-width ratio of the wallpaper picture are matched with the respective display screen.

Description

Technical Field

[0001] This invention relates to human-computer interaction technology in automotive intelligent cockpits, and more particularly to a method and apparatus for generating and synchronizing AI wallpapers in a vehicle-mounted three-screen heterogeneous system. Background Technology

[0002] With the development of automotive intelligence, multi-screen heterogeneous architecture has become the mainstream configuration for high-end intelligent cockpits. A typical car's front dashboard alone features three displays: a central control screen in the middle, an entertainment screen on the right, and an instrument cluster screen on the left. Typically, the central control and entertainment screens use the Android system, while the instrument cluster screen uses BlackBerry's QNX microkernel real-time operating system, balancing rich interactivity with operational security. However, due to this multi-screen heterogeneous architecture, the wallpaper functionality of these multiple in-vehicle displays generally suffers from several shortcomings.

[0003] 1. The existing wallpaper changing function only supports single-screen independent operation. Users need to set the central control screen, instrument screen and passenger screen separately. The operation steps are cumbersome and the interactive experience is poor.

[0004] 2. Traditional AI-generated wallpapers are mostly of a single fixed size. When they are cropped and stretched to fit in-vehicle displays with different aspect ratios, problems such as the main subject of the image being shifted, key content being missing, and visual proportion being out of balance are very likely to occur.

[0005] 3. Generating wallpapers for different displays will result in a fragmented style across multiple screens, disrupting the unified visual effect of the entire vehicle cabin;

[0006] 4. Android and QNX are heterogeneous operating systems. They lack an efficient transmission and synchronization mechanism for large images, making it impossible to achieve one-click synchronization of wallpapers across multiple screens. Cross-system data transmission suffers from high latency and poor stability.

[0007] In summary, existing multi-screen heterogeneous architecture systems cannot meet users' needs for achieving unified style across three screens and simultaneous AI wallpaper changes through simple operations. New technical solutions are urgently needed to address these shortcomings. Summary of the Invention

[0008] To address the above issues, this invention proposes a method and apparatus for generating and synchronizing AI wallpapers in a vehicle-mounted three-screen heterogeneous system.

[0009] The present invention provides a method for generating and synchronizing AI wallpapers in a vehicle-mounted three-screen heterogeneous system, comprising the following steps:

[0010] S1: The user inputs relevant prompts about the theme and style of the desired wallpaper through the in-vehicle voice input system, and the relevant prompts are converted into text string data;

[0011] S2: Perform prompt enhancement processing on the text string data, including: supplementing style qualifiers, usage qualifiers, and quantity and consistency qualifiers to form complete prompt words; simultaneously, obtain the parameters of the three displays in the vehicle system; using the complete prompt words and the parameters of the three displays as generation conditions, call the cloud-based text-to-image AI to generate three AI images with a unified style and adapted to each display screen respectively; the three displays in the vehicle system are the central control screen, the entertainment screen, and the instrument panel screen; the display screen parameters are resolution and aspect ratio;

[0012] S3: Download the three AI images generated by the cloud-based Wenshengtu AI to the memory cache, mark the display screen number corresponding to each AI image, and preview them on the central control screen interface; after the user confirms the settings, save the three AI images to local storage;

[0013] S4: Write the AI ​​image of the instrument panel of the QNX system corresponding to the microkernel real-time operating system into the shared memory area between the Android system and the QNX system, and send the address of the memory area to the QNX system through the inter-board virtual Ethernet; The QNX system reads the wallpaper data, saves it locally and sets it as the wallpaper of the instrument panel, and sends a successful setting feedback to the Android system after completion;

[0014] S5: After receiving feedback that the QNX system wallpaper has been successfully set, the Android system creates a ContentProvider component within the Android system to share the two AI images corresponding to the central control screen and the entertainment screen; it notifies the Launcher desktop application of the Android system to obtain the AI ​​images through the ContentProvider component and set them as the wallpapers of the display screen and the entertainment screen, thus completing the synchronized setting of the wallpapers on the three displays.

[0015] Furthermore, in step S2, the text string data is enhanced with prompt words, including: supplementing with keywords such as high-definition image quality, in-vehicle wallpaper, adapted to car display screens, generating three images, and having a unified style but slightly different content, to ensure that the generated images meet the requirements of in-vehicle usage scenarios and style consistency; the resolutions of the central control screen, entertainment screen and instrument screen are 2348×1080, 3840×720 and 3840×720, respectively.

[0016] Furthermore, the inter-board virtual Ethernet described in step S4 uses the application layer communication protocol SOME / IP protocol stack and adopts a custom lightweight protocol with checksum and retry mechanism to ensure reliable cross-system command and data transmission.

[0017] The present invention relates to an AI wallpaper generation and synchronization device for a vehicle-mounted three-screen heterogeneous system, which embeds an AI wallpaper application module in the vehicle-mounted Android system and a QNX wallpaper service module in the vehicle-mounted QNX system.

[0018] The AI ​​wallpaper application module includes:

[0019] Voice integration module: capable of receiving wallpaper prompts input by the user via voice and converting them into text string data;

[0020] Image generation module: This module receives text string data and performs prompt enhancement processing, including: supplementing style qualifiers, usage qualifiers, and quantity and consistency qualifiers to form complete prompts; acquiring parameters of the three displays in the vehicle system; and using the complete prompts and the parameters of the three displays as generation conditions, calling cloud-based text-to-image AI to generate three AI images with a unified style and adapted to the parameters of each display; the three displays in the vehicle system are the central control screen, the entertainment screen, and the instrument panel screen; the display parameters are resolution and aspect ratio.

[0021] Image management module: It can download AI images generated by cloud-based Wenshengtu AI and mark them with display screen numbers, preview and display them on the central control screen interface, save AI images to local storage in response to user commands, and trigger the wallpaper setting module;

[0022] Cross-system communication module: It can provide information interaction between Android system and QNX system, write the AI ​​image of the corresponding QNX system instrument screen into the shared memory area between Android and QNX system, obtain the memory address and send it to QNX wallpaper service module; at the same time, it listens for the feedback message of QNX wallpaper service module to complete the setting.

[0023] Wallpaper setting module: It can interact with the QNX wallpaper service module through the cross-system communication module. After receiving feedback from the QNX wallpaper service module that the wallpaper has been successfully set, it creates a ContentProvider component in the Android system to share AI images from the central control screen and the passenger screen. It also notifies the Launcher desktop application in the Android system to obtain the AI ​​images through the ContentProvider component and set them as the wallpapers for the display screen and the entertainment screen, thus completing the synchronized wallpaper settings for the three displays.

[0024] The QNX wallpaper service module can interact with the AI ​​wallpaper application module through inter-board virtual Ethernet communication; it receives the shared memory address of the AI ​​image from the instrument panel, reads and saves the AI ​​image to the QNX system's local storage space; then, it sets the AI ​​image as the instrument panel wallpaper, and sends a successful setting feedback to the Android system through inter-board virtual Ethernet communication.

[0025] Furthermore, embedding the AI ​​wallpaper application module in the vehicle Android system refers to developing the AI ​​wallpaper application module into an AI wallpaper application APP and then installing it into the vehicle Android system; embedding the QNX wallpaper service module in the vehicle QNX system refers to developing the QNX wallpaper service module into a QNX wallpaper service APP and then installing it into the vehicle QNX system.

[0026] Furthermore, the AI ​​wallpaper application module is also equipped with a rollback unit, which is used to restore the display screen to the last used wallpaper when the wallpaper setting fails abnormally.

[0027] The beneficial technical effects of the present invention, the AI ​​wallpaper generation and synchronization method and device for a three-screen heterogeneous vehicle system, are that it can simultaneously set wallpapers for the central control screen, entertainment screen and instrument panel, and the wallpapers set for the three displays have a unified style and are generated by cloud-based text-to-image AI according to the user's voice prompts; furthermore, the resolution and aspect ratio of the wallpaper images are matched to their respective displays. Attached Figure Description

[0028] Appendix Figure 1 This is a schematic diagram of the architecture of the AI ​​wallpaper generation and synchronization device for the in-vehicle three-screen heterogeneous system of the present invention;

[0029] Appendix Figure 2 This is a schematic diagram of the structure of the AI ​​wallpaper application module of the present invention;

[0030] Appendix Figure 3 This is a timing diagram of the AI ​​wallpaper generation and synchronization method and device for the in-vehicle three-screen heterogeneous system of the present invention.

[0031] The method and apparatus for generating and synchronizing AI wallpapers in a vehicle-mounted three-screen heterogeneous system of the present invention will be further described below with reference to the accompanying drawings and specific embodiments. Detailed Implementation

[0032] The present invention provides a method for generating and synchronizing AI wallpapers in a vehicle-mounted three-screen heterogeneous system, comprising the following steps:

[0033] S1: The user inputs relevant prompts about the theme and style of the desired wallpaper through the in-vehicle voice input system, and the relevant prompts are converted into text string data;

[0034] S2: Perform prompt enhancement processing on the text string data, including: supplementing style qualifiers, usage qualifiers, quantity and consistency qualifiers to form complete prompt words; simultaneously, obtain the parameters of the three displays in the vehicle system; using the complete prompt words and the parameters of the three displays as generation conditions, call the cloud-based text-to-image AI to generate three AI images with a unified style and adapted to the parameters of each display; the three displays in the vehicle system are the central control screen, the entertainment screen, and the instrument panel screen; the display parameters are resolution and aspect ratio;

[0035] S3: Download the three AI images generated by the cloud-based Wenshengtu AI to the memory cache, mark the display screen number corresponding to each AI image, and preview them on the central control screen interface; after the user confirms the settings, save the three AI images to local storage;

[0036] S4: Write the AI ​​image of the instrument panel of the QNX system corresponding to the microkernel real-time operating system into the shared memory area between the Android system and the QNX system, and send the address of the memory area to the QNX system through the inter-board virtual Ethernet; The QNX system reads the wallpaper data, saves it locally and sets it as the wallpaper of the instrument panel, and sends a successful setting feedback to the Android system after completion;

[0037] S5: After receiving feedback that the QNX system wallpaper has been successfully set, the Android system creates a ContentProvider component within the Android system to share the two AI images corresponding to the central control screen and the entertainment screen; it notifies the Launcher desktop application of the Android system to obtain the AI ​​images through the ContentProvider component and set them as the wallpapers of the display screen and the entertainment screen, thus completing the synchronized setting of the wallpapers on the three displays.

[0038] This invention provides an AI wallpaper generation and synchronization method for a three-screen heterogeneous vehicle system. Based on user voice input prompts, the prompts are enhanced and then sent to a cloud-based text-to-image AI. This cloud-based AI generates three AI images with a unified style, each adapted to one of the displays. After user confirmation, the instrument panel, central control screen, and entertainment screen are set as wallpapers with the corresponding AI images as backgrounds. Therefore, this invention's AI wallpaper generation and synchronization method for a three-screen heterogeneous vehicle system can simultaneously set wallpapers for the central control screen, entertainment screen, and instrument panel. The wallpapers for the three displays have a unified style and are generated by the cloud-based text-to-image AI based on the user's voice prompts; furthermore, the resolution and aspect ratio of the wallpaper images are matched to their respective displays.

[0039] As one of the preferred technical solutions, step S2 involves enhancing the text string data with prompts, including: adding keywords such as high-definition image quality, in-vehicle wallpaper, adaptation to car displays, generating three images, and ensuring that the generated images meet the requirements of in-vehicle usage scenarios and style consistency; the resolutions of the three displays in the in-vehicle system are 2348×1080, 3840×720, and 3840×720, respectively. The prompts for the user are further enhanced, ensuring that the three AI images have a consistent style with subtle differences, making them more suitable for in-vehicle usage scenarios.

[0040] As one of the preferred technical solutions, the inter-board virtual Ethernet described in step S4 uses the SOME / IP application layer communication protocol stack, employing a custom lightweight protocol with checksum and retry mechanisms to ensure reliable cross-system command and data transmission. The SOME / IP application layer communication protocol is a service-oriented communication protocol specifically designed for automobiles; its full name is "IP-based Scalable Service-Oriented Middleware," primarily used in in-vehicle Ethernet to enable efficient data exchange between electronic control units (ECUs) within the vehicle. This invention's method for generating and synchronizing AI wallpapers in a heterogeneous in-vehicle three-screen system involves information interaction between the Android system and the QNX system, as well as information interaction between the invention's dedicated module and the Android or QNX system. Using SOME / IP not only ensures convenience and reliability but also guarantees the speed and security of data transmission.

[0041] See appendix Figure 1 , 2 3. The AI ​​wallpaper generation and synchronization device for the in-vehicle three-screen heterogeneous system of the present invention embeds an AI wallpaper application module in the in-vehicle Android system and a QNX wallpaper service module in the in-vehicle QNX system.

[0042] The AI ​​wallpaper application module includes:

[0043] Voice integration module: capable of receiving wallpaper prompts input by the user via voice and converting them into text string data;

[0044] Image generation module: This module receives text string data and performs prompt enhancement processing, including: supplementing style qualifiers, usage qualifiers, and quantity and consistency qualifiers to form complete prompts; acquiring parameters of the three displays in the vehicle system; using the complete prompts and the parameters of the three displays as generation conditions, calling the cloud-based text-to-image interface to generate three AI images with a unified style and adapted to each display; the three displays in the vehicle system are the central control screen, the entertainment screen, and the instrument panel screen; the display parameters are resolution and aspect ratio.

[0045] Image management module: It can download AI images generated by the cloud-based image processing interface, mark the display screen number, preview and display them on the central control screen interface, save the AI ​​images to local storage in response to user commands, and trigger the wallpaper setting module;

[0046] Cross-system communication module: It can provide information interaction between Android system and QNX system, write the AI ​​image of the corresponding QNX system instrument screen into the shared memory area between Android and QNX system, obtain the memory address and send it to QNX wallpaper service module; at the same time, it listens for the feedback message of QNX wallpaper service module to complete the setting.

[0047] Wallpaper setting module: It can interact with the QNX wallpaper service module through the cross-system communication module. After receiving feedback from the QNX wallpaper service module that the wallpaper has been successfully set, it creates a ContentProvider component in the Android system to share AI images from the central control screen and the passenger screen. It also notifies the Launcher desktop application in the Android system to obtain the AI ​​images through the ContentProvider component and set them as the wallpapers for the display screen and the entertainment screen, thus completing the synchronized wallpaper settings for the three displays.

[0048] The QNX wallpaper service module can interact with the AI ​​wallpaper application module through inter-board virtual Ethernet communication; it receives the shared memory address of the AI ​​image from the instrument panel, reads and saves the AI ​​image to the QNX system's local storage space; then, it sets the AI ​​image as the instrument panel wallpaper, and sends a successful setting feedback to the Android system through inter-board virtual Ethernet communication.

[0049] This invention proposes an AI wallpaper generation and synchronization device for a three-screen heterogeneous vehicle system, specifically designed for the method of this invention. The design makes full use of the existing functions or functional units of the vehicle Android system and QNX system, without requiring any additional hardware facilities. While ensuring that the technical effects of this invention can be achieved, it minimizes the impact on the existing functions or functional units of the vehicle Android system and QNX system, so as to ensure that the existing functions or functional units of the vehicle Android system and QNX system can operate accurately and reliably.

[0050] As one of the preferred technical solutions, embedding the AI ​​wallpaper application module in the in-vehicle Android system refers to developing the AI ​​wallpaper application module into an AI wallpaper application APP and then installing it into the in-vehicle Android system; embedding the QNX wallpaper service module in the in-vehicle QNX system refers to developing the QNX wallpaper service module into a QNX wallpaper service APP and then installing it into the in-vehicle QNX system. By embedding the relevant modules of this invention into the in-vehicle Android system and the QNX system using application software (APP), the accurate and reliable operation of the original functions or functional units of the in-vehicle Android system and the QNX system can be fully guaranteed; at the same time, the necessary operating functions of this invention are added.

[0051] As a preferred technical solution, the AI ​​wallpaper application module is also equipped with a rollback unit, which is used to restore the display screen to the last used wallpaper when the wallpaper setting fails abnormally. The rollback unit ensures that in the event of an unexpected event during the wallpaper setting process, such as a sudden power outage or network loss, the three displays can be restored to their original state, guaranteeing the normal operation of the three displays.

[0052] Obviously, the beneficial technical effect of the AI ​​wallpaper generation and synchronization method and device for the in-vehicle three-screen heterogeneous system of the present invention is that it can set wallpapers for the central control screen, entertainment screen and instrument panel at the same time. The wallpapers set for the three screens have a unified style and are generated by cloud-based text-to-image AI according to the user's voice prompts. Furthermore, the resolution and aspect ratio of the wallpaper images are matched to their respective screens.

Claims

1. A method for generating and synchronizing AI wallpapers in a vehicle-mounted three-screen heterogeneous system, characterized in that, The method includes the following steps: S1: The user inputs relevant prompts about the theme and style of the desired wallpaper through the in-vehicle voice input system, and the relevant prompts are converted into text string data; S2: Perform prompt enhancement processing on the text string data, including: supplementing style qualifiers, usage qualifiers, and quantity and consistency qualifiers to form complete prompt words; simultaneously, obtain the parameters of the three displays in the vehicle system; using the complete prompt words and the parameters of the three displays as generation conditions, call the cloud-based text-to-image AI to generate three AI images with a unified style and adapted to each display screen respectively; the three displays in the vehicle system are the central control screen, the entertainment screen, and the instrument panel screen; the display screen parameters are resolution and aspect ratio; S3: Download the three AI images generated by the cloud-based Wenshengtu AI to the memory cache, mark the display screen number corresponding to each AI image, and preview them on the central control screen interface; after the user confirms the settings, save the three AI images to local storage; S4: Write the AI ​​image of the instrument panel of the QNX system corresponding to the microkernel real-time operating system into the shared memory area between the Android system and the QNX system, and send the address of the memory area to the QNX system through the inter-board virtual Ethernet; The QNX system reads the wallpaper data, saves it locally and sets it as the wallpaper of the instrument panel, and sends a successful setting feedback to the Android system after completion; S5: After receiving feedback that the QNX system wallpaper has been successfully set, the Android system creates a ContentProvider component within the Android system to share the two AI images corresponding to the central control screen and the entertainment screen; it notifies the Launcher desktop application of the Android system to obtain the AI ​​images through the ContentProvider component and set them as the wallpapers of the display screen and the entertainment screen, thus completing the synchronized setting of the wallpapers on the three displays.

2. The method for generating and synchronizing AI wallpapers in a vehicle-mounted three-screen heterogeneous system according to claim 1, characterized in that, In step S2, the text string data is enhanced with prompt words, including: adding keywords such as high-definition image quality, in-vehicle wallpaper, adapting to car display screens, generating three images, and having a unified style but slight differences in content, to ensure that the generated images meet the requirements of in-vehicle usage scenarios and style consistency; the resolutions of the central control screen, entertainment screen and instrument screen are 2348×1080, 3840×720 and 3840×720, respectively.

3. The method for generating and synchronizing AI wallpapers in a vehicle-mounted three-screen heterogeneous system according to claim 1, characterized in that, The inter-board virtual Ethernet described in step S4 uses the application layer communication protocol SOME / IP protocol stack and adopts a custom lightweight protocol with checksum and retry mechanism to ensure reliable cross-system command and data transmission.

4. A vehicle-mounted three-screen heterogeneous system AI wallpaper generation and synchronization device, characterized in that, Generating and synchronizing AI wallpapers for a vehicle-mounted three-screen heterogeneous system using the method described in any one of claims 1 to 3 includes: embedding an AI wallpaper application module in a vehicle-mounted Android system and embedding a QNX wallpaper service module in a vehicle-mounted QNX system; The AI ​​wallpaper application module includes: Voice integration module: capable of receiving wallpaper prompts input by the user via voice and converting them into text string data; Image generation module: This module receives text string data and performs prompt enhancement processing, including: supplementing style qualifiers, usage qualifiers, and quantity and consistency qualifiers to form complete prompts; acquiring parameters of the three displays in the vehicle system; and using the complete prompts and the parameters of the three displays as generation conditions, calling cloud-based text-to-image AI to generate three AI images with a unified style and adapted to the parameters of each display; the three displays in the vehicle system are the central control screen, the entertainment screen, and the instrument panel screen; the display parameters are resolution and aspect ratio. Image management module: It can download AI images generated by cloud-based Wenshengtu AI and mark them with display screen numbers, preview and display them on the central control screen interface, save AI images to local storage in response to user commands, and trigger the wallpaper setting module; Cross-system communication module: It can provide information interaction between Android system and QNX system, write the AI ​​image of the corresponding QNX system instrument screen into the shared memory area between Android and QNX system, obtain the memory address and send it to QNX wallpaper service module; at the same time, it listens for the feedback message of QNX wallpaper service module to complete the setting. Wallpaper setting module: It can interact with the QNX wallpaper service module through the cross-system communication module. After receiving feedback from the QNX wallpaper service module that the wallpaper has been successfully set, it creates a ContentProvider component in the Android system to share AI images from the central control screen and the passenger screen. It also notifies the Launcher desktop application in the Android system to obtain the AI ​​images through the ContentProvider component and set them as the wallpapers for the display screen and the entertainment screen, thus completing the synchronized wallpaper settings for the three displays. The QNX wallpaper service module can interact with the AI ​​wallpaper application module through inter-board virtual Ethernet communication; it receives the shared memory address of the AI ​​image from the instrument panel, reads and saves the AI ​​image to the QNX system's local storage space; then, it sets the AI ​​image as the instrument panel wallpaper, and sends a successful setting feedback to the Android system through inter-board virtual Ethernet communication.

5. The in-vehicle three-screen heterogeneous system AI wallpaper generation and synchronization device according to claim 4, characterized in that, The embedding of the AI ​​wallpaper application module in the vehicle Android system refers to developing the AI ​​wallpaper application module into an AI wallpaper application APP and then installing it into the vehicle Android system; the embedding of the QNX wallpaper service module in the vehicle QNX system refers to developing the QNX wallpaper service module into a QNX wallpaper service APP and then installing it into the vehicle QNX system.

6. The in-vehicle three-screen heterogeneous system AI wallpaper generation and synchronization device according to claim 4 or 5, characterized in that, The AI ​​wallpaper application module is also equipped with a rollback unit, which is used to restore the display screen to the last used wallpaper when the wallpaper setting fails abnormally.

Images