Interface display method and vehicle

By acquiring audio information and vehicle status and dynamically rendering the in-vehicle display interface, the problem of mismatch between audio and interface display in existing technologies is solved, and the user's driving experience and the flexibility and immersion of the interface display are improved.

CN120631488APending Publication Date: 2025-09-12GREAT WALL MOTOR CO LTD
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202510754463.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-06-06
Publication Date
2025-09-12

AI Technical Summary

Technical Problem

Existing in-car music playback systems cannot effectively match audio and interface displays, resulting in a poor driving experience for users and an inability to create an immersive listening environment.

Method used

By obtaining the audio information of the target audio, determining the target elements to be displayed, and combining them with the background image for image rendering, a display interface matching the audio is generated. The background image and elements are dynamically updated to reflect the external environment and vehicle status, enhancing the flexibility and immersion of the interface display.

Benefits of technology

It improves the display flexibility and immersiveness of the audio playback interface, enhances the user's driving experience, and improves the user's operating efficiency and fun through interaction with vehicle status through visual and dynamic effects.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120631488A_ABST
    Figure CN120631488A_ABST
Patent Text Reader

Abstract

The invention provides an interface display method and a vehicle, and relates to the field of vehicles. The method comprises the steps that under the condition that an audio playing instruction is received, a background image and a currently-played target audio are acquired, and the audio playing instruction is used for indicating playing of the target audio; determining a to-be-displayed target element based on the audio information of the target audio; performing image rendering based on the background image and the target element to generate a target display interface; the target display interface is displayed, and the target display interface is a playing display interface of the target audio. According to the method, a more real song listening environment can be created for the user in the vehicle, the display flexibility of the audio playing interface is improved, and then the driving experience of the user is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of vehicles, and more specifically, to an interface display method and a vehicle in the field of vehicles. Background Art

[0002] While driving, most users will need to play audio, such as music, podcasts, and news. Existing in-car music players only display basic music information, such as lyrics and cover art, on the car's display. The mismatch between the audio playback and the interface is poor, failing to create a realistic listening environment for users in the vehicle cabin.

[0003] Therefore, how to create a real music listening environment for users in the car and improve their driving experience is an urgent problem to be solved. Summary of the Invention

[0004] The present application provides an interface display method and a vehicle, which can create a real music listening environment for users in the car and enhance the user's driving experience.

[0005] In a first aspect, a method for displaying an interface is provided, the method comprising:

[0006] When an audio playback instruction is received, obtaining a background image and a target audio currently being played, wherein the audio playback instruction is used to instruct to play the target audio;

[0007] Determining a target element to be displayed based on audio information of the target audio;

[0008] Perform image rendering based on the background image and target elements to generate a target display interface;

[0009] The target display interface is displayed, wherein the target display interface is a playback display interface of the target audio.

[0010] In the above technical solution, when an audio playback instruction for instructing to play the target audio is received, the background image and the target audio currently being played are obtained, and the target element to be displayed is determined based on the audio information of the target audio; then, image rendering is performed in combination with the background image and the target element to generate a playback display interface for the target audio to be displayed, and the playback display interface is displayed. Compared with the prior art of selecting wallpapers that match the audio from pre-stored wallpapers, the present application analyzes the audio information of the target audio, determines the elements that match the audio information, and performs image rendering in combination with the background image to obtain a display interface. This can improve the degree of matching between the audio playback interface and the target audio, display an interface that corresponds one-to-one to the target audio, and improve the display flexibility of the audio playback interface. This creates a more immersive visual experience for users during audio playback, meets users' needs for audio-visual integration, and enhances the driving experience of users in the car.

[0011] In conjunction with the first aspect, in some possible implementations, the method further includes:

[0012] Acquiring current target information, wherein the target information includes at least one of time information, weather information, and season information;

[0013] updating the background image based on the target information to obtain an updated background image;

[0014] Image rendering is performed based on the background image and the target element to generate the target display interface, including:

[0015] Image rendering is performed based on the updated background image and the target element to generate a target display interface.

[0016] In the above technical solution, the existing background image is updated in combination with at least one of the current time information, weather information and seasonal information, so that the updated background image can match the current external vehicle environment information; then, the image is rendered in combination with the updated background image and the target element to obtain a target display interface. While displaying elements matching the audio information to the user, the background image matching the real environment is displayed to the user, so that the user can perceive the environment outside the vehicle through the audio playback interface, thereby improving the user's interaction efficiency and further improving the intelligence and flexibility of the interface display.

[0017] In combination with the first aspect and the above implementation manner, in some possible implementation manners, the method further includes:

[0018] Acquiring vehicle parameters of the vehicle, wherein the vehicle parameters include operating parameters of the vehicle air conditioner and / or driving parameters of the vehicle;

[0019] Based on the vehicle parameters, the motion parameters of the target element are determined, wherein the motion parameters include motion frequency and / or motion direction.

[0020] In the above technical solution, the movement frequency and / or movement direction of the target elements in the display interface are determined according to the working parameters of the vehicle's air conditioner and / or the vehicle's driving parameters, and the vehicle's functional data is converted into a visual visual interaction language, so that the dynamic effects displayed on the interface are consistent with the driving scene, thereby enhancing the fun of vehicle-computer interaction without affecting the vehicle's driving safety, and further improving the flexibility of the interface display during audio playback.

[0021] In combination with the first aspect and the above implementations, in some possible implementations, the operating parameters of the vehicle air conditioner include air volume, wind speed, and wind direction. Based on the vehicle parameters, determining the display animation of the target element includes:

[0022] Determining the movement frequency of the target element based on the air volume and / or wind speed of the vehicle air conditioner; and / or,

[0023] Determine the movement direction of the target element based on the wind direction of the car air conditioner.

[0024] In this technical solution, the vehicle air conditioner's operating parameters, such as air volume, speed, and direction, are bound to the target element's motion frequency and direction, allowing the display interface to display dynamic elements and enhancing the interface's agility. As the user adjusts the air conditioner's operating parameters, the target element on the display interface moves accordingly, enhancing the user's sense of realism and immersion, thereby increasing the flexibility and fun of the interface display during music playback.

[0025] In combination with the first aspect and the above implementations, in some possible implementations, the vehicle's driving parameters include driving speed and the vehicle's steering direction. Determining the display animation of the target element based on the vehicle parameters includes:

[0026] Determining the movement frequency of the target element based on the vehicle's speed; and / or,

[0027] Based on the steering direction of the vehicle, the movement direction of the target element is determined.

[0028] In the above technical solution, dynamic parameters such as vehicle speed and steering direction are combined with the motion frequency, direction and other dynamic effects of the target element, and the vehicle speed information is converted into a visual motion frequency, thereby enhancing the user's speed perception through visual dynamic effects; the vehicle steering is converted into a target element to obtain the motion direction, thereby enhancing the visualization of the steering operation, thereby improving the flexibility and fun of the interface display during music playback.

[0029] In combination with the first aspect and the above implementation manner, in some possible implementation manners, the method further includes:

[0030] Determining a target scene corresponding to the target audio based on audio information of the target audio;

[0031] Determine the control parameters of the vehicle's cabin equipment based on the target scenario;

[0032] Based on the control parameters, the cockpit equipment is controlled.

[0033] In the above technical solution, the audio information of the target audio is analyzed to obtain the target scene described by the target audio; then, according to the target scene, the control parameters for controlling the cockpit equipment can be determined, thereby controlling the cockpit equipment in the car and improving the flexibility of controlling the cockpit equipment; the vehicle-mounted equipment is linked to create a more immersive listening experience for users and enhance the user's sense of scene involvement during audio playback.

[0034] In combination with the first aspect and the above implementation manner, in some possible implementation manners, the method further includes:

[0035] When receiving the instruction to turn on the audio playback function, obtain the historical playback audio and the current time period. The historical playback audio is the audio played before the audio playback function was last turned off.

[0036] Based on the current time period, determine a recommended audio set corresponding to the current time period;

[0037] Displays historically played audio and recommended audio collections.

[0038] In the above technical solution, the historical audio played before the user turned off the audio playback function for the last time is stored; when the audio playback function is turned on next time, the stored historical audio can be displayed, and the user can resume playing the historical audio through the display interface, avoiding the user's repeated search operations and improving the user's operating efficiency; at the same time, combined with the current time period, the corresponding recommended audio set is determined, and the recommended audio set is displayed to improve the fit between the audio playback and the current time period scene, thereby improving the flexibility of vehicle audio playback.

[0039] In combination with the first aspect and the above implementation, in some possible implementations, the audio information of the target audio includes an audio name and audio content, and determining the target element to be displayed based on the audio information of the target audio includes:

[0040] Determine whether the audio name has a corresponding first candidate element;

[0041] If there is a corresponding first candidate element for the audio name, determining the first candidate element as a target element to be displayed;

[0042] In the case that there is no corresponding first candidate element for the audio name, a target element to be displayed is determined based on the audio content.

[0043] In the above technical solution, it is first determined whether there is a corresponding first candidate element based on the audio name of the target audio; if the first candidate element exists, the first candidate element is directly determined as the target element to be displayed, without the need for further semantic analysis of a large amount of audio content, which can improve the efficiency of determining the target element, and then the target display interface can be quickly rendered and generated, thereby improving the efficiency of the interface display corresponding to the target audio; if the first candidate element does not exist, the target element is further determined based on the audio content of the target audio to ensure that the elements displayed in the interface match the audio content of the target audio, thereby enhancing the immersion of the audio playback interface.

[0044] In combination with the first aspect and the above implementations, in some possible implementations, determining the target element to be displayed based on the audio content includes:

[0045] Sorting the occurrence frequencies of the second candidate elements corresponding to the audio content of the target audio to obtain a ranking result of the second candidate elements;

[0046] Based on the ranking result of the second candidate elements, a target element is determined.

[0047] In the above technical solution, when there is no candidate element corresponding to the audio name, the frequency of occurrence of the second candidate element corresponding to the audio content of the target audio is sorted, and the target element to be displayed is determined based on the sorting result. By counting the frequency of occurrence of the corresponding candidate elements in the audio content, the theme focus of the audio can be directly reflected. The target element is determined based on the sorting result of the frequency of occurrence, and the elements displayed on the interface can be matched with the currently playing target audio, allowing users to more intuitively experience the audio details through visual assistance, thereby enhancing the immersion during audio playback.

[0048] In a second aspect, an interface display device is provided, the device comprising:

[0049] an acquisition module, configured to acquire a background image and a currently playing target audio upon receiving an audio playback instruction, wherein the audio playback instruction is used to instruct the target audio to be played;

[0050] An element determination module, configured to determine a target element to be displayed based on audio information of the target audio;

[0051] An interface generation module is used to perform image rendering based on the background image and the target element to generate a target display interface;

[0052] The interface display module is used to display a target display interface, wherein the target display interface is a playback display interface of a target audio.

[0053] In a third aspect, a vehicle is provided, comprising a memory and a processor. The memory is configured to store executable program code, and the processor is configured to retrieve and execute the executable program code from the memory, so that the vehicle executes the method of the first aspect or any possible implementation of the first aspect.

[0054] In a fourth aspect, a computer program product is provided, comprising: a computer program code, which, when executed on a computer, enables the computer to execute the method in the first aspect or any possible implementation of the first aspect.

[0055] In a fifth aspect, a computer-readable storage medium is provided, which stores a computer program code. When the computer program code runs on a computer, the computer executes the method in the above-mentioned first aspect or any possible implementation of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0056] Figure 1 This is a schematic diagram of a vehicle central control screen provided in an embodiment of the present application;

[0057] Figure 2 is a schematic diagram of an audio playback interface provided in an embodiment of the present application;

[0058] Figure 3 This is a schematic flow chart of an interface display method provided in an embodiment of the present application;

[0059] Figure 4 is a schematic diagram of a background image provided in an embodiment of the present application;

[0060] Figure 5 is a schematic diagram of a target display interface provided in an embodiment of the present application;

[0061] Figure 6 is a schematic diagram of another target display interface provided in an embodiment of the present application;

[0062] Figure 7 This is a schematic diagram of a target display interface according to an embodiment of the present application showing changes in information over time;

[0063] Figure 8 This is a schematic diagram of a target element in dynamic motion provided by an embodiment of the present application;

[0064] Figure 9 This is a schematic diagram of an interface in a 5D listening mode provided by an embodiment of the present application;

[0065] Figure 10 This is a schematic diagram of an interface for historically played audio and recommended audio provided by an embodiment of the present application;

[0066] Figure 11 is a schematic flow chart of another interface display method provided in an embodiment of the present application;

[0067] Figure 12 This is a structural diagram of an interface display device provided in an embodiment of the present application;

[0068] Figure 13 It is a structural schematic diagram of a vehicle provided in an embodiment of the present application. DETAILED DESCRIPTION

[0069] The following will clearly and thoroughly describe the technical solutions in this application in conjunction with the accompanying drawings. In the description of the embodiments of this application, unless otherwise specified, " / " means or, for example, A / B can mean A or B: "and / or" in the text is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of this application, "multiple" means two or more than two.

[0070] In the following, the terms "first" and "second" are used for descriptive purposes only and should not be understood to imply or suggest relative importance or implicitly indicate the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features.

[0071] While driving, after satisfying their basic car-mounted computer functional needs, users will continue to pursue spiritual satisfaction for a more comfortable driving experience. Audio playback through the car's display is one way to create a leisure and entertainment atmosphere for users, and audio playback is a high-frequency demand for most users while traveling.

[0072] To meet the entertainment needs of users in different positions within the vehicle cabin, vehicles are typically equipped with one or more in-vehicle displays. These include a central control screen, a passenger entertainment screen, a display mounted behind the front seats, or a ceiling-mounted screen. These in-vehicle displays allow users to play audio and video, among other functions.

[0073] Figure 1 This is a scene diagram of a vehicle central control screen provided in an embodiment of the present application.

[0074] For example, Figure 1As shown in scene 100 in the figure, scene 100 includes the vehicle's central control screen 101, which provides users with software for communication, audio playback, video playback, and vehicle settings. After the user clicks the software icon or launches the software through voice control, central control screen 101 will display the software interface. For example, after the user launches the audio playback software, central control screen 101 will display the audio playback interface.

[0075] Existing car entertainment systems provide users with self-developed audio playback software or third-party audio software downloaded from the Internet. During audio playback using existing audio playback software, the audio playback interface is usually a fixed preset interface. Figure 2 is a schematic diagram of an audio playback interface provided by an embodiment of the present application, such as Figure 2 As shown in (a), the user sets the wallpaper of the audio playback interface as wallpaper 201 according to his or her own preferences in advance. After the user turns on the audio playback function, the interface is displayed on the central control screen 101 with wallpaper 201 according to the parameters set by the user; or Figure 2 As shown in (b), the audio cover image 202 is processed and used as the wallpaper of the audio playback interface. However, the display method of this audio playback interface is relatively monotonous, the visual appeal of the interface is low, and long-term display may cause visual fatigue to the user, and it is impossible to create an immersive listening environment for the user.

[0076] In order to associate the music playback interface with the music, the existing technology also proposes to select wallpapers that match the music from a pre-stored wallpaper library for display based on the mood and rhythm of the music. Although different playback wallpapers can be displayed for different music styles, due to the limitations of the wallpaper library and the variety of music styles, it is impossible to determine a one-to-one corresponding playback interface for each audio segment, and the display flexibility of the audio playback interface is low.

[0077] In view of the problems existing in the prior art, this application provides an interface display method. When receiving a user's audio playback instruction for a target audio, the method obtains a background image and the currently playing target audio, determines the corresponding target element to be displayed based on the audio information of the target audio, and then combines the background image and the target element for image rendering to generate a target display interface that matches the target audio, and then displays the target display interface. This method can create a more realistic listening environment for users in the car, improve the display flexibility of the audio playback interface, and thus enhance the user's driving experience.

[0078] The following combination Figures 3 to 11 The interface display method provided in the embodiment of the present application is described in detail.

[0079] Figure 3This is a schematic flow chart of an interface display method provided by an embodiment of the present application. It should be understood that this method can be applied to a vehicle; or to a processor in a vehicle; or to a chip in a processor mounted in a vehicle.

[0080] For example, Figure 3 As shown, the method 300 includes:

[0081] S301 , upon receiving an audio play instruction, obtaining a background image and a currently playing target audio, wherein the audio play instruction is used to instruct to play the target audio.

[0082] The background image may be a desktop background image of a display screen, or the user may set a corresponding background image for the audio playback display interface in advance.

[0083] For example, for a display screen with an audio playback function, when a user has an audio playback requirement, they can perform an audio playback operation on the display screen, or play the audio through voice control, button control, etc. At this time, the user's audio playback instruction is generated. After the vehicle receives the user's audio playback instruction, it obtains the background image and the target audio currently being played.

[0084] For example, if it is detected that the user performs an operation to switch audio A to audio B, audio B can be determined as the target audio; if it is detected that the user's voice command "play audio C" is detected, audio C can be determined as the target audio.

[0085] Exemplarily, the audio type of the target audio may include music, blogs, audiobooks, etc., which is not limited in this embodiment of the present application.

[0086] Figure 4 This is a schematic diagram of a background image provided by an embodiment of the present application. If the user sets the background image corresponding to the audio playback function in the central control screen 101 to be as follows Figure 4 If the image 401 shown in (a) is shown in FIG, the image 401 can be determined as the currently required background image; if the user has not set the background image corresponding to the audio playback function, the background image currently displayed on the vehicle desktop of the central control screen 101 can be obtained as follows Figure 4 The image 402 shown in (b) in FIG. 4 is then determined as the background image currently required.

[0087] Optionally, the background image may also be a default image set by the manufacturer, which may include common elements, such as mountains, rivers, and lakes.

[0088] It should be noted that the interface display method provided in this application can be applied to any electronic display screen with audio playback function, such as the central control screen, co-pilot entertainment screen and rear screen in the vehicle cabin. The embodiment of this application only describes the central control screen as an application example.

[0089] S302: Determine a target element to be displayed based on audio information of the target audio.

[0090] Exemplarily, after the currently played target audio is determined, a target element to be displayed that matches the audio information can be determined based on the audio information of the target audio.

[0091] For example, if the audio information of the target audio is related to spring, the target element can be determined to be flowers and plants; if the audio information of the target audio is related to insects, the target element can be determined to be fireflies; if the audio information of the target audio is related to love, the target element can be determined to be love, and so on.

[0092] In one implementation, the process of determining the target element to be displayed based on the audio information of the target audio may include directly inputting the audio information of the target audio into a large language model such as an artificial intelligence (AI) model or a semantic analysis model for semantic analysis to determine the target element that can reflect the scene information described by the audio information.

[0093] In one implementation, the audio information of the target audio includes an audio name and audio content. Based on the audio information of the target audio, the process of determining the target element to be displayed may further include:

[0094] Determine whether the audio name has a corresponding first candidate element;

[0095] If there is a corresponding first candidate element for the audio name, determining the first candidate element as a target element to be displayed;

[0096] In the case that there is no corresponding first candidate element for the audio name, a target element to be displayed is determined based on the audio content.

[0097] For example, the audio information of the target audio may include an audio name (e.g., a song title, a book title, etc.) and audio content (e.g., lyrics, an article, etc.). Generally, the audio name can reflect the theme of the entire audio segment. Therefore, after obtaining the audio information of the target audio, it is possible to first determine whether the audio name of the target audio corresponds to a first candidate element; if the audio name corresponds to a first candidate element, the first candidate element can be determined as the target element; if the audio name does not correspond to the first candidate element, the target element is further determined based on the audio content of the target audio.

[0098] Optionally, a correspondence between different keywords and candidate elements is established in advance. After obtaining the audio name, the target element matching the audio name is determined from the preset correspondence by analyzing the keywords in the audio name; among them, keywords are mostly nouns and other words with practical meanings, and prepositions, modal particles and other words without practical meanings are not keywords. For example, for the audio name "Our Love", the keywords can be determined to be "we" and "love".

[0099] For example, the correspondence between keywords and candidate elements may be as shown in Table 1.

[0100] Table 1

[0101] Keywords Candidate elements like Love, candy, bow, etc. spring Flowers, grass, willow trees, etc. insect Fireflies, butterflies, bees, etc. Moonlight, Moon Moon, Moonship, Milky Way, etc. …… ……

[0102] As shown in Table 1, if the audio name of the target audio contains the keyword "love", the candidate element can be determined to be at least one of the elements that can be used to express love, such as love, candy or bow; if the audio name of the target audio contains the keyword "spring", the candidate element can be determined to be at least one of the elements used to represent the breath of spring, such as flowers, grass, willows, etc.; if the audio name of the target audio contains the keyword "insect", the candidate element can be determined to be at least one of the insect elements such as fireflies, butterflies, bees, etc.; if the audio name of the target audio contains the keyword "moonlight" or "moon", the candidate element can be determined to be at least one of the elements such as the moon, moon boat, and Milky Way.

[0103] For example, if the audio name contains one or more keywords in the correspondence set, it can be determined that there is a corresponding first candidate element for the audio name, and the first candidate element corresponding to the keyword in the audio name is determined as the target element to be displayed; for example, if the audio name of the target audio is "Insects Flying", it can be determined that the target elements include fireflies, butterflies, or honey, etc.; if the audio name is "Spring Flowers Will Bloom", it can be determined that the target elements include flowers, grass, or willows, etc. If the audio name does not contain the keywords in the correspondence set, it can be determined that there is no corresponding first candidate element for the audio name, and it is necessary to analyze the audio content of the target audio to determine the corresponding target element; for example, if the audio name of the target audio is "Hello", there may not be a candidate element corresponding to the keyword "Hello" in the correspondence set, and it is necessary to further combine the audio content to determine the target element.

[0104] In one implementation, since the range of keywords covered by the set of correspondences between preset keywords and candidate elements is limited, the audio name of the target audio can be semantically analyzed with the help of a large language model such as an AI model or a semantic analysis model to obtain the scene described by the audio name, and then determine the target element based on the candidate elements contained in the scene.

[0105] In an embodiment of the present application, it is first determined whether there is a corresponding first candidate element based on the audio name of the target audio; if the first candidate element exists, the first candidate element is directly determined as the target element to be displayed, without further semantic analysis of a large amount of audio content, which can improve the efficiency of determining the target element, and then the target display interface can be quickly rendered and generated, thereby improving the efficiency of the interface display corresponding to the target audio; if the first candidate element does not exist, the target element is further determined based on the audio content of the target audio to ensure that the elements displayed in the interface match the audio content of the target audio, thereby enhancing the immersion of the audio playback interface.

[0106] In one implementation, the process of determining the target element to be displayed based on the audio content may specifically include:

[0107] Sorting the occurrence frequencies of the second candidate elements corresponding to the audio content of the target audio to obtain a ranking result of the second candidate elements;

[0108] Based on the ranking result of the second candidate elements, a target element is determined.

[0109] For example, the specific content of the audio can reflect the scene described by the target audio, which may include multiple keywords, and accordingly, there will be multiple candidate elements. In the case where the audio name of the target audio does not correspond to the first candidate element, in order to match the target element with the scene described by the target audio, it is possible to further determine whether the audio content of the target audio has a corresponding second candidate element, and sort the occurrence frequency of the second candidate elements corresponding to the audio content to obtain a sorting result; then, based on the sorting result of the occurrence frequency of the second candidate elements, determine the target element to be displayed.

[0110] Specifically, the occurrence frequencies of the second candidate elements are sorted in descending order to obtain a sorting result; and a preset number of second candidate elements that are ranked first in the sorting result are determined as target elements.

[0111] The preset number may be 1, 2, or 3, etc. The more preset numbers there are, the more target elements to be displayed and the richer the display content of the interface.

[0112] For example, if the audio content includes keywords such as "summer," "lakeside," "wind," and "hair," and their corresponding frequencies of occurrence are 50, 30, 40, and 10, respectively, then the frequencies of occurrence of the second candidate elements corresponding to these keywords can be determined to be 50, 30, 40, and 10, respectively. Sorting the frequencies of occurrence from highest to lowest yields the following ranking: the second candidate element corresponding to "summer" > the second candidate element corresponding to "wind" > the second candidate element corresponding to "lakeside" > the second candidate element corresponding to "hair." If the preset number is 1, the second candidate element corresponding to "summer" (e.g., reeds, lotus, etc.) can be determined as the target element.

[0113] In one implementation, the audio content of the target audio is input into an AI model or a semantic analysis model, and the audio content of the target audio is analyzed using a large language model to determine the scene described by the audio content. Then, based on the scene information, the target elements related to the audio content of the target audio can be determined.

[0114] Exemplarily, the scene described by the audio information of the target audio is analyzed using an AI model, and the elements involved in the scene are used as target elements to be displayed; for example, if the audio information of the target audio is described as a summer scene through model analysis, then the target element can be determined to be an element corresponding to summer, such as reeds.

[0115] It should be noted that the target audio currently being played may be light music, which does not have any audio content. Therefore, the corresponding target element can be determined only based on the music name of the light music; if there is no element corresponding to the music name, the default music playback display interface can be displayed.

[0116] In an embodiment of the present application, if there is no candidate element corresponding to the audio name, the frequency of occurrence of the second candidate element corresponding to the audio content of the target audio is sorted, and the target element to be displayed is determined based on the sorting result. By counting the frequency of occurrence of the corresponding candidate elements in the audio content, the theme focus of the audio can be directly reflected. The target element is determined based on the sorting result of the frequency of occurrence, and the elements displayed on the interface can be matched with the currently playing target audio, allowing users to more intuitively feel the audio details through visual assistance, thereby enhancing the sense of immersion during audio playback.

[0117] S303: Perform image rendering based on the background image and the target element to generate a target display interface.

[0118] Among them, the target display interface includes background images, target elements, relevant information of the target audio (such as cover image, song title, author and lyrics, etc.) and audio playback operation controls (such as play / pause controls, song switching controls, playlist controls, etc.).

[0119] Exemplarily, after the corresponding target element is determined according to the audio information of the target audio, image rendering may be performed in combination with the acquired background image and the target element to generate a target display interface corresponding to the target audio.

[0120] In one implementation, image rendering of background images and target elements can be achieved with the help of image generation models such as AI.

[0121] Figure 5 This is a schematic diagram of a target display interface provided by an embodiment of the present application. Figure 5 As shown in (a), the target audio currently being played is "Summer Wind". According to the audio information of the target audio, the corresponding target elements are determined to include reeds. If the background image obtained is Figure 4 The image 402 shown in FIG can be used to render the image according to the image 402 and the reed element to generate the target display interface 501. Figure 5 As shown in (b), the target audio currently being played is "Spring Flowers Will Bloom". According to the audio information of the target audio, the corresponding target elements include flowers and plants. If the background image obtained is Figure 4 The image 402 shown in FIG can be used to render the image 402 and the flower and grass elements to generate the target display interface 502. Figure 5 As shown in (c), the target audio currently being played is "Insects Flying". According to the audio information of the target audio, the corresponding target elements are determined to include fireflies and butterflies. If the background image obtained is Figure 4 The image 402 shown in FIG can be used to render the image 402 and the firefly and butterfly elements to generate the target display interface 503. Figure 5 As shown in (d), the target audio currently being played is "Moonlight Postman". According to the audio information of the target audio, the corresponding target elements include the moon ship. If the background image obtained is Figure 4 The image 402 shown in , image rendering can be performed based on the image 402 and the moon spacecraft to generate a target display interface 504.

[0122] In one implementation, current target information is obtained, wherein the target information includes at least one of time information, weather information, and season information;

[0123] updating the background image based on the target information to obtain an updated background image;

[0124] The process of rendering the target image based on the background image and the target element to generate the target display interface may specifically include:

[0125] Image rendering is performed based on the updated background image and the target element to generate a target display interface.

[0126] For example, when the user plays the target audio through the display screen, at least one target information such as the current time information (for example, morning, noon, evening, late night, etc.), weather information (for example, sunny, cloudy, rainy, snowy, etc.) and season information (for example, spring, winter, etc.) can be obtained; the obtained background image can be updated in combination with the current target information to obtain an updated background image; in the process of rendering the image of the target display interface, the updated background image can be combined with the target element for rendering, and the immersive scene simulation in the car can be performed according to the changes in the external environment for 24 hours.

[0127] Figure 6 This is a schematic diagram of another target display interface provided by an embodiment of the present application. When the audio playback instruction indicates to play "Summer Wind", the current background image is obtained as follows Figure 6 In the image 401 shown in (a), the target element corresponding to the target audio is reed. The current time is 08:00, which is in the morning and the weather is sunny. Then, the image 401 can be updated according to the time information and weather information. For example, the current time period is indicated by the position of the sun, and the following is obtained: Figure 6 The updated background image 601 shown in (b) of FIG; and then the updated background image 601 can be combined with the reed element to perform image rendering to generate the following Figure 6 The target display interface 602 shown in (c) in FIG.

[0128] Figure 7 This is a schematic diagram of a target display interface according to an embodiment of the present application that changes with time information. Figure 7 As shown in (a), the current time is 08:00, which is in the morning period, and the corresponding target display interface 602 can display the rising stage of the sun; Figure 7 As shown in (b), the current time is 13:00, which is at noon, and the corresponding target display interface 701 can show the stage where the sun is directly overhead; Figure 7 As shown in (c), the current time is 18:00, which is in the evening period. The corresponding target display interface 702 can show the stage of the sun setting, hidden behind the mountain; Figure 7 As shown in (d), the current time is 21:00, which is late at night. The corresponding target display interface 703 can display the moon to match the current time period.

[0129] It should be noted that Figure 7The matching of the current time information by adjusting the display positions of the sun and the moon is only an example. In actual application, the background image can also be updated by adjusting parameters such as the hue and color temperature of the background image, or by creating scenes such as sunshine and stars in the sky that meet the target information, so as to obtain an updated background image that matches the current time information, season information and weather information. The target elements can then be combined to generate a target display interface during music playback that matches the target information.

[0130] In an embodiment of the present application, the existing background image is updated in combination with at least one of the current time information, weather information, and seasonal information, so that the updated background image can match the current external vehicle environment information; then, the image is rendered in combination with the updated background image and the target element to obtain a target display interface. While displaying elements matching the audio information to the user, a background image matching the real environment is displayed to the user, allowing the user to perceive the environment outside the vehicle through the audio playback interface, thereby improving the user's interaction efficiency and further improving the intelligence and flexibility of the interface display.

[0131] In one implementation, static display of target elements is too rigid. To enhance the interface's appeal during audio playback, target elements can be dynamically displayed. The target element's animation parameters can be pre-set fixed trajectories and frequencies, such as moving the target element from left to right. Alternatively, the target element's animation parameters can be determined based on the actual parameters of the vehicle during operation, enhancing the audio playback interface's appeal.

[0132] In one implementation, the process of determining the motion effect parameters of the target element based on the actual operating parameters of the vehicle may include:

[0133] Acquiring vehicle parameters of the vehicle, wherein the vehicle parameters include operating parameters of the vehicle air conditioner and / or driving parameters of the vehicle;

[0134] Based on the vehicle parameters, the motion parameters of the target element are determined, wherein the motion parameters include motion frequency and / or motion direction.

[0135] The vehicle's air conditioner has multiple air outlet locations; the acquired air conditioner operating parameters indicate the operating parameters corresponding to the air conditioner outlet closest to the display screen currently playing audio. For example, if the current display screen is the central control screen, the operating parameters of the air conditioners on both sides of the central control screen can be obtained; if the current display screen is the rear display screen, the operating parameters of the air conditioner located behind the cabin can be obtained.

[0136] For example, during audio playback, the operating parameters of the vehicle air-conditioning outlet adjacent to the display screen are monitored, as well as relevant parameters during vehicle driving. Based on the operating parameters of the vehicle air-conditioning and / or the driving parameters of the vehicle, the movement frequency and / or movement direction of the target element can be determined.

[0137] In an embodiment of the present application, the movement frequency and / or movement direction of the target element in the display interface is determined based on the operating parameters of the on-board air conditioner and / or the driving parameters of the vehicle, and the functional data of the vehicle is converted into a visual visual interaction language, so that the dynamic effects displayed on the interface are consistent with the driving scene, thereby improving the fun of the vehicle-computer interaction without affecting the safety of vehicle driving, and further improving the flexibility of the interface display during audio playback.

[0138] In one implementation, the operating parameters of the vehicle air conditioner include air volume, wind speed, and wind direction. Based on the vehicle parameters, the display animation of the target element is determined, including:

[0139] Determining the movement frequency of the target element based on the air volume and / or wind speed of the vehicle air conditioner; and / or,

[0140] Determine the movement direction of the target element based on the wind direction of the car air conditioner.

[0141] For example, after the user turns on the car air conditioner, the working parameters of the car air conditioner will be adjusted, such as adjusting the air volume and wind speed of the air conditioner, or adjusting the direction of the air outlet of the air conditioner; based on the currently collected air volume or wind speed of the car air conditioner, the movement frequency of the target element can be determined, wherein, as the air volume or wind speed of the car air conditioner increases, the movement frequency of the target element accelerates accordingly; based on the wind direction of the air outlet of the car air conditioner adjacent to the display screen, the movement direction of the target element can be determined, wherein, the movement direction of the target element can be consistent with the wind direction of the air outlet.

[0142] Figure 8 This is a schematic diagram of a target element in dynamic motion provided by an embodiment of the present application. Taking the currently playing target audio as "Moonlight Postman" as an example, the corresponding target element is determined to be the moon boat. The current air volume and wind speed of the car air conditioner are both at the highest level, and the wind direction of the air-conditioning outlets on both sides of the display screen is blowing to the right, then it can be determined that the movement frequency of the moon boat is fast, and the movement direction is from left to right. Figure 8 As shown, the moon boat can move from its initial left position A to the right to position B, and finally to position C. If the wind directions of the air-conditioning vents on both sides of the display screen are inconsistent, the movement direction of the moon boat can be determined to be two different directions, so that the moon boat can move back and forth on the display screen, for example, from left to right and then to left, and so on.

[0143] In this embodiment, the vehicle air conditioner's operating parameters, such as air volume, wind speed, and wind direction, are bound to dynamic parameters such as the movement frequency and direction of target elements, allowing the display interface to display dynamic elements and enhancing the flexibility of the interface display. As the user adjusts the vehicle air conditioner's operating parameters, the target elements on the display interface move accordingly, enhancing the user's sense of realism and immersion, thereby increasing the flexibility and fun of the interface display during music playback.

[0144] In one implementation, the vehicle's driving parameters include a driving speed and a steering direction of the vehicle. Based on the vehicle parameters, determining the display animation of the target element includes:

[0145] Determining the movement frequency of the target element based on the vehicle's speed; and / or,

[0146] Based on the steering direction of the vehicle, the movement direction of the target element is determined.

[0147] For example, while a vehicle is driving, its speed will constantly change, and the vehicle may make steering operations, etc. The movement frequency of the target element can be updated in real time according to the vehicle's speed, wherein the vehicle's speed and the movement frequency of the target element can be positively correlated. For example, when the speed gradually increases from 20km / h to 80km / h, the corresponding movement frequency of the target element can also gradually change from slow movement to fast movement. When the vehicle turns, the movement direction of the target element can be determined in combination with the vehicle's steering direction, wherein the movement direction of the target element can be consistent with the vehicle's steering direction. For example, when the vehicle turns left, the target element moves synchronously to the left.

[0148] In one implementation, the target element can move along a motion direction in a straight line, a curve, or an irregular motion. The target element's motion trajectory can also change with the vehicle's steering angle. For example, when the vehicle's steering angle is large, the target element can move along a larger arc; when the vehicle's steering angle is small, the target element can move along a smaller arc.

[0149] In one implementation, the vehicle's driving parameters may also include the vehicle's vertical motion trend. For example, when a vehicle is traveling on a bumpy road, the vehicle body will continuously move up and down. Accordingly, the target element's motion direction can be determined to be consistent with the vehicle body's vertical motion direction.

[0150] In an embodiment of the present application, dynamic parameters such as vehicle speed and steering direction are combined with dynamic effects such as motion frequency and direction of target elements, and vehicle speed information is converted into a visual motion frequency, thereby enhancing the user's speed perception through visual dynamic effects; the vehicle steering is converted into a target element to derive the motion direction, thereby enhancing the visualization of the steering operation, thereby improving the flexibility and fun of the interface display during music playback.

[0151] S304: Display a target display interface, wherein the target display interface is a playback display interface of the target audio.

[0152] For example, after rendering and generating the target display interface in combination with the background image and the currently playing audio information, the target display interface can be displayed on the currently playing display screen. Through the target display interface, the user can view the display elements matching the target audio and related information of the target audio, and can control the audio playback process through the controls on the target display interface.

[0153] By displaying an interface that matches the target audio, an immersive audio and visual experience can be created for the user. To further create an immersive audio and visual atmosphere, the vehicle's cockpit devices can be linked. In one implementation, the process of linking audio playback with cockpit devices may include:

[0154] Determining a target scene corresponding to the target audio based on audio information of the target audio;

[0155] Determine the control parameters of the vehicle's cabin equipment based on the target scenario;

[0156] Based on the control parameters, the cockpit equipment is controlled.

[0157] The vehicle's cabin equipment may include one or more of the following: an onboard air conditioner, a fragrance device, a humidifier, ambient lighting, lighting, and seats. Correspondingly, the control parameters of the onboard air conditioner may include air volume, wind speed, wind direction, and temperature; the control parameters of the fragrance device may include scent and air volume; the control parameters of the humidifier may include air frequency and air volume; the control parameters of the ambient lighting may include ambient light color, brightness, and flashing mode; the control parameters of the lighting may include light brightness; and the control parameters of the seats may include seat massage mode, seat ventilation mode, and seat heating mode.

[0158] For example, by analyzing the audio information of the target audio, the target scene depicted by the target audio can be obtained; then, based on the target scene, the corresponding control parameters for controlling the cockpit equipment can be determined, and then the cockpit equipment can be controlled according to the control parameters, and the cockpit equipment can be linked to create the scene depicted by the target audio for the user, providing the user with an immersive listening experience, achieving virtual reality (VR) or even spatial reality (SR) immersive listening space experience effects.

[0159] Optionally, the vehicle can provide users with an immersive listening mode, also known as a 5D listening mode. This mode can be turned on by default during audio playback, and users can also turn off this mode through relevant controls. When this mode is on, when the display screen plays audio, it will automatically control the cabin equipment in the vehicle to create an immersive listening space for users.

[0160] Figure 9 This is a schematic diagram of an interface in a 5D listening mode provided by an embodiment of the present application. Figure 9 As shown, during audio playback, if the 5D listening mode is turned on, the display screen will show parameter adjustment controls for some cabin equipment. For example, the seat massage modes include smart mode, comfort mode, and rhythm mode; the sound effects of audio playback include smart mode, wide surround mode, galactic symphony mode, and live mode; the scents of car fragrances can include jasmine and nature; parameters such as the color and brightness of the ambient light can be adjusted by moving sliders. During this process, users can adjust the relevant parameters of the cabin equipment through the above controls. When the above cabin equipment are all in smart mode, the control parameters of various cabin equipment will be adjusted according to the currently playing audio information to create a more immersive listening space.

[0161] For example, based on the currently playing audio "Summer Breeze", it is determined that the corresponding target scene can be a scene of breeze blowing by the lake in the summer evening. The control parameters of the corresponding cabin equipment can be determined as the wind speed of the car air conditioner is a breeze, the humidifier is turned on at low gear, the car fragrance equipment outputs natural scents, the brightness in the car is dimmed, the color of the ambient light is adjusted to green, etc., to create a scene of breeze blowing by the lake in the summer evening for the user.

[0162] In an embodiment of the present application, the audio information of the target audio is analyzed to obtain the target scene described by the target audio; then, according to the target scene, the control parameters for controlling the cockpit equipment can be determined, thereby controlling the cockpit equipment in the car and improving the flexibility of controlling the cockpit equipment; the vehicle-mounted equipment is linked to create a more immersive listening experience for the user, and enhance the user's sense of scene involvement during audio playback.

[0163] In one implementation, upon receiving an instruction to enable the audio playback function, obtaining historical playback audio and the current time period, where the historical playback audio is the audio played before the audio playback function was last disabled;

[0164] Based on the current time period, determine a recommended audio set corresponding to the current time period;

[0165] Displays historically played audio and recommended audio collections.

[0166] Among them, the recommended audio collection can also be called recommended audio, recommended music package, etc.

[0167] For example, when the user turns off the audio playback function, the audio information and playback progress of the currently playing audio can be memorized and stored to obtain the historical playback audio; when the audio playback function is turned on again, the audio information and playback progress of the historical playback audio can be displayed to facilitate the user to resume playback. In addition, the current time period when the audio playback function was turned on can be obtained, and a matching recommended audio set can be determined based on the current time period. The recommended audio set can be displayed simultaneously with the historical playback audio.

[0168] For example, a day can be divided into four time periods, including the morning period from 5:00 to 11:00, the afternoon period from 11:00 to 17:00, the evening period from 17:00 to 20:00, and the late night period from 20:00 to 5:00. Different time periods can correspond to different recommended audio sets. The recommended audio set corresponding to the morning period is "Good morning, the rising dawn", the recommended audio set corresponding to the afternoon period is "Quiet afternoon time", the recommended audio set corresponding to the evening period is "The night deepens, the lights come on", and the recommended audio set corresponding to the late night period is "Hearing the barking of dogs at the wooden door, a man returning home on a snowy night". Different recommended audio sets can contain different audio to match the user's current listening time.

[0169] Figure 10 This is a schematic diagram of an interface for historical audio playback and recommended audio provided by an embodiment of the present application. Figure 10As shown, the historical audio played by the user last time is XXX Audiobook. When the audio playback function is turned on next time, the historical audio can be displayed, and according to the current time period - morning time, the corresponding recommended audio collection is determined to be "Good Morning, Dawn Rising". At the same time, the historical audio and the recommended audio collection are displayed on the audio playback interface for the user to choose to play.

[0170] In one implementation, determining recommended audio collections for different time periods may include recording and analyzing the audio played by the user during different time periods while the user is using the audio playback function, determining the user's audio playback preferences for different time periods, and combining the user's previously played audio and audio of the same style or type as the previously played audio to determine recommended audio collections for different time periods. Alternatively, an AI model may be used to recommend audio for different time periods to generate corresponding recommended audio collections.

[0171] In an embodiment of the present application, the historical audio played before the user last turned off the audio playback function is stored; when the audio playback function is turned on next time, the stored historical audio can be displayed, and the user can resume playing the historical audio through the display interface, avoiding the user's repeated search operations and improving the user's operating efficiency; at the same time, combined with the current time period, the corresponding recommended audio set is determined, and the recommended audio set is displayed, thereby improving the fit between the audio playback and the current time period scene, thereby improving the flexibility of vehicle audio playback.

[0172] It should be noted that due to the time-consuming image rendering, the target display interface matching the target audio may not be loaded in the early stage of audio playback. At this stage, if there is a previous segment of audio playback, the interface corresponding to the previous segment of audio playback can be displayed. After the interface corresponding to the target audio is rendered, the target display interface corresponding to the target audio is displayed; if there is no previous segment of audio playback, the default playback display interface can be displayed. After the interface corresponding to the target audio is rendered, the target display interface corresponding to the target audio is displayed.

[0173] In one implementation, in order to further increase the fun and atmosphere during audio playback, when it is detected that the user steps on the accelerator pedal to accelerate or perform a steering operation, musical elements such as drum beats and chords can be added to the strong-beat audio to further enhance the rhythm of the audio.

[0174] In summary, in an embodiment of the present application, when an audio playback instruction for instructing the playback of a target audio is received, a background image and the target audio currently being played are obtained, and the target element to be displayed is determined based on the audio information of the target audio; then, image rendering is performed in combination with the background image and the target element to generate a playback display interface for the target audio to be displayed, and the playback display interface is displayed. Compared to the prior art of selecting wallpapers that match the audio from pre-stored wallpapers, the present application analyzes the audio information of the target audio, determines the elements that match the audio information, and performs image rendering in combination with the background image to obtain a display interface. This can improve the degree of matching between the audio playback interface and the target audio, display an interface that corresponds one-to-one to the target audio, and enhance the display flexibility of the audio playback interface. This creates a more immersive visual experience for users during audio playback, meets users' needs for audio-visual integration, and enhances the driving experience of users in the car.

[0175] Figure 11 This is a schematic flow chart of an interface display method provided by an embodiment of the present application. It should be understood that this method can be applied to a vehicle; or to a processor in a vehicle; or to a chip in a processor mounted in a vehicle.

[0176] For example, Figure 11 As shown, the method 1100 includes:

[0177] S1101, when receiving an audio play instruction, obtaining a background image, a currently playing target audio, and current target information.

[0178] The audio playback instruction is used to instruct the playback of target audio; the target information includes at least one of time information, weather information and season information.

[0179] For example, the user operates through the display screen to instruct the playback of the target audio; when the vehicle's display screen receives the user's audio playback instruction, it can obtain the background image to be displayed, the currently playing target audio, and target information such as the current time, weather and season.

[0180] The background image may be a factory default image, or a desktop background image of a display screen, or a background image preset by a user.

[0181] For example, the background image obtained is image A, the target audio currently being played is "Spring Flowers Will Bloom", and the target information includes that it is currently morning, rainy day, and spring, etc.

[0182] Optionally, the implementation of S1101 can refer to Figure 3 The relevant description of S301 in the present application is not repeated here.

[0183] S1102: Update the background image based on the target information to obtain an updated background image.

[0184] For example, after obtaining the initial background image and the current target information, the background image may be updated according to the target information to obtain an updated background image, so that the background image to be displayed can match the current environment information.

[0185] For example, image A is updated based on target information such as morning time, rainy day, and spring. Scene elements of rain and cloudy day can be added to image A to obtain an updated image A.

[0186] Optionally, the implementation of S1102 can refer to Figure 3 The relevant description of S303 in the present application is not repeated here.

[0187] S1103, determine whether the audio name of the target audio has a corresponding first candidate element; if so, execute S1104; if not, execute S1105.

[0188] Exemplarily, the audio information of the target audio is analyzed, where the audio information includes an audio name and audio content; first, it is determined whether the audio name of the target audio has a corresponding first candidate element.

[0189] Optionally, a set of correspondences between keywords and candidate elements is pre-stored to determine whether the audio name of the target audio contains the keywords in the correspondence set; if the audio name contains the keywords in the correspondence set, it can be determined that the audio name has a corresponding first candidate element; if the audio name does not contain the keywords in the correspondence set, it can be determined that the audio name does not have a corresponding first candidate element.

[0190] S1104: Determine the first candidate element as the target element to be displayed.

[0191] Exemplarily, the audio names of most audios can reflect the theme of the audio. In the case where there is a corresponding first candidate element for the audio name, the first candidate element corresponding to the audio name can be directly determined as the target element to be displayed.

[0192] For example, the audio name of the target audio is "Spring Flowers Will Bloom", which includes the keywords "spring" and "flowers". Accordingly, it can be determined that the corresponding target elements include flowers and plants.

[0193] S1105 , sorting the occurrence frequencies of the second candidate elements corresponding to the audio content of the target audio to obtain a sorting result of the second candidate elements.

[0194] For example, when there is no corresponding first candidate element for the audio name, the audio content of the target audio is further subjected to keyword analysis. Since there may be a large number of keywords involved in the audio content and a large number of second candidate elements corresponding to the corresponding keywords, the occurrence frequencies of the various second candidate elements corresponding to the audio content can be sorted to obtain the sorting results of the second candidate elements.

[0195] Specifically, the occurrence frequencies of the second candidate elements may be sorted from large to small.

[0196] S1106: Determine the target element based on the ranking result of the second candidate elements.

[0197] Illustratively, after obtaining the sorting results of the plurality of second candidate elements, the target element corresponding to the target audio may be determined according to the sorting results.

[0198] Specifically, the higher the frequency of occurrence of the keyword corresponding to the candidate element in the audio content, the more the scene described by the target audio matches the candidate element. Accordingly, based on the sorting results from large to small frequency of occurrence, a preset number (for example, 1, 3, etc.) of second candidate elements arranged in front of the sorting results can be determined as target elements.

[0199] In one implementation, a large language model such as an AI model or a speech analysis model is used to analyze the audio information of the target audio to determine the theme scene described by the target audio. Based on the theme scene, target elements that can be displayed and match the target audio can be determined to achieve visual display of the target audio.

[0200] Optionally, the implementation of S1103 to S1106 can refer to Figure 3 The relevant description of S302 in the embodiment of the present application is not repeated here.

[0201] S1107: Perform image rendering based on the updated background image and the target element to generate a target display interface.

[0202] Exemplarily, after obtaining the updated background image and the target element to be displayed, image rendering is performed in combination with the updated background image and the target element to obtain a target display interface that corresponds one-to-one to the currently playing target audio.

[0203] Optionally, the implementation of S1107 can refer to Figure 3 The relevant description of S303 in the present application is not repeated here.

[0204] S1108, displaying the target display interface.

[0205] Among them, the target display interface is the playback display interface of the target audio.

[0206] For example, after generating a target display interface corresponding to the target audio, the target display interface can be displayed on a display screen. The user can view the visual scene corresponding to the target audio and the audio information of the target audio through the target display interface, and can also perform corresponding operations on the audio through the controls in the interface, such as pause / play operations, switch operations, favorite operations, and download operations.

[0207] Optionally, the implementation of S1108 can refer to Figure 3 The relevant description of S304 in the embodiment of the present application is not repeated here.

[0208] In one implementation, a corresponding recommended audio set can be recommended to the user according to the current time period, and a corresponding interface can be displayed according to the current time period, and the cabin equipment in the car can be controlled.

[0209] For example, in the morning, the recommended audio collection is "Good morning, the dawn is rising", which can display the desktop background of the current time, control the brightness of the interior ambient light, the environmental quality (EQ) in the car, such as temperature, humidity, etc., fragrance equipment and seat massage, and display soft elements on the display interface, such as the soft light of the rising dawn; in the afternoon, the recommended audio collection is "Quiet time in the afternoon", which can display the desktop background of the current time, control the brightness, EQ and seat rhythm of the interior ambient light, and overlay elements on the display interface, such as calm water ripples, grass caressed by the breeze and soft sunshine; in the evening, the recommended audio collection is "The night is deepening, the lights are coming on" , it can display the desktop background of the current time, control the brightness, EQ and rhythm of the interior ambient light of the car, and overlay elements on the display interface, such as fireflies, starlight, etc.; in the late night period, the recommended audio collection is "Hearing the dog barking at the wooden door, and a man returning home on a windy and snowy night". It can display the desktop background of the current time, control the brightness, EQ, and rhythm of the interior ambient light of the car, and the smell of the fragrance equipment and the rhythm of the seat, so that no matter when the user uses the car, there will be corresponding audio recommendations and interface displays that suit the current time, creating a comfortable cabin environment for the user.

[0210] In one implementation, if the user is driving late at night, the music can be enhanced with drum beats, chords, etc. when acceleration and steering operations are detected, which can prevent the driver from driving fatigued at night and ensure the safety of the vehicle.

[0211] In summary, in the embodiment of the present application, by obtaining the target audio and background image, the display interface can change in real time with the audio content, forming an auditory content visualization effect, improving the user's sense of immersion during audio playback, and enhancing the user's emotional resonance with the played audio. The initial background image is updated in combination with the target information, and the target element that matches the audio information of the target audio is determined. The image rendering is performed in combination with the updated background image and target element, so that the display interface of the audio playback can match both the scene described by the audio and the current usage environment, thereby improving the flexibility and intelligence of the interface display and avoiding the fixed interface display that makes the user feel monotonous and boring. In the process of determining the target element, the audio name is first analyzed. If the target element cannot be determined based on the audio name, the audio content is further analyzed, which can reduce the amount of data to be analyzed, improve the efficiency of determining the target element, and further improve the efficiency of the interface display and enhance the user's listening experience.

[0212] Combined with the above Figures 1 to 11 The interface display method provided by the embodiment of the present application is described in detail; Figure 12 and Figure 13 The device embodiments of the present application are described in detail. It should be understood that the devices in the embodiments of the present application can execute the various methods of the aforementioned embodiments of the present application, that is, the specific working processes of the following various products can refer to the corresponding processes in the aforementioned method embodiments.

[0213] Figure 12 It is a structural diagram of an interface display device provided in an embodiment of the present application.

[0214] For example, Figure 12 As shown, the apparatus 1200 includes:

[0215] The acquisition module 1201 is configured to acquire a background image and a currently playing target audio when an audio playback instruction is received, wherein the audio playback instruction is used to instruct the target audio to be played;

[0216] An element determination module 1202 is configured to determine a target element to be displayed based on audio information of the target audio;

[0217] The interface generation module 1203 is used to perform image rendering based on the background image and the target element to generate a target display interface;

[0218] The interface display module 1204 is used to display a target display interface, wherein the target display interface is a playback display interface of a target audio.

[0219] In one possible implementation, the device 1200 is also used to obtain current target information, wherein the target information includes at least one of time information, weather information, and season information; the background image is updated based on the target information to obtain an updated background image; the interface generation module is also used to perform image rendering based on the updated background image and target elements to generate a target display interface.

[0220] In one possible implementation, the device 1200 is also used to obtain vehicle parameters of the vehicle, wherein the vehicle parameters include the operating parameters of the vehicle air conditioner and / or the driving parameters of the vehicle; based on the vehicle parameters, the dynamic effect parameters of the target element are determined, wherein the dynamic effect parameters include movement frequency and / or movement direction.

[0221] In one possible implementation, the operating parameters of the vehicle air conditioner include air volume, wind speed and wind direction. The device 1200 is also used to determine the movement frequency of the target element based on the air volume and / or wind speed of the vehicle air conditioner; and / or, to determine the movement direction of the target element based on the wind direction of the vehicle air conditioner.

[0222] In one possible implementation, the vehicle's driving parameters include the driving speed and the vehicle's turning direction. The device 1200 is also used to determine the movement frequency of the target element based on the vehicle's driving speed; and / or determine the movement direction of the target element based on the vehicle's turning direction.

[0223] In one possible implementation, the device 1200 is further used to determine a target scene corresponding to the target audio based on audio information of the target audio; determine control parameters of the vehicle's cabin equipment based on the target scene; and control the cabin equipment based on the control parameters.

[0224] In one possible implementation, the device 1200 is also used to obtain historical playback audio and the current time period when receiving an instruction to turn on the audio playback function, where the historical playback audio is the audio played before the audio playback function was last turned off; based on the current time period, determine the recommended audio set corresponding to the current time period; and display the historical playback audio and the recommended audio set.

[0225] In one possible implementation, the audio information of the target audio includes an audio name and audio content, and the device 1200 is also used to determine whether there is a corresponding first candidate element for the audio name; if there is a corresponding first candidate element for the audio name, the first candidate element is determined as the target element to be displayed; if there is no corresponding first candidate element for the audio name, the target element to be displayed is determined based on the audio content.

[0226] In a possible implementation, the device 1200 is further configured to sort the occurrence frequencies of the second candidate elements corresponding to the audio content of the target audio to obtain a sorting result of the second candidate elements; and determine the target element based on the sorting result of the second candidate elements.

[0227] It should be noted that the above interface display device is embodied in the form of a functional unit. The term "module" here can be implemented in the form of software and / or hardware, and is not specifically limited to this.

[0228] For example, a "module" may be a software program, a hardware circuit, or a combination of the two that implements the aforementioned functionality. The hardware circuit may include an application specific integrated circuit (ASIC), an electronic circuit, a processor (e.g., a shared processor, a dedicated processor, or a group of processors) and memory for executing one or more software or firmware programs, combined logic circuits, and / or other suitable components that support the described functionality.

[0229] Therefore, the units of each example described in the embodiments of this application can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0230] Figure 13 It is a structural schematic diagram of a vehicle provided in an embodiment of the present application.

[0231] For example, Figure 13 As shown, the vehicle 1300 includes: a memory 1301 and a processor 1302, wherein the memory 1301 stores an executable program code 1303, and the processor 1302 is used to call and execute the executable program code 1303 to perform an interface display method.

[0232] In addition, an embodiment of the present application also protects a device, which may include a memory and a processor, wherein the memory stores executable program code, and the processor is used to call and execute the executable program code to perform an interface display method provided by an embodiment of the present application.

[0233] In this embodiment, the device can be divided into functional modules based on the above-described method examples. For example, each functional module can be mapped to a specific functional module, or two or more functions can be integrated into a single processing module. The integrated module can be implemented in hardware. It should be noted that the module division in this embodiment is illustrative and represents only a logical functional division. In actual implementation, other division methods may be used.

[0234] In the case of dividing the functional modules into corresponding functional modules, the device may further include an acquisition module, an element determination module, an interface generation module, and an interface display module. It should be noted that all relevant contents of the various steps involved in the above method embodiment can be referred to the functional description of the corresponding functional modules and will not be repeated here.

[0235] It should be understood that the device provided in this embodiment is used to execute the above-mentioned interface display method, and thus can achieve the same effect as the above-mentioned implementation method.

[0236] In the case of an integrated unit, the device may include a processing module and a storage module. When the device is used in a vehicle, the processing module may be used to control and manage the vehicle's movements, while the storage module may be used to support the vehicle's execution of relevant program codes.

[0237] The processing module may be a processor or controller that implements or executes the various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of this application. The processor may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a digital signal processing (DSP) and a microprocessor, and the storage module may be a memory.

[0238] In addition, the device provided in the embodiments of the present application can specifically be a chip, component or module, and the chip may include a connected processor and memory; wherein the memory is used to store instructions, and when the processor calls and executes the instructions, the chip can execute an interface display method provided in the above embodiment.

[0239] This embodiment also provides a computer-readable storage medium, which stores computer program code. When the computer program code runs on a computer, the computer executes the above-mentioned related method steps to implement an interface display method provided by the above embodiment.

[0240] This embodiment further provides a computer program product. When the computer program product is run on a computer, the computer is caused to execute the above-mentioned related steps to implement an interface display method provided by the above-mentioned embodiment.

[0241] Among them, the device, computer-readable storage medium, computer program product or chip provided in this embodiment are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0242] Through the description of the above implementation methods, technical personnel in the relevant field can understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be distributed and completed by different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0243] In the embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of modules or units is only a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0244] The above content is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of the present application. Therefore, the scope of protection of the present application should be based on the scope of protection of the claims.

Claims

1. An interface display method, characterized in that: The method comprises: Upon receiving an audio playback instruction, obtaining a background image and a target audio currently being played, wherein the audio playback instruction is used to instruct the target audio to be played; Determining a target element to be displayed based on audio information of the target audio; Perform image rendering based on the background image and the target element to generate a target display interface; The target display interface is displayed, wherein the target display interface is a playback display interface of the target audio.

2. The method according to claim 1, characterized in that The method further comprises: Acquiring current target information, wherein the target information includes at least one of time information, weather information, and season information; updating the background image based on the target information to obtain an updated background image; The performing image rendering based on the background image and the target element to generate a target display interface includes: Image rendering is performed based on the updated background image and the target element to generate a target display interface.

3. The method according to claim 1, characterized in that The method further comprises: Acquiring vehicle parameters of the vehicle, wherein the vehicle parameters include operating parameters of the vehicle air conditioner and / or driving parameters of the vehicle; Based on the vehicle parameters, the motion effect parameters of the target element are determined, wherein the motion effect parameters include motion frequency and / or motion direction.

4. The method according to claim 3, characterized in that The operating parameters of the vehicle air conditioner include air volume, wind speed, and wind direction. The determining the display dynamic effect of the target element based on the vehicle parameters includes: determining the movement frequency of the target element based on the air volume and / or wind speed of the vehicle air conditioner; and / or, The moving direction of the target element is determined based on the wind direction of the vehicle air conditioner.

5. The method according to claim 3, characterized in that The driving parameters of the vehicle include a driving speed and a steering direction of the vehicle. The determining of the display animation of the target element based on the vehicle parameters includes: determining a movement frequency of the target element based on a driving speed of the vehicle; and / or, A moving direction of the target element is determined based on the steering direction of the vehicle.

6. The method according to any one of claims 1 to 5, characterized in that The method further comprises: Determining a target scene corresponding to the target audio based on audio information of the target audio; Determining control parameters of a vehicle's cabin equipment based on the target scenario; The cockpit equipment is controlled based on the control parameters.

7. The method according to any one of claims 1 to 5, characterized in that The method further comprises: When receiving an instruction to turn on the audio playback function, obtaining historical playback audio and the current time period, wherein the historical playback audio is the audio played before the audio playback function was last turned off; Based on the current time period, determining a recommended audio set corresponding to the current time period; The historically played audio and the recommended audio collection are displayed.

8. The method according to any one of claims 1 to 5, characterized in that The audio information of the target audio includes an audio name and audio content, and determining a target element to be displayed based on the audio information of the target audio includes: Determine whether there is a corresponding first candidate element for the audio name; In a case where the audio name has a corresponding first candidate element, determining the first candidate element as the target element to be displayed; In a case where the first candidate element does not correspond to the audio name, the target element to be displayed is determined based on the audio content.

9. The method according to claim 8, characterized in that The determining the target element to be displayed based on the audio content includes: Sorting the occurrence frequencies of the second candidate elements corresponding to the audio content of the target audio to obtain a ranking result of the second candidate elements; The target element is determined based on the ranking result of the second candidate elements.

10. A vehicle, characterized in that: The vehicle comprises: a memory for storing executable program code; A processor is configured to call and run the executable program code from the memory, so that the vehicle executes the method according to any one of claims 1 to 9.

Citation Information

Cited By

  • Vehicle cabin interaction method and related equipment

    CN116080567A