Vehicle cabin lyric display method and device, vehicle and storage medium

Abstract

The invention relates to the technical field of vehicles, in particular to a lyric display method and device for a vehicle cabin, a vehicle and a storage medium, and the method comprises the steps: obtaining current audio data and current lyric data of target music; analyzing the current audio data, determining a current rhythm, a current melody and a current music label of the target music, and determining a target lyric style and a target dynamic background of the current lyric data from a preset lyric style library and a preset dynamic background library according to the current music label; and using a Unity 3D engine to render the current lyric data and the target dynamic background according to the target lyric style based on the current rhythm and the current melody, playing the current audio data, and displaying the rendered current lyric data and the rendered target dynamic background. Therefore, the rhythm and melody of the music are analyzed in real time, the lyric style and the background image are dynamically matched and rendered, the defects of a music system in the aspects of visual interactivity and immersion are overcome, and immersive personalized music experience is provided.

Description

Technical Field

[0001] The present application relates to the field of vehicle technology, and in particular to a method and device for displaying lyrics in a vehicle cockpit, a vehicle, and a storage medium. Background Art

[0002] With the continuous advancement of smart car technology and people's increasing requirements for entertainment and leisure experience, in-vehicle multimedia systems are gradually becoming the core focus of users. At the same time, users' expectations for music experience are also constantly increasing.

[0003] The music playback services in the related technologies are limited to music recommendations based on intelligent algorithms, limited music library content, and a relatively single visual experience of music rhythm, which makes it difficult to meet the increasingly diverse and personalized needs of users. Specifically, the related technologies have the following problems: (1) Limited graphics rendering capabilities: 2D rendering technology is mostly used, and the lyrics and background effects often appear flat, lacking visual depth and dynamics, which limits the user's sense of immersion and makes the music experience relatively single; (2) Lack of real-time feedback mechanism: The related technologies find it difficult to achieve dynamic updates of visual content during music playback, and the user's operations often cannot be reflected in the visual effects immediately, reducing the user's sense of participation and satisfaction; (3) Insufficient data processing capabilities: The related technologies have limited capabilities in real-time data processing and analysis, and cannot effectively integrate complex music features, emotional tags or real-time traffic information, affecting the intelligence level of the system; (4) Safety and usability issues: The operating interface of the vehicle-mounted system in the related technologies is often relatively complex, which can easily distract attention during driving and pose certain safety hazards. Summary of the invention

[0004] The present application provides a lyrics display method, device, vehicle and storage medium in a vehicle cockpit to solve the deficiencies of the music system in terms of visual interactivity and immersion, and to provide users with an immersive and personalized music playback experience.

[0005] The first aspect of the present application provides a method for displaying lyrics in a vehicle cockpit. The method for displaying lyrics in a vehicle cockpit adopts a vehicle cockpit system. The vehicle cockpit system includes a Unity3D engine module, a vehicle machine module, and a music module. The method includes the following steps:

[0006] Acquire the current audio data and current lyrics data of the target music through the music module;

[0007] Analyze the current audio data using the Unity3D engine module to determine the current rhythm, current melody and current music tag of the target music, and determine the target lyrics style and target dynamic background of the current lyrics data from a preset lyrics style library and a preset dynamic background library according to the current music tag;

[0008] The Unity3D engine module is used to render current lyrics data and target dynamic background according to the target lyrics style based on the current rhythm and the current melody, the vehicle system is used to play the current audio data, and the rendered current lyrics data and target dynamic background are displayed on the display screen of the vehicle cockpit.

[0009] Optionally, in some embodiments, before using the Unity3D engine module to render the current lyrics data and the target dynamic background according to the target lyrics style based on the current rhythm and the current melody, the method further includes:

[0010] Determining whether an adjustment instruction from a user is received;

[0011] If the user adjustment instruction is received, the target lyrics style and the target dynamic background are determined according to the user adjustment instruction.

[0012] Optionally, in some embodiments, before determining the target lyrics style and the target dynamic background from the preset lyrics style library and the preset dynamic background library according to the current music tag, the method further comprises:

[0013] Constructing a preset lyrics style library and a preset dynamic background library, wherein the preset lyrics style library includes: at least one of scaling, color gradient, stroking, projection, overlay, transparency, luminescence, deformation, fading, displacement, cutting, rotation, 3D flipping, and special effect disappearance;

[0014] The preset dynamic background library includes at least one of rendering, stacking, scaling, displacement, looping, element replacement and connection, and special effect disappearance.

[0015] Optionally, in some embodiments, determining a target lyrics style and a target dynamic background from a preset lyrics style library and a preset dynamic background library according to the current music tag includes:

[0016] Presetting a first mapping relationship between at least one lyric style and at least one music tag, and presetting a second mapping relationship between at least one dynamic background and at least one music tag;

[0017] According to the current music tag, the first mapping relationship is searched to determine the target lyrics style that matches the current music tag, and according to the current music tag, the second mapping relationship is searched to determine the target dynamic background that matches the current music tag.

[0018] A second aspect of the present application provides a lyrics display device in a vehicle cabin,

[0019] The lyrics display device of the vehicle cockpit adopts a vehicle cockpit system, and the vehicle cockpit system includes a Unity3D engine module, a vehicle machine module and a music module, wherein the device includes:

[0020] An acquisition module, used for acquiring current audio data and current lyrics data of the target music through the music module;

[0021] An analysis module, used for analyzing the current audio data by using the Unity3D engine module, determining the current rhythm, current melody and current music tag of the target music, and determining the target lyrics style and target dynamic background of the current lyrics data from a preset lyrics style library and a preset dynamic background library according to the current music tag;

[0022] The display module is used to use the Unity3D engine module to render current lyrics data and target dynamic background according to the target lyrics style based on the current rhythm and the current melody, use the vehicle system to play the current audio data, and display the rendered current lyrics data and target dynamic background on the display screen of the vehicle cabin.

[0023] Optionally, in some embodiments, before using the Unity3D engine module to render the current lyrics data and the target dynamic background according to the target lyrics style based on the current rhythm and the current melody, the display module further includes:

[0024] A determination unit, used to determine whether an adjustment instruction from a user is received;

[0025] The first determination unit is used to determine a target lyrics style and a target dynamic background according to the user's adjustment instruction when receiving the user's adjustment instruction.

[0026] Optionally, in some embodiments, before determining the target lyrics style and the target dynamic background from the preset lyrics style library and the preset dynamic background library according to the current music tag, the analysis module includes:

[0027] A construction unit, used to construct a preset lyrics style library and a preset dynamic background library, wherein the preset lyrics style library includes: at least one of scaling, color gradient, stroking, projection, overlay, transparency, luminescence, deformation, fading, displacement, cutting, rotation, 3D flipping, and special effect disappearance;

[0028] The preset dynamic background library includes at least one of rendering, stacking, scaling, displacement, looping, element replacement and connection, and special effect disappearance.

[0029] Optionally, in some embodiments, the analysis module comprises:

[0030] A mapping relationship preset unit, used to preset a first mapping relationship between at least one lyric style and at least one music tag, and preset a second mapping relationship between at least one dynamic background and at least one music tag;

[0031] The second determination unit is used to search the first mapping relationship according to the current music tag to determine the target lyrics style that matches the current music tag, and to search the second mapping relationship according to the current music tag to determine the target dynamic background that matches the current music tag.

[0032] A third aspect of the present application provides a vehicle, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the method for displaying lyrics in a vehicle cockpit as described in the above embodiment.

[0033] The fourth aspect of the present application provides a computer-readable storage medium having a computer program stored thereon, the program being executed by a processor to implement the method for displaying lyrics in a vehicle cockpit as described in the above embodiment.

[0034] Thus, by acquiring the current audio data and current lyrics data of the target music and analyzing the current audio data, the current rhythm, current melody and current music tag of the target music are determined, and the target lyrics style and target dynamic background of the current lyrics data are determined from the preset lyrics style library and the preset dynamic background library according to the current music tag, and the Unity3D engine is used to render the current lyrics data and the target dynamic background according to the target lyrics style based on the current rhythm and current melody, play the current audio data, and display the rendered current lyrics data and the target dynamic background. Thus, this application solves the deficiencies of the music system in visual interactivity and immersion by dynamically matching and rendering the lyrics style and background image by analyzing the rhythm and melody of the music in real time, and providing users with an immersive and personalized music playback experience.

[0035] Additional aspects and advantages of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:

[0037] Figure 1 A flowchart of a method for displaying lyrics in a vehicle cockpit according to an embodiment of the present application;

[0038] Figure 2 A schematic diagram of a first rendering effect provided according to an embodiment of the present application;

[0039] Figure 3 A schematic diagram of a second rendering effect provided according to an embodiment of the present application;

[0040] Figure 4 A schematic diagram of a third rendering effect provided according to an embodiment of the present application;

[0041] Figure 5 A schematic diagram of a fourth rendering effect provided according to an embodiment of the present application;

[0042] Figure 6 A schematic diagram of a fifth rendering effect provided according to an embodiment of the present application;

[0043] Figure 7 A schematic diagram of an immersive dynamic visual playback interface provided according to an embodiment of the present application;

[0044] Figure 8 A schematic diagram of selecting a song playback type in a playback interface provided according to an embodiment of the present application;

[0045] Fig. 9 A schematic diagram of a display interface of a trigger song dynamic type lyrics selection panel provided according to an embodiment of the present application;

[0046] Fig.10 A schematic diagram of a display interface of a trigger song dynamic type background style selection panel provided according to an embodiment of the present application;

[0047] Fig.11 A flowchart of a method for displaying lyrics in a vehicle cockpit according to an embodiment of the present application;

[0048] Fig.12 A block diagram of a lyrics display device for a vehicle cockpit provided according to an embodiment of the present application;

[0049] Fig.13A schematic diagram of the structure of a vehicle provided according to an embodiment of the present application, DETAILED DESCRIPTION

[0050] Embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present application, and should not be construed as limiting the present application.

[0051] The following describes the lyrics display method, device, vehicle and storage medium of the vehicle cockpit of the embodiment of the present application with reference to the accompanying drawings. In view of the problem of the lack of visual interactivity and immersion of the music system mentioned in the above background technology, the present application provides a lyrics display method for the vehicle cockpit, in which the current audio data and the current lyrics data of the target music are obtained, and the current audio data is analyzed to determine the current rhythm, current melody and current music tag of the target music, and the target lyrics style and target dynamic background of the current lyrics data are determined from the preset lyrics style library and the preset dynamic background library according to the current music tag, and the Unity3D engine is used to render the current lyrics data and the target dynamic background according to the target lyrics style based on the current rhythm and current melody, play the current audio data, and display the rendered current lyrics data and the target dynamic background. Therefore, the present application solves the shortcomings of the music system in terms of visual interactivity and immersion by analyzing the rhythm and melody of the music in real time, dynamically matching and rendering the lyrics style and background image, and providing users with an immersive and personalized music playback experience.

[0052] It should be noted that the lyrics display method in the vehicle cockpit of the embodiment of the present application is applied to a vehicle cockpit system, which includes: a Unity3D engine module, a vehicle system module and a music module, and the modules achieve efficient collaboration through event-driven and data transmission.

[0053] Among them, 1. The Unity3D engine module is used to achieve dynamic visual effects (such as lyrics animation and background changes); and to provide a user interaction interface that allows users to select music and set personalized options; and is responsible for real-time rendering and performance optimization.

[0054] Processing method: The Unity3D engine plays music through the AudioSource component and uses GetSpectrumData to obtain audio data. By analyzing the audio data, it identifies the rhythm, melody, and emotional tags of the music and triggers the corresponding dynamic lyrics and background style.

[0055] The main functions of the Unity3D engine module include: (1) Rendering engine: Unity3D uses an efficient rendering engine to support high-quality 2D and 3D graphics rendering. It is based on graphics APIs such as Direct3D and OpenGL and can handle complex graphics rendering tasks, including lighting, shadows, texture mapping, etc. Unity's rendering pipeline is divided into forward rendering and deferred rendering, allowing developers to choose the rendering method that best suits the project according to their needs; (2) Physics engine: Unity has a built-in PhysX physics engine. The PhysX physics engine is a high-performance physics calculation library that can achieve real physical interaction effects such as collision detection, rigid body dynamics, and cloth simulation, which enables Unity to create realistic physical behaviors in games and simulations; (3) Audio engine: Unity provides a full-featured audio engine that supports 3D sound effects and environmental sound processing, allowing developers to control audio playback, volume, stereo diffusion, and spatialization processing to enhance the immersive experience.

[0056] 2. The vehicle system module is used to provide hardware support to ensure the normal operation of audio, display and input devices; and to process user input and feedback and integrate other vehicle functions (such as navigation, telephone, etc.).

[0057] Processing method: Communicate with the Unity3D engine module through the central processing unit (CPU) of the vehicle system to transmit audio playback status and user input, and use CAN bus or other communication protocols to ensure the stability and real-time performance of the system.

[0058] 3. The music module is used to provide storage and management of music files, supports multiple audio formats (such as MP3, WAV), and is responsible for basic operations such as audio playback, pause, and jump.

[0059] Processing method: The music module interacts with the Unity3D engine module through the API and provides status information of music playback (such as current time, total duration, etc.). When music playback starts, the music module passes the audio data to the Unity3D engine and then starts to analyze and process the audio data.

[0060] In the embodiment of the present application, the association mechanism between the Unity3D engine module, the vehicle system module and the music module includes an event-driven mechanism and a data transmission mechanism.

[0061] Among them, the event-driven mechanism: when the user selects a song and clicks to play, the music module will trigger an event. After receiving the event, the Unity3D engine module will start to render the corresponding dynamic lyrics and background. During the music playback process, the music module will send audio status updates in real time, and the Unity3D engine will adjust the display content according to the status changes; data transmission mechanism: the Unity3D engine module receives audio data from the music module through shared memory or message queues, and performs real-time analysis. The analysis results (such as rhythm, tags, melody) will be passed as parameters to the dynamic lyrics style and background manager to ensure that the visual effects are synchronized with the audio content.

[0062] In addition, in order to implement the lyrics display method in the vehicle cockpit of the embodiment of the present application, the vehicle needs to have the following equipment conditions:

[0063] 1. Hardware equipment:

[0064] Central Processing Unit (CPU): A powerful multi-core CPU is required to support the efficient operation and complex data processing requirements of Unity3D.

[0065] Graphics Processing Unit (GPU): A high-performance GPU is essential for 3D graphics rendering, especially when dealing with high resolution and complex 3D effects.

[0066] Memory and storage: Sufficient RAM (16GB or more recommended) and a high-speed solid-state drive (SSD) to ensure fast data read and write and application loading times.

[0067] Display: High-resolution display for displaying dynamic visuals and user interfaces. In an in-vehicle system, multiple displays may be required to serve both the driver and passengers.

[0068] Audio output device: High-quality sound system to provide excellent audio output and enhance the music playback experience.

[0069] Input devices: Touch screens, buttons, or other forms of input devices for user interaction and control.

[0070] 2. Software equipment.

[0071] Unity3D software: The latest version of the Unity3D development environment, including all the plug-ins and libraries needed to support the development of 3D graphics, audio, and physics engines.

[0072] Operating system: Unity3D compatible operating system

[0073] Development and debugging tools: Includes code editors, version control systems, and debugging tools to support software development and problem diagnosis.

[0074] Network equipment: If the system supports online streaming or requires remote updates, a network connection device and corresponding network interface are required.

[0075] The parameter requirements that the equipment needs to meet include:

[0076] 1. Processor (CPU).

[0077] Type: Multi-core processor (preferably 4 or 6 cores or more).

[0078] Main frequency: at least 1.5GHz.

[0079] Architecture: Supports ARM architecture (such as ARM Cortex-A series) or x86 architecture (such as Intel Atom series).

[0080] Performance: Good single-core and multi-core performance to handle complex computing and real-time rendering tasks.

[0081] 2. Graphics processing unit (GPU).

[0082] Type: Graphics processor that supports OpenGL ES 3.0 or above.

[0083] Performance: At least 1GB of video memory to support high resolution and complex 3D rendering.

[0084] Compatibility: Supports the graphics API required by Unity3D to ensure smooth rendering.

[0085] 3. Memory (RAM).

[0086] Capacity: At least 8GB (16GB or more recommended).

[0087] Speed: Supports DDR4 or LPDDR4 to ensure fast data processing and multi-tasking.

[0088] 4. Storage.

[0089] Type: Supports eMMC, SSD or NVMe solid state drives.

[0090] Capacity: At least 64 GB (128 GB or more recommended) to store the operating system, Unity3D applications, and media assets.

[0091] Read and write speed: Sequential read and write speeds of at least 150MB / s are required to ensure smooth application loading and audio data playback.

[0092] 5. Display screen.

[0093] Resolution: at least 1920x1080 (Full HD) or higher.

[0094] Size: 7-inch and above touch screen, support multi-touch function.

[0095] Refresh rate: at least 60Hz to ensure smooth animations and dynamic effects.

[0096] 5. Audio processing.

[0097] Audio decoding support: supports multiple audio formats (such as MP3, WAV, FLAC), and has good audio decoding performance.

[0098] Audio output: Supports stereo or surround sound output to ensure high-quality music playback experience.

[0099] 6. Network connection.

[0100] Wi-Fi: Supports 802.11ac or above standards, providing stable wireless network connection.

[0101] Bluetooth: Support Bluetooth 5.0 or above to ensure good pairing and data transmission with mobile devices.

[0102] 7. Operating system.

[0103] Type: Supports Android Automotive, Linux, or other real-time operating systems.

[0104] Version: Android Automotive version must be 10.0 or above to be compatible with Unity3D libraries and features.

[0105] In addition, the vehicle cabin system of the embodiment of the present application also needs to meet the following technical conditions.

[0106] Compatibility: The car system should be compatible with the Unity3D engine version. It is recommended to use the latest stable version.

[0107] Heat dissipation design: Due to the high load characteristics of the Unity3D engine, the vehicle system should have an effective heat dissipation solution (such as heat sinks and fans) to ensure stable operation in high temperature environments.

[0108] Power management: It has an efficient power management system and supports low-power operation mode to ensure that it can maintain a certain standby time after the vehicle is turned off.

[0109] Safety: Comply with safety standards to ensure the safety and stability of the vehicle system during driving.

[0110] Specifically, Figure 1 A schematic flow chart of a method for displaying lyrics in a vehicle cockpit provided in an embodiment of the present application.

[0111] like Figure 1 As shown, the method for displaying lyrics in a vehicle cockpit comprises the following steps:

[0112] In step S101, the current audio data and current lyrics data of the target music are acquired through the music module.

[0113] The target music is the music being played.

[0114] Specifically, the user selects music to play through the vehicle computer interface, the music module starts playing, and transmits the current audio data and the current lyrics data to the Unity3D engine module.

[0115] In step S102, the Unity3D engine module is used to analyze the current audio data to determine the current rhythm, current melody and current music tag of the target music, and the target lyrics style and target dynamic background of the current lyrics data are determined from the preset lyrics style library and the preset dynamic background library according to the current music tag.

[0116] Specifically, the embodiments of the present application can perform spectral analysis on the current audio data, calculate the current rhythm of the music based on the audio data, including the beat position and beat intensity; analyze the frequency distribution and amplitude changes of the audio data, and extract the melodic features of the music; identify the emotional tone of the target music based on the melodic features of the music, and mark it as a music label, such as "happy" or "tense".

[0117] In the actual execution process, the embodiment of the present application uses Unity's AudioSource component to load audio files, obtains audio data through AudioClip, uses the GetSpectrumData method to implement spectrum analysis, sets parameters such as FFTWindow to FFTWindow.BlackmanHarris to obtain higher spectrum resolution, and extracts rhythm from the analysis results (for example: calculates audio energy at regular time intervals) to trigger lyrics and background changes.

[0118] Further, in some embodiments, a target lyric style and a target dynamic background are determined from a preset lyric style library and a preset dynamic background library according to the current music tag, including: presetting a first mapping relationship between at least one lyric style and at least one music tag, and presetting a second mapping relationship between at least one dynamic background and at least one music tag; according to the current music tag, searching the first mapping relationship to determine a target lyric style that matches the current music tag, and according to the current music tag, searching the second mapping relationship to determine a target dynamic background that matches the current music tag.

[0119] Furthermore, in some embodiments, before determining the target lyric style and the target dynamic background from the preset lyric style library and the preset dynamic background library according to the current music tag, it includes: constructing a preset lyric style library and a preset dynamic background library, wherein the preset lyric style library includes: at least one of scaling, color gradient, stroke, projection, overlay, transparency, glow, deformation, fading, displacement, cutting, rotation, 3D flipping, and special effect disappearance; the preset dynamic background library includes: at least one of rendering, stacking, scaling, displacement, looping, element replacement and connection, and special effect disappearance.

[0120] Specifically, the embodiment of the present application can construct a preset lyrics style library: create a LyricStyleDatabase to store a variety of lyrics styles, including fonts, sizes, strokes, luminous effects, and motion trajectories; construct a preset dynamic background library: establish a BackgroundDatabase, which contains different types of dynamic backgrounds and element motion trajectories. Each lyrics style in the preset lyrics style library is associated with a specific music tag, and each background in the preset dynamic background library is also associated with a specific music tag. The target lyrics style and target dynamic background can be determined from the preset lyrics style library and the preset dynamic background library through the music tag.

[0121] The embodiment of the present application utilizes the GetSpectrumData method of the AudioSource component in the Unity3D engine to extract the rhythm, melody and music tags of the music; in LyricManager, the MatchLyricStyle() function is called according to the extracted tags to select a suitable lyrics style from the LyricStyleDatabase; and the MatchBackground() function is implemented in BackgroundManager to select a suitable dynamic background according to the current music tags.

[0122] In step S103, the Unity3D engine module is used to render the current lyrics data and the target dynamic background according to the target lyrics style based on the current rhythm and the current melody, the vehicle system is used to play the current audio data, and the rendered current lyrics data and the target dynamic background are displayed on the display screen of the vehicle cabin.

[0123] It should be noted that the embodiment of the present application can use the Scene view of Unity3D to create the main interface, including a large-screen lyrics and background display area, and use C# scripts to write the main functional modules, including audio analysis, dynamic lyrics and background management.

[0124] Specifically, for the lyric style, the embodiment of the present application uses the TextMeshPro component of the Unity3D engine to perform high-quality text rendering, and dynamically adjusts the color and size of the text according to the audio rhythm. In the Update loop, the audio playback status is checked and the lyrics are updated according to the current timestamp, and the Lerp method is used to achieve a smooth transition effect; for the dynamic background, the embodiment of the present application uses the Animator component to create a background animation, and adjusts the background change frequency and effect according to the rhythm parameters (such as the number of beats per minute); for the rendering effect, the embodiment of the present application uses the RenderTexture feature of Unity to render the background and lyrics to two different textures respectively, to ensure efficient display performance, and controls the timeline of the dynamic effect through the Coroutine method to ensure that the visual effect is synchronized with the audio to avoid delays, such as Figures 2 to 6 As shown, five different rendering effects are shown in the figure.

[0125] Optionally, in some embodiments, before using the Unity3D engine to render the current lyric data and the target dynamic background according to the target lyric style based on the current rhythm and the current melody, it also includes: determining whether an adjustment instruction from the user is received; if an adjustment instruction from the user is received, determining the target lyric style and the target dynamic background according to the adjustment instruction from the user.

[0126] The embodiments of the present application can not only determine the target lyrics style and target dynamic background by analyzing the music tags of the target music, but also allow the user to customize the lyrics style and background according to personal preferences, thereby enhancing the personalized entertainment experience.

[0127] Specifically, Figures 7 to 10 As shown, Figure 7 This is a diagram of the fully immersive dynamic visual playback interface of the song. Figure 8 A schematic diagram of a user selecting a song playback type on a playback interface, where the user can select a song playback type; Fig. 9 A schematic diagram of the display interface of the dynamic type lyrics selection panel for triggering a song, where the user can select the target lyrics style; Fig.10 A schematic diagram of the display interface of the background style selection panel for triggering the song dynamic type, where the user can select the target dynamic background.

[0128] The embodiment of the present application uses Button and Slider components in the car system UI to achieve music playback control, volume adjustment and theme selection, monitors user input through C# scripts, uses EventSystem to trigger events, and dynamically changes the current lyrics style and background. In addition, the embodiment of the present application can also set adjustable parameters, such as the frequency of background changes, the transition time of lyrics, the sensitivity of audio analysis, etc., to meet the needs of different users.

[0129] During the development process, monitor system performance through Unity's Profiler tool to optimize rendering and processing efficiency to ensure a smooth experience.

[0130] Therefore, combined with Fig.11 As shown, the user selects the target music through the in-vehicle system, and the in-vehicle system analyzes the audio data of the selected music and extracts information such as rhythm, melody and emotional tags for subsequent matching of dynamic visual effects; based on the analysis results, the system selects suitable dynamic lyrics style and background effects to ensure the close integration of visual content and music content; the system renders 3D dynamic lyrics and background effects in real time, and plays them synchronously with the music to create an immersive audio-visual experience; in addition, the user can interact with the system through the touch screen or physical buttons to customize the lyrics style and dynamic background to meet personal preferences and emotional needs. After the playback, the system records the user's preference settings, provides personalized recommendations for future music selections, and enhances the user's overall experience.

[0131] In order to enable relevant technical personnel in the field to further understand the lyrics display method of the vehicle cockpit of the embodiment of the present application, it is elaborated in detail below in conjunction with specific embodiments.

[0132] Here, the embodiments of the present application are explained from three aspects: realizing dynamic lyrics style display, realizing dynamic background display, and realizing matching of dynamic lyrics style, dynamic background and audio data.

[0133] (I) Steps to implement dynamic lyrics style:

[0134] Step 1: Lyrics resource library construction: Create a LyricStyleDatabase to store multiple lyrics styles, including font, size, stroke, glow effect and motion track. Each style is associated with a specific music tag.

[0135] Step 2: Lyrics data structure: Define the LyricData class, which contains lyrics text, timestamp, and style attributes. Read the lyrics file (such as LRC format) and parse it into a list of LyricData objects.

[0136] Step 3: Lyrics display: Use the TextMeshPro component to create a dynamic lyrics display area. In the LyricManager script, update the lyrics text through the TextMeshProUGUI and set the initial style.

[0137] Step 4: Dynamic change effect: In the Update method, get the current music playback time and calculate the corresponding lyrics index, and use the interpolation function to dynamically adjust the transparency, color and position of the lyrics.

[0138] Step 5: Lyrics animation effect: Use Animator to add entry and exit animations for each line of lyrics. Set animation triggers to trigger corresponding animations when the lyrics are played, making the lyrics more dynamic.

[0139] Step 6: Rhythm synchronization: According to the rhythm data obtained from audio analysis, the style of the lyrics is adjusted. For example, when the rhythm reaches a certain threshold, the font size or color of the lyrics is changed to make them more prominent.

[0140] Step 7: User interaction design: Provide UI options to allow users to customize the style of lyrics, such as selecting fonts, colors, and dynamic effects, and update the displayed lyrics style in real time through the OnValueChanged event.

[0141] (II) Dynamic background implementation steps:

[0142] Step 1: Build a background resource library: Create a BackgroundDatabase class to store various dynamic background materials, including pictures, videos, and animation presets, and assign relevant tags and rhythm characteristics to each background.

[0143] Step 2: Background material preparation: Prepare different types of background materials, including static images, dynamic videos, and 3D models, and ensure that the resolution and quality of the materials are suitable for the target display device.

[0144] Step 3: Background Manager Implementation: Create a BackgroundManager script to load and update the dynamic background. Initialize the background library in the Start() method and load the initial background.

[0145] Step 4: Background matching logic: According to the rhythm and label of the music, write the MatchBackground() function to select the appropriate background from the BackgroundDatabase.

[0146] Step 5: Dynamic background display: Use Unity's Renderer and Material components to update the current background display. You can use Shader and MaterialPropertyBlock to achieve dynamic effects.

[0147] Step 6: Background animation and special effects: Use Animator and Animation components to add animation effects to the background, set different state machines, and control the switching and animation of the background.

[0148] Step 7: Real-time rendering and performance optimization: Use RenderTexture to improve background rendering performance. Consider using LOD (Level of Detail) technology to dynamically adjust the background quality based on the camera distance.

[0149] Step 8: Background element motion trajectory: In the Update() method, control the motion trajectory of the background element and adjust the movement speed of the background element according to the rhythm changes.

[0150] (3) Implementation steps for matching dynamic lyrics style, dynamic background, music rhythm, label, melody and other parameters:

[0151] Step 1: Resource library construction:

[0152] Dynamic Lyric Style Library: Create a LyricStyleDatabase to store multiple lyrics styles, including font, size, stroke, glow effect and motion track. Each style is associated with a specific music tag.

[0153] Dynamic background library: Establish BackgroundDatabase, which contains different types of dynamic backgrounds and element motion trajectories, classified by music emotion and rhythm.

[0154] Step 2: Music parameter extraction:

[0155] Use the AudioSource component and the GetSpectrumData method to extract the rhythm, melody, and emotion tags of music.

[0156] Analyze audio data to identify the emotional tone of the current music, marking it with specific labels (such as "happy", "nervous").

[0157] Step 3: Automatically match lyrics style:

[0158] In LyricManager, call the MatchLyricStyle() function based on the extracted tags and select the appropriate lyrics style from the LyricStyleDatabase.

[0159] Step 4: Automatically match dynamic background:

[0160] Implement the MatchBackground() function in BackgroundManager to select the appropriate dynamic background based on the current music tag.

[0161] Step 5: Real-time update and rendering:

[0162] In the Update() method, the music is continuously analyzed and the lyrics style and background are updated in real time.

[0163] Step 6: Dynamic effect realization:

[0164] Use Unity's Animator and Animation components to add effects such as scaling, stroke, glow, and motion tracks to the lyrics;

[0165] Use Shader to achieve the glow effect, and use the Outline component to achieve the stroke.

[0166] Step 7: Background dynamic effect:

[0167] In the background manager, the motion trajectory and dynamic effects of background elements are realized through the Tween library or custom scripts, and the movement speed and direction of the background are adjusted according to the rhythm and label.

[0168] Step 8: Parameter adjustment and optimization:

[0169] Provides adjustable parameters to allow users to customize the response sensitivity of lyrics style and background to suit different music styles.

[0170] Use Unity's Profiler to monitor performance and optimize rendering and processing efficiency to ensure a smooth experience.

[0171] In summary, the embodiments of the present application have the following beneficial effects.

[0172] (1) Enhanced user experience: Through real-time matching of dynamic lyrics and background, the interactivity and immersion of music playback are improved, allowing users to participate more deeply in the music experience.

[0173] (2) Personalization: Users can customize the lyrics style and background according to their personal preferences to enhance their personalized entertainment experience.

[0174] (3) Improve system performance: Utilize the efficient rendering capabilities of the Unity3D engine to ensure smooth operation under high load conditions and optimize system resource usage.

[0175] (4) Multimedia Integration: Through the close integration of audio and visual, a rich variety of multimedia entertainment options are provided to passengers, meeting the needs of modern users for in-vehicle entertainment.

[0176] According to the method for displaying lyrics in a vehicle cockpit proposed in an embodiment of the present application, the current audio data and current lyrics data of the target music are obtained, and the current audio data is analyzed to determine the current rhythm, current melody and current music tag of the target music, and the target lyrics style and target dynamic background of the current lyrics data are determined from the preset lyrics style library and the preset dynamic background library according to the current music tag, and the Unity3D engine is used to render the current lyrics data and the target dynamic background according to the target lyrics style based on the current rhythm and current melody, play the current audio data, and display the rendered current lyrics data and the target dynamic background. Therefore, the present application solves the deficiencies of the music system in terms of visual interactivity and immersion by analyzing the rhythm and melody of the music in real time, dynamically matching and rendering the lyrics style and background image, and providing users with an immersive and personalized music playback experience.

[0177] Next, the lyrics display device for a vehicle cockpit according to an embodiment of the present application will be described with reference to the accompanying drawings.

[0178] Fig.12 It is a block diagram of a lyrics display device in a vehicle cockpit according to an embodiment of the present application.

[0179] like Fig.12 As shown, the lyrics display device 10 in the vehicle cockpit includes: an acquisition module 100, an analysis module 200 and a display module 300.

[0180] The acquisition module 100 is used to acquire the current audio data and current lyrics data of the target music through the music module.

[0181] The analysis module 200 is used to analyze the current audio data using the Unity3D engine module, determine the current rhythm, current melody and current music tag of the target music, and determine the target lyrics style and target dynamic background of the current lyrics data from a preset lyrics style library and a preset dynamic background library according to the current music tag.

[0182] The display module 300 is used to use the Unity3D engine module to render the current lyrics data and the target dynamic background according to the target lyrics style based on the current rhythm and the current melody, use the vehicle system to play the current audio data, and display the rendered current lyrics data and the target dynamic background on the display screen of the vehicle cabin.

[0183] Optionally, in some embodiments, before using the Unity3D engine module to render the current lyrics data and the target dynamic background according to the target lyrics style based on the current rhythm and the current melody, the display module 300 further includes: a judgment unit and a first determination unit.

[0184] The judging unit is used to judge whether an adjustment instruction from the user is received.

[0185] The first determination unit is used to determine a target lyrics style and a target dynamic background according to the user's adjustment instruction when receiving the user's adjustment instruction.

[0186] Optionally, in some embodiments, before determining the target lyrics style and the target dynamic background from a preset lyrics style library and a preset dynamic background library according to the current music tag, the analysis module 200 includes: a construction unit.

[0187] The construction unit is used to construct a preset lyrics style library and a preset dynamic background library, wherein the preset lyrics style library includes: at least one of scaling, color gradient, stroking, projection, overlay, transparency, luminescence, deformation, fading, displacement, cutting, rotation, 3D flipping, and special effect disappearance;

[0188] The preset dynamic background library includes at least one of rendering, stacking, scaling, displacement, looping, element replacement and connection, and special effect disappearance.

[0189] Optionally, in some embodiments, the analysis module 200 includes: a mapping relationship preset unit and a second determination unit.

[0190] Among them, the mapping relationship preset unit is used to preset a first mapping relationship between at least one lyric style and at least one music tag, and preset a second mapping relationship between at least one dynamic background and at least one music tag.

[0191] The second determination unit is used to search for the first mapping relationship according to the current music tag to determine the target lyrics style that matches the current music tag, and to search for the second mapping relationship according to the current music tag to determine the target dynamic background that matches the current music tag.

[0192] It should be noted that the above explanation of the embodiment of the method for displaying lyrics in a vehicle cockpit is also applicable to the device for displaying lyrics in a vehicle cockpit of this embodiment, and will not be repeated here.

[0193] According to the lyrics display device for the vehicle cockpit proposed in the embodiment of the present application, the current audio data and the current lyrics data of the target music are obtained, and the current audio data is analyzed to determine the current rhythm, current melody and current music tag of the target music, and the target lyrics style and target dynamic background of the current lyrics data are determined from the preset lyrics style library and the preset dynamic background library according to the current music tag, and the Unity3D engine is used to render the current lyrics data and the target dynamic background according to the target lyrics style based on the current rhythm and the current melody, play the current audio data, and display the rendered current lyrics data and the target dynamic background. Therefore, the present application solves the deficiencies of the music system in terms of visual interactivity and immersion by analyzing the rhythm and melody of the music in real time, dynamically matching and rendering the lyrics style and background image, and providing users with an immersive and personalized music playback experience.

[0194] Fig.13 A schematic diagram of the structure of a vehicle provided in an embodiment of the present application. The vehicle may include:

[0195] A memory 1301 , a processor 1302 , and a computer program stored in the memory 1301 and executable on the processor 1302 .

[0196] When the processor 1302 executes the program, the method for displaying lyrics in the vehicle cockpit provided in the above embodiment is implemented.

[0197] Furthermore, the vehicle also includes:

[0198] The communication interface 1303 is used for communication between the memory 1301 and the processor 1302 .

[0199] The memory 1301 is used to store computer programs that can be executed on the processor 1302 .

[0200] The memory 1301 may include a high-speed RAM (Random Access Memory) memory, and may also include a non-volatile memory, such as at least one disk memory.

[0201] If the memory 1301, the processor 1302 and the communication interface 1303 are implemented independently, the communication interface 1303, the memory 1301 and the processor 1302 can be connected to each other through a bus and communicate with each other. The bus can be an ISA (Industry Standard Architecture) bus, a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Fig.13 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0202] Optionally, in a specific implementation, if the memory 1301, the processor 1302 and the communication interface 1303 are integrated on a chip, the memory 1301, the processor 1302 and the communication interface 1303 can communicate with each other through an internal interface.

[0203] The processor 1302 may be a CPU (Central Processing Unit), or an ASIC (Application Specific Integrated Circuit), or one or more integrated circuits configured to implement the embodiments of the present application.

[0204] An embodiment of the present application also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the above-mentioned method for displaying lyrics in a vehicle cockpit.

[0205] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms are not necessarily directed to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or N embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, without contradiction.

[0206] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the features. In the description of this application, "N" means at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0207] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, fragment or portion of code comprising one or more executable instructions for implementing the steps of a custom logical function or process, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present application belong.

[0208] It should be understood that the various parts of the present application can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiment, the N steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array, a field programmable gate array, etc.

[0209] A person skilled in the art may understand that all or part of the steps in the method for implementing the above-mentioned embodiment may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, which, when executed, includes one or a combination of the steps of the method embodiment.

[0210] Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limitations on the present application. Ordinary technicians in this field can change, modify, replace and modify the above embodiments within the scope of the present application.

Claims

1. A method for displaying lyrics in a vehicle cockpit, characterized in that: The vehicle cockpit lyrics display method adopts a vehicle cockpit system, wherein the vehicle cockpit system includes a Unity3D engine module, a vehicle machine module and a music module, wherein the method includes the following steps: Acquire the current audio data and current lyrics data of the target music through the music module; Analyze the current audio data using the Unity3D engine module to determine the current rhythm, current melody and current music tag of the target music, and determine the target lyrics style and target dynamic background of the current lyrics data from a preset lyrics style library and a preset dynamic background library according to the current music tag; The Unity3D engine module is used to render current lyrics data and target dynamic background according to the target lyrics style based on the current rhythm and the current melody, the vehicle system is used to play the current audio data, and the rendered current lyrics data and target dynamic background are displayed on the display screen of the vehicle cockpit.

2. The method according to claim 1, characterized in that Before using the Unity3D engine module to render the current lyrics data and the target dynamic background according to the target lyrics style based on the current rhythm and the current melody, the method further includes: Determining whether an adjustment instruction from a user is received; If the user adjustment instruction is received, the target lyrics style and the target dynamic background are determined according to the user adjustment instruction.

3. The method according to claim 1, characterized in that: Before determining the target lyrics style and the target dynamic background from the preset lyrics style library and the preset dynamic background library according to the current music tag, the method includes: Constructing a preset lyrics style library and a preset dynamic background library, wherein the preset lyrics style library includes: at least one of scaling, color gradient, stroking, projection, overlay, transparency, luminescence, deformation, fading, displacement, cutting, rotation, 3D flipping, and special effect disappearance; The preset dynamic background library includes at least one of rendering, stacking, scaling, displacement, looping, element replacement and connection, and special effect disappearance.

4. The method according to claim 1, characterized in that: The step of determining a target lyrics style and a target dynamic background from a preset lyrics style library and a preset dynamic background library according to the current music tag comprises: Presetting a first mapping relationship between at least one lyric style and at least one music tag, and presetting a second mapping relationship between at least one dynamic background and at least one music tag; According to the current music tag, the first mapping relationship is searched to determine the target lyrics style that matches the current music tag, and according to the current music tag, the second mapping relationship is searched to determine the target dynamic background that matches the current music tag.

5. A lyrics display device in a vehicle cockpit, characterized in that: The lyrics display device of the vehicle cockpit adopts a vehicle cockpit system, and the vehicle cockpit system includes a Unity3D engine module, a vehicle machine module and a music module, wherein the device includes: An acquisition module, used for acquiring current audio data and current lyrics data of the target music through the music module; An analysis module, used for analyzing the current audio data by using the Unity3D engine module, determining the current rhythm, current melody and current music tag of the target music, and determining the target lyrics style and target dynamic background of the current lyrics data from a preset lyrics style library and a preset dynamic background library according to the current music tag; The display module is used to use the Unity3D engine module to render current lyrics data and target dynamic background according to the target lyrics style based on the current rhythm and the current melody, use the vehicle system to play the current audio data, and display the rendered current lyrics data and target dynamic background on the display screen of the vehicle cabin.

6. The device according to claim 5, characterized in that Before using the Unity3D engine module to render the current lyrics data and the target dynamic background according to the target lyrics style based on the current rhythm and the current melody, the display module further includes: A determination unit, used to determine whether an adjustment instruction from a user is received; The first determination unit is used to determine a target lyrics style and a target dynamic background according to the user's adjustment instruction when receiving the user's adjustment instruction.

7. The device according to claim 5, characterized in that Before determining the target lyrics style and the target dynamic background from the preset lyrics style library and the preset dynamic background library according to the current music tag, the analysis module includes: A construction unit, used to construct a preset lyrics style library and a preset dynamic background library, wherein the preset lyrics style library includes: at least one of scaling, color gradient, stroking, projection, overlay, transparency, luminescence, deformation, fading, displacement, cutting, rotation, 3D flipping, and special effect disappearance; The preset dynamic background library includes at least one of rendering, stacking, scaling, displacement, looping, element replacement and connection, and special effect disappearance.

8. The device according to claim 5, characterized in that The analysis module comprises: A mapping relationship preset unit, used to preset a first mapping relationship between at least one lyric style and at least one music tag, and preset a second mapping relationship between at least one dynamic background and at least one music tag; The second determination unit is used to search the first mapping relationship according to the current music tag to determine the target lyrics style that matches the current music tag, and to search the second mapping relationship according to the current music tag to determine the target dynamic background that matches the current music tag.

9. A vehicle, characterized in that: include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the method for displaying lyrics in a vehicle cockpit as described in any one of claims 1 to 4.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: The program is executed by a processor to implement the lyrics display method in a vehicle cockpit as described in any one of claims 1 to 4.

Images