Immersive visual linkage method, device and equipment for vehicle-mounted cabin music and medium

Abstract

The embodiment of the invention relates to the technical field of vehicle-mounted information entertainment and intelligent cabin man-machine interaction, and discloses a vehicle-mounted cabin music immersive visual linkage method, device and equipment and a medium, and the method comprises the steps: obtaining an album cover image and an audio data stream of currently played music in response to a music playing instruction; performing dominant hue extraction on the cover image to obtain at least one theme color; and displaying a dynamic visual graph synchronized with the music rhythm on a vehicle-mounted main screen based on the theme color and the audio data stream. By applying the technical scheme of the invention, the music album cover can be used as a unified visual emotion source, and the deviation between the subjectively set visual change and the music rhythm is avoided through real-time sound and picture data fusion and synchronous rendering, so that the visual response can be accurately matched with the core characteristics such as the strength and the rhythm of the music, and the music quality is improved. And the dynamic response accuracy of the system is improved.

Description

Technical Field

[0001] This invention relates to the field of in-vehicle infotainment and smart cockpit human-computer interaction technology, specifically to an in-vehicle cockpit music immersive visual linkage method, device, equipment, and medium. Background Technology

[0002] With the increasing intelligence of automobiles, in-vehicle infotainment systems are shifting from functional to emotionally engaging. Among these, music playback, as a core scenario, demands a high level of immersion in the audiovisual experience.

[0003] Currently, in-vehicle systems typically only provide static or simple dynamic visual feedback when presenting music. For example, the screen interface mainly displays information such as album art and song text. Even if some systems support visualization effects based on audio waveforms, their visual style is relatively monotonous and fails to establish a deep connection with the artistic emotions of the musical work itself (such as the color emotions conveyed through album art).

[0004] At the same time, as an important carrier of ambient light, the color changes of the in-car ambient lighting are often independent of the media content and are driven only by the driving mode or manual settings by the user. This results in a disconnect between screen vision and ambient light vision, making it difficult to create a unified and enveloping cabin atmosphere. Summary of the Invention

[0005] In view of the above problems, embodiments of the present invention provide a method, device, equipment and medium for immersive visual linkage of in-vehicle cabin music, which is used to solve the problem of fragmented in-vehicle music experience caused by the disconnect between visual feedback and musical emotion, the separation between screen and ambient light display, and insufficient adaptation to multiple sound sources.

[0006] According to one aspect of the present invention, an immersive visual linkage method for music in a vehicle cabin is provided. The method includes: in response to a music playback command, acquiring an album cover image and an audio data stream of the currently playing music; extracting the main color tone from the cover image to obtain at least one theme color; and displaying dynamic visual graphics synchronized with the music rhythm on the vehicle's main screen based on the theme color and the audio data stream.

[0007] According to another aspect of the present invention, an in-vehicle cabin music immersive visual linkage device is provided, comprising: a data acquisition module, configured to acquire an album cover image and audio data stream of the currently playing music in response to a music playback command; a cover color acquisition module, configured to extract the main color tone of the cover image to obtain at least one theme color; and a visualization module, configured to display dynamic visualization graphics synchronized with the music rhythm on the in-vehicle main screen based on the theme color and the audio data stream.

[0008] According to another aspect of the present invention, an in-vehicle cabin music immersive visual linkage device is provided, comprising: a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other through the communication bus; the memory is used to store at least one executable instruction, which causes the processor to perform operations such as the in-vehicle cabin music immersive visual linkage method of the first aspect.

[0009] According to another aspect of the present invention, a computer-readable storage medium is provided, wherein at least one executable instruction is stored in the storage medium, and the executable instruction, when executed on a vehicle-mounted cockpit music immersive visual linkage method device / apparatus, causes the vehicle-mounted cockpit music immersive visual linkage device / apparatus to perform the operation of the vehicle-mounted cockpit music immersive visual linkage method as described in any of the first aspects.

[0010] This invention uses the main color of a music album cover as a unified visual control source to synchronously drive the color output of the vehicle ambient lighting and the color tone of the dynamic visualization graphics on the vehicle's main screen. This enables deep integration and coordinated control of the cabin ambient lighting system and the vehicle information display system, which were originally independent in terms of color and timing. It avoids deviations between subjectively set visual changes and music rhythm, allowing the visual response to accurately match the core characteristics of the music, such as intensity and tempo, thus improving the accuracy of the system's dynamic response.

[0011] The above description is merely an overview of the technical solutions of the embodiments of the present invention. In order to better understand the technical means of the embodiments of the present invention and to implement them in accordance with the contents of the specification, and to make the above and other objects, features and advantages of the embodiments of the present invention more apparent and understandable, specific embodiments of the present invention are described below. Attached Figure Description

[0012] The accompanying drawings are for illustrative purposes only and are not intended to limit the invention. Furthermore, the same reference numerals denote the same parts throughout the drawings. In the drawings: Figure 1 A flowchart illustrating a first embodiment of the in-vehicle cockpit music immersive visual linkage method provided by the present invention is shown. Figure 2 A flowchart illustrating a second embodiment of the in-vehicle cockpit music immersive visual linkage method provided by the present invention is shown. Figure 3 A schematic diagram of the structure of the first embodiment of the in-vehicle cockpit music immersive visual linkage device provided by the present invention is shown. Figure 4 A schematic diagram of an embodiment of the in-vehicle cabin music immersive visual linkage device provided by the present invention is shown. Detailed Implementation

[0013] Exemplary embodiments of the invention will now be described in more detail with reference to the accompanying drawings. Although exemplary embodiments of the invention are shown in the drawings, it should be understood that the invention may be implemented in various forms and should not be limited to the embodiments set forth herein.

[0014] The visual interaction system for in-vehicle music playback in related technologies has the following limitations: 1. The in-vehicle control screen and ambient lighting typically operate as two independent subsystems. The lack of unified control logic and synchronization mechanisms between the screen display and the lighting colors and dynamic effects prevents the creation of a cohesive visual atmosphere based on the same content source (such as currently playing music), resulting in a fragmented visual experience within the cabin.

[0015] 2. Insufficient adaptability to heterogeneous audio sources. For example, in Bluetooth music playback scenarios, due to the field limitations of the transmission protocol, standard lyrics information often cannot be reliably transmitted, resulting in a blank lyrics display area. This not only wastes screen space but also disrupts the complete layout of the user interface and the consistency of functional logic.

[0016] 3. When faced with non-standard or incomplete metadata (such as lyrics fragments mixed into the song title field in some Bluetooth transmissions), related technologies can usually only passively accept or directly ignore it, lacking the ability to analyze, clean and reconstruct defective data in real time, resulting in the system functions not being fully realized in specific audio source scenarios.

[0017] Therefore, the present invention provides a method for immersive visual linkage of music in vehicle cabins to solve the above problems.

[0018] Figure 1 A flowchart illustrating a first embodiment of the in-vehicle cabin music immersive visual linkage method of the present invention is shown. This method is executed by an in-vehicle cabin music immersive visual linkage device. Figure 1 As shown, the method includes the following steps: Step S101: In response to the music playback command, obtain the album cover image and audio data stream of the currently playing music.

[0019] Step S102: Extract the main color tone from the cover image to obtain at least one theme color.

[0020] Step S103: Display dynamic visual graphics synchronized with the music rhythm on the vehicle's main screen based on theme colors and audio data streams.

[0021] Specifically, when the system receives a music playback command, it initiates the entire process as a trigger signal. In response to this command, the system obtains two core data sources: the first is the album art image of the currently playing music, which is usually obtained from the metadata embedded in the music file or by querying it from a cloud music server via a network interface; the second is the audio data stream of the current music, that is, the raw or decoded continuous digital audio signal that is being played.

[0022] The system processes the acquired album cover images, extracting the dominant color tone using image processing algorithms. This extraction process can be achieved through computational analysis, such as using color histogram statistics to determine the most frequently occurring color scheme, or employing K-means clustering algorithms to classify and categorize the image colors, thereby obtaining one or more primary colors that can represent the overall visual style and emotional atmosphere of the cover. These colors are defined as "theme colors".

[0023] The system first establishes the extracted theme color as the basic color scheme for visual presentation, using it as the core color tone for subsequently generated dynamic visualizations. Simultaneously, the system performs real-time analysis of the acquired audio data stream, such as calculating its short-time energy or spectral characteristics to extract audio feature parameters that reflect changes in music rhythm and intensity. These real-time changing audio feature parameters are used as driving signals to control the dynamic attributes of the visualizations, ensuring that the dynamic changes of the graphics are synchronized with the music rhythm. Finally, based on the determined theme color tone and combined with the real-time audio-driven dynamic control, the graphics rendering engine generates and displays dynamic visualizations synchronized with the music rhythm on the vehicle's main screen. These dynamic visualizations can be particle systems, waveforms, fluid simulations, or other forms of dynamic graphics.

[0024] This invention achieves a dual unity in both color origin and temporal dynamics among music content, screen visual presentation, and the cabin environment by using the theme color extracted from the album cover as a unified visual emotional tone and combining it with audio data streams to generate dynamic visual graphics synchronized with the rhythm. This invention establishes the visual identifier of the music itself (cover color) as the driving core of the cabin visual system, ensuring the inherent consistency between visual expression and musical emotion. Simultaneously, by establishing a real-time synchronization mechanism between audio data streams and graphic dynamics, it achieves a precise transformation from auditory rhythm to visual dynamics, upgrading the traditional "music playback and static information display" to a "music-driven emotional dynamic visual environment." This creates an immersive audiovisual space within the cabin that is unified from the source, responsive in real time, and provides a coherent experience, enhancing the overall integrity, intelligence, and emotional expressiveness of the in-vehicle infotainment system.

[0025] Figure 2A flowchart illustrating another embodiment of the in-vehicle cabin music immersive visual linkage method of the present invention is shown, which is executed by an in-vehicle cabin music immersive visual linkage device. Figure 2 As shown, the method includes the following steps: Step S201: In response to the music playback command, obtain the album art image and audio data stream of the currently playing music. See details below. Figure 1 Step S101 of the illustrated embodiment will not be described again here.

[0026] Step S202: Extract the main color tone from the cover image to obtain at least one theme color. See details below. Figure 1 Step S102 of the illustrated embodiment will not be described again here.

[0027] Step S203: Display dynamic visual graphics synchronized with the music rhythm on the vehicle's main screen based on theme colors and audio data streams.

[0028] Specifically, step S203 includes: Step S2031: Determine the graphic elements of the dynamic visualization graphics; Step S2032: Perform time-frequency analysis on the audio data stream to obtain music feature parameters.

[0029] Step S2033: Determine the corresponding attribute parameters based on the music feature parameters. The attribute parameters are used to adjust the attributes of the theme color.

[0030] Step S2034: Map the music feature parameters and attribute parameters to dynamic control parameters for controlling the predefined visual graphical model.

[0031] Step S2035: Based on dynamic control parameters and graphic elements, generate and display dynamic visual graphics synchronized with the music rhythm on the vehicle's main screen.

[0032] Specifically, firstly, based on the style of the currently playing music (such as rock, classical, electronic, folk, etc.) or system preset rules, the core constituent units (i.e., graphic elements) of the dynamic visualization are selected. Graphic elements are the basic visual components for visualization, and their types include, but are not limited to, particles (figurative or abstract particles such as light spots, water droplets, and star points), geometric shapes (basic or combined shapes such as circles, triangles, and polygons), lines (straight lines, curves, and wavy lines), fluid units (discrete or continuous visual units simulating liquid flow), and spectrum bars (column-shaped components corresponding to different frequency bands). At the same time, the initial attributes of each graphic element are determined, including the initial shape, initial size, initial color (based on the theme color base value), initial distribution position, and initial motion state (such as stationary or uniform motion), providing a basic visual carrier for subsequent dynamic control.

[0033] Simultaneously, time-frequency conversion processing is performed on the acquired continuous audio data stream. Algorithms such as Short-Time Fourier Transform (STFT), wavelet transform, or power spectrum estimation are used to map the one-dimensional time-domain audio signal into a two-dimensional time-frequency domain data matrix, enabling the capture of the dynamic changes of different frequency components over time. Through quantitative analysis of the time-frequency domain data, multi-dimensional quantifiable music feature parameters are extracted, including but not limited to real-time energy values, instantaneous signal amplitude, time intervals of rhythm beats, zero-crossing rate (frequency of the signal crossing the zero axis), and spectral centroid (central tendency of frequency distribution) of different frequency bands (low frequency 0-200Hz, mid frequency 200-2000Hz, high frequency 2000-20000Hz). These parameters comprehensively characterize the objective features of music from dimensions such as rhythm, intensity, and timbre, providing refined data support for subsequent visual linkage.

[0034] Subsequently, the system internally pre-defines a set of mapping rules, which define the quantitative correlation between music feature parameters and color visual attributes. The quantitative correlation mapping rules between theme color attributes and music feature parameters are established through sample training or engineering calibration, covering the core adjustable dimensions of theme colors (brightness, saturation, transparency, color gradation rate, and color mixing ratio, etc.). Based on the real-time music feature parameters obtained from the previous step, the corresponding attribute parameters are calculated according to the pre-define mapping rules.

[0035] In one example, low-frequency energy values ​​can be linearly correlated with color saturation (increased low-frequency energy leads to increased saturation), instantaneous amplitude can be positively correlated with color brightness (increased amplitude leads to increased brightness), rhythm beat intervals can be negatively correlated with color gradation rate (shorter beat intervals lead to faster gradation), and high-frequency energy values ​​can be inversely correlated with color transparency (increased high-frequency energy leads to decreased transparency). This process transforms abstract audio features into quantized adjustment commands that can be directly applied to the theme color.

[0036] Subsequently, the music feature parameters and attribute parameters are mapped to dynamic control parameters to control the predefined visualization graphic model. A two-layer mapping from music feature parameters to attribute parameters to dynamic control parameters is constructed, pre-setting the correspondence between the full-dimensional control dimensions of the visualization graphic model and the parameters. On one hand, the obtained music feature parameters are directly mapped to control parameters for the dynamic behavior of graphic elements, specifically including the movement speed, trajectory, emission quantity, deformation amplitude, vibration frequency, display density, and geometric scaling factor of graphic elements (for example, amplitude intensity is mapped to the scaling factor of the whole or part of the graphic, and low-frequency energy value is mapped to particle emission velocity). On the other hand, the determined attribute parameters are integrated into the graphic color control system, transformed into quantitative indicators such as the color brightness value, saturation value, transparency value, gradient time parameter, and color mixing weight of graphic elements. Through the integration and quantification of the two types of parameters, a unified set of dynamic control parameters that combines dynamic behavior control logic and color control logic is generated, providing precise instruction basis for driving the visualization graphic model.

[0037] Finally, within each frame rendering cycle, the graphics rendering engine calls predefined visualization graphics models (such as particle system models, fluid simulation models, and spectrum waveform models). These models contain the physical motion rules of the graphic elements, rendering priorities, and display logic. Based on the determined graphic elements (and their initial attributes) and the generated set of dynamic control parameters, the engine completes multi-dimensional calculations of the graphic elements within each frame rendering cycle: including coordinate position updates, shape deformation adjustments, color attribute filling, and dynamic effect overlays (e.g., adjusting the size of the graphic elements according to the scaling factor, and updating brightness and saturation according to color parameters). The calculated graphic pixel data for each frame is output to the rendering engine of the in-vehicle main screen, where it is rendered and optimized for real-time display, ultimately forming a dynamic visualization graphic whose graphic elements, dynamic behavior, and color performance are precisely synchronized with the music rhythm—the rhythmic desktop.

[0038] In one exemplary embodiment, for an electronic music track being played, the system extracts the album cover's main colors as tech blue (RGB 50, 180, 255) and neon pink (RGB 240, 80, 120). Based on the electronic music style, pulse particles and gradient spectrum bars are selected as graphic elements. The initial size of the pulse particles is set to 3px, the color to tech blue, and they are distributed on both sides of the screen and slowly suspended. The initial height of the gradient spectrum bars is 20px, the width to 10px, the color to be a two-tone gradient, and they are distributed at the bottom of the screen and remain stationary. Then, a short-time Fourier transform is performed on the audio data stream to obtain characteristic parameters such as low-frequency energy (8-15dB), instantaneous amplitude (0.3-0.8 units), beat interval (0.2 seconds), and high-frequency energy (3-7dB). Finally, according to preset rules, low-frequency energy is associated with color saturation, amplitude with brightness, beat interval with color gradient rate, and high-frequency energy with neon pink. The transparency is calculated to obtain the corresponding attribute parameters. Then, the music feature parameters are transformed into dynamic control parameters such as particle emission quantity (10-30 particles / frame), movement speed (5-15px / frame), and spectrum column scaling factor (1.2-2.5 times) through a two-layer mapping model. At the same time, the color attribute parameters are transformed into quantitative indicators such as pixel light intensity and purity coefficient. Finally, the particle and spectrum model is called to render at a cycle of 16ms per frame. In the climax section with dense drum beats, the tech blue particles are controlled to move towards the center and the spectrum column is magnified. The brightness and saturation of the two-tone color are maximized and rapidly gradient. In the high-frequency detail section, the transparency of the neon pink is reduced to form color contrast. Finally, the rhythm desktop that is precisely synchronized with the rhythm of electronic music is presented on the main screen of the car.

[0039] This invention provides a method for immersive visual linkage in a vehicle cabin music experience. First, by selecting corresponding graphic elements based on the music style (e.g., matching pulse particles and spectral columns to electronic music, and fluid units and geometric lines to classical music), the visualization carrier is aligned with the artistic style of the music from the outset, avoiding any disharmony between visual elements and the musical atmosphere and providing users with a more immersive audiovisual experience. Second, time-frequency analysis technology is used to analyze the full-frequency characteristic parameters of the music. Then, a two-layer mapping model is used to transform these parameters into control commands for the dynamic behavior and color attributes of the graphics. This achieves macroscopic synchronization between the dynamic graphics and the intensity of the music's rhythm, accurately responding to variations in low-frequency drumbeats, mid-frequency vocals, and high-frequency details. The visual presentation directly reflects the layers and texture of the music, enhancing the delicacy and accuracy of the audiovisual linkage. Finally, based on the attribute adjustment logic of the album cover's theme color, the colors of the visualized graphics are always based on the album cover's tone. Simultaneously, brightness, saturation, and other attributes are dynamically adjusted in conjunction with music characteristic parameters. This ensures the unity of color and the original visual expression of the music while strengthening the transmission of musical emotion through dynamic color changes, avoiding the visual monotony caused by fixed colors.

[0040] In one optional embodiment, the in-vehicle cockpit music immersive visual linkage method provided by the present invention further includes: Step a1: Generate a color control signal based on the theme color and send the color control signal to the in-vehicle ambient lighting control system to drive the ambient lights to present a light effect related to the theme color.

[0041] Specifically, after extracting the theme color of the album cover, the system generates a standardized color control signal based on the color value parameters of that theme color. This signal contains core information such as the RGB values ​​of the color, brightness adjustment thresholds, and light effect mode instructions. Subsequently, the system sends the color control signal to the in-vehicle ambient lighting control system via the vehicle bus (such as CAN bus or LIN bus). After receiving the signal, the ambient lighting control system parses the color parameters and mode instructions, and drives the ambient lights in various areas of the vehicle (such as the center console ambient lights, door panel ambient lights, and seat ambient lights) to present a light effect that is consistent with or has a gradient of the same color scheme as the theme color. The light effect modes can include static constant light, breathing gradient, color cycle, etc., and the brightness and gradient frequency of the light effect can be associated and adapted with subsequent music feature parameters to achieve color-based linkage between the ambient lights and the dynamic visual graphics on the screen.

[0042] This invention achieves color uniformity in the in-vehicle ambient lighting through theme color homogeneity control, creating a surround-style cabin visual atmosphere and enhancing the integration of the cabin environment with the music style. At the same time, it expands the single-screen visual presentation into a dual visual coverage of screen and spatial lighting effects, combined with music auditory input to form a triple sensory stimulation, allowing users to be enveloped by all-round music linkage effects and enhancing the immersive experience level. Since the ambient lighting effects are derived from the theme colors of album covers that carry musical emotions and styles, their integration further deepens the transmission of musical emotions, allowing users to perceive musical emotions more intuitively.

[0043] In one alternative implementation, the method further includes: Step b1: In response to the music playback command, detect whether the lyrics text of the currently playing music has been obtained, and obtain the detection result.

[0044] Step b2: Adjust the display layout of the vehicle's main screen based on the test results.

[0045] Specifically, in response to music playback commands, the system simultaneously triggers a lyrics text detection process while initiating audio playback, album art parsing, and visualization generation. This is achieved by scanning embedded lyric tags in the music file, querying a local lyrics database, or calling a cloud-based lyrics API to obtain the lyrics text of the currently playing music. The system then generates a detection result, such as "lyrics obtained" or "lyrics not obtained," based on whether valid lyrics text was found. This result is transmitted to the screen layout control module, which then adjusts the display layout of the vehicle's main screen according to the detection result.

[0046] This invention employs a real-time detection and layout adjustment mechanism based on the presence or absence of lyrics. This enables the system to intelligently adapt to the differences in characteristics of different music sources or songs (some songs include lyrics, some do not), transforming screen display resources from static presets to dynamic allocation on demand. From a technical perspective, this mechanism treats the presence of lyrics information as a key system state variable, driving the switching of the display controller's operating mode. This comprehensively improves the adaptability and space utilization efficiency of the in-vehicle infotainment system interface, avoiding issues such as blank interface elements or unreasonable layouts due to missing information, and ensuring the functional integrity and visual consistency of the user interface.

[0047] In one alternative implementation, step b2 includes: Step c1: If the detection result is that no lyrics text content has been obtained, control the vehicle's main screen to display dynamic visual graphics in full-screen mode.

[0048] Step c2: If the detection result indicates that the lyrics text content has been obtained, control the vehicle's main screen to enter split-screen collaboration mode, where the first area is used to display the lyrics text content and the second area is used to display dynamic visualization graphics.

[0049] Specifically, if the detection result indicates that the lyrics text content has not been obtained, the screen layout control module issues a full-screen display command, controlling the in-vehicle main screen to render dynamic visual graphics in full-screen mode. At this time, the album cover can be shrunk and floated in the corner of the screen or hidden to maximize the visual immersion area. If the detection result indicates that the lyrics text content has been obtained, the screen layout control module triggers a split-screen collaboration command, dividing the in-vehicle main screen into two functional areas: the first area occupies the main display space on the left and middle of the screen, used to clearly display the scrolling lyrics text to ensure the user's reading needs; the second area occupies the right side of the screen, used to continuously display dynamic visual graphics, realizing the parallel presentation of lyrics reading and visual enjoyment.

[0050] This invention provides differentiated layouts for scenarios with and without lyrics. By using two discrete and clearly defined interface states—full-screen mode and split-screen collaboration mode—it achieves the optimal balance and seamless switching between entertainment (dynamic visual effects) and functionality (lyrics reading) in different scenarios. Responding to detection results, it provides a deterministic solution for space partitioning and resource allocation, ensuring that while providing a rich visual experience, it prioritizes the reliable transmission of core information (lyrics), achieving intelligent and optimized user experience and avoiding layout chaos or information competition.

[0051] In one alternative implementation, step b1 includes: Step d1: Identify whether the music playback source is transmitted via Bluetooth.

[0052] Step d2: If the transmission is identified as Bluetooth, parse its metadata and determine whether the standard lyrics field is empty.

[0053] Step d3: If the standard lyrics field is not empty, then it is determined that the lyrics text content has been obtained.

[0054] Step d4: If the standard lyrics field is empty, then the non-standard field content is parsed to identify whether it includes lyrics text content.

[0055] Step d5: If the non-standard field content includes lyrics text content, then it is determined that the lyrics text content has been obtained.

[0056] Step d6: If the non-standard field content does not include lyrics text content, then it is determined that the lyrics text content has not been obtained.

[0057] Specifically, when detecting lyrics text content, the system also uses the audio source recognition interface to determine whether the current music playback source is Bluetooth (Bluetooth A2DP / AVRCP) transmission. If it is identified as local music, it directly searches for lyrics files in the current storage space. If it is identified as Bluetooth transmission, it initiates the Bluetooth metadata parsing process, extracts the standard lyrics field from the metadata, and performs a non-empty check. The system first checks whether there is a standardized field specifically for lyrics (such as lyrics) in the metadata and checks whether its content is valid. If the standard field is not empty, it directly determines that lyrics exist. If the standard lyrics field is empty or does not exist, the system does not immediately determine that there are no lyrics, but instead initiates an enhanced parsing process: it moves on to checking other fields that may be used "non-standardly" to carry lyrics information, such as title (song title), artist (artist), or even album (album) fields, and analyzes whether the string content of these fields conforms to certain implicit lyric fragment patterns.

[0058] This invention addresses the challenge of lyric recognition caused by inconsistent Bluetooth music metadata formats by employing targeted Bluetooth audio source lyric detection logic and adding targeted, conditionally triggered secondary parsing logic. It covers lyric extraction scenarios with both standard and non-standard fields, improving the comprehensiveness and accuracy of lyric detection and ensuring consistency in lyric detection standards between Bluetooth audio sources and local and cloud-based audio sources.

[0059] In one alternative implementation, step d4 includes: Step e1: Parse the song title field in the Bluetooth metadata.

[0060] Step e2: Extract the lyrics fragments from the song title field as the lyrics text content.

[0061] Specifically, when the standard lyrics field of the Bluetooth metadata is empty, the system initiates a special parsing process for the song title field. Through algorithms such as string splitting and keyword matching, the system parses the text content in the song title field, identifies and extracts the lyrics fragments embedded in a specific format (e.g., identifying the text within parentheses in the format "singer-song title [lyric fragment]"). The extracted lyrics fragments are then filled into the lyrics cache field inside the system to complete the lyrics text content, enabling the system to determine that the current Bluetooth music is in a "lyrics present" state.

[0062] This invention employs a targeted, non-standard data extraction scheme to accurately extract information from the "song title field," which is most likely to contain additional information, by utilizing its common formatting rules. By leveraging the non-standard embedded information in the Bluetooth metadata song title field, it compensates for the lack of lyrics fields in the Bluetooth protocol layer. This allows for the recognition of lyrics in Bluetooth music without modifying the underlying protocol, ensuring that Bluetooth music can adapt to split-screen collaborative layouts like other audio sources and improving the consistency of the experience across all audio source scenarios.

[0063] Figure 3 A structural schematic diagram of an embodiment of the in-vehicle cockpit music immersive visual linkage device of the present invention is shown. Figure 3 As shown, the device 300 includes: The data acquisition module 301 is used to acquire the album cover image and audio data stream of the currently playing music in response to the music playback command.

[0064] The cover color acquisition module 302 is used to extract the main color tone of the cover image to obtain at least one theme color.

[0065] The visualization module 303 is used to display dynamic visual graphics synchronized with the music rhythm on the vehicle's main screen based on theme colors and audio data streams.

[0066] In one alternative approach, the visualization module includes: Define graphic element units, used to determine the graphic elements of dynamic visualization graphics.

[0067] The music feature unit is used to perform time-frequency analysis on the audio data stream and obtain music feature parameters.

[0068] The attribute parameter determination unit is used to determine the corresponding attribute parameters based on the music characteristic parameters. These attribute parameters are used to adjust the attributes of the theme color.

[0069] A dynamic control unit is defined to map music feature parameters and attribute parameters to dynamic control parameters, which are used to control a predefined visual graphical model.

[0070] The display visualization graphics unit is used to generate and display dynamic visualization graphics synchronized with the music rhythm on the vehicle's main screen based on dynamic control parameters and graphic elements.

[0071] In one alternative embodiment, the device further includes: The control signal sending unit is used to generate a color control signal based on the theme color and send the color control signal to the in-vehicle ambient lighting control system to drive the ambient lights to present a light effect related to the theme color.

[0072] In one alternative embodiment, the apparatus further includes: The lyrics text detection module is used to respond to music playback commands, detect whether the lyrics text content of the currently playing music has been obtained, and obtain the detection result.

[0073] The display layout adjustment module is used to adjust the display layout of the vehicle's main screen based on the test results.

[0074] In one optional implementation, the display layout adjustment module includes: The first display control unit is used to control the vehicle's main screen to display dynamic visual graphics in full-screen mode if the detection result is that no lyrics text content has been obtained.

[0075] The second display control unit is used to control the vehicle's main screen to enter a split-screen collaboration mode if the detection result indicates that the lyrics text content has been obtained. The first area is used to display the lyrics text content, and the second area is used to display dynamic visual graphics.

[0076] In one optional implementation, the lyrics text detection module includes: The playback source identification unit is used to identify whether the music playback source is Bluetooth transmission.

[0077] Parse metadata unit, used to parse its metadata if it is identified as a Bluetooth transmission, and determine whether the standard lyrics field is empty.

[0078] The first unit for obtaining lyrics text content is used to determine that the lyrics text content has been obtained if the standard lyrics field is not empty.

[0079] Parse non-standard field units. If the standard lyrics field is empty, parse the non-standard field content to identify whether it includes lyrics text.

[0080] The second unit for obtaining lyrics text content is used to determine that lyrics text content has been obtained if non-standard field content includes lyrics text content.

[0081] Confirm whether to retrieve lyrics text content unit. If the non-standard field content does not include lyrics text content, it is determined that the lyrics text content has not been retrieved.

[0082] In one alternative implementation, parsing non-standard field units includes: The parsing song title field unit is used to parse the song title field in Bluetooth metadata.

[0083] The third unit, which retrieves lyrics text content, is used to extract lyrics fragments from the song title field as lyrics text content.

[0084] This invention provides an immersive visual linkage device for in-vehicle cabin music. By integrating three major functional modules—data acquisition, color feature extraction, and dynamic graphics rendering—and establishing standardized data interfaces and processing pipelines between modules, it achieves synchronous capture, fusion calculation, and real-time visualization output of visual emotional information from music album covers and audio rhythm information. This device integrates a complex task that originally required multiple independent subsystems to collaborate into a single, efficient, and collaborative processing entity. Therefore, at the system architecture level, it provides a stable, reliable, and emotionally coherent immersive audiovisual linkage capability for the cabin environment, effectively solving the technical problems of difficult visual collaboration among multiple devices and fragmented audio-visual processing workflows.

[0085] Figure 4 The diagram shows a structural schematic of an embodiment of the in-vehicle cabin music immersive visual linkage device of the present invention. The specific embodiments of the present invention do not limit the specific implementation of the in-vehicle cabin music immersive visual linkage device.

[0086] like Figure 4 As shown, the in-vehicle cockpit music immersive visual linkage device may include: processor 402, communication interface 404, memory 406, and communication bus 408.

[0087] The processor 402, communication interface 404, and memory 406 communicate with each other via communication bus 408. Communication interface 404 is used to communicate with other network elements such as clients or other servers. The processor 402 executes program 410, specifically performing the relevant steps described above in the embodiment of the in-vehicle cockpit music immersive visual linkage method.

[0088] Specifically, program 410 may include program code, which includes computer-executable instructions.

[0089] Processor 402 may be a central processing unit (CPU), an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to implement embodiments of the present invention. The in-vehicle cockpit immersive audio-visual linkage device includes one or more processors, which may be processors of the same type, such as one or more CPUs; or processors of different types, such as one or more CPUs and one or more ASICs.

[0090] Memory 406 is used to store program 410. Memory 406 may include high-speed RAM memory, and may also include non-volatile memory, such as at least one disk storage device.

[0091] This invention also provides a computer-readable storage medium. The methods described above according to embodiments of the invention can be implemented in hardware or firmware, or implemented as computer code that can be recorded on a storage medium, or implemented as computer code downloaded via a network and originally stored on a remote storage medium or a non-transitory machine-readable storage medium and then stored on a local storage medium. Thus, the methods described herein can be processed by software stored on a storage medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware. The storage medium can be a magnetic disk, optical disk, read-only memory, random access memory, flash memory, hard disk, or solid-state drive, etc.; further, the storage medium can also include combinations of the above types of memory. It is understood that computers, processors, microprocessor controllers, or programmable hardware include storage components capable of storing or receiving software or computer code, which, when accessed and executed by the computer, processor, or hardware, implements the methods shown in the above embodiments.

[0092] The algorithms or displays provided herein are not inherently related to any particular computer, virtual system, or other device. Furthermore, the embodiments of this invention are not directed to any particular programming language.

[0093] Numerous specific details are set forth in the specification provided herein. However, it will be understood that embodiments of the invention may be practiced without these specific details. Similarly, for the sake of brevity and to aid in understanding one or more aspects of the invention, in the description of exemplary embodiments of the invention above, various features of the embodiments are sometimes grouped together in a single embodiment, figure, or description thereof. The claims, which follow the detailed description, are hereby expressly incorporated into that detailed description, wherein each claim itself is a separate embodiment of the invention.

[0094] Those skilled in the art will understand that the modules in the device of the embodiment can be adaptively changed and placed in one or more devices different from that embodiment. Modules, units, or components in the embodiment can be combined into a single module, unit, or component, and further, they can be divided into multiple sub-modules, sub-units, or sub-components, except that at least some of such features and / or processes or units are mutually exclusive.

[0095] It should be noted that the above embodiments are illustrative of the invention and not restrictive, and that those skilled in the art can devise alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses should not be construed as limiting the claims. The word "comprising" does not exclude the presence of elements or steps not listed in the claims. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention can be implemented by means of hardware comprising several different elements and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by the same item of hardware. The use of the words first, second, and third, etc., does not indicate any order. These words can be interpreted as names. The steps in the above embodiments, unless otherwise specified, should not be construed as limiting the order of execution.

Claims

1. A method for immersive visual interaction in a vehicle cockpit, characterized in that, The method includes: In response to a music playback command, obtain the album art and audio data stream of the currently playing music; The cover image is subjected to primary color extraction to obtain at least one theme color; Based on the theme color and the audio data stream, a dynamic visual graphic synchronized with the music rhythm is displayed on the in-vehicle main screen.

2. The method according to claim 1, characterized in that, The display of dynamic visual graphics synchronized with the music rhythm on the vehicle's main screen based on the theme color and the audio data stream includes: Determine the graphic elements of the dynamic visualization; Time-frequency analysis is performed on the audio data stream to obtain music feature parameters; The corresponding attribute parameters are determined based on the music feature parameters, and the attribute parameters are used to adjust the attributes of the theme color; The music feature parameters and the attribute parameters are mapped to dynamic control parameters to control a predefined visual graphic model; Based on the dynamic control parameters and the graphic elements, dynamic visual graphics synchronized with the music rhythm are generated and displayed on the vehicle's main screen.

3. The method according to claim 2, characterized in that, The method further includes: A color control signal is generated based on the theme color, and the color control signal is sent to the in-vehicle ambient lighting control system to drive the ambient lighting to present a light effect related to the theme color.

4. The method according to claim 1, characterized in that, The method further includes: In response to a music playback command, detect whether the lyrics text content of the currently playing music has been obtained, and obtain the detection result; Based on the test results, adjust the display layout of the vehicle's main screen.

5. The method according to claim 4, characterized in that, Adjusting the display layout of the vehicle's main screen based on the detection results includes: If the detection result is that no lyrics text content is obtained, then the vehicle's main screen is controlled to display dynamic visual graphics in full-screen mode; If the detection result indicates that the lyrics text content has been obtained, the vehicle's main screen is controlled to enter a split-screen collaboration mode, wherein the first area is used to display the lyrics text content, and the second area is used to display the dynamic visualization graphics.

6. The method according to claim 4 or 5, characterized in that, The step of responding to a music playback command by detecting whether the lyrics text content of the currently playing music has been obtained, and obtaining the detection result, includes: It can identify whether the music playback source is transmitted via Bluetooth. If the transmission is identified as Bluetooth, the Bluetooth metadata is parsed, and the standard lyrics field is determined based on the metadata. If the lyrics field of the standard is not empty, it is determined that the lyrics text content has been obtained; If the standard lyrics field is empty, the non-standard field content is parsed to identify whether it includes the lyrics text content; If the non-standard field content includes the lyrics text content, then it is determined that the lyrics text content has been obtained; If the non-standard field content does not include the lyrics text content, then it is determined that the lyrics text content has not been obtained.

7. The method according to claim 6, characterized in that, The parsing of non-standard field content includes: Parse the song title field in Bluetooth metadata; The lyrics fragments are extracted from the song title field and used as the lyrics text content.

8. A vehicle-mounted cockpit music immersive visual linkage device, characterized in that, The device includes: The data acquisition module is used to acquire the album art and audio data stream of the currently playing music in response to music playback commands. The cover color acquisition module extracts the main color tone from the cover image to obtain at least one theme color; A visualization module is used to display dynamic visual graphics synchronized with the music rhythm on the vehicle's main screen based on the theme color and the audio data stream.

9. A vehicle-mounted cockpit music immersive visual linkage device, characterized in that, include: The processor, memory, communication interface, and communication bus are provided, wherein the processor, memory, and communication interface communicate with each other via the communication bus. The memory is used to store at least one executable instruction that causes the processor to perform the operation of the in-vehicle cockpit music immersive visual linkage method as described in any one of claims 1-7.

10. A computer-readable storage medium, characterized in that, The storage medium stores at least one executable instruction, which, when executed on the vehicle-mounted cockpit music immersive visual linkage method device / apparatus, causes the vehicle-mounted cockpit music immersive visual linkage method device / apparatus to perform the operation of the vehicle-mounted cockpit music immersive visual linkage method as described in any one of claims 1-7.

Images