Exterior entertainment interaction system, device and medium

Abstract

The invention discloses an out-of-vehicle entertainment interaction system and device and a medium, the system comprises a central control module, an out-of-vehicle loudspeaker module, an audio processing module and a vehicle lamp control module, the central control module is used for receiving audio information played by a user and sending the audio information to the out-of-vehicle loudspeaker module and the audio processing module respectively, and the vehicle lamp control module is used for controlling the vehicle lamp control module to play the audio information. The external loudspeaker module is used for converting the received audio information into sound and playing the sound through a loudspeaker, the audio processing module is used for analyzing and processing the received audio information to extract audio feature information and sending the audio feature information to the vehicle lamp control module, and the vehicle lamp control module is used for receiving the audio feature information and sending the audio feature information to the vehicle lamp control module. And according to the audio feature information, synchronous control of the vehicle lamp and the audio is realized. According to the system, through deep linkage of the loudspeaker outside the vehicle and the vehicle lamp, the flexibility and adaptability of vehicle lamp display are greatly improved, and the visual and auditory experience of a user is enriched.

Description

Technical Field

[0001] The present invention belongs to the technical field of vehicle control, and in particular relates to an out-of-vehicle entertainment interaction system, equipment and medium. Background Art

[0002] With the continuous development of intelligent cars, the functions of in-vehicle entertainment systems are gradually developing towards personalization, interaction, and intelligence, especially in terms of off-vehicle interactive entertainment, where the market demand is gradually increasing. In modern cars, in-vehicle entertainment systems have gradually realized the comprehensive application of multiple functions such as audio, video, and navigation. However, the application of off-vehicle entertainment systems is still in a relatively early stage, and the linkage effect between off-vehicle equipment (such as speakers, lights, etc.) and on-vehicle systems has not yet been fully realized. Existing off-vehicle speakers are mainly used for warnings, prompts, or simple sound output, while lights are mostly used for lighting and basic light signals.

[0003] The current external car speakers and lighting systems usually work independently, with the external car speakers only used to play audio content, while the lights are used for lighting and signal display. Therefore, car owners cannot enjoy a richer and more personalized entertainment experience. The existing dynamic effects of car lights are mostly preset simple modes, such as flowing lights or breathing lights, which cannot be adjusted or changed in real time according to the audio content played by the external car speakers. The lack of intelligent control and dynamic adjustment mechanism makes it impossible to display richer and more flexible lighting effects according to changes in audio content. The interactivity between external car speakers and lights is poor, and the dynamic linkage of audio and lighting effects cannot be achieved. This prevents car owners and people outside the car from enjoying a more immersive entertainment experience, especially from being able to perceive changes in audio content through the interaction of lights and audio outside the car. There are functional differences between different car models and different car light configurations, but most of the existing external car lighting systems cannot make dynamic adjustments according to different car light configurations. For example, models equipped with dot matrix screens can display different lighting effects and animations compared to other models, but the existing solutions cannot make dynamic adjustments for different car light configurations. Although some cars already have dot-matrix screens to display content, these displays are often static or simple information displays, lacking dynamic linkage with the content played by external speakers. Summary of the invention

[0004] The purpose of the present invention is to provide an outdoor entertainment interaction system, equipment and medium. When the system uses a speaker to play content, it adjusts the dynamic effect of the car lights in real time according to the change of audio content, and the lighting effect of the car lights changes accordingly according to the configuration type of the car lights. If it is matched with a dot matrix screen, it plays a dynamic visual effect similar to an equalizer, which solves the technical problem in the prior art that the interactivity between the outdoor speaker and the car lights is poor and it is difficult to achieve dynamic linkage of audio and lighting effects.

[0005] In order to solve the above technical problems, the present invention is achieved through the following technical solutions:

[0006] The present invention provides an out-of-car entertainment interaction system, which includes: a central control module, an out-of-car speaker module, an audio processing module and a car light control module;

[0007] The central control module is used to receive audio information played by the user, and send the audio information to the external speaker module and the audio processing module respectively;

[0008] The external speaker module is used to convert the received audio information into sound and play it through the speaker;

[0009] The audio processing module is used to analyze and process the received audio information to extract audio feature information, and send the audio feature information to the vehicle light control module;

[0010] The vehicle light control module is used to receive the audio characteristic information and realize synchronous control of the vehicle light and the audio according to the audio characteristic information.

[0011] In one embodiment of the present invention, the central control module has a built-in headlight configuration recognition module, and the headlight configuration recognition module is used to obtain the headlight configuration information of the current vehicle and send the headlight configuration information to the headlight control module.

[0012] In one embodiment of the present invention, the headlight configuration identification module identifies the type and model of the headlight through the vehicle bus or reads the hardware configuration file of the headlight to obtain the headlight configuration information of the current vehicle.

[0013] In one embodiment of the present invention, the external speaker module includes a plurality of speaker units for receiving audio information sent by the central control module and outputting corresponding audio signals according to the frequency components and volume requirements of the audio information.

[0014] In one embodiment of the present invention, the audio processing module is used to extract audio features from the received audio information using a preset audio feature extraction model, and send the extracted audio feature information to the vehicle light control module.

[0015] In one embodiment of the present invention, the audio feature information corresponds to different lighting effects, wherein the audio feature information includes frequency features, volume features, emotion features, rhythm features and style features of an audio signal.

[0016] In one embodiment of the present invention, different frequency characteristics, volume characteristics, emotional characteristics, rhythm characteristics and style characteristics correspond to different brightness, colors and light effect modes of the car lights.

[0017] In one embodiment of the present invention, the vehicle light control module includes an exterior light control unit and a dot matrix screen control unit;

[0018] The exterior light control unit is used to control the dynamic lighting effects of the vehicle exterior lights according to the audio information sent by the audio processing module;

[0019] The dot matrix screen control unit is used to dynamically display different frequency bands of audio according to the same audio information sent by the audio processing module.

[0020] Based on the same inventive concept, another embodiment of the present invention further provides an electronic device, the electronic device comprising:

[0021] one or more processors;

[0022] A storage device is used to store one or more programs. When the one or more programs are executed by the one or more processors, the electronic device implements the out-of-vehicle entertainment interaction system as described in any of the above embodiments.

[0023] Based on the same inventive concept, another embodiment of the present invention further provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor of a computer, the computer executes the out-of-vehicle entertainment interaction system as described in any of the above embodiments.

[0024] As described above, the present invention provides an out-of-car entertainment interactive system, the system includes a central control module, an out-of-car speaker module, an audio processing module and a car light control module, the central control module is used to receive the audio information played by the user, and send the audio information to the out-of-car speaker module and the audio processing module respectively, the out-of-car speaker module is used to convert the received audio information into sound, and play it through the speaker, the audio processing module is used to analyze and process the received audio information to extract audio feature information, and send the audio feature information to the car light control module, the car light control module is used to receive the audio feature information, and according to the audio feature information, realize the synchronous control of the car light and audio. The system deeply links the out-of-car speaker with the car light, so that the audio content can drive the dynamic change of the car light effect, and the audio and visual effects change synchronously, thereby greatly enhancing the immersion of the out-of-car entertainment system and the richness and interactivity of the entertainment experience. In addition, the audio is analyzed in real time, the audio features are extracted, and the light effect of the car light is adjusted in real time according to these features. At the same time, it can automatically adjust the lighting effect according to different vehicle lighting configurations (such as through-lights, dot matrix screens, etc.) to achieve personalized lighting display. Through real-time spectrum analysis, the changes in audio content are mapped to the dot matrix screen, and dynamic lighting effects similar to equalizers are displayed according to changes in audio frequency, rhythm, etc., enhancing the interactivity of vision and hearing. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for describing the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative work.

[0026] Figure 1 A schematic diagram of the structure of an out-of-vehicle entertainment interaction system provided as an exemplary embodiment of the present application.

[0027] Figure 2 A schematic structural diagram of an electronic device provided for another exemplary embodiment of the present application. DETAILED DESCRIPTION

[0028] The following describes the embodiments of the present invention by specific examples, and those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. The present invention can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present invention. It should be noted that the following embodiments and features in the embodiments can be combined with each other without conflict.

[0029] It should be noted that the illustrations provided in the following embodiments are only schematic illustrations of the basic concept of the present invention, and thus the drawings only show components related to the present invention rather than being drawn according to the number, shape and size of components in actual implementation. In actual implementation, the type, quantity and proportion of each component may be changed arbitrarily, and the component layout may also be more complicated.

[0030] In the following description, numerous details are discussed to provide a more thorough explanation of the embodiments of the present invention. However, it is obvious to those skilled in the art that the embodiments of the present invention can be implemented without these specific details. In other embodiments, well-known structures and devices are shown in the form of block diagrams rather than in detail to avoid making the embodiments of the present invention difficult to understand.

[0031] In order to solve the problems in the prior art that the external vehicle speakers and lights work independently and lack linkage, and the dynamic effects of the lights are single and lack intelligent control, the present invention provides an external vehicle entertainment interaction system. When the system uses the external vehicle speakers to play audio content, it will adjust the dynamic effects of the lights in real time according to the changes in the audio content, and the lighting effects of the lights will be adjusted accordingly according to the configuration type of the lights. If the vehicle is equipped with a dot matrix screen, it will display a dynamic visual effect similar to an equalizer.

[0032] See also Figure 1 As shown, in an exemplary embodiment of the present application, the out-of-car entertainment interaction system includes a central control module 100 (Driving Information and Entertainment Host Unit, DHU), an out-of-car speaker module 200, an audio processing module 300 (Digital Signal Processor, DSP) and a headlight control module 500. The central control module 100 is used to receive audio information played by the user, and send the audio information to the out-of-car speaker module 200 and the audio processing module 300 respectively. The out-of-car speaker module 200 is used to convert the received audio information into sound and play it through the speaker. The audio processing module 300 is used to analyze and process the received audio information to extract audio feature information, and send the audio feature information to the headlight control module 500. The headlight control module 500 is used to receive the audio feature information and realize synchronous control of the headlight and audio according to the audio feature information.

[0033] It should be noted that, in this embodiment, the central control module 100 is responsible for the coordination and management of the entire outdoor entertainment interaction system. The central control module 100 receives input signals from all other modules, performs comprehensive calculations and judgments, and outputs control signals to ensure coordinated and synchronous work among the modules.

[0034] In an exemplary embodiment of the present application, the central control module 100 is further equipped with a headlight configuration recognition module 400, which is used to obtain the headlight configuration information of the current vehicle and send the headlight configuration information to the headlight control module 500. It should be noted that the headlight configuration recognition module 400 identifies the type and model of the headlight through the vehicle bus (CAN bus) or reads the hardware configuration file of the headlight to obtain the headlight configuration information of the current vehicle.

[0035] Specifically, once the headlight configuration module 400 identifies the type and model of the headlight, it immediately sends the headlight configuration information to the headlight control module 500, and the headlight control module 500 selects a suitable lighting effect according to the specific lighting configuration in the headlight configuration information. It should be noted that in this embodiment, the lighting effects include but are not limited to running lights, breathing lights, etc. For example, during audio playback, the front and rear through lights of the vehicle can be displayed as running lights or breathing lights. As the audio signal changes, the lights flow, flicker or gradually change. In addition, if the vehicle is equipped with a dot matrix screen, the headlight control module 500 converts the audio spectrum data into dynamic lighting effects on the dot matrix screen, presenting a visual performance similar to that of an audio equalizer.

[0036] In an exemplary embodiment of the present application, the external speaker module 200 includes a plurality of speaker units, and the external speaker module 200 is used to receive the audio information sent by the central control module 100, and output a corresponding audio signal according to the frequency component and volume requirement of the audio information. It should be noted that when the external speaker plays the audio content, the car lights also automatically adjust the lighting effects according to the different contents of the audio.

[0037] In an exemplary embodiment of the present application, the audio processing module 300 is used to extract audio features from the received audio information using a preset audio feature extraction model, and send the extracted audio feature information to the car light control module. It should be noted that the audio feature information corresponds to different lighting effects, wherein the audio feature information includes frequency features, volume features, emotional features, rhythm features and style features of the audio signal. It is worth noting that different frequency features, volume features, emotional features, rhythm features and style features correspond to different brightness, colors and lighting effect modes of the car lights. In this embodiment, the lighting effect mode of the car lights is dynamically adjusted according to these audio features. For example, high-frequency audio may correspond to fast-flashing bright lights, while low-frequency audio may correspond to slowly changing dark lights.

[0038] Specifically, the audio processing module 300 uses a preset audio feature extraction model to analyze the frequency, rhythm, volume, emotion and other features in the audio signal, extracts dynamic data related to the audio, and transmits it to the external light control unit 510 and the dot matrix screen control unit 520 to drive the real-time changes of the light and display effects. In this embodiment, the emotional features include but are not limited to happiness, sadness, excitement and calmness, etc., and the frequency features include but are not limited to low frequency, medium frequency and high frequency. In other embodiments, different frequency thresholds can also be set to divide the frequency features into low frequency, medium-low frequency, medium frequency, medium-high frequency and high frequency.

[0039] In an exemplary embodiment of the present application, the vehicle light control module 500 includes an exterior light control unit 510 and a dot matrix screen control unit 520. The exterior light control unit 510 is used to control the dynamic lighting effects of the vehicle exterior lights according to the audio information sent by the audio processing module 300, and the dot matrix screen control unit 520 is used to dynamically display different frequency bands of audio according to the same audio information sent by the audio processing module 300.

[0040] Specifically, the exterior light control unit 510 controls the lighting performance of the vehicle exterior lights by receiving audio data from the audio processing module 300. According to the characteristics of the audio (such as frequency characteristics, etc.), the exterior light control unit 510 determines the display mode of different lighting effects. It should be noted that the type of vehicle lights will also affect the style and performance of the lighting effects. In this embodiment, the types of vehicle lights include but are not limited to through lights, tail lights and dot matrix screen lights. The dot matrix screen control unit 520 works in coordination with the exterior light control unit 510. The dot matrix screen control unit 520 maps the spectrum data sent by the audio processing module 300 to the dot matrix screen to generate a visual dynamic effect similar to an audio equalizer. It should be noted that the display of the dot matrix screen is not just a basic lighting effect, but dynamically displays each frequency band of the audio by analyzing the spectrum of the audio in real time. In this embodiment, the audio spectrum analysis technology is used to convert the audio content into a dynamic visual effect in real time. Specifically, the display effect of the dot matrix screen is similar to that of an audio equalizer. As the frequency of the audio changes, the position and brightness of the light spots on the dot matrix screen will also change synchronously. The high frequency part may appear as a brighter area, while the low frequency part appears as a more gradual brightness change. The dot matrix screen does not only display a fixed pattern, but also adjusts the dot matrix pattern in real time according to the spectral characteristics of the audio. As the audio content changes, the dot matrix screen displays the spectrum energy fluctuations of different frequency bands, enhancing the interactive experience of vision and hearing.

[0041] In an exemplary embodiment of the present application, the audio feature extraction model of the audio processing module 300 deeply analyzes the high-level features of the audio signal such as emotion, rhythm, style, etc. by combining a machine learning algorithm (especially a deep learning model), and further improves the linkage performance of light and audio. Specifically, the audio signal is emotionally analyzed by a deep neural network (DNN) to identify emotional features such as happiness, sadness, excitement, and calmness. According to these different emotions, the audio processing module 300 can flexibly adjust the lighting effect performance of the car lights and the dot matrix screen. For example, when happy, the light will show higher brightness and fast flashing, and when sad, it will show lower brightness and gradual effect. At the same time, the audio processing module 300 also uses a machine learning algorithm to accurately identify the rhythm and beat of the audio signal, and intelligently judge the speed, beat and rhythm change of the audio. Through the training data, the rhythm characteristics of different types of music (such as rock, electronic, classical, etc.) are pre-understood, and the audio processing module 300 can adjust the flashing frequency and change mode of the light effect in real time to achieve more accurate synchronization. In addition, by training the audio classification model, it is possible to accurately identify the style or genre of the audio, and adjust the brightness, motion effects and frequency response of the lights according to different types of music (such as electronic music, rock, jazz, etc.), so that the lighting effects complement the overall atmosphere of the music.

[0042] In this embodiment, the audio processing module 300 extracts the low-frequency, medium-frequency and high-frequency parts by analyzing the frequency characteristics of the audio signal in real time. Low-frequency signals are usually associated with the gradual change or breathing effect of the vehicle lights, while high-frequency signals drive more dynamic and flickering lighting effects. Not only the frequency, but also the rhythm of the audio (i.e., the speed and beat of the notes) will affect the frequency of change of the lights. For example, when the audio is played at a high rhythm, the speed of the lights will increase, showing faster lighting dynamics, and vice versa. The audio processing module 300 can also adjust the atmosphere of the lights according to the emotional color of the audio, and adjust the brightness of the lights according to the changes in pitch. For example, low-frequency audio may make the lights appear low-brightness, representing a lower, more intense note, while high-frequency audio can make the lights appear high-brightness, giving a clear feeling.

[0043] In summary, the present invention provides an out-of-car entertainment interactive system, the system includes a central control module 100, an out-of-car speaker module 200, an audio processing module 300 and a car light control module 500, the central control module 500 is used to receive the audio information played by the user, and send the audio information to the out-of-car speaker module 200 and the audio processing module 300 respectively, the out-of-car speaker module 200 is used to convert the received audio information into sound, and play it through the speaker, the audio processing module 300 is used to analyze and process the received audio information to extract audio feature information, and send the audio feature information to the car light control module 500, the car light control module 500 is used to receive the audio feature information, and according to the audio feature information, realize the synchronous control of the car light and audio. The system deeply links the out-of-car speaker with the car light, so that the audio content can drive the dynamic change of the car light effect, and the audio and visual effects change synchronously, thereby greatly enhancing the immersion of the out-of-car entertainment system and the richness and interactivity of the entertainment experience. In addition, the audio is analyzed in real time to extract audio features, and the lighting effects of the headlights are adjusted in real time based on these features. At the same time, the lighting effects can be automatically adjusted according to different headlight configurations (such as through-lights, dot matrix screens, etc.) to achieve personalized lighting displays. If the vehicle is equipped with a dot matrix screen, the changes in the audio content are mapped to the dot matrix screen through real-time spectrum analysis, and dynamic lighting effects similar to equalizers are displayed based on changes in the frequency and rhythm of the audio, enhancing the interactivity of vision and hearing.

[0044] Based on the same inventive concept, please refer to Figure 2 As shown, another embodiment of the present invention further provides an electronic device 1, which may include a memory 12, a processor 13 and a bus 11, and may also include a computer program stored in the memory 12 and executable on the processor 13, such as an out-of-vehicle entertainment interaction program.

[0045] Among them, the memory 12 includes at least one type of readable storage medium, and the readable storage medium includes flash memory, mobile hard disk, multimedia card, card-type memory (for example: SD or DX memory, etc.), magnetic memory, disk, optical disk, etc. In some embodiments, the memory 12 can be an internal storage unit of the electronic device 1, such as a mobile hard disk of the electronic device 1. In other embodiments, the memory 12 can also be an external storage device of the electronic device 1, such as a plug-in mobile hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. equipped on the electronic device 1. Further, the memory 12 can also include both an internal storage unit of the electronic device 1 and an external storage device. The memory 12 can not only be used to store application software and various types of data installed in the electronic device 1, such as codes for off-board entertainment interaction, etc., but can also be used to temporarily store data that has been output or is to be output.

[0046] In some embodiments, the processor 13 may be composed of an integrated circuit, for example, a single packaged integrated circuit, or a plurality of packaged integrated circuits with the same or different functions, including one or more central processing units (CPUs), microprocessors, digital processing chips, graphics processors, and a combination of various control chips. The processor 13 is the control core (Control Unit) of the electronic device 1, and uses various interfaces and lines to connect the various components of the entire electronic device 1, and executes or executes the programs or modules (such as the off-board entertainment interactive program, etc.) stored in the memory 12, and calls the data stored in the memory 12 to execute various functions of the electronic device 1 and process data.

[0047] The processor 13 executes the operating system and various installed applications of the electronic device 1. The processor 13 executes the applications to implement the steps in the above-mentioned out-of-vehicle entertainment interaction system.

[0048] Exemplarily, the computer program may be divided into one or more modules, which are stored in the memory 12 and executed by the processor 13 to complete the present application. The one or more modules may be a series of computer program instruction segments capable of completing specific functions, which are used to describe the execution process of the computer program in the electronic device 1.

[0049] The above-mentioned integrated unit implemented in the form of a software function module can be stored in a computer-readable storage medium, and the computer-readable storage medium can be non-volatile or volatile. The above-mentioned software function module is stored in a storage medium, including a number of instructions for enabling a computer device (which can be a personal computer, a computer device, or a network device, etc.) or a processor to perform part of the functions of the out-of-car entertainment interaction system described in each embodiment of the present application.

[0050] The above embodiments are merely illustrative of the principles and effects of the present invention, and are not intended to limit the present invention. Anyone familiar with the art may modify or alter the above embodiments without departing from the spirit and scope of the present invention. Therefore, all equivalent modifications or alterations made by a person of ordinary skill in the art without departing from the spirit and technical concept disclosed by the present invention shall still be covered by the claims of the present invention.

Claims

1. An out-of-car entertainment interactive system, characterized in that: include: Central control module, exterior speaker module, audio processing module and lighting control module; The central control module is used to receive audio information played by the user, and send the audio information to the external speaker module and the audio processing module respectively; The external speaker module is used to convert the received audio information into sound and play it through the speaker; The audio processing module is used to analyze and process the received audio information to extract audio feature information, and send the audio feature information to the vehicle light control module; The vehicle light control module is used to receive the audio characteristic information and realize synchronous control of the vehicle light and the audio according to the audio characteristic information.

2. The out-of-car entertainment interactive system according to claim 1, characterized in that: The central control module has a built-in headlight configuration recognition module, and the headlight configuration recognition module is used to obtain the headlight configuration information of the current vehicle and send the headlight configuration information to the headlight control module.

3. The out-of-car entertainment interactive system according to claim 2, characterized in that: The vehicle light configuration identification module identifies the type and model of the vehicle light through the vehicle bus or by reading the hardware configuration file of the vehicle light to obtain the vehicle light configuration information of the current vehicle.

4. The out-of-car entertainment interactive system according to claim 1, characterized in that: The external speaker module includes a plurality of speaker units, which are used to receive the audio information sent by the central control module and output corresponding audio signals according to the frequency components and volume requirements of the audio information.

5. The out-of-car entertainment interactive system according to claim 1, characterized in that: The audio processing module is used to extract audio features from the received audio information using a preset audio feature extraction model, and send the extracted audio feature information to the vehicle light control module.

6. The out-of-car entertainment interactive system according to claim 5, characterized in that: The audio feature information corresponds to different lighting effects, wherein the audio feature information includes frequency features, volume features, emotion features, rhythm features and style features of the audio signal.

7. The out-of-car entertainment interactive system according to claim 6, characterized in that: Different frequency characteristics, volume characteristics, emotional characteristics, rhythm characteristics and style characteristics correspond to different brightness, colors and light effect modes of the car lights.

8. The out-of-car entertainment interactive system according to claim 1, characterized in that: The vehicle light control module includes an exterior light control unit and a dot matrix screen control unit; The exterior light control unit is used to control the dynamic lighting effects of the vehicle exterior lights according to the audio information sent by the audio processing module; The dot matrix screen control unit is used to dynamically display different frequency bands of audio according to the same audio information sent by the audio processing module.

9. An electronic device, characterized in that: The electronic device comprises: one or more processors; A storage device for storing one or more programs, which, when executed by the one or more processors, enables the electronic device to implement the out-of-vehicle entertainment interaction system as described in any one of claims 1 to 8.

10. A computer-readable storage medium, characterized in that: A computer program is stored thereon, and when the computer program is executed by a processor of a computer, the computer is enabled to execute the out-of-vehicle entertainment interaction system as claimed in any one of claims 1 to 8.

Images