A scene-based music audiovisual method and system

Abstract

The application discloses a kind of music audio-visual methods and systems based on scene, it is related to music audio-visual technical field, including: preset daily scene on car machine, and open scene customization function, and user can custom setting scene;When user voice or trigger corresponding scene, car machine can call corresponding setting;While playing music, the real-time frequency point of audio is parsed, and the dynamic effect that car machine display screen shows according to frequency point distribution beats, and atmosphere lamp beats according to frequency point distribution situation;When user triggers scene, car machine sends corresponding car set signal, and each controller completes corresponding instruction.The music audio-visual method based on scene provided by the application provides more abundant music audio-visual experience for user, by scene matching, makes vehicle internal environment consistent with the current situation of user, improves driving comfort, automatically and online music platform are connected, without user manual search and selection, save time, improve convenience.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of music audio-visual technology, in particular to a music audio-visual method and system based on scenes. BACKGROUND

[0002] With the popularity of private cars, cars have become a mobile private space for people. And with the rise of car camping, a new eco-tourism way, vehicles are not only a means of transportation, but also a space for people to relax and entertain. The main way for people to relax and entertain in the car is to play music. Currently, the basic function provided by vehicles is to play music, which cannot meet the user's usage scenarios.

[0003] In order to meet the user's more usage scenarios of music and improve the user experience, the present application provides a music audio-visual method based on scenes. SUMMARY

[0004] This section aims to summarize some aspects of the embodiments of the present application and briefly introduce some preferred embodiments. Some simplifications or omissions may be made in this section and the abstract and title of the specification to avoid obscuring the purpose of this section, abstract and title, and such simplifications or omissions cannot be used to limit the scope of the present application.

[0005] In view of the above problems, the present application is proposed.

[0006] Therefore, the technical problem solved by the present application is that the existing vehicle-mounted music playing system cannot automatically select and match appropriate music according to the real-time state of the vehicle and environmental conditions, and how to optimize the matching between music playing and vehicle state and environmental conditions.

[0007] To solve the above technical problems, the present application provides the following technical scheme: a music audio-visual method based on scenes, comprising: presetting daily scenes on the car machine, and opening the scene customization function, which allows users to customize and set scenes; when the user triggers the corresponding scene by voice or action, the car machine can call the corresponding settings; while playing music, the real-time frequency points of the audio are analyzed, and the car machine display screen displays the dynamic effect of the rhythm according to the frequency point distribution, and the atmosphere lamp performs corresponding rhythm according to the frequency point distribution; when the user triggers the scene, the car machine sends corresponding vehicle setting signals, and each controller completes the corresponding instructions.

[0008] As a preferred scheme of the music audio-visual method based on scenes, the judgment of whether to reach the stopping condition to get the optimal result comprises: the triggering of the corresponding scene includes the analysis and judgment of the car machine according to the current vehicle speed, vehicle gear, light intensity and rainfall conditions;

[0009] When it is confirmed that the vehicle meets the condition of triggering the scene, the car machine calls the user-defined setting scene to select the appropriate scene setting;

[0010] The car machine communicates with the online music platform to obtain the music resources matched with the selected scene number for playing;

[0011] The car machine converts the selected scene number into specific vehicle setting commands and sends instructions to the control systems of the vehicle to complete the corresponding vehicle setting adjustment, so as to realize the synchronous adjustment of the overall scene music visual and auditory experience.

[0012] As a preferred scheme of the scene-based music visual and auditory method, the judgment of whether the stop condition is met to obtain the optimal result includes that the precondition includes the defined parameters of vehicle speed v, vehicle gear g, light intensity l and rainfall amount r, when v < 60 km / h, g < 3, l < 500 lux and r = 0, the scene number is 1, and the first driving mode is judged, when v > 100 km / h, g >= 4, l < 300 lux and r > 10 mm / h, the scene number is 2, and the second driving mode is judged, and if the parameters do not meet the scene number 1 and the scene number 2, the scene number is 0, and the third driving mode is judged;

[0013] The car machine calls the preset scene configuration according to the determined scene number, the scene configuration includes the corresponding music resources, dynamic effect display and vehicle setting adjustment parameters, and communicates with the online music platform to obtain the matched music resources for playing;

[0014] The car machine converts the selected scene number and the corresponding configuration into specific vehicle setting commands and sends instructions to the control systems of the vehicle to complete the corresponding vehicle setting adjustment, so as to realize the synchronous adjustment of the overall scene music visual and auditory experience.

[0015] As a preferred scheme of the scene-based music visual and auditory method, the judgment of whether the stop condition is met to obtain the optimal result includes that the analysis of the real-time frequency point of the audio includes that the sampling frequency range is set to 20 Hz-20 KHz and the sampling period is 50 ms through the Visualizer tool to obtain the pulse code modulation data stream of the audio;

[0016] Through the fast Fourier transform, the sampling number is set to 512 in the conversion, 512 frequency sampling points are uniformly inserted in the sampling range, and the PCM data stream of the audio is converted into an array of sampling frequency and corresponding amplitude;

[0017] Since the amplitude value has a negative number and an imaginary part, the real part square and the imaginary part square of the amplitude value are summed and taken the square root to convert into a real number to obtain the frequency and the corresponding amplitude value;

[0018] The car machine display screen is arranged according to the low-to-high order of frequency sampling according to 512 sampling frequency points and corresponding amplitude values, and the corresponding amplitude values are displayed according to the graphic height of UI design, the image height changes with the sampling period, and the dynamic effect of rhythm is formed;

[0019] The 512 sampling points are removed from the first three and the last three sampling points, the amplitude values of two adjacent sampling points are added according to the sampling point order, and the sequence number and the amplitude value are renumbered and sorted to obtain 253 arrays, and each sequence number is matched with the color of the 253 atmosphere lamps, the color corresponding to the sequence number in the array with the maximum amplitude value is set as the color of the atmosphere lamp at this time, the color of the atmosphere lamp is changed with the rhythm period to form the atmosphere lamp rhythm, when the user triggers the scene, the car machine sends the vehicle setting signal corresponding to the scene, and the controller completes the corresponding instruction.

[0020] As a preferred scheme of the scene-based music audio-visual method, the judgment of whether the stop condition is reached to obtain the optimal result comprises: the corresponding rhythm comprises a sliding average processing of the amplitude array obtained by the sampling period, the average amplitude of the first five sampling periods is calculated, and the brightness adjustment strategy is executed.

[0021] The sliding average processing is represented as,

[0022]

[0023] Wherein, SMA i Indicates the average amplitude, A j Indicates the amplitude obtained in the jth sampling period, i indicates the sequence number of the current sampling period, and n indicates the number of sampling periods, Indicates the sum of all values from i-n+1 to i.

[0024] As a preferred scheme of the scene-based music audio-visual method, the judgment of whether the stop condition is reached to obtain the optimal result comprises: the controller completes the corresponding instruction, which comprises: when it is judged that the first driving mode, the warm driving mode is activated, when it is judged that the second driving mode, the active driving mode is activated, and when it is judged that the third driving mode, the standard driving mode is activated, the car machine sends the corresponding vehicle setting signal and communicates with each vehicle control system, converts the scene number or voice instruction into a specific vehicle setting command, adjusts the setting according to the real-time vehicle speed or the vehicle environment, communicates with the car machine through the online music platform, and plays the music resource matched with the scene number.

[0025] As a preferred scheme of the scene-based music audio-visual method, the judgment of whether the stop condition is met comprises: if the first driving mode is set, when the air quality in the vehicle is detected to decrease by more than a preset threshold, the air purification system is started, the air purification voice prompt is played, when the temperature is sensed to be lower than a preset threshold, the seat heating is started, the atmosphere lamp is switched to a warm color, and when the external light intensity is detected to be lower than a preset threshold, the standby atmosphere lamp is started.

[0026] If the second driving mode is set, when the relative speed is detected to be greater than a preset threshold, the seat support is started, when the external noise is detected by the environmental noise sensor to be greater than a preset threshold, the in-vehicle sound insulation mode is started, and the music volume level is increased, and when the vehicle detects that the driver continuously drives for more than two hours, the atmosphere lamp periodically changes to a bright color.

[0027] If the third driving mode is set, the sound effect of the in-vehicle sound system is adjusted according to the feedback of the in-vehicle passenger quantity sensor, when the rain amount sensor detects that the rain amount increases by more than a preset threshold, the window is closed, the atmosphere lamp is switched to a blue color, and the music is switched to a quiet mode, and when the vehicle CO2 sensor detects that the in-vehicle CO2 concentration rises by more than a preset threshold, the fresh air system is started.

[0028] Another object of the present application is to provide a scene-based music audio-visual system, which can automatically select music and vehicle settings matched with the current scene through real-time monitoring and analysis of the vehicle state and environmental conditions, thereby solving the problem of mismatch between vehicle music playing and vehicle state and environmental conditions.

[0029] To solve the above technical problems, the present application provides the following technical scheme: a scene-based music audio-visual system, comprising: an environmental perception module, a scene matching module, a personalized setting module, and an environmental feature module; the environmental perception module is used for real-time monitoring and analysis of environmental parameters to provide input data for the scene matching module; the scene matching module is used for identifying the current environmental scene according to the data collected by the environmental perception module to provide scene information; the personalized setting module is used for adjusting music and environmental parameters according to the scene and the personalized settings of the user, continuously optimizing personalized recommendations through machine learning, and learning the preferences and habits of the user; and the environmental feature module is used for receiving data transmitted from the scene matching module and the personalized setting module, adjusting environmental features, real-time monitoring of environmental changes, and automatically adjusting the features to maintain the best state.

[0030] A computer device comprises a memory and a processor, the memory stores a computer program, and the processor implements the steps of the scene-based music audio-visual method when executing the computer program.

[0031] A computer readable storage medium, having stored thereon a computer program, wherein the computer program is executed by a processor to implement the steps of the scene-based music and video method as described above.

[0032] The scene-based music and video method provided by the present application provides users with a more rich music and video experience, makes driving more interesting and personalized, matches the vehicle interior environment with the current situation of the user through scene matching, improves driving comfort, automatically interfaces with an online music platform, and saves time and improves convenience without manual searching and selection by the user. BRIEF DESCRIPTION OF DRAWINGS

[0033] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiment description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor. Among them:

[0034] Figure 1 The overall flowchart of a scene-based music and video method provided by an embodiment of the present application.

[0035] Figure 2 The data processing process in a scene-based music and video method provided by the first embodiment of the present application.

[0036] Figure 3 The sequence number and atmosphere lamp color correspondence diagram of a scene-based music and video method provided by the first embodiment of the present application.

[0037] Figure 4 The overall structure diagram of a scene-based music and video system provided by the second embodiment of the present application. DETAILED DESCRIPTION

[0038] In order to make the above-mentioned purposes, features and advantages of the present application more obvious and easy to understand, the specific embodiments of the present application will be described in detail below with reference to the drawings in the specification. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor should be within the scope of protection of the present application.

[0039] In the following description, many specific details are set forth in order to provide a thorough understanding of the present application, but the present application can also be implemented in other ways different from those described herein, and those skilled in the art can make similar generalizations without departing from the scope of the present application. Therefore, the present application is not limited to the specific embodiments disclosed below.

[0040] Secondly, the term “one embodiment” or “an embodiment” as used herein means that a particular implementation can include a particular feature, structure, or characteristic, but every embodiment can not necessarily include the particular feature, structure, or characteristic. Furthermore, the appearances of the term “in one embodiment” or “in an embodiment” in various places in the specification are not necessarily all referring to the same embodiment, nor are they necessarily mutually exclusive.

[0041] The application is described in detail in conjunction with the schematic drawings. In the detailed description of the embodiments of the application, the sectional views of the device structure are partially enlarged without the general scale for the convenience of illustration, and the schematic drawings are only examples, which should not limit the scope of protection of the application. In addition, the three-dimensional spatial dimensions of length, width and depth should be included in actual production.

[0042] Meanwhile, in the description of the application, it should be noted that the terms “up, down, inner and outer” indicate the orientation or positional relationship based on the orientation or positional relationship shown in the drawings, which is only for the convenience of describing the application and simplifying the description, and does not indicate or imply that the device or element referred to must have a particular orientation, be constructed and operated in a particular orientation, and therefore cannot be understood as a limitation on the application. In addition, the terms “first, second or third” are only for descriptive purposes and cannot be understood as indicating or implying relative importance.

[0043] Unless otherwise specifically defined and limited, the terms “mounting, connecting, connection” in the application should be understood broadly, for example: it can be fixed connection, detachable connection or integral connection; it can also be mechanical connection, electrical connection or direct connection, it can also be indirectly connected through intermediate medium, or it can be the communication between two elements. For those skilled in the art, the specific meaning of the above terms in the application can be understood according to the specific circumstances.

[0044] Embodiment 1

[0045] Reference Figures 1-3 For an embodiment of the application, a scene-based music audiovisual method is provided, comprising:

[0046] The daily scene is preset on the car machine, and the scene customization function is opened, so that the user can customize and set the scene.

[0047] When the user voice or triggers the corresponding scene, the car machine can call the corresponding settings.

[0048] While playing music, the real-time frequency point of the audio is analyzed, the car machine display screen displays the dynamic effect of the rhythm according to the frequency point distribution, and the atmosphere lamp performs corresponding rhythm according to the frequency point distribution.

[0049] When the user triggers the scene, the car machine sends corresponding car setting signals, and each controller completes the corresponding instructions.

[0050] The triggering of the corresponding scene includes that the car machine analyzes and judges according to the current vehicle speed, vehicle gear, light intensity and rainfall condition; when it is confirmed that the vehicle meets the conditions of triggering the scene, the car machine calls the user-defined setting scene, so as to select the appropriate scene setting; the car machine communicates with the online music platform to obtain the music resources matched with the selected scene number for playing; the car machine converts the selected scene number into specific vehicle setting commands and sends instructions to the vehicle control system to complete the corresponding vehicle adjustment, so as to realize the synchronous adjustment of the overall scene music visual and auditory experience.

[0051] The precondition includes defining parameters of vehicle speed v, vehicle gear g, light intensity l and rainfall condition r; when v < 60 km / h, g < 3, l < 500 lux and r = 0, the scene number is 1, and the first driving mode is judged; when v > 100 km / h, g ≥ 4, l < 300 lux and r > 10 mm / h, the scene number is 2, and the second driving mode is judged; if the parameters do not meet the scene number 1 and the scene number 2, the scene number is 0, and the third driving mode is judged;

[0052] The car machine calls the preset scene configuration according to the determined scene number, the scene configuration includes corresponding music resources, dynamic effect display and vehicle adjustment parameters, and communicates with the online music platform to obtain the matched music resources for playing; the car machine converts the selected scene number and the corresponding configuration into specific vehicle setting commands and sends instructions to the vehicle control system to complete the corresponding vehicle adjustment, so as to realize the synchronous adjustment of the overall scene music visual and auditory experience.

[0053] As shown in Figure 2 The real-time frequency point of the audio is analyzed, including that the Visualizer tool is used to set the sampling frequency range to 20 Hz-20 KHz and the sampling period to 50 ms to obtain the pulse code modulation data stream of the audio; the fast Fourier transform is used, and in the conversion, the number of samples is set to 512, 512 frequency sampling points are uniformly inserted in the sampling range, the PCM data stream of the audio is converted into an array of sampling frequency and corresponding amplitude; since the amplitude values have negative numbers and imaginary parts, the sum of the squares of the real part and the imaginary part of the amplitude values is taken to obtain the real number, and the frequency and the corresponding amplitude value are obtained; the car machine display screen arranges the 512 sampling frequency points and the corresponding amplitude values in the order from low to high according to the frequency sampling, and displays the corresponding amplitude values according to the height of the UI design graph, the image height changes with the sampling period, and a dynamic effect is formed; the 512 sampling points are removed from the first three and the last three sampling points, the amplitude values of the adjacent two sampling points are added according to the sampling point order, and the sequence number and the amplitude value are renumbered and sorted to obtain 253 arrays, and each sequence number is matched with 253 kinds of atmosphere lamp colors.Figure 3 As shown, the color corresponding to the serial number in the array with the maximum amplitude is set as the color of the atmosphere lamp at this time, and the color changes with the rhythm period to form the atmosphere lamp rhythm. When the user triggers the scene, the vehicle machine sends a vehicle setting signal corresponding to the scene, and the controller completes the corresponding instructions. The rhythm period is an integer multiple of the sampling period, and the rhythm periods of different scenes are different.

[0054] The corresponding rhythm includes performing a moving average processing on the amplitude array obtained in the sampling period, calculating the average amplitude of the previous 5 sampling periods, and executing the brightness adjustment strategy.

[0055] The moving average processing is represented as,

[0056]

[0057] wherein SMA i represents the average amplitude, A j represents the amplitude obtained in the jth sampling period, i represents the serial number of the current sampling period, and n represents the number of sampling periods, represents the sum of all values from i-n+1 to i.

[0058] The default brightness L default is used at the beginning. First, the change rate δSMA i of the average amplitude SMA i is judged. If the rate is greater than a preset rate threshold R, the rate-sensitive mode is entered, otherwise, the normal mode is entered to adjust the brightness.

[0059] When in the rate-sensitive mode, the brightness adjustment will be more significant and the response to the change of music will be faster.

[0060] L'=L+α×δSMA i

[0061] wherein α is a coefficient greater than that in the normal mode.

[0062] When in the normal mode, a non-linear brightness adjustment is used to obtain a smooth brightness change:

[0063]

[0064] wherein β is a preset coefficient smaller than α.

[0065] After adjusting the brightness each time, it is checked whether the new brightness exceeds the allowed maximum and minimum brightness values. If it does, the brightness is adjusted back to within the allowed range. If it is detected that the vehicle is stationary or the music stops for more than a preset time threshold, the brightness is returned to the default state.

[0066] The controller completes the corresponding instructions, including when it is judged that the first driving mode, activating the warm driving mode, reducing the noise inside the vehicle through the vehicle communication module, adjusting the seat to the warming massage state, setting the atmosphere lamp to the warm color, and playing soft music to increase comfort, when it is judged that the second driving mode, activating the exciting driving mode, enhancing the engine sound through the vehicle communication module, adjusting the seat support to the sports mode, setting the atmosphere lamp to the energetic color, and playing music with strong rhythm to enhance driving passion, when it is judged that the third driving mode, activating the standard driving mode, restoring the vehicle settings to the default state preset by the user through the vehicle communication module, including the seat position, atmosphere lamp color and music selection, the vehicle machine sends corresponding vehicle setting signals to communicate with each vehicle control system, converts the scene number or voice instruction into a specific vehicle setting command, adjusts the setting according to the real-time vehicle speed or the vehicle environment, and communicates with the vehicle machine through the online music platform to play the music resources matched with the scene number.

[0067] The fine-tuning setting includes, if in the first driving mode, starting the air purification system when detecting that the air quality inside the vehicle decreases by more than a preset threshold, playing a purified air voice prompt, starting the seat heating when sensing that the temperature is lower than a preset threshold, and switching the atmosphere lamp to a warm color when detecting that the external light intensity is lower than a preset threshold;

[0068] If in the second driving mode, starting the seat support when detecting that the relative speed is greater than a preset threshold, starting the vehicle interior sound insulation mode when the environmental noise sensor detects that the external noise is greater than a preset threshold, and increasing the music volume level when the vehicle machine detects that the driver has been driving continuously for more than two hours, the atmosphere lamp will periodically change to a prominent color;

[0069] If in the third driving mode, adjusting the sound effect of the vehicle audio system according to the feedback of the vehicle passenger number sensor, closing the window when the vehicle rain sensor detects that the rainfall increases by more than a preset threshold, switching the atmosphere lamp to a blue color, and switching the music to a quiet mode when the vehicle CO2 sensor detects that the CO2 concentration inside the vehicle rises by more than a preset threshold, starting the fresh air system.

[0070] Embodiment 2

[0071] Reference Figure 4 For an embodiment of the present application, a scene-based music audio-visual system is provided, comprising: an environment perception module, a scene matching module, a personalized setting module, and an environment feature module.

[0072] The environment perception module is used to monitor and analyze environmental parameters in real time, and provides input data for the scene matching module.

[0073] The scene matching module is used to identify the current environmental scene according to the data collected by the environment perception module, and provide scene information.

[0074] The personalized setting module is used to adjust the music and environment parameters according to the scene and the user's personalized settings, continuously optimize the personalized recommendations through machine learning, and learn the user's preferences and habits.

[0075] The environment feature module is used to receive data transmitted from the scene matching module and the personalized setting module, adjust the environment features, monitor the environmental changes in real time, and automatically adjust the features to maintain the optimal state.

[0076] Embodiment 3

[0077] One embodiment of the present application, which is different from the first two embodiments, is as follows:

[0078] If the functions are realized in the form of software function units and sold or used as independent products, they can be stored in a computer readable storage medium. Based on this understanding, the technical solutions of the present application or the parts of the present application that essentially contribute to the prior art or the parts of the technical solutions can be embodied in the form of software products, which are stored in a storage medium and include a plurality of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk or an optical disk, and various program code storage media.

[0079] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered a list of executable instructions for implementing logic functions, and can be specifically embodied in any computer-readable medium for use by an instruction execution system, apparatus or device, such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, apparatus or device and execute the instructions, or in conjunction with these instructions execution systems, apparatus or devices. For the purpose of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transport programs for use by an instruction execution system, apparatus or device, or in conjunction with these instruction execution systems, apparatus or devices.

[0080] More specific examples (a non-exhaustive list) of the computer-readable medium include the following: an electrical connection (electronic) having one or more wires, a portable computer diskette (magnetic), a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, and a portable compact disc read-only memory (CDROM). Additionally, the computer readable medium can be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, for example via optical scanning of the paper or other medium, then compiled, interpreted, or otherwise processed in a suitable manner, if necessary, and stored in a computer memory.

[0081] It should be understood that aspects of the application can be implemented in hardware, software, firmware or combinations thereof. In the embodiments described above, various steps or methods can be implemented, in part, or in whole, in software, or firmware that is stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any of the following techniques, or combinations thereof, can be utilized to implement at least a portion of the described functionality: discrete logic circuitry having logic gates for implementing logic functions upon data signals, application specific integrated circuits having logic gates, programmable gate arrays (PGA), field programmable gate arrays (FPGA), and so forth.

[0082] Example 4

[0083] For an embodiment of the present application, a scene-based music audio-visual method is provided, and in order to verify the beneficial effects of the present application, economic benefit calculation and simulation experiments are carried out for scientific demonstration.

[0084] The present application and the traditional method are respectively simulated in a preset scene, and the music selection, ambient light color, vehicle equipment adjustment, and driver satisfaction are compared, and the experimental results are shown in Table 1.

[0085] Table 1 Comparison of experimental results

[0086] Scenario Method Music selection Ambient light color Vehicle equipment adjustment Driver satisfaction 1 Traditional method Pop tune Blue Default 5 1 Our invented method Light music Warm color Seat fine-tuning, breeze 8 2 Traditional method Pop tune Blue Default 6 2 Our invented method Dynamic music Purple Seat support, soundproofing 9 3 Traditional method Pop tune Blue Default 4 3 Our invented method Peaceful tune Green Air conditioning activation 7

[0087] In various driving scenes, the music selection of the present application method is more in line with the driving environment, enhancing the immersion of the driver, the ambient light color change of the present application method is more matched with the driving environment, helping the emotional regulation of the driver, the present application method can adjust the vehicle equipment according to different driving scenes, improving the comfort of the driver, and the driver satisfaction score obtained by the present application method is higher than that of the traditional method.

[0088] The vehicle-mounted music playing system of the traditional method only provides a fixed music playing function, and the user needs to manually search and select music, which is not associated with the real-time state of the vehicle and external environmental conditions. However, the method of the present application automatically selects and matches appropriate music and atmosphere lamp effects through interaction with the vehicle state and external environmental conditions, greatly enhancing the user's driving experience. In addition, the method of the present application also fully interacts with other vehicle-mounted devices, such as seat warming, air purification systems, etc., to provide a more complete and comfortable driving environment for the user. Therefore, the method of the present application has obvious advantages over the traditional method in providing rich music visual and audio experience, enhancing driving comfort, improving operation convenience, etc.

[0089] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present application and are not limiting. Although the present application has been described in detail with reference to the preferred embodiments, it should be understood by those skilled in the art that the technical solutions of the present application can be modified or replaced by equivalents without departing from the spirit and scope of the technical solutions of the present application, which should be covered by the scope of the claims of the present application.

Claims

1. A scene-based music audiovisual method, characterized by, The application relates to a method for realizing a scene music visual and auditory experience on a vehicle. The method comprises the following steps: A preset daily scene is set on a vehicle machine, and a scene customization function is opened, so that a user can customize and set the scene; When the user triggers the corresponding scene through voice or other means, the vehicle machine can call the corresponding settings; When music is played, the real-time frequency points of the audio are analyzed, the vehicle display screen displays a dynamic effect according to the frequency point distribution, and the atmosphere lamp performs corresponding rhythmic movements according to the frequency point distribution; When the user triggers the scene, the vehicle machine sends a corresponding vehicle setting signal, and each controller completes the corresponding instruction; The real-time frequency points of the audio are analyzed by using a Visualizer tool, the sampling frequency range is set as 20Hz-20KHz, the sampling period is set as 50ms, and the pulse code modulation data stream of the audio is obtained; Through fast Fourier transform, the sampling number is set as 512 during conversion, 512 frequency sampling points are uniformly inserted in the sampling range, the PCM data stream of the audio is converted into an array of sampling frequencies and corresponding amplitudes; Since the amplitude values have negative numbers and imaginary parts, the real part square and the imaginary part square of the amplitude values are summed and taken square roots to convert into real numbers, so that the frequency and the corresponding amplitude value are obtained; According to the 512 sampling frequency points and the corresponding amplitude values, the vehicle display screen is arranged in a low-to-high order of the frequency sampling, and the corresponding amplitude values are displayed according to the height of the UI design graph; the image height changes with the sampling period, and a dynamic effect of rhythmic movement is formed; 2. The scene-based music audiovisual method according to claim 1, characterized in that: The 512 sampling points are removed from the first three and the last three sampling points, the amplitude values of two adjacent sampling points are added according to the sampling point order, the sequence number and the amplitude value are re-sequenced to form an array, 253 arrays are obtained, each sequence number is matched with the color of the 253 atmosphere lamps, the color corresponding to the sequence number in the array with the maximum amplitude value is set as the color of the atmosphere lamp at this moment, the color of the atmosphere lamp changes with the rhythmic period to form the rhythmic movement of the atmosphere lamp, and when the user triggers the scene, the vehicle machine sends a vehicle setting signal corresponding to the scene, and the controller completes the corresponding instruction. The triggering of the corresponding scene comprises that the vehicle machine analyzes and judges the current vehicle speed, the vehicle gear, the light intensity and the rainfall condition; When it is confirmed that the vehicle meets the condition of triggering the scene, the vehicle machine calls the scene set by the user, so that a suitable scene is selected; The vehicle machine communicates with an online music platform, obtains music resources matched with the selected scene number and plays the music resources; 3. The scene-based music audiovisual method according to claim 2, characterized in that: The vehicle machine converts the selected scene number into a specific vehicle setting command, sends the command to each control system of the vehicle, completes corresponding vehicle setting adjustment and realizes synchronous adjustment of the overall scene music visual and auditory experience. The precondition comprises defining parameters of a vehicle speed v, a vehicle gear g, a light intensity l and a rainfall condition r; when v<60km / h, g<3, l<500lux and r=0, the scene number is 1, and the first driving mode is judged; when v>100km / h, g>=4, l<300lux and r>10mm / h, the scene number is 2, and the second driving mode is judged; and when none of the parameters meets the scene number 1 and the scene number 2, the scene number is 0, and the third driving mode is judged. The vehicle machine calls a preset scene configuration according to the determined scene number, the scene configuration including corresponding music resources, dynamic effect display and vehicle setting adjustment parameters, and communicates with an online music platform to obtain matched music resources for playing; The vehicle machine converts the selected scene number and corresponding configuration into specific vehicle setting commands, sends instructions to vehicle control systems, and completes corresponding vehicle setting adjustments to realize synchronous adjustment of the overall scene music visual and auditory experience.

4. The scene-based music audiovisual method of claim 3, wherein: The corresponding rhythm adjustment includes performing a moving average processing on the amplitude array obtained in the sampling period, calculating the average amplitude of the first five sampling periods, and executing a brightness adjustment strategy; The moving average processing is represented as, wherein SMA i denotes the average amplitude, A j denotes the amplitude obtained in the jth sampling period, i denotes the sequence number of the current sampling period, and n denotes the number of sampling periods, denotes the sum of all values from i-n+1 to i.

5. The scene-based music audiovisual method according to claim 4, characterized in that: The controller completes corresponding instructions, including activating a warm driving mode when the first driving mode is determined, activating an emotional driving mode when the second driving mode is determined, and activating a standard driving mode when the third driving mode is determined, the vehicle machine sending corresponding vehicle setting signals to the vehicle control systems, converting the scene number or voice instructions into specific vehicle setting commands, fine-tuning the settings according to the real-time vehicle speed or the in-vehicle environment, and communicating with the vehicle machine through the online music platform to retrieve and play music resources matching the scene number.

6. The scene-based music audiovisual method according to claim 5, characterized in that: The fine-tuning settings include starting the air purification system and playing a clean air voice prompt when the in-vehicle air quality is detected to have decreased by more than a preset threshold in the first driving mode, starting the seat heating and switching the ambient light to warm colors when the temperature is sensed to be lower than a preset threshold, and starting the backup ambient light when the external light intensity is detected to be lower than a preset threshold; In the second driving mode, the seat support is started when the relative speed is detected to be greater than a preset threshold, the in-vehicle sound insulation mode is started when the external noise is detected by the environmental noise sensor to be greater than a preset threshold, and the music volume level is increased, and the ambient light periodically changes to a bright color when the vehicle machine detects that the driver has been driving continuously for more than two hours; In the third driving mode, the sound effect of the in-vehicle sound system is adjusted according to the feedback of the in-vehicle passenger number sensor, the windows are closed and the ambient light is switched to blue when the vehicle-mounted rain sensor detects that the rainfall has increased by more than a preset threshold, and the fresh air system is started when the vehicle-mounted CO2 sensor detects that the in-vehicle CO2 concentration has increased by more than a preset threshold.

7. A system employing the scene-based music audiovisual method according to any one of claims 1 to 6, characterized in that, It includes: An environment perception module, a scene matching module, a personalized setting module, and an environment feature module; The environment perception module is used to monitor and analyze environmental parameters in real time, providing input data for the scene matching module; The scene matching module is used to identify the current environmental scene according to the data collected by the environment perception module and provide scene information; The personalized setting module is used to adjust music and environmental parameters according to the scene and the user's personalized settings, continuously optimize personalized recommendations through machine learning, and learn the user's preferences and habits; The environment feature module is used to receive data transmitted from the scene matching module and the personalized setting module, adjust environmental features, monitor environmental changes in real time, and automatically adjust the features to maintain the best state.

8. A computer device comprising a memory and a processor, the memory storing a computer program, characterized in that, The computer program is executed by the processor to implement the steps of the scene-based music audiovisual method of any one of claims 1 to 6.

9. A computer readable storage medium having stored thereon a computer program, characterized in that, The computer program is executed by the processor to implement the steps of the scene-based music audiovisual method of any one of claims 1 to 6.

Images