Light effect determination method, sound, atmosphere lamp device and robot

Abstract

This application relates to the field of lighting effect control technology, providing a method for determining lighting effects, an audio system, an ambient lighting device, and a robot. The method includes: acquiring ambient light data of the environment where the light strip is located and emotional data of the current audio. The ambient light data includes ambient illuminance and ambient color temperature, and the emotional data includes arousal and emotional valence. Based on the ambient illuminance and arousal, the method determines the lighting effect brightness of the light strip; based on the ambient color temperature and the emotional valence, the method determines the lighting effect color temperature of the light strip; and based on the lighting effect brightness and color temperature, the method controls the light strip to illuminate. This application utilizes ambient illuminance and arousal to determine lighting effect brightness, and uses ambient color temperature and emotional valence to determine lighting effect color temperature, achieving a dual fusion of environmental perception and emotional perception. Compared to a single rhythm-following method, this significantly improves the intelligence level of lighting effect control and the user experience.

Description

Technical Field

[0001] This application belongs to the field of lighting effect control technology, and in particular relates to a method for determining lighting effects, sound, ambient lighting devices and robots. Background Technology

[0002] With the rapid popularization of smart lighting, smart homes, and audio-visual entertainment scenarios, users' demand for sound and light interaction experiences continues to upgrade. At present, the common method of controlling lighting effects is to use a simple rhythm-following method. Although it can achieve basic sound and light interaction, it still has significant shortcomings in terms of visual comfort and cannot meet the needs of immersive use of lighting effects. Summary of the Invention

[0003] Some embodiments of this application provide a method for determining lighting effects, a sound system, an ambient lighting device, and a robot, which can solve the problem of insufficient visual comfort of lighting effects and the inability to meet the immersive use requirements of lighting effects.

[0004] Firstly, some embodiments of this application provide a method for determining lighting effects, including: Acquire ambient light data of the environment where the light strip is located and emotional data of the current audio, wherein the ambient light data includes ambient light illuminance and ambient light color temperature, and the emotional data includes arousal and emotional valence; The lighting effect brightness of the light strip is determined based on the ambient light intensity and the wakefulness. The light effect color temperature of the light strip is determined based on the ambient light color temperature and the emotional valence. The light strip is controlled to illuminate based on the light effect brightness and the light effect color temperature.

[0005] In this application, the relevant technology generally controls the lighting effect according to the rhythm of the audio. The lighting effect of the light strip is linked with the audio, and the light changes according to the high and low, fast and slow rhythm of the audio. The lighting effect can only intuitively reflect the rhythmic characteristics of the audio, and the lighting effect expression is monotonous and the sense of light and shadow atmosphere is poor.

[0006] This application first acquires ambient light data of the environment where the light strip is located. Based on the ambient illuminance in the ambient light data, it determines the brightness of the light effect; based on the ambient color temperature in the ambient light data, it determines the color temperature of the light strip. This allows the light strip's effect to dynamically match the actual lighting conditions of the current environment, avoiding excessive visual contrast between the light effect and the environment, and significantly improving the user's visual comfort. In addition, this application also acquires the emotional data of the current audio. Based on the arousal level in the emotional data, it determines the brightness of the light effect; based on the emotional valence in the emotional data, it determines the color temperature of the light effect. This breaks through the limitations of traditional solutions that only perform simple rhythm following, enabling the light effect to not only respond to the physical characteristics of the audio but also reflect the emotional connotations conveyed by the audio, enhancing the immersiveness and expressiveness of the sound-light interaction. Furthermore, this application uses ambient illuminance and arousal level to determine the brightness of the light effect, and uses ambient color temperature and emotional valence to determine the color temperature of the light effect, achieving a dual fusion of environmental perception and emotional perception. Compared to a single rhythm following method, this significantly improves the intelligence level of light effect control and the user experience.

[0007] In one possible implementation of the first aspect, determining the luminous efficacy of the light strip based on the ambient illuminance and the wakefulness includes: The ambient brightness value is determined based on the ambient illuminance, the upper limit of the brightness adjustment of the light strip, and the lower limit of the brightness adjustment of the light strip. Based on the arousal level and the preset baseline brightness value, the emotional brightness value is determined; The light strip's brightness is obtained by weighted summation of the ambient brightness value and the emotional brightness value.

[0008] In this application, the ambient brightness value is determined based on the ambient illuminance, the upper limit of brightness adjustment, and the lower limit of brightness adjustment. This ensures that the final lighting effect brightness does not exceed the physically achievable brightness range of the light strip, while also guaranteeing that the lighting effect brightness remains within a comfortable range for the human eye, even when the ambient light varies, preventing situations where it is imperceptible or glaring. The emotional brightness value is determined using a base brightness value and arousal level to avoid the light turning off when there is no emotional state. The lighting effect brightness is determined by combining the ambient brightness value and the emotional brightness value, ensuring that the determined lighting effect both conforms to the current environment and reflects the emotional state of the audio.

[0009] In one possible implementation of the first aspect, determining the light strip's color temperature based on the ambient light color temperature and the emotional valence includes: The ambient color temperature value is determined based on the sum of the ambient light color temperature and the preset color temperature offset. The emotional color temperature value is determined based on the emotional valence, the preset upper limit of color temperature adjustment, and the preset lower limit of color temperature adjustment. The light effect color temperature of the light strip is obtained by weighted summation of the ambient color temperature value and the emotional color temperature value.

[0010] In this application, the ambient color temperature value is determined based on the ambient light color temperature and color temperature offset, ensuring that the final determined lighting effect color temperature always fluctuates around the actual ambient light color temperature, reducing visual abruptness. The emotional color temperature value is determined based on emotional valence, an upper limit for color temperature adjustment, and a lower limit for color temperature adjustment, keeping the color temperature within a comfortable and achievable range for the human eye. Finally, the ambient color temperature value and the emotional color temperature value are weighted and summed to obtain a lighting effect color temperature that matches both the ambient light color temperature and the current mood.

[0011] In one possible implementation of the first aspect, before acquiring ambient light data of the environment where the light strip is located and emotional data of the current audio, the method further includes: When playing test audio in the environment where the light strip is located, the direct sound amplitude value and the reflected sound amplitude value of the test audio are obtained. The direct sound amplitude value is the sound wave amplitude value of the test audio first received by the sound receiving device after the test audio is played. The reflected sound amplitude value is the sound wave amplitude value of the test audio received by the sound receiving device after the test audio has been played for a preset time. The environment is the environment in which the current audio is played. The reverberation intensity of the environment is determined based on the direct sound amplitude and the reflected sound amplitude. Obtain the amplitude values ​​of sounds at different frequencies in the test audio; The absolute value of the difference in amplitude between sounds of different frequencies is calculated to obtain the degree of sound attenuation in the environment; The acoustic characteristics of the environment are determined based on the reverberation intensity and the sound attenuation. Accordingly, controlling the light strip to illuminate based on the light effect brightness and the light effect color temperature includes: Based on the acoustic characteristics, at least one of the light effect brightness and the light effect color temperature is corrected to obtain the target light effect; Based on the target lighting effect, the light strip is controlled to illuminate.

[0012] In this application, reverberation intensity is determined by playing test audio and analyzing the amplitudes of direct and reflected sound. The degree of sound attenuation is then calculated by determining the amplitude difference between different frequencies. Finally, the environmental acoustic characteristics are derived based on both reverberation intensity and sound attenuation. This simultaneous consideration of both reverberation intensity and sound attenuation provides a more accurate reflection of the environment's true impact on sound compared to a single parameter. Based on these environmental acoustic characteristics, the brightness and color temperature of the lighting effects are adaptively adjusted, ensuring that the light strip's effects match the actual auditory characteristics of the current environment. This effectively avoids the problem of inconsistency between sound and light effects caused by differences in environmental acoustics, improves the synchronization and consistency between lighting effects and audio experience, and enhances the overall audiovisual immersion.

[0013] In one possible implementation of the first aspect, the method further includes: The current audio is separated into audio tracks to obtain sub-audio tracks of the first target audio track; Determine the sub-light strip corresponding to the first target audio track, wherein the sub-light strip is a portion of the light strip; Extract first audio features from the sub-audio of the first target audio track, wherein the first audio features include at least one of time-domain features and frequency-domain features; Based on the first audio feature, determine the sub-lighting effect of the sub-light strip corresponding to the sub-audio; Accordingly, controlling the light strip to illuminate based on the light effect brightness and the light effect color temperature includes: Based on the sub-light effect, the light effect brightness, and the light effect color temperature, the sub-light strips in the light strip are controlled to light up.

[0014] In this application, by separating audio tracks, sub-audio frequencies of different audio tracks are extracted, and the sub-lighting effects of sub-light strips are determined based on the first audio characteristics of the sub-audio frequencies. Independent sub-lighting effects are set for sub-light strips, realizing refined zone linkage between music and light, improving the layering of lighting effects, synchronization accuracy and musical expressiveness, and enhancing the user's audiovisual experience.

[0015] In one possible implementation of the first aspect, the step of performing track separation on the current audio to obtain sub-audio of the first target audio track includes: If the human voice in the current audio does not include the human voice received by the microphone, the current audio is separated into audio tracks to obtain the sub-audio of the first target audio track.

[0016] In this application, if the current audio does not include the human voice received by the microphone, it means that the current human voice is not a real-time human voice and the current audio is a pre-recorded audio. Only the pre-recorded regular music is separated into tracks, providing a lighting effect expression form and enriching the lighting effect determination method.

[0017] In one possible implementation of the first aspect, controlling the light strip to illuminate based on the light effect brightness and the light effect color temperature includes: The basic lighting effect, rhythmic lighting effect, and focal lighting effect of the light strip are obtained. The basic lighting effect includes the color and flow speed of the lighting effect, the rhythmic lighting effect includes the flashing frequency and flashing duration of the lighting effect, and the focal lighting effect includes the color and brightness of the lighting effect. The light strip is controlled to illuminate based on the basic lighting effect, the rhythmic lighting effect, the focal lighting effect, the lighting effect brightness, and the lighting effect color temperature.

[0018] In this application, a multi-level lighting effect system is constructed, consisting of basic lighting effects, rhythmic lighting effects, and focal lighting effects. Combined with the comprehensive control of brightness and color temperature of the light strips, the lighting effects are displayed in a hierarchical and refined manner, enhancing the expressiveness and rhythm of the lights, and improving the coordination and immersive experience of sound and light interaction.

[0019] In one possible implementation of the first aspect, obtaining the basic lighting effect, rhythmic lighting effect, and focal lighting effect of the light strip includes: If the current audio includes human voices received by the microphone, then acquire the basic lighting effect, the rhythm lighting effect, and the focus lighting effect.

[0020] In this application, if the current audio includes human voice received by the microphone, it means that the current human voice is a real-time human voice. At this time, the lighting effect is displayed in layers to make the lighting effect more diverse.

[0021] In one possible implementation of the first aspect, obtaining the basic lighting effect, the rhythmic lighting effect, and the focal lighting effect includes: The current audio is separated into audio tracks to obtain sub-audio tracks of the second target audio track. The second target audio track includes a vocal track, a drum track, and other accompaniment tracks, wherein the other accompaniment tracks are the accompaniment tracks excluding the drum track. The basic lighting effect of the light strip is determined based on the second audio characteristics of the sub-audio of the other accompaniment tracks; Based on the third audio features of the sub-audio of the drum track, the rhythmic lighting effect of the light strip is determined, wherein the priority of the rhythmic lighting effect is higher than the priority of the basic lighting effect. Based on the fourth audio feature of the sub-audio of the human voice track, the focus lighting effect of the light strip is determined, wherein the focus lighting effect has a higher priority than the rhythm lighting effect.

[0022] In this application, by separating the audio into multiple tracks, different levels of lighting effects are determined based on the sub-audio frequencies of different tracks, making the lighting effects more layered. Priorities are set for different levels to achieve precise matching between the lighting effects and the music, ensuring clear hierarchy and distinct layers of lighting, while making the sound and light linkage more in line with auditory perception, thus enhancing the expressiveness of the lighting effects and the immersive audiovisual experience.

[0023] Secondly, some embodiments of this application provide a device for determining lighting effects, including: The data acquisition module is used to acquire ambient light data of the environment where the light strip is located and emotional data of the current audio. The ambient light data includes ambient light illuminance and ambient light color temperature, and the emotional data includes arousal and emotional valence. A brightness determination module is used to determine the lighting effect brightness of the light strip based on the ambient light intensity and the wake-up level; A color temperature determination module is used to determine the light effect color temperature of the light strip based on the ambient light color temperature and the emotional valence. The lighting effect control module is used to control the light strip to light up based on the lighting effect brightness and the lighting effect color temperature.

[0024] Thirdly, some embodiments of this application provide an audio system, including: A light strip, wherein the light strip is provided with multiple LED beads; The system includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the method for determining the lighting effect described in the first aspect above, so that the light strip is illuminated.

[0025] Fourthly, some embodiments of this application provide an ambient lighting device, including: A light strip installed in the interior of a passenger vehicle, the light strip having multiple LED beads; The system includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor, when executing the computer program, implements the method for determining the lighting effect described in the first aspect above, so that the light strip is illuminated.

[0026] Fifthly, some embodiments of this application provide a terminal device, including: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the method for determining the lighting effect as described in any of the first aspects above.

[0027] Sixthly, some embodiments of this application provide a computer-readable storage medium storing a computer program that, when executed by a processor, implements the method for determining the lighting effect described in any one of the first aspects above.

[0028] In a seventh aspect, some embodiments of this application provide a computer program product that, when run on a terminal device, causes the terminal device to execute the method for determining the lighting effect described in any of the first aspects.

[0029] Eighthly, some embodiments of this application provide a robot, including: A light strip, wherein the light strip is provided with multiple LED beads; The system includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the method for determining the lighting effect described in the first aspect above, so that the light strip is illuminated.

[0030] It is understood that the beneficial effects of aspects two through eight above can be found in the relevant descriptions in aspect one above, and will not be repeated here. Attached Figure Description

[0031] To more clearly illustrate the technical solutions in some embodiments of this application, the accompanying drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0032] Figure 1 This is a schematic diagram of different sounds provided in one embodiment of this application; Figure 2 This is a flowchart illustrating a method for determining lighting effects according to an embodiment of this application; Figure 3 This is a flowchart illustrating a method for determining environmental acoustic features according to an embodiment of this application; Figure 4 This is a flowchart illustrating a method for determining the lighting effect of a sub-light strip by separating audio tracks according to an embodiment of this application. Figure 5 This is a flowchart illustrating a method for layered lighting effect control according to an embodiment of this application; Figure 6 This is a schematic diagram of the structure of a lighting effect determination device provided in an embodiment of this application; Figure 7 This is a schematic diagram of the structure of a terminal device provided in an embodiment of this application. Detailed Implementation

[0033] It should be understood that, when used in this application specification and the appended claims, the term "comprising" indicates the presence of the described features, integrals, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components and / or a collection thereof.

[0034] It should also be understood that the term “and / or” as used in this application specification and the appended claims means any combination of one or more of the associated listed items and all possible combinations, and includes such combinations.

[0035] As used in this application specification and the appended claims, the term "if" may be interpreted, depending on the context, as "when," "once," "in response to determination," or "in response to detection." Similarly, the phrase "if determined" or "if detected [the described condition or event]" may be interpreted, depending on the context, as "once determined," "in response to determination," "once detected [the described condition or event]," or "in response to detection [the described condition or event]."

[0036] Furthermore, in the description of this application and the appended claims, the terms "first," "second," "third," etc., are used only to distinguish descriptions and should not be construed as indicating or implying relative importance.

[0037] To create a better user experience, current smart devices often incorporate ambient lighting. This can be found in various locations such as speakers, displays, car interiors, and light bars. These light bars can be cylindrical or circular.

[0038] Taking intelligent devices as an example, such as audio equipment Figure 1 The images show speakers of different shapes. The hardware components of a speaker can include a signal receiving component, a data processing component, a sound reproduction component, and ambient lighting. The signal receiving component is the starting point for sound, used to acquire sound signals, which can be analog or digital signals, etc. The data processing component is used to filter and amplify the sound signal to obtain a processed sound signal. The sound reproduction component is used to convert the processed sound signal from an electrical signal into a sound wave. Additionally, the data processing component is used to determine the lighting mode of the ambient lighting to control its illumination.

[0039] The software architecture of an audio system can include an application layer, a service layer, a core processing layer, an algorithm and inference layer, and a system and driver layer.

[0040] The application layer is the interface through which users interact with the speaker, directly determining the product's functional experience. The application layer can include voice interaction, music playback, smart services, and system settings.

[0041] The service layer is the core that distinguishes smart speakers from traditional speakers, responsible for handling complex dialogue logic and providing personalized services. For example, the service layer can provide skill and service orchestration: routing user requests to the corresponding functional modules; the service layer can provide dialogue management: maintaining the context of the dialogue and resolving referential issues; the service layer can also provide user profiles: by analyzing user habits and preferences, it can provide personalized recommendations (such as recommending frequently listened-to music genres) and proactive services (such as automatically broadcasting morning traffic updates).

[0042] The core processing layer is responsible for processing all incoming and outgoing sound signals, ensuring that they are "clearly audible" and "well-playable".

[0043] The algorithm and inference layer is a collection of models that provide algorithmic support for upper-level processing, such as speech recognition models, natural language understanding models, and speech synthesis models.

[0044] The system and driver layers are responsible for interacting directly with the hardware and providing a unified calling interface for the upper layers.

[0045] During audio usage, after receiving a command signal, the application layer transmits it to the service layer. The service layer parses the command signal to determine the intent information. Based on this intent information, the service layer prepares resources and constructs a playback task, then transmits the playback task instruction to the core processing layer. The core processing layer retrieves the corresponding data based on the playback task instruction, decodes the data, and performs effect adaptation; it also calls the model in the algorithm and inference layer to adjust the audio. Finally, the core processing layer transmits the processed, correctly formatted audio data to the system and driver layer. The system and driver layer routes the audio data to the corresponding hardware device to achieve audio playback.

[0046] Currently, the lighting effects of LED strips in devices generally adopt an audio-following method. After receiving the audio, the rhythm of the audio is extracted, and the lighting effect is determined according to the rhythm of the audio. The lighting effects of the LED strip only reflect the rhythmic characteristics of the audio, and the lighting effect expression is not rich enough and cannot meet the needs of users.

[0047] Therefore, this application proposes a method for determining lighting effects, which involves acquiring ambient light data of the environment in which the light strip is located and emotional data of the current audio, and determining the lighting effects of the light strip based on the ambient light data and emotional data, so that the lighting effects of the light strip can be linked with the ambient light and the emotional content of the audio, making the lighting effects more expressive.

[0048] The following combination Figure 2 The method for determining lighting effects according to some embodiments of this application will be described in detail. The method of this application can be operated in a terminal device with a light strip, the light strip having multiple LED beads. The terminal device can be a speaker, a display screen, a vehicle, a light stick, a television, a mechanical keyboard, a treadmill, stage decoration equipment, etc.

[0049] Figure 2 A schematic flowchart of the method for determining lighting effects provided in this application is shown, with reference to... Figure 2 The method is described in detail below: S101, acquire ambient light data of the environment where the light strip is located and emotional data of the current audio, wherein the ambient light data includes ambient light illuminance and ambient light color temperature, and the emotional data includes arousal level and emotional valence.

[0050] In this embodiment, an ambient light sensor is used to collect ambient light illuminance. A color temperature sensor is used to collect ambient light color temperature.

[0051] Specifically, the initial illuminance is collected and calibrated to obtain the ambient illuminance. The illuminance calibration formula is: ,in, For ambient light intensity, This is the ambient light calibration factor, which can be a value between 0.95 and 1.05. Initial illuminance, This is the preset zero-point offset of the ambient light sensor.

[0052] The initial light color temperature is collected and calibrated to obtain the ambient light color temperature. The color temperature calibration formula is: ,in, For ambient light color temperature, This is the color temperature calibration coefficient. The initial light color temperature, This is the preset zero-point offset of the color temperature sensor.

[0053] In this embodiment, emotional valence describes the degree to which a person is attracted to or repelled by something, reflecting the positive / negative degree of the emotional content of the audio, and its value ranges from [0, 1]. The method for calculating emotional valence is as follows: ,in, For emotional valence, The mean value of the cepstral coefficients of the audio Mel-spectrum. Characterizing the emotional features of timbre; This represents the mean of the root-mean-square energy of the current audio. Characterizing the emotional features of volume; This refers to the normalized audio rhythm. Characterizing rhythmic and emotional features; , and All are weighting coefficients. The formula for calculating the root mean square energy is: , Here, N represents the root mean square energy, and N is the total number of sampling points. Let be the audio amplitude of the i-th sampling point.

[0054] Arousal reflects the intensity and activity of emotional experience, characterizing the strength of the emotion conveyed in audio. The formula for calculating arousal is: , For wakefulness, , and All are weighting coefficients; The standard deviation of the audio spectrum amplitude; This represents the mean zero-crossing rate of the audio signal. This is the normalized audio rhythm. The zero-crossing rate is calculated as follows: , The zero-crossing rate is N; N is the total number of sampling points. This is a sign function; it outputs 1 when the input is positive, -1 when the input is negative, and 0 when the input is 0. Let be the audio amplitude value at the i-th sampling point; It represents the audio amplitude at the (i-1)th sampling point.

[0055] S102, determine the lighting effect brightness of the light strip based on the ambient light intensity and the wake-up level.

[0056] In one approach, a brightness lookup table is pre-stored, which stores the mapping relationship between different ambient illuminance, wakefulness, and lighting brightness. The lighting brightness corresponding to the current ambient illuminance and wakefulness can be determined through the brightness lookup table.

[0057] In another approach, an ambient brightness value is determined based on the ambient illuminance, the upper limit of the brightness adjustment of the light strip, and the lower limit of the brightness adjustment of the light strip; an emotional brightness value is determined based on the arousal level and a preset base brightness value; and the ambient brightness value and the emotional brightness value are weighted and summed to obtain the light effect brightness of the light strip.

[0058] Specifically, the lighting effect brightness is determined based on a brightness calculation model. The brightness calculation model is as follows: ; For lighting brightness, This refers to the ambient light value. This represents the emotional intensity value. Weights are adapted to the environment. In practical use, Set a minimum threshold and a maximum threshold. The brightness of the lighting effect cannot be less than the minimum threshold and cannot be greater than the maximum threshold.

[0059] in, For ambient light intensity, Low light threshold This is the highlight threshold. hour, ;when hour, ;when hour, Linear change, the formula for linear change is: .or, It is a preset fixed value. Or, according to... Sure The value; The value at the next moment. The value at the current moment; The preset weight adjustment step size; The ambient illuminance at the current moment; This represents the ambient light level at the previous moment.

[0060] in, , This is the lower limit for adjusting the brightness of the light strip; This is the upper limit for adjusting the brightness of the light strip.

[0061] in, M represents the preset base brightness value, such as 50%. This is a preset coefficient, for example, 50%.

[0062] In one way, in obtaining After that, the calculation can be performed. A smoothing process is performed to obtain the final lighting effect brightness, ensuring smoothness of the brightness. Specifically, this is achieved using... To achieve the final lighting effect brightness; To achieve the final lighting effect brightness; The brightness of the lighting effect at the previous moment; This is the brightness smoothing coefficient.

[0063] S103, Based on the ambient light color temperature and the emotional valence, determine the light effect color temperature of the light strip.

[0064] In one approach, a color temperature lookup table is pre-stored, which stores the mapping relationship between different ambient light color temperatures, emotional valence, and lighting effect color temperatures. The color temperature lookup table can be used to determine the ambient light color temperature and the lighting effect color temperature corresponding to the emotional valence at the current moment.

[0065] In another approach, the ambient color temperature value is determined based on the sum of the ambient light color temperature and a preset color temperature offset; the emotional color temperature value is determined based on the emotional valence, a preset upper limit for color temperature adjustment, and a preset lower limit for color temperature adjustment; and the ambient color temperature value and the emotional color temperature value are weighted and summed to obtain the light effect color temperature of the light strip.

[0066] Specifically, the color temperature of the lighting effect is calculated using a color temperature calculation model. The color temperature calculation model is as follows: , For the color temperature of the lamp effect; For color temperature blending weight, , To adapt weights to the environment, or This is a preset fixed value; This refers to the ambient color temperature value. This refers to the emotional color temperature value. In actual use, set the maximum and minimum values ​​for the lighting effect color temperature. The lighting effect color temperature cannot exceed the maximum value or be less than the minimum value.

[0067] in, , For ambient light color temperature, This is the preset color temperature offset.

[0068] in, , This is the preset upper limit for color temperature adjustment; This is the preset lower limit for color temperature adjustment; This refers to emotional valence. The higher the emotional valence, the warmer the ambient light color temperature; the lower the emotional valence, the cooler the ambient light color temperature.

[0069] In one way, in obtaining After that, the calculation can be performed. A smoothing process is performed to obtain the final lighting effect color temperature, ensuring a smooth color temperature. Specifically, this is achieved using... To obtain the final color temperature of the lighting effect; The final color temperature for the lighting effect; The color temperature of the lighting effect at the previous moment; This is the color temperature smoothing coefficient.

[0070] S104, based on the light effect brightness and the light effect color temperature, control the light strip to light up.

[0071] This application first acquires ambient light data of the environment where the light strip is located. Based on the ambient illuminance in the ambient light data, the brightness of the light effect is determined; based on the ambient color temperature in the ambient light data, the color temperature of the light strip is determined. This allows the light strip's effect to dynamically match the actual lighting conditions of the current environment, avoiding excessive visual contrast between the light effect and the environment, and significantly improving the user's visual comfort. In addition, this application also acquires the emotional data of the current audio. Based on the arousal level in the emotional data, the brightness of the light effect is determined; based on the emotional valence in the emotional data, the color temperature of the light effect is determined. This breaks through the limitations of traditional solutions that only perform simple rhythm following, enabling the light effect to not only respond to the physical characteristics of the audio but also reflect the emotional connotations conveyed by the audio, enhancing the immersiveness and expressiveness of the sound-light interaction. Furthermore, this application uses ambient illuminance and arousal level to determine the brightness of the light effect, and uses ambient color temperature and emotional valence to determine the color temperature of the light effect, achieving a dual fusion of environmental perception and emotional perception. Compared to a single rhythm following method, this significantly improves the intelligence level of light effect control and the user experience.

[0072] In one possible implementation, current lighting designs assume an ideal acoustic environment, neglecting the impact of environmental structure, reflective materials, and sound-absorbing materials on auditory perception in real-world application scenarios. This leads to a severe disconnect between auditory and visual experience. For example, in an open room (high reverberation environment), sound propagates diffusely with significant reverberation, creating a sense of pervasiveness. However, existing lighting effects still output focused, intense light, creating a conflict between the visual focus and the auditory pervasiveness. In a small, softly padded room (strong sound absorption environment), sound is largely absorbed, resulting in a muffled and lacking-depth auditory experience. Existing lighting effects, however, maintain low-contrast, soft light, further exacerbating the discrepancy between auditory and visual perception and severely impacting the immersive audiovisual experience. Therefore, considering the reverberation intensity of the environment / room, determining the acoustic characteristics of the environment based on the reverberation intensity, and then determining the lighting effects based on these acoustic characteristics can better integrate the lighting effects with the audio.

[0073] Specifically, such as Figure 3 As shown, this application may also include: S201, when playing test audio in the environment where the light strip is located, obtain the direct sound amplitude value and the reflected sound amplitude value of the test audio.

[0074] Wherein, the direct sound amplitude is the sound wave amplitude value of the test audio first received by the receiving device after the test audio is played, the reflected sound amplitude is the sound wave amplitude value of the test audio received by the receiving device after the test audio has been played for a preset duration, and the environment is the environment in which the current audio is played. Direct sound is sound that has not been reflected; reflected sound is sound that has been reflected.

[0075] In this embodiment, the preset frequency range of the test audio can be set as needed. For example, the frequency range of the test audio is 20 Hz to 20 kHz, the amplitude is 80 dB, and the duration is 5 seconds.

[0076] S202, Based on the direct sound amplitude and the reflected sound amplitude, determine the reverberation intensity of the environment.

[0077] In this embodiment, the formula is used Calculate the reverberation intensity, which can also be called the reverberation time; Reverberation intensity can also characterize the time required for the sound amplitude to decay in Wdb. Set a preset amplitude, for example, 60 dB; This represents the amplitude of the reflected sound. t represents the direct sound amplitude; t represents the decay time, such as 0.1-5s.

[0078] S203, obtain the amplitude of sounds at different frequencies in the test audio.

[0079] In this embodiment, different frequencies can be set as needed, for example, the amplitudes of 1kHz (human voice core frequency) and 8kHz (high frequency harmonic frequency) can be selected.

[0080] S204, calculate the absolute value of the difference in amplitude between different frequencies of sound to obtain the degree of sound attenuation in the environment.

[0081] In this embodiment, , The degree of sound attenuation; The amplitude of a sound at a certain frequency; The amplitude of a sound at another frequency.

[0082] S205, determine the acoustic characteristics of the environment based on the reverberation intensity and the sound attenuation degree.

[0083] In this embodiment, Case 1: If the reverberation intensity is greater than or equal to the preset intensity and the sound attenuation is less than the preset attenuation, then the acoustic characteristics of the environment are determined to be a high reverberation environment.

[0084] Scenario 2: If the reverberation intensity is less than the preset intensity and the sound attenuation is greater than or equal to the preset attenuation, then the acoustic characteristics of the environment are determined to be a strong attraction environment.

[0085] Scenario 3: If the reverberation intensity is greater than or equal to the preset intensity and the sound attenuation is greater than or equal to the preset attenuation, then the acoustic characteristics of the environment are determined to be a normal environment. If the reverberation intensity is less than the preset intensity and the sound attenuation is less than the preset attenuation, then the acoustic characteristics of the environment are determined to be a normal environment. In other words, if neither Scenario 1 nor Scenario 2 is satisfied, then the acoustic characteristics of the environment are determined to be a normal environment.

[0086] In another approach, the reverberation intensity and sound attenuation are weighted and summed to obtain eigenvalues; the acoustic characteristics of the environment are then determined based on these eigenvalues.

[0087] For example, according to Calculate the eigenvalues, where, For eigenvalues; Reverberation intensity; The degree of sound attenuation; These are the preset weighting coefficients. The value can range from 0 to 5. The higher the value, the stronger the reverberation in the environment and the weaker the sound absorption in the environment; The smaller the value, the weaker the reverberation and the stronger the sound absorption in the environment. When the value is less than the first preset value, the acoustic characteristics of the environment are determined to be a strong sound-absorbing environment. When the reverberation level is greater than the second preset value, the acoustic characteristics of the environment are determined to be a high reverberation environment, where the second preset value is greater than the first preset value. When the acoustic characteristics of the environment are greater than or equal to the first preset value and less than or equal to the second preset value, the environment is determined to be a normal environment.

[0088] Accordingly, the implementation process of step S104 above may include: Based on the acoustic characteristics, at least one of the light effect brightness and the light effect color temperature is corrected to obtain the target light effect; based on the target light effect, the light strip is controlled to illuminate.

[0089] Specifically, scenario one: for high reverberation environments.

[0090] The brightness of the lighting effect remains unchanged, but the color temperature of the lighting effect is corrected.

[0091] The method for correcting the color temperature of lighting effects is as follows: , The corrected color temperature of the lighting effect; The color temperature of the lighting effect is uncorrected. Reverberation intensity; The reverberation time threshold; The preset threshold is 100.

[0092] In addition, in high reverberation environments, diffusion, contrast, and sharpness can also be determined.

[0093] The diffusivity can be calculated using the formula... Calculated; where, For diffusion; Reverberation intensity; The reverberation time threshold; This is the preset maximum diffusion value. m This indicates that the minimum value is taken. The greater the reverberation intensity, the higher the diffusion.

[0094] Contrast can be achieved using formulas Calculated; where, For contrast; Maximum contrast; Reverberation intensity; The reverberation time threshold; This represents the minimum contrast value. This indicates taking the maximum value.

[0095] Sharpness can be achieved using formulas Calculated; where, For sharpness; This indicates taking the maximum value; This represents the minimum sharpness value. Reverberation intensity; This is the reverberation time threshold.

[0096] Scenario 2: For environments with strong sound absorption.

[0097] Both the brightness and color temperature of the lighting effects have been corrected.

[0098] Correction to lighting brightness: ;in, The corrected brightness of the lighting effect; The original brightness of the lighting effect; This is the threshold for the frequency response difference; The degree of sound attenuation; The preset threshold is 5.

[0099] Correction of lighting color temperature: ;in, The corrected color temperature of the lighting effect; The original color temperature of the lighting effect; This is the threshold for the frequency response difference; The degree of sound attenuation; This is a preset value, such as 150.

[0100] Regarding diffusion: ;in, This represents the minimum diffusivity.

[0101] Regarding contrast: ;in, This represents the maximum contrast value.

[0102] Regarding sharpness: , This represents the maximum sharpness value.

[0103] Scenario 3: For a normal environment.

[0104] The brightness and color temperature of the lighting effect can be left uncalibrated, or the brightness and color temperature can be multiplied by a preset coefficient.

[0105] Diffusion, contrast, and sharpness can all be set to their respective preset values.

[0106] In one possible implementation, the current light strip's lighting effects are rather monotonous and lack depth. To increase the depth of the lighting effects, different lighting effects can be determined by different audio tracks in the audio.

[0107] Specifically, such as Figure 4 As shown, the above method may further include: S301, perform track separation on the current audio to obtain the sub-audio of the first target audio track.

[0108] In this embodiment, a preset audio track separation model is used to separate the current audio tracks. For example, the preset audio track separation model can be the Demucs model (Deep Extractor for Music Sources) or the U-Net model.

[0109] In this embodiment, the first target audio track may include one or more of a vocal track, a drum track, a bass track, and other instrument tracks.

[0110] In one implementation, it is determined whether the human voice in the current audio includes the human voice received by the microphone. If the human voice in the current audio does not include the human voice received by the microphone, it indicates that the current audio is pre-recorded audio. In this case, the current audio is separated into audio tracks to obtain the sub-audio of the first target audio track. If the human voice in the current audio includes the human voice received by the microphone, it indicates that the human voice in the current audio is input in real time, and in this case, the process of step S301 is not executed.

[0111] S302, determine the sub-light strip corresponding to the first target audio track, wherein the sub-light strip is a portion of the light strip.

[0112] In this embodiment, the light strip is pre-divided into different sub-light strips. For example, according to the arrangement position of the light strip, it is divided into an upper light strip, a lower light strip, a left light strip, and a right light strip. A mapping table between different first target audio tracks and sub-light strips is pre-established. Based on the mapping table, the sub-light strip corresponding to different first target audio tracks can be found. For example, the sub-light strip corresponding to a vocal track is the upper light strip; the sub-light strip corresponding to a drum track is the lower light strip, and so on. Furthermore, different mapping tables can be set according to the type of audio. For example, the type of audio can include rock, classical, pop, etc. If the audio type is rock, the sub-light strip corresponding to the first target audio track is found from mapping table A; if the audio type is classical, the sub-light strip corresponding to the first target audio track is found from mapping table B.

[0113] S303, extract the first audio features of the sub-audio of the first target audio track, wherein the first audio features include at least one of time-domain features and frequency-domain features.

[0114] In this embodiment, the time-domain features may include the root mean square energy and the zero-crossing rate. The calculation of the root mean square energy and the zero-crossing rate is described in the explanation of step S101 above, and will not be repeated here.

[0115] Frequency domain characteristics can include spectral centroid and spectral amplitude. The spectral centroid reflects the timbre characteristics of the audio track, while the spectral amplitude reflects the frequency distribution intensity of the audio track.

[0116] The method for calculating the spectral centroid is as follows: ,in, K represents the centroid of the spectrum; K represents the number of frequency points in the spectrum. The frequency value at the k-th frequency point; Let be the spectral amplitude at the k-th frequency point. The spectral amplitude can be obtained by performing a Fourier transform on the audio.

[0117] The spectral amplitude is: k = 1, 2, 3, ..., K.

[0118] S304, based on the first audio feature, determine the sub-lighting effect of the sub-light strip corresponding to the sub-audio.

[0119] In this embodiment, the correspondence between different audio features and lighting effects is stored in advance, and the corresponding lighting effect can be determined based on the first audio feature.

[0120] As an example, when the first target audio track is a human voice track, the hue of the sub-strip can be determined based on the centroid of the spectrum; the sub-brightness of the sub-strip can be determined based on the root mean square energy.

[0121] When the first target audio track is a drum track, the flashing frequency and white light intensity of the lighting effect can be determined based on the root mean square energy.

[0122] When the first target audio track is a bass track, the flashing frequency of the lighting effect can be determined based on the zero-crossing rate. The blue light intensity of the lighting effect can be determined based on the spectral amplitude.

[0123] When the first target audio track is another instrument track, the color of the sub-strip lighting effect can be determined based on the centroid of the spectrum; the flow speed of the lighting effect can be determined based on the zero-crossing rate.

[0124] After obtaining step S304, the sub-light strip can be controlled to light up based on the sub-light effect determined in step S304, the light effect brightness determined in step S102, and the light effect color temperature determined in step S103.

[0125] Specifically, the lighting of the sub-light strips in the light strip is controlled based on the sub-light effect, the brightness of the light effect, and the color temperature of the light effect.

[0126] If the brightness of a sub-light effect differs from the brightness determined in step S102, the average of the two brightness values ​​or the maximum value of the two brightness values ​​can be taken to obtain the target brightness. The sub-light strips are then controlled to illuminate based on the target brightness. For other light effect parameters, if two different light effect parameters exist, the method for determining the target brightness can be referred to, and will not be elaborated here.

[0127] In one possible implementation, to increase the layering of lighting effects, layered lighting effects can be set based on audio.

[0128] Specifically, such as Figure 5 As shown, the implementation process of step S104 above may include: S401, obtain the basic lighting effect, rhythmic lighting effect, and focal lighting effect of the light strip, wherein the basic lighting effect includes the hue and flow speed of the lighting effect, the rhythmic lighting effect includes the flashing frequency and flashing duration of the lighting effect, and the focal lighting effect includes the color and brightness of the lighting effect.

[0129] In this embodiment, it is determined whether the human voice in the current audio includes the human voice received by the microphone; if the human voice in the current audio includes the human voice received by the microphone, it means that the human voice in the current audio is input in real time, and the process of step S401 is executed.

[0130] In this embodiment, the basic lighting effect serves as the background tone for the lighting effects, creating an immersive atmosphere for the user. The rhythmic lighting effect is used to achieve precise synchronization between the lighting effects and the audio rhythm. The focal lighting effect is a lighting effect determined based on human voice, used to represent the state of the human voice.

[0131] In this embodiment, the basic lighting effect is determined based on the audio of other accompaniment tracks, the rhythm lighting effect is determined based on the audio of the drum track, and the focus lighting effect is determined based on the audio of the vocal track.

[0132] In this embodiment, the focal lighting effect can be displayed on the light strip in a preset area, such as the central area of ​​the light strip, and there is no limitation.

[0133] S402, based on the basic lighting effect, the rhythm lighting effect, the focal lighting effect, the lighting effect brightness, and the lighting effect color temperature, control the light strip to illuminate.

[0134] In this embodiment, if there are two identical lighting effect parameters, for example, two lighting effect brightness values, then the average of the two lighting effect parameters or one of them is taken.

[0135] In one possible implementation, the process of step S401 may include: S4011, Perform audio track separation on the current audio to obtain sub-audio of the second target audio track, wherein the second target audio track includes a vocal track, a drum track, and other accompaniment tracks, and the other accompaniment tracks are the accompaniment tracks excluding the drum track.

[0136] S4012, Based on the second audio characteristics of the sub-audio of the other accompaniment tracks, determine the basic lighting effect of the light strip.

[0137] In this embodiment, the second audio feature may include the spectral centroid and the root mean square energy.

[0138] The system pre-stores the correspondence between different spectral centroids and the colors of the lighting effects, and the color of the lighting effect can be determined based on the spectral centroid at the current moment.

[0139] The correspondence between different root mean square energies and the flow speed of the lighting effect is stored in advance. The flow speed of the lighting effect can be determined based on the root mean square energy at the current moment.

[0140] S4013, Based on the third audio feature of the sub-audio of the drum track, determine the rhythmic lighting effect of the light strip, wherein the priority of the rhythmic lighting effect is higher than the priority of the basic lighting effect.

[0141] In this embodiment, the third audio feature may include the zero-crossing rate and the root mean square energy.

[0142] The correspondence between different zero-crossing rates and flashing frequencies is stored in advance, and the flashing frequency of the light effect can be determined based on the zero-crossing rate at the current moment.

[0143] The correspondence between different root mean square energies and flashing durations is stored in advance. The flashing duration of the light effect can be determined based on the root mean square energy at the current moment.

[0144] When a drum track is present in the audio, the light strip is controlled to blink according to a determined blinking frequency and blinking duration.

[0145] S4014, based on the fourth audio feature of the sub-audio of the human voice track, determine the focus lighting effect of the light strip, wherein the focus lighting effect has a higher priority than the rhythm lighting effect.

[0146] In this embodiment, the fourth audio feature includes the quality of human voice. The color and brightness of the lighting effect are determined based on the quality of the human voice.

[0147] Vocal quality can include pitch accuracy. Specifically, the YIN algorithm is used to extract the pitch of the vocals and the pitch of the accompaniment from the sub-audio. The absolute value of the difference between the vocal pitch and the accompaniment pitch is calculated to obtain the pitch deviation. If the pitch deviation is less than or equal to a preset deviation, the pitch is considered acceptable. If the pitch deviation is greater than the preset deviation, the pitch is considered unacceptable.

[0148] If the pitch is correct, find the color and brightness of the lighting effect that corresponds to the correct pitch.

[0149] If the pitch is off, find the corresponding light effect color and brightness. The color and brightness of the light effect will differ depending on whether the pitch is correct or not.

[0150] In one possible implementation, if multiple terminal devices exist, and each device displays light strips, multiple light strips can be controlled simultaneously. Furthermore, different lighting effect parameters can be sent based on the priority of the terminal devices to ensure the reliability of data transmission.

[0151] Specifically, the above methods may also include: Obtain the device type, communication protocol type, and signal strength of the terminal device. Find the preset type parameter value based on the device type; find the corresponding protocol parameter value based on the communication protocol type; and find the corresponding signal strength parameter value based on the signal strength. Perform a weighted sum of the type parameter value, protocol parameter value, and signal strength parameter value to obtain the terminal device's score.

[0152] All terminal devices are ranked in descending order of their scores. Terminal devices with scores higher than the preset score are classified as high-priority devices, while those with scores less than or equal to the preset score are classified as low-priority devices.

[0153] Send all lighting effect parameters, such as lighting effect brightness, lighting effect color temperature, lighting effect speed, and lighting effect color, to high-priority devices.

[0154] Preset lighting effect parameters are sent to low-priority devices. The number of lighting effect parameters sent to low-priority devices is less than the number of lighting effect parameters sent to high-priority devices. For example, lighting effect color and lighting effect brightness.

[0155] It should be understood that the sequence number of each step in the above embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of some embodiments of this application.

[0156] Corresponding to the method for determining the lighting effect described in the above embodiments, Figure 6 The diagram shows a structural block diagram of a lighting effect determination device provided in some embodiments of this application. For ease of explanation, only the parts related to some embodiments of this application are shown.

[0157] Reference Figure 6 The device 500 may include: a data acquisition module 510, a brightness determination module 520, a color temperature determination module 530, and a lighting effect control module 540.

[0158] The data acquisition module 510 is used to acquire ambient light data of the environment where the light strip is located and emotional data of the current audio. The ambient light data includes ambient light illuminance and ambient light color temperature, and the emotional data includes arousal and emotional valence. Brightness determination module 520 is used to determine the lighting effect brightness of the light strip based on the ambient light intensity and the wake-up level; The color temperature determination module 530 is used to determine the light effect color temperature of the light strip based on the ambient light color temperature and the emotional valence. The lighting effect control module 540 is used to control the light strip to light up based on the lighting effect brightness and the lighting effect color temperature.

[0159] It should be noted that the information interaction and execution process between the above-mentioned devices / units are based on the same concept as the method embodiments of this application. For details on their specific functions and technical effects, please refer to the method embodiments section, and they will not be repeated here.

[0160] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is merely an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit. Furthermore, the specific names of the functional units and modules are only for easy differentiation and are not intended to limit the scope of protection of this application. The specific working process of the units and modules in the above system can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0161] Some embodiments of this application also provide an audio device, including: a light strip with a plurality of LED beads; a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the above-described method for determining the lighting effect, so that the light strip is illuminated.

[0162] Some embodiments of this application also provide an ambient lighting device, including: a light strip mounted on the interior of a passenger vehicle, the light strip having a plurality of LEDs; a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the above-described method for determining lighting effects, so that the light strip is illuminated.

[0163] Some embodiments of this application also provide a robot, including: a light strip with a plurality of LED beads; a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the above-described method for determining the lighting effect, so that the light strip is lit.

[0164] Some embodiments of this application also provide a terminal device, see [link to relevant documentation]. Figure 7The terminal device 600 may include: at least one processor 610, a memory 620, and a computer program stored in the memory 620 and executable on the at least one processor 610. When the processor 610 executes the computer program, it implements the steps in any of the above method embodiments, for example... Figure 2 Steps S101 to S104 in the illustrated embodiment. Alternatively, when the processor 610 executes the computer program, it implements the functions of each module / unit in the above-described device embodiments, for example... Figure 6 The functions of the data acquisition module 510 to the lighting effect control module 540 are shown.

[0165] For example, a computer program may be divided into one or more modules / units, one or more of which are stored in memory 620 and executed by processor 610 to complete this application. The one or more modules / units may be a series of computer program segments capable of performing specific functions, which describe the execution process of the computer program in terminal device 600.

[0166] Those skilled in the art will understand that Figure 7 This is merely an example of a terminal device and does not constitute a limitation on the terminal device. It may include more or fewer components than shown, or combine certain components, or different components, such as input / output devices, network access devices, buses, etc.

[0167] The processor 610 can be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor.

[0168] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0169] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments can also be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by one or more processors, it can implement the steps of the various method embodiments described above.

[0170] Similarly, as a computer program product, when the computer program product is run on a terminal device, it enables the terminal device to implement the steps in the above-described method embodiments.

[0171] The computer program includes computer program code, which may be in the form of source code, object code, executable file, or some intermediate form. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording media, USB flash drive, portable hard drive, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signals, telecommunication signals, and software distribution media, etc.

[0172] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.

Claims

1. A method for determining lighting effects, characterized in that, The method, applied to devices with LED strips, wherein the LED strips are provided with multiple LED beads, includes: Acquire ambient light data of the environment where the light strip is located and emotional data of the current audio, wherein the ambient light data includes ambient light illuminance and ambient light color temperature, and the emotional data includes arousal and emotional valence; The lighting effect brightness of the light strip is determined based on the ambient light intensity and the wakefulness. The light effect color temperature of the light strip is determined based on the ambient light color temperature and the emotional valence. The light strip is controlled to illuminate based on the light effect brightness and the light effect color temperature.

2. The method for determining lighting effects as described in claim 1, characterized in that, Determining the light strip's brightness based on the ambient light level and the wakefulness level includes: The ambient brightness value is determined based on the ambient illuminance, the upper limit of the brightness adjustment of the light strip, and the lower limit of the brightness adjustment of the light strip. Based on the arousal level and the preset baseline brightness value, the emotional brightness value is determined; The light strip's brightness is obtained by weighted summation of the ambient brightness value and the emotional brightness value.

3. The method for determining lighting effects as described in claim 1, characterized in that, Determining the light strip's color temperature based on the ambient light color temperature and the emotional valence includes: The ambient color temperature value is determined based on the sum of the ambient light color temperature and the preset color temperature offset. The emotional color temperature value is determined based on the emotional valence, the preset upper limit of color temperature adjustment, and the preset lower limit of color temperature adjustment. The light effect color temperature of the light strip is obtained by weighted summation of the ambient color temperature value and the emotional color temperature value.

4. The method for determining lighting effects as described in claim 1, characterized in that, Before acquiring ambient light data of the environment where the light strip is located and emotional data of the current audio, the method further includes: When playing test audio in the environment where the light strip is located, the direct sound amplitude value and the reflected sound amplitude value of the test audio are obtained. The direct sound amplitude value is the sound wave amplitude value of the test audio first received by the sound receiving device after the test audio is played. The reflected sound amplitude value is the sound wave amplitude value of the test audio received by the sound receiving device after the test audio has been played for a preset time. The reverberation intensity of the environment is determined based on the direct sound amplitude and the reflected sound amplitude. Obtain the amplitude values ​​of sounds at different frequencies in the test audio; The absolute value of the difference in amplitude between sounds of different frequencies is calculated to obtain the degree of sound attenuation in the environment; The acoustic characteristics of the environment are determined based on the reverberation intensity and the sound attenuation. Accordingly, controlling the light strip to illuminate based on the light effect brightness and the light effect color temperature includes: Based on the acoustic characteristics, at least one of the light effect brightness and the light effect color temperature is corrected to obtain the target light effect; Based on the target lighting effect, the light strip is controlled to illuminate.

5. The method for determining the lighting effect as described in any one of claims 1 to 4, characterized in that, The method further includes: The current audio is separated into audio tracks to obtain sub-audio tracks of the first target audio track; Determine the sub-light strip corresponding to the first target audio track, wherein the sub-light strip is a portion of the light strip; Extract first audio features from the sub-audio of the first target audio track, wherein the first audio features include at least one of time-domain features and frequency-domain features; Based on the first audio feature, determine the sub-lighting effect of the sub-light strip corresponding to the sub-audio; Accordingly, controlling the light strip to illuminate based on the light effect brightness and the light effect color temperature includes: The lighting of the sub-light strips in the light strip is controlled based on the sub-light effect, the brightness of the light effect, and the color temperature of the light effect.

6. The method for determining lighting effects as described in claim 5, characterized in that, Before performing track separation on the current audio to obtain the sub-audio of the first target audio track, the method further includes: Detect whether the human voice in the current audio includes the human voice received by the microphone; Accordingly, the step of separating the current audio track to obtain the sub-audio of the first target audio track includes: If the human voice in the current audio does not include the human voice received by the microphone, the current audio is separated into audio tracks to obtain the sub-audio of the first target audio track.

7. The method for determining the lighting effect as described in any one of claims 1 to 4, characterized in that, The step of controlling the light strip to illuminate based on the light effect brightness and the light effect color temperature includes: The basic lighting effect, rhythmic lighting effect, and focal lighting effect of the light strip are obtained. The basic lighting effect includes the color and flow speed of the lighting effect, the rhythmic lighting effect includes the flashing frequency and flashing duration of the lighting effect, and the focal lighting effect includes the color and brightness of the lighting effect. The light strip is controlled to illuminate based on the basic lighting effect, the rhythmic lighting effect, the focal lighting effect, the lighting effect brightness, and the lighting effect color temperature.

8. The method for determining lighting effects as described in claim 7, characterized in that, Before obtaining the basic lighting effects, rhythmic lighting effects, and focal lighting effects of the light strip, the method further includes: Detect whether the human voice in the current audio includes the human voice received by the microphone; Accordingly, obtaining the basic lighting effects, rhythmic lighting effects, and focal lighting effects of the light strip includes: If the current audio includes human voices received by the microphone, then acquire the basic lighting effect, the rhythm lighting effect, and the focus lighting effect.

9. The method for determining lighting effects as described in claim 8, characterized in that, The acquisition of the basic lighting effect, the rhythm lighting effect, and the focus lighting effect includes: The current audio is separated into audio tracks to obtain sub-audio tracks of the second target audio track. The second target audio track includes a vocal track, a drum track, and other accompaniment tracks, wherein the other accompaniment tracks are the accompaniment tracks excluding the drum track. The basic lighting effect of the light strip is determined based on the second audio characteristics of the sub-audio of the other accompaniment tracks; Based on the third audio features of the sub-audio of the drum track, the rhythmic lighting effect of the light strip is determined, wherein the priority of the rhythmic lighting effect is higher than the priority of the basic lighting effect. Based on the fourth audio feature of the sub-audio of the human voice track, the focus lighting effect of the light strip is determined, wherein the focus lighting effect has a higher priority than the rhythm lighting effect.

10. A sound system, characterized in that, include: A light strip, wherein the light strip is provided with multiple LED beads; The memory, the processor, and the computer program stored in the memory and executable on the processor, wherein the processor, when executing the computer program, implements the method for determining the lighting effect as described in any one of claims 1 to 9, so that the light strip is illuminated.

11. An ambient lighting device, characterized in that, The ambient lighting device includes: A light strip installed in the interior of a passenger vehicle, the light strip having multiple LED beads; The memory, the processor, and the computer program stored in the memory and executable on the processor, wherein the processor, when executing the computer program, implements the method for determining the lighting effect as described in any one of claims 1 to 9, so that the light strip is illuminated.

12. A robot, characterized in that, include: A light strip, wherein the light strip is provided with multiple LED beads; The memory, the processor, and the computer program stored in the memory and executable on the processor, wherein the processor, when executing the computer program, implements the method for determining the lighting effect as described in any one of claims 1 to 9, so that the light strip is illuminated.

Images