Lighting effect control method, electronic device, and storage medium

Abstract

A lighting effect control method, an electronic device (10), and a storage medium. The method comprises: acquiring a sound signal (S11), and on the basis of a sound field type of the sound signal, constructing a corresponding pulse response filter (S12); on the basis of the pulse response filter, filtering the sound signal to obtain an analog signal (S13); transforming the analog signal to obtain a plurality of spectrum signals (S14); and calculating a target excitation value of each spectrum signal (S15), and on the basis of the target excitation value, calculating the human-perceived loudness of each spectrum signal (S16); and on the basis of the human-perceived loudness of the sound signal, controlling the lighting effect of at least one lighting device (S17). Thus, the control accuracy of the lighting effect can be improved.

Description

Lighting effect control method, electronic device and storage medium Technical Field

[0001] The present application relates to the field of lighting technology, and in particular to a lighting effect control method, electronic device, and storage medium. Background Art

[0002] People can associate sounds with colors and / or lighting effects. People mentally associate the perceived loudness of a sound with a corresponding lighting color and / or effect. For example, people often associate loud sounds with bright colors, such as white and yellow. This is because loud sounds stimulate the auditory nerves, causing feelings of excitement and pleasure, similar to the emotional responses evoked by bright colors. Furthermore, the human brain also combines sound and visual information to form associations with lighting effects.

[0003] Among the technologies used to control lighting effects, the frequency of sound signals is the primary method for controlling lighting effects. However, the human auditory system's perception of sound loudness is dependent on factors such as the signal's amplitude, frequency, sound pressure level, duration, and propagation direction. Controlling lighting effects solely based on the frequency of sound signals does not align with human subjective perception and accurately reflects the perceived loudness of sound. Consequently, the controlled lighting effect does not match the perceived loudness of the sound, resulting in inaccurate lighting control and a lack of a comfortable user experience.

[0004] Summary of the Invention

[0005] In view of the above, it is necessary to provide a lighting effect control method, electronic device and storage medium to solve the technical problem that controlling lighting effects by the frequency of sound signals does not conform to the subjective perception of the human body and cannot accurately reflect the loudness of sound perceived by the human body, resulting in inaccurate lighting effect control.

[0006] On the one hand, the present application provides a lighting effect control method, the method comprising: obtaining a sound signal, and constructing a corresponding impulse response filter according to the sound field type of the sound signal, filtering the sound signal according to the impulse response filter to obtain an analog signal, transforming the analog signal to obtain multiple spectrum signals, calculating a target excitation value for each spectrum signal, and calculating the human-perceived loudness of each spectrum signal based on the target excitation value, and controlling the lighting effect of at least one lighting device based on the human-perceived loudness of the sound signal.

[0007] The loudness of sound or human-perceived loudness in the embodiments of this application is both subjective loudness. Objective loudness is the amplitude of the sound wave. Different from objective loudness, subjective loudness is the loudness of the sound perceived by the human body after the sound signal passes through the human auditory system and nervous organs.

[0008] In some embodiments of the present application, constructing a corresponding impulse response filter according to the sound field type of the sound signal includes: if the sound field type is a free sound field, constructing a first low-pass filter as the impulse response filter according to a preset cutoff frequency and a preset filter type, or, if the sound field type is a diffuse sound field, constructing a filter group consisting of multiple second low-pass filters and high-pass filters in series as the impulse response filter, or, if the sound field type is a headphone sound field, constructing a filter group consisting of multiple second low-pass filters and band-pass filters in series as the impulse response filter.

[0009] In some embodiments of the present application, filtering the sound signal according to the impulse response filter to obtain the analog signal includes: performing a convolution operation on the impulse response filter and the sound signal to obtain the analog signal.

[0010] In some embodiments of the present application, the transforming of the analog signal to obtain multiple spectrum signals includes: framing the analog signal to obtain multiple short-time period signals, performing windowing processing on each short-time period signal, and performing Fourier transform on each short-time period signal after the windowing processing to obtain a spectrum signal of each short-time period signal.

[0011] In some embodiments of the present application, the calculation of the target excitation value of each spectrum signal includes: calculating the center frequency of each spectrum signal, and calculating the equirectangular bandwidth of each spectrum signal based on the center frequency, determining the frequency range corresponding to each spectrum signal based on the center frequency and the equirectangular bandwidth of each spectrum signal, and calculating the target excitation value of each spectrum signal based on the effective value power and weight coefficient of each frequency component in each spectrum signal in the corresponding frequency range.

[0012] In some embodiments of the present application, calculating the human perceived loudness of each spectral signal based on the target stimulus value includes: calculating the instantaneous specific loudness of each target stimulus value based on a comparison result between each target stimulus value and a first preset threshold value and a second preset threshold value; for a first spectral signal among the multiple spectral signals, using the instantaneous specific loudness of the first spectral signal as the human perceived loudness of the first spectral signal; and for any spectral signal among the multiple spectral signals other than the first spectral signal, calculating the human perceived loudness of any spectral signal based on a preset configuration value, the instantaneous specific loudness of any spectral signal, and the human perceived loudness of a spectral signal preceding the any spectral signal.

[0013] In some embodiments of the present application, controlling the lighting effect of at least one lighting device according to the human-perceived loudness of the sound signal includes: controlling the lighting effect of the at least one lighting device according to a preset control function and the size of the human-perceived loudness.

[0014] In some embodiments of the present application, the method further includes: generating the human-perceived loudness based on a plurality of preset filters and the analog signal.

[0015] On the other hand, the present application provides a lighting effect control device, which operates on an electronic device and includes: an acquisition unit for acquiring a sound signal; a construction unit for constructing a corresponding impulse response filter based on the sound field type of the sound signal; a processing unit for filtering the sound signal according to the impulse response filter to obtain an analog signal; a transformation unit for transforming the analog signal to obtain multiple spectrum signals; a calculation unit for calculating a target excitation value for each spectrum signal and calculating the human-perceived loudness of each spectrum signal based on the target excitation value; and a control unit for controlling the lighting effect of at least one lighting device based on the human-perceived loudness of the sound signal.

[0016] On the other hand, the present application provides an electronic device, comprising: a memory storing at least one instruction; and a processor executing the at least one instruction to implement the lighting effect control method.

[0017] On the other hand, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores at least one instruction, and the at least one instruction is executed by a processor in an electronic device to implement the lighting effect control method.

[0018] In the above embodiment, since the impulse filter is constructed based on the sound field type of the sound signal, each impulse response filter is equivalent to the structure of the human ear in the corresponding sound field. Filtering the sound signal according to the impulse response filter simulates the filtering characteristics of the human ear structure on the sound signal, allowing the simulated signal to accurately reflect the sound perceived by the human body, and thus allowing the human-perceived loudness calculated from the simulated signal to accurately reflect the actual sound loudness perceived by the human body. Controlling the lighting effect of the lighting device based on the human-perceived loudness can ensure that the controlled lighting effect matches the actual sound loudness perceived by the user. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] FIG1 is a diagram showing an application environment of a lighting effect control method provided in an embodiment of the present application.

[0020] FIG2 is a flow chart of a lighting effect control method provided in an embodiment of the present application.

[0021] FIG3 is a flow chart of a method for calculating a target incentive value provided by an embodiment of the present application.

[0022] FIG4 is a flow chart of a method for calculating human-perceived loudness provided in an embodiment of the present application.

[0023] FIG5 is a flowchart of a lighting effect control method provided by another embodiment of the present application.

[0024] FIG6 is a functional module diagram of a lighting effect control device provided in an embodiment of the present application.

[0025] FIG7 is a structural diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0026] It should be noted that in this application, "at least one" means one or more, and "more than one" means two or more than two. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The terms "first", "second", "third", "fourth", etc. (if any) in the specification, claims and drawings of this application are used to distinguish similar objects, rather than to describe a specific order or sequence.

[0027] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a concrete manner. The following embodiments and features in the embodiments may be combined with each other unless there is a conflict.

[0028] People can associate sounds with colors and / or lighting effects. People mentally associate the perceived loudness of a sound with a corresponding lighting color and / or effect. For example, people often associate loud sounds with bright colors, such as white and yellow. This is because loud sounds stimulate the auditory nerves, causing feelings of excitement and pleasure, similar to the emotional responses evoked by bright colors. Furthermore, the human brain also combines sound and visual information to form associations with lighting effects.

[0029] Among the technologies used to control lighting effects, the frequency of sound signals is the primary method for controlling lighting effects. However, the human auditory system's perception of sound loudness is dependent on factors such as the signal's amplitude, frequency, sound pressure level, duration, and propagation direction. Controlling lighting effects solely based on the frequency of sound signals does not align with human subjective perception and accurately reflects the perceived loudness of sound. Consequently, the controlled lighting effect does not match the perceived loudness of the sound, resulting in inaccurate lighting control and a lack of a comfortable user experience.

[0030] In order to solve the above problems, the embodiments of the present application provide a lighting effect control method, an electronic device and a storage medium, which will be introduced below in conjunction with relevant drawings.

[0031] Figure 1 shows an application environment for a lighting effect control method according to an embodiment of the present application. In Figure 1 , an electronic device 10 communicates with multiple lighting devices 20. The electronic device 10 can connect to the multiple lighting devices 20 via Bluetooth, hotspots, Wi-Fi, or other methods, enabling the electronic device 10 to control the lighting effects (e.g., brightness) of the multiple lighting devices 20.

[0032] The electronic device 10 may be a mobile phone, a tablet computer, a laptop computer, or other electronic device. The embodiment of the present application does not impose any limitation on the specific type of the electronic device.

[0033] The multiple lighting devices 20 can be multiple lamps, for example, lamps using light emitting diodes (LEDs) as light sources, referred to as LED lamps, energy-saving lamps, floodlights, security lamps, light strips and lamp beads that present different lighting effects according to different sound loudness, etc. The embodiments of the present application do not impose any restrictions on the specific types of lighting devices.

[0034] FIG2 is a flowchart of a lighting effect control method according to an embodiment of the present application. The method is performed by an electronic device, such as electronic device 10 shown in FIG1 . The order of the steps in the flowchart may be adjusted to meet specific requirements, and some steps may be omitted.

[0035] S11, obtaining a sound signal.

[0036] In some embodiments, the electronic device may obtain the sound signal (sound wave signal) from a sound collection device such as a microphone. The sound collection device may also be a microphone, a sound card, a vibration sensor, etc. Since the microphone performs signal processing (such as sampling, quantization, and pulse code modulation (PCM)) on the collected raw signal, the sound signal is a digital signal after signal processing.

[0037] In other embodiments of the present application, the electronic device may use a received digital source file of audio information as the sound signal. The format of the digital source file of audio information may be WMA, WAV, APE, FLAC, etc. For example, the electronic device may receive a signal in a digital source file of audio information in WAV format uploaded by a user as the sound signal.

[0038] S12: constructing a corresponding impulse response filter according to the sound field type of the sound signal.

[0039] In some embodiments, the sound field type refers to the propagation environment of the sound signal, and the sound field types include free sound field, diffuse sound field, and headphone sound field. The free sound field refers to an open propagation environment without any reflection or interference, the diffuse sound field refers to a closed propagation environment with reflection and interference, and the headphone sound field refers to a propagation environment created by wearing headphones.

[0040] In one embodiment of the present application, if the sound field type is a free sound field, the electronic device constructs a corresponding impulse response filter (impulse response filter) according to the sound field type of the sound signal, including: the electronic device constructs a first low-pass filter as the impulse response filter according to a preset cutoff frequency and a preset filter type.

[0041] Among them, the preset cutoff frequency enables the first low-pass filter to only retain signals below the preset cutoff frequency when filtering the signal. The preset cutoff frequency can be set by yourself, and this application does not limit this. The preset filter types include, but are not limited to: Butterworth filter, Chebyshev filter and elliptic filter, etc. The first low-pass filter is represented as a transfer function. The electronic device can use software such as Matlab or python to calculate multiple filter coefficients according to the preset cutoff frequency and the preset filter type, and use the transfer function generated by the multiple filter coefficients as the first low-pass filter. The multiple filter coefficients include normalized cutoff frequency and filter order, etc.

[0042] In another embodiment of the present application, if the sound field type is a diffuse sound field, the electronic device constructs a corresponding impulse response filter according to the sound field type of the sound signal, including: the electronic device constructs a filter group consisting of multiple second low-pass filters and high-pass filters in series as the impulse response filter.

[0043] Among them, the construction process of multiple second low-pass filters is basically the same as the construction process of the first low-pass filter, so this application will not repeat the description here.

[0044] When constructing a high-pass filter, it is necessary to select a high-pass cutoff frequency so that the high-pass filter retains only signals above the high-pass cutoff frequency when filtering the signal. The high-pass cutoff frequency can be set arbitrarily and is not limited in this application. The construction process of the high-pass filter can be referenced in related art.

[0045] In another embodiment of the present application, if the sound field type is a headphone sound field, the electronic device constructs a corresponding impulse response filter according to the sound field type of the sound signal, including: the electronic device constructs a filter group consisting of the multiple second low-pass filters and the band-pass filters in series as the impulse response filter.

[0046] When constructing the bandpass filter, it is necessary to select a preset upper frequency limit and a preset lower frequency limit so that the bandpass filter only retains signals within the range of the preset upper frequency limit and the preset lower frequency limit when filtering the signal. The preset upper frequency limit and the preset lower frequency limit can be set arbitrarily, and this application does not impose any restrictions on this. The construction process of the bandpass filter can refer to the relevant art.

[0047] In this embodiment, since the impulse response filter is constructed according to the sound field type, the impulse response filter is equivalent to the structure of a human ear in the corresponding sound field.

[0048] S13, filtering the sound signal according to the impulse response filter to obtain an analog signal.

[0049] In some embodiments, the electronic device filters the sound signal according to the impulse response filter to obtain the analog signal, which includes: the electronic device performs a convolution operation on the impulse response filter and the sound signal to obtain the analog signal.

[0050] In this embodiment, since the impulse response filter is a transfer function, the impulse response filter can perform a convolution operation with the sound signal.

[0051] In this embodiment, the sound signal is filtered using the impulse response filter, simulating the filtering characteristics of the human ear structure on the sound signal, so that the simulated signal can accurately reflect the sound perceived by the human body.

[0052] S14, transforming the analog signal to obtain multiple spectrum signals.

[0053] In some embodiments of the present application, the electronic device transforms the analog signal to obtain multiple spectrum signals, including: the electronic device frames the analog signal to obtain multiple short-time period signals, performs windowing processing on each short-time period signal, and performs Fourier transform on each short-time period signal after the windowing processing to obtain a spectrum signal of each short-time period signal.

[0054] The lengths of the multiple short-period signals may be the same or different, and the number of the multiple short-period signals may be set arbitrarily, which is not limited in this application. For example, the number of the multiple short-period signals may be 24.

[0055] The electronic device may perform windowing processing on each short-term signal using a time window function, where the time window function may be a rectangular window function, a Hamming window function, a Blackman window function, etc. The Fourier transform includes, but is not limited to, a fast Fourier transform (FFT) and a short-time Fourier transform (STFT), etc. The electronic device performs windowing processing on each short-term signal including: multiplying each short-term signal by the time window function to obtain the short-term signal after the windowing processing.

[0056] In this embodiment, framing the analog signal can make each short-term signal more stable and more consistent with the periodicity requirement of Fourier transform. Windowing each short-term signal can reduce spectrum leakage of the spectrum signal.

[0057] In other embodiments of the present application, the electronic device can first perform Fourier transform on the analog signal to obtain an initial spectrum signal of the analog signal, select a target spectrum signal from the initial spectrum signal based on the frequency band range that the human ear can perceive, and frame the target spectrum signal to obtain multiple sub-spectrum signals, and then the electronic device uses the time window function to perform windowing processing on each sub-spectrum signal to obtain the multiple spectrum signals.

[0058] Among them, the electronic device can select a signal in the frequency band range from the initial spectrum signal as the target spectrum signal. For example, the frequency band range can be 50-15000HZ, etc. In the process of using the time window function to perform windowing processing on each sub-spectrum signal, the smaller the frequency band of the sub-spectrum signal, the longer the time window function used. The number of the multiple sub-spectrum signals can be set by yourself, and this application does not impose any restrictions on this. For example, the number of the multiple sub-spectrum signals can be 24 or 100, etc.

[0059] In this embodiment, a target spectrum signal is selected from the initial spectrum signal based on the frequency band range that can be perceived by the human ear. Redundant signals are filtered out while ensuring that the target spectrum signal covers the frequency band range that can be perceived by the human ear, thereby increasing the generation speed of the multiple spectrum signals.

[0060] S15, calculating the target excitation value of each spectrum signal.

[0061] In some embodiments of the present application, each target excitation value is obtained by calculating the power of all frequency components in each spectral signal by the auditory filter corresponding to each spectral signal. Each auditory filter is expressed as a function of the center frequency of each spectral signal, and the bandwidth and shape of the auditory filter corresponding to each spectral signal are determined by the center frequency and weight coefficient (or sound pressure level) corresponding to each spectral signal. The center frequency and the weight coefficient will be described below with respect to the process in Figure 3.

[0062] S16: Calculate the human-perceived loudness of each spectrum signal according to the target excitation value.

[0063] In some embodiments of the present application, the human-perceived loudness refers to the calculated perceived loudness of the sound signal by the human auditory system. Each target stimulus value can be converted into a corresponding human-perceived loudness using multiple preset thresholds. For a detailed description of the process in FIG. 4 , please refer to the following description.

[0064] S17: Control a lighting effect of at least one lighting device according to the human-perceived loudness of the sound signal.

[0065] In some embodiments of the present application, controlling the lighting effect of at least one lighting device based on the human-perceived loudness of the sound signal includes: the electronic device controlling the lighting effect of the at least one lighting device based on a preset control function and the magnitude of the human-perceived loudness. The human-perceived loudness may be one or more, and the lighting device may be a plurality of lamps, such as lamp beads and light strips, for example, the plurality of lighting devices 20 in FIG1 .

[0066] The preset control function may be a function between lighting effect and human perceived loudness, where the dependent variable in the preset control function is a parameter corresponding to the lighting effect, and the independent variable is a parameter corresponding to human perceived loudness. By substituting each human perceived loudness into the preset control function, a target lighting effect corresponding to each human perceived loudness can be obtained, and then the lighting effect of the at least one lighting device is controlled based on the target lighting effect. In the preset control function, the lighting effect is positively correlated with human perceived loudness: a larger human perceived loudness corresponds to a higher lighting effect, and a smaller human perceived loudness corresponds to a lower lighting effect. For example, the preset control function may be y=kx or y=k(zx), where y is a parameter corresponding to the lighting effect, k is a preset constant greater than 1, x is a parameter corresponding to human perceived loudness, and z can be calculated using multiple historical human perceived loudness values ​​(for example, it can be the average of multiple historical human perceived loudness values).

[0067] In other embodiments of the present application, in addition to controlling the lighting effects of the at least one lighting device, the at least one lighting device can also be controlled to emit a specific lighting effect based on the human-perceived loudness. For example, when any human-perceived loudness is greater than or equal to a preset loudness threshold, the electronic device can control the light strip to emit flashing lights. Alternatively, when the human-perceived loudness is less than the preset loudness threshold, the electronic device can control the light strip to emit a slow-moving water-ripple lighting effect. Furthermore, for sounds transmitted from a distance, the human ear perceives a lower loudness (human-perceived loudness), while for sounds transmitted from nearby, the human ear perceives a higher loudness (human-perceived loudness). Therefore, the human-perceived loudness varies for sounds transmitted at different distances. When the human ear perceives a sound whose human-perceived loudness changes from low to high, it creates a sense of space approaching. Therefore, the lighting effect of the at least one electronic device can be controlled to change based on the change in human-perceived loudness. For example, when the human body perceives loudness from small to large, the electronic device can control the lamp beads from far to near to become brighter and brighter within a unit time, so as to present an oncoming lighting effect that matches the human body's perceived loudness, giving the user a three-dimensional visual and auditory enjoyment.

[0068] In other embodiments of the present application, the at least one lighting device may be controlled by other more control functions to enrich the lighting effect as the loudness perceived by the human body changes.

[0069] In related technologies, loudness level (in squares) is often used to describe the subjective perception of sound by the human ear. The higher the loudness level, the louder the sound perceived by the human ear. The human ear's perception of sound is related to multiple factors, such as the duration of the sound, sound pressure level, frequency, and timbre.

[0070] Research has shown that the human ear's perception of sound has the following characteristics: (1) Within a certain range, the longer the sound lasts, the louder the human ear perceives the sound. (2) For sounds with the same sound pressure level and different frequencies, the loudness perceived by the human ear is different (the loudness levels are different); in order for the human ear to perceive sounds with the same loudness level, the required sound pressure level and frequency are also different. (3) The human ear's perception of sounds of different frequencies is affected by the sound pressure level. For sounds with different frequencies and sound pressure levels above 80dB, the loudness levels perceived by the human ear are basically the same (when the sound pressure level is high, the loudness perceived by the human ear for sounds of different frequencies is basically the same).

[0071] Based on the aforementioned characteristics of the human ear's perception of sound, it can be seen that relying on the frequency of sound signals to control the lighting effects of lighting equipment does not align with human subjective perception and cannot accurately reflect the perceived loudness of sound, resulting in inaccurate controlled lighting effects. For example, for sound signals with varying frequencies and sound pressure levels above 80dB, if the lighting effects of a lighting device are controlled based on the frequency of the sound signal, the lighting effect will vary accordingly depending on the frequency. However, based on the aforementioned characteristics, the human ear perceives essentially the same loudness level for sounds with varying frequencies and sound pressure levels above 80dB, and the lighting effect should remain unchanged. Therefore, controlling lighting effects based on the frequency of the sound signal does not align with human subjective perception.

[0072] For a white noise signal composed of a uniform mixture of sounds of all frequencies within the human hearing range (20Hz-20,000Hz), its loudness is evenly distributed within the human hearing range (the loudness levels perceived by the human ear are essentially the same). In this case, it should be controlled to change at a gentle, uniform rate, such as controlling the lighting device to produce a slow, water-ripple effect, to align with the human body's subjective perception of white noise. However, if the lighting effect of the lighting device is controlled based on the frequency of the sound signal, the lighting effect will change accordingly when the frequency of the white noise changes. Therefore, controlling the lighting effect based on the frequency of the sound signal does not align with the human body's subjective perception.

[0073] To address the above technical issues, the loudness of sound or human-perceived loudness in the embodiments of the present application are both subjective loudness. Objective loudness is the amplitude of a sound wave. Unlike objective loudness, subjective loudness is the loudness perceived by the human body after the sound signal passes through the human auditory system and nervous system (human-perceived loudness is derived by simulating the filtering characteristics of the sound signal by the human ear). Therefore, human-perceived loudness accurately reflects the actual loudness perceived by the human body. Controlling the lighting effects of lighting equipment using accurate human-perceived loudness can improve the accuracy of lighting effect control.

[0074] In the above embodiment, since the impulse filter is constructed based on the sound field type of the sound signal, each impulse response filter is equivalent to the structure of the human ear in the corresponding sound field. Filtering the sound signal according to the impulse response filter simulates the filtering characteristics of the human ear structure on the sound signal, allowing the simulated signal to accurately reflect the sound perceived by the human body, and thus allowing the human-perceived loudness calculated from the simulated signal to accurately reflect the actual sound loudness perceived by the human body. Controlling the lighting effect of the lighting device based on the human-perceived loudness can ensure that the controlled lighting effect matches the actual sound loudness perceived by the user.

[0075] In some embodiments of the present application, FIG3 is a flow chart of a method for calculating a target incentive value provided by an embodiment of the present application. Specifically, the method includes the following steps:

[0076] S151, calculating the center frequency of each spectrum signal.

[0077] In some embodiments of the present application, the electronic device calculates the center frequency of each target spectrum signal from each target spectrum signal at a preset time interval. The preset time interval can be set arbitrarily and is not limited in this application. For example, the preset time interval can be 1 ms. The center frequency can be the frequency corresponding to the peak value of each spectrum signal, or the center frequency can be obtained by performing a weighted operation on each spectrum signal.

[0078] S152: Calculate the equirectangular bandwidth of each spectrum signal according to the center frequency.

[0079] In some embodiments of the present application, the center frequency is substituted into a preset equirectangular bandwidth calculation formula to obtain the equirectangular bandwidth. The equirectangular bandwidth calculation formula is a function of the center frequency.

[0080] For example, the calculation method of the equirectangular bandwidth can refer to the following formula (1): ERBc=24.673(0.004358f c +1); (1)

[0081] Wherein, ERBc represents the equirectangular bandwidth, f c represents the center frequency.

[0082] S153 , determining a frequency range corresponding to each spectrum signal according to the center frequency and the equirectangular bandwidth of each spectrum signal.

[0083] In some embodiments of the present application, the electronic device calculates the sum of the center frequency and one-half of the equirectangular bandwidth, calculates the difference between the center frequency and one-half of the equirectangular bandwidth, and generates the frequency range based on the sum and the difference. For example, if the center frequency is A and the equirectangular bandwidth is B, then the frequency range is [A+B / 2, AB / 2].

[0084] S154 , calculating a target excitation value for each spectrum signal according to the effective power and weight coefficient of each frequency component in the corresponding frequency range in each spectrum signal.

[0085] In some embodiments of the present application, the electronic device calculates the product of the effective value power of each frequency component in the corresponding frequency range in each spectrum signal and the weight coefficient, and determines the sum of multiple products corresponding to each spectrum signal as the target excitation value of each spectrum signal. The effective value power of each frequency component can be calculated based on the center frequency and equirectangular bandwidth corresponding to the frequency component, and the weight coefficient of each frequency component can be calculated based on the center frequency and effective value power of the frequency component.

[0086] For example, the target excitation value can be calculated using the Moore steady-state loudness model. The specific calculation formulas can refer to the following formulas (2)-(8): w j =(1+p j g j ); (3)

[0087] If f j ≤f c ,

[0088] like

[0089] like

[0090] like

[0091] like

[0092] Among them, E c represents the target incentive value, w j Represents the weight coefficient, p j The effective power, E0, represents the output value of a pure tone signal with a frequency of 1000 Hz and a sound pressure level of 0 dB after passing through an auditory filter with a center frequency of 1000 Hz, and p0 represents the preset sound pressure level (e.g., 2×10 -5 Pa), ERBc represents the equirectangular bandwidth, f j Represents the frequency value of the jth frequency component of the spectrum signal in the corresponding frequency range, f c represents the center frequency, ERBLj represents f j The corresponding input excitation level, ERBLj, can be calculated by referring to relevant technologies.

[0093] In some embodiments of the present application, FIG4 is a flow chart of a method for calculating human perceived loudness provided by an embodiment of the present application. Specifically, the method includes the following steps:

[0094] S161 , calculating the instantaneous specific loudness of each target stimulus value according to a comparison result between each target stimulus value and a first preset threshold value and a second preset threshold value.

[0095] In some embodiments of the present application, the second preset threshold is greater than the first preset threshold. The first preset threshold and the second preset threshold can be set arbitrarily, and the present application does not limit this. For example, the first preset threshold can be 2000, and the second preset threshold can be 10 10 .

[0096] The comparison results between each target stimulus value and the first preset threshold and the second preset threshold include: the target stimulus value is less than the first preset threshold, or the target stimulus value is greater than or equal to the first preset threshold and less than the second preset threshold, or the target stimulus value is greater than the second preset threshold. For different comparison results, different formulas can be used to calculate the instantaneous specific loudness of each target stimulus value based on each target stimulus value, and each formula can be a function of the target stimulus value.

[0097] For example, when the target stimulus value is less than the first preset threshold, the calculation method of the instantaneous specific loudness of the target stimulus value may refer to the following formula (9); or, when the target stimulus value is greater than or equal to the first preset threshold and less than the second preset threshold, the calculation method of the instantaneous specific loudness of the target stimulus value may refer to the following formula (10); or, when the target stimulus value is greater than the second preset threshold, the calculation method of the instantaneous specific loudness of the target stimulus value may refer to the following formula (11).

[0098] Where N′ represents the instantaneous specific loudness, C represents the preset constant, and E c represents the target incentive value, E THRQ represents the first preset threshold, G represents the gain of the auditory filter corresponding to the target excitation value, E0 represents the output value of a pure tone signal with a frequency of 1000 Hz and a sound pressure level of 0 dB after passing through an auditory filter with a center frequency of 1000 Hz, and A and α are both preset values ​​related to G.

[0099] S162 : For a first spectrum signal among the multiple spectrum signals, use the instantaneous specific loudness of the first spectrum signal as the human-perceived loudness of the first spectrum signal.

[0100] In this embodiment, since the perceived loudness of the first spectrum signal among the multiple spectrum signals is not interfered with by other perceived loudnesses, the electronic device can directly use the instantaneous specific loudness of the first spectrum signal as the human perceived loudness of the first spectrum signal.

[0101] S163 : For any spectrum signal other than the first spectrum signal among the multiple spectrum signals, calculate the human perceived loudness of the any spectrum signal according to a preset configuration value, the instantaneous specific loudness of the any spectrum signal, and the human perceived loudness of a spectrum signal previous to the any spectrum signal.

[0102] In some embodiments of the present application, the electronic device calculating the human perceived loudness of any spectral signal based on a preset configuration value, the instantaneous specific loudness of any spectral signal, and the human perceived loudness of a spectral signal preceding the any spectral signal includes: the electronic device may perform a weighted operation on the instantaneous specific loudness of the any spectral signal and the human perceived loudness of the spectral signal preceding the any spectral signal based on the preset configuration value to obtain the human perceived loudness of the any spectral signal. The preset configuration value can be set voluntarily and is not limited in this application. For example, the preset configuration value is 0.01 or 0.005.

[0103] For example, the calculation method of the human body perceived loudness can refer to the following formula (12): N n ′=α r N n +(1-α r )N n-1 '; (12)

[0104] Among them, N n ′ represents the human perceived loudness of the nth spectrum signal, n is greater than or equal to 2, α r Represents the preset configuration value, N n Represents the instantaneous specific loudness of the nth spectrum signal, N n-1 ′ represents the human-perceived loudness of the spectrum signal of the n-1th spectrum signal.

[0105] The preset configuration value can be set arbitrarily, and this application does not limit this. For example, the preset configuration value can be 0.01.

[0106] In this embodiment, since the perceived loudness of any spectrum signal other than the first spectrum signal among the multiple spectrum signals is affected by the instantaneous perceived loudness of the previous spectrum signal, for any spectrum signal other than the first spectrum signal among the multiple spectrum signals, calculating the human perceived loudness of the any spectrum signal other than the first spectrum signal by weighted operation can improve the accuracy of the human perceived loudness.

[0107] FIG5 is a flowchart of a lighting effect control method according to another embodiment of the present application. The method is performed by an electronic device, such as electronic device 10 shown in FIG1 . The order of the steps in the flowchart may be adjusted to meet specific requirements, and some steps may be omitted.

[0108] S21, obtaining a sound signal.

[0109] In some embodiments, the sound signal is a signal processed by signal processing such as PCM encoding. The detailed process of obtaining the sound signal can be referred to step S11, and will not be repeated in this application.

[0110] S22: Construct a corresponding impulse response filter according to the sound field type of the sound signal.

[0111] In some embodiments, the sound field type refers to the propagation environment of the sound signal, and the sound field types include free sound field, diffuse sound field, and headphone sound field. The detailed process of constructing the impulse response filter corresponding to the sound field type can be specifically referred to in step S12 above.

[0112] S23, filtering the sound signal according to the impulse response filter to obtain an analog signal.

[0113] In some embodiments, the electronic device filters the sound signal according to the impulse response filter to obtain the analog signal, which includes: the electronic device performs a convolution operation on the impulse response filter and the sound signal to obtain the analog signal.

[0114] In this embodiment, since the impulse response filter is a transfer function, a convolution operation can be performed on the sound signal.

[0115] S24: Generate human-perceived loudness of the sound signal based on a plurality of preset filters and the analog signal.

[0116] In some embodiments, the plurality of preset filters include, but are not limited to: a second-order filter, a square filter, a smoothing filter, etc. The plurality of preset filters can be pre-set, and this application does not impose any limitation on this.

[0117] In some embodiments of the present application, the electronic device generates the human-perceived loudness of the sound signal based on multiple preset filters and the analog signal, including: framing the analog signal to obtain multiple first signals, performing signal extraction on each first signal using the second-order filter to obtain a second signal corresponding to each first signal, filtering each second signal using the square filter to obtain a third signal corresponding to each second signal, and performing weighted averaging on each third signal using the smoothing filter to obtain the human-perceived loudness of each third signal, thereby obtaining the human-perceived loudness of the sound signal. The human-perceived loudness may be one or more.

[0118] In this embodiment, the second-order filter can be preconfigured to extract a second signal within a predetermined frequency range from each first signal. Multiple second-order filters may be provided. The square filter can filter out noise from each second signal. The smoothing filter can reduce noise and fluctuations in each third signal by performing a weighted average on each third signal and outputting the weighted average as an output value.

[0119] Figure 6 shows a functional block diagram of a lighting effect control device according to one embodiment of the present application. The lighting effect control device 11 includes an acquisition unit 110, a construction unit 111, a processing unit 112, a transformation unit 113, a calculation unit 114, and a control unit 115. A module / unit as referred to herein refers to a series of computer-readable instruction segments that can be acquired by the processor 13 in Figure 7 and perform a fixed function, and is stored in the memory 12 in Figure 7. The functions of each module / unit in this embodiment will be described in detail in subsequent embodiments.

[0120] The acquisition unit 110 is configured to acquire a sound signal.

[0121] The constructing unit 111 is configured to construct a corresponding impulse response filter according to the sound field type of the sound signal.

[0122] In some embodiments of the present application, if the sound field type is a free sound field, the constructing unit 111 is further configured to construct a first low-pass filter as the impulse response filter according to a preset cutoff frequency and a preset filter type.

[0123] In some embodiments of the present application, if the sound field type is a diffuse sound field, the constructing unit 111 is further configured to construct a filter group consisting of a plurality of second low-pass filters and high-pass filters connected in series as the impulse response filter.

[0124] In some embodiments of the present application, if the sound field type is a headphone sound field, the constructing unit 111 is further configured to construct a filter group consisting of the plurality of second low-pass filters and band-pass filters connected in series as the impulse response filter.

[0125] The processing unit 112 is configured to filter the sound signal using the impulse response filter to obtain an analog signal.

[0126] In some embodiments of the present application, the processing unit 112 is further configured to perform a convolution operation on the impulse response filter and the sound signal to obtain the analog signal.

[0127] The transforming unit 113 is configured to transform the analog signal to obtain multiple spectrum signals.

[0128] In some embodiments of the present application, the transformation unit 113 is further used to frame the analog signal to obtain multiple short-term signals, perform windowing processing on each short-term signal, and perform Fourier transform on each short-term signal after windowing processing to obtain a spectrum signal of each short-term signal.

[0129] The calculation unit 114 is configured to calculate a target excitation value for each spectrum signal, and calculate a human-perceived loudness of each spectrum signal according to the target excitation value.

[0130] In some embodiments of the present application, the calculation unit 114 is also used to calculate the center frequency of each spectrum signal, and calculate the equirectangular bandwidth of each spectrum signal based on the center frequency, determine the frequency range corresponding to each spectrum signal based on the center frequency and the equirectangular bandwidth of each spectrum signal, and calculate the target excitation value of each spectrum signal based on the effective value power and weight coefficient of each frequency component in each spectrum signal in the corresponding frequency range.

[0131] In some embodiments of the present application, the calculation unit 114 is further configured to: calculate the instantaneous specific loudness of each target stimulus value based on a comparison result between each target stimulus value and a first preset threshold value and a second preset threshold value; for a first spectrum signal among the multiple spectrum signals, use the instantaneous specific loudness of the first spectrum signal as the human perceived loudness of the first spectrum signal; and for any spectrum signal among the multiple spectrum signals other than the first spectrum signal, calculate the human perceived loudness of the any spectrum signal based on a preset configuration value, the instantaneous specific loudness of the any spectrum signal, and the human perceived loudness of a spectrum signal preceding the any spectrum signal.

[0132] The control unit 115 is configured to control a lighting effect of at least one lighting device according to the human-perceived loudness of the sound signal.

[0133] In some embodiments of the present application, the control unit 115 is further configured to control a lighting effect of the at least one lighting device according to a preset control function and the magnitude of the human-perceived loudness.

[0134] In some other embodiments of the present application, the calculation unit 114 further includes a generation subunit, and the generation subunit is configured to generate the human-perceived loudness based on a plurality of preset filters and the analog signal.

[0135] FIG7 is a block diagram of an electronic device according to an embodiment of the present application. The electronic device 10 shown in FIG7 may include a communication module 101, a memory 102, a processor 103, an input / output (I / O) interface 104, and a bus 105. The processor 103 is coupled to the communication module 101, the memory 102, and the I / O interface 104 via the bus 105.

[0136] The communication module 101 may include a wired communication module and / or a wireless communication module. The wired communication module may provide one or more wired communication solutions such as universal serial bus (USB) and controller area network (CAN). The wireless communication module may provide one or more wireless communication solutions such as wireless fidelity (Wi-Fi), Bluetooth (BT), mobile communication network, frequency modulation (FM), near field communication (NFC), infrared technology (IR), etc.

[0137] The memory 102 may include one or more random access memories (RAMs) and one or more non-volatile memories (NVMs). The RAM can be directly read and written by the processor 103 and can be used to store executable programs (e.g., machine instructions) of other running programs, as well as user and application data. The RAM may include static random-access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), etc.

[0138] The non-volatile memory can also store executable programs and user and application data, etc., and can be pre-loaded into the random access memory for direct reading and writing by the processor 110. The non-volatile memory can include disk storage devices and flash memory.

[0139] The memory 102 is used to store one or more computer programs. The one or more computer programs are configured to be executed by the processor 103. The one or more computer programs include multiple instructions. When the multiple instructions are executed by the processor 103, the lighting effect control method executed on the electronic device 10 can be implemented.

[0140] In other embodiments, the electronic device 10 shown in FIG. 6 further includes an external memory interface for connecting to an external memory to expand the storage capacity of the electronic device 10 .

[0141] The processor 103 may include one or more processing units. For example, the processor 103 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0142] The processor 103 provides computing and control capabilities. For example, the processor 103 is configured to execute a computer program stored in the memory 102 to implement the above-mentioned lighting effect control method.

[0143] The input / output interface 104 is used to provide a channel for user input or output. For example, the input / output interface 104 can be used to connect various input and output devices, such as a mouse, keyboard, touch device, display screen, etc., so that the user can enter information or visualize information.

[0144] The bus 105 is at least used to provide a channel for mutual communication among the communication module 101 , the memory 102 , the processor 103 , and the input / output interface 104 in the electronic device 10 .

[0145] It should be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 10. In other embodiments of the present application, the electronic device 10 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0146] An embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored. The computer program includes program instructions. The method implemented when the program instructions are executed can refer to the methods in the above-mentioned embodiments of the present application.

[0147] The computer-readable storage medium may be an internal memory of the electronic device described in the above embodiment, such as a hard disk or memory of the electronic device. The computer-readable storage medium may also be an external storage device of the electronic device, such as a plug-in hard disk, a smart memory card (SMC), a secure digital (SD) card, a flash memory card, etc. equipped on the electronic device.

[0148] In some embodiments, the computer-readable storage medium may include a program storage area and a data storage area, wherein the program storage area may store an operating system, applications required for at least one function, etc.; the data storage area may store data created according to the use of the electronic device, etc.

[0149] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices, and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of modules is merely a logical function division, and other division methods may be used in actual implementation.

[0150] The modules described as separate components may or may not be physically separate, and the components displayed as modules may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the present embodiment. In addition, the functional modules in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The above-mentioned integrated units may be implemented in the form of hardware or in the form of hardware plus software functional modules.

[0151] Therefore, from any point of view, the embodiments should be regarded as illustrative and non-restrictive, and the scope of the present application is limited by the appended claims rather than the above description, and it is intended that all changes that fall within the meaning and scope of equivalents of the claims are included in this application. Any figure mark in the claims should not be regarded as limiting the claim involved. In addition, it is obvious that the word "comprising" does not exclude other units or steps, and the singular does not exclude the plural. Multiple units or devices stated in this application can also be implemented by one unit or device through software or hardware. Words such as first and second are used to indicate names and do not indicate any particular order.

[0152] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application and are not intended to limit the present application. Although the present application has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solutions of the present application may be modified or replaced by equivalents without departing from the spirit and scope of the technical solutions of the present application.

Claims

1. A lighting effect control method, characterized in that: The method comprises: Acquire a sound signal, and construct a corresponding impulse response filter according to the sound field type of the sound signal; Filtering the sound signal according to the impulse response filter to obtain an analog signal; Transforming the analog signal to obtain multiple spectrum signals; Calculating a target excitation value for each spectrum signal, and calculating a human-perceived loudness for each spectrum signal according to the target excitation value; The lighting effect of at least one lighting device is controlled according to the human-perceived loudness of the sound signal.

2. The lighting effect control method according to claim 1, characterized in that: The step of constructing a corresponding impulse response filter according to the sound field type of the sound signal comprises: If the sound field type is a free sound field, constructing a first low-pass filter as the impulse response filter according to a preset cutoff frequency and a preset filter type; or If the sound field type is a diffuse sound field, constructing a filter group consisting of a plurality of second low-pass filters and high-pass filters connected in series as the impulse response filter; or If the sound field type is a headphone sound field, a filter group formed by connecting the plurality of second low-pass filters and band-pass filters in series is constructed as the impulse response filter.

3. The lighting effect control method according to claim 2, characterized in that: The filtering the sound signal according to the impulse response filter to obtain an analog signal comprises: The impulse response filter is convolved with the sound signal to obtain the analog signal.

4. The lighting effect control method according to claim 1, characterized in that: The converting the analog signal to obtain a plurality of spectrum signals comprises: Framing the analog signal to obtain multiple short-term signals; Each short-term signal is subjected to windowing processing, and each short-term signal after the windowing processing is subjected to Fourier transform to obtain a spectrum signal of each short-term signal.

5. The lighting effect control method according to claim 1 or 4, characterized in that: The calculating of the target excitation value of each spectrum signal comprises: Calculate the center frequency of each spectrum signal, and calculate the Equirectangular bandwidth; According to the center frequency and equirectangular bandwidth of each spectrum signal, the frequency range corresponding to each spectrum signal is determined; The target excitation value of each spectrum signal is calculated according to the effective value power and the weight coefficient of each frequency component in the corresponding frequency range in each spectrum signal.

6. The lighting effect control method according to claim 1, characterized in that: The step of calculating the human perceived loudness of each spectrum signal according to the target excitation value comprises: Calculating the instantaneous specific loudness of each target stimulus value according to the comparison result between each target stimulus value and the first preset threshold value and the second preset threshold value; For a first spectrum signal among the multiple spectrum signals, taking the instantaneous specific loudness of the first spectrum signal as the human-perceived loudness of the first spectrum signal; For any spectrum signal among the multiple spectrum signals except the first spectrum signal, the human perceived loudness of the any spectrum signal is calculated according to a preset configuration value, the instantaneous specific loudness of the any spectrum signal, and the human perceived loudness of a spectrum signal previous to the any spectrum signal.

7. The lighting effect control method according to claim 1, characterized in that: The controlling the lighting effect of at least one lighting device according to the human-perceived loudness of the sound signal comprises: The lighting effect of the at least one lighting device is controlled according to a preset control function and the magnitude of the human body perceived loudness.

8. The lighting effect control method according to claim 1, characterized in that: The method further comprises: The human perceived loudness is generated based on a plurality of preset filters and the analog signal.

9. An electronic device, comprising: A memory storing at least one instruction; and A processor executes the at least one instruction to implement the lighting effect control method according to any one of claims 1 to 8.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores at least one instruction, and the at least one instruction is executed by a processor in an electronic device to implement the lighting effect control method according to any one of claims 1 to 8.

Images