A method and system for controlling the change of lights by sound

Abstract

The present application provides a method and system for controlling the change of lights by sound, belonging to the field of intelligent light control, which includes: collecting sound signals and performing operational amplification and volume control processing to obtain an output signal; performing a time-domain to frequency-domain conversion on the output signal according to the fast Fourier transform algorithm to obtain first information data; calculating the output signal and the first information data by using time-domain and / or frequency-domain processing methods to obtain second information data; analyzing and processing the reduction factors of color information according to the output signal and the first information data, obtaining a reduction coefficient and substituting it into a preset light color modulation formula for calculation to obtain third information data; controlling the on / off, brightness, and color of the lights according to the second information data and the third information data. It can adaptively assign colors to the display lights that match the music style and audio information; and provide appropriate light displays through a display control strategy, providing a better experience for users.

Description

Technical Field

[0001] The present invention belongs to the field of intelligent lighting control, and particularly relates to a method and system for controlling lighting changes by sound. Background Art

[0002] With the progress of technology and the improvement of living standards, people's demand for a quality life is increasing day by day. People have found that in addition to providing lighting functions, lights can also create an atmosphere by adjusting the color and brightness of the lights. Since then, various lighting systems aimed at rendering the scene atmosphere have emerged in the market, and the originally simple lighting lights have begun to become colorful and gorgeous. Among various atmosphere lighting technologies, there is an atmosphere lighting technology called lighting music rhythm that has had a very important impact on people's atmosphere creation and quality of life improvement. In the lighting system using this lighting technology, the lights usually change regularly with the change of background music, including brightness change, color change, etc.

[0003] There is a publicly disclosed music rhythm display system (patent application number: CN201910845112.X), which includes: a rhythm control device monitors the sound volume of a speaker device and outputs a control command to an in-vehicle display device to adjust the display brightness; when the speaker device plays sound, the rhythm control device monitors the sound frequency of the speaker device and outputs a control command to the in-vehicle display device to adjust the display color.

[0004] There is also a publicly disclosed in-vehicle music rhythm atmosphere lamp circuit (patent application number: CN202011292584.6), which includes a power supply circuit, a light sensor detection circuit, a constant voltage circuit, a light-emitting circuit, and a sound detection circuit. The power supply circuit outputs a stable voltage to the light-emitting circuit and the sound detection circuit after being regulated by the constant voltage circuit. The light sensor detection circuit controls the on / off of the constant voltage circuit by detecting the change of an external light signal. The light-emitting circuit includes a driving circuit and a light-emitting diode LED1. The sound detection circuit controls the on / off of the driving circuit by detecting the change of an external sound signal, so that the light-emitting diode LED1 lights and goes out rhythmically with the change of the external sound.

[0005] The above two existing solutions first collect sound and then analyze and process it to control the lights, realizing the linkage between sound and lights, that is, by establishing an intermediate control unit to realize the linkage of sound to lighting changes. However, this method has time delay and inaccuracy, the linear change of the lights is not natural, not saturated and vivid enough, has poor flexibility and is prone to errors. Summary of the Invention

[0006] The present application provides a method and system for controlling the change of lights by sound, aiming to solve the problems such as time delay, poor matching, unnatural linear change, insufficient saturation and vividness in the linkage between sound and light change.

[0007] To achieve the above object, the present invention adopts the following technical solutions, including:

[0008] Collect sound signals, perform operational amplification and volume control processing on the sound signals to obtain output signals;

[0009] Perform a time-domain to frequency-domain conversion on the output signals according to the fast Fourier transform algorithm to obtain first information data;

[0010] Perform calculations on the output signals and the first information data by using information processing methods in the time domain and / or frequency domain to obtain second information data;

[0011] Analyze and process the reduction factors of color information based on the output signals and the first information data to obtain reduction coefficients, and substitute the reduction coefficients into a preset light color modulation formula for calculation to obtain third information data. The reduction factors include sound audio signals, music styles and visual curves;

[0012] Control the turning on and off, brightness and color of the lights according to the second information data and the third information data.

[0013] Preferably, performing a time-domain to frequency-domain conversion on the output signals according to the fast Fourier transform algorithm to obtain first information data includes:

[0014] Analyze the sound spectrum based on the output signals to obtain first analysis data; or

[0015] Analyze the music style based on the output signals, calculate the color reduction coefficient, and obtain second analysis data.

[0016] Preferably, performing a time-domain to frequency-domain conversion on the output signals according to the fast Fourier transform algorithm to obtain first information data further includes:

[0017] Analyze the sound spectrum based on the output signals and increase the auditory response curve gain to obtain third analysis data A′n = An*S = {an1·S1, an2·S2,......, an m ·S m}, where An = {an1, an2,......, an m} = FFT(yn) is the frequency-domain analysis data of the sound, where yn is the parameter of the output signal, and S = {S1, S2,......, S m} is the auditory loudness curve gain.

[0018] Preferably, based on the output signal and the first information data, the reduction factors of the color information are analyzed and processed to obtain reduction coefficients, and the reduction coefficients are substituted into a preset lighting color modulation formula for calculation to obtain the third information data, including:

[0019] Based on the output signal and the first information data, and through the sound audio signal, the reduction coefficient of the color information is calculated to obtain the first coefficient, and the first coefficient includes where Rn is the information of red light, Gn is the information of green light, Bn is the information of blue light, M R and M G are respectively the serial numbers of the highest frequency spectrum segments corresponding to red light and green light, where An = {an1, an2,......, an m} = FFT(yn) is the frequency domain analysis data of the sound, where yn is the parameter of the output signal, and S = {S1, S2,......, S m} is the auditory loudness curve gain;

[0020] Based on the output signal and the first information data, and through the music genre melody, the reduction coefficient of the color information is calculated to obtain the second coefficient Cn = {C R n, C G n, C B n} = g(yn);

[0021] Based on the output signal and the first information data, and through the visual curve, the reduction coefficient of the color information is calculated to obtain the third coefficient Vn = {V R n, V G n, V B n};

[0022] Substitute the first coefficient, the second coefficient, and the third coefficient into the formula

[0023]

[0024] for calculation, and summarize to obtain the third information data, where R% is the proportion of red light output, G% is the proportion of green light output, and B% is the proportion of blue light output.

[0025] Preferably, based on the second information data and the third information data, the on / off, brightness, and color of the light are controlled, including:

[0026] Based on the second information data, the light is brightened by the formula , where C B n(t) is the light brightness at the acquisition point n, CB nmax is the maximum light display brightness at the acquisition point n, and ΔT is the time interval for the light to rise to the maximum value; or

[0027] According to the second information data through the formula Perform dimming adjustment on the light, where β ∈ (1, ∞);

[0028] Adjust the light color according to the third information data and control the display refresh frequency and color switching state;

[0029] Adjust the on / off, brightness, and color of the light and perform light display in a dot-like, linear, or planar manner.

[0030] A system for controlling light changes by sound, comprising:

[0031] Sound acquisition module: used to acquire sound signals, perform operational amplification and volume control processing on the sound signals to obtain output signals;

[0032] Audio decoding module: used to perform time-domain to frequency-domain conversion on the output signals according to the fast Fourier transform algorithm to obtain first information data;

[0033] Rhythm calculation module: used to calculate the output signals and the first information data by adopting information processing methods in the time domain and / or frequency domain to obtain second information data;

[0034] Color calculation module: used to analyze and process the reduction factors of color information according to the output signals and the first information data to obtain reduction coefficients, and substitute the reduction coefficients into the preset light color modulation formula for calculation to obtain third information data, and the reduction factors include sound audio signals, music styles, and visual curves;

[0035] Light display module: used to control the on / off, brightness, and color of the light according to the second information data and the third information data.

[0036] Preferably, the audio decoding module includes:

[0037] Audio first processing module: used to analyze the sound spectrum according to the output signals to obtain first analysis data; or

[0038] Audio second processing module: used to analyze the music style according to the output signals, calculate the color reduction coefficients, and obtain second analysis data.

[0039] Preferably, the audio decoding module further includes:

[0040] Audio third processing module: used to analyze the sound spectrum according to the output signal and increase the gain of the auditory response curve to obtain the third analysis data A′n = An * S = {an1·S1, an2·S2,......, an m ·S m}, where An = {an1, an2,......, an m} = FFT(yn) is the frequency-domain analysis data of the sound, where yn is the parameter of the output signal, and S = {S1, S2,......, S m} is the auditory loudness curve gain.

[0041] Preferably, the color calculation module includes:

[0042] Sound audio reduction coefficient calculation module: used to calculate the reduction coefficient of color information according to the output signal and the first information data through the sound audio signal to obtain the first coefficient, and the first coefficient includes where Rn is the information of red light, Gn is the information of green light, Bn is the information of blue light, M R and M G are respectively the sequence numbers of the highest frequency spectrum segments corresponding to red light and green light, where An = {an1, an2,......, an m} = FFT(yn) is the frequency-domain analysis data of the sound, where yn is the parameter of the output signal, and S = {S1, S2,......, S m} is the auditory loudness curve gain;

[0043] Music genre melody reduction coefficient calculation module: used to calculate the reduction coefficient of color information according to the output signal and the first information data through the music genre melody to obtain the second coefficient Cn = {C R n,C G n,C B n} = g(yn);

[0044] Visual curve reduction coefficient calculation module: used to calculate the reduction coefficient of color information according to the output signal and the first information data through the visual curve to obtain the third coefficient Vn = {V R n,V G n,V B n};

[0045] Trichromatic light flux calculation module: used to substitute the first coefficient, the second coefficient and the third coefficient into the formula Perform calculations in it to summarize and obtain the third information data, where R% is the proportion of red light output, G% is the proportion of green light output, and B% is the proportion of blue light output.

[0046] Preferably, the light display module includes:

[0047] The light brightening adjustment module: used to perform light brightening adjustment according to the second information data through the formula where C B n(t) is the light brightness of acquisition point n, C B n max is the maximum light display brightness of acquisition point n, and ΔT is the time interval for the light to rise to the maximum value; or

[0048] The light dimming adjustment module: used to perform light dimming adjustment according to the second information data through the formula where β ∈ (1, ∞);

[0049] The light color adjustment module: used to adjust the light color according to the third information data and control the display refresh frequency and color switching state;

[0050] The light processing and display module: used to adjust the lighting on and off, brightness, and color of the light and perform light display in a dot-like, linear, or planar manner.

[0051] The present invention has the following beneficial effects:

[0052] This solution is based on the certain correspondence between the emotional expression transmitted by the audio recognized by the human ear in existing research and the visible red, green, and blue colors. It directly establishes the connection between sound and color change and is supplemented by rhythm calculation, enabling the sound to directly control the corresponding color change as a variable without the need for control by an intermediate module, increasing the reaction speed, avoiding latency, making the change of the light more accurate, and with the addition of color calculation, making the change of the light color more natural and saturated;

[0053] It can adaptively perform real-time and accurate rhythm capture and response to sounds of different volumes; it can adaptively assign light colors that match the music style and audio; by providing a suitable light display control strategy based on the characteristics of the human eye, it provides a better experience for users. BRIEF DESCRIPTION OF THE DRAWINGS

[0054] Figure 1 It is a flowchart of a method for controlling light change by sound in the present invention

[0055] Figure 2 It is a schematic diagram of the implementation process of the solution in the present invention

[0056] Figure 3 The auditory loudness curve in the present invention

[0057] Figure 4 The visual loudness curve in the present invention

[0058] Figure 5 The structural schematic diagram of a system for controlling the change of light by sound in the present invention

[0059] Figure 6 The structural schematic diagram of the audio decoding module 20 in the present invention

[0060] Figure 7 The structural schematic diagram of the color calculation module 40 in the present invention

[0061] Figure 8 The structural schematic diagram of the light display module 50 in the present invention Detailed implementation manners

[0062] Embodiment 1

[0063] As Figure 1 shown, a method for controlling the change of light by sound includes the following steps:

[0064] S11. Collect a sound signal, perform operational amplification and volume control processing on the sound signal to obtain an output signal;

[0065] S12. Perform a time-domain to frequency-domain conversion on the output signal according to the fast Fourier transform algorithm to obtain first information data;

[0066] S13. Calculate the output signal and the first information data by using an information processing method in the time domain and / or frequency domain to obtain second information data;

[0067] S14. Analyze and process the reduction factors of the color information according to the output signal and the first information data to obtain a reduction coefficient, and substitute the reduction coefficient into a preset light color modulation formula for calculation to obtain third information data. The reduction factors include sound audio signals, music styles and visual curves;

[0068] S15. Control the turning on and off, brightness and color of the light according to the second information data and the third information data.

[0069] In this embodiment, the overall process of the scheme implementation is as Figure 2As shown in the figure, first, the sound vibration signal is converted into a voltage signal through the sound pickup and operational amplifier module, and the voltage signal is filtered and amplified through operation; the data conversion module processes and transforms the output signal of the operational amplifier to provide appropriate and quickly processable data and data formats for the backend; the volume control module judges the output data of the operational amplifier in real time, and adjusts the gain of the sound pickup module or the operational amplifier to adjust the output data of the operational amplifier, so that it operates within a suitable working area range where the rhythm information can be effectively identified;

[0070] Among them, the sound pickup part is usually sound collection devices and components such as a microphone, a silicon microphone, or a microphone; the operational amplifier part is usually devices and components with signal amplification functions such as an operational amplifier and a triode; the data conversion module mainly performs data ADC acquisition, primary operation of the acquired data, and reasonable data format transformation, such as polarity conversion, non-linear processing, data lossless / low-loss compression, and noise reduction processing, etc.; according to research, the resolution of the human ear's identification of sound pressure is non-linear under different volume levels. To reduce the data storage amount, speed up the operation, and reduce power consumption, the audio data can be transformed. Preferably, logarithmic form can be used for data non-linear processing; when the system resources are sufficient or it is allowed to moderately lose some information and reduce some performance, this type of data conversion can also be not performed and directly transferred to the backend for use, that is, without conversion processing through the data conversion module;

[0071] The volume control module mainly realizes the adaptability to the volume size by monitoring the output data of the operational amplifier in real time, judging the signal, and timely adjusting the gain of the sound pickup or operational amplifier module;

[0072] After the processing of the above solution, data that can restore the sound source and meet the needs of the backend operation is output, and this data is the output signal.

[0073] After the above processing of the collected sound signal, regardless of the external sound source category collected by the sound pickup, the volume size, the soothing or rapid sound effect, or various sound effect environments such as the fast or slow rhythm change, data information that meets the backend rhythm calculation and color calculation can be output, improving the effectiveness of color control display.

[0074] Then, by using methods such as DFT and FFT (for simplicity of explanation, the time-frequency domain conversion is uniformly represented by FFT), the output signal of the sound collection module is converted from the time domain to the frequency domain, and audio information is output:

[0075] Through the spectral analysis of the sound, frequency domain analysis data can be obtained, and this data is the first analysis data:

[0076] Among them, An = {an1, an2,......, an m} = FFT(yn) is the frequency domain analysis data of the sound, where yn is the parameter of the output signal;

[0077] To more realistically restore human hearing, the frequency spectrum can be cut and analyzed by using methods such as similar Mel triangular sampling;

[0078] To more intuitively express the normalized loudness of each frequency spectrum on human ear hearing, the gain of the auditory response curve can be increased:

[0079] A′n = An * S = {an1·S1, an2·S2,......, an m ·S m},

[0080] where S = {S1, S2,......, S m} is the gain of the auditory loudness curve, which can be specifically obtained by analysis from Figure 3 ; The above analysis data after increasing the gain of the auditory response curve is the third analysis data; When not increasing the gain of the auditory loudness curve, this solution can also be implemented, and after increasing it, the effect of this solution can be made better.

[0081] It is also possible to process the time-domain and frequency-spectrum analysis data to obtain information such as the timbre, melody, and music genre of the sound, for restoring the color of the emotion expressed by the sound; The data obtained by this method is the second analysis data. Summing up the above-obtained first analysis data, second analysis data, and third analysis data, the first information data processed by the audio analysis module is obtained;

[0082] Among them, to ensure the effectiveness of data output, reduce data storage volume, and improve calculation efficiency, the data can also be transformed to optimize the system efficiency.

[0083] Through spectrum analysis, signal processing in the time-frequency domain, and analysis of information such as music genre and melody, the sound feature information such as music rhythm and melody is restored, and the environmental atmosphere suitable for the emotion expressed by the music is reproduced in the form of light, creating a high-quality light atmosphere.

[0084] After obtaining the first information data processed by the audio analysis module, the calculation of the sound rhythm is performed. The capture of the music rhythm can be obtained through certain operations on the sound collection and processed signals (that is, the output signal directly output by the sound collection module and the first information data processed by the audio analysis module), and can be implemented by using information processing methods of time domain, frequency domain, and time-frequency domain fusion, as follows:

[0085] The method for capturing the sound rhythm in the time domain is:

[0086] The change in the sound acquisition signal yn exceeds the determination threshold; preferably, for different characteristic sound signals, such as continuously stable fluctuating sound signals, continuously stable rising fluctuating sound signals, and continuously stable falling fluctuating sound signals, etc., the accuracy of rhythm acquisition can be improved by dynamically adjusting the determination threshold; more preferably, the background noise of the system can be determined to reduce the influence of background noise on the rhythm; in this way, the first rhythm data is obtained;

[0087] The sampling rhythm is captured by the frequency domain method, such as:

[0088] After weighted averaging the decomposed frequency domain signals in the first information data, it can be restored to the time domain signal for rhythm information acquisition; preferably, loudness curve gain compensation can be added to each decomposed frequency domain information; preferably, the sound spectrum information can also be integrated into n frequency domain information points for rhythm acquisition by combining spectrum decomposition and increasing the sound loudness curve coefficient, etc.; in this way, the second rhythm data is obtained;

[0089] Preferably, the rhythm can also be captured by a method that combines the time domain and the frequency domain.

[0090] In summary, the rhythm data obtained by the time domain, the frequency domain, or the method that combines the time domain and the frequency domain is summarized to obtain the second information data.

[0091] Color calculation module: Through the time domain and frequency domain information of sound acquisition and processing (i.e., the output signal of the sound acquisition module and the first information data processed by the audio analysis module), analyze, process, and perform color mapping on the atmosphere environment created by sound information such as timbre, music genre, melody, etc., and provide a display control signal that can achieve bright and saturated light colors.

[0092] According to the existing research information: There is a certain corresponding relationship between the emotional expression conveyed by the audible sound audio signal of the human ear and the visible red, green, and blue colors; the melody and music genre of music can usually also convey emotional information such as joy, happiness, or sadness more vividly; that is, there is a corresponding connection between the emotional expression conveyed by sound and the three primary colors that are visible, and the emotional expression conveyed by the sound information can be restored through the corresponding three primary colors by analyzing the sound information.

[0093] Therefore, in specific implementation, the emotional information conveyed by the sound can be realized through the following data processing, which is convenient for the restoration of the light rhythm and color to bring a better experience to the user. The specific implementation is as follows:

[0094] Restoration of color information through the sound audio signal:

[0095] Where Rn is the information of red light, Gn is the information of green light, Bn is the information of blue light, MR and M G are respectively the serial numbers of the highest frequency spectrum bands corresponding to red light and green light;

[0096] The above reduction coefficient is the first coefficient;

[0097] Through the analysis of information such as music style and melody, the color information is restored, and the reduction coefficients are as follows:

[0098] Cn = {C R n, C G n, C B n} = g(yn), and this coefficient is the second coefficient;

[0099] Considering the visual curve as Figure 4 shown, the visual response is normalized, and the reduction coefficients are as follows:

[0100] Vn = {V R n, V G n, V B n}, and this coefficient is the third coefficient;

[0101] After considering the reduction factors such as sound audio signals, music styles and melodies, and visual curves, the data ratio of the normalized R / G / B light output luminous flux is as follows:

[0102]

[0103]

[0104]

[0105] Among them, R% is the proportion of red light output, G% is the proportion of green light output, and B% is the proportion of blue light output;

[0106] Substitute the first coefficient, the second coefficient, and the third coefficient into the above formula for calculation respectively, and the proportion of the light output of the corresponding three primary colors (red, green, blue) can be obtained. Summarize the calculation results to obtain the color data corresponding to the sound. This data is the third information data. The above three formulas are collectively called the light color modulation formulas.

[0107] In practical applications, for the convenience of calculation, the above information can be simplified, such as:

[0108] Ignore the influence of the visual curve;

[0109] Partial non-linear processing can be performed on the above R%, G%, and B% data. Artificially increase the main color parameters or two of the larger proportion parameters, and decrease the parameters of other colors to improve the color saturation; or preferably simplify it to a few colors with higher saturation and adapt according to the parameters.

[0110] In addition, in the case of special sound sources, only one or a few light display colors can be continuously presented in the above manner. The richness of the audio display information can be improved by means of scaling the frequency domain window, shifting the frequency domain analysis range, etc., to ensure the vividness and richness of the light colors.

[0111] In a more convenient case, the above calculated and analyzed colors can also be replaced by the colors built into the system, and good visual display effects can also be obtained.

[0112] After a series of calculation and processing based on the collected sound signals, a second information data containing rhythm information and a third information data containing color information are obtained. Based on these two data, the lighting can be controlled for on-off, brightness, and color display.

[0113] This solution directly establishes the connection between sound and color changes according to the corresponding relationship between the emotional expression of auditory recognition and the visible red, green, and blue colors in existing research, and supplements it with rhythm calculation, so that the sound can directly control the lighting for rhythmic on-off, brightness, and color changes without the control of an intermediate module, reducing the delay, making the lighting changes more accurate, and the color changes of the lighting more natural and saturated, bringing a better user experience.

[0114] Embodiment 2

[0115] The specific solution for lighting control based on the calculated rhythm data and color data is as follows:

[0116] The lighting display module controls the lighting display drive according to the signals provided by the rhythm calculation module and the color calculation module, mainly manifested as the display unit providing drive control signals for rhythmic lighting on-off, brightness, and color display; the specific implementation form is as follows:

[0117] Display of a single light source: The lighting on-off, brightness, and color can be controlled;

[0118] Display of a linear multi-controlled light source: Not only can the lighting on-off, brightness, and color be controlled, but also the movement of the light on the line can be controlled;

[0119] Display of a planar multi-controlled light source: Not only can the lighting on-off, brightness, and color be controlled, and the movement of the light on the line be controlled; but also the pattern and angle of the light can be displayed.

[0120] Due to the automatic light adjustment ability of the human eye, it can adapt to a wide range of living environments. Specifically, such as the adaptive adjustment of light brightness, the response to different spectral frequencies (colors), and the visual persistence of quantization signal acquisition. When actually controlling the display of lights, it is necessary to comprehensively consider the impact of these factors on vision and provide a higher-quality visual effect of lights. Essentially, by adjusting:

[0121] a. Light brightness adjustment: Preferably, the light is gradually brightened and gradually dimmed;

[0122] When the light brightens, refer to the following relationship:

[0123] where C B n(t) is the light brightness at acquisition point n, C B n max is the maximum light display brightness at acquisition point n, and ΔT is the time interval for the light to rise to the maximum value; when the light fades, refer to the following relationship:

[0124] where β ∈ (1, ∞);

[0125] where Imax is the maximum light brightness, y peak is the maximum value that can be output by sound acquisition, and a ∈ (0, 1);

[0126] b. Light color display: After the signal output by the color calculation module is processed by the light display unit, it is presented on the display unit; to avoid visual superposition and distortion caused by rapid color switching, it is necessary to control the refresh frequency and color switching state of the color display, etc. The color switching method:

[0127] According to scientific research, the human eye can approximately retain visual persistence for about 0.1 - 0.4 s after the image disappears. Therefore, a data refresh interval of dozens to hundreds of milliseconds is selected.

[0128] Generally, the light switches colors according to the newly acquired second data information (rhythm points); when the rhythm is acquired quickly, the light may still be in a relatively high brightness state when the next rhythm is acquired. Preferably, the current display color is maintained within a short period; however, if it continues to output at a relatively high brightness for a long time period, the light color is forced to switch. That is, the condition for light color switching is Rn = 1, and C D(n-1) (t0 + Δt) < C D_limitL ; or Rn = 1 and the color display has been maintained for more than N refresh cycles. At this time, the refreshed color is the color acquired from the latest rhythm or the processed value of the colors in the previous m unrefreshed cycles; otherwise, the color remains unchanged.

[0129] c. Display mode:

[0130] Color display of a single light source, characterized in that there are 1 to N light source points, but as long as the brightness or color of one of the light source points changes, all other light source points will make corresponding changes in brightness or color. Specifically, it is achieved by changing the brightness or color of the light source, and the display mode refers to the descriptions of a) light brightness adjustment and b) light color display above;

[0131] Display of a linear multi-controlled light source, characterized in that it is composed of 1 to MxN light source points, where M is the number of rows and N is the number of columns; as long as the brightness and color of one light source point in a certain row change, the other M-1 rows of light beads at the corresponding positions will make corresponding changes in brightness or color; but each light source in the N columns can be controlled separately in terms of brightness and / or color. The display of this type of linear multi-controlled light source is achieved through the following methods:

[0132] Specifically, the length change display can be divided into two states: length expansion and contraction, which can be realized by formulas respectively. For light length expansion Preferably, the first linear expansion method described above is adopted; for light length contraction where β ∈ (1, ∞), preferably, the first linear contraction method described above is adopted. Lmax is the maximum length that the light can display, and y peak is the maximum value that the sound collection can output, and a ∈ (0, 1).

[0133] Specifically, in terms of light brightness display, optimally, a brightness display method of maximum brightness at the beginning + maximum brightness in the middle + gradual extinction of the light brightness at the end can be adopted. The gradual extinction of the end brightness can refer to the calculation formula of light fading.

[0134] Specifically, in terms of light color display, optimally, it can be realized by adopting a unified color, color segmentation, or color segmentation and gradual change method.

[0135] Through the above methods, it is possible to see both the rapid changes that vary instantaneously with the volume and the length displayed under the overall volume condition, enhancing the overall presentation effect of the light. In addition, multi-segment same-direction, reverse-direction, or back-to-back combined displays can be made linearly for this type of display.

[0136] Display of a planar multi-controlled light source: It can be achieved either through brightness and bright color changes or by adopting horizontal / vertical direction changes; on the basis of the above linear display, effects such as planar direction rotation, display spot size, color transition, and light guiding at different angles can be added, which will not be elaborated here.

[0137] In summary, for a digital system, analog-to-digital conversion is required. This implementation belongs to common technology and will not be elaborated here.

[0138] Embodiment 3

[0139] As Figure 5 shown, a system for controlling the change of light by sound includes:

[0140] A sound collection module 10: used to collect sound signals, perform operational amplifier and volume control processing on the sound signals, and obtain an output signal;

[0141] An audio decoding module 20: used to perform a time-domain to frequency-domain conversion on the output signal according to the fast Fourier transform algorithm to obtain first information data;

[0142] A rhythm calculation module 30: used to calculate the output signal and the first information data by adopting an information processing method in the time domain and / or frequency domain to obtain second information data;

[0143] A color calculation module 40: used to analyze and process the reduction factors of color information according to the output signal and the first information data to obtain a reduction coefficient, substitute the reduction coefficient into a preset light color modulation formula for calculation to obtain third information data, and the reduction factors include sound audio signals, music styles, and visual curves;

[0144] A light display module 50: used to control the on / off, brightness, and color of the light according to the second information data and the third information data.

[0145] An implementation manner of the above system is that in the sound collection module 10, a sound signal is collected, the sound signal is subjected to operational amplifier and volume control processing to obtain an output signal, in the audio decoding module 20, a time-domain to frequency-domain conversion is performed on the output signal according to the fast Fourier transform algorithm to obtain first information data, in the rhythm calculation module 30, the output signal and the first information data are calculated by adopting an information processing method in the time domain and / or frequency domain to obtain second information data, in the color calculation module 40, the reduction factors of color information are analyzed and processed according to the output signal and the first information data to obtain a reduction coefficient, the reduction coefficient is substituted into a preset light color modulation formula for calculation to obtain third information data, the reduction factors include sound audio signals, music styles, and visual curves, and in the light display module 50, the on / off, brightness, and color of the light are controlled according to the second information data and the third information data.

[0146] Embodiment 4

[0147] As Figure 6 shown, the audio decoding module 20 includes:

[0148] Audio first processing module 21: used to analyze the sound spectrum based on the output signal to obtain first analysis data; or

[0149] Audio second processing module 22: used to analyze the music style melody based on the output signal, calculate the color restoration coefficient, and obtain second analysis data;

[0150] Audio third processing module 23: used to analyze the sound spectrum based on the output signal and increase the gain of the auditory response curve to obtain third analysis data A′n = An*S = {an1·S1, an2·S2,......, an m ·S m}, where An = {an1, an2,......, an m} = FFT(yn) is the frequency domain analysis data of the sound, where yn is a parameter of the output signal, and S = {S1, S2,......, S m} is the auditory loudness curve gain.

[0151] One implementation of the above modules is that in the audio first processing module 21, the sound spectrum is analyzed based on the output signal to obtain first analysis data; or in the audio second processing module 22, the music style melody is analyzed based on the output signal, the color restoration coefficient is calculated, and second analysis data is obtained. In the audio third processing module 23, the sound spectrum is analyzed based on the output signal and the gain of the auditory response curve is increased to obtain third analysis data A′n = An*S = {an1·S1, an2·S2,......, an m ·S m}, where An = {an1, an2,......, an m} = FFT(yn) is the frequency domain analysis data of the sound, where yn is a parameter of the output signal, and S = {S1, S2,......, S m} is the auditory loudness curve gain.

[0152] Example 5

[0153] As Figure 7 shown, the color calculation module 40 includes:

[0154] Sound audio restoration coefficient calculation module 41: used to calculate the restoration coefficient of the color information through the sound audio signal based on the output signal and the first information data to obtain the first coefficient, and the first coefficient includes where Rn is the information of red light, Gn is the information of green light, Bn is the information of blue light, M R and M GThey are the serial numbers corresponding to the highest frequency spectrum segments of red light and green light respectively, where An = {an1, an2,..., an m} = FFT(yn) is the frequency domain analysis data of the sound, where yn is the parameter of the output signal, and S = {S1, S2,..., S m} is the auditory loudness curve gain;

[0155] Music genre melody reduction coefficient calculation module 42: It is used to calculate the reduction coefficient of color information according to the output signal and the first information data through the music genre melody, and obtain the second coefficient Cn = {C R n, C G n, C B n} = g(yn);

[0156] Visual curve reduction coefficient calculation module 43: It is used to calculate the reduction coefficient of color information according to the output signal and the first information data through the visual curve, and obtain the third coefficient Vn = {V R n, V G n, V B n};

[0157] Trichromatic light flux calculation module 44: It is used to substitute the first coefficient, the second coefficient and the third coefficient into the formula for calculation, and summarize to obtain the third information data, where R% is the proportion of red light output, G% is the proportion of green light output, and B% is the proportion of blue light output.

[0158] An implementation manner of the above module is that in the sound audio reduction coefficient calculation module 41, according to the output signal and the first information data, the reduction coefficient of color information is calculated through the sound audio signal to obtain the first coefficient, and the first coefficient includes where Rn is the information of red light, Gn is the information of green light, Bn is the information of blue light, M R and M G They are the serial numbers corresponding to the highest frequency spectrum segments of red light and green light respectively, where An = {an1, an2,..., an m} = FFT(yn) is the frequency domain analysis data of the sound, where yn is the parameter of the output signal, and S = {S1, S2,..., S m} is the auditory loudness curve gain. In the music genre melody reduction coefficient calculation module 42, according to the output signal and the first information data, the reduction coefficient of color information is calculated through the music genre melody to obtain the second coefficient Cn = {CR n, C G n, C B n} = g(yn). In the visual curve reduction coefficient calculation module 43, according to the output signal and the first information data, the reduction coefficient of the color information is calculated through the visual curve, and the third coefficient Vn = {V R n, V G n, V B n} is obtained. In the three-primary color light flux calculation module 44, the first coefficient, the second coefficient, and the third coefficient are respectively substituted into the formula for calculation, and the third information data is summarized, where R% is the proportion of the red light output, G% is the proportion of the green light output, and B% is the proportion of the blue light output.

[0159] Example 6

[0160] As Figure 8 shown, the light display module 50 includes:

[0161] The light brightening adjustment module 51: used to adjust the light brightening according to the second information data through the formula , where C B n(t) is the light brightness at the acquisition point n, C B n max is the maximum light display brightness at the acquisition point n, and ΔT is the time interval for the light to rise to the maximum value; or

[0162] The light dimming adjustment module 52: used to adjust the light dimming according to the second information data through the formula , where β ∈ (1, ∞);

[0163] The light color adjustment module 53: used to adjust the light color according to the third information data and control the display refresh frequency and color switching state;

[0164] The light processing and display module 54: used to adjust the on / off, brightness, and color of the light and display the light in a dot-like, linear, or planar manner.

[0165] One implementation of the above module is that in the light brightening adjustment module 51, the light brightening is adjusted according to the second information data through the formula , where C B n(t) is the light brightness at the acquisition point n, C B n max is the maximum light display brightness at the acquisition point n, and ΔT is the time interval for the light to rise to the maximum value; or in the light dimming adjustment module 52, the light dimming is adjusted according to the second information data through the formula Perform dimming adjustment of the light, where β ∈ (1, ∞). In the light color adjustment module 53, the light color is adjusted according to the third information data and by controlling the display refresh frequency and color switching state. In the light processing and display module 54, the turning on and off, brightness, and color of the light are adjusted and the light is displayed in a dot-like, linear, or planar manner.

[0166] The above are only specific embodiments of the present invention, but the technical features of the present invention are not limited thereto. Any changes or modifications made by those skilled in the art within the scope of the present invention are covered by the patent scope of the present invention.

Claims

1. A method for controlling the change of a light by sound, characterized in that, Including: Collecting a sound signal, performing operational amplification and volume control processing on the sound signal to obtain an output signal; Converting the output signal from the time domain to the frequency domain according to the fast Fourier transform algorithm to obtain first information data; Calculating the output signal and the first information data using an information processing method in the time domain and / or frequency domain to obtain second information data; Analyzing and processing the color information reduction factors based on the output signal and the first information data to obtain a reduction coefficient, substituting the reduction coefficient into a preset lighting color modulation formula for calculation to obtain third information data, and the reduction factors include sound audio signals, music styles, and visual curves; Controlling the lighting on / off, brightness, and color according to the second information data and the third information data; Analyzing and processing the color information reduction factors based on the output signal and the first information data to obtain a reduction coefficient, substituting the reduction coefficient into a preset lighting color modulation formula for calculation to obtain third information data, including: Calculating the reduction coefficient of color information based on the output signal and the first information data and through the sound audio signal to obtain a first coefficient, the first coefficient includes where Rn is the information of red light, Gn is the information of green light, Bn is the information of blue light, M R and M G are the serial numbers of the highest frequency spectrum segments corresponding to red light and green light respectively, where An = {an1, an2,..., an m} = FFT(yn) is the frequency domain analysis data of the sound, where yn is the parameter of the output signal, and S = {S1, S2,..., S m} is the auditory loudness curve gain; Based on the output signal and the first information data, and through the music genre melody, calculate the reduction coefficient of the color information to obtain the second coefficient Cn = {C R n, C G n, C B n} = g(yn); Calculate the reduction coefficient of color information based on the output signal and the first information data and through the visual curve, and obtain the third coefficient Vn = {V R n, V G n, V B n}; Respectively substituting the first coefficient, the second coefficient, and the third coefficient into the formula Calculate in it and summarize to obtain the third information data, where R% is the proportion of red light output, G% is the proportion of green light output, and B% is the proportion of blue light output.

2. A method for controlling the change of a light by sound according to claim 1, characterized in that Converting the output signal from the time domain to the frequency domain according to the fast Fourier transform algorithm to obtain first information data, including: Analyzing the sound spectrum based on the output signal to obtain first analysis data; or Analyzing the music style based on the output signal, calculating the color reduction coefficient, and obtaining second analysis data.

3. A method for controlling the change of light by sound according to claim 2, characterized in that, Converting the output signal from the time domain to the frequency domain according to the fast Fourier transform algorithm to obtain first information data, further including: Analyze the sound spectrum based on the output signal and increase the gain of the auditory response curve to obtain the third analysis data A′n = An * S = {an1·S1, an2·S2,......, an m ·S m}, where An = {an1, an2,......, an m} = FFT(yn) is the frequency-domain analysis data of the sound, where yn is the parameter of the output signal, and S = {S1, S2,......, S m} is the auditory loudness curve gain.

4. A method for controlling the change of a light according to sound as claimed in claim 1, characterized in that, Controlling the lighting on / off, brightness, and color according to the second information data and the third information data, including: According to the second information data, through the formula perform the light brightening adjustment, where C B n(t) is the light brightness of acquisition point n, C Bnmax is the maximum light display brightness of acquisition point n, and ΔT is the time interval for the light to rise to the maximum value; or Dim the light according to the second information data through the formula where β ∈ (1, ∞); Adjusting the lighting color according to the third information data and controlling the display refresh frequency and color switching state; Adjusting the lighting on / off, brightness, and color and performing lighting display in a dot-like, linear, or planar manner.

5. A system for controlling the change of a light by sound, which is used to implement a method for controlling the change of a light by sound as described in claim 1, characterized in that, Including: Sound acquisition module: Used to collect a sound signal, perform operational amplification and volume control processing on the sound signal to obtain an output signal; Audio decoding module: Used to convert the output signal from the time domain to the frequency domain according to the fast Fourier transform algorithm to obtain first information data; Rhythm calculation module: Used to calculate the output signal and the first information data using an information processing method in the time domain and / or frequency domain to obtain second information data; Color calculation module: Used to analyze and process the color information reduction factors based on the output signal and the first information data to obtain a reduction coefficient, substitute the reduction coefficient into a preset lighting color modulation formula for calculation to obtain third information data, and the reduction factors include sound audio signals, music styles, and visual curves; Lighting display module: Used to control the lighting on / off, brightness, and color according to the second information data and the third information data; analyzing and processing the color information reduction factors based on the output signal and the first information data to obtain a reduction coefficient, substituting the reduction coefficient into a preset lighting color modulation formula for calculation to obtain third information data, including: Calculating the reduction coefficient of color information based on the output signal and the first information data and through the sound audio signal to obtain a first coefficient, the first coefficient includes where Rn is the information of red light, Gn is the information of green light, Bn is the information of blue light, M R and M G are the sequence numbers of the highest frequency spectrum segments corresponding to red light and green light respectively, where An = {an1, an2,..., an m} = FFT(yn) is the frequency domain analysis data of the sound, where yn is the parameter of the output signal, and S = {S1, S2,..., S m} is the auditory loudness curve gain; According to the output signal and the first information data, and through the music genre melody, the reduction coefficient of the color information is calculated to obtain the second coefficient Cn = {C R n, C G n, C B n} = g(yn); Calculate the reduction coefficient of color information based on the output signal and the first information data and through the visual curve, and obtain the third coefficient Vn = {V R n, V G n, V B n}; Respectively substituting the first coefficient, the second coefficient, and the third coefficient into the formula Calculate in it, and summarize to obtain the third information data, where R% is the proportion of red light output, G% is the proportion of green light output, and B% is the proportion of blue light output.

6. The system for controlling the change of a light by sound according to claim 5, characterized in that, Audio decoding module, including: Audio first processing module: Used to analyze the sound spectrum based on the output signal to obtain first analysis data; or Audio second processing module: used to analyze the music style melody according to the output signal, calculate the color restoration coefficient, and obtain the second analysis data.

7. The system for controlling the change of the light by sound according to claim 5, characterized in that, The audio decoding module further includes: Audio third processing module: used to analyze the spectrum of sound according to the output signal and increase the gain of the auditory response curve to obtain the third analysis data A′n = An * S = {an1·S1, an2·S2,......, an m ·S m}, where An = {an1, an2,......, an m} = FFT(yn) is the frequency-domain analysis data of the sound, where yn is the parameter of the output signal, and S = {S1, S2,......, S m} is the auditory loudness curve gain.

8. A system for controlling the change of lighting by sound according to claim 5, characterized in that, The lighting display module includes: Light brightening adjustment module: used to perform light brightening adjustment according to the second information data through the formula where C B n(t) is the light brightness at the acquisition point n, C B n max is the maximum light display brightness at the acquisition point n, and ΔT is the time interval for the light to rise to the maximum value; or Light dimming adjustment module: used to perform light dimming adjustment according to the second information data through the formula where β ∈ (1, ∞); Light color adjustment module: used to adjust the light color according to the third information data and control the display refresh frequency and color switching state; Light processing and display module: used to adjust the lighting, brightness, and color of the light and display the light in a dot-like, linear, or planar manner.

Images