Sound and light synchronous linkage method and sound and light synchronous linkage system

Abstract

The present disclosure discloses a method for synchronously linking sound and light, which includes: receiving a user-selected working mode; receiving a sound signal from a media source; converting the sound signal into a light signal, wherein the light signal is at least related to the frequency information in the sound signal; converting the sound signal into an audio signal; and executing the selected working mode using the light signal and the audio signal. The disclosed method for synchronously linking sound and light can combine the music playing status with the ambient light in the car, realize real-time integrated sound and light output, make full use of the atmosphere created by the ambient light and sound effects, and thus greatly improve the use effect of the ambient light in the car.

Description

Technical Field

[0001] The present disclosure relates to automobile technology, and more particularly to a sound-light synchronous linkage method and a sound-light synchronous linkage system. Background Art

[0002] With the continuous development of the automobile industry, consumers have higher and higher requirements for automobile configuration and pursuit of quality. In order to create an atmosphere inside the car, ambient lights have gradually appeared in the configuration of vehicles of various levels. Ambient lights are a vital part of creating the visual atmosphere inside the car.

[0003] In the prior art, most of the atmosphere lights need to be equipped with a separate music rhythm controller. The multimedia processor needs to send the audio data to the music rhythm controller. The music rhythm controller needs to analyze the audio and get the corresponding control instructions to send to the atmosphere light, so as to achieve the rhythm control of the atmosphere light following the music. However, in actual applications, the audio data is transmitted to the music rhythm controller for analysis, which easily leads to the rhythm delay of the atmosphere light and even causes signal loss, which eventually causes the atmosphere light to fail to follow the music rhythm. Summary of the invention

[0004] The object of the present invention is to solve at least one of the above-mentioned problems and defects in the prior art.

[0005] In view of the above problems, the first aspect of the present disclosure proposes an acoustic-optical synchronous linkage method, which includes:

[0006] Receive the working mode selected by the user;

[0007] receiving a sound signal from a media source;

[0008] Converting the sound signal into a light signal, wherein the light signal is at least related to frequency information in the sound signal;

[0009] converting the sound signal into an audio signal; and

[0010] The selected working mode is executed using the light signal and the audio signal.

[0011] According to an exemplary embodiment of the present invention, converting the sound signal into a light signal further comprises:

[0012] extracting the frequency information from the sound signal;

[0013] Using a color mixing algorithm, the frequency information is converted into ratio information of the three primary colors RGB;

[0014] The light signal is generated by using the ratio information of the RGB three primary colors and the brightness function of the light signal.

[0015] According to an exemplary embodiment of the present invention, extracting the frequency information in the sound signal further comprises:

[0016] The frequency information is extracted according to an extraction period, wherein the extraction period is an integer multiple of a sampling period of the sound signal.

[0017] According to an exemplary embodiment of the present invention, converting the frequency information into ratio information of RGB three primary colors by using a color mixing algorithm further includes:

[0018] The frequency information in the extraction period is processed by using the color mixing algorithm, and the ratio information of the three primary colors RGB in the extraction period is obtained according to the following formula:

[0019] g(R)=ΔF1 / F*a1+F1 / F*b1;

[0020] Wherein, g(R) represents the proportion of red light in the extraction period T, F represents the total energy density corresponding to the frequency information in the extraction period T, F1 is the energy density in the first frequency band in the frequency information, ΔF1 represents the change of energy density in the first frequency band in the extraction period T, and a1 and b1 are weighting coefficients respectively;

[0021] g(G)=ΔF2 / f*a2+F2 / F*b2;

[0022] Wherein, g(G) represents the proportion of green light in the extraction period T, F2 is the energy density in the second frequency band in the frequency information, ΔF2 represents the change of energy density in the second frequency band in the extraction period T, and a2 and b2 are weighting coefficients;

[0023] g(B)=ΔF3 / F*a3+F3 / f*b3;

[0024] Wherein, g(B) represents the proportion of blue light in the extraction period T, F3 is the energy density in the third frequency band in the frequency information, ΔF3 represents the change of energy density in the third frequency band in the extraction period T, and a3 and b3 are weighting coefficients;

[0025] And, g(R)+g(G)+g(B)=1.

[0026] According to an exemplary embodiment of the present invention, generating the light signal using the ratio information of the three primary colors RGB and the brightness function of the light signal further comprises:

[0027] By using the energy density change of the frequency information within the extraction period T, the brightness function L(T) of the light signal is obtained:

[0028] L(T)=k(ΔF1+ΔF2+ΔF3);

[0029] Wherein, L(T) represents the brightness of the light in the extraction period T, and k is a constant coefficient representing the light intensity;

[0030] Using the ratio information of the three primary colors RGB in the extraction period T and the brightness function of the light signal, the color dynamic response algorithm model in the extraction period T is obtained:

[0031] C(T)=g(R)L(T)+g(G)L(T)+g(B)L(T),

[0032] Wherein, C(T) represents the light signal including light color and light brightness within the extraction period T.

[0033] According to an exemplary embodiment of the present invention, the extraction period T is less than 500 ms.

[0034] According to an exemplary embodiment of the present invention, receiving a sound signal from a media source further comprises:

[0035] receiving a sound signal decoded by the media source, wherein the decoded sound signal further includes a tag indicating a music type,

[0036] The ranges of the first frequency band, the second frequency band and the third frequency band are determined according to the music type.

[0037] According to an exemplary embodiment of the present invention, the operating mode of executing the selection using the light signal and the audio signal further comprises:

[0038] In case the first mode is selected, the light signal is sent to all light channels, and the audio signal is sent to all sound channels;

[0039] In case the second mode is selected, the light signal is sent to the selected one or more light channels, and the audio signal is sent to the selected one or more sound channels;

[0040] In case the third mode is selected, the lighting signal is sent to the selected one or more light channels, and the audio signal is sent to all sound channels.

[0041] In view of the above problems, the second aspect of the present disclosure proposes an acoustic-optical synchronous linkage system, which includes:

[0042] A receiving unit, which is used to receive a sound signal from a working mode selected by a user and from a media source;

[0043] A data processing unit for:

[0044] Converting the sound signal into a light signal, wherein the light signal is at least related to frequency information in the sound signal;

[0045] converting the sound signal into an audio signal; and

[0046] The selected working mode is executed using the light signal and the audio signal.

[0047] According to an exemplary embodiment of the present invention, the data processing unit converts the sound signal into a light signal further comprising:

[0048] extracting the frequency information from the sound signal;

[0049] Using a color mixing algorithm, the frequency information is converted into ratio information of the three primary colors RGB;

[0050] The light signal is generated by using the ratio information of the RGB three primary colors and the brightness function of the light signal.

[0051] According to an exemplary embodiment of the present invention, the data processing unit extracting the frequency information from the sound signal further comprises:

[0052] The frequency information is extracted according to an extraction period, wherein the extraction period is an integer multiple of a sampling period of the sound signal.

[0053] According to an exemplary embodiment of the present invention, the data processing unit converts the frequency information into the ratio information of the three primary colors RGB by using the color mixing algorithm further comprising:

[0054] The frequency information in the extraction period is processed by using the color mixing algorithm, and the ratio information of the three primary colors RGB in the extraction period is obtained according to the following formula:

[0055] g(R)=ΔF1 / F*a1+F1 / F*b1;

[0056] Wherein, g(R) represents the proportion of red light in the extraction period T, F represents the total energy density corresponding to the frequency information in the extraction period T, F1 is the energy density in the first frequency band in the frequency information, ΔF1 represents the change of energy density in the first frequency band in the extraction period T, and a1 and b1 are weighting coefficients respectively;

[0057] g(G)=ΔF2 / f*a2+F2 / F*b2;

[0058] Wherein, g(G) represents the proportion of green light in the extraction period T, F2 is the energy density in the second frequency band in the frequency information, ΔF2 represents the change of energy density in the second frequency band in the extraction period T, and a2 and b2 are weighting coefficients;

[0059] g(B)=ΔF3 / F*a3+F3 / F*b3;

[0060] Wherein, g(B) represents the proportion of blue light in the extraction period T, F3 is the energy density in the third frequency band in the frequency information, ΔF3 represents the change of energy density in the third frequency band in the extraction period T, and a3 and b3 are weighting coefficients;

[0061] And, g(R)+g(G)+g(B)=1.

[0062] According to an exemplary embodiment of the present invention, the data processing unit obtains the light signal using the ratio information of the RGB three primary colors and the brightness function of the light signal further comprising:

[0063] By using the energy density change of the frequency information within the extraction period T, the brightness function L(T) of the light signal is obtained:

[0064] L(T)=k(ΔF1+ΔF2+ΔF3);

[0065] Wherein, L(T) represents the brightness of the light in the extraction period T, and k is a constant coefficient representing the light intensity;

[0066] Using the ratio information of the three primary colors RGB in the extraction period T and the brightness function of the light signal, the color dynamic response algorithm model in the extraction period T is obtained:

[0067] C(T)=g(R)L(T)+g(G)L(T)+g(B)L(T),

[0068] Wherein, C(T) represents the light signal including light color and light brightness within the extraction period T.

[0069] According to an exemplary embodiment of the present invention, the system further comprises: a plurality of sound channels and a plurality of light channels, wherein each of the sound channels is used to receive the audio signal and convert it into sound, and each of the light channels is used to receive the light signal and convert it into light;

[0070] When the first mode is selected, all light channels receive the light signal, and all sound channels receive the audio signal;

[0071] In case the second mode is selected, one or more of all the light channels receive the light signal, and one or more of all the sound channels receive the audio signal;

[0072] When the third mode is selected, one or more of all the light channels receive the light signal, and all the sound channels receive the audio signal.

[0073] In the aforementioned exemplary embodiments of the present invention, compared with the existing sound and light linkage technology, the disclosed sound and light synchronous linkage method and device can utilize the frequency information correlation between light signals and sound signals to realize real-time sound and light integrated output, realize sound and light synchronous linkage in the geometric space inside the car, and improve user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0074] The features, advantages and other aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings, in which several embodiments of the present disclosure are shown in an exemplary and non-limiting manner. In the accompanying drawings:

[0075] Figure 1 A schematic flow chart of the sound-light synchronous linkage method disclosed in the present invention;

[0076] Figure 2 Based on Figure 1 A schematic flow chart of specific steps of the disclosed method for synchronous acousto-optic linkage; and

[0077] Figure 3 It is a schematic diagram of the sound-light synchronous linkage system disclosed in the present invention. DETAILED DESCRIPTION

[0078] The technical solution of the present invention is further specifically described below by examples and in conjunction with the accompanying drawings. In the specification, the same or similar reference numerals indicate the same or similar components. The following description of the embodiments of the present invention with reference to the accompanying drawings is intended to explain the overall inventive concept of the present invention and should not be construed as a limitation of the present invention.

[0079] The terms "including", "comprising" and similar terms used herein should be understood as open terms, i.e., "including / including but not limited to", indicating that other contents may also be included. The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one other embodiment", and so on.

[0080] The present invention mainly focuses on the following technical problem: how to realize the integrated sound and light linkage function in a car.

[0081] In order to solve the above problems, the present invention discloses a method for synchronous sound and light linkage, which includes: receiving an operating mode selected by a user; receiving a sound signal from a media source; converting the sound signal into a light signal, wherein the light signal is at least related to the frequency information in the sound signal; converting the sound signal into an audio signal; and executing the selected operating mode using the light signal and the audio signal.

[0082] Figure 1 An example of the acoustic-optical synchronous linkage method disclosed in the present invention is shown. The acoustic-optical synchronous linkage method specifically includes:

[0083] S10: Receive the working mode selected by the user.

[0084] In this example, based on the user experience data accumulated over a long period of time, at least the following three working modes can be included: the first working mode: all sound channels and all light channels in the car work at the same time to realize the sound and light linkage mode of the entire car; the second working mode: users select some sound channels and some light channels to work at the same time as needed to realize the sound and light linkage mode of some areas in the car; the third working mode: in some special circumstances (for example, there are sleeping infants in the car or passengers in the car need a dim environment to rest), only some light channels and all sound channels in the car work at the same time to realize the sound and light linkage mode of some areas in the car.

[0085] S20: receiving a sound signal from a media source. In this example, the media source can perform audio decoding processing on the sound signal it obtains.

[0086] Specifically, the media source outputs a decoded sound signal, and the decoded sound signal also includes a tag indicating the type of music, and different types of music include different sound frequency bands.

[0087] S30: Convert the sound signal into a light signal, wherein the light signal is at least related to the frequency information in the sound signal; in this example, this step is as follows Figure 2 It includes the following sub-steps:

[0088] S31: Extracting frequency information from the sound signal.

[0089] In this step, the frequency information in the sound signal is extracted according to an extraction period, wherein the extraction period is an integer multiple of the sampling period of the sound signal.

[0090] Since it is difficult for the human body to perceive sound within 500ms, in order to solve the problem of asynchrony between the sound and light changes that the human body can perceive, the extraction period of the light signal can be set within 500ms to calibrate and debug the appropriate time difference to ensure the consistency of the human body's experience of sound and light. That is, in this example, the extraction period T is less than 500ms.

[0091] S32: Use a color mixing algorithm to convert the frequency information into the ratio information of the three primary colors RGB. Specifically, the color mixing algorithm can be used to convert the frequency information in the sound signal into the light color in optics, and the sound change in each unit time (for example, extraction period T) can have a corresponding optical color output. This step specifically includes:

[0092] Using the color mixing algorithm, the frequency information within the extraction period T is processed, and the proportion information of the three primary colors RGB within the extraction period is obtained according to the following formula:

[0093] g(R)=ΔF1 / F*a1+F1 / F*b1;

[0094] Wherein, g(R) represents the proportion of red light in the extraction period T, F represents the total energy density corresponding to the frequency information in the extraction period T, F1 represents the energy density in the first frequency band in the frequency information, ΔF1 represents the change of energy density in the first frequency band in the extraction period T, and a1 and b1 are weighting coefficients respectively;

[0095] g(G)=ΔF2 / F*a2+F2 / F*b2;

[0096] Wherein, g(G) represents the proportion of green light in the extraction period T, F2 is the energy density in the second frequency band in the frequency information, ΔF2 represents the change of energy density in the second frequency band in the extraction period T, and a2 and b2 are weighting coefficients;

[0097] g(B)=ΔF3 / F*a3+F3 / F*b3;

[0098] Wherein, g(B) represents the proportion of blue light in the extraction period T, F3 is the energy density in the third frequency band in the frequency information, ΔF3 represents the change of energy density in the third frequency band in the extraction period T, and a3 and b3 are weighting coefficients;

[0099] And, g(R)+g(G)+g(B)=1.

[0100] In this example, the ranges of the first frequency band, the second frequency band, and the third frequency band are determined according to the type of music. For example, when the frequency band range of the first sound signal determined according to the type of music is 20Hz-20KHz, the first frequency band can be set to 20-200Hz, the second frequency band can be set to 200Hz-3KHz, and the third frequency band can be set to 3KHz-20KHz. Alternatively, when the frequency band range of the second sound signal determined according to the type of music is 200Hz-5KHz, the first frequency band can be set to 200-800Hz, the second frequency band can be set to 800Hz-2.5KHz, and the third frequency band can be set to 2.5KHz-5KHz.

[0101] S33: Generate a light signal using the ratio information of the three primary colors RGB and the brightness function of the light signal. In this example, the light brightness in the brightness function is related to the voltage value, and the volume of the sound signal is also related to the voltage value, so the change in the volume of the sound signal can be associated with the light brightness. Specifically, this step includes:

[0102] First, the energy density change of the frequency information within the extraction period T is used to obtain the brightness function L(T) of the light signal:

[0103] L(T)=k(ΔF1+ΔF2+ΔF3);

[0104] Wherein, L(T) represents the brightness of the light within the extraction period T, and k is a constant coefficient representing the light intensity.

[0105] Secondly, using the ratio information of the RGB three primary colors within the extraction period T and the brightness function of the light signal, the color dynamic response algorithm model within the extraction period T is obtained:

[0106] C(T)=g(R)L(T)+g(G)L(T)+g(B)L(T),

[0107] Wherein, C(T) represents the light signal including light color and light brightness within the extraction period T.

[0108] According to the method of converting the sound signal into a light signal disclosed in step S30, the final light color can be determined by extracting the energy density change in each frequency band within the period T and the energy proportion of each frequency band, and a fast response to dynamic changes can be achieved.

[0109] S40: Convert the sound signal into an audio signal. This step can adopt the existing audio signal conversion technology, which will not be described in detail here.

[0110] S50: Execute the selected working mode using the light signal and the audio signal. This step specifically includes:

[0111] When the first mode is selected, light signals are sent to all light channels, and audio signals are sent to all sound channels, so that all light channels and all sound channels work simultaneously, realizing an overall sound-light linkage mode in the car.

[0112] When the second mode is selected, the light signal is sent to one or more selected light channels, and the audio signal is sent to one or more selected sound channels, so that the light channels that only receive the light signal and the sound channels that only receive the audio signal work simultaneously, realizing the sound and light linkage mode of some areas in the car.

[0113] When the third mode is selected, the light signal is sent to one or more selected light channels, and the audio signal is sent to all sound channels. Similar to the second mode, no further description is given.

[0114] In addition, if Figure 3 As shown, the present disclosure also discloses a sound-light synchronous linkage system, which includes: a media source 310, a receiving unit 320, a data processing unit 330, a first actuator 340 and a second actuator 350.

[0115] Specifically, the media source 310 performs audio decoding processing on the sound signal and sends the processed sound signal to the receiving unit 320. In addition, the receiving unit 320 is also used to receive the working mode selected by the user (for example, the first mode, the second mode, the third mode, etc.).

[0116] The data processing unit 330 is used to implement Figure 1 and Figure 2 The steps S30-S50 shown in the figure send the obtained sound signal to the first actuator 340 and the obtained light signal to the second actuator 350, which will not be repeated here.

[0117] Specifically, the data processing unit 330 includes at least a DSP (Digital Signal Processing) processing module and an MCU (Microcontroller Unit) processing module. The DSP processing module is used to execute Figure 1 The steps S20-S40 shown in the figure then send the processed light signal and audio signal to the MCU processing module, which selectively sends the audio signal to the first actuator 340 and the light signal to the second actuator 350 according to the received working mode selected by the user. In particular, based on using the DSP processing module to execute steps S20-S40, it can effectively ensure that the audio signal and the light signal are output according to the required timing, thereby ensuring the consistency of the sound and light linkage.

[0118] Furthermore, the first actuator 340 includes a plurality of sound channels, and the second actuator 350 includes a plurality of light channels. Each sound channel is used to receive an audio signal and convert it into sound, and each light channel is used to receive a light signal and convert it into light.

[0119] In case the first mode is selected, all light channels receive light signals from the data processing unit 330 , and all sound channels receive audio signals from the data processing unit 330 .

[0120] Specifically, the MCU processing module sends the audio signal to all sound channels of the first actuator 340 and sends the light signal to all light channels of the second actuator 350 according to the first mode selected by the user, so as to achieve a full-range sound and light linkage effect in the car.

[0121] When the second mode is selected, only one or more of all the light channels receive light signals from the data processing unit 330 , and only one or more of all the sound channels receive audio signals from the data processing unit 330 .

[0122] Specifically, the MCU processing module selectively sends the audio signal to one or more sound channels in the first actuator 340, and selectively sends the light signal to one or more light channels in the second actuator 350 according to the second mode selected by the user, so as to achieve the sound and light linkage effect in some areas inside the car.

[0123] In case the third mode is selected, only one or more light channels among all light channels receive light signals from the data processing unit 330 , and all sound channels receive audio signals from the data processing unit 330 .

[0124] Specifically, the MCU processing module selectively sends the audio signal to all sound channels in the first actuator 340 and selectively sends the light signal to one or more light channels in the second actuator 350 according to the third mode selected by the user.

[0125] The sound-light synchronous linkage method and the sound-light synchronous linkage system disclosed in this article overcome the problem of how to effectively integrate sound signals and optical signals, and obtain light signals by utilizing the correlation between light signals and frequency information in sound signals, thereby meeting the real-time and delay-free requirements of sound-light linkage, and ultimately meeting people's sound-light needs for the riding experience.

[0126] The above are only optional embodiments of the embodiments of the present disclosure, and are not intended to limit the embodiments of the present disclosure. For those skilled in the art, the embodiments of the present disclosure may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the embodiments of the present disclosure shall be included in the protection scope of the embodiments of the present disclosure.

[0127] Although the embodiments of the present disclosure have been described with reference to several specific embodiments, it should be understood that the embodiments of the present disclosure are not limited to the specific embodiments disclosed. The embodiments of the present disclosure are intended to cover various modifications and equivalent arrangements included in the spirit and scope of the appended claims. The scope of the appended claims is consistent with the broadest interpretation, thereby including all such modifications and equivalent structures and functions.

Claims

1. A method for synchronously linking sound and light, comprising: Receive the working mode selected by the user; receiving a sound signal from a media source; Convert the sound signal into a light signal: Extracting frequency information from the sound signal within an extraction period T; Using a color mixing algorithm, the frequency information is converted into ratio information of the three primary colors RGB; as well as Multiplying the ratio information of the three primary colors of RGB by the brightness function of the light signal respectively to generate the light signal within the extraction period T, wherein the brightness function of the light signal is related to the energy density change of the frequency information within the extraction period T; converting the sound signal into an audio signal; and The selected working mode is executed using the light signal and the audio signal.

2. The method for synchronously linking sound and light according to claim 1, characterized in that: The extraction period T is an integer multiple of the sampling period of the sound signal.

3. The method for synchronously linking sound and light according to claim 2, characterized in that: Converting the frequency information into the ratio information of the three primary colors RGB by using the color mixing algorithm further includes: The frequency information within the extraction period T is processed by using the color mixing algorithm, and the ratio information of the three primary colors RGB within the extraction period T is obtained according to the following formula: g(R)=ΔF1 / F*a1+F1 / F*b1; Wherein, g(R) represents the proportion of red light in the extraction period T, F represents the total energy density corresponding to the frequency information in the extraction period T, F1 is the energy density in the first frequency band in the frequency information, ΔF1 represents the change of energy density in the first frequency band in the extraction period T, and a1 and b1 are weighting coefficients respectively; g(G)=ΔF2 / F*a2+F2 / F*b2; Wherein, g(G) represents the proportion of green light in the extraction period T, F2 is the energy density in the second frequency band in the frequency information, ΔF2 represents the change of energy density in the second frequency band in the extraction period T, and a2 and b2 are weighting coefficients; g(B)=ΔF3 / F*a3+F3 / F*b3; Wherein, g(B) represents the proportion of blue light in the extraction period T, F3 is the energy density in the third frequency band in the frequency information, ΔF3 represents the change of energy density in the third frequency band in the extraction period T, and a3 and b3 are weighting coefficients; And, g(R)+g(G)+g(B)=1.

4. The method for synchronously linking sound and light according to claim 3, characterized in that: Multiplying the ratio information of the three primary colors of RGB by the brightness function of the light signal to generate the light signal further comprises: By using the energy density change of the frequency information within the extraction period T, the brightness function L(T) of the light signal is obtained: L(T)=k(ΔF1+ΔF2+ΔF3); Wherein, L(T) represents the brightness of the light in the extraction period T, and k is a constant coefficient representing the light intensity; The ratio information of the three primary colors RGB within the extraction period T is multiplied by the brightness function of the light signal to obtain the color dynamic response algorithm model within the extraction period T: C(T)=g(R)L(T)+g(G)L(T)+g(B)L(T), Wherein, C(T) represents the light signal including light color and light brightness within the extraction period T.

5. The method for synchronously linking sound and light according to claim 3, characterized in that: The extraction period T is less than 500 ms.

6. The method for synchronously linking sound and light according to claim 3, characterized in that: Receiving a sound signal from a media source further comprises: receiving a sound signal decoded by the media source, wherein the decoded sound signal further includes a tag indicating a music type, The ranges of the first frequency band, the second frequency band and the third frequency band are determined according to the music type.

7. The method for synchronously linking sound and light according to claim 1, characterized in that: The operating mode of executing the selection using the light signal and the audio signal further includes: In case the first mode is selected, the light signal is sent to all light channels, and the audio signal is sent to all sound channels; In case the second mode is selected, the light signal is sent to the selected one or more light channels, and the audio signal is sent to the selected one or more sound channels; In case the third mode is selected, the lighting signal is sent to the selected one or more light channels, and the audio signal is sent to all sound channels.

8. An acoustic and optical synchronous linkage system, comprising: A receiving unit, which is used to receive a sound signal from a working mode selected by a user and from a media source; A data processing unit for: Convert the sound signal into a light signal: Extracting frequency information from the sound signal within an extraction period T; Using a color mixing algorithm, the frequency information is converted into ratio information of the three primary colors RGB; as well as Multiplying the ratio information of the three primary colors RGB by the brightness function of the light signal respectively to generate the light signal within the extraction period T, wherein the brightness function of the light signal is related to the energy density change of the frequency information within the extraction period T; converting the sound signal into an audio signal; and The selected working mode is executed using the light signal and the audio signal.

9. The sound and light synchronous linkage system according to claim 8, characterized in that: The extraction period T is an integer multiple of the sampling period of the sound signal.

10. The sound and light synchronous linkage system according to claim 9, characterized in that: The data processing unit converts the frequency information into the ratio information of the three primary colors RGB by using the color mixing algorithm, further comprising: The frequency information within the extraction period T is processed by using the color mixing algorithm, and the ratio information of the three primary colors RGB within the extraction period T is obtained according to the following formula: g(R)=ΔF1 / F*a1+F1 / F*b1; Wherein, g(R) represents the proportion of red light in the extraction period T, F represents the total energy density corresponding to the frequency information in the extraction period T, F1 is the energy density in the first frequency band in the frequency information, ΔF1 represents the change of energy density in the first frequency band in the extraction period T, and a1 and b1 are weighting coefficients respectively; g(G)=ΔF2 / F*a2+F2 / F*b2; Wherein, g(G) represents the proportion of green light in the extraction period T, F2 is the energy density in the second frequency band in the frequency information, ΔF2 represents the change of energy density in the second frequency band in the extraction period T, and a2 and b2 are weighting coefficients; g(B)=ΔF3 / F*a3+F3 / F*b3; Wherein, g(B) represents the proportion of blue light in the extraction period T, F3 is the energy density in the third frequency band in the frequency information, ΔF3 represents the change of energy density in the third frequency band in the extraction period T, and a3 and b3 are weighting coefficients; And, g(R)+g(G)+g(B)=1.

11. The sound and light synchronous linkage system according to claim 10, characterized in that: The data processing unit multiplies the ratio information of the three primary colors RGB by the brightness function of the light signal to generate the light signal further comprising: By using the energy density change of the frequency information within the extraction period T, the brightness function L(T) of the light signal is obtained: L(T)=k(ΔF1+ΔF2+ΔF3); Wherein, L(T) represents the brightness of the light in the extraction period T, and k is a constant coefficient representing the light intensity; The ratio information of the three primary colors RGB within the extraction period T is multiplied by the brightness function of the light signal to obtain the color dynamic response algorithm model within the extraction period T: C(T)=g(R)L(T)+g(G)L(T)+g(B)L(T), Wherein, C(T) represents the light signal including light color and light brightness within the extraction period T.

12. The sound and light synchronous linkage system according to claim 8, characterized in that: The system further comprises: a plurality of sound channels and a plurality of light channels, wherein each of the sound channels is used to receive the audio signal and convert it into sound, and each of the light channels is used to receive the light signal and convert it into light; When the first mode is selected, all light channels receive the light signal, and all sound channels receive the audio signal; In case the second mode is selected, one or more of all the light channels receive the light signal, and one or more of all the sound channels receive the audio signal; When the third mode is selected, one or more of all the light channels receive the light signal, and all the sound channels receive the audio signal.

Images