Audio playback device and array, related methods and media

Abstract

The present disclosure provides an audio playback device and array, related methods and media. The audio playback device includes: a wireless communication unit for receiving an audio signal; a decoding unit for decoding the received audio signal; a playback module for playing the decoded audio signal; a control module for generating a light control parameter according to the audio signal; and a light emitting unit for emitting light in synchronization with the audio signal played by the playback module according to the light control parameter. The light emitted by the audio playback device provided in the embodiment of the present disclosure can change in real time according to the content being played, thereby enhancing the real-time experience of the audio playback device and improving the interactive effect of the audio playback device.

Description

Technical Field

[0001] The present disclosure relates to the field of smart devices, and in particular to an audio playback device and array, and related methods and media. Background Art

[0002] At present, the main function of a speaker is to play music. As the number of smart speaker users increases, users have diversified their demands for smart speaker playback functions, which will challenge the single playback mode of traditional speakers. Although some speakers use some decorative lights, the flashing content of the decorative lights has nothing to do with the content being played, and users have a poor experience when listening to the speakers. Summary of the invention

[0003] In view of this, an object of the present disclosure is to provide a luminous audio playback device so that the emitted light changes in real time according to the played content, thereby enhancing the real-time experience of the audio playback device and improving the interactive effect of the audio playback device.

[0004] According to one aspect of the present disclosure, there is provided an audio playback device, comprising:

[0005] A wireless communication unit for receiving an audio signal;

[0006] A decoding unit, used for decoding a received audio signal;

[0007] A playback module, used to play the decoded audio signal;

[0008] A control module, used to generate light control parameters according to the audio signal;

[0009] The light-emitting unit is used to emit light synchronously with the audio signal played by the playing module according to the light-emitting control parameters.

[0010] Optionally, the control module is further used for:

[0011] Get lighting effect control parameters;

[0012] The light-emitting unit is controlled according to the light-emitting control parameter and the light-effect control parameter.

[0013] Optionally, the light-emitting unit is a light strip or a light matrix, the light strip includes a plurality of lights, each row or each column of the light matrix includes a plurality of lights, and the step of generating the light-emitting control parameter according to the audio signal includes:

[0014] Based on the audio value within a predetermined time length of the audio signal, a corresponding frequency domain signal is obtained;

[0015] Convert the frequency domain signal to the Bark domain, and obtain a Bark domain subband value in each dimension of the Bark domain;

[0016] According to the Bark domain subband value on each Bark domain dimension, the quantized Bark domain subband value of each lamp in the lamp strip is determined as the light control parameter, or the number of lamps lit in each column of the lamp matrix is ​​determined as the light control parameter.

[0017] Optionally, the lighting effect parameters include at least one of a light emitting unit color, a light emitting unit flashing frequency, and a light emitting unit flashing duty cycle.

[0018] Optionally, the audio playback device further includes: an interaction unit, configured to display a lighting effect parameter input page and receive input lighting effect parameters.

[0019] Optionally, the control module obtains sound attribute data from the received audio signal, and determines the lighting effect parameters based on the sound attribute data.

[0020] Optionally, the sound attribute data includes at least one of rhythm data, genre data, sound emotion data, and pitch data.

[0021] Optionally, obtaining the corresponding frequency domain signal based on the audio value within a predetermined time length of the audio signal includes: obtaining the frequency domain signal corresponding to the single audio track data based on the audio value within a predetermined time length of the single audio track data in the audio signal; converting the frequency domain signal to the Bark domain to obtain a Bark domain subband value in each dimension of the Bark domain, including: converting the frequency domain signal corresponding to the single audio track data to the Bark domain, and obtaining a Bark domain subband value in each dimension of the Bark domain; determining the quantized Bark domain subband value of each light in the light strip as the light control parameter according to the Bark domain subband value on each Bark domain dimension, or the number of lights lit in each column in the light matrix as the light control parameter, including: determining the quantized Bark domain subband value of each light in the light strip as the light control parameter according to the Bark domain subband value on each Bark domain dimension corresponding to the single audio track data, or the number of lights lit in each column in the light matrix as the light control parameter.

[0022] Optionally, the light-emitting unit includes multiple sub-light-emitting units corresponding to the audio tracks, and the quantized Bark domain subband value of each light in the light strip is determined as the light-emitting control parameter according to the Bark domain subband value on each Bark domain dimension corresponding to the single audio track data, or the number of lights lit in each column in the light matrix is ​​used as the light-emitting control parameter, including: according to the Bark domain subband value on each Bark domain dimension corresponding to each track of single audio track data, the quantized Bark domain subband value of each light in the light strip in the sub-light-emitting unit corresponding to the audio track is determined as the light-emitting control parameter, or the number of lights lit in each column in the light matrix is ​​used as the light-emitting control parameter.

[0023] Optionally, the light-emitting unit includes a plurality of light zones, the plurality of light zones are connected into a predetermined shape, the light zone includes a plurality of lamps, the light-emitting control parameter is the number of lamps lit in the light zone, and the light-emitting according to the light-emitting control parameter is synchronously emitted with the audio signal played by the playback module, including: lighting the lamps in each light zone according to the number of lamps lit.

[0024] Optionally, the audio playback device is associated with an associated device, and the associated device also has a light-emitting unit. The light-emitting unit of the associated device also emits light synchronously with the audio signal played by the playback module according to the light-emitting control parameters.

[0025] Optionally, determining the quantized Bark domain subband value of each lamp in the lamp strip as the light control parameter, or the number of lamps lit in each column of the lamp matrix as the light control parameter according to the Bark domain subband value on each Bark domain dimension, includes:

[0026] When the number of Bark domain dimensions is equal to the number of lights in the light strip or the number of columns in the light matrix, each Bark domain dimension corresponds to a light in the light strip or a column of lights in the light matrix, and the light emission control parameters of the light or the column of lights are determined according to the Bark domain sub-band values ​​on each Bark domain dimension;

[0027] When the number of Bark domain dimensions is greater than the number of lights in the light strip or the number of columns in the light matrix, a valid Bark domain dimension is selected from the Bark domain dimensions according to the first rule, so that each valid Bark domain dimension corresponds to a light in the light strip or a column of lights in the light matrix, and a light emission control parameter of the light or a column of lights is determined according to the Bark domain sub-band value on each valid Bark domain dimension;

[0028] When the number of Bark domain dimensions is smaller than the number of lights in the light strip or the number of columns in the light matrix, the valid lights in the light strip or the valid columns in the light matrix are selected according to the second rule, so that each Bark domain dimension corresponds to a valid light in the light strip or a valid column in the light matrix, and the luminous control parameters of the valid light or valid column are determined according to the Bark domain sub-band values ​​on each Bark domain dimension.

[0029] Optionally, converting the frequency domain signal into the Bark domain includes: searching a correspondence table between frequency range and Bark domain dimension, and converting the frequency domain signal into the Bark domain.

[0030] Optionally, the interaction unit further receives at least one of the following:

[0031] First rule;

[0032] Second rule:

[0033] The number of Bark domain dimensions to be set;

[0034] Frequency range and Bark domain dimension correspondence table.

[0035] Optionally, if the interaction unit receives the set number of Bark domain dimensions, the control module generates a frequency range and Bark domain dimension correspondence table according to a predetermined correspondence generation rule.

[0036] Optionally, the quantized Bark domain subband value of each light in the light strip is determined as the light control parameter according to the Bark domain subband value on each Bark domain dimension, including: based on the quantization peak, the maximum sound intensity corresponding to the quantization peak, and each Bark domain subband value, the quantized Bark domain subband value of each light in the light strip is determined as the light control parameter.

[0037] Optionally, the number of lit lights in each column of the light matrix is ​​determined as the light control parameter based on the Bark domain subband value on each Bark domain dimension, including: based on the number of lights in each column of the light matrix, the maximum sound intensity corresponding to the number of lights in each column, and each Bark domain subband value, the number of lit lights in each column of the light matrix is ​​determined as the light control parameter.

[0038] Optionally, the quantization peak value is updated according to a comparison between the Bark subband value and the quantization peak value.

[0039] Optionally, the quantized peak value is updated in the following manner:

[0040] When the Bark domain subband value is greater than the quantization peak value, updating the quantization peak value with the Bark domain subband value;

[0041] When the Bark domain subband value is not greater than the quantization peak value, an equalization value between the Bark domain subband value and the quantization peak value is obtained according to an equalization factor as an updated quantization peak value.

[0042] Optionally, the determining, based on the quantized peak value, the maximum sound intensity value corresponding to the quantized peak value, and each Bark domain sub-band value, of the quantized Bark domain sub-band value of each lamp in the lamp strip as the light control parameter includes:

[0043] Based on the quantized peak value, the maximum sound intensity corresponding to the quantized peak value, and each Bark domain sub-band value, respectively determine the quantized Bark domain sub-band value of each light in the light strip;

[0044] Acquiring rhythm data from the sound data;

[0045] The quantized Bark domain subband value is smoothed using a smoothing factor corresponding to the rhythm data, and the smoothed quantized Bark domain subband value is used as the light emission control parameter.

[0046] According to one aspect of the present disclosure, an audio playback device array is provided, comprising a control module and a plurality of audio playback devices, wherein each audio playback device corresponds to one or more Bark domain dimensions; the control module is used to: obtain a corresponding frequency domain signal based on an audio value within a predetermined time length of an audio signal to be played; convert the frequency domain signal to the Bark domain, and obtain a Bark domain subband value in each dimension of the Bark domain; determine a light emission control parameter corresponding to each Bark domain dimension according to the Bark domain subband value in each Bark domain dimension; send the light emission control parameter of the Bark domain dimension corresponding to the audio playback device and the audio data in the Bark domain dimension in the audio signal to be played to each audio playback device; the sound box comprises: a wireless communication unit, used to receive the light emission control parameter of the Bark domain dimension corresponding to the sound box and the audio data in the Bark domain dimension in the audio signal to be played; a decoding unit, used to decode the received audio data; a playback module, used to play the decoded audio data; and a light emission unit, used to emit light synchronously with the audio signal played by the playback module according to the light emission control parameter.

[0047] According to one aspect of the present disclosure, a light emission control method of an audio playback device is provided, comprising:

[0048] Wirelessly receive audio signals;

[0049] generating a light-emitting unit control parameter according to the audio signal;

[0050] According to the light control parameter, the light emitting unit of the audio playback device is made to emit light in synchronization with the played audio signal.

[0051] Optionally, making the light-emitting unit of the audio playback device emit light in synchronization with the played audio signal according to the light-emitting control parameter comprises:

[0052] Get lighting effect control parameters;

[0053] The light-emitting unit is controlled to emit light according to the light-emitting control parameter and the light-effect control parameter.

[0054] Optionally, the light-emitting unit is a light strip or a light matrix, the light strip includes a plurality of lights, each row or each column of the light matrix includes a plurality of lights, and the step of generating the light-emitting control parameter according to the audio signal includes:

[0055] Based on the audio value within a predetermined time length of the audio signal, a corresponding frequency domain signal is obtained;

[0056] Convert the frequency domain signal to the Bark domain, and obtain a Bark domain subband value in each dimension of the Bark domain;

[0057] According to the Bark domain subband value on each Bark domain dimension, the quantized Bark domain subband value of each lamp in the lamp strip is determined as the light control parameter, or the number of lamps lit in each column of the lamp matrix is ​​determined as the light control parameter.

[0058] Optionally, the lighting effect parameters include at least one of a light emitting unit color, a light emitting unit flashing frequency, and a light emitting unit flashing duty cycle.

[0059] Optionally, the audio playback device further includes: an interaction unit, configured to display a lighting effect parameter input page and receive input lighting effect parameters.

[0060] According to one aspect of the present disclosure, a computer-readable medium is provided, storing a computer-executable code, wherein the computer-executable code is executed by a processor to implement the method as described above.

[0061] In the audio playback device of the disclosed embodiment, the control module generates a light control parameter according to the received audio signal, and the light-emitting unit emits light synchronously with the audio signal played by the playback module according to the light control parameter. In this way, the light emitted by the light-emitting unit and the sound played by the playback module are both synchronously derived from the received audio signal, and the two respond to each other (for example, when the played sound is strong, the light emitted is also strong), which improves the real-time experience of the audio playback device for the user and enhances the interactive effect of the audio playback device. BRIEF DESCRIPTION OF THE DRAWINGS

[0062] The above and other objects, features and advantages of the present invention will become more apparent through the description of the embodiments of the present invention with reference to the following drawings, in which:

[0063] Figure 1 A structural diagram of an audio playback device according to an embodiment of the present disclosure is shown;

[0064] Figure 2A -D respectively show schematic diagrams of audio playback devices with a single-point light-emitting unit, a ring-shaped light-emitting unit, a light-strip light-emitting unit, and a light-matrix light-emitting unit;

[0065] Figure 3 Shows Figure 2D A schematic diagram of each illuminated column of a light matrix light emitting unit;

[0066] Figure 4 A schematic diagram of an audio playback device with an interactive unit is shown;

[0067] Figure 5A -C shows Figure 4 A schematic diagram of an interactive interface of an interactive unit;

[0068] Figure 6 The corresponding relationship curve between the frequency domain and the Bark domain is shown exemplarily;

[0069] Figure 7 The frequency range corresponding to each Bark domain sub-band is shown exemplarily;

[0070] Figure 8 A structural diagram of an audio playback device array according to an embodiment of the present disclosure is shown;

[0071] Fig. 9 A flow chart of a light emission control method of an audio playback device according to an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0072] The present invention is described below based on embodiments, but the present invention is not limited to these embodiments. In the detailed description of the present invention below, some specific details are described in detail. It is possible for a person skilled in the art to fully understand the present invention without the description of these details. In order to avoid confusing the essence of the present invention, known methods, processes, and procedures are not described in detail. In addition, the drawings are not necessarily drawn to scale.

[0073] The audio playback device of the embodiment of the present disclosure

[0074] According to an embodiment of the present disclosure, an audio playback device is provided. An audio playback device refers to a device whose main function is to play audio, including a speaker, an external microphone, a microphone that can play sound at the same time, a playback pen, etc. They can be used independently, have a built-in playback function, and are mainly used to play audio.

[0075] like Figure 1 As shown, according to one embodiment of the present disclosure, the audio playback device 100 includes a wireless communication unit 110, a decoding unit 120, a control module 140, a playback module 130, a light emitting unit 150, and an interaction unit 160, wherein the interaction unit 160 is omissible.

[0076] The wireless communication unit 110 is a component in the audio playback device 100 that receives the audio signal to be played. It can be embodied in the form of an antenna, etc. The audio playback device 100 of the embodiment of the present disclosure is used independently. Wireless communication is a common way for independent devices to obtain signals from the outside world.

[0077] The decoding unit 120 is a unit for decoding received audio signals. In order to be played on an audio playing device 100 such as a speaker, the audio signal generally needs to go through a decoding process.

[0078] The playing module 130 is a module for playing the decoded audio signal. A module is generally a collection of the smallest system of chips, generally composed of multiple chips and PCBs, which can be developed by chip manufacturers or third-party companies, greatly facilitating the use of chips.

[0079] The control module 140 is a module that generates light control parameters according to the audio signal. The light control parameters are parameters for controlling the light emission of the light emitting unit 150, such as the light emission brightness of a single-point light emitting unit, the ring lighting ratio of a ring light emitting unit, each frequency domain characteristic value or Bark domain subband value of a light strip light emitting unit, the number of lights lit in each column of a light matrix light emitting unit, etc.

[0080] The light emitting unit 150 is a unit that emits light in synchronization with the audio signal played by the playing module 130 according to the light emitting control parameters. Figure 2A -D describes 4 different types of light emitting units 150 and corresponding light emitting control parameters. It should be understood that the above types are only examples, and those skilled in the art can also conceive of other types of light emitting units 150.

[0081] Figure 2A 1 shows a schematic diagram of an audio playback device 100 with a single-point light-emitting unit 150. The single-point light-emitting unit 150 is a light-emitting unit that emits light at only one point, such as Figure 2A In the case of a single-point light-emitting unit 150, the light-emitting control parameter may be the light-emitting brightness of the single-point light-emitting unit 150. The method by which the control module 140 generates the light-emitting brightness according to the audio signal may be to extract the time domain feature value from the audio signal and generate the light-emitting brightness accordingly, or to extract the frequency domain feature value of a single frequency band or a comprehensive index of the frequency domain feature values ​​of multiple frequency bands from the audio signal and generate the light-emitting brightness accordingly, and so on.

[0082] In the case of extracting time domain eigenvalues ​​from an audio signal and generating luminous brightness accordingly, the time domain eigenvalues ​​may be envelope values ​​within a predetermined time length of the audio signal. The predetermined time length is the period of each change in the brightness value of the light-emitting unit 150, which is equal to the inverse of the light effect refresh frequency of the light-emitting unit 150 (for example, how many times the brightness value of the light-emitting unit changes per second). The predetermined time length is multiplied by the sampling rate of the audio signal (for example, how many samples are taken per second, generally 48k / s) to obtain the number of samples in the predetermined time length. The root mean square of the sampling values ​​of the audio signal in the predetermined time length is calculated to obtain the envelope value in the predetermined time length. In order to prevent the lighting effect from changing too quickly and the display from being unstable, the envelope value may be smoothed to obtain the time domain eigenvalue.

[0083] In one embodiment, the luminous brightness can be proportional to the time domain characteristic value. Therefore, after obtaining the time domain characteristic value, multiply it by a predetermined coefficient to obtain the luminous brightness. The predetermined coefficient can be equal to the maximum luminous brightness that the light unit 150 can emit divided by the maximum time domain characteristic value of the general audio signal.

[0084] In the case where the frequency domain characteristic value of a single frequency band or a comprehensive index of the frequency domain characteristic values ​​of multiple frequency bands is extracted from the audio signal and the luminous brightness is generated accordingly, the frequency domain characteristic value may be the spectrum value of the center frequency point of a single frequency band, and a comprehensive index of the frequency domain characteristic values ​​of multiple frequency bands may refer to the average or sum of the spectrum values ​​of the center frequency points of multiple frequency bands. The reason why the frequency domain characteristic value of a single frequency band or a comprehensive index of the frequency domain characteristic values ​​of multiple frequency bands is used to generate the luminous brightness is that these frequency bands are the frequency bands of concern (for example, the frequency bands that the human ear is sensitive to or the frequency bands where the playback effect of a certain audio playback device is the clearest). Therefore, in some cases, the flashing of the light-emitting unit is allowed to track the changes in the values ​​of these key frequency bands or frequency points, so that the user has a more immersive sense. After obtaining the frequency domain characteristic value or the comprehensive index, in one embodiment, when determining the luminous brightness, the luminous brightness can be made proportional to the frequency domain characteristic value or the above-mentioned comprehensive index value. Therefore, after obtaining the frequency domain characteristic value or the comprehensive index value, multiply it by a predetermined coefficient to obtain the luminous brightness. The predetermined coefficient may be equal to the maximum light brightness that the light emitting unit 150 can emit divided by the maximum frequency domain characteristic value of the single frequency band of the general audio signal or the maximum value of a comprehensive index of the frequency domain characteristic values ​​of multiple frequency bands.

[0085] Figure 2B A schematic diagram of an audio playback device 100 with a ring-shaped light-emitting unit 150 is shown. The ring-shaped light-emitting unit 150 is a light-emitting unit in a ring shape. The ring of the ring-shaped light-emitting unit 150 can be partially lit, or the entire ring can be lit. In the case of the ring-shaped light-emitting unit 150, the light control parameter can be the ring lighting ratio of the ring-shaped light-emitting unit 150. The method for the control module 140 to generate the ring lighting ratio according to the audio signal can be to extract the time domain feature value from the audio signal and generate the ring lighting ratio accordingly, or to extract the frequency domain feature value of a single frequency band or a comprehensive index of the frequency domain feature value of multiple frequency bands from the audio signal and generate the ring lighting ratio accordingly, and so on. They are basically the same as the method of extracting the time domain feature value from the audio signal and generating the luminous brightness accordingly, or extracting the frequency domain feature value of a single frequency band or a comprehensive index of the frequency domain feature value of multiple frequency bands from the audio signal and generating the luminous brightness accordingly in the case of the single-point light-emitting unit 150, and the only difference is that the ring lighting ratio replaces the luminous brightness, so it is not repeated.

[0086] Figure 2CA schematic diagram of an audio playback device 100 with a light strip light-emitting unit 150 is shown. The light strip light-emitting unit 150 is a strip formed by a plurality of lights arranged in a row. In the case of the light strip light-emitting unit 150, the light control parameter may be a spectrum value of a certain frequency point in a frequency domain signal converted from an audio signal, or a subband value of a Bark domain signal.

[0087] In the case where the light control parameter is the spectrum value of a certain frequency point in the frequency domain signal converted from the audio signal, the light control parameter can be obtained as follows: based on the audio value within the predetermined time length of the audio signal, the corresponding frequency domain signal is obtained; and the spectrum value of the predetermined frequency point is obtained from the frequency domain signal as the light control parameter. The reason why the frequency domain signal is obtained based on the audio value within the predetermined time length of the audio signal is also due to the need to consider the situation of the audio signal within a light unit change cycle as described above.

[0088] The conversion from the time domain signal to the frequency domain signal can be carried out by using an existing method. Then, the spectrum values ​​of a predetermined number of frequency points can be taken from the frequency domain signal. The predetermined number is consistent with the number of lights in the light strip. The spectrum value of each frequency point corresponds to a light. According to the spectrum value of the frequency point, the brightness of the corresponding light can be determined. In one embodiment, when determining the luminous brightness of the light, the luminous brightness can be made proportional to the spectrum value of the corresponding frequency point. The luminous brightness of the corresponding light is obtained by multiplying the spectrum value of the corresponding frequency point by a predetermined coefficient. The predetermined coefficient can be equal to the maximum luminous brightness that the light of the light strip can emit divided by the maximum spectrum value of the frequency point of the general audio signal. The embodiment of the light strip has the advantage of reflecting the strength of audio signals at different frequency points or frequency bands relative to the embodiment of the single-point or ring-shaped light-emitting unit, so that the user can visually form respective stimulations for the strength of the sound of different audio bands (such as the low-frequency end and the high-frequency end), thereby improving the user's listening experience.

[0089] However, since the human ear has different sensitivities to sounds in different frequency bands and has critical frequency bands, using Bark domain eigenvalues ​​and frequency domain eigenvalues ​​can be closer to the human ear's perception of sound. The disclosed embodiment also introduces Bark domain eigenvalues ​​into the flashing of the light-emitting unit consistent with the audio signal for the first time. Critical band is a professional term in audiology and psychoacoustics, which was proposed by Harvey Fletcher in the 1840s. The cochlea is a sensor organ in the inner ear, and the critical band refers to the frequency bandwidth of the auditory filter generated by the cochlear structure. Simply put, the critical band is a sound frequency band, in which the perception of the first single tone will be disturbed by the auditory masking of the second single tone. In acoustic research, people use auditory filters to simulate different critical frequency bands. Later, researchers found that the structure of the human ear will roughly resonate with 24 frequency points. Based on this conclusion, Eberhard Zwicker proposed in 1961 for the special structure of the human ear that the audio signal also presents 24 critical frequency bands in the frequency band, from 1 to 24. This is the Bark domain. Each critical frequency band of the Bark domain is called a Bark domain subband, and the sound intensity value on the subband is the Bark domain subband value. An embodiment of the present disclosure uses the subband value of the Bark domain signal as a light emission control parameter.

[0090] In the case where the light control parameter is a subband value of a Bark domain signal converted from an audio signal, the light control parameter can be obtained as follows: based on the audio value within a predetermined time length of the audio signal, a corresponding frequency domain signal is obtained; the frequency domain signal is converted to the Bark domain, and a Bark domain subband value is obtained in each dimension of the Bark domain; according to the Bark domain subband values ​​in each Bark domain dimension, the quantized Bark domain subband values ​​of each light in the light strip are respectively determined as the light control parameter.

[0091] The method of obtaining the corresponding frequency domain signal based on the audio value within the predetermined time length of the audio signal is the same as the aforementioned frequency domain conversion.

[0092] Figure 6 The corresponding relationship curve between the frequency domain and the Bark domain is shown as an example. The horizontal axis of the curve represents various frequencies of the audio signal, and the vertical axis represents the corresponding Bark domain subband, such as one of the 24 subbands above. It should be understood that the number of the above Bark domain subbands may not be 24, but can be set by the user. Figure 6 The point (2.5kHz,15) on the middle curve represents the frequency 2.5kHz corresponding to Bark domain subband 15. Figure 7 is a table of correspondence between frequency range and Bark domain dimension, which clarifies the frequency range corresponding to each Bark domain subband. The frequency domain signal can be converted to the Bark domain by looking up Figure 7The frequency range shown is performed in the form of a correspondence table between the frequency range and the Bark domain dimension.

[0093] In one embodiment, according to the Bark domain subband value on each Bark domain dimension, the quantized Bark domain subband value of each light in the light strip is determined as the light control parameter, and the following method can be adopted: based on the quantization peak value, the maximum sound intensity corresponding to the quantization peak value, and each Bark domain subband value, the quantized Bark domain subband value of each light in the light strip is determined as the light control parameter. Quantization is the process of converting the analog value of an audio signal into a digital value. The maximum value that can be represented by the digital value is the quantization peak value. For example, in the case of a 16-bit digital signal, 2^15-1=32767, then 32767 is the quantization peak value, and the maximum value of the analog value corresponding to it is the maximum sound intensity corresponding to the quantization peak value. Divide each Bark domain subband value by the maximum sound intensity corresponding to the quantization peak value, and then multiply by the quantization peak value to obtain the quantization value corresponding to the Bark domain subband value, that is, the quantized Bark domain subband value, as the light control parameter. For example, the Bark domain subband value of half the maximum sound intensity corresponding to the quantized peak value corresponds to a quantized subband value of 32767*50%=16383. When it is used to control the brightness of the corresponding lights in the light strip, the adjusted light brightness is equal to the maximum light brightness divided by the quantized peak value, multiplied by the above quantized Bark domain subband value. For example, the quantized subband value is 16383, and the corresponding light brightness is half of the maximum light brightness.

[0094] Figure 2D FIG. 1 is a schematic diagram of an audio playback device 100 with a light matrix lighting unit 150. The light matrix lighting unit 150 includes a matrix consisting of multiple rows and columns of lights. In the case of the light matrix lighting unit 150, the light control parameter may be the number of lights that are lit in each column of the light matrix. Figure 3 As shown, the light matrix has 17 columns and 5 rows. The number of lights lit in each column is different, and the maximum number of lights that can be lit is 5.

[0095] In this embodiment, Figure 2C Similarly, in the embodiment of , based on the audio value of the audio signal within a predetermined time length, a corresponding frequency domain signal is obtained. The frequency domain signal is converted to the Bark domain, and a Bark domain subband value is obtained in each dimension of the Bark domain. Figure 2D Examples and Figure 2C The difference between the embodiments is that it determines the number of lights lit in each column of the light matrix as the light control parameter according to the Bark domain subband value on each Bark domain dimension, rather than determining the quantized Bark domain subband value of each light as the light control parameter.

[0096] The number of lights that are lit in each column of the light matrix can be determined based on the number of lights in each column of the light matrix, the maximum sound intensity corresponding to the number of lights in each column, and the values ​​of each Bark domain sub-band. It can be considered that the maximum sound intensity corresponding to the number of lights in each column corresponds to the number of lights in each column of the light matrix. That is, when the sound intensity of the Bark domain sub-band reaches the maximum value, all lights in the column should be lit. Therefore, by dividing each Bark domain sub-band value by the maximum sound intensity corresponding to the number of lights in each column, and then multiplying by the number of lights in each column, the number of lights that are lit in the column is obtained. The advantage of this embodiment is that the number of lights that are lit in each column is used to vividly indicate the strength of the sound signals in various frequency bands or frequency points, further improving the user's listening experience.

[0097] As mentioned above, the number of Bark domain subbands, or the number of Bark domain dimensions, is generally 24, but it can also be flexibly set according to user needs. Figure 7 The frequency range and Bark domain dimension correspondence table shown in the figure should be readjusted. In practice, try to make the number of Bark domain dimensions equal to Figure 2C The number of lights in the light strip or Figure 2D In this case, each Bark domain dimension corresponds to a light in the light strip or a column of lights in the light matrix. According to the Bark domain subband value on each Bark domain dimension, the light control parameter of the light or the column of lights is determined. In this way, the change of each light in the light strip or each column of lights in the light matrix directly reflects the Bark domain subband value of the audio signal.

[0098] However, in practice, there are Figure 2C The number of lights in the light strip or Figure 2D The number of columns of the light matrix does not coincidentally equal the number of Bark domain dimensions set in advance. In this case, one means of adjustment is to remove some Bark domain dimensions, or ignore some lights in the light strip or some columns in the light matrix (for example, keep them unlit). Another means of adjustment is to re-set the number of columns according to the actual Bark domain dimensions. Figure 2C The number of lights in the light strip or Figure 2D The number of columns of the light matrix described in the above example is reset as Figure 7 The frequency range and Bark domain dimension correspondence table shown.

[0099] Let's first discuss the former adjustment method. When the number of Bark domain dimensions is greater than the number of lights in the light strip or the number of columns in the light matrix, the effective Bark domain dimensions can be selected from the Bark domain dimensions according to the first rule. The effective Bark domain dimensions are the Bark domain dimensions selected to control the light emission. Generally, some Bark domain dimensions that are more strongly perceived by the human ear or the Bark domain dimensions that are more fully recognized by the audio playback device are selected as the effective Bark domain dimensions. How to select is specified by the first rule. The number of selected Bark domain dimensions is equal to the number of lights in the light strip or the number of columns in the light matrix, so that each effective Bark domain dimension corresponds to a light in the light strip or a column of lights in the light matrix. According to the Bark domain sub-band values ​​on each effective Bark domain dimension, the light emission control parameters of the light or a column of lights can be determined. Similarly, when the number of Bark domain dimensions is less than the number of lights in the light strip or the number of columns in the light matrix, the effective lights of the light strip or the effective columns of the light matrix can be selected according to the second rule, so that the number of Bark domain dimensions is equal to the effective number of lights in the light strip or the effective number of columns in the light matrix. How to select is specified by the second rule. After selection, each Bark domain dimension corresponds to an effective lamp in the lamp strip or an effective column in the lamp matrix. Then, according to the Bark domain subband value on each Bark domain dimension, the light control parameter of the effective lamp or effective column can be determined. The advantage of the above embodiment is that there is no need to redefine the corresponding relationship table between the frequency range and the Bark domain dimension, which is simple and easy to implement with high implementation efficiency.

[0100] The first rule and the second rule may be set in advance by an administrator or by a user through the interactive unit 160. The advantage of setting through the interactive unit 160 is that the user can flexibly set the rules according to actual needs, and the rules can better reflect the specific needs of the application, thereby improving the portability and scalability of the application.

[0101] The interaction unit 160 is an interface for the user to interact with the audio playback device 100. It can be embodied as follows Figure 4 The touch display screen on the audio playback device 100 shown may also be a voice control device, etc. The voice control device may receive a voice signal spoken by a user, and recognize the first rule or the second rule in the voice signal, etc. In addition, the interaction unit 160 may also be embodied as a deaf-mute gesture recognition device, which recognizes the gesture of the deaf-mute through image recognition, and obtains the first rule or the second rule from the recognized gesture.

[0102] In re-according to the actual Figure 2C The number of lights in the light strip or Figure 2D The number of columns of the light matrix described in the above example is reset as Figure 7In the embodiment of the frequency range and Bark domain dimension correspondence table shown in FIG. 1 , the frequency range and Bark domain dimension correspondence table set by the user can be received through the interaction unit 160. Since the correspondence table is set by the user, it ensures that the number of Bark domain dimensions in the correspondence table is consistent with the actual Figure 2C The number of lights in the light strip or Figure 2D In a more automated embodiment, the number of Bark domain dimensions set by the user may be received only through the interaction unit 160. Figure 4 As shown, the user selects the "Bark domain dimension number setting" option in the interactive unit 160, and a pop-up window appears. Figure 5C The interface shown in the figure prompts the user to enter the desired number of Bark domain dimensions. Figure 2C The number of lights in the light strip or Figure 2D In this case, the control module 140 may generate a table of correspondence between frequency range and Bark domain dimension according to a predetermined correspondence generation rule.

[0103] In the above-mentioned Bark domain embodiment, the light-emitting control parameter is proportional to the Bark domain subband value on each Bark domain dimension. The larger the Bark domain subband value on each Bark domain dimension, the larger the light-emitting control parameter, the greater the light-emitting brightness, or the more lights are lit in each column of the light matrix. However, music has different types. For some generally soothing music, such as nature music, hypnotic music, etc., the value of the quantized output always floats near the lowest order. When reflected in the light-emitting control, the user feels that the rhythmic rhythm resolution is insufficient on the one hand, and on the other hand, the light effect continues to be displayed in the low-brightness area, and the light effect change cannot be perceived, and the user experience is poor.

[0104] Therefore, in one embodiment, a solution is proposed to dynamically track and dynamically update the peak value of each Bark domain subband value. Its advantage is that regardless of the value of the sound source of the playback content and the current system volume, the quantized peak value can be adaptively adjusted with the playback content, so that the rhythmic feature display on the lighting effect can obtain a greater resolution and rhythmic sense.

[0105] In this embodiment, the quantization peak value is updated based on the comparison between the Bark subband value and the quantization peak value. k represents the number of the luminous change cycle. The following is the formula for real-time update of the quantization peak value:

[0106]

[0107] Among them, rhythm_vector[k] represents the Bark subband value of the kth luminous change period, and dynamic_max[k] represents the quantization peak value of the kth luminous change period. When the Bark domain subband value rhythm_vector[k] is greater than dynamic_max[k], the quantization peak value dynamic_max[k] is updated with the Bark domain subband value rhythm_vector[k]. When the Bark domain subband value rhythm_vector[k] is not greater than the quantization peak value dynamic_max[k], the equalization value between the Bark domain subband value rhythm_vector[k] and the quantization peak value dynamic_max[k] is obtained according to the equalization factor release_para as the updated quantization peak value dynamic_max[k]. For example, when the equalization factor release_para=0.4, 0.4dynamic_max[k]+0.6rhythm_vector[k] is a value between dynamic_max[k] and rhythm_vector[k]. This value is used to update dynamic_max[k] so that dynamic_max[k] moves closer to rhythm_vector[k]. In this way, when playing relatively soft and soothing nature music, since the Bark domain subband value rhythm_vector[k] will be smaller than the quantization peak value dynamic_max[k], an equilibrium value will be found between the Bark domain subband value rhythm_vector[k] and the quantization peak value dynamic_max[k] according to the equalization factor release_para, as the new quantization peak value dynamic_max[k], which will be smaller than the original quantization peak value dynamic_max[k]. In the next luminous change cycle, the adjusted quantized peak value dynamic_max[k] may still be larger than the Bark domain subband value rhythm_vector[k] of the next luminous change cycle, so the distance between the Bark domain subband value rhythm_vector[k] and the quantized peak value dynamic_max[k] will be further reduced according to the equalization factor release_para. In this way, the purpose of smoothly adjusting the quantized peak value dynamic_max[k] is achieved, so that the quantized peak value dynamic_max[k] can be adaptively adjusted with the playback content, so that the rhythmic feature display on the lighting effect can obtain a greater resolution and rhythmic sense.

[0108] In addition, when playing music with strong rhythm, people often want the lights to flash quickly; conversely, when playing music with weak rhythm, people often want the lights to flash slowly, which can help people blend into the emotions of various music and improve the listening experience. Therefore, in a further embodiment of the present disclosure, a method of adjusting the light control parameters according to the rhythm of the sound data is adopted, so that the flashing rhythm of the light unit is more unified with the rhythm of the sound, thereby improving the user's immersive experience.

[0109] In this embodiment, in the above process of determining the quantized Bark domain subband value of each light in the light strip as the light control parameter based on the quantization peak value, the maximum sound intensity value corresponding to the quantization peak value, and each Bark domain subband value, the quantized Bark domain subband value of each light in the light strip is determined based on the quantization peak value, the maximum sound intensity value corresponding to the quantization peak value, and each Bark domain subband value, the rhythm data is obtained from the sound data, and the quantized Bark domain subband value is smoothed using a smoothing factor corresponding to the rhythm data, and the smoothed quantized Bark domain subband value is used as the light control parameter. The rhythm data can be obtained from the sound data using an existing method. The corresponding balance factor can be determined according to the rhythm data by a table lookup, etc. The quantized Bark domain subband value quantify_vector(k) can be smoothed using the smoothing factor sm_para corresponding to the rhythm data using the following formula:

[0110] final_vector[k]=final_vector[k-1]*sm_para+quantify_vector(k)*(1-sm_para)

[0111] Among them, final_vector[k] is the Bark domain subband value after smoothing of the kth luminescence change period, final_vector[k-1] is the Bark domain subband value after smoothing of the k-1th luminescence change period, and quantify_vector(k) is the Bark domain subband value quantized above. Assume that final_vector[0]=0, then final_vector[1] is only related to quantify_vector(1). After that, the smoothed Bark domain subband value of each luminescence change period is related to both the quantized Bark domain subband value and the smoothed Bark domain subband value accumulated in the previous period. Since the smoothed Bark domain subband value accumulated in the previous period cannot be changed, in the current luminescence change period, the quantized Bark domain subband value determines the final smoothed Bark domain subband value.

[0112] In the above embodiment, the control module 140 generates a light control parameter and controls the light emitting unit 150 to emit light accordingly. The light control parameter controls only the specific parameters of the light emission, such as brightness, and does not control the specific lighting effect. For example, the control parameter is sent to control the brightness of the light emitting unit, but the color of the light emitted is pre-set and is not within the control range. The light flashing frequency is also pre-set and is not within the control range. They are the contents of the light effect control. The light effect is the light effect of the light emitting unit 150. The light effect parameter is a parameter indicating the light effect, which includes the color of the light emitting unit, the flashing frequency of the light emitting unit, the flashing duty cycle of the light emitting unit, etc. The flashing frequency of the light emitting unit refers to the number of flashes per unit time. For example, the light emission change cycle is 1 second, and the light emitting unit 150 emits light at the brightness indicated by the light control parameter within this 1 second, but it can emit light all the time or flash light, for example, it flashes 5 times and turns off 5 times at the brightness indicated by the light control parameter within 1 second, and its flashing frequency is 5 times / second. The flashing duty cycle of the light emitting unit refers to the ratio of the duration of flashing to the duration of off when flashing.

[0113] In another embodiment of the present disclosure, the control module 140 not only generates the light control parameters, but also obtains the lighting effect control parameters, and controls the light emitting unit according to the light control parameters and the lighting effect control parameters. In this embodiment, not only the light parameters (brightness, etc.) can be controlled, but also the lighting effect can be controlled, thereby improving the flexibility of light control.

[0114] In one embodiment, the lighting effect control parameters are set by the user. The interaction unit 160 displays the lighting effect parameter input page and receives the lighting effect parameters input by the user. Figure 4 As shown, the interface displayed by the interactive unit 160 has the options of "light color setting" and "light flashing setting". Figure 4 When you select "Light Color Settings" in the interface, the Figure 5A The light color setting drop-down menu shown in the figure can be used by users to select the color they want to set. Figure 4 When you select "Light Flashing Settings" in the interface, the Figure 5B The flicker frequency setting drop-down menu and flicker duty cycle setting drop-down menu are shown, and the user can select the flicker frequency or flicker duty cycle that he needs to set in the corresponding drop-down menu. This embodiment can realize the personalized customization of lighting effect parameters and improve the flexibility of user control.

[0115] In another embodiment, the lighting effect parameters are not input by the user, but are determined by the sound attribute data. For example, when listening to sad music, dark lights (such as dark blue) can better bring the user's emotions into the music; when listening to happy music, cheerful colors (such as red) can better bring the user's emotions into the music. Therefore, the lighting effect parameters are determined based on the sound attribute data, so that the emotional color of the light is consistent with the emotional color of the sound, further improving the user experience.

[0116] In this embodiment, the control module 140 obtains sound attribute data from the received audio signal, and determines the lighting effect parameters based on the sound attribute data. The sound attribute data is data indicating the attributes of the sound, including rhythm data, genre data, sound emotion data, tone data, etc. Rhythm data is data indicating the rhythm of the sound. Generally, the faster the rhythm of the music, the higher the flashing frequency can be set, so that the experience of the light is unified with the experience of the music. Genre data is data indicating the genre of the music. Music genres include classical, pop, folk, jazz, R&B, etc. For relatively soothing music of genres such as classical, the color of the light can be adjusted to dark colors, such as dark blue and dark purple. For music of genres such as pop, the color of the light can be adjusted to red, yellow, etc. Sound emotion data is data indicating the emotions expressed in the sound, such as sadness, happiness, calmness, etc. If the sound emotion is sad music, the color of the light can be set to dark blue, dark purple, etc. If the sound emotion is calm music, the color of the light can be set to white, etc. Tone data is data indicating the pitch of the sound. For example, for songs with higher pitches (such as songs sung by soprano), the color of the light can be adjusted to bright colors, such as red and yellow. For songs with lower pitches (such as songs sung by bass), the color of the light can be adjusted to dark colors such as dark blue and dark purple. The sound attributes can be identified from the audio information through existing methods. Based on the sound attribute data, the lighting effect parameters can be determined by searching a pre-set correspondence table.

[0117] In the above embodiments, the light-emitting unit is controlled by determining the light-emitting control parameter according to the complete audio signal. In another embodiment, the light-emitting unit can also be controlled by determining the light-emitting control parameter according to one track in the audio signal. This is more meaningful in some scenarios. For example, for songs, controlling the light emission according to the audio signal of the vocal track may be easier to make the user feel involved in the vocals than controlling the light emission according to the overall vocals. Therefore, when the embodiment obtains the corresponding frequency domain signal based on the audio value within the predetermined time length of the audio signal, the frequency domain signal corresponding to the single audio track data (such as vocal data) is obtained based on the audio value within the predetermined time length of the single audio track data (such as vocal data) in the audio signal. The audio track data of a predetermined track in the audio signal can be obtained by an existing method. When the embodiment converts the frequency domain signal to the Bark domain and obtains a Bark domain subband value in each dimension of the Bark domain, the frequency domain signal corresponding to the single audio track data (such as vocal data) is also converted to the Bark domain, and a Bark domain subband value is obtained in each dimension of the Bark domain. In this embodiment, when the quantized Bark domain subband value of each light in the light strip is determined as the light control parameter according to the Bark domain subband value on each Bark domain dimension, or the number of lights lit in each column in the light matrix is ​​used as the light control parameter, the quantized Bark domain subband value of each light in the light strip is determined as the light control parameter, or the number of lights lit in each column in the light matrix is ​​used as the light control parameter according to the Bark domain subband value on each Bark domain dimension corresponding to the single audio track data (such as vocal data).

[0118] In another embodiment, not only can the light control parameters be determined according to one track of the audio signal to control the light emission of the light emitting unit, but also the light control parameters can be determined according to each track of the audio signal to control the light emission of the light emitting unit. In this way, for various audio tracks in the audio, such as vocals, piano, guitar, cello, violin, etc., there are lights emitted corresponding to them, making the user's perception richer and further enhancing the user's immersive experience.

[0119] In this embodiment, the light unit 150 may include multiple sub-light units corresponding to the tracks. Each track may correspond to a sub-light unit. For example, the vocal track corresponds to one sub-light unit, the piano track corresponds to another sub-light unit, the guitar track corresponds to another sub-light unit, and so on. For the single-point light-emitting method, the light unit 150 includes multiple sub-light units similar to Figure 2A The single-point sub-light-emitting unit 150 in the single-point light-emitting unit, for example, the speaker has multiple light-emitting square points. Each single-point sub-light-emitting unit is responsible for the corresponding light emission of one track. For the ring-shaped light-emitting method, the light-emitting unit 150 includes multiple similar Figure 2BThe ring-shaped light-emitting unit 150 in the ring-shaped light-emitting unit is a ring-shaped sub-light-emitting unit, such as a speaker having multiple rings. Each ring-shaped sub-light-emitting unit is responsible for emitting light corresponding to a track. For the light strip light-emitting method, the light-emitting unit 150 includes multiple similar Figure 2C The light strip light-emitting unit 150 in the light strip light-emitting unit is a light strip sub-light-emitting unit. For example, the speaker has multiple light strips. Each light strip sub-light-emitting unit is responsible for emitting light corresponding to one track. For the light matrix light-emitting method, the light-emitting unit 150 includes multiple similar Figure 2D The light matrix sub-light-emitting units of the light matrix light-emitting unit 150, for example, a speaker has multiple light matrices. Each light matrix sub-light-emitting unit is responsible for the corresponding light emission of one track. When determining the quantized Bark domain sub-band value of each light in the light strip as the light control parameter, or the number of lights lit in each column of the light matrix as the light control parameter, the quantized Bark domain sub-band value of each light in the light strip in the sub-light-emitting unit corresponding to the track can be determined as the light control parameter, or the number of lights lit in each column of the light matrix can be determined as the light control parameter according to the Bark domain sub-band value on each Bark domain dimension corresponding to each track of single audio track data.

[0120] In another embodiment, the light-emitting unit 150 includes a plurality of light zones, and the plurality of light zones are connected to form a predetermined pattern, such as the shape of a rooster. Each light zone includes a plurality of lights. These lights are connected to form a part of the predetermined shape, such as a chicken head, a chicken breast, a chicken tail, a chicken foot, and the like. The light-emitting control parameter is the number of lights lit in the light zone. When the light is emitted synchronously with the audio signal played by the playback module according to the light-emitting control parameter, the lights can be lit in each light zone according to the number of lights lit. Taking the above-mentioned rooster as an example, although the head, breast, tail, and feet of the chicken are all lit with lights, the lights lit in each part are different, and the fatness of each part is different, resulting in a different sense of the whole rooster. In this way, the fatness of each part of the overall shape can be figuratively controlled to reflect, for example, the height of each Bark domain subband value, thereby giving the user a figurative lighting experience that matches the sound.

[0121] The number of lights that are lit in the light zone can be determined based on the number of lights in the light zone, the maximum sound intensity corresponding to the number of lights, and the values ​​of each Bark domain sub-band. It can be considered that the maximum sound intensity corresponds to the number of lights in a light zone. That is, when the sound intensity of the Bark domain sub-band reaches the maximum value, all lights in the light zone should be lit. Therefore, by dividing each Bark domain sub-band value by the maximum sound intensity and then multiplying it by the number of lights in the light zone, the number of lights that are lit in the light zone is obtained.

[0122] In application scenarios such as smart homes, there may be light-emitting units 150 on various home appliances. If these light-emitting units can emit light adapted to the audio signal along with the audio signal of the main device, a stronger immersive experience will be generated for the user in the entire home environment. Therefore, in one embodiment, the audio playback device 100 is associated with an associated device. The associated device can be other devices with light-emitting units 150 in the smart home, such as a refrigerator with light on the door, a washing machine with light on the cabinet, a television with light on the casing, curtains decorated with lights, doors with lights installed, and the like. These associated devices have wireless communication units inside, which communicate with the wireless communication unit 110 of the audio playback device 100 and receive the light control parameters sent by the wireless communication unit 110 of the audio playback device 100. Then, the light-emitting units of these associated devices can emit light synchronously with the audio signal played by the audio playback device 100 according to the received light control parameters. In this way, the light-emitting units of all associated devices emit light according to the received light control parameters, and they emit light together according to the same brightness and the same mode, so that the user obtains a unified telepresence experience. The advantage of this embodiment is that, in addition to making each associated device emit light synchronously to enhance the user's immersive experience, when the audio playback device 100 itself does not have the light-emitting unit 150 or the light-emitting unit 150 is broken, the same light-sound coordination effect can be achieved with the help of the light-emitting units of other associated devices.

[0123] The audio playback device array of the present disclosure embodiment

[0124] In the above-mentioned embodiment of a single audio playback device, the brightness of different lights in the light strip, or the number of lights lit in different columns in the light matrix, is used to reflect the values ​​of each Bark domain sub-band within a luminous change cycle. According to an embodiment of the present disclosure, an audio playback device array is also proposed, in which there are multiple audio playback devices 100, and the light emitted by the light-emitting unit 150 of each audio playback device 100 reflects a Bark domain sub-band value, so that the light emitted by the light-emitting unit 150 of multiple audio playback devices 100 reflects all Bark domain sub-band values ​​of the audio signal within a luminous change cycle. In addition, the playback module 130 of each audio playback device 100 can also play only the audio signal part of its corresponding Bark domain sub-band. In this way, if the user wants to listen to the sound of a certain Bark domain sub-band specifically and feel the related luminous changes, he can go to the vicinity of the corresponding audio playback device 100 to listen and feel. If the user wants to listen to the overall sound effect and feel the overall luminous effect corresponding to the music, he can listen and feel it at a position slightly far away from each audio playback device 100, so that the user can feel both a part of the sound and the overall sound effect, bringing a diversified experience to the user.

[0125] like Figure 8As shown, in this embodiment, the audio playback device array includes a control module 140 and a plurality of audio playback devices 100. Each audio playback device 100 corresponds to one or more Bark domain dimensions. One audio playback device 100 can correspond to a plurality of Bark domain dimensions at the same time because the number of audio playback devices included in the audio playback device array may be less than the number of Bark domain dimensions, or some Bark domain dimensions sound similar and do not need to be distinguished very accurately, etc.

[0126] Figure 8 The control module 140 in the embodiment obtains the corresponding frequency domain signal based on the audio value within the predetermined time length of the audio signal to be played. The control module 140 may have a wireless communication unit ( Figure 8 Not shown), for receiving the audio signal to be played. After receiving the audio signal to be played, the control module 140 obtains the corresponding frequency domain signal based on it. Then, the control module 140 converts the frequency domain signal to the Bark domain, and obtains a Bark domain subband value in each dimension of the Bark domain. Next, the control module 140 determines the luminous control parameters corresponding to each Bark domain dimension according to the Bark domain subband values ​​in each Bark domain dimension. The specific method for determining the luminous control parameters is the same as the previous embodiment. Afterwards, the control module 140 sends the luminous control parameters of the Bark domain dimension corresponding to the audio playback device 100 and the audio data in the Bark domain dimension in the received audio signal to be played to each audio playback device 100. In addition, the control module 140 may also have an interactive unit 160 for receiving lighting effect parameters input by the user. In the case of lighting effect parameters, the control module 140 sends the lighting control parameters of the Bark domain dimension corresponding to the audio playback device 100 and the audio data in the Bark domain dimension of the received audio signal to be played to each audio playback device 100, and also sends the lighting effect parameters to each audio playback device 100.

[0127] like Figure 8 As shown, the audio playback device 100 may include a wireless communication unit 110, a decoding unit 120, a playback module 130, and a light-emitting unit 150. The wireless communication unit 110 receives the light-emitting control parameters of the Bark domain dimension corresponding to the audio playback device 100, the audio data in the Bark domain dimension in the audio signal to be played, and the possible lighting effect parameters. The decoding unit 120 decodes the received audio data. The playback module 130 plays the decoded audio data. The light-emitting unit 150 emits light synchronously with the audio signal played by the playback module 130 according to the light-emitting control parameters and the lighting effect parameters.

[0128] Lighting control method of an audio playback device according to an embodiment of the present disclosure

[0129] According to an embodiment of the present disclosure, a light emitting control method of an audio playback device 100 is provided. The method is executed by the control module 140 of the audio playback device 100. Fig. 9 As shown, the method includes:

[0130] Step 210: Acquire an audio signal;

[0131] Step 220: Generate a light-emitting unit control parameter according to the audio signal;

[0132] Step 230: according to the light control parameter, the light emitting unit of the audio playback device 100 is made to emit light in synchronization with the played audio signal.

[0133] Optionally, the step of causing the light-emitting unit of the audio playback device 100 to emit light in synchronization with the played audio signal according to the light-emitting control parameter comprises:

[0134] Get lighting effect control parameters;

[0135] The light emitting unit 150 is controlled to emit light according to the light emitting control parameter and the light effect control parameter.

[0136] Optionally, the light emitting unit 150 is a light strip or a light matrix, the light strip includes a plurality of lights, each row or each column of the light matrix includes a plurality of lights, and the light emitting control parameter is generated according to the audio signal, including:

[0137] Based on the audio value within a predetermined time length of the audio signal, a corresponding frequency domain signal is obtained;

[0138] Convert the frequency domain signal to the Bark domain, and obtain a Bark domain subband value in each dimension of the Bark domain;

[0139] According to the Bark domain subband value on each Bark domain dimension, the quantized Bark domain subband value of each lamp in the lamp strip is determined as the light control parameter, or the number of lamps lit in each column of the lamp matrix is ​​determined as the light control parameter.

[0140] Optionally, the lighting effect parameters include at least one of a light emitting unit color, a light emitting unit flashing frequency, and a light emitting unit flashing duty cycle.

[0141] Optionally, the audio playback device further includes: an interaction unit 160, configured to display a lighting effect parameter input page and receive input lighting effect parameters.

[0142] Other aspects and implementation details of the method embodiment have been fully described in the previous device embodiment and will not be repeated here.

[0143] Through the description of the above implementation, it is easy for those skilled in the art to understand that the example implementation described here can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the embodiment of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, including a number of computer executable codes. When the computer executable code is called and executed by the control module 140, it can be implemented as follows: Fig. 9 The method in the embodiment shown.

[0144] According to one embodiment of the present disclosure, a program product for implementing the method in the above method embodiment is also provided, which can adopt a portable compact disk read-only memory (CD-ROM) and include program code, and can be run on an audio playback device. However, the program product of the present invention is not limited to this. In this document, a readable storage medium can be any tangible medium containing or storing a program, which can be used by or in combination with an instruction execution system, an apparatus or a device.

[0145] The program product may use any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0146] Computer readable signal media may include data signals propagated in baseband or as part of a carrier wave, in which readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Readable signal media may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0147] The program code embodied on the readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the foregoing.

[0148] Program code for performing the operations of the present invention may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving a remote computing device, the remote computing device may be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., through the Internet using an Internet service provider).

[0149] It should be noted that, although several modules or units of the device for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present disclosure, the features and functions of two or more modules or units described above can be embodied in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into multiple modules or units to be embodied.

[0150] In addition, although the steps of the method in the present disclosure are described in a specific order in the drawings, this does not require or imply that the steps must be performed in this specific order, or that all the steps shown must be performed to achieve the desired results. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step, and / or one step may be decomposed into multiple steps, etc.

[0151] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any modification, use or adaptation of the present disclosure, which follows the general principles of the present disclosure and includes common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present disclosure are indicated by the appended claims.

Claims

1. An audio playback device, comprising: A wireless communication unit for receiving an audio signal; A decoding unit, used for decoding a received audio signal; A playback module, used to play the decoded audio signal; A control module, used for generating a light control parameter according to the audio signal, wherein the light control parameter includes a quantized Bark domain subband value of each light of the light strip light unit; The light-emitting unit is used to emit light synchronously with the audio signal played by the playing module according to the light-emitting control parameters.

2. The audio playback device according to claim 1, wherein: The control module is further used for: Get lighting effect control parameters; The light-emitting unit is controlled according to the light-emitting control parameter and the light-effect control parameter.

3. The audio playback device according to claim 2, wherein: The light-emitting unit is a light strip or a light matrix, the light strip includes a plurality of lights, each row or each column of the light matrix includes a plurality of lights, and the light-emitting control parameter is generated according to the audio signal, including: Based on the audio value within a predetermined time length of the audio signal, a corresponding frequency domain signal is obtained; Convert the frequency domain signal to the Bark domain, and obtain a Bark domain subband value in each dimension of the Bark domain; According to the Bark domain subband value on each Bark domain dimension, the quantized Bark domain subband value of each lamp in the lamp strip is determined as the light control parameter, or the number of lamps lit in each column of the lamp matrix is ​​determined as the light control parameter.

4. The audio playback device according to claim 2, wherein: The lighting effect control parameter includes at least one of the light emitting unit color, the light emitting unit flashing frequency, and the light emitting unit flashing duty cycle.

5. The audio playback device according to claim 3, further comprising: The interactive unit is used to display the lighting effect control parameter input page and receive the input lighting effect control parameters.

6. The audio playback device according to claim 2, wherein: The control module obtains sound attribute data from the received audio signal, and determines the lighting effect control parameter based on the sound attribute data.

7. The audio playback device according to claim 6, wherein: The sound attribute data includes at least one of rhythm data, genre data, sound emotion data, and pitch data.

8. The audio playback device according to claim 3, wherein: The step of obtaining a corresponding frequency domain signal based on an audio value within a predetermined time period of the audio signal comprises: obtaining a frequency domain signal corresponding to the single audio track data based on an audio value within a predetermined time period of the single audio track data in the audio signal; The converting the frequency domain signal to the Bark domain to obtain a Bark domain subband value in each dimension of the Bark domain includes: converting the frequency domain signal corresponding to the single audio track data to the Bark domain to obtain a Bark domain subband value in each dimension of the Bark domain; The method of determining the quantized Bark domain subband value of each light in the light strip as the light control parameter or the number of lights lit in each column of the light matrix as the light control parameter according to the Bark domain subband value on each Bark domain dimension corresponding to the single audio track data includes: determining the quantized Bark domain subband value of each light in the light strip as the light control parameter or the number of lights lit in each column of the light matrix as the light control parameter according to the Bark domain subband value on each Bark domain dimension corresponding to the single audio track data.

9. The audio playback device according to claim 8, wherein: The light emitting unit includes a plurality of sub-light emitting units corresponding to the audio tracks, The method of determining the quantized Bark domain subband value of each light in the light strip as the light control parameter, or the number of lights lit in each column in the light matrix as the light control parameter, according to the Bark domain subband value on each Bark domain dimension corresponding to the single audio track data, includes: determining the quantized Bark domain subband value of each light in the light strip in the sub-light-emitting unit corresponding to the audio track as the light control parameter, or the number of lights lit in each column in the light matrix as the light control parameter, according to the Bark domain subband value on each Bark domain dimension corresponding to each track of single audio track data.

10. The audio playback device according to claim 1, wherein: The light-emitting unit includes a plurality of light zones, the plurality of light zones are connected to form a predetermined shape, the light zone includes a plurality of lamps, and the light-emitting control parameter is the number of lamps lit in the light zone. The emitting light synchronously with the audio signal played by the playing module according to the light emitting control parameter includes: lighting the lights in each light area according to the number of the lighted lights.

11. The audio playback device according to claim 1, wherein: The audio playback device is associated with an associated device, and the associated device also has a light-emitting unit. The light-emitting unit of the associated device also emits light synchronously with the audio signal played by the playback module according to the light-emitting control parameters.

12. The audio playback device according to claim 5, wherein: The determining, according to the Bark domain subband value on each Bark domain dimension, the quantized Bark domain subband value of each lamp in the lamp strip as the light control parameter, or the number of lamps lit in each column of the lamp matrix as the light control parameter, comprises: When the number of Bark domain dimensions is equal to the number of lights in the light strip or the number of columns in the light matrix, each Bark domain dimension corresponds to a light in the light strip or a column of lights in the light matrix, and the light emission control parameters of the light or the column of lights are determined according to the Bark domain sub-band values ​​on each Bark domain dimension; When the number of Bark domain dimensions is greater than the number of lights in the light strip or the number of columns in the light matrix, a valid Bark domain dimension is selected from the Bark domain dimensions according to the first rule, so that each valid Bark domain dimension corresponds to a light in the light strip or a column of lights in the light matrix, and a light emission control parameter of the light or a column of lights is determined according to the Bark domain sub-band value on each valid Bark domain dimension; When the number of Bark domain dimensions is smaller than the number of lights in the light strip or the number of columns in the light matrix, the valid lights in the light strip or the valid columns in the light matrix are selected according to the second rule, so that each Bark domain dimension corresponds to a valid light in the light strip or a valid column in the light matrix, and the luminous control parameters of the valid light or valid column are determined according to the Bark domain sub-band values ​​on each Bark domain dimension.

13. The audio playback device according to claim 5, wherein: The converting the frequency domain signal into the Bark domain includes: searching a table of correspondence between frequency range and Bark domain dimension, and converting the frequency domain signal into the Bark domain.

14. The audio playback device according to claim 12 or 13, wherein: The interaction unit also receives at least one of the following: First rule; Second rule: The number of Bark domain dimensions to be set; Frequency range and Bark domain dimension correspondence table.

15. The audio playback device according to claim 14, wherein: If the interaction unit receives the set number of Bark domain dimensions, the control module generates a frequency range and Bark domain dimension correspondence table according to a predetermined correspondence generation rule.

16. The audio playback device according to claim 3, wherein: The determining, according to the Bark domain sub-band value on each Bark domain dimension, the quantized Bark domain sub-band value of each lamp in the lamp strip as the light emission control parameter includes: Based on the quantized peak value, the maximum sound intensity value corresponding to the quantized peak value, and each Bark domain sub-band value, the quantized Bark domain sub-band value of each lamp in the lamp strip is determined as the light emission control parameter.

17. The audio playback device according to claim 3, wherein: The determining, according to the Bark domain subband value on each Bark domain dimension, the number of lights lit in each column of the light matrix as the light emission control parameter includes: Based on the number of lights in each column of the light matrix, the maximum sound intensity corresponding to the number of lights in each column, and each Bark domain sub-band value, the number of lights lit in each column of the light matrix is ​​determined as the light control parameter.

18. The audio playback device according to claim 16, wherein: The quantization peak value is updated according to a comparison between the Bark domain subband value and the quantization peak value.

19. The audio playback device according to claim 18, wherein: The quantized peak value is updated by: When the Bark domain subband value is greater than the quantization peak value, updating the quantization peak value with the Bark domain subband value; When the Bark domain subband value is not greater than the quantization peak value, an equalization value between the Bark domain subband value and the quantization peak value is obtained according to an equalization factor as an updated quantization peak value.

20. The audio playback device according to claim 16, wherein: The method of determining the quantized Bark domain sub-band value of each lamp in the lamp strip as the light control parameter based on the quantized peak value, the maximum sound intensity value corresponding to the quantized peak value, and each Bark domain sub-band value, respectively, includes: Based on the quantized peak value, the maximum sound intensity corresponding to the quantized peak value, and each Bark domain sub-band value, respectively determine the quantized Bark domain sub-band value of each light in the light strip; Obtaining rhythm data from the sound attribute data; The quantized Bark domain subband value is smoothed by using a smoothing factor corresponding to the rhythm data, and the smoothed quantized Bark domain subband value is used as the light emission control parameter.

21. An audio playback device array, comprising a control module and a plurality of audio playback devices, wherein: Each audio playback device corresponds to one or more Bark domain dimensions; The control module is used to: obtain a corresponding frequency domain signal based on an audio value within a predetermined time length of the audio signal to be played; convert the frequency domain signal to the Bark domain, and obtain a Bark domain subband value in each dimension of the Bark domain; determine the light control parameters corresponding to each Bark domain dimension according to the Bark domain subband values ​​in each Bark domain dimension; and send the light control parameters of the Bark domain dimension corresponding to the audio playback device and the audio data in the Bark domain dimension in the audio signal to be played to each audio playback device; The audio playback device includes: a wireless communication unit, used to receive the light control parameters of the Bark domain dimension corresponding to the audio playback device and the audio data in the Bark domain dimension in the audio signal to be played; a decoding unit, used to decode the received audio data; a playback module, used to play the decoded audio data; and a light-emitting unit, used to emit light synchronously with the audio signal played by the playback module according to the light control parameters.

22. A light emission control method for an audio playback device, comprising: Get audio signal; generating a light-emitting control parameter according to the audio signal; According to the light control parameter, the light unit of the audio playback device is made to emit light in synchronization with the played audio signal, wherein the light control parameter includes a quantized Bark domain subband value of each light of the light strip light unit.

23. The method according to claim 22, wherein: The step of causing the light emitting unit of the audio playback device to emit light in synchronization with the played audio signal according to the light emitting control parameter comprises: Get lighting effect control parameters; The light-emitting unit is controlled to emit light according to the light-emitting control parameter and the light-effect control parameter.

24. The method according to claim 23, wherein: The light-emitting unit is a light strip or a light matrix, the light strip includes a plurality of lights, each row or each column of the light matrix includes a plurality of lights, and the light-emitting control parameter is generated according to the audio signal, including: Based on the audio value within a predetermined time length of the audio signal, a corresponding frequency domain signal is obtained; Convert the frequency domain signal to the Bark domain, and obtain a Bark domain subband value in each dimension of the Bark domain; According to the Bark domain subband value on each Bark domain dimension, the quantized Bark domain subband value of each lamp in the lamp strip is determined as the light control parameter, or the number of lamps lit in each column of the lamp matrix is ​​determined as the light control parameter.

25. The method according to claim 23, wherein: The lighting effect control parameter includes at least one of the light emitting unit color, the light emitting unit flashing frequency, and the light emitting unit flashing duty cycle.

26. The method according to claim 23, wherein the audio playback device further comprises an interaction unit for displaying a lighting effect control parameter input page and receiving input lighting effect control parameters.

27. A computer-readable medium storing computer-executable codes, wherein the computer-executable codes are executed by a processor to implement the method according to any one of claims 22-26.

Images