Light emission control method and related device

By analyzing the energy variation amplitude of audio segments to determine the rhythm points, the lighting effect of the lighting equipment is controlled, solving the problem that the lighting equipment cannot be synchronized with the audio and achieving rich lighting performance.

CN116189638BActive Publication Date: 2026-01-30SHENZHEN INTELLIROCKS TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202111421691.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-11-26
Publication Date
2026-01-30
Estimated Expiration
2041-11-26

AI Technical Summary

Technical Problem

In existing technologies, lighting devices cannot be effectively controlled in conjunction with audio data, thus failing to meet users' needs for diverse lighting atmospheres and audio synchronization.

Method used

By acquiring the audio energy change amplitude of the target audio segment and the audio energy change amplitude of the reference audio segment, it is determined whether there is a rhythm point in the audio segment, and the light emission effect of the light emission device is controlled according to the rhythm point.

Benefits of technology

It achieves synchronized switching between light-emitting devices and audio rhythm, enhancing the user experience and presenting rich lighting effects.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116189638B_ABST
    Figure CN116189638B_ABST
Patent Text Reader

Abstract

This application relates to the field of smart home technology, specifically disclosing a light-emitting control method and related equipment. The method includes: acquiring a target audio segment; determining a first audio energy change amplitude of the target audio segment relative to the reference audio segment based on the audio energy of the target audio segment and the audio energy of a reference audio segment, wherein the reference audio segment includes at least one historical audio segment preceding the target audio segment; determining a second audio energy change amplitude within the target audio segment along the direction of increasing sampling time based on the audio energy of at least two audio sub-segments in the target audio segment; determining whether the target audio segment has a rhythm point based on the first audio energy change amplitude and the second audio energy change amplitude; if it is determined that the target audio segment has a rhythm point, then controlling a light-emitting device to emit light based on the target audio segment; this solution realizes the control of a light-emitting device by combining audio.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of smart home, more particularly, to a light emitting control method and related device. BACKGROUND

[0002] Light emitting devices such as lamp posts, lamp strips, etc. are widely used to create a light atmosphere or present a variety of equivalent scenes. With the development of smart home technology, users have higher requirements for light emitting devices, and users expect to control light emitting devices in combination with audio data.

[0003] Therefore, how to control light emitting devices in combination with audio data is a technical problem to be solved in the prior art. SUMMARY

[0004] In view of the above problems, the embodiments of the present application propose a light emitting control method and related device to improve the above problems.

[0005] According to an aspect of the embodiments of the present application, a light emitting control method is provided, comprising: obtaining a target audio segment; determining a first audio energy variation amplitude of the target audio segment relative to a reference audio segment according to an audio energy of the target audio segment and an audio energy of the reference audio segment, the reference audio segment comprising at least one historical audio segment before the target audio segment; determining a second audio energy variation amplitude in an increasing direction of a sampling time within the target audio segment according to audio energies of at least two audio sub-segments in the target audio segment; determining whether the target audio segment has a rhythm point according to the first audio energy variation amplitude and the second audio energy variation amplitude; and controlling a light emitting device to emit light according to the target audio segment if it is determined that the target audio segment has a rhythm point.

[0006] According to an aspect of the embodiments of the present application, a light emitting device is provided, comprising a controller and a light emitting module, the light emitting module being electrically connected with the controller, and the controller being configured to control the light emitting module to emit light according to the method as described above.

[0007] According to an aspect of some embodiments of the present application, a light emitting control apparatus is provided, comprising: an obtaining module configured to obtain a target audio segment; a first audio energy variation amplitude determination module configured to determine a first audio energy variation amplitude of the target audio segment relative to a reference audio segment according to an audio energy of the target audio segment and an audio energy of the reference audio segment, the reference audio segment comprising at least one historical audio segment corresponding to the target audio segment; a second audio energy variation amplitude determination module configured to determine a second audio energy variation amplitude in a direction of increasing sampling time within the target audio segment according to audio energies of at least two audio sub-segments in the target audio segment; a beat point determination module configured to determine whether the target audio segment is a beat point according to the first audio energy variation amplitude and the second audio energy variation amplitude; and a control module configured to control a light emitting device to emit light according to the target audio segment if it is determined that the target audio segment is a beat point.

[0008] In some embodiments, the beat point determination module comprises a beat point determination unit configured to determine that the target audio segment has a beat point if it is determined that the first audio energy variation amplitude indicates an audio energy increase amplitude that is not less than a first threshold value and the second audio energy variation amplitude indicates an audio energy decrease amplitude that is not less than a second threshold value.

[0009] In some embodiments, the reference audio segment comprises a first historical audio segment and a second historical audio segment, the first historical audio segment being a previous audio segment of the target audio segment, and the second historical audio segment being a previous audio segment of the first historical audio segment. In this embodiment, the first audio energy variation amplitude determination module comprises: a first energy difference calculation unit configured to calculate a first energy difference between the audio energy of the target audio segment and the audio energy of the first historical audio segment; a second energy difference calculation unit configured to calculate a second energy difference between the audio energy of the first historical audio segment and the audio energy of the second historical audio segment; and a first trend determination unit configured to determine the first audio energy variation amplitude according to the first energy difference and the second energy difference.

[0010] In some embodiments, the at least two audio sub-segments include a first audio sub-segment, a second audio sub-segment and a third audio sub-segment sampled in a first-to-second order; in this embodiment, the second audio energy variation amplitude determination module includes: a third energy difference calculation unit configured to calculate a third energy difference between the audio energy of the second audio sub-segment and the audio energy of the first audio sub-segment; a fourth energy difference calculation unit configured to calculate a fourth energy difference between the audio energy of the third audio sub-segment and the audio energy of the first audio sub-segment; and a second audio energy variation amplitude determination unit configured to determine the second audio energy variation amplitude in the target audio segment in the increasing direction of the sampling time according to the third energy difference and the fourth energy difference.

[0011] In some embodiments, the light emission control apparatus further includes: a judgment module configured to judge whether the audio energy increase amplitude indicated by the first audio energy variation amplitude is not less than a first threshold value; and a target audio segment determination module configured to, if the audio energy increase amplitude indicated by the first audio energy variation amplitude is less than the first threshold value, determine a next sampled audio segment as the target audio segment; and if the audio energy increase amplitude indicated by the first audio energy variation amplitude is not less than the first threshold value, proceed to the second audio energy variation amplitude determination module.

[0012] In some embodiments, the control module includes: an audio energy acquisition module configured to acquire the audio energy of the target audio segment; a light effect control signal determination module configured to determine a light effect control signal corresponding to the audio energy of the target audio segment; and a light emission control module configured to control the light emitting device to emit light according to the light effect control signal corresponding to the audio energy of the target audio segment.

[0013] In some embodiments, the light effect control signal includes at least one of a brightness control signal, a light emitting color control signal and a light emitting quantity control signal.

[0014] In some embodiments, the light emission control apparatus further includes: a music recognition module configured to perform music recognition on the target audio segment to obtain a music recognition result; and if the music recognition result indicates that the target audio segment is music data, proceed to the first audio energy variation amplitude determination module.

[0015] According to an aspect of an embodiment of the present application, an electronic device is provided, including: a processor; a memory having computer readable instructions stored thereon, the computer readable instructions being executed by the processor to implement the light emission control method as described above.

[0016] According to an aspect of the embodiments of the present application, a computer readable storage medium is provided, and the computer readable storage medium has stored thereon computer readable instructions which, when executed by a processor, implement the light emitting control method as described above.

[0017] In the scheme of the present application, the historical audio segment corresponding to the target audio segment is taken as the reference audio segment, the first audio energy variation amplitude presented by the target audio segment relative to the reference audio segment is determined according to the audio energy of the target audio segment and the audio energy of the reference audio segment, and the second audio energy variation amplitude presented in the target audio segment is determined in combination with at least two audio sub-segments in the target audio segment. Then, whether the target audio segment has a rhythm point is determined according to the first audio energy variation amplitude and the second audio energy variation amplitude, and in the case that the target audio segment is determined as a rhythm point, the light emitting device is controlled to emit light according to the target audio segment, which can realize the light emitting device to switch light emission along with the rhythm point in the audio, presenting rich light effects, and effectively realizing the control of the light emitting device in combination with the audio.

[0018] In the scheme, since the second audio energy variation amplitude can approximately reflect the audio energy variation trend presented after the target audio segment, in combination with the first audio energy variation amplitude and the second audio energy variation amplitude, whether the target audio segment is an audio energy maximum value in the audio can be determined, for example, if the first audio energy variation amplitude is an audio energy increase amplitude and the second audio energy variation amplitude is an audio energy decrease amplitude, it can be determined that the target audio segment is an audio energy maximum value in the audio, and then the target audio segment can be determined to have a rhythm point. Then, the light emitting device is controlled to emit light according to the corresponding control, which can realize the light emitting device to switch light emission along with the position of the audio energy maximum value in the audio. Since the user is more sensitive to the position of the audio energy maximum value in the audio in hearing, the light emitting device switching light emission along with the position of the audio energy maximum value in the audio can improve the user experience. BRIEF DESCRIPTION OF DRAWINGS

[0019] The accompanying drawings, which are incorporated herein and constitute part of the specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor on the basis of these drawings.

[0020] Figure 1 is a flowchart of a light emitting control method according to an embodiment of the present application.

[0021] Figure 2 is a flowchart of step 120 according to an embodiment of the present application.

[0022] Figure 3 is a flowchart of step 130 according to an embodiment of the present application.

[0023] Figure 4 is a flowchart of a light emitting control method according to another embodiment of the present application.

[0024] Figure 5 is a block diagram of a light emitting apparatus according to an embodiment of the present application.

[0025] Figure 6 is a block diagram of a light emitting control device according to an embodiment.

[0026] Figure 7 is a block diagram of an electronic apparatus according to an embodiment of the present application. DETAILED DESCRIPTION

[0027] Example implementations will now be described more fully with reference to the accompanying drawings. Example implementations may, however, be implemented in many different forms and should not be construed as limited to the examples set forth herein; rather, these implementations are provided so that this disclosure will be thorough and complete, and will fully convey the scope of example implementations to those skilled in the art.

[0028] Moreover, the described features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a thorough understanding of embodiments of the application. One skilled in the relevant art will recognize, however, that the

[0029] The block diagrams in the drawings show only the functionality of the embodiments and do not imply any particular physical or architectural arrangement of the devices, systems, or methods. No inference should be drawn regarding the implementational aspects of the embodiments as shown and described herein. Further, having described a few embodiments, modifications, alternatives, and variations of the embodiments can be apparent to others skilled in the art.

[0030] The flow diagrams depicted herein are examples of sequences of operations that can be performed, for example, by a processor. The depicted examples are not meant to be limiting, as one of skill in the art could readily devise many other variations of the examples shown without departing from the scope of the present disclosure. For example, one or more of the operations shown and described can be eliminated, some operations can be combined, and the order of certain operations can be changed.

[0031] It should be noted that the "multiple" referred to in this paper refers to two or more than two. The association relationship of the associated object is described as "and / or", which means that there can be three relationships, for example, A and / or B can represent three cases: A exists alone, A and B exist together, and B exists alone. The character " / " generally represents an "or" relationship between the associated objects before and after it.

[0032] The implementation details of the technical solutions of the embodiments of the present application are described in detail as follows:

[0033] Figure 1 is a flow chart of a light emitting control method according to an embodiment of the present application, which can be executed by an electronic device with processing capability, which can be a light emitting device provided with a light emitting module. The light emitting device can be provided with one or more light emitting modules, such as LED lamps, RGBIC type lamp beads, incandescent lamps, etc., which are not specifically limited here. The light emitting device can be an ambient lighting device, a lamp post, a lamp strip, an LED lamp panel, etc. In some embodiments, the electronic device can also be a device in communication connection with the light emitting device, for example, in a smart home system, the electronic device can be a gateway in communication connection with the light emitting device, etc. Of course, the electronic device can also be other devices with edge computing capability in the smart home system, which are not specifically limited here. Referring to Figure 1 The method at least includes steps 110-150, which are described in detail as follows:

[0034] Step 110, obtaining a target audio segment.

[0035] In some embodiments, the audio data is sampled at a set sampling frequency, and one audio frame is obtained by one sampling. A first set number of audio frames obtained by sequential sampling can be regarded as an audio segment, and the first set number can be set according to actual needs, for example, the first set number can be 256, 512, etc.

[0036] The target audio segment refers to an audio segment to be determined whether to include a rhythm point, and the target audio segment includes a plurality of audio frames. In specific embodiments, the target audio segment can be the audio segment obtained by the current sampling.

[0037] Step 120, determining a first audio energy change amplitude of the target audio segment relative to a reference audio segment according to an audio energy of the target audio segment and an audio energy of the reference audio segment, the reference audio segment including at least one historical audio segment before the target audio segment.

[0038] The reference audio segment can be one or more, that is, one historical audio segment corresponding to the target audio segment can be selected as the reference audio segment, or two or more historical audio segments corresponding to the target audio segment can be selected as the reference audio segment. The historical audio segment corresponding to the target audio segment refers to an audio segment with a sampling time earlier than the target audio segment.

[0039] In other words, the reference audio segment can be one or more audio segments with a sampling time earlier than the target audio segment and a sampling time distance from the target audio segment within a set time range. It can be understood that the audio segments are sorted in the order of sampling time from early to late, and the reference audio segment can be a historical audio segment directly adjacent to the target audio segment or a historical audio segment not directly adjacent to the target audio segment.

[0040] It can be understood that the closer the sampling time of the reference audio segment to the target audio segment, the more accurate the first audio energy change amplitude determined reflects the audio energy change amplitude of the target audio segment relative to the adjacent previous audio segment. Therefore, in some embodiments, in order to ensure the accuracy of the determined first audio energy change amplitude, the second set number of audio segments with a sampling time earlier than the target audio segment and a closest sampling time distance from the target audio segment can be used as the reference audio segment, and the second set number can be set according to actual needs, which is not specifically limited here.

[0041] For example, if audio segment I, audio segment II, audio segment III, and audio segment IV are sequentially sampled from early to late, and audio segment IV is assumed to be the target audio segment, if the reference audio segment is one, audio segment III can be used as the reference audio segment; if the reference audio segment is two, audio segment III and audio segment II can be used as the reference audio segment.

[0042] In some embodiments, the audio energy can be reflected by the short-time energy mean, and therefore, in step 120, the difference between the short-time energy mean of the target audio segment and the short-time energy mean of the reference audio segment can be calculated, and then the first audio energy change amplitude is determined based on the obtained difference.

[0043] In specific embodiments, the target audio segment can be subjected to short-time Fourier transform (STFT), and then the short-time energy mean of the target audio segment is determined.

[0044] The audio energy variation amplitude indicated by the first audio energy variation amplitude can be an audio energy increase amplitude or an audio energy decrease amplitude. The audio energy variation amplitude can be an absolute audio energy variation amplitude or a relative audio energy variation amplitude.

[0045] In some embodiments, the reference audio segment can be one, for example, the reference audio segment is the first historical audio segment, where the first historical audio segment is the last audio segment of the target audio segment. In this embodiment, step 120 can include: calculating a first energy difference between the audio energy of the target audio segment and the audio energy of the first historical audio segment; determining the first audio energy variation amplitude according to the first energy difference. Specifically, when the first energy difference is positive, the first audio energy variation amplitude is determined to be an audio energy increase amplitude, and the value of the audio energy increase amplitude is the first audio energy difference; otherwise, when the first energy difference is negative, the first audio energy variation amplitude is determined to be an audio energy decrease amplitude, and the value of the audio energy decrease amplitude is the absolute value of the first audio energy difference.

[0046] In some embodiments, since the absolute value of the first energy difference represents an absolute energy variation amplitude, the first energy difference can be further divided by a reference audio energy to obtain a relative energy variation amplitude of the target audio segment relative to the first historical audio segment, and then the first audio energy variation amplitude is determined. The reference audio energy can be the audio energy of the first historical audio segment, which is not limited here. Then, the first audio energy variation amplitude is determined based on the relative audio energy variation amplitude and the audio energy variation direction reflected by the sign of the first audio energy difference.

[0047] In some embodiments, the reference audio segment includes a first historical audio segment and a second historical audio segment, the first historical audio segment refers to the last audio segment of the target audio segment; the second historical audio segment refers to the last audio segment of the first historical audio segment; in this embodiment, as shown in Figure 2 Step 120 includes:

[0048] Step 210, calculating a first energy difference between the audio energy of the target audio segment and the audio energy of the first historical audio segment.

[0049] Step 220, calculating a second energy difference between the audio energy of the first historical audio segment and the audio energy of the second historical audio segment.

[0050] In specific embodiments, if the short-time energy average is used as the audio energy of the corresponding audio segment, i.e., the audio energy of the target audio segment comprises the short-time energy average of the target audio segment, the audio energy of the first historical audio segment comprises the short-time energy average of the first historical audio segment, then step 210 comprises: calculating the difference between the short-time energy average of the target audio segment and the short-time energy average of the first historical audio segment to obtain the first energy difference. Similarly, the short-time energy average of the first historical audio segment can be subtracted from the short-time energy average of the second historical audio segment to obtain the second energy difference.

[0051] Step 230 comprises: determining the first audio energy variation amplitude according to the first energy difference and the second energy difference.

[0052] When the first energy difference and the second energy difference are both positive numbers, it indicates that the audio energy variation trend from the second historical audio segment to the target audio segment is an increasing trend; if the first energy difference and the second energy difference are both negative numbers, it indicates that the audio energy variation trend from the second historical audio segment to the target audio segment is a decreasing trend; if the first energy difference is positive and the second energy difference is negative, it indicates that the audio energy variation trend from the second historical audio segment to the target audio segment is a trend of first increasing and then decreasing; if the first energy difference is negative and the second energy difference is positive, it indicates that the audio energy variation trend from the second historical audio segment to the target audio segment is a trend of first decreasing and then increasing.

[0053] In some embodiments, when the first energy difference and the second energy difference are both positive numbers, the first audio energy variation amplitude can be determined as an audio energy increase amplitude, and correspondingly, the first energy difference and / or the second energy difference can be determined as the value of the audio energy increase amplitude, for example, the smaller one of the first energy difference and the second energy difference can be determined as the value of the audio energy increase amplitude; in other embodiments, the average of the first energy difference and the second energy difference can also be determined as the value of the audio energy increase amplitude. In this embodiment, the first audio energy variation amplitude is determined in combination with the two audio segments (i.e., the first historical audio segment and the second historical audio segment) before the target audio segment, which can ensure the accuracy of the determined first audio energy variation amplitude while reducing the calculation amount.

[0054] Please continue to refer to Figure 1 Step 130 comprises: determining a second audio energy variation amplitude presented in the target audio segment according to the audio energies of at least two audio sub-segments in the target audio segment.

[0055] As described above, the target audio segment includes a plurality of audio frames, and the plurality of audio frames in the target audio segment can be grouped on the basis that the plurality of audio frames in the target audio segment are sorted from early to late according to sampling time, and the plurality of audio frames adjacent to each other in a group are taken as an audio sub-segment.

[0056] In order to determine the second audio energy variation amplitude in the target audio segment in the direction of increasing sampling time, at least two audio sub-segments in the target audio segment are required to determine the audio energy, and therefore, the audio frames in the target audio segment can be sequentially divided into at least two groups. Assuming that the target audio segment is divided into k1(k1≥2, k1 is a positive integer) groups, k1 audio sub-segments are obtained, and k2(0≤k2≤k1) audio sub-segments can be selected from them to determine the second audio energy variation amplitude. It can be understood that the more the number of audio sub-segments selected to determine the second audio energy variation amplitude, the more accurate the determined second audio energy variation amplitude, and of course, the calculation amount also increases.

[0057] In some embodiments, k2 audio sub-segments can be randomly selected from them to determine the second audio energy variation amplitude; in some embodiments, k2 audio sub-segments adjacent to each other in sampling time can be selected from them to determine the second audio energy variation amplitude; in some embodiments, on the basis of sorting k1 audio sub-segments according to sampling time, the first k2 audio sub-segments in the sorting can be selected to determine the second audio energy variation amplitude, or the last k2 audio sub-segments in the sorting can be selected to determine the second audio energy variation amplitude, or the k2 audio sub-segments in the middle of the sorting can be selected to determine the second audio energy variation amplitude, and the specific determination can be determined according to actual needs.

[0058] In some embodiments, two audio sub-segments in the target audio segment can be selected to determine the second audio energy variation amplitude. If the at least two audio sub-segments include a first audio sub-segment and a second audio sub-segment sampled from early to late, in this embodiment, step 130 includes: calculating a third energy difference value between the audio energy of the second audio sub-segment and the audio energy of the first audio sub-segment; and determining the second audio energy variation amplitude in the target audio segment in the direction of increasing sampling time according to the third energy difference value.

[0059] In some embodiments, the third energy difference value can be obtained by subtracting the short-term energy mean value of the first audio sub-segment from the short-term energy mean value of the second audio sub-segment.

[0060] Since the first audio sub-fragment and the second audio sub-fragment are derived from the target audio fragment and have a sequential relationship in the sampling time, the probability that the audio energy change trend presented in the target audio fragment is the same as the audio energy change trend from the first audio sub-fragment to the second audio sub-fragment is relatively high, and thus the audio energy change amplitude from the first audio sub-fragment to the second audio sub-fragment can be determined as the second audio energy change amplitude

[0061] On this basis, if the third energy difference value is positive, it can be determined that the second audio energy change amplitude is an audio energy increase amplitude, and correspondingly, the value of the audio energy increase amplitude can be the third energy difference value; if the third energy difference value is negative, it can be determined that the second audio energy change amplitude is an audio energy decrease amplitude, and correspondingly, the value of the audio energy decrease amplitude can be the absolute value of the third energy difference value.

[0062] In some embodiments, the at least two audio sub-fragments include a first audio sub-fragment, a second audio sub-fragment and a third audio sub-fragment sampled from front to back; in this embodiment, as shown in Figure 3 The step 130 includes:

[0063] The step 310 calculates a third energy difference value between the audio energy of the second audio sub-fragment and the audio energy of the first audio sub-fragment.

[0064] The step 320 calculates a fourth energy difference value between the audio energy of the third audio sub-fragment and the audio energy of the second audio sub-fragment.

[0065] The step 330 determines a second audio energy change amplitude presented in the target audio fragment according to the third energy difference value and the fourth energy difference value.

[0066] The audio energy of an audio sub-fragment (such as the first audio sub-fragment, the second audio sub-fragment, the third audio sub-fragment) can also be the short-time energy mean value of the audio sub-fragment.

[0067] Similarly, since the trend of the audio energy from the first audio sub-segment to the second audio sub-segment to the third audio sub-segment in the direction of the increase of the collection time is more likely to be the same as the trend of the audio energy in the target audio segment in the direction of the increase of the collection time, the trend of the audio energy presented by the first audio sub-segment to the second audio sub-segment to the third audio sub-segment can be determined as the trend of the audio energy presented in the target audio segment in the direction of the increase of the sampling time. Specifically, when the third energy difference and the fourth energy difference are both positive numbers, it can be determined that the first audio energy change trend is an audio energy increase trend; if the third energy difference and the fourth energy difference are both negative numbers, it is determined that the second audio energy change trend is an audio energy decrease trend; if the third energy difference is positive and the fourth energy difference is negative, it is determined that the second audio energy change trend is a change trend of first increasing and then decreasing; if the third energy difference is negative and the fourth energy difference is positive, it is determined that the second audio energy change trend is a change trend of first decreasing and then increasing.

[0068] In some embodiments, when the third energy difference and the fourth energy difference are both negative numbers, it can be determined that the second audio energy change amplitude is an audio energy decrease amplitude, and correspondingly, the absolute value of the third energy difference and / or the absolute value of the fourth energy difference can be determined as the value of the audio energy decrease amplitude, for example, the smaller one of the absolute value of the third energy difference and the absolute value of the fourth energy difference is determined as the value of the audio energy decrease amplitude; in other embodiments, the average value of the absolute value of the third energy difference and the absolute value of the fourth energy difference can also be determined as the value of the audio energy decrease amplitude. Please refer to Figure 1 , step 140, determining whether the target audio segment has a rhythm point according to the first audio energy change amplitude and the second audio energy change amplitude.

[0069] The rhythm point in the audio can be the position of the maximum audio energy in the audio. In the present scheme, the second audio energy change amplitude can approximately reflect the trend of the audio energy presented after the target audio segment, therefore, when the audio energy change amplitude indicated by the first audio energy change amplitude is an audio energy increase amplitude, and the audio energy change amplitude indicated by the second audio energy change amplitude is an audio energy decrease amplitude, it indicates that the trend of the audio energy presented before the target audio segment is an audio energy increase trend, and the trend of the audio energy presented in the target audio segment in the direction of the increase of the sampling time is an audio energy decrease trend, correspondingly, the trend of the audio energy presented after the target audio segment is more likely to be an audio energy decrease trend, and then it can be indicated that the target audio segment is a maximum audio energy in the audio.

[0070] Therefore, in an embodiment, if it is determined that the first audio energy variation amplitude is an audio energy increase amplitude and the second audio energy variation amplitude is an audio energy decrease amplitude, it is determined that the target audio segment has a beat point. Conversely, if the first audio energy variation amplitude is not an audio energy increase amplitude and / or the second audio energy variation amplitude is not an audio energy decrease amplitude, it is determined that the target audio segment does not have a beat point.

[0071] In some embodiments, since the user's feeling of the position of the sudden increase of the audio energy in the audio is relatively strong, the process can also be used to determine whether the target audio segment has a beat point as follows: if the audio energy increase amplitude indicated by the first audio energy variation amplitude is not less than a first threshold value and the audio energy decrease amplitude indicated by the second audio energy variation amplitude is not less than a second threshold value, it is determined that the target audio segment has a beat point; conversely, if the audio energy increase amplitude indicated by the first audio energy variation amplitude is less than the first threshold value and / or the audio energy decrease amplitude indicated by the second audio energy variation amplitude is less than the second threshold value, it is determined that the target audio segment does not have a beat point. The first threshold value and the second threshold value are both greater than or equal to zero, and the first threshold value and the second threshold value can be equal or not equal, which can be set according to the actual needs.

[0072] It can be understood that when the first threshold value and the second threshold value are both zero, it is equivalent to determining that the target audio segment has a beat point when it is determined that the first audio energy variation amplitude is an audio energy increase amplitude and it is determined that the second audio energy variation amplitude is an audio energy decrease amplitude.

[0073] In some embodiments, if the reference audio segment includes the first historical audio segment, the first energy difference value can be determined as the first audio energy variation amplitude, and the third energy difference value can be determined as the second audio energy variation amplitude, and if the first energy difference value is not less than the first threshold value, the third energy difference value is less than zero, and the absolute value of the third energy difference value is not less than the second threshold value, it can be determined that the target audio segment has a beat point.

[0074] In some embodiments, if the reference audio segment includes the first historical audio segment and the second historical audio segment, the first energy difference value and the second energy difference value can be determined as the first audio energy variation amplitude, and the third energy difference value and the fourth energy difference value can be determined as the second audio energy variation amplitude, and if the first energy difference value and the second energy difference value are both not less than the first threshold value, the third energy difference value and the fourth energy difference value are both less than zero, and the absolute value of the third energy difference value and the absolute value of the fourth energy difference value are both not less than the second threshold value, it is determined that the target audio segment has a beat point.

[0075] In step 150, if it is determined that the target audio segment is a beat point, the light emitting device is controlled to emit light according to the target audio segment.

[0076] In some embodiments, at least one of the brightness, the number of lighted lamps, the lighted lamp area, and the lighted lamp color at the beat time can be set, so that the light emitting device is controlled to emit light according to at least one of the brightness, the number of lighted lamps, the lighted lamp area, and the lighted lamp color at the beat time after it is determined that the target audio segment has the beat.

[0077] In some embodiments, a light effect scene at the beat time can also be set, which can be a dynamic light effect scene or a static light effect scene, for example, a set picture is presented, and of course, the light effect scene is realized by comprehensive control of the lighted lamp color, the brightness, the lighted lamp area, and the number of lighted lamps of the plurality of light emitting units. On this basis, the light emitting device is controlled to emit light according to the equivalent control signal corresponding to the set light effect scene after it is determined that the target audio segment has the beat.

[0078] In some embodiments, step 150 includes: obtaining the audio energy of the target audio segment; determining the light effect control signal corresponding to the audio energy of the target audio segment; and controlling the light emitting device to emit light according to the light effect control signal corresponding to the audio energy of the target audio segment. In this embodiment, a mapping relationship between the audio energy (for example, the short-time energy mean value) and the light effect control signal can be set in advance, so that the equivalent control signal corresponding to the audio energy of the target audio segment can be determined after the audio energy of the target audio segment is determined.

[0079] In some embodiments, the light effect control signal includes at least one of a brightness control signal, a lighted lamp color control signal, a lighted lamp number control signal, a lighted lamp flashing frequency signal, and a lighted lamp area control signal. The brightness control signal indicates the brightness of light emission, the lighted lamp color control signal indicates the light emission color, the lighted lamp number control signal indicates the number of lighted lamps, which can also be understood as indicating the number of light emitting modules that need to emit light, and the lighted lamp flashing frequency signal is used to indicate the flashing frequency of the lighted lamps; the lighted lamp area control signal can be used to indicate the area that needs to be lighted.

[0080] In some embodiments, when the light emitting device is a light strip, a mapping relationship between the audio energy and the lighted lamp number control signal can be set, so that if it is determined that the target audio segment has the beat, the number of lighted lamps is also correspondingly different if the audio energy of the target audio segment is different, for example, the audio energy and the number of lighted lamps are positively correlated.

[0081] In some embodiments, if the light emitting device is a lamp post, the mapping relationship between the audio energy and the lighted number control signal can be set. Specifically, since the light emitting units arranged on the lamp post are arranged in the vertical direction, it can be understood that the higher the specified height on the lamp post, the more the number of light emitting units included in the area below the specified height on the lamp post. Therefore, in this case, the lighted number control signal can be used to indicate the lighted height on the lamp post. If the lighted height indicated by the lighted number control signal is H, the light emitting units on the lamp post with a height less than or equal to H are controlled to be lighted.

[0082] In some embodiments, if the light emitting device is a lamp panel, such as an LED lamp panel, the mapping relationship between the audio energy and the lighted area control signal can be set. Therefore, if it is determined that the target audio segment has a rhythm point, if the audio energy of the target audio segment is different, the size of the lighted area is also correspondingly different. For example, the audio energy and the size of the lighted area are positively correlated. It can be understood that if the light emitting units on the light emitting device are uniformly arranged, the larger the size of the lighted area, the larger the number of light emitting units. When the lighted areas indicated by different lighted area control signals are determined based on the same reference point (for example, the center of a circle), the lighted area control signal can be replaced by the lighted number control signal at this time.

[0083] In some embodiments, the corresponding relationship between the audio energy and the lamp effect control signal can be set in advance. Specifically, the corresponding relationship between the audio energy range and the equivalent control signal can be set. For example, if the lamp effect control signal is a brightness control signal, the corresponding relationship between the audio energy range (assuming the short-term energy mean range) and the brightness value can be set as shown in Table 1:

[0084] Table 1

[0085] Short-term energy mean range Luminance value (W1, W2] K1 (W2, W3] K2 ....... ...... (Wn-1, Wn] Kn-1

[0086] Based on the corresponding relationship between the short-term energy mean range and the brightness value shown in Table 1, if it is determined that the target audio segment has a rhythm point and the short-term energy mean of the target audio segment is in the range of (W2, W3], it is determined that the brightness control signal corresponding to the audio energy of the target audio segment is the control signal indicating the brightness value K2.

[0087] Similarly, a corresponding relationship between the audio energy and the lighting color, or a corresponding relationship between the audio energy and the number of lights, or a corresponding relationship between the audio energy and the light effect scene can also be set, so that after determining that the target audio segment is a rhythm point, the lighting device is further controlled correspondingly. It can be understood that the light effect scene can be defined in combination with one or more of the lighting on / off of the lighting module, the brightness of the lighting module, and the lighting color of the lighting module, so that the control signal corresponding to the presentation of a light effect scene can be set in advance, and then after determining the equivalent scene corresponding to the audio energy of the target audio segment, the control signal associated with the equivalent scene is obtained as the corresponding equivalent control signal.

[0088] In some embodiments, the specified lighting time at which the lighting device is to be controlled to emit light when it is determined that the target audio segment has a rhythm point can also be set, so that after the lighting time reaches the specified lighting time, the lighting device is controlled to turn off or return to the previous lighting state.

[0089] In the scheme of the present application, the historical audio segment corresponding to the target audio segment is taken as the reference audio segment, the first audio energy variation amplitude of the target audio segment relative to the reference audio segment is determined according to the audio energy of the target audio segment and the audio energy of the reference audio segment, and the second audio energy variation amplitude in the direction of increasing sampling time within the target audio segment is determined in combination with at least two audio sub-segments within the target audio segment. Then, whether the target audio segment is a rhythm point is determined according to the first audio energy variation amplitude and the second audio energy variation amplitude, and the lighting device is controlled to emit light according to the light effect control signal corresponding to the audio energy of the target audio segment when it is determined that the target audio segment is a rhythm point, so that the lighting device can be switched to emit light along the rhythm point in the audio, and a rich light effect can be presented. The lighting device can be effectively controlled in combination with the audio.

[0090] In the scheme, since the second audio energy variation amplitude can approximately reflect the audio energy variation trend presented after the target audio segment, the first audio energy variation amplitude and the second audio energy variation amplitude can be combined to determine whether the target audio segment is an audio energy maximum value in the audio. For example, if the first audio energy variation amplitude is an audio energy increase amplitude and the second audio energy variation amplitude is an audio energy decrease amplitude, it can be determined that the target audio segment is an audio energy maximum value in the audio, and then it can be determined that the target audio segment has a rhythm point. The lighting device can be switched to emit light along the audio energy maximum value position in the audio according to the corresponding control of the lighting device. Since users are more sensitive to the audio energy maximum value position in the audio in terms of hearing, the lighting device can be switched to emit light along the audio energy maximum value position in the audio, which can improve the user experience.

[0091] In the present solution, the second audio energy change amplitude is used to reflect the audio energy change trend after the target audio segment, and thus the present solution can be applied to a scenario where data for determining the audio energy change trend in the future is lacking, for example, if the target audio segment is sampled from currently playing audio. Since the part of the audio that has not been played cannot be sampled temporarily, data for determining the audio energy change trend in the future is lacking. In this case, the second audio energy change amplitude can be used to reflect the audio energy change trend after the target audio segment according to the solution of the present application, and then the first audio energy change amplitude and the second audio energy change amplitude are combined to determine whether the target audio segment has a rhythm point.

[0092] In some embodiments, if it is determined that the target audio segment does not have a rhythm point, the current light-emitting state of each light-emitting module in the light-emitting device can be maintained unchanged.

[0093] Figure 4 is a flowchart of a light-emitting control method according to another embodiment of the present application, as shown in Figure 4 compared with Figure 1 In the present embodiment, before step 130, the method further includes:

[0094] Step 121: determining whether the audio energy increase amplitude indicated by the first audio energy change amplitude is not less than a first threshold value.

[0095] If the audio energy increase amplitude indicated by the first audio energy change amplitude is not less than the first threshold value, step 130 is performed. Then, step 140 includes step 141: determining whether the audio energy decrease amplitude indicated by the second audio energy change amplitude is not less than a second threshold value. If it is determined that the audio energy decrease amplitude indicated by the second audio energy change amplitude is not less than the second threshold value, it is determined that the target audio segment has a rhythm point, and then step 150 is performed. If it is determined that the audio energy decrease amplitude indicated by the second audio energy change amplitude is less than the second threshold value, the next sampled audio segment is taken as the target audio segment, and then the method returns to step 110.

[0096] If it is determined that the audio energy increase amplitude indicated by the first audio energy change amplitude is less than the first threshold value, step 160 is performed, and then the method returns to step 110.

[0097] In the present embodiment, before step 130, it is first determined whether the audio energy increase amplitude indicated by the first audio energy change amplitude is not less than the first threshold value. If the audio energy increase amplitude indicated by the first audio energy change amplitude is less than the first threshold value, step 130 does not need to be performed to determine the second audio energy change amplitude, and thus invalid processing can be avoided, and the processing resource of the processor is saved.

[0098] In some embodiments, the method further comprises: performing the step 140, and then determining whether the audio energy decrease amplitude indicated by the second audio energy change amplitude indication is not less than a second threshold value, if the audio energy decrease amplitude indicated by the second audio energy change amplitude indication is determined to be not less than the second threshold value, performing the step 130; if the audio energy decrease amplitude indicated by the second audio energy change amplitude indication is less than the second threshold value, performing the step 160. After performing the step 130, determining whether the audio energy increase amplitude indicated by the first audio energy change amplitude indication is not less than a first threshold value, if the audio energy increase amplitude indicated by the first audio energy change amplitude indication is determined to be not less than the first threshold value, determining that the target audio segment has a rhythm point, and then performing the step 150; otherwise, if the audio energy increase amplitude indicated by the first audio energy change amplitude indication is determined to be less than the first threshold value, performing the step 160.

[0099] In some embodiments, the method further comprises: performing music identification on the target audio segment to obtain a music identification result; and if the music identification result indicates that the target audio segment is music data, performing the step 120.

[0100] The music identification result is used to indicate whether the target audio segment is music data, and if so, subsequent steps 120 and other steps are performed; otherwise, if the music identification result indicates that the target audio segment is not music data, the subsequent steps 120-150 are not performed. Compared with music, other audio data (such as speech (dialogue audio) and the like) is not as pleasing to the ear. In the present scheme, music identification is performed before rhythm point determination, so that the light emitting device emits light in accordance with the rhythm points in the music data, and the user's auditory experience can be ensured.

[0101] In some embodiments, since noise may be mixed in the target audio segment, after the step 110, the target audio segment can be subjected to noise reduction processing, and the steps 120 and 130 are performed after the noise reduction processing. Since noise in the target audio segment is filtered out or reduced, the influence of noise on the determination of the first audio energy change amplitude and the determination of the second audio energy change amplitude can be reduced, thereby improving the accuracy of the determined first audio energy change amplitude and the second audio energy change amplitude, and further ensuring the accuracy of the rhythm point determination.

[0102] Figure 5 is a block diagram of a light emitting device according to an embodiment of the present application, as shown in Figure 5 The light emitting device includes a controller 510 and a light emitting module 520, the light emitting module 520 is electrically connected with the controller 510, and the controller is used to control the light emitting module to emit light according to the method in any of the above embodiments. Figure 5Two light emitting modules are exemplarily shown in the figure, but the number of light emitting modules arranged in the light emitting device can also be other numbers in other embodiments, which are not specifically limited here. The device embodiments of the present application are introduced below, which can be used to perform the methods in the above embodiments of the present application. For details not disclosed in the device embodiments of the present application, please refer to the above method embodiments of the present application.

[0103] Figure 6 is a block diagram of a light emitting control device according to an embodiment, as shown in the figure, the light emitting control device comprises: an acquisition module 610, configured to acquire a target audio segment; a first audio energy variation amplitude determination module 620, configured to determine a first audio energy variation amplitude of the target audio segment relative to a reference audio segment according to an audio energy of the target audio segment and an audio energy of the reference audio segment, the reference audio segment comprising at least one historical audio segment before the target audio segment; a second audio energy variation amplitude determination module 630, configured to determine a second audio energy variation amplitude in a direction of increasing sampling time within the target audio segment according to audio energies of at least two audio sub-segments in the target audio segment; a rhythm point determination module 640, configured to determine whether a rhythm point exists in the target audio segment according to the first audio energy variation amplitude and the second audio energy variation amplitude; and a control module 650, configured to control a light emitting device to emit light according to the target audio segment if it is determined that the rhythm point exists in the target audio segment. Figure 6

[0104] In some embodiments, the rhythm point determination module 640 comprises a rhythm point determination unit, configured to determine that the rhythm point exists in the target audio segment if it is determined that an audio energy increasing amplitude indicated by the first audio energy variation amplitude is not less than a first threshold value and an audio energy decreasing amplitude indicated by the second audio energy variation amplitude is not less than a second threshold value.

[0105] In some embodiments, the reference audio segment comprises a first historical audio segment and a second historical audio segment, the first historical audio segment refers to a previous audio segment of the target audio segment; and the second historical audio segment refers to a previous audio segment of the first historical audio segment; in this embodiment, the first audio energy variation amplitude determination module 620 comprises: a first energy difference calculation unit, configured to calculate a first energy difference between an audio energy of the target audio segment and an audio energy of the first historical audio segment; a second energy difference calculation unit, configured to calculate a second energy difference between the audio energy of the first historical audio segment and an audio energy of the second historical audio segment; and a first amplitude determination unit, configured to determine the first audio energy variation amplitude according to the first energy difference and the second energy difference.

[0106] ​In some embodiments, the at least two audio sub-segments include a first audio sub-segment, a second audio sub-segment and a third audio sub-segment sampled in a first-to-second order; in this embodiment, the second audio energy variation amplitude determination module 630 includes: a third energy difference calculation unit configured to calculate a third energy difference between the audio energy of the second audio sub-segment and the audio energy of the first audio sub-segment; a fourth energy difference calculation unit configured to calculate a fourth energy difference between the audio energy of the third audio sub-segment and the audio energy of the second audio sub-segment; and a second trend determination unit configured to determine a second audio energy variation amplitude in the target audio segment along an increasing direction of the sampling time according to the third energy difference and the fourth energy difference.

[0107] In some embodiments, the light emission control apparatus further includes: a judgment module configured to judge whether the audio energy increase amplitude indicated by the first audio energy variation amplitude is not less than a first threshold; and a target audio segment determination module configured to, if the audio energy increase amplitude indicated by the first audio energy variation amplitude is less than the first threshold, determine a next sampled audio segment as the target audio segment; and if the audio energy increase amplitude indicated by the first audio energy variation amplitude is not less than the first threshold, proceed to the second audio energy variation amplitude determination module 630.

[0108] In some embodiments, the control module 650 includes: an audio energy acquisition module configured to acquire the audio energy of the target audio segment; a light effect control signal determination module configured to determine a light effect control signal corresponding to the audio energy of the target audio segment; and a light emission control module configured to control the light emitting device to emit light according to the light effect control signal corresponding to the audio energy of the target audio segment.

[0109] In some embodiments, the light effect control signal includes at least one of a brightness control signal, a light emission color control signal and a light emission quantity control signal.

[0110] In some embodiments, the light emission control apparatus further includes: a music recognition module configured to perform music recognition on the target audio segment to obtain a music recognition result; and if the music recognition result indicates that the target audio segment is music data, proceed to the first audio energy variation amplitude determination module 620.

[0111] An embodiment of the present application further provides an electronic device, as shown in the figure, which includes a processor 710 and a memory 720, wherein the memory has computer readable instructions stored thereon, and the computer readable instructions are executed by the processor 710 to implement the control method of the light emitting device in any one of the above embodiments. Figure 7

[0112] ​The processor 710 can include one or more processing cores. The processor 710 connects various parts within the entire electronic device 700 with various interfaces and lines, performs various functions of the electronic device 700 and processes data by running or executing instructions, programs, code sets or instruction sets stored in the memory 720, and calls data stored in the memory 720. Optionally, the processor 710 can be implemented in at least one of a hardware form of a digital signal processing (DSP), a field-programmable gate array (FPGA), a programmable logic array (PLA). The processor 710 can integrate a combination of one or several of a central processing unit (CPU), a graphics processing unit (GPU), and a modem. Among them, the CPU mainly processes an operating system, a user interface, and an application program; the GPU is responsible for rendering and drawing display content; and the modem is used for processing wireless communication. It can be understood that the above-mentioned modem can also not be integrated into the processor 710, but can be implemented by a separate communication chip.

[0113] The memory 720 can include a random access memory (RAM) and can also include a read-only memory (ROM). The memory 720 can be used to store instructions, programs, codes, code sets or instruction sets.

[0114] As another aspect, the present application also provides a computer readable storage medium, which can be included in the electronic device described in the above embodiments, or can exist separately without being assembled into the electronic device. The above computer readable storage medium carries computer readable instructions, which, when executed by a processor, implement the method in any of the above embodiments.

[0115] The computer readable storage medium can be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read-only memory), an EPROM, a hard disk or a ROM. Optionally, the computer readable storage medium includes a non-volatile computer readable medium. The computer readable storage medium has a storage space for program codes for executing any of the above method steps. These program codes can be read from or written to one or more computer program products.

[0116] According to an aspect of the embodiments of the present application, a computer program product or computer program is provided, which includes computer instructions stored in a computer readable storage medium. A processor of a computer device reads the computer instructions from the computer readable storage medium, and the processor executes the computer instructions, so that the computer device performs the method in any of the above embodiments.

[0117] It should be noted that, although several modules or units of the device for action execution are mentioned in the above detailed description, the division is not mandatory. In fact, according to the embodiments of the present application, the features and functions of two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided into several modules or units.

[0118] From the above description of the embodiments, those skilled in the art will readily appreciate that the example embodiments described herein can be implemented by software and / or by hardware coupled with software. Accordingly, the technical solutions according to the embodiments of the present application can be embodied in the form of a software product. The software product can be stored in a non-volatile storage medium (which can be a CD-ROM, U disk, mobile hard disk, etc.) or network, and includes several instructions to make a computing device (which can be a personal computer, server, touch terminal, or network device, etc.) execute the methods according to the embodiments of the present application.

[0119] Other embodiments of the present application will be apparent to those skilled in the art from consideration of the specification and practice of the embodiments disclosed herein. The present application is intended to cover any variations, uses, or adaptations of the application following, in general, the principles of the application and including such

[0120] It should be understood that the present application is not limited to the precise construction that has been described above and illustrated in the accompanying drawings, and that various modifications and changes can be made by those skilled in the art without departing from the scope of the present application. The scope of the present application is limited only by the appended claims.

Claims

1. A light emission control method characterized by, The method comprises: sampling current playing audio to obtain a target audio segment; determining a first audio energy variation amplitude of the target audio segment relative to a reference audio segment according to audio energy of the target audio segment and audio energy of the reference audio segment, the reference audio segment comprising at least one historical audio segment before the target audio segment; determining a second audio energy variation amplitude in the target audio segment along an increasing direction of sampling time according to audio energy of last k2 audio sub-segments in the target audio segment, k2 being an integer not less than 2; determining whether the target audio segment has a rhythm point according to the first audio energy variation amplitude and the second audio energy variation amplitude, comprising: if it is determined that an audio energy increasing amplitude indicated by the first audio energy variation amplitude is not less than a first threshold value and an audio energy decreasing amplitude indicated by the second audio energy variation amplitude is not less than a second threshold value, it is determined that the target audio segment has a rhythm point; the first threshold value and the second threshold value are both greater than or equal to zero; if it is determined that the target audio segment has a rhythm point, controlling a light emitting device to emit light according to a light effect control signal corresponding to the audio energy of the target audio segment, so as to make the light emitting device switch light emission along with the rhythm point in the audio.

2. The method of claim 1, wherein, The reference audio segment comprises a first historical audio segment and a second historical audio segment, the first historical audio segment being a last audio segment of the target audio segment, and the second historical audio segment being a last audio segment of the first historical audio segment. The method comprises: calculating a first energy difference value between the audio energy of the target audio segment and the audio energy of the first historical audio segment; calculating a second energy difference value between the audio energy of the first historical audio segment and the audio energy of the second historical audio segment; determining the first audio energy variation amplitude according to the first energy difference value and the second energy difference value.

3. The method of claim 1, wherein, The k2 audio sub-segments comprise a first audio sub-segment, a second audio sub-segment and a third audio sub-segment sampled from front to back; The method comprises: calculating a third energy difference value between the audio energy of the second audio sub-segment and the audio energy of the first audio sub-segment; calculating a fourth energy difference value between the audio energy of the third audio sub-segment and the audio energy of the second audio sub-segment; determining the second audio energy variation amplitude in the target audio segment along the increasing direction of sampling time according to the third energy difference value and the fourth energy difference value.

4. The method of claim 1, wherein, Before the step of determining the second audio energy variation amplitude in the target audio segment in the increasing direction of the sampling time according to the audio energy of the last k2 audio sub-segments in the target audio segment, the method further comprises: determining whether the audio energy increase amplitude indicated by the first audio energy variation amplitude is not less than a first threshold value; if the audio energy increase amplitude indicated by the first audio energy variation amplitude is not less than the first threshold value, performing the step of determining the second audio energy variation amplitude in the target audio segment in the increasing direction of the sampling time according to the audio energy of the last k2 audio sub-segments in the target audio segment; if the audio energy increase amplitude indicated by the first audio energy variation amplitude is less than the first threshold value, taking the next sampled audio segment as the target audio segment.

5. The method of claim 1, wherein, The light effect control signal comprises at least one of a brightness control signal, a light emitting color control signal, and a light emitting quantity control signal.

6. The method of claim 1, wherein, The method further comprises: performing music recognition on the target audio segment to obtain a music recognition result; if the music recognition result indicates that the target audio segment is music data, performing the step of determining the first audio energy variation trend of the target audio segment relative to the reference audio segment according to the audio energy of the target audio segment and the audio energy of the reference audio segment.

7. A light emitting device characterized by The light emitting module and the controller are electrically connected, and the controller is configured to control the light emitting module to emit light according to the method in any one of claims 1-6.

8. A light emission control device, characterized by comprising: The method further comprises: an acquisition module configured to sample currently playing audio to obtain a target audio segment; a first audio energy variation amplitude determination module configured to determine a first audio energy variation amplitude of the target audio segment relative to a reference audio segment according to the audio energy of the target audio segment and the audio energy of the reference audio segment, the reference audio segment comprising at least one historical audio segment before the target audio segment; a second audio energy variation amplitude determination module configured to determine a second audio energy variation amplitude in the target audio segment in the increasing direction of the sampling time according to the audio energy of the last k2 audio sub-segments in the target audio segment; k2 is an integer not less than 2; a rhythm point determination module configured to determine whether the target audio segment has a rhythm point according to the first audio energy variation amplitude and the second audio energy variation amplitude, comprising: if it is determined that the audio energy increase amplitude indicated by the first audio energy variation amplitude is not less than a first threshold value, and the audio energy decrease amplitude indicated by the second audio energy variation amplitude is not less than a second threshold value, it is determined that the target audio segment has a rhythm point; the first threshold value and the second threshold value are both greater than or equal to zero; a control module configured to control a light emitting device to emit light according to the target audio segment if it is determined that the light effect control signal corresponding to the audio energy of the rhythm point of the target audio segment exists.

9. An electronic device, comprising: The method further comprises: a processor; a memory having computer readable instructions stored thereon, the computer readable instructions, when executed by the processor, implement the method of any one of claims 1-6.

10. A computer readable storage medium having computer readable instructions stored thereon, the computer readable instructions, when executed by a processor, implement the method of any one of claims 1-6.

Citation Information

Patent Citations

  • Music rhythm detection method based on frequency domain and time domain and storage medium

    CN111081271A

  • Control method of light-emitting equipment and related equipment

    CN116189639A