Method for controlling interface light and scene light in linkage and storage medium

Abstract

The application discloses an interface light and scene light linkage control method and a storage medium, and the method comprises the following steps: acquiring audio data in real time, and identifying drum points in the audio data in real time; determining interface light display parameters according to the drum points in the audio data, and controlling the display of the interface light in real time according to the interface light display parameters; determining scene light control parameters according to a preset mapping relationship between the interface light and the scene light and the interface light display parameters, and controlling the scene light in real time according to the scene light control parameters. The application can enrich the visual effect of a display screen, and can realize the unity of the interface light effect and the scene light effect.

Description

Technical Field

[0001] This invention relates to the field of lighting control technology, and in particular to a method and storage medium for the linkage control of interface lighting and scene lighting. Background Technology

[0002] In digital audiovisual venues such as KTVs, bars, and dance halls, themed lighting effects or very cool lighting effects are often set up during the decoration process, so that customers can enjoy a full range of sensory entertainment.

[0003] Currently, there have been many reports on the linkage between audio and scene lighting in order to allow users to better immerse themselves in the entertainment of these digital audiovisual venues. However, these digital audiovisual venues often also have display screens (TV screens or large screens). At present, these screens usually only display music videos or pre-set pictures or videos, and the display effect is relatively simple. No one has yet been found to link the content displayed on the screens with the scene lighting, and the equipment in the venue is not being fully utilized to allow users to better immerse themselves in the entertainment atmosphere. Summary of the Invention

[0004] The technical problem to be solved by the present invention is to provide a method and storage medium for the linkage control of interface lighting and scene lighting, which can enrich the visual effect of the display screen and achieve the unification of interface lighting effect and scene lighting effect.

[0005] To solve the above-mentioned technical problems, the technical solution adopted by the present invention is: a method for linkage control of interface lighting and scene lighting, comprising:

[0006] Acquire audio data in real time and identify drum beats in the audio data in real time;

[0007] Based on the drum beats in the audio data, determine the interface lighting display parameters, and control the display of the interface lights in real time based on the interface lighting display parameters;

[0008] Based on the preset mapping relationship between interface lights and scene lights and the interface light display parameters, scene light control parameters are determined, and scene lights are controlled in real time according to the scene light control parameters.

[0009] The present invention also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the method described above.

[0010] The beneficial effects of this invention are as follows: by detecting the drum beats in the audio data and controlling the display of interface lighting animations according to the drum beats, the interface lighting can change according to the audio changes, enriching the visual effects of the display screen; by controlling the scene lighting according to the scene lighting control parameters corresponding to the interface lighting display parameters, the ambient lighting effect and the interface lighting effect are unified, realizing the linkage between interface lighting and scene lighting, which not only enriches the visual effects of the display screen, but also enhances the atmosphere of the scene, giving users an immersive experience. Attached Figure Description

[0011] Figure 1 This is a flowchart of a method for linking interface lighting and scene lighting according to the present invention;

[0012] Figure 2 This is a flowchart of the method according to Embodiment 1 of the present invention;

[0013] Figure 3 This is a flowchart of step S2 in Embodiment 3 of the present invention. Detailed Implementation

[0014] To explain the technical content, objectives, and effects of the present invention in detail, the following description is provided in conjunction with the embodiments and accompanying drawings.

[0015] Please see Figure 1 A method for coordinated control of interface lighting and scene lighting, comprising:

[0016] Acquire audio data in real time and identify drum beats in the audio data in real time;

[0017] Based on the drum beats in the audio data, determine the interface lighting display parameters, and control the display of the interface lights in real time based on the interface lighting display parameters;

[0018] Based on the preset mapping relationship between interface lights and scene lights and the interface light display parameters, scene light control parameters are determined, and scene lights are controlled in real time according to the scene light control parameters.

[0019] As can be seen from the above description, the beneficial effects of the present invention are: it can enrich the visual effects of the display screen and achieve the unity of interface lighting effects and scene lighting effects.

[0020] Furthermore, before determining the scene lighting control parameters based on the preset mapping relationship between interface lighting and scene lighting and the interface lighting display parameters, and before controlling the scene lighting according to the scene lighting control parameters, the process further includes:

[0021] The singing score is calculated in real time based on the user's singing audio;

[0022] If the singing score reaches a preset score threshold, the display of the interface lights is controlled according to the interface light display parameters and display time corresponding to the score threshold.

[0023] Furthermore, before determining the scene lighting control parameters based on the preset mapping relationship between interface lighting and scene lighting and the interface lighting display parameters, and before controlling the scene lighting according to the scene lighting control parameters, the process further includes:

[0024] Real-time recognition of lyrics in audio data;

[0025] When a preset emotional lyrics are detected, the interface light display is controlled according to the corresponding interface light display parameters and display time.

[0026] As described above, the lighting effects can not only change according to the audio, but also according to the singing situation and the lyrics, further enriching the lighting display effects.

[0027] Furthermore, the interface lighting includes interface spotlights and / or interface background lights. The interface spotlights include left and right interface spotlights and bottom interface spotlights, and the interface background lights include bottom interface background lights. The left and right interface spotlights are displayed on the left and right sides of the display screen, and the bottom interface spotlights and bottom interface background lights are displayed at the bottom of the display screen.

[0028] The scene lighting includes scene spotlights and / or scene background lights. The scene spotlights include one or more scene left and right spotlights and one or more scene bottom spotlights. The scene background lights include one or more scene bottom background lights. The one or more scene left and right spotlights are respectively located on the left and right sides of the display screen. The one or more scene bottom spotlights are located below the display screen. The one or more scene bottom background lights are located directly opposite the display screen.

[0029] The left and right spotlights of the interface are associated with one or more scene left and right spotlights, the bottom spotlight of the interface is associated with one or more scene bottom spotlights, and the bottom background light of the interface is associated with one or more scene bottom background lights.

[0030] As described above, the association between interface lighting and scene lighting is achieved.

[0031] Furthermore, prior to acquiring audio data in real time and identifying drum beats in the audio data in real time, the process further includes:

[0032] The preset interface left and right spotlight display parameters are associated with the preset scene left and right spotlight display parameters to obtain the first association relationship. The interface left and right spotlight display parameters include the interface light number, display level and display rate. The scene left and right spotlight display parameters include the scene light number, motion trajectory and motion rate. The motion trajectory includes the light color and swaying trajectory. The motion rate includes the swaying rate and flicker rate.

[0033] The preset interface bottom spotlight display parameters are associated with the preset scene bottom spotlight display parameters to obtain a second association relationship. The interface bottom spotlight display parameters include the interface light number and display level, and the scene bottom spotlight display parameters include the scene light number and motion trajectory. The motion trajectory includes the light color and swaying trajectory.

[0034] The preset interface bottom background light display parameters are associated with the preset scene bottom background light display parameters to obtain a third association relationship. The interface bottom background light display parameters include the interface light number, display level and transparency. The scene bottom background light display parameters include the scene light number, motion trajectory and brightness level. The motion trajectory includes the light color and swaying trajectory.

[0035] Based on the first association, the second association, and the third association, the mapping relationship between interface lights and scene lights is obtained.

[0036] As described above, pre-establishing a mapping relationship between interface lighting display parameters and scene lighting display parameters facilitates subsequent control of scene lighting based on interface lighting.

[0037] Furthermore, determining the interface lighting display parameters based on the drum beats in the audio data specifically involves:

[0038] Based on the preset drum beat frequency level detection period, obtain the number of drum beats within the current drum beat frequency level detection period, and determine the drum beat frequency level of the current drum beat frequency level detection period based on the number of drum beats.

[0039] According to the preset drum energy level detection cycle, the maximum spectral energy of the drum within the current drum energy level detection cycle is obtained, and the drum energy level of the current drum energy level detection cycle is determined based on the maximum spectral energy.

[0040] Based on the drum frequency level of the current drum frequency level detection cycle, determine the interface lighting display parameters for the next drum frequency level detection cycle, and / or based on the drum energy level of the current drum energy level detection cycle, determine the interface lighting display parameters for the next drum energy level detection cycle.

[0041] As described above, the interface lighting display parameters are determined based on the frequency and energy level of the drumbeats.

[0042] Further, the steps of obtaining the number of drumbeats within the current drumbeat frequency level detection period according to a preset drumbeat frequency level detection period, and determining the drumbeat frequency level of the current drumbeat frequency level detection period based on the number of drumbeats; and obtaining the maximum spectral energy of the drumbeats within the current drumbeat energy level detection period according to a preset drumbeat energy level detection period, and determining the drumbeat energy level of the current drumbeat energy level detection period based on the maximum spectral energy, specifically are as follows:

[0043] When the preset drum frequency level detection cycle is reached, the drum beats with an energy difference greater than the preset first threshold within the current drum frequency level detection cycle are obtained, and the first drum beat is obtained.

[0044] Based on the number of the first drumbeats, determine the drumbeat frequency level corresponding to the current drumbeat frequency level detection cycle;

[0045] When the preset drum energy level detection period is reached, the maximum value of the sum of the spectral energy of each drum within the current drum energy level detection period is obtained, and the drum energy level corresponding to the current drum energy level detection period is determined based on the maximum value.

[0046] As described above, the drum frequency level is determined based on the number of drum beats with an energy difference greater than a preset threshold, and the drum energy level is determined based on the maximum spectral energy of the drum beats.

[0047] Furthermore, the interface lighting display parameters include the display parameters of the left and right sidelights and the display parameters of the bottomlight.

[0048] The specific steps for determining the interface lighting display parameters for the next drum beat frequency level detection cycle based on the drum beat frequency level of the current drum beat frequency level detection cycle are as follows:

[0049] Based on the display level and display rate corresponding to the drum frequency level in the current drum frequency level detection cycle, determine the display level and display rate of the left and right spotlights of the interface in the next drum frequency level detection cycle.

[0050] Based on the display level corresponding to the drum frequency level in the current drum frequency level detection cycle, determine the display level of the bottom spotlight in the interface for the next drum frequency level detection cycle.

[0051] Furthermore, the interface lighting display parameters include the interface bottom background light display parameters;

[0052] The specific steps for determining the interface lighting display parameters for the next drumbeat energy level detection cycle based on the drumbeat energy level of the current drumbeat energy level detection cycle are as follows:

[0053] The display level of the background light at the bottom of the interface is determined based on the display level corresponding to the drum energy level in the current drum energy level detection cycle.

[0054] The transparency of the background light at the bottom of the interface is determined based on the maximum value of the spectral energy of each drumbeat within the current drumbeat energy level detection period.

[0055] As described above, the scene lighting display parameters are determined based on the interface lighting display parameters to ensure that the ambient lighting effect is consistent with the interface lighting effect.

[0056] Furthermore, determining the transparency of the background light at the bottom of the interface based on the maximum value of the sum of the spectral energy of each drumbeat within the current drumbeat energy level detection period specifically involves:

[0057] If the maximum value of the sum of the spectral energy of each drumbeat within the current drumbeat energy level detection period is less than or equal to the preset energy threshold, then the transparency of the background light at the bottom of the interface will be set to the preset transparency.

[0058] If the maximum sum of the spectral energy of each drumbeat within the current drumbeat energy level detection period is greater than the preset energy threshold, then the transparency of the bottom background light is set according to the maximum sum of the spectral energy of each drumbeat within the current drumbeat energy level detection period.

[0059] As described above, based on the maximum spectral energy of the drumbeat and the calculated transparency, when the drumbeat is weak, the transparency is low, resulting in a weaker display effect of the background light at the bottom of the interface; when the drumbeat is strong, the transparency is high, resulting in a stronger display effect of the background light at the bottom of the interface.

[0060] The present invention also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the method described above.

[0061] Example 1

[0062] Please refer to Figure 2 Embodiment 1 of the present invention is: a method for linking interface lighting and scene lighting, which can be applied to digital audiovisual venues such as KTV, bars, and dance halls.

[0063] In this embodiment, the interface lighting includes interface spotlights and interface background lights. The interface spotlights include left and right interface spotlights and bottom interface spotlights, and the interface background lights include bottom interface background lights. The left and right interface spotlights are displayed on the left and right sides of the display screen, and the bottom interface spotlights and bottom interface background lights are displayed at the bottom of the display screen.

[0064] Scene lighting includes scene spotlights and scene background lights. Scene spotlights include one or more scene left and right spotlights and one or more scene bottom spotlights. Scene background lights include one or more scene bottom background lights. Scene left and right spotlights are respectively set on the left and right sides of the display screen, scene bottom spotlights are set below the display screen, and scene bottom background lights are set directly opposite the display screen, for example, they can be installed on the top of the wall directly opposite the display screen.

[0065] Specifically, the left and right spotlights of the interface are associated with one or more scene left and right spotlights, the bottom spotlight of the interface is associated with one or more scene bottom spotlights, and the bottom background light of the interface is associated with one or more scene bottom background lights.

[0066] like Figure 2 As shown, it includes the following steps:

[0067] S1: Obtain the mapping relationship between interface lights and scene lights.

[0068] Before this step, perform the following steps to obtain the mapping relationship between interface lights and scene lights.

[0069] The preset display parameters for the left and right spotlights on the interface are associated with the preset display parameters for the left and right spotlights in the scene to obtain the first association relationship. Among them, the display parameters for the left and right spotlights on the interface include the interface light number, display level, and display rate; the display parameters for the left and right spotlights in the scene include the scene light number, motion trajectory, and motion rate. The motion trajectory includes the light color and swaying trajectory, and the motion rate includes the swaying rate and flicker rate.

[0070] The preset parameters for the bottom spotlights on the interface are associated with the preset parameters for the bottom spotlights on the scene to obtain a second association relationship. The parameters for the bottom spotlights on the interface include the interface light number and display level, while the parameters for the bottom spotlights on the scene include the scene light number and motion trajectory. The motion trajectory includes the light color and swaying trajectory.

[0071] The preset interface bottom background light display parameters are associated with the preset scene bottom background light display parameters to obtain a third association relationship. The interface bottom background light display parameters include the interface light number, display level, and transparency; the scene bottom background light display parameters include the scene light number, motion trajectory, and brightness level. The motion trajectory includes the light color and swaying trajectory.

[0072] Based on the first association, the second association, and the third association, the mapping relationship between interface lights and scene lights is obtained.

[0073] S2: Acquire audio data in real time and identify drum beats in the audio data in real time;

[0074] In this embodiment, audio data is acquired, and then each 0.3s or 0.4s of audio data is taken as an audio frame. The difference between the spectral energy of adjacent audio frames is calculated to obtain the energy difference of the audio frames. Finally, based on the energy difference of the audio frames, the drum beats in the audio data are identified in real time.

[0075] S3: Determine the interface lighting display parameters based on the drum beats in the audio data, and control the display of the interface lights in real time based on the interface lighting display parameters.

[0076] Specifically, this step includes the following steps:

[0077] S301: Based on the preset drum beat frequency level detection period, obtain the number of drum beats within the current drum beat frequency level detection period, and determine the drum beat frequency level of the current drum beat frequency level detection period based on the number of drum beats.

[0078] Specifically, when the preset drum beat frequency level detection cycle is reached, the drum beats with an energy difference greater than the preset first threshold within the current drum beat frequency level detection cycle are obtained to obtain the first drum beat; then, based on the number of the first drum beats, the drum beat frequency level corresponding to the current drum beat frequency level detection cycle is determined.

[0079] In this embodiment, the drum beat frequency level detection period can be 1s-2s, specifically 1.6s. Every 1.6s, the number of first drum beats with an energy difference greater than a preset first threshold is obtained, and the drum beat frequency level corresponding to the current period is determined based on the number. In this embodiment, four drum beat frequency levels are set. Specifically, if the number of first drum beats is 0 or 1, the drum beat frequency level corresponding to the current drum beat frequency level detection period is set to 1; if the number of first drum beats is 2, the drum beat frequency level corresponding to the current drum beat frequency level detection period is set to 2; if the number of first drum beats is 3 or 4, the drum beat frequency level corresponding to the current drum beat frequency level detection period is set to 3; if the number of first drum beats is greater than or equal to 5, the drum beat frequency level corresponding to the current drum beat frequency level detection period is set to 4.

[0080] S302: Determine the interface lighting display parameters for the next drum beat frequency level detection cycle based on the drum beat frequency level of the current drum beat frequency level detection cycle.

[0081] In this embodiment, the drum beat frequency level is used to determine the display parameters of the left and right spotlights and the bottom spotlight of the interface.

[0082] Specifically, based on the display level and display rate corresponding to the drum frequency level in the current drum frequency level detection cycle, the display level and display rate of the left and right spotlights and the display level of the bottom spotlight in the interface for the next drum frequency level detection cycle are determined.

[0083] For example, if the drum beat frequency level is 1, the corresponding display level is 1, and the display rate is 0.106. Then, if the drum beat frequency level of the current cycle is 1, the display level of the left and right spotlights of the interface in the next cycle will be 1, the display rate will be 0.106, and the display level of the bottom spotlight of the interface will be 1.

[0084] S303: Control the interface lighting for the next drum beat frequency level detection cycle based on the interface lighting display parameters for the next drum beat frequency level detection cycle.

[0085] Specifically, in the next drumbeat frequency level detection cycle, the display of the left and right spotlights on the interface is controlled according to the display level and display rate of the left and right spotlights on the interface. At the same time, the display of the bottom spotlight on the interface is controlled according to the display level of the bottom spotlight on the interface.

[0086] S304: Based on the preset drum energy level detection period, obtain the maximum spectral energy of the drum within the current drum energy level detection period, and determine the drum energy level of the current drum energy level detection period based on the maximum spectral energy.

[0087] Specifically, when the preset drum energy level detection period is reached, the maximum value of the sum of the spectral energy of each drum within the current drum energy level detection period is obtained, and then the drum energy level corresponding to the current drum energy level detection period is determined based on the maximum value.

[0088] In this embodiment, the drum beat energy level detection period is 0.6s. Every 0.6s, the maximum value of the sum of the spectral energy of each drum beat is obtained, and then the drum beat energy level corresponding to the current period is determined based on the maximum value. In this embodiment, three drum beat energy levels are set. Specifically, if there are no drum beats in the current drum beat energy level detection period, that is, the number of drum beats is 0, then the drum beat energy level corresponding to the current drum beat energy level detection period is set to 1; if the maximum value of the sum of the spectral energy of each drum beat in the current drum beat energy level detection period is less than or equal to 30, then the drum beat energy level corresponding to the current drum beat energy level detection period is set to 2; if the maximum value is greater than 30, then the drum beat energy level corresponding to the current drum beat energy level detection period is set to 3.

[0089] S305: Determine the interface lighting display parameters for the next drum energy level detection cycle based on the drum energy level of the current drum energy level detection cycle.

[0090] In this embodiment, the drum energy level is used to determine the display parameters of the background light at the bottom of the interface.

[0091] Specifically, based on the display level corresponding to the drum energy level in the current drum energy level detection cycle, the display level of the bottom background light of the interface in the next drum energy level detection cycle is determined; based on the maximum value of the sum of the spectral energy of each drum in the current drum energy level detection cycle, the transparency of the bottom background light of the interface in the next drum energy level detection cycle is calculated.

[0092] Specifically, if the maximum sum of the spectral energy of all drums within the current drum energy level detection period is less than or equal to a preset energy threshold, the transparency of the bottom background light is set to a preset transparency; otherwise, the transparency of the bottom background light is set according to the maximum sum of the spectral energy of all drums within the current drum energy level detection period. Preferably, the preset energy threshold is 60, and the preset transparency is 50%.

[0093] When the maximum sum of the spectral energy of each drumbeat within the current drumbeat energy level detection period exceeds a preset energy threshold, the transparency of the bottom background light is set as follows: for example, when the maximum sum of the spectral energy of each drumbeat within the current drumbeat energy level detection period is between 90 and 100, the transparency of the bottom background light is 95%; when the maximum sum of the spectral energy of each drumbeat within the current drumbeat energy level detection period is between 70 and 90, the transparency of the bottom background light is 85%; and when the maximum sum of the spectral energy of each drumbeat within the current drumbeat energy level detection period is between 60 and 70, the transparency of the bottom background light is 60%.

[0094] S306: Control the interface lighting for the next drumbeat energy level detection cycle based on the interface lighting display parameters for that cycle. Specifically, during the next drumbeat frequency level detection cycle, control the display of the bottom background light based on the transparency of the display level of the bottom background light.

[0095] The above steps S301-303 and steps S304-306 can be executed simultaneously.

[0096] S4: Determine the scene lighting control parameters based on the mapping relationship between the interface lights and the scene lights, as well as the interface lights display parameters.

[0097] Step S3 determines the display level and display rate of the left and right spotlights on the interface, as well as the display level of the bottom spotlight on the interface, for the next drum beat frequency level detection cycle. It also determines the display level and transparency of the bottom background light on the interface for the next drum beat energy level detection cycle. In this step, based on the mapping relationship, the motion trajectory (light color and swaying trajectory) of the left and right spotlights is determined according to their display levels; the motion rate (swaying speed and flicker rate) of the left and right spotlights is determined according to their display rates; the motion trajectory (light color and swaying trajectory) of the bottom spotlight is determined according to its display level; the motion trajectory (light color and swaying trajectory) of the bottom background light is determined according to its display level; and the brightness of the bottom background light is determined according to its transparency.

[0098] S5: Control the scene lighting in real time according to the scene lighting control parameters.

[0099] Specifically, in the next drumbeat frequency level detection cycle, the display of the left and right spotlights on the scene surface is controlled according to the movement trajectory and display rate of the left and right spotlights. Simultaneously, the display of the bottom spotlight is controlled according to the movement trajectory of the bottom spotlight. In this embodiment, the bottom spotlight moves at a fixed rate. In the next drumbeat energy level detection cycle, the display of the bottom background light is controlled according to the brightness of the bottom background light.

[0100] For example, assuming the drum beat frequency level is 1, the display level of the left and right spotlights on the interface is also 1. They will display according to the spotlight animation effect for display level 1, with a display rate of 0.106 and a color of blue. The left and right spotlights will control their movement with a swing trajectory corresponding to display level 1 and a swing rate of once every 2 seconds, and the light color will also be blue or a similar color. When the drum beat frequency level is 1, the display level of the bottom spotlight on the interface is also 1, and it will display according to the spotlight animation effect for display level 1. The bottom spotlight will control its movement with a circular trajectory and a preset swing rate.

[0101] Assuming the drum energy level is 1, the display level of the background light at the bottom of the interface is 1, and the transparency can be 50%. The background light at the bottom of the scene can display the motion trajectory corresponding to level 1 to control the movement of the light.

[0102] This embodiment can be applied to the Android system, greatly reducing the device cost to achieve the same effect; it can dynamically configure interface lighting effects and scene lighting effects, displaying different lighting effects, making the display effects of interface lighting and scene lighting more diverse; it realizes the interaction between songs and interface lighting, as well as the linkage between interface lighting and scene lighting, which not only enriches the visual effects of the display screen, but also enhances the atmosphere of the scene, giving users an immersive experience.

[0103] Example 2

[0104] This embodiment is a further extension of Embodiment 1. The similarities will not be repeated here. The difference is that this embodiment will also control the display of the interface lights in real time based on the singing score and lyrics.

[0105] During the playback of audio data, the singing score is calculated in real time based on the user's singing audio. If the singing score reaches the preset scoring threshold, the display of the interface lights will be controlled according to the interface lighting display parameters and display time corresponding to the scoring threshold.

[0106] Meanwhile, during the playback of audio data, lyrics in the audio data are identified in real time. If the lyrics identified in real time are preset emotional lyrics, the display of the interface lights is controlled according to the interface light display parameters and display time corresponding to the emotional lyrics.

[0107] For example, with a scoring range of 1-100, when the singing score reaches 90 or above, the display level of the left and right spotlights on the interface can be 4, and the light color can be red or yellow, displaying the corresponding spotlight animation effect at a high speed; the display level of the bottom spotlight on the interface can be 4, displaying a visually strong spotlight animation effect; the display level of the bottom background light can be 3, displaying a visually strong background light animation effect, with 100% transparency (i.e., opaque). Correspondingly, the left and right spotlights can choose red and yellow light sources, moving at a high speed in a circular trajectory; the bottom spotlight can choose blue light sources, and the light source is high-brightness, moving at a high speed in a left-right swaying trajectory; the bottom background light displays at high brightness.

[0108] For example, when the lyrics detected in real time contain melancholic or sad words, the display level of the left and right spotlights on the interface can be set to 1, and the light color can be white or dark, displaying the corresponding spotlight animation effect at a slower display rate; the display level of the bottom spotlight on the interface can be set to 1, displaying a weaker spotlight animation effect; the display level of the bottom background light can be set to 1, displaying a weaker background light animation effect, with the transparency state set to 2 / 3 transparent (i.e., approximately 35% transparency). Correspondingly, the left and right spotlights in the scene can choose white and dark light sources, moving at a low speed with a left-right swaying trajectory; the bottom spotlight in the scene can be turned off (i.e., not lit); and the bottom background light in the scene is displayed at a low brightness.

[0109] Furthermore, after the lighting effects corresponding to the scoring threshold or the emotional lyrics have been displayed, the interface lighting continues to be controlled according to the drum beats.

[0110] This embodiment identifies singing scores and lyrics in real time. When the singing score reaches a certain set value or when emotional lyrics are identified, the corresponding lighting effects are displayed first. After a certain period of time, the system switches back to displaying lighting effects based on drum beats. This allows the lighting effects to change not only according to audio changes but also according to the singing situation and lyrics, further enriching the lighting display effects.

[0111] Example 3

[0112] Please refer to Figure 3 This embodiment is a further extension of step S2 in Embodiment 1. For example... Figure 3 As shown, in this embodiment, step S2 specifically includes the following steps:

[0113] S201: Acquire audio data in real time, and further, normalize the audio data after acquisition.

[0114] S202: Sequentially obtain an audio frame from the audio data as the current audio frame, and take the difference between the sum of the spectral energy of the current audio frame and the previous audio frame as the energy difference D of the current audio frame. n And save the energy difference D n .

[0115] Specifically, this step includes the following steps:

[0116] S2021: According to the preset frame length, obtain the first audio frame of the audio data; in this embodiment, the frame length is 0.3s, that is, every 0.3s of audio data is taken as an audio frame.

[0117] S2022: Perform a Fourier transform on the first audio frame to obtain the spectrum of the first audio frame.

[0118] S2023: Calculate the sum of spectral energy of the first audio frame within a preset frequency band; the frequency band range can be selected according to requirements, such as the low-frequency part, mid-frequency part, high-frequency part, or the entire frequency band. In this embodiment, the sum of spectral energy is calculated within the entire frequency band range, denoted as S. n The subscript n indicates the frame number, which is counted starting from 1, i.e., the sequence number corresponding to the audio frame.

[0119] S2024: Based on the preset frame length, obtain the next audio frame of the audio data and use it as the current audio frame.

[0120] S2025: Perform a Fourier transform on the current audio frame to obtain the spectrum of the current audio frame.

[0121] S2026: Calculate the spectral energy of the current audio frame in the preset frequency band.

[0122] S2027: Subtract the sum of the spectral energy of the previous audio frame from the sum of the spectral energy of the current audio frame to obtain the energy difference value of the current audio frame, and save the energy difference value. Specifically, according to formula D... n =S n -S n-1 Calculate the energy difference between the current audio frame and the previous audio frame. The energy difference for the first audio frame can be ignored, or the spectral energy value of the first audio frame can be directly used as the energy difference.

[0123] S203: Determine the energy threshold δ corresponding to the current audio frame. n In this embodiment, the energy threshold can be a preset empirical value. Also, in this embodiment, the energy threshold corresponding to each audio frame is the same, which is the preset empirical value.

[0124] In other alternative embodiments, the energy threshold may not be a fixed value, but may be adaptively adjusted based on the energy difference of the processed audio frames.

[0125] S204: Obtain the current audio frame and two or more consecutive audio frames adjacent to it, and obtain the energy difference of three or more audio frames.

[0126] S205: Determine whether there is a peak value among the energy differences of the three or more audio frames, and whether the peak value is greater than the energy threshold corresponding to the current audio frame. If yes, proceed to step S206; otherwise, continue to obtain the next audio frame, i.e., proceed to step S202. For example, when obtaining the energy difference of three audio frames, determine whether the following condition is met: D n-2 <D n-1 And D n-1 >D n Meanwhile, D n-1 >δ n , where D n-1 D represents the energy difference between the current audio frame and the previous audio frame. n-2 It represents the energy difference between the two preceding audio frames of the current audio frame.

[0127] S206: Mark the audio frame corresponding to the peak as a drum beat. Return to step S202, and further, return to step S2024 until the audio data processing is complete.

[0128] This embodiment detects drum beats in audio data based on the energy difference between audio frames. This can be done in real time and has higher accuracy. Furthermore, it does not require the establishment of a model. By analyzing and comparing the energy differences of several adjacent audio frames, the drum beats are determined, which improves the detection efficiency.

[0129] Example 4

[0130] This embodiment is a computer-readable storage medium corresponding to the above embodiments, on which a computer program is stored. When the computer program is executed by a processor, it implements the various processes in the above embodiments of the linkage control method for interface lighting and scene lighting, and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0131] In summary, the present invention provides a method and storage medium for the coordinated control of interface lighting and scene lighting. By detecting drum beats in audio data and controlling the display of interface lighting animations based on the frequency and energy of the drum beats, the interface lighting can change according to audio variations, enriching the visual effects of the display screen. By controlling scene lighting according to scene lighting control parameters corresponding to the interface lighting display parameters, the ambient lighting effects are unified with the interface lighting effects, achieving coordinated control between interface lighting and scene lighting. This not only enriches the visual effects of the display screen but also enhances the atmosphere, providing users with an immersive experience. By recognizing singing scores and lyrics in real time, when a singing score reaches a certain set value or emotional lyrics are identified, the corresponding lighting effects are prioritized for display. After a certain display time, the system switches back to displaying lighting effects based on drum beats. This allows the lighting effects to change not only according to audio variations but also according to the singing situation and changes in lyrics, further enriching the lighting display effects.

[0132] The above description is merely an embodiment of the present invention and does not limit the patent scope of the present invention. Any equivalent modifications made based on the content of the present invention specification and drawings, or direct or indirect applications in related technical fields, are similarly included within the patent protection scope of the present invention.

Claims

1. A method for coordinated control of interface lighting and scene lighting, characterized in that, include: Acquire audio data in real time and identify drum beats in the audio data in real time; Based on the drum beats in the audio data, the interface lighting display parameters are determined, and the interface lighting display is controlled in real time according to the interface lighting display parameters; wherein, the interface lighting is displayed on the display screen, and the interface lighting includes interface spotlights and / or interface background lights; the scene lighting includes scene spotlights and / or scene background lights; the interface lights and the scene lights at the corresponding positions are associated to obtain the mapping relationship between the interface lights and the scene lights; Based on the mapping relationship and the interface lighting display parameters, the scene lighting control parameters are determined, and the scene lighting is controlled in real time according to the scene lighting control parameters. The specific steps for determining the interface lighting display parameters based on the drum beats in the audio data are as follows: Based on the preset drum beat frequency level detection period, obtain the number of drum beats within the current drum beat frequency level detection period, and determine the drum beat frequency level of the current drum beat frequency level detection period based on the number of drum beats. According to the preset drum energy level detection cycle, the maximum spectral energy of the drum within the current drum energy level detection cycle is obtained, and the drum energy level of the current drum energy level detection cycle is determined based on the maximum spectral energy. Based on the drum frequency level of the current drum frequency level detection cycle, determine the interface lighting display parameters for the next drum frequency level detection cycle, and / or based on the drum energy level of the current drum energy level detection cycle, determine the interface lighting display parameters for the next drum energy level detection cycle. Wherein, the drum beat frequency level is used to determine the display level and / or display rate of the interface spotlight, the drum beat energy level is used to determine the display level of the interface background light, and the maximum spectral energy is used to determine the transparency of the interface background light.

2. The method for linking interface lighting and scene lighting according to claim 1, characterized in that, Before determining scene lighting control parameters based on a preset mapping relationship between interface lighting and scene lighting, and the interface lighting display parameters, and before controlling the scene lighting based on the scene lighting control parameters, the process further includes: The singing score is calculated in real time based on the user's singing audio; If the singing score reaches a preset score threshold, the display of the interface lights is controlled according to the interface light display parameters and display time corresponding to the score threshold.

3. The method for linking interface lighting and scene lighting according to claim 1, characterized in that, Before determining scene lighting control parameters based on a preset mapping relationship between interface lighting and scene lighting, and the interface lighting display parameters, and before controlling the scene lighting based on the scene lighting control parameters, the process further includes: Real-time recognition of lyrics in audio data; When a preset emotional lyrics are detected, the interface light display is controlled according to the corresponding interface light display parameters and display time.

4. The method for linking interface lighting and scene lighting according to any one of claims 1-3, characterized in that, The interface spotlights include left and right interface spotlights and a bottom interface spotlight, and the interface background light includes a bottom interface background light; the left and right interface spotlights are displayed on the left and right sides of the display screen, and the bottom interface spotlight and the bottom interface background light are displayed at the bottom of the display screen. The scene spotlights include one or more scene left and right spotlights and one or more scene bottom spotlights, and the scene background light includes one or more scene bottom background lights; the one or more scene left and right spotlights are respectively arranged on the left and right sides of the display screen, the one or more scene bottom spotlights are arranged below the display screen, and the one or more scene bottom background lights are arranged directly opposite the display screen. The left and right spotlights of the interface are associated with one or more scene left and right spotlights, the bottom spotlight of the interface is associated with one or more scene bottom spotlights, and the bottom background light of the interface is associated with one or more scene bottom background lights.

5. The method for linking interface lighting and scene lighting according to claim 4, characterized in that, Before acquiring audio data in real time and identifying drum beats in the audio data in real time, the method further includes: The preset interface left and right spotlight display parameters are associated with the preset scene left and right spotlight display parameters to obtain the first association relationship. The interface left and right spotlight display parameters include the interface light number, display level and display rate. The scene left and right spotlight display parameters include the scene light number, motion trajectory and motion rate. The motion trajectory includes the light color and swaying trajectory. The motion rate includes the swaying rate and flicker rate. The preset interface bottom spotlight display parameters are associated with the preset scene bottom spotlight display parameters to obtain a second association relationship. The interface bottom spotlight display parameters include the interface light number and display level, and the scene bottom spotlight display parameters include the scene light number and motion trajectory. The motion trajectory includes the light color and swaying trajectory. The preset interface bottom background light display parameters are associated with the preset scene bottom background light display parameters to obtain a third association relationship. The interface bottom background light display parameters include the interface light number, display level and transparency. The scene bottom background light display parameters include the scene light number, motion trajectory and brightness level. The motion trajectory includes the light color and swaying trajectory. Based on the first association, the second association, and the third association, the mapping relationship between interface lights and scene lights is obtained.

6. The method for linking interface lighting and scene lighting according to claim 1, characterized in that, The steps of obtaining the number of drumbeats within the current drumbeat frequency level detection period according to a preset drumbeat frequency level detection period, and determining the drumbeat frequency level of the current drumbeat frequency level detection period based on the number of drumbeats; and obtaining the maximum spectral energy of the drumbeats within the current drumbeat energy level detection period according to a preset drumbeat energy level detection period, and determining the drumbeat energy level of the current drumbeat energy level detection period based on the maximum spectral energy, specifically are as follows: When the preset drum frequency level detection cycle is reached, the drum beats with an energy difference greater than the preset first threshold within the current drum frequency level detection cycle are obtained, and the first drum beat is obtained. Based on the number of the first drumbeats, determine the drumbeat frequency level corresponding to the current drumbeat frequency level detection cycle; When the preset drum energy level detection period is reached, the maximum value of the sum of the spectral energy of each drum within the current drum energy level detection period is obtained, and the drum energy level corresponding to the current drum energy level detection period is determined based on the maximum value.

7. The method for linking interface lighting and scene lighting according to claim 1, characterized in that, The interface lighting display parameters include the display parameters of the left and right side spotlights and the display parameters of the bottom spotlight. The specific steps for determining the interface lighting display parameters for the next drum beat frequency level detection cycle based on the drum beat frequency level of the current drum beat frequency level detection cycle are as follows: Based on the display level and display rate corresponding to the drum frequency level in the current drum frequency level detection cycle, determine the display level and display rate of the left and right spotlights of the interface in the next drum frequency level detection cycle. Based on the display level corresponding to the drum frequency level in the current drum frequency level detection cycle, determine the display level of the bottom spotlight in the interface for the next drum frequency level detection cycle.

8. The method for linking interface lighting and scene lighting according to claim 1, characterized in that, The interface lighting display parameters include the interface bottom background light display parameters; The specific steps for determining the interface lighting display parameters for the next drumbeat energy level detection cycle based on the drumbeat energy level of the current drumbeat energy level detection cycle are as follows: The display level of the background light at the bottom of the interface is determined based on the display level corresponding to the drum energy level in the current drum energy level detection cycle. The transparency of the background light at the bottom of the interface is determined based on the maximum value of the spectral energy of each drumbeat within the current drumbeat energy level detection period.

9. The method for linking interface lighting and scene lighting according to claim 8, characterized in that, The method of determining the transparency of the background light at the bottom of the interface based on the maximum value of the sum of the spectral energy of each drumbeat within the current drumbeat energy level detection period is as follows: If the maximum value of the sum of the spectral energy of each drumbeat within the current drumbeat energy level detection period is less than or equal to the preset energy threshold, then the transparency of the background light at the bottom of the interface will be set to the preset transparency. If the maximum sum of the spectral energy of each drumbeat within the current drumbeat energy level detection period is greater than the preset energy threshold, then the transparency of the bottom background light is set according to the maximum sum of the spectral energy of each drumbeat within the current drumbeat energy level detection period.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the method as described in any one of claims 1-9.

Images