Control method and control system for lighting effects based on audio signals
Patent Information
- Application Number
- CN202211388378.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-11-07
- Publication Date
- 2026-09-01
- Estimated Expiration
- 2042-11-07
AI Technical Summary
[0002]音响和灯均属于家居用品,随着智能家居的普及,各家居用品之间的关联逐步加强,并且音响和灯也可以尝试进行相互控制,在现有技术中,音响接收灯的启动信号,并进行触发式启动,此时,音响和灯之间仅仅进行开启关联,并且音响无法对灯的灯效进行控制
[0006]在本发明实施例中,通过本发明实施例中的方法,采集音频信号,并对音频信号进行分帧处理,此时,记录相邻的两帧的偏移量;基于多个偏移量构建动态偏移坐标;在动态偏移坐标对音频信号进行处理,并获取对应的音频采样数据;基于音频采样数据解析,并确定对应的音频节奏点;根据音频节奏点动态调整灯效的变化状态,并根据偏移量调整灯效的持续时间;实时比较连续一段时间内偏移量的变化幅度,并基于偏移量的变化幅度调控灯效中亮暗程度,其中,基于相邻的两帧的偏移量对灯效进行变化控制,并且根据音频节奏点动态调整灯效的变化状态,并根据偏移量调整灯效的持续时间,以便于对灯效的变化形态和灯效的持续时间进行管控,也充分利用了偏移量的变化幅度调控灯效中亮暗程度,进而实现了音响对灯效的控制效果。
Smart Images

Figure CN115767845B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of lighting effect control technology, and in particular to a control method and control system for controlling lighting effects based on audio signals. Background Technology
[0002] Both speakers and lights are household appliances. With the popularization of smart homes, the connection between various household appliances is gradually strengthening, and speakers and lights can also be tested to control each other. In the current technology, the speaker receives the start signal of the light and triggers it to start. At this time, the speaker and the light are only connected to turn on, and the speaker cannot control the lighting effect of the light. Summary of the Invention
[0003] The purpose of this invention is to overcome the shortcomings of the prior art. This invention provides a control method and control system for controlling lighting effects based on audio signals. The lighting effect is controlled based on the offset between two adjacent frames, and the changing state of the lighting effect is dynamically adjusted according to the audio rhythm point. The duration of the lighting effect is also adjusted according to the offset, so as to control the changing form and duration of the lighting effect. It also makes full use of the change amplitude of the offset to regulate the brightness of the lighting effect, thereby realizing the control effect of sound on the lighting effect.
[0004] To address the aforementioned technical problems, this invention provides a method for controlling lighting effects based on audio signals, comprising: acquiring audio signals and performing frame-by-frame processing on the audio signals, while recording the offset between two adjacent frames; constructing dynamic offset coordinates based on multiple offsets; processing the audio signals at the dynamic offset coordinates and obtaining corresponding audio sampling data; parsing the audio sampling data and determining the corresponding audio rhythm points; dynamically adjusting the changing state of the lighting effects according to the audio rhythm points, and adjusting the duration of the lighting effects according to the offsets; comparing the magnitude of the offset changes over a continuous period of time in real time, and adjusting the brightness of the lighting effects based on the magnitude of the offset changes.
[0005] In addition, this invention also provides a control system for controlling lighting effects based on audio signals. The control system includes: a data acquisition module for acquiring audio signals and performing frame-by-frame processing, recording the offset between adjacent frames; a coordinate module for constructing dynamic offset coordinates based on multiple offsets; an audio module for processing the audio signals at the dynamic offset coordinates and acquiring corresponding audio sampling data; a sampling module for parsing the audio sampling data and determining the corresponding audio rhythm points; a lighting effect module for dynamically adjusting the lighting effect's state according to the audio rhythm points and adjusting the duration of the lighting effect according to the offset; and a control module for comparing the amplitude of offset changes over a continuous period and controlling the brightness of the lighting effect based on the amplitude of offset changes.
[0006] In this embodiment of the invention, an audio signal is acquired and processed into frames using the method described herein. The offset between two adjacent frames is recorded. A dynamic offset coordinate system is constructed based on multiple offsets. The audio signal is processed using the dynamic offset coordinate system to obtain corresponding audio sampling data. The audio sampling data is parsed to determine the corresponding audio rhythm points. The lighting effect's change state is dynamically adjusted according to the audio rhythm points, and the duration of the lighting effect is adjusted according to the offsets. The amplitude of the offset change over a continuous period is compared in real time, and the brightness of the lighting effect is adjusted based on the amplitude of the offset change. Specifically, the lighting effect is controlled based on the offset between two adjacent frames, and the lighting effect's change state is dynamically adjusted according to the audio rhythm points. The duration of the lighting effect is adjusted according to the offsets, which facilitates control over the changing form and duration of the lighting effect. It also fully utilizes the amplitude of the offset change to control the brightness of the lighting effect, thereby achieving the effect of sound control over the lighting effect. Attached Figure Description
[0007] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0008] Figure 1 This is a flowchart illustrating the control method for controlling lighting effects based on audio signals in an embodiment of the present invention.
[0009] Figure 2 This is a flowchart illustrating the offset of the control method for controlling lighting effects based on audio signals in an embodiment of the present invention.
[0010] Figure 3 This is a flowchart illustrating the control strategy of the control method for controlling lighting effects based on audio signals in an embodiment of the present invention.
[0011] Figure 4 This is a schematic diagram of the audio data flow in the audio signal-based lighting effect control method of the present invention embodiment;
[0012] Figure 5 This is a schematic diagram of the structural composition of the control system for controlling lighting effects based on audio signals in an embodiment of the present invention;
[0013] Figure 6 This is a hardware diagram of an electronic device according to an exemplary embodiment. Detailed Implementation
[0014] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.
[0015] Example
[0016] Please see Figures 1 to 4 A control method for lighting effects based on audio signals, the method comprising:
[0017] S11: Acquire audio signals and perform frame segmentation on the audio signals. At this time, record the offset between two adjacent frames.
[0018] In the specific implementation of this invention, the specific steps can be as follows:
[0019] S111: Acquire audio signals and input the audio signals into the frame segmentation model;
[0020] S112: The frame-segmentation model processes the audio signal into frames and outputs each frame. At this time, each frame represents the audio signal at each time interval.
[0021] S113: Compare two adjacent frames and record the offset between the two adjacent frames.
[0022] The frame segmentation model processes the audio signal into frames. It learns from previous frame segmentation data and outputs each frame. Each frame represents the audio signal at each time interval. For the offset, it compares two adjacent frames and records the offset between the two adjacent frames.
[0023] S12: Construct dynamic offset coordinates based on multiple offsets;
[0024] In the specific implementation of this invention, the specific steps can be as follows:
[0025] S121: Perform offset statistics on multiple offsets and generate corresponding markers;
[0026] S122: Establish dynamic offset coordinates and record the corresponding marks in the dynamic offset coordinates to form a dynamic offset curve;
[0027] S123: Records the rate of change of offset based on dynamic offset curve;
[0028] S124: A modulation strategy for the audio signal is triggered based on the rate of change of the offset.
[0029] This process involves statistically analyzing multiple offsets and generating corresponding markers, which are then recorded in a dynamic offset coordinate system to form a dynamic offset curve. Calculations are performed based on this dynamic offset curve, and the rate of change of the offsets is recorded. The rate of change of the offsets triggers an audio signal control strategy. Furthermore, the control strategy can address the stability of the audio signal, managing the input channel and dynamically detecting the input status of the audio signal.
[0030] S13: Process the audio signal at the dynamic offset coordinates and obtain the corresponding audio sampling data;
[0031] In the specific implementation of this invention, the specific steps can be as follows:
[0032] S131: Process the audio signal in the dynamic offset coordinate and record the turning points in the dynamic offset coordinate;
[0033] S132: Sample the audio signal at the corresponding turning point within the corresponding time period;
[0034] S133: Obtain the corresponding audio sampling data.
[0035] Specifically, the audio signal is processed in the dynamic offset coordinate system, and the turning points in the dynamic offset coordinate system are recorded. At this time, the turning points in the dynamic offset coordinate system are captured, and the audio signal at the corresponding turning point is sampled within the corresponding time period in order to obtain the corresponding audio sampling data.
[0036] S14: Based on the analysis of audio sampling data, determine the corresponding audio rhythm points;
[0037] In the specific implementation of this invention, the specific steps can be as follows: parse the audio sampling data and output data information; traverse the audio rhythm points in the data information and determine the corresponding audio rhythm points; locate the audio rhythm points and connect them to lighting effects. Specifically, lighting effects are controlled based on changes in the audio rhythm points, and the intensity is adjusted according to these changes to facilitate variations in the lighting effects.
[0038] S15: Dynamically adjust the changing state of the lighting effect according to the audio rhythm point, and adjust the duration of the lighting effect according to the offset.
[0039] In the specific implementation of this invention, the specific steps include: dynamically adjusting the changing state of the lighting effect according to the audio rhythm points; gradually verifying the changing state of the lighting effect as the audio rhythm points fluctuate; controlling the changing state of the lighting effect along the preset change logic, at which time the lighting effect evolves into a corresponding animation under the state change; adjusting the duration of the lighting effect according to the offset, at which time the duration of the lighting effect is determined based on the mapping between the offset and the duration table.
[0040] S16: Real-time comparison of the change range of offset over a continuous period of time, and adjustment of the brightness of the lighting effect based on the change range of offset.
[0041] In the specific implementation of this invention, the specific steps include: comparing the change range of the offset over a continuous period of time in real time; classifying the change range into different levels and outputting different change levels; and adjusting the brightness of the lighting effect based on the different change levels.
[0042] The method for controlling lighting effects based on audio signals further includes: obtaining the positions of the speakers and lights in the room; forming a fan-shaped area based on the positions between the speakers and lights, with the center between the speakers and lights as the center of the circle; arranging other lights based on the fan-shaped area, with all lights associated with the speakers; and triggering changes in the brightness of the lights by the volume output from the speakers.
[0043] In addition, the digital audio / analog audio signal sampling and spectrum algorithm and control software program, through the PWM control interface, output segmented data spectrum scanning control signals, which are transmitted to the intelligent external LED (RGB) system, and the LED (RGB) flashes and changes with the beat of the music (or other programs) to create an audio-visual scene.
[0044] In this embodiment of the invention, an audio signal is acquired and processed into frames using the method described herein. The offset between two adjacent frames is recorded. A dynamic offset coordinate system is constructed based on multiple offsets. The audio signal is processed using the dynamic offset coordinate system to obtain corresponding audio sampling data. The audio sampling data is parsed to determine the corresponding audio rhythm points. The lighting effect's change state is dynamically adjusted according to the audio rhythm points, and the duration of the lighting effect is adjusted according to the offsets. The amplitude of the offset change over a continuous period is compared in real time, and the brightness of the lighting effect is adjusted based on the amplitude of the offset change. Specifically, the lighting effect is controlled based on the offset between two adjacent frames, and the lighting effect's change state is dynamically adjusted according to the audio rhythm points. The duration of the lighting effect is adjusted according to the offsets, which facilitates control over the changing form and duration of the lighting effect. It also fully utilizes the amplitude of the offset change to control the brightness of the lighting effect, thereby achieving the effect of sound control over the lighting effect.
[0045] Example
[0046] Please see Figure 5 , Figure 5 This is a schematic diagram of the structure of the control system for controlling lighting effects based on audio signals in an embodiment of the present invention.
[0047] like Figure 5 As shown, a control system for controlling lighting effects based on audio signals includes:
[0048] Acquisition module 21: used to acquire audio signals and perform frame segmentation on the audio signals. At this time, the offset between two adjacent frames is recorded.
[0049] Coordinate module 22: Used to construct dynamic offset coordinates based on multiple offsets;
[0050] Audio module 23: Used to process audio signals at dynamic offset coordinates and acquire corresponding audio sampling data;
[0051] Sampling module 24: used to parse audio sampling data and determine the corresponding audio rhythm points;
[0052] Lighting Effect Module 25: Used to dynamically adjust the changing state of the lighting effect according to the audio rhythm point, and adjust the duration of the lighting effect according to the offset.
[0053] Control module 26: Used to compare the change range of offset over a continuous period of time in real time, and to control the brightness of the lighting effect based on the change range of offset.
[0054] This invention provides a control method and control system for controlling lighting effects based on audio signals. The method involves acquiring audio signals and performing frame-by-frame processing, recording the offset between adjacent frames; constructing dynamic offset coordinates based on multiple offsets; processing the audio signals at these dynamic offset coordinates to obtain corresponding audio sampling data; parsing the audio sampling data to determine the corresponding audio rhythm points; dynamically adjusting the lighting effect's state according to the audio rhythm points and adjusting the duration of the lighting effect based on the offsets; and comparing the amplitude of offset changes over a continuous period in real time, adjusting the brightness of the lighting effect based on the amplitude of offset changes. The method of controlling the lighting effect's changes based on the offsets between adjacent frames, dynamically adjusting the lighting effect's state according to the audio rhythm points, and adjusting the duration of the lighting effect based on the offsets allows for control over the lighting effect's shape and duration, fully utilizing the amplitude of offset changes to regulate the brightness of the lighting effect, thereby achieving audio-based control of the lighting effect.
[0055] Example
[0056] Please see Figure 6 See below for reference. Figure 6To describe an electronic device 40 according to this embodiment of the present invention. Figure 6 The electronic device 40 shown is merely an example and should not impose any limitation on the functionality and scope of use of the embodiments of the present invention.
[0057] like Figure 6 As shown, the electronic device 40 is manifested in the form of a general-purpose computing device. The components of the electronic device 40 may include, but are not limited to: at least one processing unit 41, at least one storage unit 42, and a bus 43 connecting different system components (including storage unit 42 and processing unit 41).
[0058] The storage unit stores program code, which can be executed by the processing unit 41 to perform the steps described in the "Embodiment Methods" section of this specification according to various exemplary embodiments of the present invention.
[0059] Storage unit 42 may include a readable medium in the form of a volatile storage unit, such as random access memory (RAM) 421 and / or cache memory 422, and may further include a read-only memory (ROM) 423.
[0060] Storage unit 42 may also include a program / utility 424 having a set (at least one) of program modules 425, including but not limited to: an operating system, one or more application programs, other program modules, and program data, each or some combination of these examples may include an implementation of a network environment.
[0061] Bus 43 can represent one or more of several types of bus structures, including a memory cell bus or memory cell controller, a peripheral bus, a graphics acceleration port, a processing unit, or a local bus using any of the multiple bus structures.
[0062] Electronic device 40 can also communicate with one or more external devices (e.g., keyboard, pointing device, Bluetooth device, etc.), and with one or more devices that enable a user to interact with electronic device 40, and / or with any device that enables electronic device 40 to communicate with one or more other computing devices (e.g., router, modem, etc.). This communication can be performed via input / output (I / O) interface 45. Furthermore, electronic device 40 can also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN), and / or public networks, such as the Internet) via network adapter 46. Figure 6 As shown, network adapter 46 communicates with other modules of electronic device 40 via bus 43. It should be understood that, although... Figure 6As not shown, other hardware and / or software modules may be used in conjunction with electronic device 40, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup control systems.
[0063] From the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein can be implemented by software or by combining software with necessary hardware. Therefore, the technical solutions according to the embodiments of this disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (such as a CD-ROM, USB flash drive, external hard drive, etc.) or on a network, including several instructions to cause a computing device (such as a personal computer, server, terminal device, or network device, etc.) to execute the methods according to the embodiments of this disclosure.
[0064] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be implemented by a program instructing related hardware. This program can be stored in a computer-readable storage medium, which may include: read-only memory (ROM), random access memory (RAM), a magnetic disk, or an optical disk, etc. Furthermore, it stores computer program instructions, which, when executed by a computer, cause the computer to perform the methods described above.
[0065] Furthermore, the above description of the control method and system for controlling lighting effects based on audio signals provided in the embodiments of the present invention has been detailed. Specific examples have been used to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only for the purpose of helping to understand the method and core ideas of the present invention. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of the present invention. Therefore, the content of this specification should not be construed as a limitation of the present invention.
Claims
1. A control method for lighting effects based on audio signals, characterized in that, include: Acquire audio signals and perform frame segmentation on the audio signals. At this time, record the offset between two adjacent frames. Dynamic offset coordinates are constructed based on multiple offsets; The audio signal is processed using dynamic offset coordinates, and the corresponding audio sampling data is obtained. Based on the analysis of audio sampling data, the corresponding audio rhythm points are determined; The lighting effects are dynamically adjusted based on the audio rhythm, and the duration of the lighting effects is adjusted based on the offset. The system compares the magnitude of the offset change over a continuous period of time in real time and adjusts the brightness of the lighting effects based on the magnitude of the offset change. The construction of dynamic offset coordinates based on multiple offsets includes: Perform offset statistics on multiple offsets and generate corresponding tags; Establish dynamic offset coordinates and record the corresponding marks in the dynamic offset coordinates to form a dynamic offset curve; The rate of change of offset is recorded based on the dynamic offset curve. The audio signal modulation strategy is triggered based on the rate of change of the offset.
2. The control method for lighting effects based on audio signals according to claim 1, characterized in that, The process involves acquiring audio signals and performing frame segmentation. During this process, the offset between two adjacent frames is recorded, including: Acquire audio signals and input them into the frame segmentation model; The frame-segmentation model processes the audio signal into frames and outputs each frame. Each frame represents the audio signal at each time interval. Compare two adjacent frames and record the offset between them.
3. The control method for lighting effects based on audio signals according to claim 2, characterized in that, The process of processing the audio signal at dynamic offset coordinates and obtaining the corresponding audio sampling data includes: The audio signal is processed using dynamic offset coordinates, and the turning points in the dynamic offset coordinates are recorded. The audio signal at the corresponding turning point is sampled within the corresponding time period; Obtain the corresponding audio sampling data.
4. The control method for lighting effects based on audio signals according to claim 3, characterized in that, The process of parsing audio sample data and determining the corresponding audio rhythm points includes: The audio sampling data is parsed and the data information is output. Traverse the audio rhythm points in the data information and determine the corresponding audio rhythm points; Locate the audio rhythm points and connect them to lighting effects.
5. The control method for lighting effects based on audio signals according to claim 4, characterized in that, The method of dynamically adjusting the lighting effect state according to the audio rhythm point and adjusting the duration of the lighting effect according to the offset includes: The lighting effects are dynamically adjusted according to the rhythm of the audio. The changes in the lighting effects are gradually verified as the audio rhythm fluctuates. The lighting effects are controlled according to the preset change logic, and the lighting effects evolve into corresponding animations as the state changes. The duration of the lighting effect is adjusted based on the offset. At this point, the duration of the lighting effect is determined based on the mapping between the offset and the duration table.
6. The control method for lighting effects based on audio signals according to claim 5, characterized in that, The real-time comparison of the change range of the offset over a continuous period of time, and the adjustment of the brightness of the lighting effect based on the change range of the offset, includes: Real-time comparison of the magnitude of offset change over a continuous period of time; The magnitude of change is categorized into different levels, and the different levels of change are output. The brightness of the lighting effect is adjusted based on different levels of variation.
7. The control method for lighting effects based on audio signals according to claim 6, characterized in that, The control method for lighting effects based on audio signals also includes: Find the locations of the speakers and lights in the room; A fan-shaped area is formed based on the position between the speaker and the light, with the center between the speaker and the light serving as the center of the circle; Additional lights are arranged in a fan-shaped area, and all lights are linked to audio equipment; The brightness of the light is triggered by the volume output from the speaker.
8. A control system for controlling lighting effects based on audio signals, characterized in that, The control system based on audio signal-controlled lighting effects includes: Acquisition module: Used to acquire audio signals and perform frame segmentation on the audio signals. At this time, the offset between two adjacent frames is recorded. Coordinate module: Used to construct dynamic offset coordinates based on multiple offsets; Audio module: Used to process audio signals at dynamic offset coordinates and acquire corresponding audio sampling data; Sampling module: Used to parse audio sample data and determine the corresponding audio rhythm points; Lighting effects module: Used to dynamically adjust the changing state of lighting effects according to the audio rhythm points, and adjust the duration of lighting effects according to the offset; Control module: Used to compare the change in offset over a continuous period of time in real time, and to adjust the brightness of the lighting effect based on the change in offset. The construction of dynamic offset coordinates based on multiple offsets includes: Perform offset statistics on multiple offsets and generate corresponding tags; Establish dynamic offset coordinates and record the corresponding marks in the dynamic offset coordinates to form a dynamic offset curve; The rate of change of offset is recorded based on the dynamic offset curve. The audio signal modulation strategy is triggered based on the rate of change of the offset.
Citation Information
Patent Citations
Method, device and system for controlling lighting effect and storage medium
CN112261767A
Audio control lamp effect method, device and system and storage medium
CN114096047A