Sound control rhythm guide lamp system, interaction system and dual-mode interaction method

Abstract

The invention discloses a sound control rhythm guide lamp system, an interaction system and a dual-mode interaction method, and relates to the technical field of intelligent illumination control. The sound control rhythm guide lamp system comprises an acoustic sensing module, a core control module, a lighting effect execution module, a communication interaction module and a dormancy control module. The acoustic sensing module synchronously collects environment sound and separates semantic instructions from rhythm features; the core control module performs corresponding processing according to whether a semantic instruction exists or not, calls a preset lighting effect when the semantic instruction exists, and converts the rhythm characteristic into a dimming instruction when the semantic instruction does not exist; the lighting effect execution module converts the instruction into a dynamic light field; the communication interaction module receives user-defined settings; and the dormancy control module realizes energy conservation. According to the invention, dual-mode interaction of semantics and rhythms is realized, the anti-interference capability is high, the energy-saving effect is good, accurate guidance and feedback can be provided in scenes such as voice rehabilitation training, and the flexibility, adaptability and practicability of the system are improved.

Description

Technical Field

[0001] The present invention relates to the field of intelligent lighting control technology, and in particular to a voice-controlled rhythmic guidance light system, an interactive system, and a dual-mode interaction method. Background Art

[0002] Existing intelligent lighting systems have limitations in voice-controlled interaction. They are often limited to responding to semantic commands or simply following the rhythm of sound, failing to achieve efficient dual-mode interaction combining semantic commands with rhythmic features. During the interaction process, they are susceptible to electromagnetic interference, which can affect the accuracy of sound signal acquisition and processing. Furthermore, they lack intelligent sleep control mechanisms, resulting in energy waste. Furthermore, in specific scenarios such as speech rehabilitation training, existing systems struggle to accurately correlate speech speed with lighting fluctuations and provide effective feedback, failing to meet personalized and specialized needs. Summary of the Invention

[0003] The purpose of the present invention is to provide a voice-controlled rhythmic guidance light system, an interactive system and a dual-mode interaction method, aiming to solve the technical problems existing in the existing intelligent lighting system in dual-mode processing, anti-interference, energy saving and specific scenario applications of voice-controlled interaction.

[0004] To solve the above problem, according to one aspect of the present application, an embodiment of the present invention provides a sound-controlled rhythmic guidance light system, comprising:

[0005] Acoustic perception module, used to synchronously collect environmental sounds and separate semantic instructions from rhythmic features;

[0006] The core control module is connected to the acoustic perception module via a high-speed data bus and is configured as follows:

[0007] Receive semantic instructions and rhythm feature signals output by the acoustic perception module;

[0008] When semantic instructions exist, the rhythm feature signal is forced to be overwritten and the preset light effect is called;

[0009] When the semantic instruction does not exist, the rhythm feature signal is converted into a PWM dimming instruction;

[0010] A light effect execution module, connected to the core control module via a PWM signal interface, for converting light effect instructions into a spatial dynamic light field;

[0011] The communication interaction module is wirelessly connected to the user terminal and is used to receive the custom instruction library and parameter configuration;

[0012] A sleep control module, electrically connected to the acoustic perception module and the core control module, for cutting off power supply to non-essential modules when silence times out;

[0013] Among them, the acoustic perception module, core control module, light effect execution module, communication interaction module and sleep control module are integrated into the same shell, and the acoustic perception module is located in the central area of ​​the top of the device.

[0014] In some embodiments, the acoustic perception module includes a full-range pickup unit and a voice recognition chip. The full-range pickup unit is coaxially arranged directly above the voice recognition chip. The two are physically isolated from the core control module by an electromagnetic shielding structure. The electromagnetic shielding structure includes multiple layers of metal grids, and the layers are filled with insulating materials with a dielectric constant of ≤2.3.

[0015] In some embodiments, the core control module includes a priority decision logic unit and a rhythm analysis unit, and the priority decision logic unit and the rhythm analysis unit are connected in parallel to a signal distribution node, which is respectively connected to the output end of the acoustic perception module and the driving circuit of the light effect execution module through a dual-channel data line.

[0016] In some embodiments, the rhythm analysis unit extracts the energy peak of the 80-240 Hz frequency band as a rhythm reference through a fast Fourier transform algorithm, dynamically ignores transient noise pulses with a duration of less than 50 ms, and outputs a synchronous dimming signal to the light effect execution module; and / or,

[0017] The priority decision logic unit implements the following conflict handling rules:

[0018] When a semantic instruction is detected, the output of the rhythm analysis unit is immediately interrupted, and the light effect parameters corresponding to the semantic instruction are written into the light effect execution module;

[0019] When the semantic instruction ended, the environmental rhythmic response pattern was automatically restored.

[0020] In some embodiments, the light effect execution module includes an RGB LED array and an acrylic diffusion lampshade, and the inner surface of the acrylic diffusion lampshade is provided with a wavy optical microstructure with a period of 0.5-2mm and a depth of 0.1-0.3mm, and the refractive index gradient difference is ≥0.2.

[0021] In some embodiments, the sleep control module collects the output signal energy of the acoustic perception module in real time through the signal monitoring bus. If the output signal energy is continuously lower than -50dB, the sleep control module sends a sleep instruction to the core control module to cut off the power supply to the light effect execution module; and / or,

[0022] The dynamic light effect instruction includes three-dimensional light effect parameters, driving the RGB LED array to achieve at least one of radial rotating light spots, ripple diffusion effects, and beat synchronized flashing.

[0023] In some embodiments, the communication interaction module supports low-power Bluetooth or WiFi protocol, and is used to receive a custom keyword instruction library, a rhythm sensitivity threshold, and an energy-saving sleep duration parameter issued by a user terminal; and / or,

[0024] When the system is applied to speech rehabilitation training, it is configured to convert the user's speaking speed rhythm into the light fluctuation frequency, and the ratio coefficient K of frequency to speaking speed is adjustable from 0.8 to 1.2, with an adjustment step of 0.05. The user terminal displays the matching score of speaking speed and light frequency in real time.

[0025] An embodiment of the present invention provides an acoustic-optical interaction system, comprising the above-described voice-controlled rhythm guidance light system and a user terminal, wherein the user terminal is configured to send rehabilitation training parameters to the communication interaction module, including a speech rate-optical frequency mapping curve and an error tolerance threshold.

[0026] An embodiment of the present invention provides a dual-mode interaction method for a voice-controlled rhythmic guidance light, which is applied to the voice-controlled rhythmic guidance light system described above and is characterized by comprising the following steps:

[0027] The acoustic perception module collects semantic and rhythmic features of environmental sounds in parallel;

[0028] When a preset keyword is recognized, the light effect mode mapped by the semantic instruction is called to overwrite the current state;

[0029] When no semantic instructions are detected, rhythm features are extracted and synchronized light effect instructions are generated;

[0030] The light effect execution module converts the light effect instructions into a dynamic light field.

[0031] In some embodiments, the rhythm feature extraction step includes: separating the energy peak in the 80-240 Hz frequency band by using a fast Fourier transform algorithm, dynamically ignoring transient noise pulses with a duration of less than 50 ms, and generating a PWM dimming signal based on the peak frequency; and / or,

[0032] The semantic instruction execution step includes:

[0033] Interrupting the output of the rhythm analysis unit through the priority decision logic unit and writing the light effect parameters corresponding to the semantic instruction into the driving circuit of the light effect execution module; and / or,

[0034] When applied to speech rehabilitation training, the ratio coefficient K between the light fluctuation frequency and the user's speaking speed is dynamically adjusted with an adjustment step of 0.05, and the matching score is calculated in real time.

[0035] Compared with the prior art, the voice-controlled rhythmic guidance light system of the present invention has at least the following beneficial effects:

[0036] The embodiment of the present invention discloses a voice-controlled rhythmic guidance light system, which realizes dual-mode interaction of semantic instructions and rhythmic characteristics, can respond to the semantic instructions of the user, and follow the changes in the rhythm of the environment, thereby improving the flexibility and adaptability of the system; the acoustic perception module adopts an electromagnetic shielding structure, which reduces electromagnetic interference and improves the accuracy of sound signal acquisition and processing; the priority processing mechanism of the core control module ensures the priority execution of semantic instructions, avoids signal conflicts, and improves the response efficiency of user operations; the light effect execution module presents a uniform, soft and diverse dynamic light field through a special optical structure design, which enhances the user's visual experience; it has an intelligent sleep control module, which effectively reduces energy consumption and extends the service life of the equipment; the communication interaction module supports user-defined settings, meets personalized needs, and can provide accurate guidance and feedback in specific scenarios such as speech rehabilitation training, thereby improving the practicality of the system.

[0037] The above description is only an overview of the technical solution of the present invention. In order to more clearly understand the technical means of the present invention and implement it according to the contents of the specification, the following is a detailed description of the preferred embodiments of the present invention with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0039] Figure 1 A schematic diagram of module connections for a voice-controlled rhythmic guidance light system according to an embodiment of the present invention;

[0040] Figure 2 A schematic diagram of the structure of the RGB LED array of the voice-controlled rhythmic guidance light system provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0041] To further illustrate the technical means and effects employed by the present invention to achieve its intended objectives, the following detailed description of the specific implementation methods, structures, features, and effects of the present invention is provided in conjunction with the accompanying drawings and preferred embodiments. In the following description, different references to "one embodiment" or "embodiment" do not necessarily refer to the same embodiment. Furthermore, specific features, structures, or characteristics of one or more embodiments may be combined in any suitable manner.

[0042] In the description of the present invention, it should be clarified that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence; the terms "vertical", "transverse", "longitudinal", "front", "back", "left", "right", "up", "down", "horizontal", etc. indicating directions or positional relationships are based on the directions or positional relationships shown in the drawings, and are only for the convenience of describing the present invention, and do not mean that the devices or elements referred to must have a specific direction or position, and therefore cannot be understood as limiting the present invention.

[0043] In the description of the present invention, it should be noted that, unless otherwise specified or limited, the terms "mounted," "connected," and "connected" should be understood broadly. For example, they may refer to fixed, detachable, or integral connections; mechanical or electrical connections; and direct or indirect connections through an intermediary. Those skilled in the art will understand the specific meanings of the above terms in the present invention based on the specific circumstances.

[0044] like Figure 1-2 As shown, an embodiment of the present invention provides a sound-controlled rhythm guidance light system, comprising:

[0045] Acoustic perception module, used to synchronously collect environmental sounds and separate semantic instructions from rhythmic features;

[0046] The core control module is connected to the acoustic perception module via a high-speed data bus and is configured as follows:

[0047] Receive semantic instructions and rhythm feature signals output by the acoustic perception module;

[0048] When semantic instructions exist, the rhythm feature signal is forced to be overwritten and the preset light effect is called;

[0049] When the semantic instruction does not exist, the rhythm feature signal is converted into a PWM dimming instruction;

[0050] A light effect execution module, connected to the core control module via a PWM signal interface, for converting light effect instructions into a spatial dynamic light field;

[0051] The communication interaction module is wirelessly connected to the user terminal and is used to receive the custom instruction library and parameter configuration;

[0052] A sleep control module, electrically connected to the acoustic perception module and the core control module, for cutting off power supply to non-essential modules when silence times out;

[0053] Among them, the acoustic perception module, core control module, light effect execution module, communication interaction module and sleep control module are integrated into the same shell, and the acoustic perception module is located in the central area of ​​the top of the device.

[0054] In this embodiment, the operation of the voice-controlled rhythmic guidance light system begins with the synchronous collection of ambient sound by the acoustic perception module. During this process, it can accurately separate the semantic instructions and rhythmic features, and then transmit these two types of signals to the core control module through a high-speed data bus. After receiving the signal, the core control module will first determine whether there is a semantic instruction: if there is a semantic instruction, it will forcibly overwrite the rhythmic feature signal and directly call the preset light effect mode; if there is no semantic instruction, the rhythmic feature signal will be converted into a PWM dimming instruction and sent to the light effect execution module. After receiving the instruction through the PWM signal interface, the light effect execution module will convert it into a spatial dynamic light field, thereby presenting the corresponding lighting effect.

[0055] At the same time, the communication interaction module always maintains a wireless connection with the user terminal, and is responsible for receiving the custom instruction library and various parameter configurations issued by the user, so that the system can be personalized according to user needs. The sleep control module is electrically connected to the acoustic perception module and the core control module respectively. It will monitor the ambient sound status in real time. When it detects that the silent state has timed out, it will cut off the power supply to non-essential modules to achieve the purpose of energy saving. In addition, the system's acoustic perception module, core control module, light effect execution module, communication interaction module and sleep control module are integrated into the same housing, and the acoustic perception module is located in the top center area of ​​the device. This design helps to improve the accuracy of acoustic collection and the integrity of the device.

[0056] This embodiment first utilizes the synchronous acquisition and separation capabilities of the acoustic perception module to achieve parallel processing of semantic commands and rhythmic features, laying the foundation for dual-mode interaction and enabling the system to both respond to specific commands and adapt to changes in the environmental rhythm. Secondly, the core control module's priority processing mechanism ensures the prioritized execution of semantic commands, avoiding conflicts between different signals and improving the efficiency and accuracy of user operation responses. The lighting effect execution module converts commands into spatial dynamic light fields, enriching the lighting expression and providing users with a more immersive visual experience. The presence of the communication interaction module greatly enhances the system's flexibility, allowing users to customize settings according to their preferences to meet diverse needs. The energy-saving design of the sleep control module effectively reduces energy consumption and extends the device's service life while ensuring normal system operation. The integrated design of each module and the rational layout of the acoustic perception module not only reduce the device's size but also improve the sensitivity and stability of acoustic acquisition, making the entire system more efficient and reliable.

[0057] In some embodiments, the acoustic perception module includes a full-range pickup unit and a voice recognition chip. The full-range pickup unit is coaxially arranged directly above the voice recognition chip. The two are physically isolated from the core control module by an electromagnetic shielding structure. The electromagnetic shielding structure includes multiple layers of metal grids, and the layers are filled with insulating materials with a dielectric constant of ≤2.3.

[0058] In this embodiment, the acoustic perception module consists of a full-range sound pickup unit and a voice recognition chip. The full-range sound pickup unit is coaxially positioned directly above the voice recognition chip. This structural layout ensures a more direct path for sound acquisition and transmission to the recognition chip, reducing sound loss and distortion during propagation, allowing the voice recognition chip to more accurately receive and process sound signals. Furthermore, the full-range sound pickup unit and voice recognition chip are physically isolated from the core control module by an electromagnetic shielding structure consisting of multiple layers of metal mesh, with insulating material with a dielectric constant of ≤2.3 filling the interlayers.

[0059] During operation, the full-range pickup unit is responsible for collecting various sound signals from the surrounding environment. Due to its coaxial configuration with the voice recognition chip, the collected sound can be transmitted to the voice recognition chip with better quality. The voice recognition chip processes the received sound signals, separating the semantic instructions and rhythmic characteristics. The electromagnetic shielding structure plays a key role in this process. The multi-layer metal mesh can effectively block the electromagnetic radiation generated by the core control module during operation, preventing it from interfering with the full-range pickup unit and the voice recognition chip. The low dielectric constant insulating material filled between the layers further enhances the shielding effect, reduces the electromagnetic coupling between the different layers of metal mesh, and ensures the purity of the sound signal processing environment.

[0060] This embodiment improves the efficiency and accuracy of sound collection and transmission by coaxially arranging the full-frequency pickup unit and the voice recognition chip, providing high-quality raw data for subsequent signal processing. The application of the electromagnetic shielding structure greatly reduces the impact of electromagnetic interference generated by other components such as the core control module on the acoustic perception module, enabling the voice recognition chip to more stably and accurately separate semantic instructions and rhythmic features, thereby improving the reliability of the entire system in sound signal processing. The selection of insulating materials with low dielectric constants further optimizes the shielding performance and ensures the effectiveness of the shielding structure, allowing the acoustic perception module to maintain a good working condition in a complex electromagnetic environment, providing a strong guarantee for the stable operation of the system.

[0061] In some embodiments, the core control module includes a priority decision logic unit and a rhythm analysis unit, and the priority decision logic unit and the rhythm analysis unit are connected in parallel to a signal distribution node, which is respectively connected to the output end of the acoustic perception module and the driving circuit of the light effect execution module through a dual-channel data line.

[0062] In this embodiment, the core control module includes a priority decision logic unit and a rhythm analysis unit. These two units are connected in parallel to the signal distribution node, which is connected to the output end of the acoustic perception module and the driving circuit of the light effect execution module through a dual-channel data line.

[0063] During operation, the semantic instructions and rhythmic feature signals output by the acoustic perception module are first transmitted to the signal distribution node, which distributes these signals simultaneously to the priority decision logic unit and the rhythm analysis unit, enabling parallel processing of both signals. The priority decision logic unit is primarily responsible for determining the presence of semantic instructions and performing corresponding priority processing when such instructions are present. The rhythm analysis unit focuses on analyzing and processing the rhythmic feature signals to extract valid rhythmic information. The processed signals are then transmitted through the signal distribution node via a dual-channel data line to the driver circuit of the light effect execution module, thereby driving the light effect execution module.

[0064] This embodiment enables the system to process semantic instructions and rhythm features simultaneously through the parallel connection of the priority decision logic unit and the rhythm analysis unit, greatly improving the working efficiency of the core control module and reducing the delay of signal processing. The setting of the signal distribution node plays a role in efficient signal distribution and transmission, ensuring that the signal can be accurately and promptly transmitted to each processing unit and drive circuit. The use of dual-channel data lines enhances the stability and speed of signal transmission, avoids the congestion or signal loss problems that may occur in single-channel transmission, ensures that the light effect execution module can quickly respond to the instructions of the core control module, and improves the reaction sensitivity of the entire system. In addition, this structural layout also makes the functional division of the core control module clearer, facilitates subsequent maintenance and upgrades, and enhances the scalability and adaptability of the system.

[0065] In some implementations, the fast Fourier transform algorithm uses a 2048-point sampling window, a Hanning window function, a frequency resolution of 5.4 Hz, and updates the spectrum analysis results every 200 ms.

[0066] In this embodiment, the system uses a 2048-point sampling window combined with a Hanning window function for spectrum analysis, achieving a frequency resolution of 5.4Hz, and updating the analysis results every 200ms. The specific operating process is as follows: After the acoustic perception module collects the ambient sound signal, the analog-to-digital converter converts the analog signal into a digital sequence, and the processor uses the fast Fourier transform algorithm to perform a fast Fourier transform on 2048 consecutive sampling points. The Hanning window function reduces spectral leakage through weighted processing, making the amplitude detection of frequency components more accurate. The 5.4Hz frequency resolution means that the system can distinguish between adjacent 5.4Hz frequency differences, for example, it can recognize the pitch change between 300Hz and 305.4Hz. The analysis results are updated every 200ms, ensuring that the system's response delay to voice commands and ambient sound changes is controlled within 200ms to meet real-time interaction requirements.

[0067] First, the 2048-point sampling window strikes a balance between computational effort and frequency resolution, nearly doubling the frequency resolution compared to 1024-point sampling while avoiding the increased processing latency associated with 4096-point sampling. The introduction of the Hanning window function effectively suppresses sidelobe effects, enabling accurate identification of target frequency components even in complex environments (such as those with background noise). For example, when a user issues a voice command such as "lower brightness," the system accurately captures changes in the fundamental frequency and formant through FFT analysis, unaffected by interference from other frequency components in the environment.

[0068] The update frequency of every 200ms takes into account both real-time performance and computing resource usage. In speech rehabilitation training scenarios, the system needs to track changes in the user's speaking speed in real time. The 200ms update cycle can capture frequency changes 5 times per second, which is sufficient to meet the feedback needs of speech speed adjustment. At the same time, this update frequency will not cause excessive processor load, ensuring that the system remains stable during long-term operation. For example, in a medical rehabilitation environment, the system can continuously monitor the patient's pronunciation frequency and provide visual feedback by dynamically adjusting the light flashing frequency to help patients correct their pronunciation rhythm.

[0069] Analog-to-digital conversion uses a 24-bit ADC with a sampling rate of 44.1kHz; Hanning window weighting reduces spectral leakage by 40%; FFT calculation is performed after 80-240Hz bandpass filtering; dynamic threshold detection: rhythm recognition is triggered when the signal-to-noise ratio is greater than 15dB.

[0070] Compared with 1024-point sampling, the frequency resolution is improved by 53%; the 200ms period meets the ISO 9241-110 interactive response standard; and the signal-to-noise ratio control reduces the false trigger rate to less than 0.5%.

[0071] The Hanning window function of the fast Fourier transform algorithm satisfies:

[0072] w(n)=0.5(1-cos(2πn / (N-1))),

[0073] Where N=2048, n∈[0,N-1].

[0074] When the algorithm runs on the STM32H743 chip, the spectrum analysis results are updated every 200ms with a frequency resolution of 5.4Hz.

[0075] Signal processing flow:

[0076] The ADC acquires the audio signal at a sampling rate of 44.1kHz;

[0077] Pre-emphasis filtering (coefficient α = 0.95) compensates for high-frequency attenuation;

[0078] Perform FFT after Hanning window framing;

[0079] The energy peaks in the 80-240 Hz frequency band were extracted, and transient pulses lasting <50 ms were ignored.

[0080] In some embodiments, the rhythm analysis unit extracts the energy peak in the 80-240 Hz frequency band as a rhythm reference through a fast Fourier transform algorithm, dynamically ignores transient noise pulses with a duration of less than 50 ms, and outputs a synchronous dimming signal to the light effect execution module.

[0081] In this embodiment, during operation, the rhythm analysis unit receives rhythm feature signals from the acoustic perception module and processes these signals using the fast Fourier transform (FFT) algorithm. This algorithm can convert time-domain sound signals into frequency-domain signals, thereby more clearly presenting the energy distribution of different frequency bands. The rhythm analysis unit focuses on a specific frequency band of 80-240Hz. After testing, the selection of the 80-240Hz frequency band enables the accuracy of rhythm recognition to reach 92.4% in a 65dB noise environment (compared to 78.2% for the 60-500Hz frequency band). This frequency band usually contains important information related to human voices, music rhythms, etc. in the environment. By extracting the energy peak of this frequency band and using it as a rhythm benchmark, the rhythm characteristics of the environmental sound can be accurately captured.

[0082] At the same time, the rhythm analysis unit also has the ability to dynamically identify and filter transient noise. When transient noise pulses with a duration of less than 50ms are detected, it will determine these pulses as irregular interference signals and automatically ignore them to prevent these noises from interfering with the extraction of the rhythm benchmark, ensuring that the extracted rhythm information is purer and more accurate. After completing the extraction and filtering of the rhythm features, the rhythm analysis unit will generate a synchronous dimming signal based on the obtained rhythm benchmark and output it to the light effect execution module to control the lighting effect to keep in sync with the rhythm.

[0083] This embodiment uses the fast Fourier transform algorithm to provide strong technical support for the extraction of rhythm features. Its efficient spectrum analysis capability enables the system to accurately identify the energy peaks in the 80-240Hz frequency band, ensuring the accuracy and reliability of the rhythm benchmark. The filtering of transient noise pulses with a duration of less than 50ms effectively improves the system's anti-interference ability, reduces the misoperation of lights due to sudden noise, and makes the changes in lighting effects more stable and in line with expectations. The generated synchronous dimming signal can ensure that the lighting effects presented by the light effect execution module are highly synchronized with the rhythm of the ambient sound. Whether it is following the beat during music playback or echoing the speed of speech in daily communication, it can bring a more coordinated and immersive sensory experience, enhancing the interactivity and adaptability of the system to the environment.

[0084] In some embodiments, the light effect execution module includes an RGB LED array and an acrylic diffusion lampshade, and the inner surface of the acrylic diffusion lampshade is provided with a wavy optical microstructure with a period of 0.5-2mm and a depth of 0.1-0.3mm, and the refractive index gradient difference is ≥0.2.

[0085] In this embodiment, the light effect execution module is composed of an RGB LED array and an acrylic diffusion lampshade, wherein the inner surface of the acrylic diffusion lampshade is provided with a special wavy optical microstructure with a period of 0.5-2mm, a depth of 0.1-0.3mm, and a refractive index gradient difference ≥0.2.

[0086] During operation, the lighting effect execution module receives lighting effect commands from the core control module via a PWM signal interface. These commands drive the RGB LED array. The RGB LED array emits three primary colors: red, green, and blue. By mixing these colors in varying proportions, a rich variety of colors can be produced to meet the lighting effect requirements of different scenarios. Light from the RGB LED array is directed toward the acrylic diffuser lampshade. When the light contacts the wavy optical microstructures on the inner surface of the lampshade, optical phenomena such as refraction, reflection, and scattering occur. The carefully designed period and depth of the microstructures homogenize the light, making it more dispersed during propagation and avoiding areas of excessive brightness or darkness. Furthermore, a refractive index gradient of ≥0.2 ensures sufficient refraction at the microstructure interface, further enhancing the light diffusion capability, ultimately creating a uniform, soft, and dynamically changing spatial dynamic light field. This refractive index gradient of ≥0.2 achieves a light uniformity of 92.4% (compared to 83.1% for conventional lampshades).

[0087] This embodiment uses an RGB LED array to provide the system with rich color expression capabilities, capable of presenting a variety of lighting colors according to different instructions and scenarios, greatly improving the aesthetics and adaptability of the lighting effect. The wavy optical microstructure on the inner surface of the acrylic diffusion lampshade is the key to achieving a high-quality light field. The specific period and depth parameters ensure that the light can be effectively diffused and uniformed, reducing the occurrence of glare, making the light softer and more comfortable, and protecting the user's eyesight. The design of the refractive index gradient difference further optimizes the propagation path of light, making the spatial distribution of the dynamic light field more reasonable and the lighting effect more delicate and natural. Whether used for atmosphere creation or interactive guidance, it can bring users an excellent visual experience.

[0088] In some embodiments, the cross section of the wavy optical microstructure is a sine curve, forming concentric circles in the radial direction of the lampshade, and the gradient coefficient of the distance between adjacent corrugations is 0.85-1.15.

[0089] In this embodiment, the lampshade of this system utilizes a sinusoidal wavy optical microstructure, forming concentric circles in the radial direction. The spacing between adjacent ripples varies gradually by a factor of 0.85-1.15. Specifically, as light from an LED passes through the acrylic wavy microstructure, the sinusoidal cross-section causes the light to refract and scatter at varying angles at different locations. The concentric ripples create a radially symmetrical optical path, and the gradually varying spacing factor causes the light's propagation path length to vary at different radii, creating a dynamically changing light field effect in space.

[0090] This optical design offers unique advantages in practical applications. The sinusoidal microstructure transforms a point light source into a diffuse surface light source while preserving the light's directionality. For example, in speech rehabilitation training, the system can adjust LED light intensity based on the patient's pronunciation frequency. The wavy microstructure diffuses the light into radially rotating ripples, allowing the patient to intuitively perceive the accuracy of their pronunciation rhythm by observing the dynamic light effects. The gradual change in the spacing between adjacent ripples further enhances the layering of the light field, creating a visual effect similar to the diffusion of water ripples in entertainment scenarios, enhancing user immersion.

[0091] Acrylic material balances optical performance and mechanical strength. It offers excellent light transmittance and impact resistance, making it suitable for lampshades. The wavy microstructure is produced using an injection molding process. Precise control of mold parameters allows for a precise gradient in the ripple pitch. For example, a gradient coefficient of 0.85-1.15 allows for flexible adjustment of lighting effects in different application scenarios. A smaller gradient coefficient can be used for a strong visual impact, while a larger gradient coefficient can provide softer visual feedback in medical rehabilitation settings.

[0092] The wavy optical microstructure:

[0093] The cross section is a sinusoidal curve (amplitude 0.2mm); radial concentric circle distribution (spacing tolerance ±5μm)

[0094] The refractive index gradient difference is achieved by doping nano-SiO2 to achieve a surface roughness Ra < 0.05μm.

[0095] Light uniformity: 92.4% (measured according to CIE standards); color difference ΔE <1.5 (under D65 illuminant); glare index (UGR) <16. The acrylic diffuser lampshade is doped with nano-SiO2 at a concentration of 0.5-1.2wt%, with a particle size distribution of D50 = 50nm. When the nano-SiO2 doping concentration is 0.5-1.2wt%, light uniformity reaches 92.4% ± 0.5% (compared to 83.1% for the undoped control).

[0096] In some embodiments, the priority decision logic unit implements the following conflict handling rules:

[0097] When a semantic instruction is detected, the output of the rhythm analysis unit is immediately interrupted, and the light effect parameters corresponding to the semantic instruction are written into the light effect execution module;

[0098] When the semantic instruction ended, the environmental rhythmic response pattern was automatically restored.

[0099] In this embodiment, the priority decision logic unit plays a key role in conflict resolution during system operation. After the acoustic perception module collects and separates semantic instructions from ambient sound, these instructions are transmitted to the priority decision logic unit. At this point, the priority decision logic unit immediately activates its processing mechanism. Once the presence of a semantic instruction is detected, it quickly interrupts the output of the rhythm analysis unit, ensuring that the rhythmic characteristic signals processed by the rhythm analysis unit do not interfere with the execution of the current semantic instruction.

[0100] Next, the priority decision logic unit accurately writes the lighting effect parameters corresponding to the semantic instruction into the lighting effect execution module, driving the lighting effect execution module to operate according to the preset lighting effect mode. For example, when the user issues the "turn on the lights" command, the system will immediately execute the lighting effect, regardless of the current environmental rhythm. When the semantic instruction is executed, that is, after the user's instruction operation is completed, the priority decision logic unit automatically switches its operating mode to the environmental rhythm response mode. At this time, the output of the rhythm analysis unit is re-effective, and the lighting effect execution module continues to render the corresponding lighting effect according to the rhythmic characteristics of the environment.

[0101] First, this embodiment ensures the priority execution of semantic instructions. When the user issues a clear operation instruction, the system can respond quickly, avoiding the interference of rhythm characteristic signals, allowing the user's control intention to be realized in a timely and accurate manner, and improving the convenience and effectiveness of user operations. Secondly, after the semantic instruction ends, the environmental rhythm response mode is automatically restored, without the user having to perform additional operation switching, ensuring the consistency and smoothness of system operation and reducing the user's operating burden. This intelligent conflict handling mechanism enables the system to seamlessly switch between active user control and passive following of the environmental rhythm, greatly enhancing the system's practicality and user experience, and allowing the system to demonstrate good adaptability and reliability in various usage scenarios.

[0102] In some embodiments, the sleep control module collects the output signal energy of the acoustic perception module in real time through the signal monitoring bus. If it is lower than -50dB for 30 seconds, a sleep instruction is sent to the core control module to cut off the power supply to the light effect execution module.

[0103] In this embodiment, the sleep control module maintains a real-time connection with the acoustic perception module via a signal monitoring bus during operation, continuously collecting the energy of the acoustic perception module's output signal. It monitors and analyzes the collected signal energy in real time to determine whether the current environment is silent.

[0104] If the acoustic sensing module detects that the output signal energy level remains below -50dB for 30 consecutive seconds, the sleep control module determines that the system is in a silent state due to prolonged inactivity and sends a sleep command to the core control module. Upon receiving the sleep command, the core control module shuts off power to the light effect execution module, putting it into a sleep state to reduce unnecessary energy consumption. If the acoustic sensing module detects a valid sound signal again, and its energy level exceeds -50dB, the sleep control module will cancel the sleep command, and the core control module will restore power to the light effect execution module, resuming normal operation.

[0105] First, this embodiment can achieve intelligent energy saving of the system. By real-time monitoring of the ambient sound status, when no one is using the system for a long time or there is no effective sound signal, the power supply to the light effect execution module is promptly cut off, thereby avoiding energy waste and extending the battery life and service life of the device. Secondly, the 30-second continuous monitoring time and -50dB energy threshold setting are relatively reasonable, which not only avoids the false triggering of sleep due to short silence, ensuring the stability of the system during normal use, but also can start sleep in a real silent state in time, balancing the relationship between energy saving and ease of use. In addition, the collaborative work of the sleep control module and other modules makes the energy consumption management of the entire system more efficient and intelligent, improving the overall performance of the system and user satisfaction.

[0106] In some embodiments, the sleep control module adopts a three-level sleep mechanism: the first level sleep cuts off the power supply of the LED array, the second level sleep turns off the radio frequency of the communication module, and the third level sleep maintains the acoustic perception module operating at a 10% sampling rate.

[0107] In this embodiment, the sleep control module of the system adopts a three-level sleep mechanism: the first level of sleep cuts off the power supply to the LED array, the second level of sleep turns off the radio frequency of the communication module, and the third level of sleep maintains the acoustic perception module operating at a sampling rate of 10%. The specific operation process is as follows: the system determines whether to enter the sleep state by monitoring the energy level of the ambient sound signal. When the sound pressure level is detected to be lower than -50dB for 30 seconds, it first enters the first level of sleep and cuts off the power supply to the LED array to save energy; if there is still no activity, it enters the second level of sleep and turns off the radio frequency function of the communication module such as Wi-Fi or Bluetooth; if there is no activity for a long time, the system enters the third level of sleep and only maintains the acoustic perception module operating at a sampling rate of 10% to ensure that the wake-up signal can be detected in time.

[0108] This hierarchical sleep mechanism has demonstrated significant energy-saving effects in practical applications. Level 1 sleep reduces the power consumption of the LED array to zero, making it suitable for scenarios with short periods of inactivity, such as automatically turning off the lights in a conference room when no one is using it. Level 2 sleep further shuts down the communication module, reducing the energy consumption of transmitting and receiving RF signals, making it suitable for scenarios requiring long periods of standby time, such as home night mode. In level 3 sleep mode, the acoustic perception module operates at a low sampling rate, ensuring the system's basic ability to monitor ambient sound while minimizing power consumption. For example, in a medical ward, the system can enter level 3 sleep at night. When a patient makes a faint call, the acoustic perception module can wake up the system in time to provide necessary lighting and assistance.

[0109] The design of the three-level sleep mechanism also takes into account the system's rapid wake-up capability. In the third-level sleep state, the acoustic perception module still operates at a 10% sampling rate. When the sound pressure level exceeds the preset threshold, the system can complete the wake-up process within 200ms and resume normal operation. This design is particularly important in emergency situations. For example, in an emergency in a public place, the user's shouting can quickly wake the system and provide emergency lighting and guidance. In addition, the sleep state switching logic can be adjusted through software configuration. Users can set different sleep thresholds and switching conditions according to actual needs, improving the system's flexibility and adaptability.

[0110] The three levels of sleep control module are shown in Table 1.

[0111]

[0112] Table 1

[0113] Wake-up sensitivity: Level 1>65dB, Level 2>70dB, Level 3>80dB

[0114] Overall standby power consumption is reduced by 87%; it meets the IEC 62301 energy-saving standard; and the emergency wake-up success rate in medical scenarios is 100%.

[0115] In some embodiments, the dynamic light effect instruction includes three-dimensional light effect parameters, driving the RGB LED array to achieve at least one of radially rotating light spots, ripple diffusion effects, and rhythmic synchronized flashing.

[0116] In this embodiment, the dynamic lighting effect instructions contain three-dimensional lighting effect parameters, which specify information such as the spatial distribution, color changes, and dynamic rhythm of the lighting effect. During system operation, the core control module generates dynamic lighting effect instructions containing these three-dimensional parameters based on the semantic instructions or rhythm characteristics and sends them to the lighting effect execution module.

[0117] After receiving instructions, the RGB LED array in the light effect execution module will operate under the drive of three-dimensional parameters. For example, when a radially rotating light spot effect is required, the three-dimensional parameters will control the LEDs in different positions in the RGB LED array to light up and go out according to a specific order and brightness change pattern, so that the light spot can present a dynamic effect of rotation along the radial direction; for the ripple diffusion effect, the parameters will guide the LED to gradually change brightness from the center to the periphery or from the periphery to the center, simulating the visual experience of ripples spreading on the water surface; and beat-synchronized flashing allows the LEDs to flash synchronously according to the beat changes of the rhythm characteristics, achieving a precise response between light and rhythm. By executing these parameters, the RGB LED array ultimately converts the dynamic light effect instructions into an actual spatial dynamic light field.

[0118] The three-dimensional light effect parameters of this embodiment provide rich control dimensions for the presentation of light effects, enabling the RGB LED array to create a variety of dynamic light effects to meet the needs of different scenarios. Whether it is creating a warm party atmosphere, providing a soothing and relaxing environment, or providing intuitive rhythm guidance in rehabilitation training, these dynamic light effects can play an important role. The realization of specific effects such as radially rotating light spots, ripple diffusion effects, and beat-synchronized flashing enhances the expressiveness and interactivity of lighting, allowing users to more intuitively feel the changes in sound or the execution of commands through vision, thereby enhancing the immersiveness of the system and user experience. At the same time, the selectivity of a variety of light effects also makes the system more flexible and adaptable to the personalized needs of different users.

[0119] In some implementations, the communication interaction module supports low-power Bluetooth or WiFi protocols, and is configured to receive a custom keyword instruction library, a rhythm sensitivity threshold, and energy-saving sleep duration parameters issued by a user terminal.

[0120] In this embodiment, the communication interaction module supports low-power Bluetooth or WiFi protocols, which enables it to establish a stable wireless connection with the user terminal. During system operation, the user can make various custom settings through the user terminal, and these settings will be transmitted to the communication interaction module via low-power Bluetooth or WiFi protocols.

[0121] Specifically, users can customize the keyword instruction library on the user terminal, such as adding personalized instructions such as "turn on the colored lights" and "dim the lights" to the instruction library. After receiving them, the communication interaction module will update these customized keyword instruction libraries to the system, so that the acoustic perception module can recognize these new keyword instructions, thereby improving the system's recognition range and accuracy of user instructions. At the same time, users can also set the rhythm sensitivity threshold. The communication interaction module passes this parameter to the rhythm analysis unit. The rhythm analysis unit will adjust its sensitivity to rhythm characteristics based on this threshold. For example, when the threshold is increased, the system will only respond to more obvious rhythm changes, reducing the probability of false triggering. In addition, users can set the energy-saving sleep time parameter through the user terminal. This parameter is transmitted to the sleep control module via the communication interaction module. The sleep control module will determine when to start the sleep mode according to the set time to meet the user's personalized needs for energy-saving strategies.

[0122] The application of low-power Bluetooth or WiFi protocol in this embodiment reduces the energy consumption of the communication interaction module while ensuring the quality of communication, and extends the service life of the device. Supporting user-defined keyword instruction library greatly enhances the personalization of the system, allowing users to control the system with instructions that are more in line with their habits, thereby improving the user experience. The adjustability of the rhythm sensitivity threshold enables the system to adapt to different environments and user needs, and improves the accuracy and adaptability of the system to rhythm response. The customized setting of the energy-saving sleep duration parameter allows users to adjust the energy-saving strategy according to their own usage habits, maximizing the energy-saving effect while ensuring ease of use. The existence of the communication interaction module makes the interaction between the system and the user terminal more convenient and efficient, allowing users to easily realize personalized configuration of the system, thereby enhancing the flexibility and practicality of the system.

[0123] In some embodiments, when the system is applied to speech rehabilitation training, it is configured to convert the user's speaking speed rhythm into the light fluctuation frequency, and the ratio coefficient K of frequency to speaking speed is adjustable from 0.8 to 1.2, with an adjustment step of 0.05. The user terminal displays the matching score of speaking speed and light frequency in real time.

[0124] In this embodiment, when the system is used for speech rehabilitation training, its operation is specifically configured for the training needs. During speech rehabilitation training, the user speaks. The acoustic perception module collects the user's speech signal, separates the speech rate and rhythm characteristics, and transmits them to the core control module. The core control module converts the user's speech rate and rhythm into a light fluctuation frequency, where the ratio coefficient K of frequency to speech rate is adjustable from 0.8 to 1.2, with an adjustment step of 0.05.

[0125] Specifically, users can adjust the ratio coefficient K through the user terminal according to their own training situation. For example, when the user speaks slowly, the K value can be appropriately increased to make the light fluctuation frequency relatively faster, helping the user to perceive the relationship between speech speed and light frequency; when the user speaks quickly, the K value can be lowered to make the light fluctuation frequency relatively slower. During the training process, the light effect execution module will present the corresponding light fluctuation effect according to the converted light fluctuation frequency. Users can intuitively feel their own speaking speed and rhythm by observing the light fluctuation. At the same time, the user terminal will calculate and display the matching score of speech speed and light frequency in real time. The score is generated based on the degree of fit between the user's current speech speed and the set light frequency. For example, when the two are highly matched, the score is higher, otherwise it is lower. Users can understand their own training situation based on the score and make targeted adjustments.

[0126] This embodiment converts the user's speech rhythm into the frequency of light fluctuations, allowing users to intuitively perceive their own speech speed in a visual way, which helps users better understand and control their own speech speed. In particular, for rehabilitation trainees with weak speech rhythm control ability, this visual feedback can provide a clear reference and improve the training effect. The ratio coefficient K is adjustable and the adjustment step is 0.05, which makes the adjustment more precise and can adapt to the needs of different training stages and different users. Users can gradually adjust the K value to find the most suitable correspondence between their speech speed and light frequency, thereby enhancing the targeted training. The matching score displayed in real time on the user terminal provides users with instant feedback, allowing users to understand their training performance in a timely manner, identify the direction of improvement, and improve the enthusiasm and effectiveness of training. This design combines voice rehabilitation training with light interaction, innovates the training method, makes the boring training process more intuitive and interesting, helps to improve users' training compliance, and promotes the improvement of rehabilitation effects.

[0127] Table 2 compares the training effects under different speech speed-light frequency ratio coefficients (K)

[0128]

[0129] Table 2

[0130] Test conditions description:

[0131] Sample size: 20 language disorder patients in each group;

[0132] Testing environment: Standard training room in a professional rehabilitation center;

[0133] Evaluation method: The Standard Speech Rate Assessment Scale (SRAS) was used.

[0134] Rehabilitation training application in noisy environments: Even in a rehabilitation training room with 60dB background noise, the system can still accurately identify:

[0135] Therapist's voice instructions (recognition rate 98.2%)

[0136] Patient's speech rhythm (detection error <3%)

[0137] Automatically filters out air conditioning noise (transient pulses lasting less than 45ms).

[0138] Multi-device networking application; when 5 devices are networked through a Mesh network:

[0139] Command synchronization delay <50ms

[0140] Light effect synchronization error <5%

[0141] Supports unified control of treatment terminals.

[0142] The dual-mode interaction mechanism of the present invention produces unexpected technical effects in speech rehabilitation training:

[0143] Through visual mapping of light frequency and speech speed, the accuracy of patients' speech speed perception is increased by more than 3 times;

[0144] The semantic priority mechanism ensures that the therapist's instructions can interrupt the automatic mode at any time, and the response time in emergency situations is <200ms;

[0145] The specific 80-240Hz frequency band selection enables rhythm recognition to maintain an accuracy of over 92% in a noisy rehabilitation environment;

[0146] The optical microstructure design of the acrylic lampshade makes the light uniformity reach more than 90%, avoiding local strong light stimulation.

[0147] An embodiment of the present invention also provides an audio-visual interaction system, comprising the above-described voice-controlled rhythm guidance light system and a user terminal, wherein the user terminal is configured to send rehabilitation training parameters to the communication interaction module, including a speech rate-light frequency mapping curve and an error tolerance threshold.

[0148] In this embodiment, the audio-visual interactive system includes the aforementioned voice-controlled rhythmic guidance light system and a user terminal. During operation, the two work together to meet the needs of scenarios such as speech rehabilitation training. The user terminal configures specific training parameters based on the specific requirements of speech rehabilitation training, including speech rate-to-light frequency mapping curves and error tolerance thresholds.

[0149] After the configuration is completed, the user terminal will send these rehabilitation training parameters to the communication interaction module of the voice-controlled rhythm guidance light system. After receiving the parameters, the communication interaction module will pass them to the core control module. The core control module will determine the correspondence between the user's speaking speed and the light fluctuation frequency based on the speaking speed-light frequency mapping curve. For example, in the mapping curve, different speaking speed intervals correspond to different light frequency ranges to ensure that the light fluctuation can accurately reflect the changes in speaking speed. At the same time, the error tolerance threshold will be used to determine whether the deviation between the user's speaking speed and the light fluctuation frequency is within an acceptable range. When the deviation is less than the error tolerance threshold, the system believes that the current speaking speed meets the training requirements and the light fluctuation remains stable; when the deviation exceeds the threshold, the system may inform the user through light changes or prompts on the user terminal to remind them to adjust their speaking speed.

[0150] The sound and light interaction system of this embodiment combines the voice-controlled rhythm guide light system with the user terminal to form a complete interactive closed loop, making the configuration and execution of rehabilitation training parameters more accurate and efficient. The distribution of the speech rate-light frequency mapping curve provides the system with a clear standard for the correspondence between speech rate and light frequency, ensuring that the light fluctuation can accurately reflect the user's speech rate, providing users with a consistent and reliable visual reference, and helping users to form a stable speech rate perception. The setting of the error tolerance threshold allows the system to make quantitative judgments on the user's speech rate deviation, allowing normal fluctuations within a certain range to avoid excessive constraints on the user, and can provide timely reminders when the deviation is too large to help users correct their speech rate and improve the scientificity and effectiveness of the training. The collaborative work of the user terminal and the voice-controlled rhythm guide light system makes the configuration of rehabilitation training parameters more convenient, and the monitoring and feedback of the training process more timely, which improves the practicality and professionalism of the entire sound and light interaction system in scenarios such as speech rehabilitation training.

[0151] The calculation formula for the speech speed-optical frequency matching score is:

[0152]

[0153] Where T is the evaluation window (5s by default).

[0154] An embodiment of the present invention provides a dual-mode interaction method for a voice-controlled rhythmic guidance light, which is applied to the voice-controlled rhythmic guidance light system described above and is characterized by comprising the following steps:

[0155] The acoustic perception module collects semantic and rhythmic features of environmental sounds in parallel;

[0156] When a preset keyword is recognized, the light effect mode mapped by the semantic instruction is called to overwrite the current state;

[0157] When no semantic instructions are detected, rhythm features are extracted and synchronized light effect instructions are generated;

[0158] The light effect execution module converts the light effect instructions into a dynamic light field.

[0159] In this embodiment, when this dual-mode interaction method is applied to the aforementioned voice-controlled rhythmic guidance light system, its operation begins with the operation of the acoustic perception module. This module simultaneously collects semantic and rhythmic features from ambient sound. This means that while capturing the semantic instructions a user might issue (e.g., "Turn on the lights"), it also simultaneously analyzes the rhythmic changes in ambient sound (e.g., the tempo of music, the speed of speech).

[0160] When the acoustic perception module recognizes a preset keyword, such as "turn off the lights" or "switch modes" preset in the system, the corresponding semantic instruction will be immediately triggered. At this time, the system will call the lighting effect mode mapped to the semantic instruction. Regardless of the current lighting effect state of the system, it will be overwritten by the new lighting effect mode to ensure that the user's instruction is executed in a timely manner. For example, when the system is flashing to the rhythm of music, the user says "turn off the lights", the system will immediately execute the operation to turn off the lights, interrupting the previous rhythm-following mode.

[0161] When the acoustic perception module does not detect semantic instructions, the system will focus on extracting the rhythmic characteristics of the ambient sound. By analyzing the rhythmic characteristics, it generates rhythmic lighting instructions, which are then transmitted to the lighting execution module. After receiving the lighting instructions, the lighting execution module converts them into a dynamic light field (dynamic light field refers to radial rotating light spots, ripple diffusion, or beat-synchronized flashing effects achieved through the RGB LED array). For example, it can present a synchronized flashing light effect according to the beat of the music, or present corresponding light fluctuations according to the speaking speed.

[0162] This embodiment takes into account both the user's active command control and the system's passive response to the environment, achieving a flexible and efficient interaction method. The parallel collection of semantic features and rhythmic features ensures that the system can process two types of information at the same time, improves the efficiency of information processing, and reduces response delays. The recognition of preset keywords and the light effect mode coverage mechanism ensure the priority and effectiveness of user commands, allowing users to control the system through voice commands at any time, improving the convenience of operation. When there are no semantic commands, synchronized light effect commands are generated based on rhythmic features, allowing the system to interact well with ambient sounds and create an immersive atmosphere for users, which can play a positive role in both entertainment scenes and rehabilitation training scenes. The light effect execution module converts commands into dynamic light fields, and enhances the intuitiveness of the interaction through visual presentation, allowing users to clearly feel the response of the system and improving the overall interactive experience.

[0163] In some embodiments, the rhythm feature extraction step includes: separating the energy peak in the 80-240 Hz frequency band through a fast Fourier transform algorithm, dynamically ignoring transient noise pulses with a duration of less than 50 ms, and generating a PWM dimming signal based on the peak frequency.

[0164] In this embodiment, the rhythm feature extraction step in this dual-mode interaction method has a clear operational process. First, the system receives ambient sound signals collected by the acoustic perception module. These signals contain rhythmic information of various sounds. Next, the system processes these sound signals using the Fast Fourier Transform (FFT) algorithm. The FFT algorithm can convert time-domain sound signals into frequency-domain signals, clearly displaying the energy distribution of different frequency bands.

[0165] In frequency domain analysis, the system focuses on the 80-240Hz band, as this frequency band often contains important rhythmic information related to vocals and musical beats. By analyzing the energy distribution within this frequency band, the system isolates the energy peak within it. This energy peak accurately reflects the main rhythmic characteristics of the ambient sound and is therefore used as the rhythm benchmark.

[0166] At the same time, the system will detect transient noise pulses in the sound signal. When transient noise pulses with a duration of less than 50ms are detected, the system will determine that these pulses are irregular interference signals. In order to avoid these interferences affecting the extraction of rhythm features, the system will dynamically ignore these transient noise pulses.

[0167] After completing the above processing, the system will generate a PWM dimming signal based on the extracted energy peak frequency. This signal can accurately control the light brightness and change frequency of the light effect execution module, ensuring that the lighting effect is synchronized with the rhythm of the ambient sound.

[0168] The application of the fast Fourier transform algorithm of this embodiment provides a strong technical support for the extraction of rhythm features. Its efficient spectrum analysis capability enables the system to accurately separate the energy peak of the 80-240Hz frequency band, ensuring the accuracy and reliability of the rhythm benchmark. Focusing on the 80-240Hz frequency band enables the system to capture rhythm information related to human activities in a targeted manner, improving the relevance and effectiveness of rhythm extraction. Ignoring transient noise pulses with a duration of less than 50ms effectively enhances the system's anti-interference ability, reduces the misoperation of lights caused by sudden noise, and makes the changes in lighting effects more stable and in line with expectations. Generating a PWM dimming signal based on the energy peak frequency ensures that the lighting effect can be highly synchronized with the rhythm of the ambient sound, whether it is music playback or daily communication, it can bring a coordinated and immersive sensory experience, and improve the quality of interaction between the system and the environment. The core of the present invention lies in the synergistic effect of 80-240Hz frequency band selection and speech rehabilitation training, not the algorithm itself. Actual measurements show that selecting the 80-240Hz frequency band results in a speech rate and rhythm detection error of <3% (the error in the 60-500Hz frequency band is 8.5%).

[0169] In some implementations, the semantic instruction execution step includes:

[0170] The output of the rhythm analysis unit is interrupted by the priority decision logic unit, and the light effect parameters corresponding to the semantic instruction are written into the driving circuit of the light effect execution module.

[0171] In this embodiment, the priority decision logic unit plays a core role in the semantic instruction execution step of the dual-mode interaction method. When the acoustic perception module recognizes the semantic instruction and transmits it to the system, the priority decision logic unit immediately responds to the semantic instruction.

[0172] First, the priority decision logic unit will interrupt the output of the rhythm analysis unit. This means that even if the rhythm analysis unit is processing rhythm features and generating corresponding light effect signals at this time, it will be paused to ensure that the semantic instructions can be executed first, avoid conflicts between the two signals, and ensure that the user's instructions can be responded to in a timely manner.

[0173] The priority decision logic unit then accurately writes the lighting effect parameters corresponding to the semantic instruction into the driver circuit of the lighting effect execution module. Upon receiving these lighting effect parameters, the driver circuit drives the RGB LED array to operate according to the parameters, producing the lighting effect corresponding to the semantic instruction. For example, if the semantic instruction is "turn on red light," the priority decision logic unit writes the corresponding parameters for red light into the driver circuit, which then controls the red LEDs in the RGB LED array to illuminate and achieve the corresponding lighting effect.

[0174] The priority decision logic unit of this embodiment interrupts the output of the rhythm analysis unit, ensuring the absolute priority of the semantic instructions, allowing the user's active control intention to be reflected in the most timely manner, avoiding instruction delays or failures caused by the continuous output of rhythm signals, and improving the reliability and effectiveness of user operations. Writing the light effect parameters corresponding to the semantic instructions directly into the driving circuit of the light effect execution module reduces the intermediate links in signal transmission, speeds up the response speed of the light effect, enables the lights to change quickly according to the user's instructions, and enhances the user's sense of control and satisfaction with the system. This execution mechanism makes the system more efficient and direct when processing semantic instructions, and can accurately and correctly realize the user's control needs, improving the practicality and user experience of the entire interaction method.

[0175] In some embodiments, when applied to speech rehabilitation training, the ratio coefficient K of the light fluctuation frequency to the user's speech speed is dynamically adjusted with an adjustment step of 0.05, and the matching score is calculated in real time.

[0176] In this embodiment, when this dual-mode interaction method is applied to speech rehabilitation training, its operation process is dynamically adjusted based on the training needs. During training, the user speaks, and the acoustic perception module collects the user's speaking speed and rhythm, transmitting it to the system for processing. The system converts the user's speaking speed and rhythm into a light fluctuation frequency. The ratio coefficient K of the light fluctuation frequency to the user's speaking speed can be dynamically adjusted in steps of 0.05.

[0177] Specifically, the user or trainer can adjust the ratio coefficient K through the user terminal based on the training progress and the user's actual situation. The value of K ranges from 0.8 to 1.2. For example, when a user has difficulty controlling their speaking speed in the early stages of training, the K value can be set to around 1.0, so that the light fluctuation frequency remains roughly consistent with the speaking speed, providing the user with an intuitive reference. When the user needs to speed up the speaking training, the K value can be appropriately increased so that the light fluctuation frequency is slightly faster than the current speaking speed, guiding the user to speak faster. During the adjustment process, the step size of 0.05 ensures the precision of the adjustment, which can meet the training needs of different stages.

[0178] At the same time, the system calculates a real-time matching score between speech rate and light frequency. This score is based on the degree of compatibility between the user's current speech rate and the light frequency converted based on the K value. For example, if the two trends are consistent and the deviation is small, the score is high; if the deviation is large, the score is low. The user terminal displays this matching score in real time, allowing the user to understand their training performance and adjust their speech rate in a timely manner to better match the speech rate and light frequency.

[0179] The dynamic adjustment ratio coefficient K of this embodiment enables the system to flexibly adapt to the training needs of different users and different training stages, provide users with personalized training guidance, and improve the pertinence and effectiveness of training. The adjustment step of 0.05 ensures the accuracy of the K value adjustment, allowing users to make subtle parameter adjustments to find the training rhythm that best suits them. The matching score calculated and displayed in real time provides users with instant feedback information, allowing users to clearly understand their own speech speed control, identify the direction of improvement, and enhance the purposefulness and enthusiasm of training. This method of combining speech speed with light fluctuation frequency and assisting training through dynamic adjustment and real-time scoring has innovated the voice rehabilitation training model, making the training process more intuitive and efficient, and helping to improve the user's training effect and rehabilitation progress.

[0180] The 2048-point FFT and the 80-240Hz frequency band form a golden section, reducing CPU usage to less than 20% on the STM32H743. Sine wave ripples combined with nano-doping enable a CRI greater than 95, far exceeding the industry standard of 80.

[0181] Three levels of sleep and voice wake-up constitute a complete low-power solution.

[0182] The voice-controlled rhythmic guidance light system of the present invention also has a KTV entertainment mode:

[0183] The music rhythm recognition accuracy in KTV entertainment mode is 98.7%; the multi-device synchronization error is less than 3ms.

[0184] The voice-controlled rhythm guidance light system of the present invention also has a medical alert mode:

[0185] In medical alert mode, the emergency word recognition rate is 99.2%; the red light flashes at a frequency of 5Hz (in compliance with IEC 60601-1-8).

[0186] In medical scenarios:

[0187] The recognition rate of emergency words (such as help) is 99.2% (test samples: 1000);

[0188] Red light flashing frequency 5Hz±0.5Hz (meets IEC 60601-1-8 medical device alarm standard);

[0189] The system's wake-up time from Level 3 sleep mode is less than 500ms. In ICU testing, the system achieved a 99.2% recognition rate for "emergency calls" (with a background noise level of 60dB), with a red light flashing frequency of 5Hz±0.1Hz, complying with the IEC 60601-1-8 medical alarm standard.

[0190] Industrial scenario implementation examples

[0191] In a factory environment (noise level 65dB, including 50Hz mechanical vibration):

[0192] The system automatically adjusts the FFT analysis frequency band to 100-300Hz to avoid 50Hz mechanical noise. In factories with 50Hz mechanical noise, the system automatically adjusts the analysis frequency band to 100-300Hz to keep the voice command recognition signal-to-noise ratio above 12dB.

[0193] When an "emergency stop" semantic command is detected, the red 5Hz flashing is triggered (in compliance with ISO 7010 safety standards), with a critical word recognition rate of 99.2% and a wake-up time of <500ms;

[0194] The electromagnetic shielding structure keeps the speech recognition signal-to-noise ratio above 12dB.

[0195] Rehabilitation training applications rely on specific speech rate-optical frequency mapping algorithms.

[0196] Rehabilitation training applications rely on a specific speech rate-light frequency mapping algorithm (K=0.8-1.2) and the light uniformity of the optical microstructure (UGR<16).

[0197] This invention addresses the problem of existing voice-controlled lighting systems being unable to balance semantic commands with rhythmic interaction, providing a dual-mode voice-controlled rhythmic guidance lighting system. This system uses an acoustic perception module (including 80-240Hz FFT analysis) to separate semantic and rhythmic signals. The core control module implements a semantic-first strategy, and the lighting effect execution module utilizes an optical microstructured lampshade with a period of 0.5-2mm to achieve a uniform light field. Tests have shown that the semantic command response time is less than 200ms, the rhythm recognition accuracy is 92.4% (in noisy environments), and the speech rate control accuracy for rehabilitation training has been tripled.

[0198] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described equipment, devices and units can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0199] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in the present invention, and such modifications or substitutions are intended to be within the scope of protection of the present invention. Therefore, the scope of protection of the present invention shall be subject to the scope of protection of the claims.

Claims

1. A sound-controlled rhythmic guidance light system, characterized in that: include: Acoustic perception module, used to synchronously collect environmental sounds and separate semantic instructions from rhythmic features; The core control module is connected to the acoustic perception module via a high-speed data bus and is configured as follows: Receive semantic instructions and rhythm feature signals output by the acoustic perception module; When semantic instructions exist, the rhythm feature signal is forced to be overwritten and the preset light effect is called; When the semantic instruction does not exist, the rhythm feature signal is converted into a PWM dimming instruction; A light effect execution module, connected to the core control module via a PWM signal interface, for converting light effect instructions into a spatial dynamic light field; The communication interaction module is wirelessly connected to the user terminal and is used to receive the custom instruction library and parameter configuration; A sleep control module, electrically connected to the acoustic perception module and the core control module, for cutting off power supply to non-essential modules when silence times out; Among them, the acoustic perception module, core control module, light effect execution module, communication interaction module and sleep control module are integrated into the same shell, and the acoustic perception module is located in the central area of ​​the top of the device.

2. The sound-controlled rhythmic guidance light system according to claim 1, characterized in that: The acoustic perception module includes a full-range pickup unit and a voice recognition chip. The full-range pickup unit is coaxially arranged directly above the voice recognition chip. The two are physically isolated from the core control module by an electromagnetic shielding structure. The electromagnetic shielding structure includes multiple layers of metal grids, and the layers are filled with insulating materials with a dielectric constant of ≤2.

3.

3. The sound-controlled rhythmic guidance light system according to claim 1, characterized in that: The core control module includes a priority decision logic unit and a rhythm analysis unit. The priority decision logic unit and the rhythm analysis unit are connected in parallel to the signal distribution node, which is connected to the output end of the acoustic perception module and the driving circuit of the light effect execution module through a dual-channel data line.

4. The sound-controlled rhythmic guidance light system according to claim 3, characterized in that: The rhythm analysis unit extracts the energy peak of the 80-240 Hz frequency band as the rhythm reference through the fast Fourier transform algorithm, dynamically ignores transient noise pulses with a duration of less than 50 ms, and outputs a synchronous dimming signal to the light effect execution module; and / or, The priority decision logic unit implements the following conflict handling rules: When a semantic instruction is detected, the output of the rhythm analysis unit is immediately interrupted, and the light effect parameters corresponding to the semantic instruction are written into the light effect execution module; When the semantic instruction ended, the environmental rhythmic response pattern was automatically restored.

5. The sound-controlled rhythmic guidance light system according to claim 1, characterized in that: The light effect execution module includes an RGB LED array and an acrylic diffusion lampshade. The inner surface of the acrylic diffusion lampshade is provided with a wavy optical microstructure with a period of 0.5-2mm and a depth of 0.1-0.3mm, and the refractive index gradient difference is ≥0.

2.

6. The sound-controlled rhythmic guidance light system according to claim 1, characterized in that: The sleep control module collects the output signal energy of the acoustic perception module in real time through the signal monitoring bus. If the output signal energy is lower than -50dB for 30 seconds, it sends a sleep instruction to the core control module to cut off the power supply to the light effect execution module; and / or, The dynamic light effect instruction includes three-dimensional light effect parameters, driving the RGB LED array to achieve at least one of radial rotating light spots, ripple diffusion effects, and beat synchronized flashing.

7. The sound-controlled rhythmic guidance light system according to claim 1, characterized in that: The communication interaction module supports low-power Bluetooth or WiFi protocol and is used to receive a custom keyword instruction library, rhythm sensitivity threshold and energy-saving sleep time parameters issued by the user terminal; and / or, When the system is applied to speech rehabilitation training, it is configured to convert the user's speaking speed rhythm into the light fluctuation frequency, and the ratio coefficient K of frequency to speaking speed is adjustable from 0.8 to 1.2, with an adjustment step of 0.

05. The user terminal displays the matching score of speaking speed and light frequency in real time.

8. An acoustic-optical interactive system, comprising the sound-controlled rhythmic guidance light system and a user terminal according to any one of claims 1 to 7, characterized in that: The user terminal is configured to send rehabilitation training parameters to the communication interaction module, including a speech speed-optical frequency mapping curve and an error tolerance threshold.

9. A dual-mode interaction method for a voice-controlled rhythmic guidance light, applied to the voice-controlled rhythmic guidance light system according to any one of claims 1 to 7, characterized in that: The following steps are involved: The acoustic perception module collects semantic and rhythmic features of environmental sounds in parallel; When a preset keyword is recognized, the light effect mode mapped by the semantic instruction is called to overwrite the current state; When no semantic instructions are detected, rhythm features are extracted and synchronized light effect instructions are generated; The light effect execution module converts the light effect instructions into a dynamic light field.

10. The dual-mode interaction method according to claim 9, characterized in that: The rhythm feature extraction step includes: separating the energy peak of the 80-240 Hz frequency band by using a fast Fourier transform algorithm, dynamically ignoring transient noise pulses with a duration of less than 50 ms, and generating a PWM dimming signal based on the peak frequency; and / or, The semantic instruction execution step includes: Interrupting the output of the rhythm analysis unit through the priority decision logic unit and writing the light effect parameters corresponding to the semantic instruction into the driving circuit of the light effect execution module; and / or, When applied to speech rehabilitation training, the ratio coefficient K between the light fluctuation frequency and the user's speaking speed is dynamically adjusted with an adjustment step of 0.05, and the matching score is calculated in real time.

Images