An LED display method with volume level indication and strumming guidance

By analyzing the user's performance audio signal in real time and adjusting the display mode of the LED light, providing volume level indications and singing guidance, it solves the problem of insufficient comprehensive guidance on volume, pitch and rhythm in the prior art, and improves the user's learning efficiency and performance level.

CN119724085BActive Publication Date: 2025-06-27HUIZHOU ENYA MUSICAL INSTR CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202510220985.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2025-02-27
Publication Date
2025-06-27
Estimated Expiration
2045-02-27

AI Technical Summary

Technical Problem

The existing LED display methods lack comprehensive guidance on musical elements such as volume, pitch and rhythm, and fail to fully utilize the synergy of multiple senses, resulting in poor user experience.

Method used

By collecting the user's performance audio signals in real time, extracting musical elements such as volume, pitch and rhythm, and adjusting the brightness, flickering frequency and color of the LED lights based on these elements, providing volume level indicators and singing guidance.

Benefits of technology

It has achieved a rich and personalized teaching experience for music learners, improved the user's learning efficiency and performance level, and enhanced self-correction ability.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119724085B_ABST
    Figure CN119724085B_ABST
Patent Text Reader

Abstract

This application relates to the technical field of computers, and particularly to an LED display method with volume level indication and strumming guidance, including: when the user is performing, the performance audio signal of the user is collected in real time, the performance audio signal is preprocessed, the preprocessed performance audio signal is analyzed, and the corresponding music elements are extracted. The music elements include volume, pitch, and rhythm; the display mode of the LED lights is adjusted according to the music elements, and volume level indication and strumming guidance are sent to the user based on the display mode of the LED lights. The display mode includes the brightness and blinking frequency of the LED lights; it is determined whether the user plays correctly. When the user plays correctly, the LED lights display green and continue. When the user plays incorrectly, the LED lights are controlled to display red and continue. If the incorrect playing continues, the LED lights are controlled to display red and blink. This application can provide a more rich and personalized teaching experience.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the technical field of computers, and in particular to an LED display method with volume level indication and strumming and singing guidance. Background Art

[0002] With the development of technology, more and more intelligent devices are being applied to music teaching and performance. Traditional music teaching methods mainly rely on teachers' oral guidance and written materials, which are less efficient and difficult to meet personalized needs. In recent years, some intelligent musical instruments have started to use LED lights to assist teaching, such as by lighting to prompt users of the correct key positions, but these methods usually only provide simple visual feedback and lack comprehensive guidance on music elements such as volume, pitch, and rhythm.

[0003] In addition, most of the existing LED display methods only focus on single visual feedback and fail to fully utilize the synergy of multiple senses, resulting in a poor user experience. At the same time, these methods also lack intelligent recognition and response capabilities and cannot provide timely and effective feedback according to the actual performance of users.

[0004] Therefore, a new LED display method is needed that can integrate volume level indication and strumming and singing guidance, provide a more rich and personalized teaching experience, and improve the learning efficiency and performance level of users. Summary of the Invention

[0005] In order to provide a more rich and personalized teaching experience, this application provides an LED display method with volume level indication and strumming and singing guidance.

[0006] In a first aspect, this application provides an LED display method with volume level indication and strumming and singing guidance, adopting the following technical solutions:

[0007] An LED display method with volume level indication and strumming and singing guidance includes: when a user is performing, real-time collecting the user's performance audio signal, preprocessing the performance audio signal, analyzing the preprocessed performance audio signal, and extracting corresponding music elements, where the music elements include volume, pitch, and rhythm; adjusting the display mode of the LED lights according to the music elements, and sending volume level indication and strumming and singing guidance to the user based on the display mode of the LED lights, where the display mode includes the brightness and blinking frequency of the LED lights; determining whether the user plays correctly, when the user plays correctly, the LED lights display green and continue, when the user plays incorrectly, controlling the LED lights to display red and continue, and if the incorrect playing continues, controlling the LED lights to display red and blink.

[0008] By adopting the above technical solution, by integrating real-time audio analysis and visual feedback mechanisms, a richer and more personalized teaching experience is provided for music learners. It can not only instantly reflect key musical elements such as volume, pitch, and rhythm during performance, but also intuitively guide users to improve their performance skills by adjusting the brightness and blinking frequency of the LED lights. In particular, this method introduces correct performance feedback - when the user plays correctly, the LED light remains green, while in the face of errors, it is prompted in red and blinks as a warning when there are continuous errors, thus effectively enhancing the user's self-correction ability. This immediate and intuitive interaction method greatly improves learning efficiency, enabling users to gain a deeper understanding and skill improvement in practice, while encouraging them to keep trying and exploring, and ultimately optimizing the personalized learning path.

[0009] Optionally, the method further includes: analyzing and decomposing the preprocessed performance audio signal into at least two frequency bands, and each frequency band corresponds to a specific frequency range; assigning a specific color to each frequency band for corresponding LED light indication; during performance, determining the corresponding actual volume based on the performance audio signal, and adjusting the brightness and blinking frequency of the corresponding LED lights based on the actual volume of each frequency band.

[0010] By adopting the above technical solution, more detailed and comprehensive volume feedback is provided, and the user's understanding of volume changes in different frequency ranges is also enhanced. This method enables users to visually see the actual volume levels of each frequency band during performance, and achieve precise control of volume by adjusting the brightness and blinking frequency of the corresponding LED lights. This combination of multi-band volume analysis and visual feedback not only helps users more accurately master the overall volume dynamics, but also enables personalized adjustment for different instruments or sound components, thus significantly improving the teaching effect and user experience. In addition, it supports users to better balance the volume of each frequency band in complex pieces, further optimizing the performance and personal skill development.

[0011] Optionally, the method further includes: during the user's performance, retrieving a preselected stored standard track, where the standard track includes recordings of professional performers, teaching pieces, or other high-quality music samples; obtaining the corresponding performance track based on the performance audio signal, and comparing the performance track with the standard track, where the comparison content includes volume, pitch, rhythm, and timbre; obtaining the corresponding track comparison result, determining the difference detection result between the performance audio and the standard track based on the track comparison result, and instantaneously feedbacking the difference detection result through LED lights with different colors and display modes, where the difference detection result includes volume difference, pitch difference, rhythm difference, and timbre difference.

[0012] By adopting the above technical solutions, not only are multiple key elements such as volume, pitch, rhythm, and timbre compared, but also the difference detection results are instantaneously fed back by LED lights of different colors and display modes. The combination of this real-time comparison and visual feedback helps users quickly identify and correct minor problems in their performances, enhancing their self-assessment and improvement capabilities. In addition, this method provides personalized practice guidance, enabling users to obtain specific improvement suggestions in each performance, thereby accelerating skill improvement, optimizing the learning path, and greatly enhancing the efficiency and fun of practice.

[0013] Optionally, the method further includes: dividing the volume range into multiple levels, each volume level corresponding to a specific volume range; retrieving the corresponding volume threshold, and determining the corresponding real-time volume level based on the performance audio signal and the volume threshold; allocating the corresponding real-time color based on the real-time volume level, and controlling the corresponding real-time color of the LED light to turn on based on the real-time color.

[0014] By adopting the above technical solutions, not only can users intuitively see their volume changes at different time periods, but also it helps them better understand and control the volume levels in their performances. This method combining precise volume grading and color coding provides a clear and instant feedback mechanism, enhancing users' perception and adjustment capabilities, thereby optimizing the practice effect and promoting the learning and mastery of more efficient volume control skills.

[0015] Optionally, the method further includes: retrieving the corresponding difference detection results, determining the corresponding target difference element based on the difference detection results; adjusting the display priority indicated by the LED light based on the target difference element, and controlling the display of the LED light based on the display priority; if the user corrects the target difference element, gradually reducing the display priority corresponding to the indication of the target difference element.

[0016] By adopting the above technical solutions, the key target difference elements (such as pitch, rhythm, etc.) are determined according to the difference detection results, and the visual feedback of these elements is preferentially highlighted, helping users quickly identify and focus on solving the main problems. When the user successfully corrects the target difference element, the system gradually reduces its display priority, thereby guiding the user to shift from one focus to another, ensuring comprehensive improvement of the performance. This intelligent priority management not only optimizes the pertinence and timeliness of the feedback, but also enhances the user's practice experience, enabling them to more efficiently master and consolidate the correct performance skills.

[0017] Optionally, the method further includes: performing volume analysis on the performance audio signal to obtain corresponding volume data, and generating a continuous volume curve based on the volume data; controlling a preset multi-channel LED light array to display the volume curve based on the volume curve, where each LED light represents the volume value at a time point; determining a corresponding time interval, and updating the display in the LED light array based on the time interval.

[0018] By adopting the above technical solution, by generating a continuous volume curve and controlling the multi-channel LED light array to display in real time, this method provides users with an intuitive visual feedback of volume changes. Each LED light represents the volume value at a time point, and the system updates the display at the set time interval to ensure the immediate presentation of the volume change trend. This way not only helps users understand the volume dynamics during performance more clearly, but also promotes the mastery and improvement of volume control skills, significantly enhancing the practice effect and user experience.

[0019] Optionally, the method further includes: retrieving a pre-designed multi-channel LED light array; controlling the LED lights of different colors in the multi-channel LED light array to display at the same time based on the display mode, where each LED light in the LED light array can be independently controlled, and the color coding of the LED lights is fixedly assigned to specific musical elements.

[0020] By adopting the above technical solution, by calling a pre-designed multi-channel LED light array, this method uses LED lights of different colors to indicate specific musical elements (such as volume, pitch, rhythm) at the same time, and each LED light is independently controlled and fixedly assigned a color coding. This way provides multi-dimensional real-time feedback, helps users understand and adjust multiple musical elements more intuitively, and significantly improves the efficiency and accuracy of performance learning.

[0021] In a second aspect, the present application provides an LED display method with volume level indication and strumming guidance, adopting the following technical solution:

[0022] An LED display method with volume level indication and strumming guidance,

[0023] In a third aspect, the present application provides an LED display method with volume level indication and strumming guidance, adopting the following technical solution:

[0024] An LED display method with volume level indication and strumming guidance, including a processor, and a program of the LED display method with volume level indication and strumming guidance described in any one of the above is running in the processor.

[0025] In a fourth aspect, the present application provides a storage medium, adopting the following technical solution:

[0026] A storage medium stores a program of the LED display method with volume level indication and strumming guidance described in any one of the above.

[0027] In summary, the present application includes at least one of the following beneficial technical effects:

[0028] By integrating a real-time audio analysis and a visual feedback mechanism of a multi-channel LED light array, this method provides a more rich and personalized teaching experience for music learners. It can not only immediately reflect key musical elements such as volume, pitch, and rhythm during performance, but also intuitively guide users to improve their performance skills by adjusting the brightness, color, and blinking frequency of the LED lights. In particular, the system introduces correct performance feedback - the LED lights remain green when the user plays correctly, while errors are indicated in red and a warning is given by blinking when there are continuous errors, thus effectively enhancing the user's self-correction ability. In addition, through multi-band analysis of the audio signal and comparison with a standard track, users can obtain detailed feedback on volume distribution and performance differences, helping them quickly identify and correct problems and optimize the practice effect.

[0029] Furthermore, by dynamically adjusting the priority and display mode of the LED light indication, this method intelligently highlights key teaching points according to the user's actual performance, ensuring that users can focus on solving the main problems and gradually improve their overall performance level. At the same time, a continuous volume curve is generated and displayed in real time through the LED light array, enabling users to intuitively understand the volume change trend during performance and promoting the mastery of volume control skills. This highly interactive and personalized feedback mechanism not only improves learning efficiency but also encourages users to continuously try and explore, ultimately optimizing the learning path to be efficient and enjoyable. Description of the Drawings

[0030] Figure 1 is a flowchart of an LED display method with volume level indication and strumming guidance shown according to an exemplary embodiment.

[0031] Figure 2 is a structural block diagram of an LED display method device with volume level indication and strumming guidance shown according to an exemplary embodiment. Detailed Embodiments

[0032] The following details the embodiments of the present application, and the examples of the embodiments are shown in the drawings.

[0033] In the description of this specification, the description referring to terms such as "certain embodiments", "one embodiment", "some embodiments", "schematic embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials, or characteristics described in connection with the embodiments or examples are included in at least one embodiment or example of this application. In this specification, the schematic expressions of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described can be combined in a suitable manner in any one or more embodiments or examples.

[0034] An embodiment of this application discloses an LED display method with volume level indication and strumming guidance. Referring to Figure 1 , it includes:

[0035] S100, when the user is performing, the performance audio signal of the user is collected in real time, the performance audio signal is preprocessed, and the preprocessed performance audio signal is analyzed to extract the corresponding music elements.

[0036] Among them, the system captures the sound of the user performing on the instrument in real time through a built-in or external high-quality microphone or pickup. These devices can record the audio signal in a high-fidelity and low-latency manner, ensuring that the collected data accurately reflects the user's performance; if the user is using multiple instruments or a multi-channel setup, the system can collect audio signals from multiple input sources simultaneously to ensure comprehensive coverage of all performance details.

[0037] It should be noted here that advanced digital signal processing (DSP) technology is used to remove ambient noise and other interference signals to ensure the purity of the audio signal; the audio signals from different sources are adjusted to a unified format and parameters, such as sampling rate, bit depth, etc., for the consistency and accuracy of subsequent analysis; at the same time, dynamic range compression is performed on the audio signal so that even in the case of large volume changes, the clarity and stability of the signal can be maintained.

[0038] In addition, algorithms such as the fast Fourier transform (FFT) are used to convert the audio signal from the time domain to the frequency domain to extract frequency information for identifying pitch and timbre; the time characteristics of the audio signal, such as start time, duration, and end time, can also be analyzed to detect changes in rhythm and volume. In addition, combined with machine learning algorithms, key music elements are automatically identified and extracted. The music elements include but are not limited to volume, pitch, and rhythm.

[0039] S110, adjust the display mode of the LED lights according to the music elements, and send volume level indication and strumming guidance to the user based on the display mode of the LED lights.

[0040] Among them, the display mode includes the brightness and blinking frequency of the LED lights. The specific implementation process includes:

[0041] Brightness control: Dynamically adjust the brightness of the LED lights according to the extracted volume data. For example, the greater the volume, the brighter the LED lights; the smaller the volume, the dimmer the LED lights.

[0042] Color coding: Assign specific colors to different musical elements. For example, volume is represented by yellow, pitch by blue, and rhythm by green.

[0043] Blinking frequency: Adjust the blinking frequency of the LED lights according to the tempo. When the tempo is fast, the LED lights blink quickly; when the tempo is slow, the LED lights blink slowly.

[0044] Through the visual feedback mechanism, visually display the changes in musical elements, helping users to more clearly understand the volume, pitch, and rhythm during performance, thereby improving the practice effect.

[0045] S120, determine whether the user plays correctly. When the user plays correctly, the LED lights display green and remain on. When the user plays incorrectly, control the LED lights to display red and remain on. If the incorrect playing persists, control the LED lights to display red and blink.

[0046] Among them, the specific implementation process of determining whether the user plays correctly: Retrieve the pre-stored standard audio track (such as the recording of a professional performer, a teaching piece), and compare it frame by frame with the user's real-time performance audio track to detect differences in pitch, rhythm, etc.; Based on the comparison results, the system intelligently determines whether there are errors in the user's performance. For example, when the pitch deviation exceeds a certain threshold or the rhythm does not meet the standard, the system will mark it as an error. If the user makes a mistake at the same position multiple times, the system will further confirm and record this error pattern.

[0047] Specifically, the process of making a judgment based on the standard audio track is as follows:

[0048] S1201, during the user's performance, retrieve the pre-selected and stored standard audio track.

[0049] Among them, the system maintains a standard audio track library containing various types. These audio tracks can be the recordings of professional performers, teaching pieces, or other high-quality music samples; each audio track has been strictly screened and annotated to ensure its high reference value in terms of pitch, rhythm, timbre, etc.

[0050] The user can select a specific track or practice segment as the standard track, and the system will automatically load the corresponding track data according to the user's selection; in addition, the standard track will be pre-processed before use, including format conversion, noise removal, etc., to ensure compatibility with the user's performance audio signal. The system also needs to synchronize the standard track with the user's real-time performance audio signal through time alignment technology to ensure their consistency on the time axis for accurate comparative analysis.

[0051] S1202. Obtain the corresponding performance track based on the performance audio signal, and compare the performance track with the standard track.

[0052] Among them, the system captures the user's performance audio signal in real time through a high-quality microphone or pickup and performs preliminary processing, such as noise filtering and normalization. The real-time collected audio signal is segmented into multiple short time periods (such as several times per second), and key music elements within each time period, such as volume, pitch, rhythm, and timbre, are extracted using techniques such as spectral analysis and time series analysis. The extracted music elements are combined into a complete performance track, which contains all the information of the user's performance and is used for subsequent comparative analysis.

[0053] The system adopts a multi-dimensional comparison algorithm to make a detailed comparison of volume, pitch, rhythm, and timbre respectively. For example:

[0054] Volume comparison: Calculate the average volume difference between the two tracks within the same time period.

[0055] Pitch comparison: Use spectral analysis technology to detect the pitch deviation and determine the pitch difference.

[0056] Rhythm comparison: Identify the matching degree of rhythm patterns through time series analysis and evaluate the rhythm accuracy.

[0057] Timbre comparison: Analyze the spectral distribution and sound characteristics to judge the similarity of timbre.

[0058] The comparison results are quantified into specific numerical values. For example, the pitch difference can be expressed in cents, the rhythm difference can be expressed in milliseconds (ms), and the volume difference can be expressed in decibels (dB). According to the user's skill level and the current practice stage, the system can dynamically adjust the sensitivity and accuracy of the comparison; for beginners, relatively loose standards may be adopted; while for advanced users, more strict and detailed comparisons can be provided.

[0059] S1203. Obtain the corresponding track comparison result, determine the difference detection result between the performance audio and the standard track based on the track comparison result, and instantaneously feedback the difference detection result through LED lights with different colors and display modes.

[0060] Among them, the system aggregates the comparison results of each dimension to generate a detailed audio track comparison report. This report not only includes the overall performance evaluation but also points out specific differences and areas for improvement. Based on the comparison results, the system uses a built-in intelligent analysis module to provide personalized improvement suggestions. For example, if the user frequently has pitch problems in a certain section, the system may recommend strengthening pitch training and provide relevant practice methods and resource links.

[0061] Based on the comparison results, the system classifies the discovered differences into volume differences, pitch differences, rhythm differences, and timbre differences, and sets priorities according to the severity and importance. For example, serious pitch problems may be listed as the highest priority, while minor timbre differences may be ranked lower.

[0062] The system dynamically adjusts the display mode of the LED lights according to the type and priority of the differences. For example, pitch problems may be indicated by blue LED lights, rhythm problems by green LED lights, volume problems by yellow LED lights, and timbre problems by purple LED lights.

[0063] The system converts the difference detection results into the color and display mode of the LED lights in real time. For example:

[0064] Volume difference: When the volume is too high, the yellow LED light becomes bright; when the volume is too low, the yellow LED light becomes dim. Pitch difference: When the pitch is too high, the blue LED light blinks; when the pitch is too low, the blue LED light stays on continuously. Rhythm difference: When the rhythm is too fast, the green LED light blinks rapidly; when the rhythm is too slow, the green LED light blinks slowly. Timbre difference: When the timbre does not meet the standard, the purple LED light lights up and stays on for a while.

[0065] The brightness and blinking frequency of the LED lights can be dynamically adjusted according to the degree of the difference. For example, a larger difference will cause the LED light to be brighter or blink faster, while a smaller difference will result in a milder change; the system will automatically adjust the brightness of the LED lights according to the ambient light conditions to ensure that the indication information is clearly visible under any lighting conditions.

[0066] It should be noted here that when the color of the LED lights overlaps with the colors of the lights mentioned in the embodiments of this application in the steps of S1201 to S1203 of this application, it does not mean that the functions overlap. This is only an example of the scheme function of the steps of S1201 to S1203. When the colors representing different functions of the LED lights mentioned later in this application overlap, it is the same as the above situation. It is only for the convenience of understanding the scheme, and in the actual application process, there will be no situation of overlapping lights.

[0067] Through the above detailed steps, this method can not only collect and analyze the user's performance audio signal in real time, but also comprehensively compare it with the pre-stored standard track, extract the differences in aspects such as volume, pitch, rhythm, and timbre, and immediately feedback to the user through different colors and display modes of the LED lights. This method significantly improves the efficiency and fun of music learning, helps users more clearly understand the subtle problems in performance, and promotes self-correction and skill improvement.

[0068] The method further includes:

[0069] S1211, retrieve the pre-designed multi-channel LED light array.

[0070] It should be noted here that the system calls the pre-designed and configured multi-channel LED light array, which consists of multiple independently controlled LED lights. Each LED light can be individually set for color, brightness, and blinking frequency. The LED light array can be flexibly arranged according to the user's needs and practice scenarios, such as installed at different positions on the instrument (such as above the keys, near the strings, or on the surface of the instrument) to ensure the best visual feedback effect.

[0071] The system connects the LED light array to the main control unit through a dedicated interface to ensure the stability and real-time performance of data transmission; before use, the system initializes and calibrates the LED light array to ensure that the color, brightness, and response speed of each LED light are consistent, avoiding display errors caused by hardware differences.

[0072] S1212, based on the display mode, control the display of LED lights of different colors in the multi-channel LED light array at the same time.

[0073] Among them, the system fixedly assigns different colors to specific musical elements according to the preset color coding rules. For example, volume is represented by yellow, pitch by blue, rhythm by green, and timbre by purple.

[0074] The system controls the display of LED lights of different colors in the multi-channel LED light array at the same time. Each LED light adjusts its color, brightness, and blinking frequency according to the current state of the musical element; for example, at a certain moment, if the user's volume is too strong, the corresponding yellow LED light will become brighter; at the same time, if the pitch is too high, the blue LED light will blink; if the rhythm is too fast, the green LED light will blink quickly.

[0075] The system updates the display in the LED light array at a fixed time interval (such as several times per second) to ensure the real-time performance and accuracy of the feedback information. The state change of each LED light is based on the analysis result of the real-time collected performance audio signal, ensuring the immediacy and interactivity of the feedback.

[0076] By retrieving a pre-designed multi-channel LED light array and controlling the display of LEDs of different colors at the same time, this method realizes multi-dimensional real-time feedback on musical elements such as volume, pitch, rhythm, and timbre. Each LED light is independently controlled and fixedly assigned a color code to ensure that users can clearly and intuitively understand the changes in each musical element, thereby optimizing the practice effect and improving learning efficiency and interest.

[0077] In the embodiment of the present application, the method further includes:

[0078] S1221, analyzing and decomposing the preprocessed performance audio signal into at least two frequency bands, and each frequency band corresponds to a specific frequency range.

[0079] Among them, the system uses spectrum analysis techniques such as the Fast Fourier Transform (FFT) to convert the preprocessed audio signal from the time domain to the frequency domain. This enables the system to identify different frequency components in the audio signal; according to music theory and actual needs, the system divides the audio signal into multiple frequency bands, and each frequency band corresponds to a specific frequency range. For example: Low frequency band (0 - 300 Hz): mainly reflects the sounds of low-frequency instruments such as bass and drums; Middle frequency band (300 - 3,000 Hz): mainly reflects the sounds of middle-frequency instruments such as vocals and guitars; High frequency band (above 3,000 Hz): mainly reflects the sounds of high-frequency instruments such as strings and high-pitched percussion instruments.

[0080] At the same time, the system can dynamically adjust the range and number of frequency band divisions according to the instrument or track type selected by the user. For example, in piano practice, more middle-frequency band subdivisions may be added, while in guitar practice, more attention may be paid to the performance of the low-frequency and high-frequency bands.

[0081] S1222, assigning a specific color to each frequency band for corresponding LED light indication.

[0082] Among them, the system assigns a specific color to each frequency band to ensure that users can intuitively identify the changes in each frequency band. For example: Low frequency band: represented by red LED lights to emphasize the volume of the low-frequency part; Middle frequency band: represented by yellow LED lights to highlight the volume of the middle-frequency part; High frequency band: represented by blue LED lights to display the volume of the high-frequency part. It should be noted here that the color coding remains consistent throughout the practice process to avoid confusing users due to frequent color changes. The color of each frequency band can be customized in the system settings, but once determined, it remains fixed.

[0083] S1223, during performance, determining the corresponding actual volume based on the performance audio signal, and adjusting the brightness and blinking frequency of the corresponding LED lights based on the actual volume of each frequency band.

[0084] Among them, the system monitors the user's playing audio signal in real time and extracts the actual volume data of each frequency band according to the frequency band division. For example, the system calculates the average volume level of each frequency band within a certain time period.

[0085] According to the actual volume of each frequency band, the system dynamically adjusts the brightness of the corresponding LED lights. For example, when the volume of a certain frequency band is high, the corresponding LED light will become brighter; when the volume is low, the LED light will become dimmer. The system can also adjust the blinking frequency of the LED lights according to the change rate of the volume. For example, when the volume of a certain frequency band suddenly increases, the LED light will blink quickly to attract the user's attention; when the volume is stable, the LED light will stay on continuously.

[0086] The system updates the status of the LED lights at fixed time intervals (such as several times per second) to ensure the real-time and accuracy of the feedback information. Each update is based on the latest audio signal analysis result, ensuring the immediacy and interactivity of the feedback; the system automatically adjusts the brightness of the LED lights according to the ambient light conditions to ensure that the indication information is clearly visible under any lighting conditions.

[0087] By performing multi-band decomposition on the preprocessed playing audio signal and assigning specific colors to each frequency band for LED light indication, precise monitoring and feedback of volume changes in different frequency ranges are achieved; based on the actual volume of each frequency band, the brightness and blinking frequency of the corresponding LED lights are dynamically adjusted to help users more intuitively understand and control the volume distribution of each frequency band.

[0088] In the embodiment of this application, the volume is also set in detail. Specifically, the method further includes:

[0089] S1231, divide the volume range into multiple levels, and each volume level corresponds to a specific volume range.

[0090] Among them, the system divides the entire volume range into multiple levels according to music teaching and actual playing needs. For example, the volume can be divided into four levels: low volume (0 - 30 dB): suitable for gentle background music or low-volume practice; medium-low volume (30 - 50 dB): suitable for daily practice and medium-intensity playing; medium-high volume (50 - 70 dB): suitable for formal performances or higher-intensity playing; high volume (above 70 dB): suitable for large-scale performances or particularly emphasized musical passages.

[0091] Each volume level corresponds to a specific volume range and corresponding volume thresholds are set. These thresholds are determined through experiments and professional opinions to ensure their applicability in different instruments and scenarios. The system allows users to adjust the volume level division and threshold setting according to personal needs. For example, users can choose a more refined volume grading or adjust the range of each level according to the characteristics of a specific instrument.

[0092] S1232, retrieve the corresponding volume threshold, and determine the corresponding real-time volume level based on the performance audio signal and the volume threshold.

[0093] Among them, the system monitors the user's performance audio signal in real time and extracts the volume data at the current moment. Each data point collected represents the volume level at the current moment. The system compares the volume data collected in real time with the preset volume threshold to determine the level to which the current volume belongs. For example, if the real-time volume is 45 dB, the system will classify it as the "medium-low volume" level.

[0094] S1233, allocate the corresponding real-time color based on the real-time volume level, and control the corresponding real-time color of the LED light to light up based on the real-time color.

[0095] Among them, the system assigns a specific color to each volume level to ensure that users can intuitively identify the current volume level. For example: low volume: represented by a light blue LED light with low brightness; medium-low volume: represented by a blue LED light with moderate brightness; medium-high volume: represented by a yellow LED light with high brightness; high volume: represented by a red LED light with the highest brightness.

[0096] According to the volume level determined in real time, the system immediately adjusts the color and brightness of the corresponding LED light. For example, when the volume changes from low to medium-low, the LED light will change from light blue to blue; when the volume further increases to medium-high, the LED light will change from blue to yellow; when the volume reaches high, the LED light will change to red. If the volume changes rapidly within a short period of time, the system can also adjust the blinking frequency of the LED light to enhance the effect of visual cues. For example, when the volume suddenly increases, the LED light may blink quickly to draw attention.

[0097] By dividing the volume range into multiple specific levels and setting the corresponding volume thresholds for each level, this method realizes the precise monitoring and feedback of volume changes. The system determines the current volume level based on the real-time volume data and adjusts the color and brightness of the LED light accordingly, providing immediate and intuitive visual feedback. This method not only helps users better understand and control the volume changes during performance, but also improves the pertinence and efficiency of practice.

[0098] For the difference detection results in the embodiments of the present application, the method further includes:

[0099] S1204, retrieve the corresponding difference detection result, and determine the corresponding target difference element based on the difference detection result.

[0100] Among them, after each performance, the system stores the difference detection results obtained from the comparative analysis in the database. When the user conducts the next practice or needs feedback, the system will automatically retrieve the most recent or specified difference detection results to ensure the continuity and consistency of the feedback information.

[0101] The system analyzes the difference detection results through intelligent algorithms to identify the target difference elements that most need improvement. For example, if the user's intonation problem is the most prominent, intonation will be determined as the target difference element; if there are more rhythm errors, rhythm will be given priority.

[0102] S1205, adjust the display priority indicated by the LED lights based on the target difference elements, and control the LED lights to display based on the display priority.

[0103] Among them, the system dynamically adjusts the display mode of the LED lights according to the priority of the target difference elements. For example, if intonation is determined to be the highest priority, all LED lights related to intonation (such as blue LED lights) will significantly enhance their visual cue effect. The adjustment of the display priority is not limited to color coding, but also includes brightness and blink frequency. For example, the LED lights corresponding to the difference elements with high priority will be brighter and blink more frequently to attract the user's special attention.

[0104] It should be noted here that the system controls the display of different color LED lights in the multi-channel LED light array at the same time to ensure that the feedback information for each frequency band or musical element can be clearly presented. For example, when both intonation and rhythm need to be improved, the blue LED lights (intonation) and green LED lights (rhythm) will work simultaneously, but the blue LED lights will have a higher brightness and blink frequency to highlight their priority.

[0105] S1206, if the user corrects the target difference element, gradually reduce the display priority corresponding to the indication of the target difference element.

[0106] Among them, the system continuously monitors the user's performance and evaluates the improvement of the target difference elements in real time. For example, if the user continuously plays the correct intonation for a period of time, the system will record this change. When the system confirms that the user has successfully corrected the target difference element, it will gradually reduce the display priority indicated by this element. For example, the originally brightly flashing blue LED lights (intonation) will gradually dim and the blink frequency will also slow down until it returns to the normal state.

[0107] If the user corrects multiple target difference elements simultaneously, the system will reset the priorities according to the new difference detection results and adjust the display mode of the LED lights accordingly. For example, if the pitch problem has been solved but the rhythm problem still exists, the system will set the rhythm as the new highest priority and adjust the corresponding LED light display. When the user successfully corrects a target difference element, the system will provide positive feedback, such as continuously lighting up the green LED light to indicate "correct", enhancing the user's confidence and learning motivation.

[0108] Based on the execution steps from S1204 to S1206 above, centralized feedback and prioritized processing of key issues are achieved. The display priority of the LED lights is dynamically adjusted according to the target difference elements to ensure that users can quickly identify and correct the most important problems. Once the user successfully corrects a target difference element, the system will gradually reduce its display priority, guiding the user to gradually optimize the overall performance. This not only improves the pertinence and efficiency of practice but also enhances the user's self-correction ability and learning experience, ultimately realizing a personalized and efficient music learning path.

[0109] In addition, the method further includes:

[0110] S1241, perform volume analysis on the performance audio signal, obtain the corresponding volume data, and generate a continuous volume curve based on the volume data.

[0111] Among them, the system captures the user's performance audio signal in real time through a high-quality microphone or pickup. Each data point collected represents the volume value at a certain time point. The system extracts the average volume value within each time period. For example, multiple data points can be collected per second to obtain more detailed volume change information.

[0112] The system combines the extracted volume data into a continuous volume curve, which reflects the changing trend of volume over time and can intuitively display the dynamic changes in volume during the user's performance. The volume curve not only includes instantaneous volume peaks but also the duration and change rate of the volume, providing a comprehensive view of volume changes.

[0113] S1242, control the preset multi-channel LED light array to display the volume curve based on the volume curve.

[0114] Among them, the system maps each data point on the volume curve to the corresponding LED light. For example, the volume value at a certain time point corresponds to the brightness of a specific LED light. The higher the volume, the brighter the corresponding LED light; the lower the volume, the dimmer the LED light. The color coding of each LED light can be customized according to user preferences, but usually, a gradient color is used to represent the volume change, such as a gradient from blue (low volume) to red (high volume).

[0115] Consistent with the foregoing, the system controls the display of different - colored LEDs in a multi - channel LED lamp array at the same time, ensuring that the feedback information for each frequency band or musical element can be clearly presented. For example, when the volume suddenly increases, the corresponding LED lamp will immediately light up and flash quickly to attract the user's attention.

[0116] S1243, determine the corresponding time interval, and update the display in the LED lamp array based on the time interval.

[0117] Among them, the system sets a fixed time interval (such as several times per second) according to actual needs for updating the display in the LED lamp array. This time interval can be adjusted according to the user's practice speed and complexity to ensure the timeliness and accuracy of feedback. The system regularly updates the state of the LED lamp at the set time interval to ensure the real - time and continuity of feedback information. Within each time interval, the system will recalculate the current volume value and accordingly adjust the brightness and color of the LED lamp. For example, if the volume suddenly increases at a certain moment, the system will immediately brighten the corresponding LED lamp in the next time interval.

[0118] By analyzing the volume of the performance audio signal and generating a continuous volume curve, this method realizes the accurate recording and visualization of volume changes, which not only helps users intuitively understand the volume changes during performance, but also enhances the interactivity and fun of practice, significantly improving the learning effect and user experience.

[0119] An embodiment of this application discloses an LED display device with volume level indication and strumming guidance. Referring to Figure 2 , the device includes but is not limited to:

[0120] A music element extraction module 200, when the user is performing, it collects the user's performance audio signal in real - time, pre - processes the performance audio signal, and analyzes the pre - processed performance audio signal to extract the corresponding music elements. The music elements include volume, pitch, and rhythm;

[0121] A display mode adjustment module 210, which adjusts the display mode of the LED lamp according to the music elements, and sends volume level indication and strumming guidance to the user based on the display mode of the LED lamp. The display mode includes the brightness and flashing frequency of the LED lamp;

[0122] A performance judgment module 220, which is used to judge whether the user plays correctly. When the user plays correctly, the LED lamp shows green and remains on. When the user plays wrongly, it controls the LED lamp to show red and remain on. If the wrong playing continues, it controls the LED lamp to show red and flash.

[0123] An embodiment of the present application also discloses an LED display method with volume level indication and strumming guidance, including a processor, and a program of the LED display method with volume level indication and strumming guidance described in any one of the above is running in the processor.

[0124] An embodiment of the present application also discloses a storage medium storing a program of the LED display method with volume level indication and strumming guidance described in any one of the above.

[0125] Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and should not be construed as limiting the present application. Those of ordinary skill in the art can make changes, modifications, substitutions, and variations to the above embodiments within the scope of the present application.

Claims

1. An LED display method with volume level indication and singing guidance, characterized in that: include: When the user is playing, the user's playing audio signal is collected in real time, the playing audio signal is preprocessed, the preprocessed playing audio signal is analyzed, and the corresponding music elements are extracted, the music elements including volume, pitch and rhythm; Adjusting the display mode of the LED light according to the music elements, and sending a volume level indication and a singing and playing guide to the user based on the display mode of the LED light, wherein the display mode includes the brightness and flashing frequency of the LED light; Determine whether the user plays correctly. When the user plays correctly, the LED light will display green and keep on. When the user plays incorrectly, the LED light will display red and keep on. If the user plays incorrectly continuously, the LED light will display red and flash. The method further includes: during the user's performance, calling up a pre-stored standard audio track, the standard audio track including music samples of professional performers; obtaining a corresponding performance audio track based on the performance audio signal, and comparing the performance audio track with the standard audio track, wherein the comparison content includes volume, pitch, rhythm, and timbre; obtaining a corresponding audio track comparison result, determining a difference detection result between the performance audio and the standard audio track based on the audio track comparison result, and instantly feeding back the difference detection result through LED lights of different colors and display modes, wherein the difference detection result includes volume difference, pitch difference, rhythm difference, and timbre difference; determining a corresponding target difference element based on the difference detection result; adjusting a display priority indicated by an LED light based on the target difference element, and controlling the LED light display based on the display priority; if the user corrects the target difference element, gradually reducing the display priority corresponding to the target difference element indication.

2. The LED display method with volume level indication and singing guidance according to claim 1, characterized in that: The method also includes: Analyze the preprocessed performance audio signal and decompose it into at least two frequency bands, and each frequency band corresponds to a specific frequency range; Assign a specific color to each frequency band for corresponding LED light indication; When performing, the corresponding actual volume is determined based on the performance audio signal, and the brightness and flashing frequency of the corresponding LED lights are adjusted based on the actual volume of each frequency band.

3. The LED display method with volume level indication and singing guidance according to claim 1, characterized in that: The method also includes: Divide the volume range into multiple levels, each volume level corresponds to a specific volume range; Retrieving a corresponding volume threshold, and determining a corresponding real-time volume level based on the performance audio signal and the volume threshold; A corresponding real-time color is allocated based on the real-time volume level, and the real-time color corresponding to the LED lamp is controlled to light up based on the real-time color.

4. The LED display method with volume level indication and singing guidance according to claim 2, characterized in that: The method also includes: Performing volume analysis on the performance audio signal to obtain corresponding volume data, and generating a continuous volume curve based on the volume data; Based on the volume curve, a preset multi-channel LED light array is controlled to display the volume curve, wherein each LED light represents a volume value at a time point; A corresponding time interval is determined, and a display in the LED light array is updated based on the time interval.

5. The LED display method with volume level indication and singing guidance according to claim 1, characterized in that: The method also includes: Retrieve a pre-designed multi-channel LED light array; Based on the display mode, different colors of LED lights of a multi-channel LED light array are controlled at the same time, wherein each LED light in the LED light array can be controlled independently, and the color codes of the LED lights are fixedly assigned to specific music elements.

6. A device for executing the LED display method with volume level indication and singing guidance as claimed in any one of claims 1 to 5, characterized in that: include: A music element extraction module collects the user's performance audio signal in real time when the user is performing, pre-processes the performance audio signal, and analyzes the pre-processed performance audio signal to extract corresponding music elements, including volume, pitch and rhythm; A display mode adjustment module, which is used to adjust the display mode of the LED light according to the music elements, and sends a volume level indication and a singing and playing guide to the user based on the display mode of the LED light, wherein the display mode includes the brightness and flashing frequency of the LED light; The performance judgment module is used to judge whether the user plays correctly. When the user plays correctly, the LED light displays green and keeps on displaying. When the user plays incorrectly, the LED light is controlled to display red and keeps on displaying. If the user plays incorrectly continuously, the LED light is controlled to display red and flash.

7. An LED display method with volume level indication and singing guidance, characterized in that: The invention comprises a processor in which a program of an LED display method with volume level indication and singing and playing guidance as claimed in any one of claims 1 to 5 is run.

8. A storage medium, characterized in that: A program is stored for the LED display method with volume level indication and singing guidance as described in any one of claims 1 to 5.

Citation Information

Patent Citations

  • An audio-based playable light control system and method

    CN109729622A

  • Piano playing auxiliary method, piano lamp control module and piano lamp

    CN114267051A