A method, device and chip for tone sequence generation of a stringless musical instrument

Abstract

The present disclosure relates to the technical field of intelligent musical instruments, and particularly relates to a sound sequence generation method, device and chip for a stringless musical instrument. The method is applied to a stringless musical instrument comprising a string touch detection module, a function button module and a sound sequence generation module, is executed by the sound sequence generation module, and controls the start and stop of an automatic accompaniment function and synchronously switches the background mode of the stringless musical instrument by recognizing a specific trigger operation on a special control button. In the automatic accompaniment mode, the current performance mode is automatically adapted to a melody performance mode, and the performance intention input by a user through a string touch action and a sound sequence selection button is collected at the same time. Finally, according to the current background mode, the real-time performance melody sound sequence generated based on the performance intention is intelligently output alone or the real-time performance melody sound sequence and the automatically generated background accompaniment sound sequence are synchronously mixed and output, forming a complete orchestral performance effect, so that the individual performance and the orchestral accompaniment are deeply integrated and intelligently controlled in an integrated manner, the same performance experience as a real guitar is realized, the freedom and music expressiveness of stringless guitar performance are significantly improved, and a performance experience with more comprehensive, convenient and expressive functions is provided for the user.

Description

Technical Field

[0001] This disclosure relates to the field of intelligent musical instrument technology, specifically to a method, apparatus, and chip for generating musical sequences for stringless musical instruments. Background Technology

[0002] With the rapid development of technology, the intelligentization of musical instruments has become an important development direction for the music industry. As a typical representative of intelligent musical instruments, the smart electronic guitar has rapidly risen in recent years due to its unique advantages, becoming a product trend that has attracted much market attention. It is not only relatively simple to play, lowering the barrier to entry for music and allowing more people to easily experience the joy of playing the guitar, but it also does not damage the skin of the fingers. This characteristic is especially favored by beginners and those who have high requirements for finger protection, thus winning widespread popularity in the market.

[0003] Currently, most smart guitars on the market adopt a stringless design to improve portability. These products mainly fall into two categories in terms of sound triggering mechanisms: one uses physical picks or keys, and the other uses optical or infrared sensors to simulate strings. However, these existing solutions still have significant shortcomings in terms of playing experience, functional completeness, and level of intelligence.

[0004] First, there are shortcomings in terms of freedom and expressiveness in performance. Using physical picks or keys results in mechanical operation and lacks the fluidity and expressiveness of traditional guitar playing where fingers interact with the strings. This prevents free strumming and nuanced dynamic control, severely limiting the transmission of musical emotion. Even when using sensors to simulate strings, existing solutions mostly focus on simple note triggering, failing to build a system capable of intelligently understanding performance intentions and generating corresponding rich tonal sequences.

[0005] Secondly, their functionality and intelligence are relatively limited. Most existing stringless guitars are positioned merely as replacements or simplified versions of traditional guitars, with functions limited to simulating the tone of a single instrument. They generally lack intelligent accompaniment systems that allow real-time interaction with the player, failing to provide collaborative performance capabilities and resulting in a monotonous playing experience that fails to meet users' needs for personalized creation or enjoying a band-like performance atmosphere.

[0006] In conclusion, existing stringless guitar technologies have many shortcomings in terms of playing experience and functional implementation.

[0007] Overcoming the shortcomings of existing technology, enhancing the freedom and musical expressiveness of stringless guitar playing, and providing users with a more comprehensive, convenient, and expressive playing experience is an urgent problem to be solved. Summary of the Invention

[0008] To address the problems in the related technologies, this disclosure provides a method, apparatus, and chip for generating tone sequences for stringless musical instruments.

[0009] In a first aspect, this disclosure provides a method for generating a musical sequence for a stringless musical instrument. The stringless musical instrument includes: a string touch detection module, a function key module, and a musical sequence generation module. The string touch detection module includes: one or two sets of through-beam sensors. The function key module includes: dedicated control keys and multiple musical sequence selection keys, each musical sequence selection key and / or a combination of multiple specified musical sequence selection keys corresponding to a specified chord or note. The string touch detection module and the function key module are respectively connected to the musical sequence generation module. The method is applied to the musical sequence generation module, including:

[0010] The system receives a function control command corresponding to the trigger state of the dedicated control button. The function control command is generated by the function button module based on the trigger state of the dedicated control button. When the trigger state of the dedicated control button is the first trigger state, the function control command is an automatic accompaniment start / stop command. The first trigger state includes: long press trigger. In response to the automatic accompaniment start / stop command, an automatic accompaniment thread is started, and an automatic accompaniment processing program is executed through the automatic accompaniment thread. The automatic accompaniment processing program includes: if automatic accompaniment is not currently started, generating the corresponding background accompaniment sequence according to preset accompaniment parameters and specified automatic chords in a sequential loop, and switching the current background mode to the automatic accompaniment mode to start automatic accompaniment; if automatic accompaniment is currently started, terminating the generation of the background accompaniment sequence to end automatic accompaniment, and switching the current background mode to the no-automatic-accompaniment mode. The system acquires a string-touch trigger signal generated by the string-touch detection module, corresponding to the user's string-touch action; the string-touch trigger signal is generated by the string-touch detection module based on the sensing signal of the through-beam sensor. Obtain the trigger state of the sequence selection key detected by the function key module; Obtain the current playing parameters, which include a playing mode, including any one of the following: chord playing mode and melody playing mode; in the chord playing mode, each note selection key and / or a combination of multiple specified note selection keys corresponds to a specified chord; in the melody playing mode, each note selection key and / or a combination of multiple specified note selection keys corresponds to a specified single note; if the current background mode is automatic accompaniment mode, then switch the playing mode in the current playing parameters to melody playing mode; The real-time performance melody sequence is generated based on the current playing parameters, the string-touch trigger signal, and the trigger state of the sequence selection button. The real-time performance melody sequence includes one or more notes. If the current background mode is automatic accompaniment mode, the real-time playing melody sequence and the background accompaniment sequence are synchronously mixed to generate a mixed sequence, which is then used as the output sequence; if the current background mode is no automatic accompaniment mode, the real-time playing melody sequence is used as the output sequence.

[0011] According to embodiments of this disclosure, the stringless musical instrument further includes a guide light strip comprising a plurality of LEDs, and the method further includes: Based on the practice piece specified by the user, load the practice piece data corresponding to the practice piece, the practice piece data including: string pressing sequence and string touching timing information; Based on the string pressing sequence of the practice piece data, the corresponding LED lights on the guide light strip are controlled to light up or change color to prompt the user to press the corresponding note selection button; Based on the string-touching timing information of the practice piece data, the guide light strip is controlled to generate a preset flashing pattern at the corresponding time to prompt the user to perform the string-touching action; During practice, the timing of the actual key presses for selecting notes and the string-touch trigger signals triggered by the user is recorded. The actual triggered key presses and timings are compared with the standard key presses and timings in the practice track data; Based on the comparison results, the accuracy score for this exercise is calculated and output.

[0012] According to embodiments of this disclosure, the playing parameters further include note characteristic parameters, and the step of generating a corresponding real-time performance melody sequence based on the current playing parameters, the string-touch trigger signal, and the trigger state of the sequence selection button includes: Based on the trigger state of the sequence selection key, obtain the identifier of the selected sequence selection key; The number of through-beam sensors triggered within a preset strumming time is determined based on the string-touch trigger signal. If, based on the number of sets of through-beam sensors triggered within the preset strumming duration, it is determined that only one set of through-beam sensors or any one of the two sets of through-beam sensors is triggered within the preset strumming duration, then: based on the current playing mode corresponding to the triggered through-beam sensor, and the correspondence between the identifier of the selected sequence selection button and the sequence, the corresponding strumming sequence is generated. If, based on the number of sets of through-beam sensors triggered within the preset strumming duration, the two sets of through-beam sensors are triggered sequentially within the preset strumming duration, then: the current strumming direction is determined according to the triggering order; based on the current strumming direction and the correspondence between the identifier of the selected note selection button and the note sequence, a corresponding strumming note sequence is generated; the strumming direction includes any one of the following: upward strumming and downward strumming, the strumming note sequence corresponding to the upward strumming direction is the upward strumming note sequence, and the strumming note sequence corresponding to the downward strumming direction is the downward strumming note sequence; Based on the notes in the generated plucking or strumming sequence configured with the current note feature parameters, a configured plucking or strumming sequence is generated, and the generated configured plucking or strumming sequence is used as the corresponding real-time performance melody sequence; wherein, the note feature parameters include one or more of the following: volume, pitch, tempo, beat, and timbre; If all the tone selection keys are in an untriggered state and the two sets of through-beam sensors are triggered sequentially within the preset strumming duration, then: the corresponding tone-cutting data is obtained according to the triggering order. The tone-cutting data is used to drive the sound source device to emit tone-cutting data. The tone-cutting data includes: downsweep tone-cutting data or upsweep tone-cutting data.

[0013] According to embodiments of this disclosure, the note characteristic parameters further include: sound effects; the stringless instrument further includes: a motion sensor; and the method further includes: Acquire motion data collected by the motion sensor; The current motion posture of the stringless instrument is identified based on the motion data collected by the motion sensor; The sound effects in the current note feature parameters are adjusted in real time according to the current movement posture of the stringless instrument.

[0014] According to embodiments of this disclosure, the stringless instrument further includes: a playing parameter adjustment module, which is connected to the sequence generation module; the playing parameters are updated based on the following method: The playing parameter adjustment module obtains the playing parameters input by the user and updates the current playing parameters to the playing parameters input by the user.

[0015] According to embodiments of this disclosure, when the dedicated control button is in a second trigger state, the function control instruction is an automatic drum machine start instruction; when the dedicated control button is in a third trigger state, the function control instruction is an automatic drum machine stop instruction; the second trigger state includes: single-click triggering; the third trigger state includes: double-click triggering; the method further includes: In response to the automatic drum machine start command, an automatic drum machine thread is started, and an automatic drum machine processing program is executed through the automatic drum machine thread. The automatic drum machine processing program includes: if the automatic drum machine is not currently started, generating a drum machine sequence in a loop according to a preset drum kit rhythm pattern to start the automatic drum machine; if the automatic drum machine is currently started, generating and inserting a random embellishment in the current measure of the drum machine sequence, and continuing to generate subsequent drum machine sequences until the end of the current measure. In response to the automatic drum machine stop command, the automatic drum machine sequence generation is terminated by the automatic drum machine thread to end the automatic drum machine; When both the automatic accompaniment and the automatic drum machine are in the started state, the start time or beat signal of the automatic accompaniment thread is aligned and synchronized with the clock signal of the automatic drum machine thread so that the background accompaniment sequence and the drum machine sequence are in the same timing. The mixed sequence or the real-time performance melody sequence is synchronously mixed with the drum machine sequence after clock alignment to generate the final mixed sequence, and the final mixed sequence is used as the output sequence.

[0016] According to embodiments of this disclosure, the random flower arrangement is generated in the following manner: Obtain the user's performance intensity parameters; Obtain current music context information, which includes at least one of the following: the tension of the current measure in the harmonic process, the section information of the preset music, and the dynamic change trend of the user's real-time performance; Based on the performance intensity parameters and the music context information, a corresponding embellished rhythm pattern is generated by selecting or fusing from a pre-set library of multiple drum embellishment templates associated with different contexts. The random perturbation is generated based on the selected or generated perturbation rhythm pattern.

[0017] According to embodiments of this disclosure, the stringless musical instrument further includes: a sequence playback module, the sequence playback module being connected to the sequence generation module; the method further includes: The output sequence is output to the sequence playback module so that the sequence playback module can play the output sequence.

[0018] Secondly, this embodiment provides a sequence generation device for a stringless musical instrument. The stringless musical instrument includes: a string touch detection module, a function key module, and a sequence generation module. The string touch detection module includes: one or two sets of through-beam sensors. The function key module includes: dedicated control keys and multiple sequence selection keys, each sequence selection key and / or a combination of multiple specified sequence selection keys corresponding to a specified chord or note. The device is disposed in the sequence generation module and includes: The function control instruction processing module is configured to: receive function control instructions corresponding to the trigger state of the dedicated control button, wherein the function control instructions are generated by the function button module according to the trigger state of the dedicated control button, wherein when the trigger state of the dedicated control button is a first trigger state, the function control instruction is an automatic accompaniment start / stop instruction; the first trigger state includes: long press trigger; in response to the automatic accompaniment start / stop instruction, start the automatic accompaniment thread, and execute the automatic accompaniment processing program through the automatic accompaniment thread, wherein the automatic accompaniment processing program includes: if automatic accompaniment is not currently started, generating the corresponding background accompaniment sequence according to preset accompaniment parameters and specified automatic chords in a sequence loop, and switching the current background mode to the automatic accompaniment mode to start automatic accompaniment; if automatic accompaniment is currently started, terminating the generation of the background accompaniment sequence to end automatic accompaniment, and switching the current background mode to the no automatic accompaniment mode; The string-touch trigger signal acquisition module is configured to acquire a string-touch trigger signal generated by the string-touch detection module that corresponds to the user's string-touch action; the string-touch trigger signal is generated by the string-touch detection module based on the sensing signal of the through-beam sensor; The key trigger state acquisition module is configured to: acquire the trigger state of the sequence selection key detected by the function key module; The output sequence generation module is configured to: acquire current playing parameters, including a playing mode, which includes any one of the following: chord playing mode and melody playing mode; in the chord playing mode, each sequence selection key and / or a combination of multiple specified sequence selection keys corresponds to a specified chord; in the melody playing mode, each sequence selection key and / or a combination of multiple specified sequence selection keys corresponds to a specified single note; if the current background mode is automatic accompaniment mode, the playing mode in the current playing parameters is switched to melody playing mode; generate a corresponding real-time playing melody sequence based on the current playing parameters, the string trigger signal, and the trigger state of the sequence selection keys, the real-time playing melody sequence including one or more notes; if the current background mode is automatic accompaniment mode, the real-time playing melody sequence is synchronously mixed with the background accompaniment sequence to generate a mixed sequence, and the mixed sequence is used as the output sequence; if the current background mode is no automatic accompaniment mode, the real-time playing melody sequence is used as the output sequence.

[0019] Thirdly, this embodiment provides a chip including a memory and a processor; wherein the memory is used to store one or more computer instructions, wherein the one or more computer instructions are executed by the processor to implement the method described in any of the first aspects.

[0020] According to the technical solution provided in this disclosure, the sequence generation method is applied to a stringless instrument including a string touch detection module, a function button module, and a sequence generation module. The sequence generation module executes the method by recognizing specific trigger operations on dedicated control buttons to control the start and stop of the automatic accompaniment function with a single button press, and simultaneously switches the background mode of the stringless instrument. In automatic accompaniment mode, the current performance mode is automatically adapted to a melody performance mode, while simultaneously collecting the user's performance intention input through string touch actions and sequence selection buttons. Finally, based on the current background mode, the real-time performance melody sequence generated according to the performance intention is intelligently output separately, or the real-time performance melody sequence is synchronously mixed with the automatically generated background accompaniment sequence for output, forming a complete band-like performance effect. This deeply integrates individual performance with band-like accompaniment and performs unified intelligent control, achieving the same performance experience as a real guitar. This significantly improves the freedom and musical expressiveness of stringless guitar playing, providing users with a more comprehensive, convenient, and expressive performance experience, thereby enhancing the user experience. Furthermore, compared to using complex music production software, this disclosure uses a single button press for easy operation, conforming to the intuitive operating habits of guitar players.

[0021] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0022] Other features, objects, and advantages of this disclosure will become more apparent from the following detailed description of non-limiting embodiments, taken in conjunction with the accompanying drawings. In the drawings: Figure 1 A flowchart illustrating a method for generating a tone sequence for a stringless musical instrument according to an embodiment of the present disclosure is shown. Figure 2 A schematic diagram of the functional modules of a stringless musical instrument according to an embodiment of the present disclosure is shown. Figure 3 A schematic diagram showing the adjustment of playing parameters according to an embodiment of the present disclosure is shown; Figure 4 A flowchart of a method for generating a real-time performance melody sequence according to an embodiment of the present disclosure is shown; Figure 5 A schematic diagram of a sequence generation device for a stringless musical instrument according to an embodiment of the present disclosure is shown. Figure 6 A structural block diagram of a chip according to an embodiment of the present disclosure is shown; Figure 7 A schematic diagram of the external structure of a stringless musical instrument according to an embodiment of the present disclosure is shown. Detailed Implementation

[0023] In the following, exemplary embodiments of the present disclosure will be described in detail with reference to the accompanying drawings to enable those skilled in the art to readily implement them. Furthermore, for clarity, portions unrelated to the description of exemplary embodiments have been omitted from the drawings.

[0024] In this disclosure, it should be understood that terms such as “comprising” or “having” are intended to indicate the presence of features, figures, steps, behaviors, components, parts or combinations thereof disclosed in this specification, and are not intended to exclude the possibility of the presence or addition of one or more other features, figures, steps, behaviors, components, parts or combinations thereof.

[0025] It should also be noted that, unless otherwise specified, the embodiments and features described in this disclosure can be combined with each other. This disclosure will now be described in detail with reference to the accompanying drawings and embodiments.

[0026] As mentioned above, existing stringless guitars, whether pick-triggered, button-triggered, or using optical or infrared sensors to simulate strings, all suffer from limitations in terms of playing freedom and expressiveness. Furthermore, they are relatively simple in terms of functional integration and intelligence, resulting in a monotonous playing experience. They fail to meet users' needs for personalized creation or enjoying a band-like playing atmosphere, thus reducing the freedom and musical expressiveness of stringless guitar playing and failing to provide users with a more comprehensive, convenient, and expressive playing experience.

[0027] How can we enhance the freedom and musical expressiveness of stringless guitar playing, providing users with a more comprehensive, convenient, and expressive playing experience? This disclosure, based on market research, reveals that most stringless guitars currently on the market are geared towards beginners, focusing on lowering the barrier to entry for playing. Their functional design is often limited to a single chord accompaniment mode. In this mode, the user presses a combination of keys on the neck with their left hand to specify a chord, while their right hand triggers a sensor to produce the sound of that chord. This mode is very suitable for "singing and playing" scenarios, where the guitar serves only as an accompaniment instrument. However, typical popular music structures usually include intros, interludes, and outros. These sections often require the guitar to simultaneously play both "harmonic accompaniment" and "solo." The existing interactive logic of stringless guitars prevents users from manually playing the melody while the instrument automatically maintains the background chord progression, making it difficult to fully perform a song with a solo section. This significantly weakens the instrument's musical expressiveness and the user's playing experience, leaving stringless guitars significantly behind traditional guitars in terms of functionality.

[0028] Therefore, this disclosure provides a method for generating tone sequences for stringless instruments. By setting up dedicated control logic, it realizes the concurrent processing of "automatic chords + manual melody" in the solo section of the stringless guitar, thereby realizing intelligent collaboration and integrated control of performance and intelligent accompaniment. This allows for both harmonic background and main melody to be taken into account under single-person operation, solving the pain point that the stringless guitar cannot play intros, interludes, and solos. It achieves band-level effects under single-person operation, greatly improving the freedom and musical expressiveness of stringless guitar performance, thereby enhancing the user experience.

[0029] The concept of "stringless instrument" in this disclosure has a broad extension, referring to the stringless simulation of existing or future stringed instruments of various types. In addition to stringless guitars, it also includes other plucked instruments, such as stringless basses and stringless ukuleles, as well as variations of bowed string instruments, such as stringless violins and stringless cellos.

[0030] Figure 1 A flowchart is shown for a method of generating a tone sequence for a stringless musical instrument according to an embodiment of the present disclosure.

[0031] Figure 2 A schematic diagram of the functional modules of a stringless musical instrument according to an embodiment of the present disclosure is shown. Figure 2 As shown, the stringless musical instrument includes: a string touch detection module, a function key module, and a note generation module. The note generation module is located in the control chip. The string touch detection module includes: one or two sets of through-beam sensors (…). Figure 2 (Taking a combination of two sets of through-beam sensors as an example); the function key module includes: a dedicated control key and multiple sequence selection keys, each sequence selection key and / or a combination of multiple specified sequence selection keys corresponds to a specified chord or note, and the string detection module and the function key module are respectively connected to the sequence generation module.

[0032] The method is applied to the sequence generation module, such as Figure 1 As shown, the process includes the following steps S110~S170: In step S110, a function control instruction corresponding to the trigger state of the dedicated control button is received. The function control instruction is generated by the function button module according to the trigger state of the dedicated control button. When the trigger state of the dedicated control button is the first trigger state, the function control instruction is an automatic accompaniment start / stop instruction. The first trigger state includes: long press trigger.

[0033] The dedicated control buttons are used to start and stop the automatic accompaniment and automatic drum machine. The corresponding automatic accompaniment and automatic drum machine functions can be controlled separately by independent dedicated control buttons, or a single dedicated control button can be used to trigger the automatic accompaniment start / stop, automatic drum machine start, and automatic drum machine stop commands respectively through different trigger states (long press, single click, double click) to realize the automatic accompaniment and automatic drum machine functions simultaneously. Compared with the former solution, the latter solution has a simpler design and saves product costs due to the reduction of the number of buttons.

[0034] In this disclosure, the design of function keys (including dedicated control keys and tone selection keys) can be implemented by mechanical keys or by touch keys. Mechanical keys have clear tactile feedback and are suitable for scenarios that require precise operation, while touch keys have a simpler appearance and a longer service life. The specific implementation method can be selected according to actual needs.

[0035] In step S120, in response to the automatic accompaniment start / stop command, an automatic accompaniment thread is started, and an automatic accompaniment processing program is executed through the automatic accompaniment thread. The automatic accompaniment processing program includes: if automatic accompaniment is not currently started, generating a corresponding background accompaniment sequence according to preset accompaniment parameters and specified automatic chords in a sequential loop, and switching the current background mode to the automatic accompaniment mode to start automatic accompaniment; if automatic accompaniment is currently started, terminating the generation of the background accompaniment sequence to end automatic accompaniment, and switching the current background mode to the no-automatic-accompaniment mode.

[0036] Among them, the accompaniment parameters are the core configuration parameters that control the style, expression and dynamics of the automatic accompaniment music. These parameters include basic parameters (such as music style, tonality, etc.), voice configuration parameters (such as voice density), dynamic parameters (such as variation mode, intensity), harmonic parameters (such as harmonic rhythm), and output parameters (such as quantization precision and output format). These parameters together constitute an accompaniment template, which determines the basic characteristics of the accompaniment.

[0037] An automatic chord progression sequence is a predefined or real-time generated chord sequence that specifies the chords to be played at a particular point in time, similar to the harmonic progressions followed by keyboardists or guitarists in a real band. In practice, it can be preset and saved, and then updated according to user settings through corresponding functional modules.

[0038] Background mode refers to the current accompaniment context of the system, which determines how the real-time performance interacts with the automatically generated sequence. Background modes include: automatic accompaniment mode and no automatic accompaniment mode. In no automatic accompaniment mode, no background sequence is generated, and only the real-time performance is processed. The performance sequence is directly output, which is used to simulate a traditional instrumental solo scene and is suitable for practice and improvisational solos. In automatic accompaniment mode, a background accompaniment sequence is generated and output. The real-time performance effect is a mixed output of the performance sequence and accompaniment, which is used to simulate a solo performance scene with band accompaniment and is suitable for singing and playing solos.

[0039] Background accompaniment sequences typically include a combination of multiple instrument tracks such as drums, bass, piano / guitar parts, and string support, forming a rich musical texture. In one specific implementation, the corresponding background accompaniment sequence can be generated by sequentially looping based on preset accompaniment parameters and specified automatic chords as follows: First, a corresponding accompaniment template is loaded based on the user-selected music style. This template defines the basic configurations of the instrument timbre, rhythm pattern, and performance mode for the drum kit, bass, chord instruments, and backing vocals. Next, an automatic chord progression sequence is parsed, which clarifies the chords and their durations for each measure, providing a unified harmonic framework for each part. Then, a sequence is generated in a multi-track parallel manner: the drum kit generates basic beats based on the rhythm pattern and inserts dynamic fills at preset embellishment points; the bass kit generates a sequence based on the chord root note and a specified progression pattern (such as a fifth from the root note or Walking). Bass constructs the bass line; chordal instrument parts (such as piano or guitar) generate arpeggios or block harmonies based on chord type and rhythmic pattern, and automatically optimize chord inversions to ensure smooth part progression; the base part generates string or synthesizer sustained notes when the intensity parameter reaches a threshold to enhance the musical texture; after all parts are generated, the system applies dynamic processing curves to adjust the volume and density between sections according to the variation pattern, then mixes each track according to the part balance parameters, and sets a loop structure based on the chord progression sequence length; finally, the generated background accompaniment sequence is sent to the playback buffer, synchronized with the system master clock, and responds in real time to user parameter adjustments and chord sequence updates, thus forming a loopable, dynamically adaptable professional-grade band accompaniment sequence.

[0040] In step S130, a string-touch trigger signal corresponding to the user's string-touch action is obtained by the string-touch detection module; the string-touch trigger signal is generated by the string-touch detection module based on the sensing signal of the through-beam sensor.

[0041] The through-beam sensor disclosed herein is a sensor based on photoelectric principles that detects the presence, position, or state changes of an object by changing the continuity of the light path between the transmitter and receiver. In the through-beam sensor, the transmitter and receiver are separate and paired for installation. Each pair of transmitters and receivers forms a through-beam sensor. Its core working principle is as follows: the transmitter continuously emits a light beam of a specific wavelength (such as infrared light, laser, etc.), and the receiver receives the light signal and outputs a stable signal when the light path is unobstructed; when an object enters the light path, the light beam is blocked, and the receiver, unable to receive the light signal, triggers a change in its output state (such as changing from a high level to a low level), thereby realizing the detection of the object.

[0042] Through-beam sensors can be categorized based on the type of light source, such as laser through-beam sensors and infrared through-beam sensors. In selecting the specific through-beam sensor used, and considering the functionality of the stringless guitar, this disclosure prioritizes the use of an infrared through-beam sensor.

[0043] The infrared through-beam sensor disclosed herein includes a transmitter and a receiver, as well as other auxiliary components (such as a housing and mounting bracket). The transmitter of the infrared through-beam sensor includes, but is not limited to, an infrared LED, which may have a built-in collimating lens. The receiver of the infrared through-beam sensor includes, but is not limited to, a photosensitive element, such as a photodiode or phototransistor. Compared to laser through-beam sensors, infrared through-beam sensors use infrared light as the light source, resulting in lower cost and power consumption. Furthermore, the readily available general-purpose components require no special packaging or certification, making them suitable for applications in consumer products such as stringless guitars. In contrast, laser through-beam sensors require highly collimated sensors to avoid signal interference when adjacent pairs of sensors are close together. High-collimation lasers are expensive and require rigorous optical calibration, increasing production time and equipment investment, which hinders cost control and mass production, thus affecting market acceptance.

[0044] According to an embodiment of this disclosure, when a touch-string trigger signal corresponding to a user's touch-string action is generated based on the sensing signal of the through-beam sensor, a light beam is emitted from the transmitter to the receiver to form a light string. When the user touches the light string, causing the light beam received by the receiver to be blocked, the touch-string trigger signal corresponding to the user's touch-string action is generated.

[0045] In one specific embodiment, after the string-touch detection module is activated, the transmitter of the infrared beam sensor continuously emits an infrared beam. When the optical path is unobstructed, the receiver receives the light signal and outputs a stable high-level signal, indicating that the optical string is not blocked. At this time, a virtual "optical string" is formed between the transmitter and receiver. When a user's finger or other object enters the optical path and blocks the infrared beam, the receiver, unable to receive the light signal, triggers a change in its output state, changing the output signal from high to low, indicating that the optical string is blocked. The string-touch detection module continuously monitors the receiver's output signal. When it detects that the receiver's output signal has changed from high to low, the string-touch detection module determines that the user has made a string-touch action and then generates a string-touch trigger signal corresponding to the user's action. This signal is typically a level change signal or a specific pulse signal. The string-touch detection module then sends the generated string-touch trigger signal to the tone sequence generation module.

[0046] In this disclosure, besides prioritizing the use of infrared through-beam sensors, the number of through-beam sensor groups used was repeatedly verified in conjunction with the functionality of the stringless guitar. Ultimately, one or two through-beam sensors were selected to achieve string touch detection. During the verification process, this disclosure simulated the number of strings and string spacing of a real guitar, using 6 through-beam sensors to achieve string touch detection on a stringless guitar. After repeated evaluation, it was found that when using 6 closely arranged through-beam sensors, since the actual string spacing of a guitar is only 1.2cm, the 6 pairs of sensors need an extremely narrow divergence angle (<9°) to avoid crosstalk. Thus, especially for laser through-beam sensors, when the collimation of the laser is insufficient, the beams between adjacent sensors are prone to crosstalk or interference, which can lead to false triggering or signal loss, affecting the accuracy and stability of the performance. Furthermore, due to the close proximity of the sensors, users must block specific beams with millimeter-level precision (simulating single-string plucking), resulting in a significant difference from the "regional" plucking feel of an actual guitar. This places excessive demands on trigger accuracy. Under such stringent playing logic, players struggle to accurately trigger the correct sensors, especially beginners or those with limited finger dexterity. This reduces the smoothness and accuracy of playing, and may even prevent normal performance, impacting user experience and hindering product market promotion and long-term development. While increasing the distance between sensors can reduce signal interference and improve trigger accuracy, this would significantly differ from the actual guitar playing experience, as the string spacing on an actual guitar is fixed and players are accustomed to this layout. Therefore, this solution, using six sets of sensors to recreate the physical structure of the strings, excessively pursues hardware simulation while neglecting user experience and mass production feasibility, thus failing to truly realize guitar playing and is functionally infeasible.

[0047] This disclosure uses one or two sets of through-beam sensors. On the one hand, since it is not necessary to equip each "string" with an independent sensor, hardware costs can be significantly reduced. The reduction in the number of sensors also simplifies the manufacturing process and assembly flow, reducing production difficulty and costs. On the other hand, reducing the number of optical strings to one or two sets allows for interference avoidance by widening the string spacing, while also reducing the collimation requirements of the through-beam sensors. Taking two sets as an example, the distance between the two sets of sensors can be set to an appropriate value, such as 3~6cm. Assuming the distance between the two sets of through-beam sensors is W, and the distance between the transmitter and receiver is L, then it is only necessary for the transmitter's emission angle to be less than 2°. With an arctan(W / L) value, sensors won't interfere with each other. For example, when using a W of approximately 6cm and an L of approximately 15cm, which corresponds to the plucking area of ​​a real guitar, the emission angle is 44 degrees. This meets the requirements of almost all low-cost transmitters. Furthermore, by reducing the number of optical strings to one or two groups, the plucking action can be simulated only from top to bottom, only from bottom to top, or from both top and bottom directions. This eliminates the possibility of accidentally triggering other optical strings, thus improving the accuracy and stability of the performance.

[0048] This disclosure also focuses on the design of the distance between the transmitter and receiver of the through-beam sensor and the spacing between each set of through-beam sensors. Two schemes are set to meet product performance requirements and market positioning: one is a fixed distance and spacing, where the through-beam distance L between the transmitter and receiver is set to any value in the range [5cm, 15cm] based on the operating habits of most players and component parameters, and the spacing W between the two sets of through-beam sensors is set to any value in the range [3cm, 10cm]. The other is an adjustable distance and spacing, where the through-beam distance between the transmitter and receiver is dynamically adjustable within a preset distance range, and / or the spacing between the two sets of through-beam sensors is dynamically adjustable within a preset spacing range. With the adjustable distance and spacing, users can adjust the string spacing and / or through-beam distance according to hand size or playing habits, adapting to different hand shapes and playing modes, thereby avoiding accidental touches or missed triggers. It also covers a full range of users, from children to adults, from beginners to professional musicians, which helps to expand the product's audience. Meanwhile, the dynamic adjustment function can counteract the effects of component aging and improve product durability. For example, if the brightness of the infrared LED decreases after long-term use, performance can be maintained by increasing L or decreasing W, avoiding hardware replacement.

[0049] In implementing adjustable distance and spacing solutions, for dynamically adjustable beam distance, a mechanical sliding rail can be used. For example, a linear slide rail can be installed inside the shell of a stringless instrument, with the transmitter and receiver fixed to sliders respectively. The slide rail is marked with graduations (e.g., 5cm / 10cm / 15cm), allowing users to manually adjust the position. A locking mechanism, using knobs, screws, or spring clips, secures the sliders to prevent displacement during playing. For dynamically adjustable string spacing, a modular sliding groove design can be used. For example, a horizontal sliding groove can be set on the instrument's panel, with two sets of sensor modules embedded in the groove via sliders. The groove has internal graduations (e.g., 3cm / 4.5cm / 6cm), and the sliders are secured with push-button clips. When simultaneously adjusting the beam distance and string spacing, two sets of sensors can be mounted on a cross slide rail. The vertical slider adjusts the beam distance, and the horizontal slider adjusts the string spacing. A linkage gear controls the vertical and horizontal sliders, ensuring that the transmitter and receiver are always facing each other during adjustment.

[0050] In implementing the adjustable distance and spacing scheme, the following structure can be used: The two sets of through-beam sensors include a first through-beam sensor and a second through-beam sensor. A cross-shaped sliding adjustment mechanism is provided in the first part of the front of the instrument body. The cross-shaped sliding adjustment mechanism includes a first longitudinal slide rail, a second longitudinal slide rail, and a transverse slide rail. The transmitter and receiver of the first through-beam sensor are mounted on the first longitudinal slide rail via their respective sliders, and the transmitter and receiver of the second through-beam sensor are mounted on the second longitudinal slide rail via their respective sliders. Both the first and second longitudinal slide rails are slidably connected to the transverse slide rail via their respective sliders. The first, second, and transverse slide rails are all provided with scale markings to indicate positions, determining the spacing between the two sets of through-beam sensors or the specific distance between the transmitter and receiver.

[0051] This disclosure also provides a locking function for the sliders on the longitudinal and transverse slide rails. According to embodiments of this disclosure, the stringless guitar further includes: a first locking member, a second locking member, a third locking member, and a fourth locking member.

[0052] The first locking member is connected to the slider on the first longitudinal slide rail on which the transmitter or receiver is mounted, and is used to lock the corresponding slider at any position on the first longitudinal slide rail.

[0053] The second locking member is connected to the slider on the second longitudinal slide rail on which the transmitter or receiver is mounted, and is used to lock the corresponding slider at any position on the second longitudinal slide rail.

[0054] The third locking member is connected to the slider corresponding to the first longitudinal slide rail, and is used to lock the first longitudinal slide rail at any position of the transverse slide rail.

[0055] The fourth locking member is connected to the slider corresponding to the second longitudinal slide rail, and is used to lock the second longitudinal slide rail at any position of the transverse slide rail.

[0056] The first locking element, the second locking element, the third locking element, and the fourth locking element can be any one of a knob screw, an eccentric cam lock, or a spring pin.

[0057] This disclosure uses a locking mechanism to fix the corresponding slider, which can prevent the sensor from shifting due to vibration or accidental contact during performance or carrying, thereby ensuring the stability and reliability of string touch detection.

[0058] In step S140, the trigger state of the sequence selection key detected by the function key module is obtained.

[0059] For multiple sequence selection keys, you can select the corresponding number of sequence selection keys as needed, such as 4 keys; in terms of layout design, you can choose a single row or double row design, and support multiple keys to be pressed at the same time to realize the combined trigger logic of multiple keys.

[0060] When detecting the trigger state of the sequence selection keys, the function key module can determine whether a key has been triggered by detecting changes in voltage level (for mechanical keys) or capacitance (for touch keys), then generate a corresponding event or interrupt, and finally notify the sequence generation module to perform the corresponding sequence generation operation. For example, when a key is detected to be pressed, a key press event is generated. When the sequence generation module receives the key press event, it will determine which keys are pressed based on the key identifier, and then search for the corresponding chord or note based on the key or key combination.

[0061] In step S150, the current playing parameters are obtained. The playing parameters include a playing mode, which includes any one of the following: chord playing mode and melody playing mode. In the chord playing mode, each note selection key and / or a combination of multiple specified note selection keys corresponds to a specified chord. In the melody playing mode, each note selection key and / or a combination of multiple specified note selection keys corresponds to a specified single note. If the current background mode is automatic accompaniment mode, the playing mode in the current playing parameters is switched to melody playing mode.

[0062] The performance mode defines whether the selected sequence selection button or its combination, triggered by the through-beam sensor, corresponds to a chord or a single note. When entering automatic accompaniment mode, the performance mode for all through-beam sensors must be switched from chord performance mode to melody performance mode to prevent harmonic conflicts.

[0063] By supporting the setting of corresponding performance modes for each set of through-beam sensors, the product can adapt to the performance needs and scenarios of different users. Specifically, the chord performance mode is suitable for providing background accompaniment for other instruments or vocals, while the melody performance mode allows users to perform solo, enhancing the instrument's versatility. The note characteristic parameters include, but are not limited to, volume, pitch, tempo, beat, and timbre. Based on these note characteristic parameters, users can customize the sound effects according to their preferences and performance needs. This personalized setting not only enhances the enjoyment of playing but also enables the product to simulate the sounds of various real instruments, increasing its expressiveness.

[0064] In addition, the playing parameters also include note characteristic parameters, which include one or more of the following: volume, pitch, tempo, beat and timbre. In this disclosure, the playing parameters can be fixed by pre-determined values ​​or dynamically adjusted by corresponding functional modules.

[0065] like Figure 2 As shown, the stringless instrument further includes: a playing parameter adjustment module, which is connected to the sequence generation module; the playing parameters are updated based on the following method: The playing parameter adjustment module obtains the playing parameters input by the user and updates the current playing parameters to the playing parameters input by the user.

[0066] In a specific example, such as Figure 2 As shown, the playing parameter adjustment module includes a playing parameter display screen and a parameter setting knob. The parameter setting knob is used to select and set playing parameters, and the playing parameter display screen is used to display the playing parameters. In specific implementation, playing parameters can be selected or adjusted by rotating the knob, and parameter value setting mode can be entered or exited by short-pressing the knob.

[0067] Figure 3 A schematic diagram showing the adjustment of playing parameters according to an embodiment of the present disclosure is provided. Figure 3 As shown, if you set the volume in the playing parameters to 5, rotate the knob until the parameter displays "Volume". After a short press of the knob, an underline appears below the parameter value. Then rotate the knob again until the parameter value displays "5". Finally, a short press of the knob will make the underline disappear, thus completing the operation of setting the volume to 5.

[0068] In addition, when the string detection module is implemented through two sets of through-beam sensors, the style corresponding to one set of through-beam sensors can be set to chord playing mode and the style corresponding to the other set can be set to melody playing mode through the playing parameter adjustment module. This allows the corresponding through-beam sensors to be triggered during playing to generate different style sequences, thereby improving the musical expressiveness of the performance.

[0069] This invention allows users to dynamically adjust playing parameters, enabling them to select the corresponding chord chart or sheet music based on the piece they wish to play. The playing parameters of the stringless instrument are then adjusted according to the selected score, allowing for the performance of different styles of music and enhancing the freedom and expressiveness of the performance. Furthermore, it allows users to adjust playing parameters according to their personal preferences and performance needs, resulting in a more personalized performance.

[0070] In a specific example, taking two sets of through-beam sensors, the playing parameters that the playing parameter adjustment module can dynamically adjust and their descriptions are shown in Table 1 below: Table 1. Comparison of Playing Parameters and Explanations

[0071] In step S160, a corresponding real-time performance melody sequence is generated based on the current playing parameters, the string-touch trigger signal, and the trigger state of the sequence selection button. The real-time performance melody sequence includes one or more notes.

[0072] Figure 4 A flowchart illustrating a method for generating a real-time performance melody sequence according to an embodiment of the present disclosure is shown. Figure 4 As shown, the step of generating the corresponding real-time performance melody sequence based on the current playing parameters, the string-touch trigger signal, and the trigger state of the sequence selection button includes the following steps S410~S460: In step S410, the identifier of the selected tone sequence selection key is obtained according to the trigger state of the tone sequence selection key.

[0073] In step S420, the number of groups of through-beam sensors triggered within a preset strumming time is determined based on the string-touch trigger signal.

[0074] The preset strumming duration is a fixed time used to determine whether the current string-touching operation is strumming or plucking. If two sets of through-beam sensors are triggered within this duration, the current string-touching operation is determined to be strumming; if only one set is triggered, it is determined to be plucking. The preset strumming duration can be set according to the string spacing. In a specific example, the preset strumming duration is set to 50ms. Determining the number of through-beam sensors triggered within the preset strumming duration can be achieved using a timer. For example, when a string-touching trigger signal is received after one set of through-beam sensors, a 50ms timer is started. If another set of through-beam sensors is received within 50ms, it is determined that two sets of through-beam sensors were triggered within the preset strumming duration; otherwise, it is determined that only one set was triggered.

[0075] If, based on the number of through-beam sensors triggered within the preset sweeping duration, it is determined that only one group of through-beam sensors or either of the two groups of through-beam sensors is triggered within the preset sweeping duration, then step S430 is executed. If, based on the number of through-beam sensors triggered within the preset sweeping duration, it is determined that the two groups of through-beam sensors are triggered sequentially within the preset sweeping duration, then step S440 is executed.

[0076] In step S430, a corresponding plucking sequence is generated based on the current playing mode corresponding to the triggered through-beam sensor and the correspondence between the identifier of the selected sequence selection button and the sequence.

[0077] The string-picking sequence refers to the sequence generated by a single trigger of a set of sensors, corresponding to a string-picking action (upstroke or downstroke). Based on the playing mode (chord / melody playing mode) and key combination, it outputs discrete note or chord decomposition sequences.

[0078] In a specific example, the correspondence between each sequence selection key and / or a combination of specified sequence selection keys and the sequence (note or chord) is set in the form of a correspondence table. Taking a sequence selection key containing four keys (key 1, key 2, key 3, and key 4) as an example, Table 2 shows a correspondence table between a key or key combination and the sequence.

[0079] Specifically, when no sequence selection button is triggered and the current playing mode corresponding to the triggered through-beam sensor is melody playing mode, a single note is emitted. .

[0080] Table 2. Correspondence between Key Presses and Pitch Sequence

[0081] In step S440, the current strumming direction is determined according to the triggering order; and the corresponding strumming sequence is generated according to the current strumming direction and the correspondence between the identifier of the selected key and the sequence of notes.

[0082] The strumming direction includes any one of the following: upward strumming and downward strumming. The strumming sequence corresponding to the upward strumming direction is the upward strumming sequence, and the strumming sequence corresponding to the downward strumming direction is the downward strumming sequence. Notes in the upward strumming sequence are triggered in ascending order of pitch, and notes in the downward strumming sequence are triggered in descending order of pitch. For example, for the C major triad [C, E, G], the corresponding upward strumming sequence is [C, E, G], and the corresponding downward strumming sequence is [G, E, C].

[0083] In one specific implementation, it is necessary to determine whether the playing mode corresponding to each set of through-beam sensors is chord playing mode. If not, the corresponding strumming sequence will not be generated. Only when the playing mode corresponding to each set of through-beam sensors is chord playing mode will the strumming sequence be generated according to the current strumming direction and the selected key selection button.

[0084] In another specific implementation, in order to more realistically simulate the strumming effect of a real guitar, when generating the corresponding strumming sequence, this disclosure generates the strumming sequence as long as the playing mode corresponding to any set of through-beam sensors is chord playing mode, or directly ignores the playing mode, even if the playing mode corresponding to any set of through-beam sensors is melody playing mode.

[0085] In this disclosure, the core difference between plucking and strumming sequences lies in the timing of note presentation. The essence of plucking sequences is to trigger the mapped notes or notes within a chord in a discrete, chronological order, creating the effect of arpeggiated chords or melodic lines. The essence of strumming sequences is to generate all the mapped notes within a chord simultaneously, simulating the harmonic blocks of guitar strumming. Upstrokes and downstrokes correspond to ascending or descending note sequences to increase realism. For chords, plucking sequences involve playing the notes within a chord sequentially, i.e., the notes within a chord are triggered sequentially (not simultaneously), forming a continuous melodic line; strumming sequences involve triggering the notes within a chord simultaneously, with all notes sounding at once. For example, for a C major triad CEG, if the sequence is generated using MIDI signals, the corresponding pluck sequence generates multiple discrete Note-On events (sent separately), and the duration of each note can be set independently (e.g., 50ms interval). The corresponding strum sequence generates a single composite Note-On event (notes are triggered simultaneously), and all notes share the same duration and start and end times.

[0086] In step S450, the notes in the generated plucking or strumming sequence are configured according to the current note feature parameters to generate the configured plucking or strumming sequence, and the generated configured plucking or strumming sequence is used as the corresponding real-time performance melody sequence.

[0087] In the actual implementation process, the type of note feature parameters to be set can be selected according to actual needs, and the notes in the plucked or strummed sequence can be configured based on the set note feature parameters. The configured sequence can be a MIDI sequence or an audio stream, containing all adjusted parameters.

[0088] According to embodiments of this disclosure, the method further includes: If all the tone selection keys are in an untriggered state and the two sets of through-beam sensors are triggered sequentially within the preset strumming duration, then: the corresponding tone-cutting data is obtained according to the triggering order. The tone-cutting data is used to drive the sound source device to emit tone-cutting data. The tone-cutting data includes: downsweep tone-cutting data or upsweep tone-cutting data.

[0089] Specifically, if the triggering order is a downward strumming (i.e., a downward strum), the corresponding downward strumming muting data is obtained; if the triggering order is an upward strumming (i.e., an upward strum), the corresponding upward strumming muting data is obtained. The downward strumming muting data and the upward strumming muting data can each be a pre-recorded fixed sequence of notes.

[0090] In this disclosure, on the one hand, the design of triggering only a muting effect (such as a muted tone) when strumming without triggering any selected note selection button accurately simulates the acoustic rule of "no sound when strumming" in a real guitar. Furthermore, when only the strumming operation is performed without triggering any selected note selection button, the corresponding single note is emitted, avoiding the incongruity of silence and providing basic performance feedback, thus preserving the essence of guitar playing to the maximum extent in a stringless instrument. On the other hand, in this disclosure, triggering the selected note selection button alone cannot generate the corresponding note sequence; it requires triggering the corresponding through-beam sensor. Compared to existing technologies that completely separate the strumming action by simply triggering sound with a button, this design restores the interaction logic of a real guitar and enhances the user's guitar playing experience.

[0091] According to embodiments of this disclosure, the note characteristic parameters further include: sound effects; the stringless instrument further includes: a motion sensor, which may be an inertial measurement unit (including a three-axis accelerometer and a three-axis gyroscope) integrated into the body of the stringless instrument, through which motion data is acquired in real time. The method further includes: The motion data collected by the motion sensor is acquired; specifically, the motion data may include linear acceleration and angular velocity. The linear acceleration of the stringless instrument in the X, Y, and Z directions is measured by an accelerometer at a fixed sampling rate (e.g., 100Hz), and the angular velocity around these three axes is measured by a gyroscope.

[0092] The system identifies the current posture of the stringless instrument based on motion data collected by the motion sensors. Specifically, a posture recognition algorithm calculates the instrument's three-dimensional spatial posture in real time based on filtered motion data. For example, a Kalman filter is used to fuse data from the accelerometer and gyroscope. Accelerometer data is used to estimate the direction of gravity to determine the pitch angle (forward and backward tilt) and roll angle (left and right tilt), but it is susceptible to linear acceleration interference. Gyroscope data integration can obtain angle changes but is subject to drift. The fusion algorithm can combine the strengths of both approaches to output stable, drift-free posture angles. Based on these posture angles, the system classifies the playing posture into several predefined action postures, such as: 1. Standard playing posture: The instrument is roughly horizontal, with a tilt angle within ±15°; 2. Forward / backward posture: A pitch angle exceeding the threshold (e.g., >20°) may indicate that the performer is leaning forward to concentrate on the performance or leaning back to relax. 3. Lateral swaying posture: The roll angle changes periodically, which may correspond to rhythmic body swaying.

[0093] 4. Rapid flipping / rotation posture: An instantaneous angular velocity exceeding a high threshold may indicate a performative action.

[0094] 5. Static / Idle attitude: All axis data are close to zero or only gravity values ​​for a long time.

[0095] The recognition process can employ a rule-based state machine, combined with a simple machine learning classifier (such as a lightweight decision tree), to improve recognition accuracy and robustness.

[0096] The sound effects in the current note characteristic parameters are adjusted in real time based on the current movement posture of the stringless instrument. In specific implementation, a "posture-sound effect" mapping table can be maintained to map the identified movement posture to specific sound effect parameter adjustment commands. The sound effect adjustment is not a simple on / off switch, but a continuous and dynamic modulation based on the amplitude, speed, and duration of the posture. Specific implementation includes: Intensity mapping: The tilt angle or rotation speed of an instrument is mapped linearly or non-linearly to sound effect parameter values. For example, the forward tilt angle of an instrument (0° to 45°) can be mapped to the intensity of a distortion effect (0% to 100%).

[0097] Timing control: Fast movements (such as rapid flips) may trigger momentary effects (such as short-delay feedback or wah sweeps), while sustained postures (such as maintaining a backward lean) may gradually introduce or maintain a certain effect (such as hall reverberation).

[0098] Parameter linkage: A single posture can simultaneously adjust multiple sound effect parameters. For example, a "left-right swaying posture" can simultaneously increase the depth of the chorus effect and the modulation speed, simulating the effect of a rotating speaker.

[0099] Smooth transition: To avoid abrupt changes in sound effects, the system uses first-order low-pass filtering or a more advanced envelope tracking algorithm to ensure smooth transition of sound effect parameters when the posture changes.

[0100] Context-aware: Adjustments take into account the current playing mode, chords, and background accompaniment. For example, in automatic accompaniment mode, gesture-triggered sound adjustments may be appropriately limited to avoid conflicting with the accompaniment.

[0101] The sound effect adjustment instructions are ultimately sent to the digital signal processing (DSP) unit or sound effect synthesis engine to modify the effects parameters in the audio processing pipeline in real time, thereby changing the timbre and spatiality of the final output sound.

[0102] This invention directly links physical actions with sound effects, breaking the traditional, fixed mapping between key presses / string picking and sound generation on musical instruments, and introducing a second dimension of real-time control. Performers can intuitively and naturally shape the timbre in real time through body language (such as tilting or swinging the instrument), greatly enriching musical expression and making electronic instrument playing more immersive and stage-worthy, closer to the integrated experience of playing a real instrument, thus enhancing expressiveness and immersion. Furthermore, it provides new possibilities for music creation and live performance, encouraging users to explore novel playing techniques and sound effects, increasing the product's playability and long-term appeal, especially for musicians who pursue individuality and innovation.

[0103] In step S170, if the current background mode is automatic accompaniment mode, the real-time playing melody sequence and the background accompaniment sequence are synchronously mixed to generate a mixed sequence, and the mixed sequence is used as the output sequence; if the current background mode is no automatic accompaniment mode, the real-time playing melody sequence is used as the output sequence.

[0104] In addition to providing an automatic accompaniment function, this disclosure also provides an automatic drum machine function, which is also implemented by triggering a dedicated control button. Specifically, when the dedicated control button is in a second trigger state, the function control command is an automatic drum machine start command; the second trigger state includes: single-click triggering; when the dedicated control button is in a third trigger state, the function control command is an automatic drum machine stop command; the third trigger state includes: double-click triggering.

[0105] Corresponding to the automatic drum machine start command and the automatic drum machine stop command, the method further includes: In response to the automatic drum machine start command, an automatic drum machine thread is started, and an automatic drum machine processing program is executed through the automatic drum machine thread. The automatic drum machine processing program includes: if the automatic drum machine is not currently started, generating a drum machine sequence in a loop according to a preset drum kit rhythm pattern to start the automatic drum machine; if the automatic drum machine is currently started, generating and inserting a random embellishment in the current measure of the drum machine sequence, and continuing to generate subsequent drum machine sequences until the end of the current measure.

[0106] In response to the automatic drum machine stop command, the automatic drum machine sequence generation is terminated by the automatic drum machine thread to end the automatic drum machine.

[0107] When both the automatic accompaniment and the automatic drum machine are in the started state, the start time or beat signal of the automatic accompaniment thread is aligned and synchronized with the clock signal of the automatic drum machine thread so that the background accompaniment sequence and the drum machine sequence are in the same timing. The mixed sequence or the real-time performance melody sequence is synchronously mixed with the drum machine sequence after clock alignment to generate the final mixed sequence, and the final mixed sequence is used as the output sequence.

[0108] Drum machine sequencers typically have a single rhythm function, providing only drum kit rhythms (such as bass drum, snare drum, hi-hat, etc.) without other instrumental parts. They are generated by the user through programmable or selected preset drum pattern modes, such as 4 / 4 time, shuffle, funk, etc., and can be manually combined with other instruments. Random embellishment refers to inserting a randomly generated drum variation during the remaining time of the current measure while the drum machine is running, maintaining the integrity of the beat before returning to the original rhythmic pattern.

[0109] This disclosure implements automatic accompaniment and drum machine functions in separate threads, allowing the sequence generation and rhythm control of the accompaniment and drum machine to run independently without blocking each other. When the user triggers other operations (such as real-time performance or parameter switching), the system can respond more quickly, avoiding operational delays caused by a single thread processing complex sequences. Furthermore, while the drum machine loops, the accompaniment thread can handle complex harmonic changes or rhythmic fillings, and the string detection and sequence generation for real-time performance can also be processed promptly, ensuring a smooth performance experience. In addition, users can independently start / stop the accompaniment or drum machine without affecting the operation of the other function.

[0110] For random flower addition, this disclosure provides the following two generation methods: Method 1: Method 1 involves the following steps: First, obtain the current section position, then calculate the remaining ticks (clock pulses) in the section. If the remaining ticks are greater than 0, generate a random filler; otherwise, queue it for generation in the next section. The generation of random embellishments is implemented as follows: First, obtain the current drum kit configuration. Then, determine the embellishment density based on the remaining time (number of ticks). For example, if the remaining time is more than half a measure (e.g., 8 ticks), generate a high-density embellishment; if the remaining time is between 1 / 4 measure and half a measure, generate a medium-density embellishment; if the remaining time is less than 1 / 4 measure, generate a low-density embellishment. The drum kit configuration determines the available tone combinations, the embellishment density affects the trigger frequency of notes, and the remaining ticks limit the length and ending method of the embellishment.

[0111] Finally, based on a Markov chain, random fillets are generated according to the current drum kit configuration, the fillet density, and the remaining tick count, including: First, the state space of the Markov chain is established. The core of the Markov chain lies in state transitions, which are represented using a state transition probability matrix. In the drum machine embellishment, each state represents a combination of timbres at one time step. Each timbre of the current drum kit (such as Kick, Snare, Hi-Hat, Clap, etc.) can be considered as a possible trigger state. Each state can include: single-note triggers (such as Kick, Snare, Hi-Hat), compound triggers (such as Kick + Snare, Hi-Hat + Clap), and rests (i.e., no trigger). The current state of the Markov chain depends on the previous N steps (such as 2 or 4 steps) to maintain rhythmic continuity.

[0112] The state transition probability matrix defines the probability of transitioning from one timbre combination to another. For example, there is a high probability of a Snare following a Kick (common in rock rhythms), and Snares or Claps may be interspersed when Hi-Hats are triggered consecutively (to increase the sense of rhythm).

[0113] Then, the transition probabilities are adjusted based on the scrambling density, which can be achieved by adjusting the transition probability matrix. For example, if the current scrambling density is high, the probability of Hi-Hat→Hi-Hat increases, while the probability of Hi-Hat→None decreases. If more complex scrambling is needed, the transition probabilities of complex states such as Snare→Kick+Clap can be increased.

[0114] Finally, filler elements are dynamically generated based on the remaining tick count. The remaining tick count determines the length and ending method of the filler elements. If there are many remaining ticks (e.g., more than 8 steps), longer transitions are allowed, such as Tom drum rolling or progressive Hi-Hat acceleration.

[0115] If there are few remaining ticks (e.g., less than 4 steps), the game tends to end abruptly, such as a strong bass drum beat or cymbal closure. The generation steps are as follows: 1. Initialize state: Start from the last valid state of the current section (e.g., [Kick, Snare]).

[0116] 2. Produce the next step step by step: Based on the transition probability of the Markov chain, select the most likely next state (e.g., [None, Hi-Hat]).

[0117] 3. A small amount of random perturbation can be introduced (such as choosing a non-highest probability state with a 10% probability) to avoid being too mechanical.

[0118] 4. Adapt to the remaining tick count: In the last few steps, force a switch to the ending mode (such as Kick + Snare to end on a strong beat). Avoid inserting overly complex timbre combinations at the end to ensure a natural transition to the next measure.

[0119] Method 2: Method 2 involves the following steps: Acquire the user's performance intensity parameters. These parameters are dynamic and quantifiable indicators of the user's state; they are no longer simply on / off signals of key presses, but rather attempt to capture the energy and emotional investment the user makes during performance, mapping physical input (action frequency, pseudo-dynamics) to parameters of musical expressiveness (dynamic strength). In practice, the performance intensity parameters are calculated by monitoring and analyzing the user's performance input signals in real time. For example, input data streams from the string touch detection module and / or the sequence selection key module are collected within a preset time window (e.g., the most recent 500ms). The calculation of the performance intensity parameters is primarily based on one or more of the following factors: 1) Frequency of string-touching action: The number of times the string is touched and triggered per unit time. High frequency usually corresponds to high-intensity performance. 2) "Virtual force" of the string: If the through-beam sensor can distinguish the duration or area of ​​the obstruction (e.g., by the attenuation of the received signal or by using an array of multiple receivers), this can be converted into a force value. 3) The pressure applied to the sequence selection key (if the key supports force sensing); 4) Generate the volume and note density of the musical sequence.

[0120] The system normalizes and weights these raw signals, and finally outputs a quantized intensity level (e.g., a MIDI velocity value of 0-127) or intensity category (e.g., "weak", "medium", "strong").

[0121] Obtain current music context information, which includes at least one of the following: the tension of the current measure in the harmonic process, the section information of the preset music, and the dynamic change trend of the user's real-time performance.

[0122] This step aims to provide the drum machine with clues to understand the current musical context. Specifically, when determining the tension of the current measure within the harmonic progression, it can select the chord identifier triggered by the key press based on the note sequence (e.g., C major tonic chord, G dominant seventh chord, etc.), and combine this with a preset music theory rule base (e.g., marking diminished chords, dominant seventh chords, and distantly related chords as high tension, and major triads and chords resolved to tonic chords as low tension) to calculate a tension score (e.g., 0-100) for the current measure or chord. If the user is playing a preset piece with structural markings (e.g., a MIDI file or proprietary data format containing verse, chorus, and bridge labels), the system can directly read and obtain the current section type identifier (e.g., "Verse_A", "Chorus", "Breakdown"), using it as the section information for the preset piece. The dynamic trend of a user's real-time performance is obtained by analyzing the changes in the performance intensity parameters over the most recent measures (such as "stable", "crescendo", "decrescendo", "drastic fluctuation"). This trend reflects the user's intention to advance or ease their emotions.

[0123] Based on the performance intensity parameters and the music context information, a corresponding embellished rhythm pattern is generated by selecting or fusing from a pre-set library of multiple drum pattern templates associated with different contexts.

[0124] Specifically, this can be achieved in the following way: 1. Primary Mapping: First, filter out all relevant, predefined drum pattern templates (e.g., "Chorus = Chorus", "Tense = High") based on the most prominent musical context (e.g., "Chorus Power Push" and "High Tension Suspense").

[0125] 2. Intensity Screening: Then, based on the performance intensity parameters, further select templates that match the difficulty or impact from the templates already screened above (for example, for high intensity, select templates with complex rhythms and a large number of tom-toms and cymbals; for low intensity, select templates that only contain snare drum rolls or hi-hat embellishments).

[0126] 3. Intelligent fusion: When a single template cannot perfectly match, segments of two or more candidate templates can be merged (e.g., taking the first two beats from template A and the last two beats from template B), or parameterized random fine-tuning can be performed based on the rhythmic skeleton of the template (e.g., randomly shifting the timing of a drumbeat or replacing a cymbal timbre) to generate a derivative rhythmic pattern that is both contextually constrained and fresh.

[0127] The random embellishment is generated based on the selected or generated embellishment rhythm pattern. Specifically, this step instantiates the abstract rhythm pattern determined in the previous step into a specific playable drum machine sequence, for example, converting each rhythm point in the rhythm pattern (such as "1st beat - snare drum", "3rd beat - tom-tom") into a standard MIDI note event or internal sequence instruction.

[0128] In Method 2 above, the "embellishments" generated by the drum machine are no longer completely random, but rather matched with intensity, understanding the current musical context (such as passages, emotions, and chord tension), and generating expressive drum embellishments that fit it. Through the above four steps, a complete technical chain is constructed from perceiving the user and the music state -> understanding the musical context -> intelligently deciding on the rhythm scheme -> accurately generating and executing it, enabling the automatic drum machine to have basic musical judgment capabilities and significantly improving the interactivity and professional level of the accompaniment.

[0129] This disclosure provides a function to generate random embellishments during drum machine operation, avoiding the mechanical repetition of looping rhythms and offering flexible variations for real-time performance, thereby enhancing musical expressiveness. Furthermore, the embellishment generation method based on Markov chains ensures that the embellishments conform to stylistic logic rather than being completely random, enhancing musical coherence; adjusting the embellishment length based on the remaining ticks avoids abrupt interruptions; and by adjusting the probability matrix, embellishments of different styles such as rock, jazz, and electronic can be generated. Thus, the generated embellishments are both randomly interesting and conform to auditory habits.

[0130] This disclosure provides automatic accompaniment and automatic drum machine functions, facilitating diverse performance operations for users. Specifically, the automatic accompaniment simulates band harmonic support, eliminating the need for additional musicians, while the automatic drum machine provides a precise rhythmic framework (such as rock or jazz drum kits), solving the problem of unstable rhythm when playing solo and achieving a realistic band collaboration experience. Furthermore, the automatic drum machine and automatic accompaniment functions are started and stopped using a single button via trigger state (long press / single click / double click), saving hardware costs.

[0131] After the corresponding output sequence is generated based on the sequence generation module, the sound can be output through the player that comes with the stringless instrument, or it can be converted into sound output through an external player connected to the headphone jack.

[0132] like Figure 2 As shown, the stringless musical instrument further includes: a sequence playback module, which is connected to the sequence generation module; the method further includes: The output sequence is output to the sequence playback module so that the sequence playback module can play the output sequence.

[0133] In one specific embodiment, the audio sequence playback module includes a digital-to-analog converter, a power amplifier, and a speaker connected in sequence.

[0134] In addition, this disclosure also includes adaptive learning and visual guidance functions in stringless instruments, which can guide users to practice specific pieces or techniques, provide visual feedback to indicate which key to press and when to pluck the string, and evaluate the accuracy of the performance in real time, greatly enhancing its value for beginners.

[0135] According to embodiments of this disclosure, the stringless instrument further includes a guide light strip comprising multiple LEDs. The guide light strip is a spatial-visual mapping output interface that transforms the abstract instruction of "pressing a chord" into an intuitive light signal at a specific position on the neck, thereby realizing "visualized fingering" and greatly reducing the cognitive load for beginners.

[0136] The method further includes: Based on the practice piece specified by the user, load the practice piece data corresponding to the practice piece, which includes: string pressing sequence and string touching timing information.

[0137] The system can add a practice mode setting function to the playing parameter adjustment module, allowing users to select preset practice pieces. The system can read the corresponding practice piece data file from memory based on the unique identifier of the selected piece. This file is a structured data format (such as JSON or a proprietary binary format) containing the fingering sequence and touch timing information. The fingering sequence is a chronologically ordered list, where each element contains a step number, an identifier for one or more key selection buttons to be pressed, and the standard time at which the fingering action should begin. The touch timing information is a list associated with or independent of the fingering sequence, indicating the timing of the plucking. Each element contains the standard time for performing the touch action and the touch type (such as "downward sweep," "upward sweep," "arpeggio first string"). Finally, the parsed fingering sequence and touch timing information are loaded into a memory buffer, and a playback pointer is initialized, pointing to the first upcoming practice step. Simultaneously, the system updates the current playing parameters (such as tempo) to the suggested values ​​for the piece.

[0138] Based on the chord sequence of the practice piece data, the system controls the corresponding LEDs on the guide light strip to light up or change color to prompt the user to press the corresponding note selection key. Specifically, the system maintains a real-time task, checking whether a chord pressing step is imminent based on the playback pointer and the current music clock (driven by an internal metronome, with speed derived from the practice piece data). (For example, 100-500ms in advance; this "pre-prompt time" is adjustable). When a prompt is needed, the system queries a key-LED mapping table (which defines the position of one or more LEDs on the guide light strip corresponding to each physical note selection key) based on the target key identifier of the current step. Then, it sends a command through the light strip driver circuit to control the corresponding LED to light up. Different colors can be used for differentiation (e.g., the light to be pressed is flashing green, turning solid blue after being pressed; the corresponding LED for a chord that needs to be pressed remains continuously blue). As the playback pointer moves forward, the system dynamically turns off the LEDs for completed steps and lights up the LEDs for the next step, creating a flowing light guide.

[0139] Based on the string-touching timing information of the practice piece data, the guide light strip is controlled to generate a preset flashing pattern at the corresponding time to prompt the user to perform the string-touching action. The preset flashing pattern converts time information and action type into dynamic visual signals, not only telling the user "when" to pluck the string, but also using different light effects to suggest "how" to pluck the string (striking direction), achieving dual guidance of rhythm and technique. Specifically, the string-touching timing information can be checked through another real-time task. When the standard string-touching time is about to arrive (e.g., a warning 50ms in advance), a prompt is triggered. Then, the system triggers a preset light flashing pattern according to the string-touching type. For example, a "downward sweep" prompt could be: LEDs on the light strip rapidly and sequentially light up and then turn off from the base of the neck (near the body) towards the headstock, simulating the visual trajectory of a downward sweep; an "upward sweep" prompt could be: LEDs rapidly and sequentially light up and then turn off from the headstock towards the base of the neck; and a "broken chord" or "single-note strumming" prompt could be: rapid bright and dark flashing of a specific LED (or a group of LEDs) at the corresponding string position. String touch cues typically work in conjunction with string pressing cues. For example, during the period when the LED indicating string pressing is constantly lit, a dynamic flashing effect of strumming is superimposed on the existing constant light when the string touch time is reached.

[0140] During practice, the timing of the actual key presses for selecting notes and the string-touch trigger signals triggered by the user is recorded. The actual triggered key presses and timings are compared with the standard key presses and timings in the practice track data; Based on the comparison results, the accuracy score for this exercise is calculated and output.

[0141] According to an embodiment of this disclosure, the method further includes: during practice, dynamically adjusting the prompting parameters of the guide light strip based on real-time accuracy data of the user following the prompts of the guide light strip, so as to control the guide light strip based on the adjusted prompting parameters, wherein the prompting parameters include the advance amount of the prompt, the duration of the prompt, and the light color used to distinguish the difficulty level of the prompt.

[0142] Specifically, after loading the practice track data, the guide light strip can first be controlled to display the upcoming note (key position) and string touch timing to the user according to the initial prompt parameters. When the user plays following the prompts of the guide light strip, the function key module detects the actual key pressed by the user in real time, and the string touch detection module detects the timing of the string touch action in real time. Then, it is determined whether the pressed key matches the prompt, whether the string touch action is completed within the prompt time window, and the delay time of the user's string touch time relative to the prompt time of the light strip is recorded. In this way, the key accuracy, timing accuracy, and follow delay of the user during practice can be obtained respectively. Then, based on the key accuracy, timing accuracy, and follow delay obtained in the current measure or preset time window, real-time accuracy data is calculated. For example: accuracy = (number of correctly responded events / total number of prompt events) × 100%. At the same time, the user's average follow delay and response stability (variance of delay time) are analyzed. Finally, according to the calculation results, the prompt parameters of the next piece of music are dynamically adjusted according to the preset adaptive algorithm. For example, if the accuracy is low (e.g., <60%) or the latency is large and unstable, the difficulty is reduced and the assistance is enhanced. Specific actions include: 1. Increasing the warning lead time (e.g., from 300ms to 400ms) to provide more preparation time; 2. Extending the warning duration (e.g., from 500ms to 600ms); 3. Changing the light color (e.g., changing it to a warning / enhanced yellow). The adjusted warning parameters are immediately applied to subsequent light strip warnings, continuously looping to form a real-time closed loop of "warning → response → evaluation → adjustment → re-warning".

[0143] After the practice session ends, an accuracy curve showing the changes throughout the entire practice process and a log of parameter adjustments can be generated. The user can then visually view their learning progress, weaknesses, and adaptive challenge paths on the display screen.

[0144] This invention transforms abstract chord fingerings and rhythmic sequences into intuitive visual cues—"press where it lights up, sweep when it flashes"—using guide lights. This allows beginners to start playing correctly with zero learning barriers and receive real-time scores and feedback on their accuracy. This feature not only significantly reduces the learning curve for string instruments and enhances learning interest and efficiency, but also provides users with personalized, quantifiable directions for improvement through precise data recording and comparison. This transforms traditionally tedious self-practice into an efficient, interactive, and rewarding intelligent learning process.

[0145] In addition, this disclosure is no longer a fixed "one-size-fits-all" prompt, but can dynamically adjust the prompt strategy according to each user's real-time level. Through a control loop of real-time monitoring-evaluation-feedback, it maximizes learning efficiency and avoids boredom for experts or frustration for beginners.

[0146] Figure 5 A schematic diagram of a sequence generation device for a stringless musical instrument according to an embodiment of the present disclosure is shown. The stringless musical instrument includes: a string touch detection module, a function key module, and a sequence generation module. The string touch detection module includes: one or two sets of through-beam sensors; the function key module includes: dedicated control keys and multiple sequence selection keys, each sequence selection key and / or a combination of multiple specified sequence selection keys corresponding to a specified chord or note; the device is disposed within the sequence generation module, such as... Figure 5As shown, the sequence generation device includes: a function control instruction processing module, configured to: receive function control instructions corresponding to the trigger state of the dedicated control button, wherein the function control instructions are generated by the function button module according to the trigger state of the dedicated control button, wherein when the trigger state of the dedicated control button is a first trigger state, the function control instruction is an automatic accompaniment start / stop instruction; the first trigger state includes: long press trigger; in response to the automatic accompaniment start / stop instruction, an automatic accompaniment thread is started, and an automatic accompaniment processing program is executed through the automatic accompaniment thread, wherein the automatic accompaniment processing program... The sequence includes: if automatic accompaniment is not currently activated, then according to preset accompaniment parameters and specified automatic chords, a corresponding background accompaniment sequence is generated in a loop, and the current background mode is switched to automatic accompaniment mode to activate automatic accompaniment; if automatic accompaniment is already activated, then the generation of the background accompaniment sequence is terminated to end automatic accompaniment, and the current background mode is switched to no automatic accompaniment mode; the string-touch trigger signal acquisition module is configured to: acquire the string-touch trigger signal generated by the string-touch detection module corresponding to the user's string-touch action; the string-touch trigger signal is sensed by the string-touch detection module based on the through-beam sensor. The signal is generated; the key trigger state acquisition module is set to: acquire the trigger state of the sequence selection key detected by the function key module; the output sequence generation module is set to: acquire the current playing parameters, the playing parameters including the playing mode, the playing mode including any one of the following: chord playing mode and melody playing mode; in the chord playing mode, each sequence selection key and / or a combination of multiple specified sequence selection keys corresponds to a specified chord, in the melody playing mode, each sequence selection key and / or a combination of multiple specified sequence selection keys corresponds to a specified single note; if If the current background mode is automatic accompaniment mode, the performance mode in the current playing parameters is switched to melody performance mode; a corresponding real-time performance melody sequence is generated based on the current playing parameters, the string trigger signal, and the trigger state of the sequence selection button. The real-time performance melody sequence includes one or more notes. If the current background mode is automatic accompaniment mode, the real-time performance melody sequence is synchronously mixed with the background accompaniment sequence to generate a mixed sequence, which is used as the output sequence. If the current background mode is no automatic accompaniment mode, the real-time performance melody sequence is used as the output sequence.

[0147] This disclosure also provides an electronic device, Figure 6 A structural block diagram of a chip according to an embodiment of the present disclosure is shown, such as... Figure 6 As shown, it includes a memory and a processor; wherein the memory is used to store one or more computer instructions, wherein the one or more computer instructions are executed by the processor to implement the method described in any of the above method embodiments.

[0148] Figure 7 A schematic diagram of the external structure of a stringless musical instrument according to an embodiment of the present disclosure is shown. Figure 7 As shown, the stringless musical instrument includes a neck and a body. The sequence selection buttons and dedicated control buttons are mechanical buttons, arranged in a single row on the upper half of the front of the neck. The lower half of the front of the neck has a playing parameter display screen and a parameter setting knob. The upper half of the front of the body has two sets of through-beam sensors, each set consisting of a paired transmitter and receiver. A status indicator light is located between the transmitter and receiver. A speaker is located inside the body opposite the lower half of the body. A hollowed-out strip-shaped sound outlet and a power switch are located on the lower half of the front of the body opposite the speaker. An earphone jack and a charging port are located on the bottom side of the body.

[0149] During actual performance, before the start of each measure, the user can press the corresponding note sequence selection key or a combination thereof with their left hand, while simultaneously plucking the invisible light string with their right hand at the start of each measure to trigger the accompaniment of that measure. Generally, the thumb plucks the upper string and the index finger plucks the lower string.

[0150] According to the technical solution provided in this disclosure, the sequence generation method is applied to a stringless instrument including a string touch detection module, a function button module, and a sequence generation module. The sequence generation module executes the method by recognizing specific trigger operations on dedicated control buttons to control the start and stop of the automatic accompaniment function with a single button press, and simultaneously switches the background mode of the stringless instrument. In automatic accompaniment mode, the current performance mode is automatically adapted to a melody performance mode, while simultaneously collecting the user's performance intention input through string touch actions and sequence selection buttons. Finally, based on the current background mode, the real-time performance melody sequence generated according to the performance intention is intelligently output separately, or the real-time performance melody sequence is synchronously mixed with the automatically generated background accompaniment sequence for output, forming a complete band-like performance effect. This deeply integrates individual performance with band-like accompaniment and performs unified intelligent control, achieving the same performance experience as a real guitar. This significantly enhances the freedom and musical expressiveness of stringless guitar playing, providing users with a more comprehensive, convenient, and expressive performance experience, thereby improving the user experience.

[0151] The above description is merely a preferred embodiment of this disclosure and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of the invention involved in this disclosure is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the inventive concept. For example, technical solutions formed by substituting the above-described features with (but not limited to) technical features disclosed in this disclosure that have similar functions.

Claims

1. A method for generating tone sequences for stringless musical instruments, characterized in that, The stringless musical instrument includes: a string touch detection module, a function key module, and a sequence generation module. The string touch detection module includes: one or two sets of through-beam sensors. The function key module includes: dedicated control keys and multiple sequence selection keys, each sequence selection key and / or a combination of multiple specified sequence selection keys corresponding to a specified chord or note. The string touch detection module and the function key module are respectively connected to the sequence generation module. The method is applied to the sequence generation module, including: The system receives a function control command corresponding to the trigger state of the dedicated control button. The function control command is generated by the function button module based on the trigger state of the dedicated control button. When the trigger state of the dedicated control button is the first trigger state, the function control command is an automatic accompaniment start / stop command. The first trigger state includes: long press trigger. In response to the automatic accompaniment start / stop command, an automatic accompaniment thread is started, and an automatic accompaniment processing program is executed through the automatic accompaniment thread. The automatic accompaniment processing program includes: if automatic accompaniment is not currently started, generating the corresponding background accompaniment sequence according to preset accompaniment parameters and specified automatic chords in a sequential loop, and switching the current background mode to the automatic accompaniment mode to start automatic accompaniment; if automatic accompaniment is currently started, terminating the generation of the background accompaniment sequence to end automatic accompaniment, and switching the current background mode to the no-automatic-accompaniment mode. The system acquires a string-touch trigger signal generated by the string-touch detection module, corresponding to the user's string-touch action; the string-touch trigger signal is generated by the string-touch detection module based on the sensing signal of the through-beam sensor. Obtain the trigger state of the sequence selection key detected by the function key module; Obtain the current playing parameters, which include a playing mode, including any one of the following: chord playing mode and melody playing mode; in the chord playing mode, each note selection key and / or a combination of multiple specified note selection keys corresponds to a specified chord; in the melody playing mode, each note selection key and / or a combination of multiple specified note selection keys corresponds to a specified single note; if the current background mode is automatic accompaniment mode, then switch the playing mode in the current playing parameters to melody playing mode; The real-time performance melody sequence is generated based on the current playing parameters, the string-touch trigger signal, and the trigger state of the sequence selection button. The real-time performance melody sequence includes one or more notes. If the current background mode is automatic accompaniment mode, the real-time playing melody sequence and the background accompaniment sequence are synchronously mixed to generate a mixed sequence, which is then used as the output sequence; if the current background mode is no automatic accompaniment mode, the real-time playing melody sequence is used as the output sequence.

2. The method according to claim 1, characterized in that, The stringless musical instrument further includes a guide light strip, the guide light strip comprising multiple LEDs, and the method further includes: Based on the practice piece specified by the user, load the practice piece data corresponding to the practice piece, the practice piece data including: string pressing sequence and string touching timing information; Based on the string pressing sequence of the practice piece data, the corresponding LED lights on the guide light strip are controlled to light up or change color to prompt the user to press the corresponding note selection button; Based on the string-touching timing information of the practice piece data, the guide light strip is controlled to generate a preset flashing pattern at the corresponding time to prompt the user to perform the string-touching action; During practice, the timing of the actual key presses for selecting notes and the string-touch trigger signals triggered by the user is recorded. The actual triggered key presses and timings are compared with the standard key presses and timings in the practice track data; Based on the comparison results, the accuracy score for this exercise is calculated and output.

3. The method according to claim 1, characterized in that, The playing parameters also include note characteristic parameters. The step of generating a corresponding real-time performance melody sequence based on the current playing parameters, the string-touch trigger signal, and the trigger state of the sequence selection button includes: Based on the trigger state of the sequence selection key, obtain the identifier of the selected sequence selection key; The number of through-beam sensors triggered within a preset strumming time is determined based on the string-touch trigger signal. If, based on the number of sets of through-beam sensors triggered within the preset strumming duration, it is determined that only one set of through-beam sensors or any one of the two sets of through-beam sensors is triggered within the preset strumming duration, then: based on the current playing mode corresponding to the triggered through-beam sensor, and the correspondence between the identifier of the selected sequence selection button and the sequence, the corresponding strumming sequence is generated. If, based on the number of sets of through-beam sensors triggered within the preset strumming duration, the two sets of through-beam sensors are triggered sequentially within the preset strumming duration, then: the current strumming direction is determined according to the triggering order; based on the current strumming direction and the correspondence between the identifier of the selected note selection button and the note sequence, a corresponding strumming note sequence is generated; the strumming direction includes any one of the following: upward strumming and downward strumming, the strumming note sequence corresponding to the upward strumming direction is the upward strumming note sequence, and the strumming note sequence corresponding to the downward strumming direction is the downward strumming note sequence; Based on the notes in the generated plucking or strumming sequence configured with the current note feature parameters, a configured plucking or strumming sequence is generated, and the generated configured plucking or strumming sequence is used as the corresponding real-time performance melody sequence; wherein, the note feature parameters include one or more of the following: volume, pitch, tempo, beat, and timbre; If all the tone selection keys are in an untriggered state and the two sets of through-beam sensors are triggered sequentially within the preset strumming duration, then: the corresponding tone-cutting data is obtained according to the triggering order. The tone-cutting data is used to drive the sound source device to emit tone-cutting data. The tone-cutting data includes: downsweep tone-cutting data or upsweep tone-cutting data.

4. The method according to claim 3, characterized in that, The note feature parameters further include: sound effects; the stringless instrument further includes: a motion sensor; and the method further includes: Acquire motion data collected by the motion sensor; The current motion posture of the stringless instrument is identified based on the motion data collected by the motion sensor; The sound effects in the current note feature parameters are adjusted in real time according to the current movement posture of the stringless instrument.

5. The method according to claim 1, characterized in that, The stringless instrument further includes a playing parameter adjustment module, which is connected to the tone sequence generation module; the playing parameters are updated based on the following method: The playing parameter adjustment module obtains the playing parameters input by the user and updates the current playing parameters to the playing parameters input by the user.

6. The method according to claim 1, characterized in that, When the dedicated control button is in the second trigger state, the function control command is an automatic drum machine start command; when the dedicated control button is in the third trigger state, the function control command is an automatic drum machine stop command. The second trigger state includes: single-click trigger; the third trigger state includes: double-click trigger; the method further includes: In response to the automatic drum machine start command, an automatic drum machine thread is started, and an automatic drum machine processing program is executed through the automatic drum machine thread. The automatic drum machine processing program includes: if the automatic drum machine is not currently started, generating a drum machine sequence in a loop according to a preset drum kit rhythm pattern to start the automatic drum machine; if the automatic drum machine is currently started, generating and inserting a random embellishment in the current measure of the drum machine sequence, and continuing to generate subsequent drum machine sequences until the end of the current measure. In response to the automatic drum machine stop command, the automatic drum machine sequence generation is terminated by the automatic drum machine thread to end the automatic drum machine; When both the automatic accompaniment and the automatic drum machine are in the started state, the start time or beat signal of the automatic accompaniment thread is aligned and synchronized with the clock signal of the automatic drum machine thread so that the background accompaniment sequence and the drum machine sequence are in the same timing. The mixed sequence or the real-time performance melody sequence is synchronously mixed with the drum machine sequence after clock alignment to generate the final mixed sequence, and the final mixed sequence is used as the output sequence.

7. The method according to claim 6, characterized in that, The random floral pattern is generated in the following way: Obtain the user's performance intensity parameters; Obtain current music context information, which includes at least one of the following: the tension of the current measure in the harmonic process, the section information of the preset music, and the dynamic change trend of the user's real-time performance; Based on the performance intensity parameters and the music context information, a corresponding embellished rhythm pattern is generated by selecting or fusing from a pre-set library of multiple drum embellishment templates associated with different contexts. The random perturbation is generated based on the selected or generated perturbation rhythm pattern.

8. The method according to any one of claims 1 to 7, characterized in that, The stringless musical instrument further includes: a sequence playback module, which is connected to the sequence generation module; the method further includes: The output sequence is output to the sequence playback module so that the sequence playback module can play the output sequence.

9. A sequence generation device for stringless musical instruments, characterized in that, The stringless musical instrument includes: a string touch detection module, a function key module, and a note generation module. The string touch detection module includes: one or two sets of through-beam sensors. The function key module includes: dedicated control keys and multiple note selection keys, each note selection key and / or a combination of multiple specified note selection keys corresponding to a specified chord or note. The device is disposed in the note generation module and includes: The function control instruction processing module is configured to: receive function control instructions corresponding to the trigger state of the dedicated control button, wherein the function control instructions are generated by the function button module according to the trigger state of the dedicated control button, wherein when the trigger state of the dedicated control button is a first trigger state, the function control instruction is an automatic accompaniment start / stop instruction; the first trigger state includes: long press trigger; in response to the automatic accompaniment start / stop instruction, start the automatic accompaniment thread, and execute the automatic accompaniment processing program through the automatic accompaniment thread, wherein the automatic accompaniment processing program includes: if automatic accompaniment is not currently started, generating the corresponding background accompaniment sequence according to preset accompaniment parameters and specified automatic chords in a sequence loop, and switching the current background mode to the automatic accompaniment mode to start automatic accompaniment; if automatic accompaniment is currently started, terminating the generation of the background accompaniment sequence to end automatic accompaniment, and switching the current background mode to the no automatic accompaniment mode; The string-touch trigger signal acquisition module is configured to acquire a string-touch trigger signal generated by the string-touch detection module that corresponds to the user's string-touch action; the string-touch trigger signal is generated by the string-touch detection module based on the sensing signal of the through-beam sensor; The key trigger state acquisition module is configured to: acquire the trigger state of the sequence selection key detected by the function key module; The output sequence generation module is configured to: acquire current playing parameters, including a playing mode, which includes any one of the following: chord playing mode and melody playing mode; in the chord playing mode, each sequence selection key and / or a combination of multiple specified sequence selection keys corresponds to a specified chord; in the melody playing mode, each sequence selection key and / or a combination of multiple specified sequence selection keys corresponds to a specified single note; if the current background mode is automatic accompaniment mode, the playing mode in the current playing parameters is switched to melody playing mode; generate a corresponding real-time playing melody sequence based on the current playing parameters, the string trigger signal, and the trigger state of the sequence selection keys, the real-time playing melody sequence including one or more notes; if the current background mode is automatic accompaniment mode, the real-time playing melody sequence is synchronously mixed with the background accompaniment sequence to generate a mixed sequence, and the mixed sequence is used as the output sequence; if the current background mode is no automatic accompaniment mode, the real-time playing melody sequence is used as the output sequence.

10. A chip, characterized in that, The method includes a memory and a processor; wherein the memory is used to store one or more computer instructions, wherein the one or more computer instructions are executed by the processor to implement the method according to any one of claims 1 to 8.

Images