A Multi-User Collaborative Music Interaction System for Art Therapy and Its Control Method

Abstract

This application belongs to the field of human-computer interaction and computer application technology, and discloses a multi-person collaborative music interaction system and its control method for art therapy, aiming to solve the problems of rhythm instability and collaboration interruption in multi-person collaboration. The method includes: using a chime bell with embedded piezoelectric sensors to collect striking vibration signals and determine valid events; calculating the beat deviation between the actual striking and the theoretical moment under a fixed time reference; providing pre-visual guidance based on a discrete time series template and triggering multimodal feedback after striking; evaluating synchronicity based on the deviation value, and achieving interactive closed loop by dynamically enhancing the guidance intensity. The system includes a physical device, a signal acquisition module, a time scheduling unit, and a feedback module. By constructing a structured collaboration mechanism and a stable beat framework, this application significantly improves the rhythmic synchronicity of multi-person interaction, reduces the cognitive load of participants, and effectively ensures the flow experience and emotional connection during art therapy.

Description

Technical Field

[0001] This invention belongs to the field of human-computer interaction and computer application technology, specifically relating to a multi-person collaborative music interaction system for art therapy and its control method. Background Technology

[0002] With the fast pace of modern life, art therapy, as a non-pharmacological intervention, has demonstrated significant value in the field of mental health regulation. Among these, music interactive systems based on digital interactive technology have gained widespread application due to their remarkable effects on emotional relief and stress release. By combining auditory stimulation with the active behavior of participants, music interactive systems enable users to achieve self-expression and psychological reconstruction in an immersive artistic creation process, and have become an important technological medium in contemporary urban public spaces and rehabilitation medical settings.

[0003] To further enhance the social attributes and emotional connection of interactive experiences, current technological research and development is gradually shifting from passive single-person listening to multi-person real-time collaborative music interaction scenarios. Specifically, multi-person music interaction systems, by providing a shared interactive platform, attempt to strengthen the psychological resonance among participants through the process of group co-creation. In this specific scenario, the core design of the system lies in how to guide multiple users to generate harmonious musical feedback through collaborative actions within a unified time sequence.

[0004] However, in current implementations, collaborative music interaction among multiple participants often exhibits extremely high uncertainty and rhythmic instability. The root cause of this deficiency lies in the general lack of structured collaborative constraints and defined time reference mechanisms for non-professional users in existing systems. This makes it difficult for participants to achieve effective time alignment in an open environment lacking clear vocal division. Because the system fails to provide participants with pre-emptive visual guidance and a stable beat framework, the movement frequencies of different participants experience severe beat drift due to individual perceptual differences, leading to rhythmic imbalance and collaborative interruptions in group interaction. This lack of collaborative structure not only results in chaotic and disordered musical effects but also forces participants to expend significant cognitive resources on repeated rhythmic experimentation and pace calibration, creating additional psychological burden and pressure. Ultimately, this severely weakens the fluid experience and emotional resonance sought by art therapy. Summary of the Invention

[0005] The purpose of this invention is to provide a multi-person collaborative music interaction system and its control method for art therapy, which can effectively solve the problems in the background art.

[0006] To achieve the above objectives, the technical solution adopted by the present invention is as follows: a multi-person collaborative music interaction system for art therapy and its control method, comprising the following specific steps: S1: Hardware deployment and real-time signal acquisition: A predetermined number of chime bells are used as interactive carriers, which are divided into multiple collaborative zones. Each zone contains a predetermined number of chime bells and corresponds to a predetermined number of participants. Piezoelectric sensors are embedded in the chime bells, and a data acquisition board is used to capture the physical vibration signals generated when the participants strike the bells in real time at a preset sampling rate. S2: Signal preprocessing and valid event determination: The captured raw electrical signal is subjected to resistor-capacitor low-pass filtering. By comparing the real-time voltage value with the preset determination threshold and combining the preset minimum trigger interval to eliminate signal tail wave interference, valid striking events are identified and event data containing chime numbers and precise timestamps are extracted. S3: Global beat scheduling and deviation calculation: The system operates under a preset fixed time base. Based on the preset discrete time series template, the theoretical trigger time of each beat is determined. The actual timestamp of the tapping is aligned with the corresponding theoretical time for analysis, and the beat deviation value reflecting the accuracy of each participant's action is calculated. S4: Pre-emptive visual guidance and multimodal feedback generation: Based on the discrete time series template, the brightness of the digital silhouette of the corresponding chime bell is changed in advance before the current beat arrives to provide striking guidance, and the corresponding sampled audio playback and exponential decay visual brightness update are triggered synchronously after the striking event is detected. S5: Collaboration Status Monitoring and Interactive Closed-Loop Control: The synchronization status of group collaboration is evaluated in real time based on the calculated beat deviation value. When the deviation value exceeds the preset tolerance window, the visual guidance intensity of the next beat is automatically enhanced, and the interactive closed loop of multi-person collaboration is achieved by maintaining a stable time structure.

[0007] Preferably, in step S1, the pitch mapping of a predetermined number of chime bells follows a multi-voice division of labor logic, assigning a predetermined number of scale notes to chime bells in different zones, and adding an additional predetermined number of high-octave repeating notes to strengthen the pitch hierarchy of key beat positions, forming a collaborative system with structured layering.

[0008] Preferably, in step S2, the calibration process of the voltage determination threshold includes acquiring the peak data of the ambient background noise and setting the determination threshold to a predetermined multiple of the peak value of the background noise, so as to ensure anti-interference performance and accurate identification of physical knocking actions in the public exhibition environment.

[0009] Preferably, in step S3, the fixed time reference is determined based on the human ear's perception of rhythmic continuity, which is used to reduce the rhythm negotiation cost for participants in the collaboration process and ensure the stability of the time series at the underlying logic level.

[0010] Preferably, in step S4, the pre-guidance duration of the digital silhouette is dynamically calculated based on the current beat speed. This guidance time is set within a preset time range to provide participants with pre-emptive psychological and physiological preparation time.

[0011] Preferably, the visual brightness update adopts an exponential decay mathematical model, and its decay coefficient is set according to the visual persistence effect to ensure that the feedback signal has instant response characteristics and a smooth fallback visual effect.

[0012] Preferably, the generation of the sampled audio adopts a preloading technique, configuring an independent timbre buffer for each chime bell, and directly calling the corresponding sample when the striking event is triggered, ensuring that the time synchronization error between audio triggering and visual feedback is less than a preset synchronization threshold.

[0013] Preferably, the system further includes a data recording unit, used to write the beat deviation value, chime number and participant identification code of each collaborative interaction process into a structured log file in real time, supporting subsequent quantitative evaluation of collaborative stability and psychological stress relief effect.

[0014] Preferably, the control method is applied to automated art installations, which realizes group co-creation within a unified time frame by real-time acquisition of the tapping behavior of multiple participants and mapping it into a harmonious combination of sound parts.

[0015] Compared with the prior art, the present invention has the following beneficial effects: 1. This invention significantly improves rhythmic synchronization in multi-person interaction by constructing a structured sound division of labor and a stable fixed beat framework, and reduces the cognitive load and movement uncertainty of non-professional participants in the collaborative process.

[0016] 2. This invention utilizes a forward-looking visual guidance and a real-time closed-loop feedback mechanism to effectively solve the problems of rhythm drift and collaboration interruption caused by individual perceptual differences, ensuring the stability of the group interaction rhythm and providing technical support for participants to form a continuous flow experience.

[0017] 3. This invention is based on the deep integration of physical interaction on the chime bell carrier and multimodal digital feedback, which strengthens the behavioral interdependence and emotional connection among participants, thereby improving the effectiveness of art therapy in emotional relief and stress release, and providing a verifiable implementation path for social mental health intervention in public spaces. Attached Figure Description

[0018] Figure 1 This is a schematic diagram of the overall technical solution architecture of the multi-person collaborative music interaction system for art therapy proposed in this invention. Figure 2This is a schematic diagram of the core principle framework of the cooperative state monitoring and interactive closed-loop control based on beat deviation in this invention; Figure 3 This is a logical flowchart of hardware deployment, collaborative partitioning, and real-time signal acquisition in this invention; Figure 4 This is a flowchart illustrating the logical flow of signal preprocessing, valid event determination, and feature extraction in this invention. Figure 5 This is a schematic diagram illustrating the principle framework of global clock scheduling, discrete time alignment, and deviation calculation in this invention. Figure 6 This is a flowchart illustrating the logical flow of the pre-visual guidance and multimodal feedback generation in this invention. Figure 7 This is a schematic diagram of the multi-level interaction relationship and data flow between the participants, the chime bell carrier, and the control system in this invention; Figure 8 This is a schematic diagram illustrating the principle framework of the pitch mapping logic, sound division of labor, and structured collaboration system in this invention. Figure 9 This is a schematic diagram illustrating the principle framework of dynamic calculation of pre-guidance duration and visual brightness index decay in this invention. Figure 10 This is a logical flowchart of the data recording unit and the quantitative evaluation of collaborative effects in this invention. Detailed Implementation

[0019] To further illustrate the technical means and effects of the present invention in achieving its intended purpose, the following detailed description of the specific implementation methods, structures, features, and effects of the present invention, in conjunction with the accompanying drawings and preferred embodiments, is provided below. Example 1

[0020] This embodiment provides a multi-person collaborative music interaction system for art therapy. The system is applied to urban public art spaces or psychological rehabilitation centers. It aims to construct an art therapy environment with structured constraints through the interactive form of multiple people playing chimes, and to guide participants into a state of flow experience by using stable rhythmic resonance.

[0021] Firstly, in terms of system architecture, the system in this embodiment consists of four parts: an interactive terminal hardware layer, a signal acquisition and processing layer, a logic scheduling and calculation layer, and a multimodal feedback layer. The interactive terminal hardware layer uses nine antique-style bronze chimes as its core carrier, arranged in a three-group, three-column array in physical space. To achieve clear human-computer interaction zones, these nine chimes are divided into three independent but logically related collaborative zones, each containing three chimes and providing a dedicated operating space for one participant. Mechanically, each chime is fixed to a support frame via a high-damping suspension bracket to reduce mechanical vibration coupling between adjacent chimes. Inside the center of each chime's body, a high-sensitivity piezoelectric ceramic sensor is embedded using high-viscosity acoustic coupling adhesive. This sensor can accurately convert the mechanical deformation waves generated by physical striking into weak charge signals, with a frequency response range covering 20 Hz to 10 kHz, ensuring complete capture of the transient characteristics during the chime's initial oscillation phase.

[0022] The signal acquisition and processing layer includes a multi-channel parallel data acquisition board. This board is equipped with a high-performance 16-bit analog-to-digital converter (ADC) and uses multi-channel synchronous sampling technology to digitize the analog signals output by the nine chime sensors in real time. To ensure timestamp accuracy, the system sets the sampling rate to 2000 Hz, meaning data is written to the database every 0.5 milliseconds. For physical connectivity, the sensors are connected to the analog front end of the acquisition board via shielded twisted-pair cables to suppress electromagnetic interference from the environment. The acquisition board integrates preprocessing circuitry, including an impedance matching unit and a preamplifier, to condition the piezoelectric signals to the optimal quantization range of the ADC.

[0023] The logic scheduling and computation layer runs on an industrial control computer or a high-performance embedded workstation. This layer is the "brain" of the system, containing a beat manager, an event determination unit, a deviation calculation engine, and a collaborative status monitor. The beat manager is responsible for generating a globally unified time base, which is rigidly set to 90 beats per minute. The event determination unit identifies the actual striking actions from massive amounts of raw sampled data by executing specific filtering algorithms and dynamic threshold comparison logic. The deviation calculation engine is responsible for real-time alignment and analysis between the actual action times and the theoretical time series.

[0024] The multimodal feedback layer consists of an audio synthesis unit, a visual rendering unit, and a digital projection device. The audio synthesis unit preloads high-sampling-rate chime bell sample timbres, with each timbre corresponding to an independent buffer. The visual rendering unit is built on the TouchDesigner software environment, using real-time generated digital silhouettes to map the positions of the chime bells to the physical entities of the chime bells.

[0025] In terms of workflow interpretation, the control method for a multi-person collaborative music interaction system oriented towards art therapy described in this embodiment includes the following specific execution steps: Step S1: Hardware deployment and real-time signal acquisition.

[0026] In this step, three participants stand in front of their respective collaborative zones. When a participant strikes the chime bells with a wooden or rubber mallet, a piezoelectric sensor embedded within the bell detects high-frequency vibrations. The data acquisition board continuously scans the nine signals at a frequency of 2000 Hz. Due to the high sampling rate, the system is able to capture the steep rising edge of the striking moment, laying the foundation for subsequent microsecond-level timestamping. The acquired raw electrical signal sequence is buffered in real-time in a circular FIFO buffer, awaiting further processing.

[0027] Step S2: Signal preprocessing and valid event determination.

[0028] The system first performs digital signal processing on the captured raw electrical signal. To eliminate potential high-frequency noise in the environment and white noise from the circuit itself, the system performs digital simulation processing of resistor-capacitor (RC) low-pass filtering, with the cutoff frequency set within a reasonable range to preserve the striking characteristics. Subsequently, the system executes event determination logic. The determination process employs a dynamic threshold algorithm, acquiring peak data of the ambient background noise and setting the current determination threshold to three times the peak value of the background noise. When the real-time voltage value exceeds this threshold, the system initially records a trigger point. To eliminate signal tailwave interference caused by the aftershocks of the chime bells, the system introduces a minimum trigger interval mechanism of 120 milliseconds, meaning that within 120 milliseconds after a valid trigger, all voltage fluctuations on the same channel are blocked. Finally, the system identifies valid striking events and generates an event data packet containing the chime bell number, participant zone number, and a precise timestamp at 2000 Hz accuracy.

[0029] Step S3: Global cycle scheduling and deviation calculation.

[0030] The system's core operating logic is based on a fixed time base of 90 beats per minute (BPM). This parameter is determined based on the human ear's perception of rhythmic continuity, aiming to provide participants with a rhythmic framework that they can follow instinctively without conscious thought. The system pre-sets a discrete time sequence template, which defines the theoretical trigger time of each beat in the musical melody. When the event data packet generated in step S2 arrives at the logic scheduling layer, the deviation calculation engine immediately extracts the actual timestamp of the strike and compares it with the nearest theoretical time in the sequence template. The calculated difference is the beat deviation value, reflecting the accuracy of each participant's movements. This deviation value is not only an indicator of individual performance but also a core parameter for subsequent closed-loop control.

[0031] Step S4: Pre-visual guidance and multimodal feedback generation.

[0032] This step enables the system to provide real-time guidance to participants. The system performs forward-looking calculations based on a discrete time series template. 200 to 300 milliseconds before the actual arrival of the current beat (this duration is dynamically adjusted according to the beat speed), the system drives the digital projection device to gradually increase the brightness of the corresponding chime bell's digital silhouette, serving as a visual instruction for "ready to strike." This pre-strike guidance compensates for human physiological reaction time and provides psychological anticipation. Once a real striking event is detected, the system immediately executes dual feedback: first, the audio synthesis unit directly retrieves and plays the lossless audio sample of the corresponding chime bell from the preloaded buffer, with its trigger delay controlled within 5 milliseconds; second, the visual rendering unit drives the silhouette into an exponentially decaying brightness update mode, simulating the natural dissipation process of physical light and shadow, ensuring the feedback signal has immediate responsiveness and a smooth visual fallback effect.

[0033] Step S5: Collaborative status monitoring and interactive closed-loop control.

[0034] The system assesses the overall synchronicity of collaboration by monitoring the beat deviation values ​​of the three participants in real time. When the system detects that the group's beat deviation value exceeds a tolerance window of 150 milliseconds, it determines that the collaboration is unstable. At this point, the control system automatically activates intervention logic, enhancing the contrast or flashing frequency of the visual guidance for the next beat, forcibly attracting the participants' attention back to the unified time frame. Through this real-time deviation compensation, the system constructs a closed loop from motion acquisition to feedback guidance to motion correction, ensuring the continuity and stability of multi-person collaboration in the art therapy process.

[0035] In a preferred embodiment, the pitch mapping of the nine chime bells follows a three-part division logic. The seven basic scale notes (Do, Re, Mi, Fa, Sol, La, Si) are strategically assigned to three zones. For example, the first zone is responsible for the bass and main notes, the second zone for the middle notes, and the third zone for the treble and ornaments. Additionally, the system adds two higher-octave repeating notes, placed at the most rhythmically dense interactive positions. This structured layering ensures that even if three participants strike randomly, a harmonious and layered musical flow can be generated within a 90 BPM framework, significantly lowering the barrier to entry for non-professional users. Example 2

[0036] Based on Embodiment 1, this embodiment further details the in-depth technical implementation of the present invention in terms of signal processing accuracy and adaptive environment adaptation, and further expands the breadth of the description of the system and method.

[0037] In terms of hardware expansion within the system architecture, this embodiment introduces a distributed synchronous acquisition architecture. To address the potential signal attenuation issues over long distances in large healing centers, each chime section is equipped with a front-end signal conditioning module. This module includes a high-impedance instrumentation amplifier and a differential drive circuit, converting the charge signal from the piezoelectric sensor into a differential voltage signal for transmission. At the logic scheduling layer, the system employs a multi-threaded real-time kernel, setting the clock timing thread to the highest priority to ensure clock jitter is controlled within microseconds.

[0038] The signal acquisition and processing methods are further elaborated as follows: In the signal preprocessing of step S2, to cope with the interference of complex mechanical vibrations (such as footsteps and background music vibrations) in the public exhibition environment, the system not only adopts RC low-pass filtering but also introduces a dynamic moving average filtering algorithm. The processor calculates the mean of the most recent 10 sampling points and uses the deviation between the instantaneous value and the mean to help determine the starting point of the tap. During the calibration of the voltage judgment threshold, the system enters a 5-second automatic environmental calibration phase after startup. This phase does not perform event judgment but focuses on collecting the statistical distribution characteristics of the environmental background noise. The calibration program calculates the root mean square (RMS) value of the background noise and dynamically sets the effective tap judgment threshold between 3 and 5 times this RMS value, thereby ensuring a very high signal-to-noise ratio even in noisy environments.

[0039] The algorithm details for global beat scheduling and deviation calculation are expanded as follows: In step S3, the 90 BPM time base is not mechanically cycled, but maintained by a high-precision hardware timer. The discrete time series template is stored as a structured array containing {beat order, theoretical milliseconds, expected pitch ID}. When a participant strikes the chimes to generate an actual timestamp Ta, the deviation calculation engine searches for the closest theoretical time value Tn in the template. The formula for calculating the beat deviation value Δt is: Δt = |Ta - Tn|. The system maintains a sliding window, recording the average deviation of the last 5 valid strikes for each partition. This average deviation value is used as real-time profile data to measure the participant's "rhythm sense". If this value shows a continuous upward trend, the system logic will predict that the participant may soon break away from cooperation, thereby triggering preventative guidance intervention.

[0040] Physical details of pre-guidance and feedback generation: In step S4, the pre-guidance of the digital silhouette employs prediction-based rendering technology. Since the system operates at a fixed 90 BPM, the timing of the next beat is fully known. The system defines a 200-millisecond guidance duration as the visual "wake-up period." During this time, the alpha channel value of the digital projection increases linearly from 0 to 0.8. After the participant completes the tap, the exponential decay model of visual brightness follows the formula: L(t) = L0 exp(-kt), where L0 is the peak brightness at the trigger moment, and k is the decay coefficient, which is set based on the persistence of vision. This ensures that the feedback has a strong impact without interfering with the guidance information for the next beat due to visual persistence, thereby improving the information transmission efficiency of the visual channel.

[0041] The logical depth of the interactive closed-loop control: In step S5, the system not only focuses on a single deviation value but also introduces a "group consistency coefficient." This coefficient is obtained by calculating the standard deviation of the deviation values ​​of the three zones. When the standard deviation is large, it indicates a disconnect in the cooperation among the three participants. At this time, the control method not only enhances visual guidance but also fine-tunes the gain of the audio feedback, moderately increasing the volume of the zone with the best rhythmic performance, acting as an invisible "rhythm leader" to guide the other two participants to follow. This closed-loop control, achieved by changing the sound field distribution, psychologically utilizes the human instinct for convergence to restore collaborative stability without interrupting interaction.

[0042] Data Recording and Quantitative Evaluation: The system in this embodiment also includes a dedicated data recording unit. This unit has non-volatile storage capabilities and can write the beat deviation value, chime number, participant identification code, and system intervention frequency during each collaboration process to a structured log file (such as JSON or CSV format) in real time. This data provides objective evidence for subsequent evaluation of the art therapy effect. For example, by analyzing the evolution curve of the average deviation value in a session, the improvement in the participant's focus after stress relief can be quantitatively evaluated. If the deviation value curve shows a smooth downward trend over time, it indicates that the participant has successfully entered a "flow experience" state and achieved the expected goals of art therapy. Example 3

[0043] This embodiment focuses on illustrating the robust design of the present invention under extreme conditions and the mode switching logic for different healing needs, further enhancing the completeness of the specific implementation.

[0044] In terms of system architecture, to improve system reliability, this embodiment adds a haptic feedback unit to the interactive terminal. A small vibration motor is installed at the bottom of the chime bell suspension frame. When the system determines that the participant's tapping is perfectly aligned with the beat (e.g., the deviation is less than 50 milliseconds), the motor generates a slight high-frequency vibration feedback to the participant's palm or sole. This added physical perception channel further enhances the immersive experience of human-computer interaction. Simultaneously, the audio module employs a multi-buffer concurrency management mechanism, capable of supporting lossless playback of up to 128 sampled audio channels simultaneously, avoiding sound cut-off or popping during rapid multi-person tapping.

[0045] Advanced flow description of the control method: In step S1, to improve the overload resistance of the acquisition board, a limiting protection unit is added to the hardware circuit. When a participant strikes with excessive force due to emotional excitement, the limiting circuit can control the voltage entering the ADC within a safe range. At the same time, the algorithm layer records a "forceful strike" flag and maps it to a louder audio effect with a longer reverberation time, thereby achieving an immediate response to the participant's emotional catharsis.

[0046] In the event determination step S2, a "frequency envelope verification" layer is added to the system to address the unique physical acoustic characteristics of the chime bells. The signal collected by the piezoelectric sensor, after time-domain determination, undergoes a Fast Fourier Transform (FFT) operator. Only when the dominant frequency component of the signal falls within the inherent frequency range of the chime bells' design (e.g., ±10% error) is it confirmed as a genuine chime bell strike. This mechanism effectively filters out low-frequency impact noise generated by moving chairs, personnel movement, or accidental touches on the support structure, greatly enhancing the system's ability to prevent accidental triggering in complex exhibition environments.

[0047] In step S3, the beat scheduling incorporates an adaptive mode. While the base beat is set at 90 BPM, for specific therapeutic scenarios (such as a soothing mode for individuals with high anxiety), the control system can slowly and smoothly adjust the overall tempo between 80 and 90 BPM based on the initial average pace of all participants. This tempo adjustment is extremely slow (changing by no more than one beat per minute), allowing participants to be gradually guided to a more stable physiological rhythm without perceiving any tempo change.

[0048] In step S4, the feedback generation hierarchy introduces a "pre-play trajectory" animation through the visual guidance system. The digital silhouettes are no longer simply variations in brightness; instead, they create subtle, flowing light effects between the chimes, foreshadowing the possible melodic direction of the next beat. This design utilizes the principles of visual persistence and synesthesia to help participants build a mental map of sound distribution in space, thereby further reducing cognitive load during collaboration.

[0049] In the closed-loop control of step S5, a fault recovery mechanism is introduced. If a sensor in a certain zone loses signal due to reasons such as loose cables, the system will automatically distribute the acoustic tasks of that zone to the other two zones and change the visual cue layout. This dynamic task redistribution ensures the "uninterrupted" operation of the art installation in public places and avoids the collapse of overall collaboration due to local failures.

[0050] To address the quantitative assessment needs of art therapy, the data recording unit in this embodiment not only records time deviations but also the statistical characteristics of the tapping force. By analyzing the standard deviation and mean of the tapping force, the system can generate a rough profile of the participant's emotional state. For example, continuous, high-intensity, irregular tapping usually corresponds to a high-stress state, while even-forced, highly aligned tapping corresponds to a relaxed state. This multi-dimensional structured data provides important quantitative tools for psychotherapists.

[0051] This invention presents a collaborative music interaction system and its control method for art therapy, which successfully constructs a collaborative field in public spaces that is both constraining and creative through sophisticated electromechanical system design, rigorous time scheduling algorithms, and deep multimodal interactive feedback. The system transforms complex rhythmic synchronization problems into intuitive visual guidance and immediate physical feedback, significantly reducing uncertainty in the collaborative process. A fixed frequency of 90 BPM and a tolerance window of 150 milliseconds work together to ensure the stability of the therapeutic process while preserving sufficient space for participants' expression. At the hardware level, through high-frequency sampling of 2000 Hz and a dynamic threshold with three times the ambient noise, this invention overcomes the technical bottlenecks of traditional interactive devices' weak anti-interference capabilities and inaccurate triggering in public environments. At the software level, real-time rendering based on TouchDesigner and a low-latency engine based on preloaded audio samples ensure a high degree of synchronization between visual, auditory, and physical actions; this millisecond-level synchronization is the technical foundation for forming a "streaming experience." At the strategic level, through the deep integration of voice division and pre-guidance, the system has achieved a fundamental shift from "independent individual participation" to "structured group collaboration," thereby truly realizing the core value of art therapy in emotional resonance and social connection.

[0052] In summary, this invention, through the deep integration of system architecture and control process, not only solves the specific problems of unstable rhythm and high participation threshold in multi-person collaboration, but also provides a feasible technical path for the intervention of digital interaction technology in mental health intervention.

[0053] All control methods and logic mentioned in this invention can be implemented through a computer-readable storage medium and a processor executing corresponding program instructions. Specific hardware implementations are not limited to the Arduino or industrial computer mentioned above; FPGAs, ARM core boards, or other control units with real-time processing capabilities can also be used. The above descriptions are merely preferred embodiments of this invention, but the scope of protection of this invention is not limited thereto. Any equivalent substitutions or modifications made by those skilled in the art within the scope of the technology disclosed in this invention, based on the technical solution and inventive concept of this invention, should be covered within the scope of protection of this invention.

Claims

1. A control method for a multi-user collaborative music interaction system for art therapy, characterized in that, Includes the following steps: S1. Divide the chime bells into multiple cooperative zones, and use piezoelectric sensors embedded in the bell bodies of each cooperative zone to capture the physical vibration signals generated when participants strike the bells; S2. Filter the physical vibration signals, identify valid striking events by comparing real-time voltage values ​​with preset judgment thresholds, and extract event data containing chime bell numbers and timestamps; S3. Run under a preset fixed time reference, determine the theoretical trigger time of each beat according to a preset discrete time series template, perform alignment analysis between the timestamps and the corresponding theoretical trigger times, and calculate the beat deviation value reflecting the accuracy of the participants' movements; S4. Based on the discrete time series template, before the current beat arrives, drive the brightness of the digital silhouette of the corresponding chime bell to change to provide striking guidance, and after recognizing the striking event, synchronously trigger the corresponding audio playback and brightness update feedback; S5. Evaluate the synchronization status of group collaboration based on the beat deviation value. When the beat deviation value exceeds a preset tolerance window, adjust the visual guidance intensity of the next beat to achieve a closed-loop interaction for multi-person collaboration.

2. The control method for a multi-person collaborative music interaction system for art therapy according to claim 1, characterized in that, In step S1, the pitch mapping of the chime bells follows the multi-voice division logic, assigning scale notes to the chime bells in different cooperative zones, and adding high-octave repeating notes to strengthen the pitch range of key beat positions.

3. The control method for a multi-person collaborative music interaction system for art therapy according to claim 1, characterized in that, In step S2, the calibration process of the determination threshold includes: acquiring the peak data of the environmental background noise and setting the determination threshold to a predetermined multiple of the peak value of the environmental background noise.

4. The control method for a multi-person collaborative music interaction system for art therapy according to claim 1, characterized in that, In step S2, identifying a valid tapping event includes: within a preset minimum trigger interval after a valid trigger, shielding voltage fluctuations in the same channel to eliminate signal tailwave interference.

5. The control method for a multi-person collaborative music interaction system for art therapy according to claim 1, characterized in that, In step S3, the fixed time reference is determined based on the human ear's perception of rhythmic continuity, which is used to reduce the rhythm negotiation cost for participants in the collaborative process.

6. The control method for a multi-person collaborative music interaction system for art therapy according to claim 1, characterized in that, In step S4, the pre-guidance duration of the digital silhouette is dynamically calculated based on the current beat speed, and is used to provide participants with pre-emptive psychological and physiological preparation time.

7. The control method for a multi-person collaborative music interaction system for art therapy according to claim 1, characterized in that, In step S4, the brightness update feedback adopts an exponential decay mathematical model, and its decay coefficient is set according to the visual persistence effect.

8. The control method for a multi-person collaborative music interaction system for art therapy according to claim 1, characterized in that, In step S4, the audio playback uses a preloading technique to configure an independent timbre buffer for each of the chime bells, and directly calls the corresponding sample when the striking event is triggered.

9. The control method for a multi-person collaborative music interaction system for art therapy according to claim 1, characterized in that, Step S5 is followed by writing the beat deviation value, the chime number, and the participant identification code into a structured log file in real time to support a quantitative assessment of the stability of collaboration and the effect of psychological stress relief.

10. A multi-user collaborative music interaction system for art therapy, characterized in that: include: The interactive terminal hardware layer includes a set of chime bells divided into multiple cooperative zones, and each chime bell has a piezoelectric sensor embedded in its bell body. The signal acquisition and processing layer is used to capture the physical vibration signals generated by the piezoelectric sensor in real time and identify impact events. The logic scheduling calculation layer is used to calculate the beat deviation value and execute closed-loop control; the multimodal feedback layer is used to generate forward visual guidance, audio feedback and brightness update feedback. The system executes a multi-user collaborative music interaction system control method for art therapy as described in any one of claims 1 to 9.

Images