Sound coordination method and system based on tinnitus condition

Abstract

The invention provides a sound coordination method and system based on a tinnitus condition, and relates to the technical field of tinnitus treatment.The method comprises the steps that a tinnitus feature vector of a patient is established through broadband hearing testing and three-dimensional sound field modeling, and a dual-mode treatment audio is generated based on the tinnitus feature vector; the dual-mode treatment audio comprises offset sound waves with opposite phases and masking sound waves with matched frequency bands; establishing a dynamic mapping relationship between a game interaction event and the audio parameters of the dual-mode treatment audio; and dynamically adjusting treatment parameters according to the dynamic mapping relation and the real-time physiological feedback data. The tinnitus characteristic vector of the patient is accurately established through comprehensive application of broadband hearing testing, three-dimensional sound field modeling and binaural sound field matching, and the treatment audio is dynamically adjusted according to personalized characteristics of tinnitus. According to the personalized sound coordination method, the tinnitus symptom can be effectively relieved according to the tinnitus symptom of each patient, and the treatment compliance of the patient is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of tinnitus treatment, and can automatically execute inspection tasks at engineering sites, and in particular to a sound coordination method and system based on tinnitus conditions. Background Art

[0002] Tinnitus is a common hearing disease characterized by a persistent ringing or buzzing sound in the ears. Its severity varies from person to person and often affects the patient's quality of life, sleep quality, and mental health. Currently, there are many treatments for tinnitus, the most common of which are medication, sound therapy, and psychotherapy. However, these methods often have certain limitations, such as possible side effects of medication, low patient compliance with ordinary sound therapy, and unstable effects of psychotherapy.

[0003] Sound therapy (including white noise, customized music, etc.) as a non-invasive treatment method has gained certain recognition in relieving tinnitus. However, traditional sound therapy has failed to completely solve the problems of lack of personalization and patient compliance. Current sound therapy is generally a unified standard sound, which fails to make personalized adjustments according to the type, frequency and intensity of tinnitus of different patients. Conventional sound therapy requires patients to wear headphones or contact sound equipment for a long time, which can easily lead to low patient compliance, thus affecting the treatment effect.

[0004] Therefore, how to improve the treatment effect and increase the patient's compliance through sound coordination according to the patient's specific tinnitus situation has become an urgent problem to be solved. Summary of the invention

[0005] In view of this, the purpose of the present invention is to propose a sound coordination method and system based on tinnitus conditions, which can better match the patient's tinnitus conditions by adjusting the frequency, loudness and other parameters of the therapeutic audio in real time, thereby effectively alleviating tinnitus symptoms and improving the patient's treatment compliance.

[0006] To achieve the above object, the present invention provides the following technical solutions: Based on the above objectives, in a first aspect, the present invention provides a sound coordination method based on tinnitus, comprising the following steps: Establishing the patient's tinnitus feature vector through broadband hearing test and three-dimensional sound field modeling, wherein the tinnitus feature vector includes main frequency band energy ratio, time domain modulation depth and spatial perception discreteness parameters; Generate a dual-mode therapeutic audio based on the tinnitus feature vector, wherein the dual-mode therapeutic audio includes a cancellation sound wave with opposite phases and a masking sound wave with matching frequency bands; Establishing a dynamic mapping relationship between game interaction events and audio parameters of the dual-mode therapeutic audio; The treatment parameters are dynamically adjusted according to the dynamic mapping relationship and the real-time physiological feedback data, wherein the real-time physiological feedback data includes heart rate variability and skin conductance indicators.

[0007] As a further solution of the present invention, before establishing the patient's tinnitus feature vector through wide-band hearing test and three-dimensional sound field modeling, binaural sound field matching is used to construct a three-dimensional tinnitus sound and image model, the auditory cortex response data is obtained through a 128-channel EEG acquisition module, and the frequency-specific hearing threshold curve in the range of 0.125-16kHz is calculated.

[0008] As a further solution of the present invention, generating dual-mode therapeutic audio based on the tinnitus feature vector includes the following steps: White noise and pink noise are mixed through the base noise generation module, and the mixing ratio is dynamically adjusted according to the main frequency band energy ratio; Use FFT analysis results to insert dynamic harmonic components in the target frequency band; HRTF personalized adaptation algorithm is used to modulate the spatial sound field.

[0009] As a further solution of the present invention, when the HRTF personalized adaptation algorithm is used to modulate the spatial sound field, an improved LMS adaptive filter is used, and the iterative formula is: W(n+1)=W(n)+μ·e(n)·X(n) / (||X(n)||²+δ) Among them, μ=0.2 is the step size parameter, δ=0.01 is the stability factor, and the number of convergence iterations does not exceed 50 times.

[0010] As a further solution of the present invention, the mapping relationship includes operation response delay triggering phase inversion and game progress threshold controlling bandwidth expansion.

[0011] As a further solution of the present invention, the established dynamic mapping relationship satisfies: The correlation function between the visual stimulation frequency Fv and the acoustic stimulation bandwidth Bw is Bw = K·log(1+Fv), where K is the patient tolerance coefficient; The negative correlation between operation accuracy Ac and treatment intensity It is It=Imax·(1-0.7Ac), where Imax is the maximum treatment intensity.

[0012] As a further solution of the present invention, when the treatment parameters are dynamically adjusted according to the dynamic mapping relationship and real-time physiological feedback data, when the standard deviation of the heart rate variability is lower than the baseline value by 15%, the game difficulty downgrade mechanism is triggered; when the skin conductance rising slope exceeds 0.05μS / s, the ambient sound fusion mode is started.

[0013] In a second aspect, the present invention further provides a sound coordination system based on tinnitus conditions, comprising the following components: The feature analysis terminal is equipped with binaural in-ear audiometry probes and a 128-channel EEG acquisition module to collect the patient's auditory data and EEG activity data; Dynamic synthesis server with built-in GPU-accelerated real-time convolution processor, supporting audio processing at 192kHz sampling rate, configured with: Parametric sound engine with configurable base noise mixer, dynamic harmonic inserter, and spatial sound field modulator; Cross-modal coordination control module to achieve triangular closed-loop control of game events, audio parameters and physiological indicators; Interactive treatment terminal, which integrates a six-degree-of-freedom tactile feedback handle and a bone conduction audio output device, is used to interact with patients in real time and provide a personalized treatment experience; The physiological monitoring array includes a wrist PPG sensor and an auricular temperature detection module, which is used to monitor the patient's physiological feedback data in real time.

[0014] As a further solution of the present invention, the dynamic synthesis server further comprises: Personalized sound generation module, which supports dynamic adjustment and can generate adaptive dual-mode therapeutic audio according to the personalized characteristics of the patient's tinnitus; Real-time audio processing module for processing multi-channel spatial sound and frequency response to enhance the masking effect of therapeutic audio.

[0015] As a further solution of the present invention, the interactive treatment terminal is configured with: A 3D soundscape game scene built on Unreal Engine, including a frequency matching level module, which is used to dynamically adjust the audio elements of the game scene based on tinnitus characteristics; Supports 256 sets of personalized HRTF databases for dynamic coupling of audio and video positions and visual elements.

[0016] As a further solution of the present invention, the system further includes: The deep belief network (DBN) model is composed of three stacked restricted Boltzmann machines (RBMs). The input layer receives 12-dimensional tinnitus features and 5-dimensional physiological baseline data, and the output layer generates a treatment parameter combination containing 6 adjustment factors.

[0017] As a further embodiment of the present invention, the physiological monitoring array further comprises: Eye tracking equipment is used to monitor the patient's visual focus and attention changes in real time, providing additional feedback data for dynamic adjustment of game difficulty and therapeutic audio.

[0018] In another aspect of the present invention, a computer device is provided, including a memory and a processor. The memory stores a computer program, and when the computer program is executed by the processor, any one of the above-mentioned sound coordination methods based on tinnitus conditions according to the present invention is executed.

[0019] In another aspect of the present invention, a computer-readable storage medium is provided, storing computer program instructions, which, when executed, implement any of the above-mentioned sound coordination methods based on tinnitus conditions according to the present invention.

[0020] Compared with the prior art, the sound coordination method and system based on tinnitus proposed in the present invention has the following beneficial effects: 1. The present invention uses a combination of broadband audiometry, three-dimensional sound field modeling, binaural sound field matching and other technologies to accurately establish the patient's tinnitus feature vector and dynamically adjust the treatment audio according to the personalized characteristics of tinnitus. This personalized sound coordination method can provide targeted treatment based on the tinnitus symptoms of each patient, significantly improving the treatment effect.

[0021] 2. The present invention can generate dual-mode therapeutic audio with good masking effect through base noise mixing, dynamic harmonic insertion and HRTF personalized adaptation algorithm. The audio contains offset sound waves and masking sound waves, which can effectively reduce the distress of tinnitus to patients, and at the same time enhance the therapeutic effect through spatial sound field modulation to meet the different needs of different patients for therapeutic audio.

[0022] 3. The present invention can adjust the treatment parameters in real time by dynamically mapping game interaction events with treatment audio parameters, combined with real-time physiological feedback data (such as heart rate variability, skin conductance, eye tracking, etc.). For example, when the patient's physiological state is not good, the system can automatically adjust the game difficulty or start the ambient sound fusion mode according to the trigger mechanism of the change of heart rate variability standard deviation or skin conductance, so as to avoid overstimulation and ensure that the treatment process is more comfortable and effective.

[0023] 4. The sound coordination system of the present invention includes a variety of technical components such as a dynamic synthesis server, a personalized sound generation module, and a real-time audio processing module. These modules can dynamically generate suitable dual-mode treatment audio according to the patient's tinnitus characteristics and physiological feedback, while optimizing spatial sound effects and enhancing the masking effect of sound. Through the cross-modal coordination control module, the system can achieve triangular closed-loop control of game events, audio parameters, and physiological feedback, so that patients can not only obtain sound therapy during the treatment process, but also obtain positive psychological feedback through interactive games, thereby improving the overall treatment experience.

[0024] 5. The present invention adopts a deep belief network (DBN) model, inputs tinnitus feature data and physiological baseline data into the model, and outputs a combination of treatment parameters. Through machine learning technology, the system can learn from the patient's historical data, further optimize the treatment plan, gradually improve the treatment effect, and continuously adjust the treatment strategy based on the patient's feedback.

[0025] 6. The interactive treatment terminal in the system of the present invention includes a six-degree-of-freedom tactile feedback handle and a bone conduction audio output device, which provides patients with a multi-sensory interactive experience not only through audio therapy but also through tactile feedback. In addition, the three-dimensional soundscape game scene built on Unreal Engine can adjust the audio elements in the game in real time, and through dynamic coupling of visual and audio-visual positions, create an immersive treatment environment for patients, help them distract their attention from tinnitus, and thus improve the enthusiasm and effect of treatment.

[0026] 7. The present invention integrates a wrist PPG sensor, an auricle temperature detection module, and an eye tracking device, so that the system can monitor the patient's physiological feedback data in real time. These data can provide the patient's psychological and physiological state, provide a basis for real-time adjustment during the treatment process, and ensure that the treatment is always in the patient's best comfort state.

[0027] In summary, the present invention not only provides a personalized, intelligent sound coordination method and system based on tinnitus conditions, but also significantly improves the treatment effect and patient treatment experience through technical means such as multimodal interaction, deep learning optimization, and real-time physiological feedback regulation, ensuring that tinnitus patients receive more accurate and comfortable treatment during the treatment process. These innovative features give the present invention significant technical advantages and broad application prospects in the field of tinnitus treatment.

[0028] These and other aspects of the present application will be more concise and understandable in the following description of the embodiments. It should be understood that the above general description and the following detailed description are only exemplary and explanatory and cannot limit the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or related technologies, the following briefly introduces the drawings required for use in the exemplary embodiments or related technical descriptions. The drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation to the present invention. In the drawings: Figure 1 The figure is a flow chart of a sound coordination method based on tinnitus according to an embodiment of the present invention.

[0030] Figure 2The present invention is a flowchart of generating dual-mode therapeutic audio in a sound coordination method based on tinnitus conditions according to an embodiment of the present invention.

[0031] Figure 3 The structure block diagram of a sound coordination system based on tinnitus according to an embodiment of the present invention. DETAILED DESCRIPTION

[0032] Below, the present application is further described in conjunction with the accompanying drawings and specific implementation methods. It should be noted that, under the premise of no conflict, the various embodiments or technical features described below can be arbitrarily combined to form a new embodiment.

[0033] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the embodiments of the present invention are further described in detail below in combination with specific embodiments and with reference to the accompanying drawings. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0034] It should be noted that all expressions using "first" and "second" in the embodiments of the present invention are intended to distinguish two non-identical entities or non-identical parameters with the same name. It can be seen that "first" and "second" are only for the convenience of expression and should not be understood as limitations on the embodiments of the present invention. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, other steps or units inherent to a process, method, system, product or device that includes a series of steps or units.

[0035] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0036] The flowcharts shown in the accompanying drawings are only examples and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may also be decomposed, combined or partially merged, so the actual execution order may change according to actual conditions.

[0037] In conjunction with the accompanying drawings, some embodiments of the present application are described in detail below. In the absence of conflict, the following embodiments and features in the embodiments can be combined with each other.

[0038] See also Figure 1 As shown, an embodiment of the present invention provides a sound coordination method based on tinnitus conditions, the method comprising the following steps: Step S10: Establishing the patient's tinnitus feature vector through broadband hearing test and three-dimensional sound field modeling, wherein the tinnitus feature vector includes main frequency band energy ratio, time domain modulation depth and spatial perception discreteness parameters.

[0039] In this step, before establishing the patient's tinnitus feature vector through wide-band hearing test and three-dimensional sound field modeling, binaural sound field matching is used to construct a three-dimensional tinnitus sound and image model, the auditory cortex response data is obtained through a 128-channel EEG acquisition module, and the frequency-specific hearing threshold curve in the range of 0.125-16kHz is calculated.

[0040] When establishing the patient's tinnitus feature vector through wide-band hearing testing and three-dimensional sound field modeling, binaural sound field matching is first performed. The patient's binaural hearing is evaluated on standard hearing test equipment, and the auditory response of each frequency band is measured using binaural sound field matching technology. This test inputs sound sources of different frequencies into the patient's left and right ears respectively, measures the difference in the ear's response to the sound source, and helps build a binaural hearing model for the patient.

[0041] Then, a three-dimensional tinnitus sound and image model is constructed. The three-dimensional sound field modeling technology is used to combine the test results with the patient's tinnitus characteristics, and a complex sound field modeling algorithm is used to generate a tinnitus sound and image model. This tinnitus sound and image model takes into account the spatial perception properties of tinnitus, that is, the location of the sound source of tinnitus, the propagation characteristics of the sound field, etc. Then, EEG acquisition and frequency-specific hearing threshold calculation are performed, and a 128-channel EEG (electroencephalogram) acquisition module is used to record the patient's auditory cortex response data in real time. EEG data can analyze the patient's auditory cortex response at different frequencies, thereby calculating the frequency-specific hearing threshold curve (0.125-16kHz range). This curve reflects the frequency characteristics and sensitivity of tinnitus, and further accurately locates the tinnitus frequency band and its interference level.

[0042] Finally, the tinnitus feature vector is extracted and converted into a tinnitus feature vector based on the above data, which includes the following parameters: Main frequency band energy ratio: the relative proportion of energy between different frequency bands, reflecting the frequency component of tinnitus.

[0043] Temporal modulation depth: The temporal fluctuation amplitude of tinnitus sound, indicating the dynamic changes of tinnitus.

[0044] Spatial perceptual dispersion: The spatial distribution characteristics of tinnitus sound sources help determine the spatial perceptual differences of tinnitus sound sources.

[0045] Step S20: Generate dual-mode therapeutic audio based on the tinnitus feature vector, wherein the dual-mode therapeutic audio includes a canceling sound wave with opposite phases and a masking sound wave with matching frequency bands.

[0046] In this step, see Figure 2As shown, generating dual-mode therapeutic audio based on the tinnitus feature vector includes the following steps: Step S201: white noise and pink noise are mixed by a base noise generation module, and the mixing ratio is dynamically adjusted according to the main frequency band energy ratio.

[0047] In this step, when generating and mixing the base noise, the base noise generation module first generates a mixture of white noise and pink noise, and the noise mixing ratio is dynamically adjusted based on the main frequency band energy ratio in the tinnitus feature vector. For example, if the tinnitus is mainly concentrated in the 2-4kHz frequency band, the system will increase the noise component in this frequency band to enhance the treatment effect.

[0048] During the generation process, the ratio of white noise and pink noise will be dynamically adjusted based on spectral analysis to ensure that the noise components in different frequency bands match the patient's tinnitus characteristics.

[0049] Step S202: insert dynamic harmonic components into the target frequency band using the FFT analysis result.

[0050] When dynamic harmonic insertion is performed in this step, the generated noise signal is analyzed in the frequency domain through FFT (Fast Fourier Transform), and dynamic harmonic components are inserted in a specific frequency band. For example, if the tinnitus frequency is around 3kHz, the system will insert harmonics in this frequency band to enhance the audio coverage of this frequency band and help reduce the interference of the tinnitus frequency. This method of inserting harmonics ensures that the frequency band of the audio is highly matched with the tinnitus characteristics, thereby improving the treatment effect.

[0051] Step S203: using the HRTF personalized adaptation algorithm to perform spatial sound field modulation.

[0052] Among them, when the HRTF personalized adaptation algorithm is used for spatial sound field modulation, an improved LMS adaptive filter is used, and the iterative formula is: W(n+1)=W(n)+μ·e(n)·X(n) / (||X(n)||²+δ) Where W(n) is the weight vector of the filter, e(n) is the error signal, X(n) is the input signal, μ=0.2 is the step size parameter, δ=0.01 is the stability factor, and the number of convergence iterations does not exceed 50.

[0053] In this step, the HRTF (head-related transfer function) personalized adaptation algorithm is used to modulate the spatial sound field of the audio. The purpose of this step is to simulate the natural auditory spatial perception so that the patient can perceive the directionality and spatial sense of the therapeutic audio. Among them, the improved LMS adaptive filter adjusts the spatial perception effect of the audio signal through iterative calculation, so that it can match the patient's tinnitus characteristics and ear shape, enhance the effect of audio therapy, and realize the spatial sense adjustment of the audio signal to match the patient's auditory space, thereby enhancing the comfort and masking effect of the audio.

[0054] The present invention can generate dual-mode therapeutic audio with good masking effect through base noise mixing, dynamic harmonic insertion and HRTF personalized adaptation algorithm. The audio includes offset sound waves and masking sound waves, which can effectively reduce the distress of tinnitus to patients, and at the same time enhance the therapeutic effect through spatial sound field modulation, meeting the different needs of different patients for therapeutic audio.

[0055] Step S30: establishing a dynamic mapping relationship between game interaction events and audio parameters of the dual-mode therapeutic audio.

[0056] In this step, the mapping relationship includes the operation response delay triggering phase reversal and the game progress threshold controlling bandwidth expansion, and the established dynamic mapping relationship satisfies: The correlation function between the visual stimulation frequency Fv and the acoustic stimulation bandwidth Bw is Bw=K·log(1+Fv), where K is the patient tolerance coefficient (which can be adjusted individually according to the patient's tolerance), Bw is the frequency bandwidth of the therapeutic audio, and Fv is the frequency of the visual stimulation (such as the update frequency of the game screen, the task trigger frequency, etc.); The negative correlation between the operation accuracy Ac and the treatment intensity It is It=Imax·(1-0.7Ac), where Imax is the maximum treatment intensity, Ac is the operation accuracy, and It is the current treatment intensity.

[0057] Among them, when the operation response delay triggers phase reversal, during the treatment process, the patient controls the audio output of the treatment process through an interactive game, such as controlling certain elements in the game (such as virtual object movement, task completion, etc.) through a touch screen, buttons or other means. Whenever the player performs an operation, the system detects the input operation and triggers the phase reversal of the audio according to the operation response delay (that is, the time delay between the player completing the operation and the audio response).

[0058] For example, the player needs to hit a "tinnitus sound source" of a specific frequency band in the virtual environment for treatment. When the player hits the target, the phase of the treatment audio will be reversed immediately to counteract the specific frequency of tinnitus. The design of the operation response delay helps to ensure that the treatment audio is synchronized with the player's actions, thereby enhancing the interactivity of the treatment.

[0059] When the game progress threshold controls bandwidth expansion, during the game, as the patient completes the treatment task, the system monitors the game progress and dynamically adjusts the bandwidth of the treatment audio according to the progress. Specifically, the frequency band (or frequency band) of the treatment audio will expand or contract as the game progresses to adapt to the patient's tinnitus characteristics at different stages.

[0060] For example: At the beginning of the game, the patient may face milder tinnitus symptoms, and the system will set a narrower treatment bandwidth; when the game progresses to a certain level and the patient's tinnitus symptoms are alleviated, the system will increase the bandwidth to cover a wider range of tinnitus frequencies, thereby providing a stronger treatment effect.

[0061] When the operation accuracy is negatively correlated with the treatment intensity, the accuracy of the game interaction (such as the player's operation accuracy in the game) directly affects the intensity of the treatment audio. The operation accuracy (Ac) is negatively correlated with the treatment intensity (It), which means that when the operation accuracy is high, the system will reduce the intensity of the treatment audio. For example, if the player's operation in the game is very accurate, the system will automatically reduce the intensity of the treatment audio to avoid overstimulation; conversely, if the operation accuracy is low, the system will increase the treatment intensity to increase the treatment effect.

[0062] Step S40: dynamically adjusting treatment parameters according to the dynamic mapping relationship and real-time physiological feedback data, wherein the real-time physiological feedback data includes heart rate variability and skin conductance indicators.

[0063] In this step, when the treatment parameters are dynamically adjusted according to the dynamic mapping relationship and real-time physiological feedback data, when the standard deviation of the heart rate variability is lower than the baseline value by 15%, the game difficulty downgrade mechanism is triggered; when the skin conductance rising slope exceeds 0.05μS / s, the ambient sound fusion mode is started.

[0064] When acquiring real-time physiological feedback data, the patient's real-time physiological feedback data, including heart rate variability (HRV) and skin conductance (EDA) indicators, are continuously monitored. These physiological feedbacks reflect the patient's physiological state and psychological response during the treatment process, and can provide a strong basis for the adjustment of treatment parameters. For example, the patient's heart rate, skin conductance and other physiological data are collected through wearable devices or physiological monitoring instruments, and fed back to the system in real time.

[0065] When the standard deviation of heart rate variability is lower than the baseline value, the game difficulty downgrade mechanism is triggered. Among them, heart rate variability (HRV) is a key indicator for measuring heart health and autonomic nervous system function. Lower HRV values ​​are usually associated with negative emotions such as stress and anxiety. During the treatment process, when the standard deviation of heart rate variability is lower than 15% of the patient's baseline value, the system will identify that the patient is in a state of excessive tension or anxiety, thereby triggering a downgrade mechanism for the game difficulty. For example, if the standard deviation of heart rate variability (HRV) is low, the system will automatically adjust the game difficulty, reduce the complexity of the task, or reduce the intensity of the treatment audio to avoid excessive psychological pressure on the patient, thereby ensuring the comfort and effectiveness of the treatment process.

[0066] When the skin conductance rising slope exceeds the threshold, the ambient sound fusion mode is activated. Skin conductance reflects the emotional changes and sympathetic nerve activity of the human body. When the skin conductance rising slope exceeds a certain threshold (for example, 0.05μS / s), it means that the patient may be in a state of tension, anxiety, etc. At this time, the system will activate the ambient sound fusion mode to help the patient relax.

[0067] For example, when skin conductance rises rapidly (usually indicating increased anxiety or stress), the system will automatically introduce environmental sounds into the therapeutic audio (such as natural ambient sounds, white noise, etc.), helping patients relieve stress and enhance the therapeutic experience through gentle environmental sound integration.

[0068] When adjusting treatment parameters in real time, the system will adjust the following treatment parameters based on the dynamic mapping relationship and real-time physiological feedback data: Treatment Intensity (It): Adjust the intensity of the treatment audio according to the operation accuracy and heart rate variability.

[0069] Bandwidth (Bw): Adjusts the bandwidth of the therapeutic audio based on the relationship between game progress and the frequency of visual stimulation.

[0070] Spatial perception regulation of therapeutic audio: According to changes in skin conductance, the spatial perception effect of the audio is adjusted to enhance or weaken the three-dimensional sense of the sound to promote relaxation.

[0071] The present invention can adjust the treatment parameters in real time by dynamically mapping game interaction events with treatment audio parameters, combined with real-time physiological feedback data (such as heart rate variability, skin conductance, eye tracking, etc.). For example, when the patient's physiological state is not good, the system can automatically adjust the game difficulty or start the ambient sound fusion mode according to the trigger mechanism of the change of heart rate variability standard deviation or skin conductance, so as to avoid overstimulation and ensure that the treatment process is more comfortable and effective.

[0072] The present invention uses a combination of broadband audiometry, three-dimensional sound field modeling, binaural sound field matching and other technologies to accurately establish the patient's tinnitus feature vector and dynamically adjust the treatment audio according to the personalized characteristics of tinnitus. This personalized sound coordination method can provide targeted treatment based on the tinnitus symptoms of each patient, significantly improving the treatment effect.

[0073] It should be noted that the above figures are only schematic illustrations of the processes included in the method according to an exemplary embodiment of the present invention, and are not intended to be limiting. It is easy to understand that the processes shown in the above figures do not indicate or limit the time sequence of these processes. In addition, it is also easy to understand that these processes can be performed synchronously or asynchronously, for example, in multiple modules.

[0074] It should be understood that, although described in a certain order, these steps are not necessarily performed in sequence in the above order. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be performed in other orders. Moreover, a part of the steps of the present embodiment may include a plurality of steps or a plurality of stages, and these steps or stages are not necessarily performed at the same time, but can be performed at different times, and the execution order of these steps or stages is not necessarily performed in sequence, but can be performed in turn or alternately with at least a part of the steps or stages in other steps or other steps.

[0075] In the second aspect of the embodiment of the present invention, see Figure 3 As shown, the present invention also provides a sound coordination system based on tinnitus conditions, comprising the following components: The feature analysis terminal 101 is equipped with binaural in-ear audiometry probes and a 128-channel EEG acquisition module for collecting the patient's auditory data and EEG activity data; Dynamic Synthesis Server 201, with built-in GPU-accelerated real-time convolution processor, supports audio processing at 192kHz sampling rate, and is configured with: Parametric sound engine with configurable base noise mixer, dynamic harmonic inserter, and spatial sound field modulator; Cross-modal coordination control module to achieve triangular closed-loop control of game events, audio parameters and physiological indicators; Interactive treatment terminal 301, integrating a six-degree-of-freedom tactile feedback handle and a bone conduction audio output device, is used to interact with the patient in real time and provide a personalized treatment experience;

[0076] The physiological monitoring array 401 includes a wrist PPG sensor and an auricle temperature detection module, which is used to monitor the patient's physiological feedback data in real time.

[0077] Wherein, the dynamic synthesis server 201 further comprises: Personalized sound generation module, which supports dynamic adjustment and can generate adaptive dual-mode therapeutic audio according to the personalized characteristics of the patient's tinnitus; Real-time audio processing module for processing multi-channel spatial sound and frequency response to enhance the masking effect of therapeutic audio.

[0078] In this embodiment, the interactive treatment terminal 301 is configured with: A 3D soundscape game scene built on Unreal Engine, including a frequency matching level module, which is used to dynamically adjust the audio elements of the game scene based on tinnitus characteristics; Supports 256 sets of personalized HRTF databases for dynamic coupling of audio and video positions and visual elements.

[0079] In this embodiment, the physiological monitoring array 401 further includes: Eye tracking equipment is used to monitor the patient's visual focus and attention changes in real time, providing additional feedback data for dynamic adjustment of game difficulty and therapeutic audio.

[0080] The system further comprises: The deep belief network (DBN) model is composed of three stacked restricted Boltzmann machines (RBMs). The input layer receives 12-dimensional tinnitus features and 5-dimensional physiological baseline data, and the output layer generates a treatment parameter combination containing 6 adjustment factors.

[0081] The present invention uses a deep belief network (DBN) model, inputs tinnitus feature data and physiological baseline data into the model, and outputs a combination of treatment parameters. Through machine learning technology, the system can learn from the patient's historical data, further optimize the treatment plan, gradually improve the treatment effect, and continuously adjust the treatment strategy based on the patient's feedback.

[0082] The sound coordination system of the present invention includes a variety of technical components such as a dynamic synthesis server, a personalized sound generation module, and a real-time audio processing module. These modules can dynamically generate suitable dual-mode treatment audio according to the patient's tinnitus characteristics and physiological feedback, while optimizing spatial sound effects and enhancing the masking effect of sound. Through the cross-modal coordination control module, the system can achieve triangular closed-loop control of game events, audio parameters, and physiological feedback, so that patients can not only obtain sound therapy during the treatment process, but also obtain positive psychological feedback through interactive games, thereby improving the overall treatment experience.

[0083] The interactive treatment terminal in the system of the present invention includes a six-degree-of-freedom tactile feedback handle and a bone conduction audio output device, which provides patients with a multi-sensory interactive experience not only through audio therapy but also through tactile feedback. In addition, the three-dimensional soundscape game scene built based on UnrealEngine can adjust the audio elements in the game in real time, and create an immersive treatment environment for patients by dynamically coupling visual and audio-visual positions, helping them distract from tinnitus, thereby improving the enthusiasm and effect of treatment.

[0084] The sound coordination system based on tinnitus of the present invention can monitor the patient's physiological feedback data in real time by integrating a wrist PPG sensor, an auricle temperature detection module and an eye tracking device. These data can provide the patient's psychological and physiological state, provide a basis for real-time adjustment during the treatment process, and ensure that the treatment is always in the patient's best comfort state.

[0085] Through the above detailed steps, the sound coordination system based on tinnitus situation of the present invention is used to execute the steps of the sound coordination method based on tinnitus situation in the above embodiment, which will not be repeated here.

[0086] The present invention not only provides a personalized, intelligent sound coordination method and system based on tinnitus conditions, but also significantly improves the treatment effect and patient treatment experience through technical means such as multimodal interaction, deep learning optimization, and real-time physiological feedback regulation, ensuring that tinnitus patients receive more accurate and comfortable treatment during the treatment process. These innovative features give the present invention significant technical advantages and broad application prospects in the field of tinnitus treatment.

[0087] According to a third aspect of an embodiment of the present invention, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the method of any one of the above embodiments is implemented.

[0088] The computer device includes a processor and a memory, and may also include an input system and an output system. The processor, memory, input system and output system may be connected via a bus or other means, and the input system may receive input digital or character information, and generate signal input related to the migration of sound coordination based on the tinnitus situation. The output system may include display devices such as a display screen.

[0089] As a non-volatile computer-readable storage medium, the memory can be used to store non-volatile software programs, non-volatile computer executable programs and modules, such as the program instructions / modules corresponding to the sound coordination system based on the tinnitus situation in the embodiment of the present application. The memory may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created by the use of the sound coordination system based on the tinnitus situation, etc. In addition, the memory may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage device. In some embodiments, the memory may optionally include a memory remotely arranged relative to the processor, and these remote memories may be connected to the local module via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0090] The processor may be a central processing unit (CPU), a controller, a microcontroller, a microprocessor, or other data processing chip in some embodiments. The processor is generally used to control the overall operation of the computer device. In this embodiment, the processor is used to run the program code stored in the memory or process data. The processors of the multiple computer devices of the computer device of this embodiment execute various functional applications and data processing of the server by running the non-volatile software programs, instructions and modules stored in the memory, that is, to implement the steps of the sound coordination method based on tinnitus situation of the above method embodiment.

[0091] It should be understood that, in the absence of mutual conflicts, all embodiments, features and advantages described above for the sound coordination method based on tinnitus conditions according to the present invention are also applicable to the sound coordination method based on tinnitus conditions and the storage medium according to the present invention.

[0092] It will also be appreciated by those skilled in the art that various exemplary logic blocks, modules, circuits and algorithm steps described in conjunction with the disclosure herein can be implemented as electronic hardware, computer software or a combination of the two. In order to clearly illustrate this interchangeability of hardware and software, a general description has been given to the functions of various schematic components, blocks, modules, circuits and steps. Whether this function is implemented as software or hardware depends on specific applications and the design constraints imposed on the entire system. Those skilled in the art can implement the function in various ways for each specific application, but this implementation decision should not be interpreted as causing a departure from the disclosed scope of the embodiments of the present invention.

[0093] Finally, it should be noted that the computer-readable storage medium (e.g., memory) herein may be a volatile memory or a non-volatile memory, or may include both a volatile memory and a non-volatile memory. As an example and not by way of limitation, a non-volatile memory may include a read-only memory (ROM), a programmable ROM (PROM), an electrically programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), or a flash memory. A volatile memory may include a random access memory (RAM), which may act as an external cache memory. As an example and not by way of limitation, RAM may be obtained in a variety of forms, such as synchronous RAM (DRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), and direct Rambus RAM (DRRAM). The storage devices of the disclosed aspects are intended to include, but are not limited to, these and other suitable types of memory.

[0094] The various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure herein may be implemented or executed using the following components designed to perform the functions herein: a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination of these components. A general-purpose processor may be a microprocessor, but alternatively, the processor may be any conventional processor, controller, microcontroller, or state machine. The processor may also be implemented as a combination of computing devices, for example, a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP, and / or any other such configuration.

[0095] The above are exemplary embodiments disclosed in the present invention, but it should be noted that various changes and modifications may be made without departing from the scope disclosed in the embodiments of the present invention as defined in the claims. The functions, steps and / or actions of the method claims according to the disclosed embodiments described herein do not need to be performed in any particular order. In addition, although the elements disclosed in the embodiments of the present invention may be described or required in individual form, they may also be understood as multiple unless explicitly limited to the singular.

[0096] It should be understood that, as used herein, the singular form "a" or "an" is intended to include the plural form as well, unless the context clearly supports an exception. It should also be understood that, as used herein, "and / or" refers to any and all possible combinations of one or more of the items listed in association. The serial numbers of the embodiments disclosed in the above embodiments of the present invention are for description only and do not represent the advantages and disadvantages of the embodiments.

[0097] A person skilled in the art should understand that the discussion of any of the above embodiments is only exemplary and is not intended to imply that the scope of the disclosure of the embodiments of the present invention (including the claims) is limited to these examples; under the concept of the embodiments of the present invention, the technical features in the above embodiments or different embodiments can also be combined, and there are many other changes in different aspects of the above embodiments of the present invention, which are not provided in detail for the sake of simplicity. Therefore, any omissions, modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the embodiments of the present invention should be included in the protection scope of the embodiments of the present invention.

Claims

1. A sound coordination method based on tinnitus, characterized in that: The method comprises the following steps: Establishing the patient's tinnitus feature vector through broadband hearing test and three-dimensional sound field modeling, wherein the tinnitus feature vector includes main frequency band energy ratio, time domain modulation depth and spatial perception discreteness parameters; Generate a dual-mode therapeutic audio based on the tinnitus feature vector, wherein the dual-mode therapeutic audio includes a cancellation sound wave with opposite phases and a masking sound wave with matching frequency bands; Establishing a dynamic mapping relationship between game interaction events and audio parameters of the dual-mode therapeutic audio; The treatment parameters are dynamically adjusted according to the dynamic mapping relationship and the real-time physiological feedback data, wherein the real-time physiological feedback data includes heart rate variability and skin conductance indicators.

2. The sound coordination method based on tinnitus condition as claimed in claim 1, characterized in that: Before establishing the patient's tinnitus feature vector through wide-band hearing test and three-dimensional sound field modeling, binaural sound field matching was used to construct a three-dimensional tinnitus sound and image model, the auditory cortex response data was obtained through a 128-channel EEG acquisition module, and the frequency-specific hearing threshold curve in the range of 0.125-16kHz was calculated.

3. The sound coordination method based on tinnitus condition as claimed in claim 2, characterized in that: Generating dual-mode therapeutic audio based on the tinnitus feature vector includes the following steps: White noise and pink noise are mixed through the base noise generation module, and the mixing ratio is dynamically adjusted according to the main frequency band energy ratio; Use FFT analysis results to insert dynamic harmonic components in the target frequency band; HRTF personalized adaptation algorithm is used to modulate the spatial sound field.

4. The sound coordination method based on tinnitus as claimed in claim 3, characterized in that: When the HRTF personalized adaptation algorithm is used for spatial sound field modulation, an improved LMS adaptive filter is used, and the iterative formula is: W(n+1)=W(n)+μ·e(n)·X(n) / (||X(n)||²+δ) Among them, μ=0.2 is the step size parameter, δ=0.01 is the stability factor, and the number of convergence iterations does not exceed 50 times.

5. The sound coordination method based on tinnitus condition as claimed in claim 1, characterized in that: The mapping relationship includes operation response delay triggering phase reversal and game progress threshold controlling bandwidth expansion.

6. The sound coordination method based on tinnitus condition as claimed in claim 5, characterized in that: The established dynamic mapping relationship satisfies: The correlation function between the visual stimulation frequency Fv and the acoustic stimulation bandwidth Bw is Bw = K·log(1+Fv), where K is the patient tolerance coefficient; The negative correlation between operation accuracy Ac and treatment intensity It is It=Imax·(1-0.7Ac), where Imax is the maximum treatment intensity.

7. The sound coordination method based on tinnitus condition as claimed in claim 6, characterized in that: When calculating the crack propagation rate and dynamically adjusting the treatment parameters according to the dynamic mapping relationship and real-time physiological feedback data, when the standard deviation of the heart rate variability is 15% lower than the baseline value, the game difficulty downgrade mechanism is triggered; when the skin conductance rising slope exceeds 0.05μS / s, the ambient sound fusion mode is started.

8. A sound coordination system based on tinnitus, characterized in that: Used to perform the sound coordination method based on tinnitus situation as described in any one of claims 1 to 7, the system comprises the following components: A feature analysis terminal (101) is provided with binaural in-ear audiometry probes and a 128-channel EEG acquisition module for collecting auditory data and brain electrical activity data of the patient; Dynamic synthesis server (201), built-in GPU accelerated real-time convolution processor, supports 192kHz sampling rate audio processing, configuration: Parametric sound engine with configurable base noise mixer, dynamic harmonic inserter, and spatial sound field modulator; Cross-modal coordination control module to achieve triangular closed-loop control of game events, audio parameters and physiological indicators; An interactive treatment terminal (301) is integrated with a six-degree-of-freedom tactile feedback handle and a bone conduction audio output device, and is used for real-time interaction with the patient to provide a personalized treatment experience; The physiological monitoring array (401) comprises a wrist PPG sensor and an auricle temperature detection module, and is used to monitor the patient's physiological feedback data in real time.

9. The sound coordination system based on tinnitus condition as claimed in claim 8, characterized in that: The dynamic synthesis server (201) further comprises: Personalized sound generation module, which supports dynamic adjustment and can generate adaptive dual-mode therapeutic audio according to the personalized characteristics of the patient's tinnitus; Real-time audio processing module for multi-channel spatial sound and frequency response.

10. The sound coordination system based on tinnitus condition as claimed in claim 8, characterized in that: The interactive treatment terminal (301) is configured with: A 3D soundscape game scene built on Unreal Engine, including a frequency matching level module, which is used to dynamically adjust the audio elements of the game scene based on tinnitus characteristics; Supports 256 sets of personalized HRTF databases for dynamic coupling of audio and video positions and visual elements.

Images