VR-based stuttering treatment auxiliary system

By designing a VR-based stuttering therapy assistance system, the problem of the monotony and inability to simulate real life communication scenarios of traditional stuttering therapy is solved, and the fun and interactive nature of the treatment is improved, the patient's enthusiasm and participation is improved, and the durability and universality of the treatment effect is enhanced.

CN120108629AInactive Publication Date: 2025-06-06虞磊
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202510192990.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-02-21
Publication Date
2025-06-06
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

The traditional stuttering treatment process is monotonous, lacking fun and interactive, making it difficult to maintain the enthusiasm and participation of patients for a long time, and at the same time, it is impossible to simulate diverse communication scenarios in real life, resulting in the limitation of the durability and universality of the treatment effect.

Method used

A VR-based stuttering therapy assistive system is designed, including a virtual situation unit, a rhythmic guidance unit, a data acquisition unit, a data transmission unit, a data storage unit, a data processing unit, an intelligent regulation unit and a remote monitoring unit. Through virtual reality technology, a diverse dialogue scene is generated, combined with a syllable metronome and multimodal data acquisition, the treatment difficulty and beat frequency are adjusted in real time.

Benefits of technology

It significantly improves the fun and interactive nature of the treatment, improves the enthusiasm and participation of patients, ensures the scientificity and accuracy of the treatment process, enhances the durability and universality of the treatment effect, and provides the convenience of remote monitoring and intervention.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120108629A_ABST
    Figure CN120108629A_ABST
Patent Text Reader

Abstract

The invention discloses a stutter treatment auxiliary system based on VR, which comprises a virtual situation unit, a rhythm guide unit, a data acquisition unit, a data transmission unit, a data storage unit, a data processing unit, an intelligent regulation and control unit and a remote monitoring unit, and belongs to the technical field of stutter treatment auxiliary. The system guides the patient to adjust the speaking rhythm in real time through the voice metronome equipment, and comprehensively monitors the language fluency and physiological status of the patient in combination with a multi-modal data acquisition unit (including speech speed, syllable repetition times, pause duration, heart rate and skin conductivity), so that the scientificity and accuracy of the treatment process are ensured. The data processing unit can calculate a voice fluency score and a virtual scene difficulty coefficient in real time according to the collected data, and dynamically adjust the dialogue difficulty and the beat frequency through the intelligent regulation and control unit to ensure that the treatment difficulty is always matched with the actual ability of the patient.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of stuttering auxiliary treatment, and more specifically discloses a stuttering treatment auxiliary system based on VR. Background Art

[0002] Stuttering is a common language disorder. When speaking, patients may repeat, pause or prolong their speech involuntarily. These symptoms not only seriously affect the fluency and clarity of the patient's speech, but also have a profound negative impact on their daily communication, social activities and mental health. Many stuttering patients often feel anxious, inferior or even avoid social occasions when communicating with others, which further aggravates the psychological burden and the decline of quality of life. Traditional stuttering treatment methods mainly rely on face-to-face guidance from speech therapists to help patients improve their symptoms through repeated language training, breathing regulation and psychological counseling. However, the treatment process of this treatment method is monotonous, lacks fun and interactivity, and it is difficult to maintain the enthusiasm and participation of patients in the long term. At the same time, traditional methods can usually only be carried out in a fixed treatment environment and cannot simulate the diverse communication scenarios in real life, making it difficult for patients to directly transfer the progress made in treatment to real life, further limiting the durability and universality of the treatment effect. Summary of the invention

[0003] Purpose of the invention: The purpose of the present invention is to solve the problem that traditional stuttering treatment methods mainly rely on face-to-face guidance from speech therapists to help patients improve their symptoms through repeated language training, breathing regulation, psychological counseling and other means. However, the treatment process of this treatment method is monotonous, lacks fun and interactivity, and it is difficult to maintain the enthusiasm and participation of patients for a long time. At the same time, traditional methods can usually only be carried out in a fixed treatment environment and cannot simulate the diverse communication scenarios in real life, making it difficult for patients to directly transfer the progress made in treatment to real life, further limiting the durability and universality of the treatment effect.

[0004] To solve the above technical problems, according to one aspect of the present invention, more specifically, a VR-based stuttering treatment auxiliary system includes: a virtual situation unit, a rhythm guidance unit, a data acquisition unit, a data transmission unit, a data storage unit, a data processing unit, an intelligent control unit, and a remote monitoring unit;

[0005] Virtual situation unit: used to generate virtual dialogue scenes for stuttering patients through VR virtual technology;

[0006] Rhythm guidance unit: used to guide patients to adjust their speaking rhythm by emitting regular beats through a voice metronome device;

[0007] Data collection unit: used to collect real-time information data generated during the stuttering treatment of patients through VR virtual technology;

[0008] Data transmission unit: used for real-time transmission of information data collected by the data collection unit;

[0009] Data storage unit: used to store the information data transmitted in real time by the data transmission unit;

[0010] Data processing unit: used to process and analyze the information data stored in the data storage unit, obtain the processing and analysis results, and then forward the obtained processing and analysis results to the remote monitoring unit, and at the same time issue control instructions to the intelligent control unit according to the processing and analysis results;

[0011] Intelligent control unit: used to receive the control signal of the data processing unit, and intelligently adjust the dialogue difficulty of the virtual situation unit and the beat frequency of the rhythm guidance unit according to the control signal;

[0012] Remote monitoring unit: used to display the information data stored in the data storage unit and the analysis results of the data processing unit in real time on the remote platform terminal. At the same time, when the results obtained by the data processing unit analysis are abnormal, an alarm is issued to the remote platform terminal.

[0013] Furthermore, the data collection unit includes: a speech rate collection module, a syllable collection module, a pause collection module, a heart rate collection module and a conductivity collection module;

[0014] Speech speed collection module: used to collect speech speed information data of stuttering patients in real time;

[0015] Syllable collection module: used to collect the information data of the number of syllable repetitions of stuttering patients in real time;

[0016] Pause collection module: used to collect the duration information data of the pauses of stuttering patients in real time;

[0017] Heart rate collection module: used to collect heart rate information data of stuttering patients in real time;

[0018] Conductive acquisition module: used to collect skin conductivity information data of stuttering patients in real time.

[0019] Furthermore, the data processing unit includes: a data acquisition module, an analysis and judgment module, a result forwarding module and a signal sending module;

[0020] Data acquisition module: used for real-time acquisition of information data stored in the data storage unit;

[0021] Analysis and judgment module: used to process and analyze the information data obtained by the data acquisition module and obtain the results of analysis and judgment;

[0022] Result forwarding module: used to forward the results of analysis processed by the analysis and judgment module to the remote monitoring unit;

[0023] Signal sending module: used to send control command signals to the intelligent control unit based on the results of analysis and judgment.

[0024] Furthermore, the intelligent control unit includes: a signal receiving module, a difficulty adjustment module and a beat adjustment module;

[0025] Signal receiving module: used to receive the control command signal sent by the signal sending module in real time;

[0026] Difficulty adjustment module: used to intelligently adjust the dialogue difficulty of the virtual situation unit according to the control signal received by the signal receiving module;

[0027] Beat adjustment module: used to intelligently adjust the beat frequency of the rhythm guidance unit according to the control signal received by the signal receiving module.

[0028] Furthermore, the remote monitoring unit includes: a data receiving module, a data display module and an abnormal alarm module;

[0029] Data receiving module: used for receiving the information data stored in the data storage unit and the analysis result information of the data processing unit in real time;

[0030] Data display module: used to display the information data received by the data receiving module on the remote platform terminal display screen;

[0031] Abnormal alarm module: used to send an alarm prompt to the remote platform terminal when the result obtained by the analysis and judgment module is abnormal.

[0032] Furthermore, the analysis and judgment module can obtain the speech speed of the stuttering patient, the number of syllable repetitions of the stuttering patient when speaking, and the duration of the stuttering patient's pauses when speaking from the data acquisition module, and obtain the speech fluency score through the analysis of the above acquired data:

[0033]

[0034] Among them, S is the speech fluency score, T is the total speech duration of the stuttering patient in the VR language communication scenario, and v t is the speech speed of the stuttering patient at the tth second, v eis the average speaking speed of normal people, N is the total number of syllables of stuttering patients in the VR language communication scenario, R i is the number of repetitions of the i-th syllable, M is the total number of pauses of the stuttering patient during the VR language communication scenario, and P j is the duration of the jth pause, P e is the average pause duration of a normal person speaking, and α is the preset conversion coefficient of speech fluency.

[0035] Furthermore, the analysis and judgment module can obtain the heart rate and skin conductivity information data of the stuttering patient from the data acquisition module, and obtain the difficulty coefficient of the virtual scene through the analysis of the above acquired data:

[0036]

[0037] If the current speech fluency score S≤δ, it means that the difficulty coefficient D of the current virtual scene is too high, and the difficulty adjustment module needs to be used to reduce the difficulty of the VR language communication scene in the current virtual scene unit. At the same time, the abnormal alarm module will be triggered to send an alarm prompt to the remote platform terminal, where D is the difficulty coefficient of the virtual scene, Q is the total number of recent historical treatments, and S q is the speech fluency score of the qth treatment, HR q is the average heart rate of stuttering patients in the qth treatment, HR h The upper limit of heart rate for normal people in VR language communication scenarios, HR l k is the lower limit of heart rate during VR language communication for normal people. q is the average skin conductivity of stuttering patients in the qth treatment, k e is the standard skin conductivity of a normal person during a VR language communication scenario, and δ is the threshold parameter for the preset difficulty adjustment.

[0038] Furthermore, the analysis and judgment module can obtain the speech speed information data of the stuttering patient from the data acquisition module, and obtain the speech metronome frequency through the analysis of the above acquired data:

[0039]

[0040] Among them, f is the frequency of the real-time generated speech metronome, v is the normal speaking speed of the stuttering patient, T is the total speech duration of the stuttering patient in the VR language communication scenario, and v t is the speech speed of the stuttering patient at the tth second, v aim is the preset target speaking speed, f 0 is the basic metronome frequency, R is the preset number of historical voice segments collected, ΔS ris the fluency change of the most recent R speech segments, ΔS r =S r -S r-1 , D is the difficulty coefficient of the virtual scene.

[0041] The beneficial effects of the VR-based stuttering treatment auxiliary system of the present invention are: a variety of virtual dialogue scenes are generated for stuttering patients through virtual reality technology, which significantly improves the fun and interactivity of the treatment, and effectively solves the problem that the traditional treatment method is monotonous and difficult to maintain the enthusiasm of patients. The system guides the patient to adjust the speaking rhythm in real time through the voice metronome device, and combines the multimodal data acquisition unit (including speech speed, syllable repetition times, pause duration, heart rate and skin conductivity) to comprehensively monitor the patient's language fluency and physiological state to ensure the scientificity and accuracy of the treatment process. The data processing unit can calculate the voice fluency score and the virtual scene difficulty coefficient in real time according to the collected data, and dynamically adjust the dialogue difficulty and beat frequency through the intelligent control unit to ensure that the treatment difficulty is always matched with the patient's actual ability, avoiding the defects of the traditional method that the treatment difficulty is fixed and cannot adapt to individual differences. In addition, the remote monitoring unit can display the treatment data and results in real time, and issue an alarm in abnormal situations, which is convenient for the therapist to remotely monitor and intervene, further improving the flexibility and operability of the treatment. By simulating diverse communication scenarios in real life, the system can help patients transfer the progress made in treatment directly to real life, significantly improving the durability and universality of treatment effects. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] The present invention is further described in detail below with reference to the accompanying drawings and specific implementation methods.

[0043] Figure 1 This is a schematic diagram of the system principle. DETAILED DESCRIPTION

[0044] The present invention will be described in detail below with reference to the accompanying drawings and in combination with embodiments. It should be noted that the embodiments and features in the embodiments of the present application can be combined with each other without conflict.

[0045] According to one aspect of the present invention, Figure 1 As shown, a VR-based stuttering treatment auxiliary system is provided. First, a virtual situation unit uses VR virtual technology to generate a virtual dialogue scene for stuttering patients. Then, a rhythm guidance unit uses a voice metronome device to emit regular beats to guide patients to adjust their speaking rhythm.

[0046] Then, through the speech speed collection module, syllable collection module, pause collection module, heart rate collection module and conductivity collection module in the data collection unit, the speech speed of the stuttering patient, the number of syllable repetitions of the stuttering patient when speaking, the length of pauses when the stuttering patient speaks, the heart rate of the stuttering patient and the skin conductivity information data of the stuttering patient are collected in real time.

[0047] Then, the collected data is transmitted to the data storage unit in real time through the data transmission unit, and then the information data is obtained from the data storage unit through the data acquisition module in the data processing unit. Further, the obtained information data is processed and analyzed through the analysis and judgment module.

[0048] Afterwards, when the analysis and judgment module finds an abnormal situation in the results of the analysis and judgment, it will trigger the abnormal alarm module to alarm the remote platform control terminal, and will send a control command signal to the intelligent control unit based on the results of the analysis and judgment to intelligently adjust the dialogue difficulty of the virtual situation unit and the beat frequency of the rhythm guidance unit.

[0049] The data receiving module in the remote monitoring unit can receive the information data stored in the data storage unit and the analysis results of the data processing unit in real time, and display the received information data on the remote platform control terminal display screen through the data display module.

[0050] The analysis and judgment module can obtain the speech speed of the stuttering patient, the number of syllable repetitions of the stuttering patient, and the duration of the pauses of the stuttering patient from the data acquisition module, and analyze the above acquired data to obtain the speech fluency score:

[0051]

[0052] Among them, S is the speech fluency score, which is used to quantify the severity of the user's stuttering. The smaller the value, the more fluent the stuttering patient's language expression. T is the total speech duration of the stuttering patient in the VR language communication scenario process. t is the speech speed of the stuttering patient at the tth second, v e is the average speaking speed of normal people, N is the total number of syllables of stuttering patients in the VR language communication scenario, R i is the number of repetitions of the i-th syllable, reflecting the repetitive characteristics of stuttering, M is the total number of pauses of the stuttering patient during the VR language communication scenario, and P j is the duration of the jth pause, P e is the average pause duration of a normal person speaking, and α is the preset conversion coefficient of speech fluency.

[0053] The analysis and judgment module can obtain the heart rate and skin conductivity information data of the stuttering patient from the data acquisition module, and analyze the above acquired data to obtain the difficulty coefficient of the virtual scene:

[0054]

[0055] If the current speech fluency score S≤δ, it means that the difficulty coefficient D of the current virtual scene is too high, and the difficulty adjustment module needs to be used to reduce the difficulty of the VR language communication scene in the current virtual scene unit. At the same time, the abnormal alarm module will be triggered to send an alarm prompt to the remote platform terminal. If the current speech fluency score S>δ, there is no need to adjust the difficulty of the VR language communication scene in the current virtual scene unit. Among them, D is the difficulty coefficient of the virtual scene, and the complexity of the virtual environment can be dynamically adjusted. Q is the total number of recent historical treatments, and S q is the speech fluency score of the qth treatment, HR q is the average heart rate of stuttering patients in the qth treatment, HR h The upper limit of heart rate for normal people in VR language communication scenarios, HR l k is the lower limit of heart rate during VR language communication for normal people. q is the average skin conductivity of stuttering patients in the qth treatment, k e is the standard skin conductivity of a normal person during a VR language communication scenario, and δ is the threshold parameter for the preset difficulty adjustment.

[0056] The analysis and judgment module can obtain the speech speed information data of the stuttering patient from the data acquisition module, and obtain the speech metronome frequency through the analysis of the above acquired data:

[0057]

[0058] Where f is the frequency of the real-time generated voice metronome, which is used to guide the user to adjust the speaking speed, v is the normal speaking speed of the stuttering patient, T is the total speech duration of the stuttering patient in the VR language communication scenario, and v t is the speech speed of the stuttering patient at the tth second, v aim is the preset target speaking rate, f 0 is the basic metronome frequency, R is the preset number of historical voice segments collected, ΔS r is the fluency change of the most recent R speech segments, ΔS r =S r -S r-1 , D is the difficulty coefficient of the virtual scene.

[0059] The above-mentioned embodiment only expresses one implementation mode of the present invention, and its description is relatively specific and detailed, but it cannot be understood as limiting the scope of the patent of the present invention. It should be pointed out that for ordinary technicians in this field, several modifications and improvements can be made without departing from the concept of the present invention, which all belong to the protection scope of the present invention. Therefore, the protection scope of the patent of the present invention shall be based on the attached claims.

Claims

1. A VR-based stuttering treatment auxiliary system, characterized in that: include: Virtual situation unit, rhythm guidance unit, data acquisition unit, data transmission unit, data storage unit, data processing unit, intelligent control unit and remote monitoring unit; Virtual situation unit: used to generate virtual dialogue scenes for stuttering patients through VR virtual technology; Rhythm guidance unit: used to guide patients to adjust their speaking rhythm by emitting regular beats through a voice metronome device; Data collection unit: used to collect real-time information data generated during the stuttering treatment of patients through VR virtual technology; Data transmission unit: used for real-time transmission of information data collected by the data collection unit; Data storage unit: used to store the information data transmitted in real time by the data transmission unit; Data processing unit: used to process and analyze the information data stored in the data storage unit, obtain the processing and analysis results, and then forward the obtained processing and analysis results to the remote monitoring unit, and at the same time issue control instructions to the intelligent control unit according to the processing and analysis results; Intelligent control unit: used to receive the control signal of the data processing unit, and intelligently adjust the dialogue difficulty of the virtual situation unit and the beat frequency of the rhythm guidance unit according to the control signal; Remote monitoring unit: used to display the information data stored in the data storage unit and the analysis results of the data processing unit in real time on the remote platform terminal. At the same time, when the results obtained by the data processing unit analysis are abnormal, an alarm is issued to the remote platform terminal.

2. A VR-based stuttering treatment auxiliary system according to claim 1, characterized in that: The data collection unit includes: a speech rate collection module, a syllable collection module, a pause collection module, a heart rate collection module and a conductivity collection module; Speech speed collection module: used to collect speech speed information data of stuttering patients in real time; Syllable collection module: used to collect the information data of the number of syllable repetitions of stuttering patients in real time; Pause collection module: used to collect the duration information data of the pauses of stuttering patients in real time; Heart rate collection module: used to collect heart rate information data of stuttering patients in real time; Conductive acquisition module: used to collect skin conductivity information data of stuttering patients in real time.

3. A VR-based stuttering treatment auxiliary system according to claim 2, characterized in that: The data processing unit includes: a data acquisition module, an analysis and judgment module, a result forwarding module and a signal sending module; Data acquisition module: used for real-time acquisition of information data stored in the data storage unit; Analysis and judgment module: used to process and analyze the information data obtained by the data acquisition module and obtain the results of analysis and judgment; Result forwarding module: used to forward the results of analysis processed by the analysis and judgment module to the remote monitoring unit; Signal sending module: used to send control command signals to the intelligent control unit based on the results of analysis and judgment.

4. The VR-based stuttering treatment auxiliary system according to claim 3, characterized in that: The intelligent control unit includes: a signal receiving module, a difficulty adjustment module and a beat adjustment module; Signal receiving module: used to receive the control command signal sent by the signal sending module in real time; Difficulty adjustment module: used to intelligently adjust the dialogue difficulty of the virtual situation unit according to the control signal received by the signal receiving module; Beat adjustment module: used to intelligently adjust the beat frequency of the rhythm guidance unit according to the control signal received by the signal receiving module.

5. The VR-based stuttering treatment auxiliary system according to claim 4, characterized in that: The remote monitoring unit includes: a data receiving module, a data display module and an abnormal alarm module; Data receiving module: used for receiving the information data stored in the data storage unit and the analysis result information of the data processing unit in real time; Data display module: used to display the information data received by the data receiving module on the remote platform terminal display screen; Abnormal alarm module: used to send an alarm prompt to the remote platform terminal when the result obtained by the analysis and judgment module is abnormal.

6. The VR-based stuttering treatment auxiliary system according to claim 5, characterized in that: The analysis and judgment module can obtain the speech speed of the stuttering patient, the number of syllable repetitions of the stuttering patient when speaking, and the duration of the stuttering patient's pauses when speaking from the data acquisition module, and obtain the speech fluency score through the analysis of the above acquired data: Among them, S is the speech fluency score, T is the total speech duration of the stuttering patient in the VR language communication scenario, and v t is the speech speed of the stuttering patient at the tth second, v e is the average speaking speed of normal people, N is the total number of syllables of stuttering patients in the VR language communication scenario, R i is the number of repetitions of the i-th syllable, M is the total number of pauses of the stuttering patient during the VR language communication scenario, and P j is the duration of the jth pause, P e is the average pause duration of a normal person speaking, and α is the preset conversion coefficient of speech fluency.

7. The VR-based stuttering treatment auxiliary system according to claim 6, characterized in that: The analysis and judgment module can obtain the heart rate and skin conductivity information data of the stuttering patient from the data acquisition module, and obtain the difficulty coefficient of the virtual scene through the analysis of the above acquired data: If the current speech fluency score S≤δ, it means that the difficulty coefficient D of the current virtual scene is too high, and the difficulty adjustment module needs to be used to reduce the difficulty of the VR language communication scene in the current virtual scene unit. At the same time, the abnormal alarm module will be triggered to send an alarm prompt to the remote platform terminal, where D is the difficulty coefficient of the virtual scene, Q is the total number of recent historical treatments, and S q is the speech fluency score of the qth treatment, HR q is the average heart rate of stuttering patients in the qth treatment, HR h The upper limit of heart rate for normal people in VR language communication scenario, HR1 l k is the lower limit of heart rate during VR language communication for normal people. q is the average skin conductivity of stuttering patients in the qth treatment, k e is the standard skin conductivity of a normal person during a VR language communication scenario, and δ is the threshold parameter for the preset difficulty adjustment.

8. The VR-based stuttering treatment auxiliary system according to claim 7, characterized in that: The analysis and judgment module can obtain the speech speed information data of the stuttering patient from the data acquisition module, and obtain the speech metronome frequency through the analysis of the above acquired data: Among them, f is the frequency of the real-time generated speech metronome, v is the normal speaking speed of the stuttering patient, T is the total speech duration of the stuttering patient in the VR language communication scenario, and v t is the speech speed of the stuttering patient at the tth second, v aim is the preset target speech rate, f0 is the basic metronome frequency, R is the preset number of historical speech segments collected, ΔS r is the fluency change of the most recent R speech segments, ΔS r =S r -S r-1 , D is the difficulty coefficient of the virtual scene.