Speech-voice evaluation and treatment protocol determination software system for speech-voice disorder digital therapeutic device of parkinson's disease patient

Abstract

The present invention relates to a speech-voice evaluation and treatment protocol determination software system for a speech-voice disorder digital therapeutic device of a Parkinson's disease patient and, more specifically, to a speech-voice evaluation and treatment protocol determination software system for a speech-voice disorder digital therapeutic device of a Parkinson's disease patient, which can provide non-pharmacological treatment for a speech-voice disorder. In order to evaluate a speech-voice disorder and provide a user-customized treatment, the present invention may evaluate (diagnose) a speech-voice function of a user for each detailed evaluation item by using a preset automation process for the speech-voice disorder of the user, and provide a treatment protocol to the user for each detailed treatment module on the basis of a result of the evaluation.

Description

Software system for speech-voice evaluation and treatment protocol determination for digital therapeutic devices for speech-voice disorders in Parkinson's disease patients

[0001] The present invention relates to a software system for speech-voice evaluation and treatment protocol determination for a digital therapeutic device for speech-voice disorders in patients with Parkinson's disease, and more specifically, to a software system for speech-voice evaluation and treatment protocol determination for a digital therapeutic device for speech-voice disorders in patients with Parkinson's disease capable of providing non-pharmacological treatment for speech-voice disorders.

[0002] Digital Therapeutics Alliance (DTA) refers to providing evidence-based therapeutic interventions to patients to prevent, manage, or treat medical disorders or diseases through software medical devices. For example, various technologies such as mobile or PC-based applications, virtual reality (VR), augmented reality (AR), games, artificial intelligence (AI), big data, and brain-computer interfaces (BCI) can be used for digital therapeutics. Such digital therapeutics are also referred to as Software as a Medical Device (SaMD), which are ICT-based medical devices in the form of software. These digital therapeutics are being utilized in various fields.

[0003] Meanwhile, since speech-voice disorders can be caused by various diseases and symptoms vary from patient to patient, it is very important to provide a customized treatment protocol for the user (patient) through detailed evaluation rather than a standardized treatment protocol.

[0004] However, existing assessments and treatments for speech-voice disorders are conducted through face-to-face meetings between speech therapists and patients or via video calls. This approach requires significant time and cost for evaluation and relies heavily on the auditory judgment of speech therapists, leading to variations in assessment results among different therapists. Consequently, existing assessments and treatments face significant challenges in providing user- (patient) customized treatment protocols, creating a need for a system for the assessment and treatment of speech-voice disorders utilizing digital therapeutics or SaMD.

[0005] This invention is an application supported by a national research and development project of the Republic of Korea, and detailed information is as follows.

[0006] [National R&D projects that supported this invention]

[0007] Project ID: 2420006363

[0008] Assignment No.: 00506856

[0009] Ministry Name: Ministry of SMEs and Startups

[0010] Project Management (Specialized) Agency Name: Korea Technology Information Promotion Agency for SMEs

[0011] Research Project Name: Technology Innovation Program for Startups (TIPS)

[0012] Research Project Title: Development of an AI-based Speech-Language Digital Therapeutic Device for Parkinson's Disease

[0013] Project Executing Organization Name: Fine Digital Health Co., Ltd.

[0014] Research Period: September 1, 2024 – August 31, 2027

[0015]

[0016] The present invention aims to provide a system, device, server, method, and application for speech-voice disorder assessment and user-customized treatment capable of providing user-customized treatment.

[0017] The present invention aims to provide a system, device, server, method, and application for speech-voice disorder assessment and user-customized treatment capable of providing non-pharmacological treatment services.

[0018] The present invention aims to provide a system, device, server, method, and application for the evaluation of speech-voice disorders and user-customized treatment with improved therapeutic effects and accessibility.

[0019] The present invention aims to provide a system, device, server, method, and application for speech-voice disorder evaluation and user-customized treatment that can provide a user-customized treatment protocol through multidimensional detailed evaluation rather than a standardized treatment protocol.

[0020]

[0021] A system of the present invention for achieving such an objective is characterized by comprising: a user terminal that displays a first image corresponding to first evaluation data and a second image corresponding to second evaluation data, and receives and outputs answer data corresponding to the first evaluation data and voice data corresponding to the second evaluation data; and a server that generates a first treatment protocol based on the answer data and converts the first treatment protocol based on the voice data to generate a second treatment protocol.

[0022] A method of the present invention for achieving such an objective comprises the steps of: displaying a first image corresponding to first evaluation data; displaying a second image corresponding to second evaluation data; collecting answer data corresponding to the first evaluation data; collecting voice data corresponding to the second evaluation data; generating a first treatment protocol based on the answer data; and converting the first treatment protocol based on the voice data to generate a second treatment protocol.

[0023] An application of the present invention for achieving such an objective is an application stored on a computer-readable medium, and is characterized by including instructions that, when executed by a computer system, cause the computer system to perform a method comprising the steps of: displaying a first image corresponding to first evaluation data; displaying a second image corresponding to second evaluation data; collecting answer data corresponding to the first evaluation data; collecting voice data corresponding to the second evaluation data; generating a first treatment protocol based on the answer data; and converting the first treatment protocol based on the voice data to generate a second treatment protocol.

[0024] A computer program of the present invention for achieving such an objective is a computer program stored on a computer-readable medium, and is characterized by including instructions that, when executed by a computer system, cause the computer system to perform a method comprising the steps of: displaying a first image corresponding to first evaluation data; displaying a second image corresponding to second evaluation data; collecting answer data corresponding to the first evaluation data; collecting voice data corresponding to the second evaluation data; generating a first treatment protocol based on the answer data; and converting the first treatment protocol based on the voice data to generate a second treatment protocol.

[0025]

[0026] In order to provide speech-voice disorder evaluation and user-customized treatment, the present invention evaluates (diagnoses) the user's speech-voice function by detailed evaluation item through a preset automated process and provides a treatment protocol to the user by detailed treatment module based on the evaluation results.

[0027] For example, the present invention may generate a first treatment protocol based on user response data for first evaluation data for survey evaluation through a system including a user terminal and a server, determine the difficulty of the first treatment protocol based on user voice data for second evaluation data for recording evaluation or text-reading evaluation, and / or generate a second treatment protocol by modifying (or modifying, changing) at least one treatment module included in the first treatment protocol, and provide the same to the user.

[0028] Accordingly, the present invention can provide non-pharmacological treatment services to users and can significantly improve treatment effectiveness and accessibility for users.

[0029] In addition, the present invention can provide a user-customized treatment protocol through multidimensional detailed evaluation rather than a standardized treatment protocol, thereby significantly improving the efficiency and reliability of treatment.

[0030]

[0031] FIG. 1 is a block diagram of a system according to one embodiment of the present invention.

[0032] FIG. 2 is a block diagram of a system according to one embodiment of the present invention.

[0033] FIG. 3 is a block diagram of a system according to one embodiment of the present invention.

[0034] FIG. 4 is a block diagram of a control unit according to one embodiment of the present invention.

[0035] FIG. 5 is a flowchart of a method according to one embodiment of the present invention.

[0036] FIG. 6 is a conceptual diagram of module assignment based on the survey evaluation and recording evaluation results of a system according to one embodiment of the present invention.

[0037] FIG. 7 is a detailed diagram of the selection of a treatment module according to the evaluation items of a system and the evaluation contents of each speech-voice function sub-item according to an embodiment of the present invention.

[0038]

[0039] The aforementioned objectives, features, and advantages are described in detail below with reference to the attached drawings, thereby enabling those skilled in the art to easily implement the technical concept of the present invention. In describing the present invention, detailed descriptions of known technologies related to the present invention are omitted if it is determined that such descriptions would unnecessarily obscure the essence of the invention. Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the attached drawings. In the drawings, the same reference numerals are used to indicate the same or similar components.

[0040] FIG. 1 is a block diagram of a system (100) according to an embodiment of the present invention.

[0041] For example, FIG. 1 is a block diagram showing a system (100) in a network environment according to various embodiments of the present invention.

[0042] Referring to FIG. 1, a system (100) according to an embodiment of the present invention may include an electronic device (110), a server (120), and a network (130). For example, the electronic device (110) may communicate with the server (120) through the network (130) (e.g., a short-range wireless communication network and / or a long-range wireless communication network) within a network environment. For example, commands or data may be transmitted or received between the electronic device (110) and the server (120) through the network (130). Meanwhile, although not illustrated in FIG. 1, the electronic device (110) may also communicate with other electronic devices through the network (130).

[0043] The electronic device (110) may include a processor (111), a communication module (112), an input module (113), a display module (114), an audio output module (115), an audio module (116), a camera module (117), a subscriber identification module (118), and a memory (119).

[0044] According to an embodiment, a processor (111), a communication module (112), an input module (113), a display module (114), an audio output module (115), an audio module (116), a camera module (117), a subscriber identification module (118), and a memory (119) included in an electronic device (110) may each be electrically and / or physically connected to one another. Meanwhile, although FIG. 1 is illustrated as having an electronic device (110) that includes a processor (111), a communication module (112), an input module (113), a display module (114), an audio output module (115), an audio module (116), a camera module (117), a subscriber identification module (118), and a memory (119), this is merely illustrative and the embodiments of the present invention are not limited thereto. For example, the electronic device (110) may be implemented with some of the above-described components omitted or with additional components other than those described above (e.g., a power management module, a battery, etc.).

[0045] The processor (111) can control at least one other component (e.g., a hardware or software component) of the electronic device (110) connected to the processor (111) by executing software (e.g., a program (119-1)), and can perform various data processing or operations. In one embodiment, as at least part of the data processing or operations, the processor (111) can store commands or data received from other components (e.g., a communication module (112), an input module (113), etc.) in volatile memory, process the commands or data stored in volatile memory, and store the resulting data in non-volatile memory. For example, memory (119) may include volatile memory or non-volatile memory.

[0046] In one embodiment, the processor (111) may include a main processor (e.g., a central processing unit or an application processor) or an auxiliary processor that can operate independently or together with it (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor, etc.). For example, if the electronic device (110) includes a main processor and an auxiliary processor, the auxiliary processor may be configured to use less power than the main processor or to be specialized for a designated function. Depending on the embodiment, the auxiliary processor may be implemented separately from the main processor or as part thereof.

[0047] The processor (111) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence model may be generated through machine learning. Machine learning refers to learning that optimizes parameters with given data using a model composed of multiple parameters. Such learning may be performed, for example, on the electronic device (110) itself where the artificial intelligence is performed, or through a separate server. An artificial intelligence learning paradigm refers to various learning methods and approaches, and may include, for example, supervised learning, unsupervised learning, semisupervised learning, reinforcement learning, self-supervised learning, or transfer learning. An artificial intelligence learning algorithm may include, for example, linear regression, logistic regression, decision trees, random forest, support vector machines (SVM), or artificial neural networks, but is not limited to the examples described above.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a deep convolutional neural network (DCNN), a recurrent neural network (RNN), a generative adversarial network (GAN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), deep Q-networks, a feedforward algorithm, or a combination of two or more of the above, but is not limited to the examples described above. An artificial intelligence model may include multiple artificial neural network layers. In addition to a hardware structure, an artificial intelligence model may additionally or substantially include a software structure.

[0048] The communication module (112) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (110) and a server (120) or an external electronic device (e.g., an electronic device other than the electronic device (110)), and the performance of communication through the established communication channel. The communication module (112) may include one or more communication processors that operate independently of the processor (111) and support direct communication (e.g., wired communication) or wireless communication. In one embodiment, the communication module (112) may include a wireless communication module (e.g., a cellular communication module, a short-range wireless communication module, or a GNSS (global navigation satellite system) communication module) or a wired communication module (e.g., a LAN (local area network) communication module, or a power line communication module). Among these communication modules, the corresponding communication modules can communicate with external electronic devices through a short-range communication network such as Bluetooth, Wi-Fi Direct, or IrDA, or a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., LAN or WAN). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips).

[0049] In one embodiment, the communication module (112) can identify or authenticate an electronic device (110) within a communication network, such as a network (130), using subscriber information stored in a subscriber identification module (118).

[0050] The input module (113) can receive commands or data to be used for a component of the electronic device (110) (e.g., processor (111)) from outside the electronic device (110) (e.g., user, etc.). The input module (113) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen), but is not limited thereto.

[0051] The display module (114) can visually provide information to an external (e.g., user) of the electronic device (110). The display module (114) may include, for example, a display (e.g., a display panel), a holographic device, or a projector, and may further include a control circuit for controlling said device. Additionally, the display module (114) may further include a touch screen to recognize touch input from the user.

[0052] In one embodiment, the display module (114) can display a graphic user interface (GUI) for receiving user input (e.g., touch input).

[0053] The sound output module (115) can output a sound signal to the outside of the electronic device (110). The sound output module (115) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. Depending on the embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0054] The audio module (116) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. In one embodiment, the audio module (116) can acquire sound through an input module (113). Additionally, the audio module (116) can output sound through an audio output module (115) or an external electronic device (e.g., a speaker or headphones) connected directly or wirelessly to the electronic device (110).

[0055] The camera module (117) can capture still images and video. In one embodiment, the camera module (117) may include one or more lenses, image sensors, image signal processors, or flashes, but is not limited thereto.

[0056] The memory (119) can store various data used by at least one component of the electronic device (110) (e.g., processor (111) etc.). The data may include, for example, input data or output data for software (e.g., program (119-1)) and related instructions.

[0057] In one embodiment, memory (119) may store a learned model. For example, at least some of the programs (119-1) stored in memory (119) may be learned models. This learning may be performed, for example, on the electronic device (110) itself where the artificial intelligence is performed (e.g., processor (111), etc.), or through a separate server (e.g., server (120)). Accordingly, the processor (111) may use the learned models by executing the programs (119-1).

[0058] The program (119-1) can be stored as software in memory (119) and may include, for example, an operating system, middleware, or an application.

[0059] Instructions related to the operations of the electronic device (110) may be stored in the memory (119). In one embodiment, at least one of instructions, an algorithm, a data structure, program code, and an application program that can be read by the processor (111) may be stored in the memory (119). The instructions, algorithm, data structure, and program code stored in the memory (119) may be implemented in a programming or scripting language such as, for example, C, C++, Java, assembler, etc., but are not limited thereto.

[0060] In the following embodiments, the processor (111) can be implemented by executing instructions or program codes stored in memory (119).

[0061] FIG. 2 is a block diagram of a system (200) according to an embodiment of the present invention.

[0062] For example, FIG. 2 is a block diagram showing a web service providing system (200) according to various embodiments of the present invention.

[0063] Referring to FIG. 2, the system (200) according to an embodiment of the present invention may be a system that provides web services. For example, the system (200) may be a system for providing a service corresponding to the web applications (221-1, 222-1, …, 22N-1) on a user's electronic device (210) by using web applications (221-1, 222-1, …, 22N-1) stored in a server (220).

[0064] For example, a system (200) according to an embodiment of the present invention may provide a service as a web service to provide a user with an evaluation (diagnosis) related to speech-voice disorders and a user (patient) customized treatment protocol based on the evaluation results as a Digital Therapeutics Alliance (DTA). In this case, the electronic device (210) included in the system (200) may be implemented as a software medical device, but is not limited thereto.

[0065] In one embodiment, the web application (221-1, 222-1, …, 22N-1) may be a cloud application that provides cloud services. The cloud application may include, for example, at least one of a SaaS (software as a service) application that provides SaaS services, a DaaS (desktop as a service) application that provides DaaS services, and an IaaS (infrastructure as a service) application that provides IaaS services, but is not limited thereto.

[0066] Referring to FIG. 2, a system (200) according to an embodiment of the present invention may include at least one server (220).

[0067] In one embodiment, the system (200) may include N (where N is an integer greater than 0) servers (221, 222, …, 22N; 220). For example, the server (220) illustrated in FIG. 2 may be the server (120) described with reference to FIG. 1.

[0068] A server (220) may include (or store) at least one analysis application. For example, each of N servers (221, 222, …, 22N) may include (or store) a corresponding analysis application (221-1, 222-1, …, 22N-1). For example, the analysis application (221-1) stored in the first server (221) may be a SaaS application, and the analysis application (222-1) stored in the second server (222) may be a DaaS application, but this is merely illustrative and the embodiments of the present invention are not limited thereto.

[0069] Additionally, the system (200) according to an embodiment of the present invention may include at least one electronic device (210). For example, the electronic device (210) shown in FIG. 2 may be the electronic device (110) described with reference to FIG. 1.

[0070] The electronic device (210) can access at least one web application (221-1, 222-1, …, 22N-1) included in at least one server (220) through a network (230). For example, the electronic device (210) can use at least one web application (221-1, 222-1, …, 22N-1) included in at least one server (220) through the network (230) using a browser or a dedicated app.

[0071] In one embodiment, the electronic device (210) may include at least one web client application (or, web client) (211). For example, the web client application (211) may provide a browser function for accessing at least one web application (221-1, 222-1, …, 22N-1) included in at least one server (220).

[0072] In one embodiment, the electronic device (210) can use at least one web application (221-1, 222-1, …, 22N-1) included in at least one server (220) through a browser provided by a web client application (211). For example, the electronic device (210) can use at least two web applications included in at least two servers among N servers (221, 222, …, 22N) through a single browser provided by a web client application (211). That is, the electronic device (210) can use multiple web applications through a single browser provided by a web client application (211). In this case, memory usage can be reduced.

[0073] In this way, through the web client application (211), the electronic device (210) can use each web application through the browser provided by the web client application (211) without having to individually install a dedicated app corresponding to each web application within the electronic device (210). Through this, the provider of the web application can reduce the burden of developing a dedicated app, and the user can reduce the burden of installing a dedicated app.

[0074] In one embodiment, a web client application (211) is implemented by at least one processor (e.g., processor (111) of FIG. 1) included in an electronic device (210), and a web application (221-1, 222-1, …, 22N-1) may be implemented by at least one processor included in a server (220).

[0075] Meanwhile, in the present specification, the operation of a user terminal (e.g., the user terminal (310) of FIG. 3) may be expressed as the operation of an electronic device (210) or the operation of at least one processor of an electronic device (210) as the operation of a web client application (211), and the operation of a server (e.g., the server (320) of FIG. 3) may be expressed as the operation of a server (220) or the operation of at least one processor of a server (220) as the operation of a web application (221-1, 222-1, …, 22N-1).

[0076] FIG. 3 is a block diagram of a system (300) according to an embodiment of the present invention.

[0077] FIG. 4 is a block diagram of a control unit (323) according to an embodiment of the present invention.

[0078] Referring to FIG. 3, a system (300) according to an embodiment of the present invention is a system (300) for evaluating speech-voice disorders and providing customized treatment for a user, and can evaluate (diagnose) the speech-voice function of a user (e.g., patient) for each detailed evaluation item through a preset automated process for the speech-voice disorder of a user (e.g., patient), and provide a customized treatment protocol to the user (e.g., patient) for each detailed treatment module based on the evaluation results.

[0079] Meanwhile, speech-voice disorders or diseases may refer to a type of communication disorder that includes articulation disorders (or pronunciation disorders) involving the inaccurate production of speech sounds, fluency disorders involving disfluent speech flow, and voice disorders involving difficulty in vocalization.

[0080] Such speech and voice disorders or diseases frequently occur in patients with Parkinson's disease. Parkinson's disease is one of the representative neurodegenerative diseases, pathologically characterized by the degeneration of dopaminergic neurons within the compact part of the substantia nigra. With the increase in the elderly population, its incidence continues to rise, making it an intractable disease that poses social and economic problems. Furthermore, the severity of Parkinson's disease is highlighted by the fact that, in addition to the elderly population, approximately 20% of patients develop the condition before the age of 50.

[0081] Currently, there is a very high demand for speech-language diagnosis and treatment for Parkinson's disease patients; however, hospitals are not proactive in providing these services due to a shortage of personnel and space, as well as low treatment costs. Furthermore, treatment is not being adequately provided because patients face difficulties in visiting hospitals in person despite their mobility issues.

[0082] Accordingly, the system (300) according to embodiments of the present invention can evaluate a speech-voice disorder of a user (e.g., patient) through an ICT-based medical device in the form of software (Software as a Medical Device; SaMD), e.g., a user terminal (310) and a server (320) communicating therewith, and provide a customized treatment protocol to the user (e.g., patient) based on the evaluation results.

[0083] For example, a user, for example, a patient with Parkinson's disease, receives speech-voice therapy through a video of a treatment protocol displayed via a user terminal (310) (e.g., a display unit (312)), and the patient's input data (e.g., voice data, etc.) generated during the treatment process is input into the user terminal (310) (e.g., an input unit (313)) and transmitted to a server (320) (e.g., a second data collection unit (323)) via network communication and can be stored on the server (320) (e.g., a storage unit (322)). Subsequently, the server (320) (e.g., a control unit (323)) can analyze this and use it to determine the next treatment protocol.

[0084] Accordingly, the system (300) according to the embodiments of the present invention can provide convenience in evaluation (diagnosis) and treatment to a user (e.g., patient), and can provide a customized treatment protocol for the user (patient) through detailed evaluation rather than a standardized treatment protocol.

[0085] To this end, in one embodiment, the system (300) may include a user terminal (310) and a server (320). The user terminal (310) may be implemented as a software medical device, for example, as the electronic device (110) described with reference to FIG. 1 and / or the electronic device (210) described with reference to FIG. 2. Meanwhile, in this specification, the user terminal (310) may be referred to as a patient terminal. Additionally, the server (320) may be implemented as, for example, the server (120) described with reference to FIG. 1 and / or the server (220) described with reference to FIG. 2. For example, the user terminal (310) and the server (320) may operate by transmitting and receiving commands or data through a network, for example, the network (130) of FIG. 1 and / or the network (230) of FIG. 2.

[0086] More specifically, the user terminal (310) may include a first data collection unit (311), a display unit (312), an input unit (313), and a first data transmission unit (314).

[0087] The first data collection unit (311) may receive the first evaluation data and the second evaluation data from the server (320), for example, the second data transmission unit (324) included in the server (320). For example, the first data collection unit (311) may receive the first evaluation data and the second evaluation data through network communication with the server (320).

[0088] Meanwhile, in the present specification, "first evaluation data" refers to data regarding at least one evaluation item (or survey, question) provided to a user (e.g., patient) and can be understood as data for the user's 'survey evaluation', and "second evaluation data" refers to data regarding at least one text (e.g., passage, paragraph, etc.) provided to a user (e.g., patient) and can be understood as data for the user's 'recording evaluation'.

[0089] For example, the first evaluation data may include information regarding at least one evaluation item to be provided to the user regarding speech-voice disorders or diseases. For example, the first evaluation data may include information regarding evaluation items such as whether the intonation is monotonous, whether there is stuttering, whether there is a fast speech rate or inability to speak for a long time, whether there is difficulty eating or drinking, and whether there is difficulty reading long texts, but this is merely illustrative and the first evaluation data may include information regarding various evaluation items.

[0090] For example, the second evaluation data may include data regarding at least one text for a user’s recording evaluation or text-reading evaluation in relation to a speech-voice disorder or disease. As an example, the second evaluation data may include data regarding text concerning monovowels or diphthongs, word text, sentence text, and / or paragraph text, but is not limited thereto.

[0091] Additionally, the first data collection unit (311) may receive a treatment protocol from the server (320), for example, the second data transmission unit (324) included in the server (320).

[0092] The display unit (312) receives first evaluation data and second evaluation data from the first data collection unit (311) and can provide a first image corresponding to the first evaluation data and a second image corresponding to the second evaluation data to the user.

[0093] For example, the display unit (312) may provide the user with a first image (e.g., a still image or a video) on which at least one evaluation question is displayed based on the first evaluation data. For example, the display unit (312) may provide the user with a first image on which, based on the first evaluation data, a first evaluation question regarding whether the intonation is monotonous, a second evaluation question regarding whether there is stuttering, a fast speech rate, or an inability to speak for a long time, a third evaluation question regarding whether there is difficulty eating or drinking food and beverages, and a fourth evaluation question regarding whether there is difficulty reading long texts.

[0094] In an additional embodiment, the display unit (312) may additionally provide the user with a first video in which a fifth evaluation question regarding the user's interests is displayed based on the first evaluation data. For example, the fifth evaluation question may include content regarding what the user's hobbies are, but is not limited thereto.

[0095] According to an embodiment, the display unit (312) may provide each of the first to fourth evaluation questions to the user by configuring them as binary evaluation questions that allow the user to select "Yes" or "No." However, this is merely an example, and the display unit (312) may provide at least one of the first to fourth evaluation questions to the user by configuring it as a multi-parallel evaluation question.

[0096] In an additional embodiment, the display unit (312) may provide the user with a multi-choice selection method that allows the user to select one of a plurality of preset interest contents in relation to a fifth evaluation question regarding the user's interest, but is not limited thereto. For example, the display unit (312) may provide the user with a fifth evaluation question in the form of a subjective answer.

[0097] According to an embodiment, the display unit (312) may sequentially provide a plurality of first images, each displaying first to fourth evaluation questions, to the user. For example, after the display unit (312) provides the first evaluation question to the user, when the user's answer data for the first evaluation question is received (e.g., answer data is received through the input unit (313)), the display unit (312) may provide the second evaluation question to the user and provide the third evaluation question and the fourth evaluation question to the user in a substantially identical or similar manner. However, this is merely illustrative, and the display unit (312) may provide the user with a plurality of first images, each displaying first to fourth evaluation questions, by dividing them on a display screen and displaying them simultaneously, or provide the user with a single first image, each displaying first to fourth evaluation questions, on a display screen.

[0098] In an additional embodiment, the display unit (312) may provide a plurality of first images displaying the first to fifth evaluation questions to the user sequentially or simultaneously.

[0099] Meanwhile, although the display unit (312) has been described above as providing the user with the first to fourth evaluation questions or the first to fifth evaluation questions, this is merely illustrative and the embodiments of the present invention are not limited thereto. For example, at least some of the first to fifth evaluation questions provided to the user by the display unit (312) may be omitted, or various evaluation questions for evaluating speech-voice disorders or diseases may be added and provided to the user.

[0100] Additionally, the display unit (312) may provide the user with a second image (e.g., a still image or a video) in which at least one text is displayed based on the second evaluation data. For example, the display unit (312) may provide the user with a second image in which a first text regarding a monophthong or diphthong for measuring the user's pronunciation time, a second text regarding a monophthong or diphthong for measuring the frequency range of the user's voice, and a third text for measuring the number of syllables the user can pronounce per unit time (e.g., 1 second) are displayed. For example, the third text may be any one of a set of words, a set of sentences, and a set of paragraphs, but is not limited thereto.

[0101] According to an embodiment, the display unit (312) may sequentially provide a plurality of second images, each displaying a first to third text, to the user. For example, after providing the first text to the user, the display unit (312) may provide the second text to the user when voice data of the user regarding the first text is received (e.g., voice data is received through the input unit (313)), and then provide the third text to the user when voice data of the user regarding the second text is received. However, this is merely an example, and the display unit (312) may provide the user with a plurality of second images, each displaying the first to third text, by dividing them on a display screen and displaying them simultaneously, or provide the user with a single second image, each displaying the first to third text, on a display screen.

[0102] Meanwhile, although the display unit (312) has been described above as providing the first to third texts to the user, this is merely illustrative and the embodiments of the present invention are not limited thereto. At least some of the first to third texts provided to the user by the display unit (312) may be omitted, or various texts for recording evaluation or text-reading evaluation of speech-voice disorders or diseases may be added and provided to the user.

[0103] According to an embodiment, the display unit (312) may be implemented as a display module (114) described with reference to FIG. 1 to display a first image based on first evaluation data and / or a second image based on second evaluation data.

[0104] Additionally, the display unit (312) provides at least one content (treatment content; e.g., video) corresponding to the treatment protocol to a user (e.g., patient) according to the treatment protocol provided by the first data collection unit (311), and the user (e.g., patient) can proceed with treatment according to the instructions of the treatment protocol.

[0105] The input unit (313) can receive data input from outside the user terminal (310) (e.g., user) in relation to the image displayed by the display unit (312).

[0106] For example, the input unit (313) may receive answer data regarding evaluation questions displayed in an image corresponding to the first evaluation data displayed by the display unit (312). For example, the input unit (313) may receive first answer data for the first evaluation question, second answer data for the second evaluation question, third answer data for the third evaluation question, and fourth answer data for the fourth evaluation question. In an additional embodiment, the input unit (313) may additionally receive fifth answer data for the fifth evaluation question.

[0107] Additionally, the input unit (313) can receive voice data for text displayed on an image corresponding to the second evaluation data displayed by the display unit (312). For example, the input unit (313) can receive first voice data corresponding to the first text, second voice data corresponding to the second text, and third voice data corresponding to the third text. For example, if there is a user's voice (sound) for at least one text displayed on an image displayed by the display unit (312), the input unit (313) can convert it into an electrical signal to generate voice data.

[0108] According to an embodiment, the input unit (313) may be implemented as an input module (113) and / or audio module (116) described with reference to FIG. 1 to receive answer data and / or voice data from outside (e.g., user) of the user terminal (310).

[0109] Additionally, the input unit (313) can receive various data, such as text data and voice data, generated according to the progress of treatment of a user (e.g., patient) according to at least one content (treatment content; e.g., video) corresponding to a treatment protocol. Hereinafter, the various data generated according to the progress of treatment described above may be referred to as "feedback data."

[0110] The first data transmission unit (314) can transmit data input (received) to the input unit (313) to an external source, for example, a server (320). For example, the first data transmission unit (314) can transmit answer data, voice data, and / or feedback data generated according to the progress of treatment of a user (e.g., patient) input through the input unit (313) to the server (320) via a network (e.g., the network (130) of FIG. 1 and / or the network (230) of FIG. 2).

[0111] Next, the server (320) may include a second data collection unit (321), a storage unit (322), a control unit (323), and a second data transmission unit (324).

[0112] The second data collection unit (321) can receive various data transmitted from the first data transmission unit (314) included in the user terminal (310), for example, the user terminal (310), and store it in the storage unit (322). For example, the second data collection unit (321) can receive answer data, voice data, and / or feedback data generated according to the progress of treatment of the user (e.g., patient) transmitted from the first data transmission unit (314) through network communication with the user terminal (310), and store it in the storage unit (322).

[0113] Additionally, the storage unit (322) may have evaluation data provided to the user, for example, first evaluation data and second evaluation data stored in it.

[0114] Additionally, the storage unit (322) can store a treatment protocol provided to the user, for example, a treatment protocol transmitted to the user terminal (310) as a treatment protocol determined by the operation of the control unit (323). For example, a plurality of treatment protocols provided to the user according to the treatment stage may be sequentially stored on the storage unit (322).

[0115] The control unit (323) can determine a treatment protocol based on the answer data and voice data provided from the second data collection unit (321) and / or storage unit (322).

[0116] For a more detailed explanation of the control unit (323), referring together with FIG. 4, the control unit (323) may include a first evaluation unit (3231), a first treatment protocol determination unit (3232), a second evaluation unit (3233), and a second treatment protocol determination unit (3234).

[0117] The first evaluation unit (3231) can analyze the first evaluation data, for example, the first to fifth answer data of a user (e.g., patient) for each of the first to fifth evaluation questions, and generate and / or output analysis result data for each.

[0118] For example, the first evaluation unit (3231) may include a first sub-evaluation unit (3231A) for analyzing first answer data, a second sub-evaluation unit (3231B) for analyzing second answer data, a third sub-evaluation unit (3231C) for analyzing third answer data, a fourth sub-evaluation unit (3231D) for analyzing fourth answer data, and a fifth sub-evaluation unit (3231E) for analyzing fifth answer data.

[0119] For example, the first sub-evaluation unit (3231A) may generate first analysis result data regarding whether the intonation is monotonous based on the first answer data, the second sub-evaluation unit (3231B) may generate second analysis result data regarding whether there is stuttering, a fast speech rate, or an inability to speak for a long time based on the second answer data, the third sub-evaluation unit (3231C) may generate third analysis result data regarding whether there is difficulty eating or drinking food and beverages based on the third answer data, and the fourth sub-evaluation unit (3231D) may generate fourth analysis result data regarding whether there is difficulty reading long texts based on the fourth answer data. Additionally, in an additional embodiment, the fifth sub-evaluation unit (3231E) may generate fifth analysis result data regarding the user's interests based on the fifth answer data.

[0120] The first treatment protocol determination unit (3232) can generate the first treatment protocol (TP1) by selecting at least one treatment module most suitable for the user (patient) from among a plurality of treatment modules pre-set for each detailed item of speech-voice function based on the content evaluated by the first evaluation unit (3231). For example, the plurality of treatment modules may include a basic module, an intonation module, a speech rate control module, a swallowing module, and a literacy module.

[0121] Meanwhile, in this specification, the term "treatment module" corresponds to treatment or training included in a single treatment protocol provided to a user (e.g., a patient), and may also be referred to as a treatment, training, or training module. For example, the treatment content included in the treatment protocol for each module—such as the basic module, intonation module, speech rate control module, swallowing module, and illiteracy module—may differ, as may include treatment training content such as warm-up exercises, voice pitch, and speech practice. For example, in the case of the intonation module, voice pitch and speech practice differ from those of the basic module; for instance, the intonation module may be configured as treatment training that includes tasks such as reading interrogative sentences or tasks where the range of voice pitch is relatively wider than that of the basic module. As another example, the speech rate control module may be configured as treatment training that induces the user (e.g., a patient) to adjust their speech rate to speak at a preset speed during speech practice. As yet another example, the swallowing module may be configured as treatment training that includes exercises to strengthen the muscles required for eating or drinking human food and beverages. As another example, in the case of the illiteracy module, the word texts, sentence texts, and / or paragraph texts that serve as the targets of speech practice are configured differently and can be set up as therapeutic training that includes tasks such as repeating or describing pictures. Additionally, multiple therapeutic modules may include various therapeutic activities such as instructional videos, quizzes, and self-assessments, in addition to the aforementioned therapeutic training.

[0122] For example, the first treatment protocol determination unit (3232) may select at least one treatment module among a basic module, an intonation module, a speech rate control module, a swallowing module, and a literacy module based on analysis result data provided from the first evaluation unit (3231), for example, first to fourth analysis result data provided from the first to fourth sub-evaluation units (3231A to 3231D).

[0123] In one embodiment, the first treatment protocol determination unit (3232) can generate a first treatment protocol (TP1) by determining whether to activate each of the basic module, intonation module, speech rate control module, swallowing module, and illiteracy module based on analysis result data provided from the first evaluation unit (3231).

[0124] For example, the first treatment protocol determination unit (3232) can generate a first treatment protocol (TP1) corresponding to the basic module when it is determined, based on the first to fourth analysis result data, that the user (e.g., patient) does not have symptoms corresponding to each of the first to fourth evaluation items. For example, the first treatment protocol determination unit (3232) can generate a first treatment protocol (TP1) in which the basic module is activated and the intonation module, speech rate control module, swallowing module, and literacy module are deactivated when it is determined, based on the first to fourth analysis result data, that the user (e.g., patient) does not have any symptoms such as monotonous intonation, stuttering, fast speech rate, inability to speak for long periods, difficulty eating or drinking, or difficulty reading long texts.

[0125] Additionally, the first treatment protocol determination unit (3232), based on the first to fourth analysis result data, may deactivate the basic module and activate at least one treatment module among the intonation module, speech rate control module, swallowing module, and illiteracy module if the user (e.g., patient) has at least one of the multiple symptoms corresponding to the first to fourth evaluation items, for example, symptoms of monotonous intonation, symptoms of stuttering or fast speech rate or inability to speak for a long time, symptoms of difficulty eating or drinking, and symptoms of difficulty reading long texts.

[0126] For example, the first treatment protocol determination unit (3232) may activate an intonation module if it is determined that there is a symptom of monotonous intonation corresponding to the first evaluation item based on the first analysis result data, activate a speech speed control module if it is determined that there is a symptom of stuttering, fast speech speed, or inability to speak for a long time corresponding to the second evaluation item based on the second analysis result data, activate a swallowing module if it is determined that there is a symptom of difficulty eating or drinking food and beverages corresponding to the third evaluation item based on the third analysis result data, and activate a literacy module if it is determined that there is a symptom of difficulty reading long texts corresponding to the fourth evaluation item based on the fourth analysis result data.

[0127] In this way, if the first treatment protocol determination unit (3232) determines that the user (e.g., patient) has at least one of the multiple symptoms corresponding to the first to fourth evaluation items, it can generate a first treatment protocol (TP1) by selecting and activating at least one treatment module from a group consisting of an intonation module, a speech rate control module, a swallowing module, and a literacy module. That is, the intonation module, the speech rate control module, the swallowing module, and the literacy module can be selected and activated in duplicate to generate the first treatment protocol (TP1).

[0128] In one embodiment, the first treatment protocol determining unit (3232) may determine the content (content) of the word text, sentence text, and / or paragraph text used for speech practice included in the treatment content used in the first treatment protocol (TP1), based on the fifth analysis result data provided from the first evaluation unit (3231), e.g., the fifth sub-evaluation unit (3231E). For example, the first treatment protocol determining unit (3232) may generate the first treatment protocol (TP1) comprising treatment content consisting of word text, sentence text, and / or paragraph text related to the content of interest of the user (e.g., patient), based on the fifth analysis result data.

[0129] The second evaluation unit (3233) can analyze voice data for the second evaluation data, for example, the first to third voice data of a user (e.g., patient) for each of the first to third texts, and generate and / or output analysis result data for each.

[0130] For example, the second evaluation unit (3233) may include a sixth sub-evaluation unit (3233A) that analyzes the first voice data, a seventh sub-evaluation unit (3233B) that analyzes the second voice data, and an eighth sub-evaluation unit (3233C) that analyzes the third voice data.

[0131] For example, the 6th sub-evaluation unit (3233A) can generate 6th analysis result data by measuring and / or extracting the user's utterance time for the 1st text based on the user's 1st voice data for the 1st text composed of a single vowel or a diphthong. Additionally, the 7th sub-evaluation unit (3233B) can generate 7th analysis result data by measuring and / or extracting the frequency range of the user's voice for the 2nd text based on the user's 2nd voice data for the 2nd text composed of a single vowel or a diphthong. Additionally, the 8th sub-evaluation unit (3233C) can generate 8th analysis result data by measuring and / or extracting the number of syllables the user can pronounce per unit time (e.g., 1 second) based on the user's 3rd voice data for the 3rd text composed of a word set, a sentence set, and / or a paragraph set (e.g., the average value of the number of syllables).

[0132] The second treatment protocol determination unit (3234) can determine the difficulty level (high, medium, low) of the treatment protocol for the first treatment protocol (TP1) generated by the first treatment protocol determination unit (3232) based on the content evaluated by the second evaluation unit (3233), and / or generate the second treatment protocol (TP2) by modifying (or modifying, changing) at least one treatment module included in the first treatment protocol (TP1).

[0133] For example, the second treatment protocol determination unit (3234) can determine the difficulty of the treatment protocol (e.g., the second treatment protocol (TP2)) based on the sixth analysis result data provided from the sixth sub-evaluation unit (3233A). For example, if the user's phonation time falls within the first range based on the sixth analysis result data, the second treatment protocol determining unit (3234) generates a second treatment protocol (TP2) composed of word text (e.g., generates a second treatment protocol (TP2) of the first difficulty level), if the user's phonation time falls within the second range greater than the first range based on the sixth analysis result data, the second treatment protocol determining unit (3234) generates a second treatment protocol (TP2) composed of sentence text (e.g., generates a second treatment protocol (TP2) of the second difficulty level), and if the user's phonation time falls within the third range greater than the second range based on the sixth analysis result data, the second treatment protocol determining unit (3234) can generate a second treatment protocol (TP2) composed of paragraph text (e.g., generates a second treatment protocol (TP2) of the third difficulty level).

[0134] Additionally, the second treatment protocol determination unit (3234) can generate a second treatment protocol (TP2) by modifying (or modifying, changing) at least one treatment module included in the first treatment protocol (TP1) based on the seventh analysis result data and the eighth analysis result data provided from the seventh sub-evaluation unit (3233B) and the eighth sub-evaluation unit (3233C).

[0135] For example, if the frequency range of the user's voice does not meet the preset range based on the seventh analysis result data, the second treatment protocol determining unit (3234) may generate the second treatment protocol (TP2) by additionally activating the intonation module in the first treatment protocol (TP1). Here, if the first treatment protocol (TP1) is configured to include a basic module, the second treatment protocol determining unit (3234) may generate the second treatment protocol (TP2) by deactivating the basic module and activating the intonation module in the first treatment protocol (TP1).

[0136] Additionally, based on the eighth analysis result data, if the number of syllables that the user can pronounce per unit time (e.g., 1 second) (e.g., average value of the number of syllables) is less than a preset value, the second treatment protocol determining unit (3234) may generate the second treatment protocol (TP2) by additionally activating the speech rate module. Here, if the first treatment protocol (TP1) is configured to include a basic module, the second treatment protocol determining unit (3234) may generate the second treatment protocol (TP2) by deactivating the basic module in the first treatment protocol (TP1) and activating the speech rate module.

[0137] Meanwhile, although the above description is based on the system (300) using first evaluation data for survey evaluation and second evaluation data for recording evaluation or text-reading evaluation as evaluation data for speech-voice functions, the embodiments of the present invention are not limited thereto. For example, the system (300) may use evaluation data such as education or quizzes.

[0138] Referring again to FIG. 3, the second treatment protocol (TP2) generated from the control unit (323), for example, the second treatment protocol determination unit (3234), can be provided to the second data transmission unit (324).

[0139] The second data transmission unit (324) can provide the first evaluation data and the second evaluation data to the user terminal (310). For example, the second data transmission unit (324) can provide the first evaluation data and the second evaluation data stored on the storage unit (322) to the first data collection unit (311) of the user terminal (310) via network communication.

[0140] Additionally, the second data transmission unit (324) provides data regarding a treatment protocol determined and / or generated by the control unit (323) to the user terminal (310), and the user terminal (310) can provide a treatment (treatment content) corresponding to the treatment protocol to the user based thereon.

[0141] Additionally, the second data transmission unit (324) provides data regarding the degree of improvement before and after treatment, the user's (e.g., patient's) treatment compliance, etc., to the user terminal (310) based on feedback data generated according to the progress of treatment of the user (e.g., patient), and the user terminal (310) can provide the data to the user through the display unit (312).

[0142] According to an embodiment, the server (320), for example, the control unit (323), can modify (update) the treatment protocol, for example, the second treatment protocol (TP2), based on feedback data generated as the user (e.g., patient) progresses with treatment.

[0143] For example, the system (300) may proceed with a process to evaluate (diagnose) the aforementioned speech-voice function before treatment based on the treatment protocol is performed for each treatment session, generate response data and / or voice data from the user terminal (310), and generate a treatment protocol, for example, a second treatment protocol (TP2), based on the response data and / or voice data through the server (320).

[0144] As another example, the system (300) may modify at least some of the treatment modules included in the determined second treatment protocol (TP2) based on feedback data generated during the treatment process based on the initially determined treatment protocol, e.g., the second treatment protocol (TP2), and provide them to the user by reflecting the degree of improvement of the user (e.g., patient) and the treatment compliance of the user (e.g., patient).

[0145] According to an embodiment, the user terminal (310) may additionally include a user authentication module (e.g., subscriber identification module (118) of FIG. 1) to perform identity verification operations for the user, and the server (320) may additionally include a user management module to perform user management operations such as registration, change, and cancellation for a user (e.g., patient) receiving a treatment protocol provision service.

[0146] Meanwhile, the operation of such a system (300) may be performed periodically according to a preset cycle. For example, a user (e.g., patient) may undergo treatment a preset number of times (e.g., 4 times per week) for a preset specific period (e.g., 5 weeks) according to a treatment protocol determined (or generated) in accordance with the operation of the system (300), and after the preset specific period has passed, the system (300) may perform at least some of the aforementioned speech-voice function evaluations (e.g., recording evaluation, text-reading evaluation) on the user (e.g., patient) and provide a result report.

[0147] Meanwhile, although a patient with Parkinson's disease has been described above as an example of a user, this is merely illustrative and the embodiments of the present invention are not limited thereto. For example, the system (300) according to an embodiment of the present invention may provide speech-voice disorder evaluation and user-customized treatment services to users other than patients with Parkinson's disease, such as patients with other neurological diseases (e.g., cerebrovascular disease, dementia, etc.) or elderly people without specific diseases.

[0148] FIG. 5 is a flowchart of a method according to an embodiment of the present invention.

[0149] Referring to FIGS. 1 through 5, in one embodiment, the method of FIG. 5 is a method for providing speech-voice disorder evaluation and user-customized treatment services, and may be substantially identical to the operation of the system (300) described with reference to FIGS. 1 through 5. For example, the method of FIG. 5 may be performed on the system (300) of FIG. 3. Accordingly, redundant descriptions will not be repeated.

[0150] Referring to FIG. 5, the method of FIG. 5 may include the step of collecting response data for the first evaluation data (S510). For example, the step of collecting response data for the first evaluation data (S510) may be substantially the same or similar to the operation in which a first data collection unit (311) included in the user terminal (310) described with reference to FIG. 3 receives the first evaluation data from a server (320), a display unit (312) included in the user terminal (310) provides an image corresponding to the first evaluation data to the user, and an input unit (313) included in the user terminal (310) receives response data from the user.

[0151] Additionally, the method of FIG. 5 may include the step of collecting voice data for the second evaluation data (S520). For example, the step of collecting voice data for the second evaluation data (S520) may be substantially the same or similar to the operation in which a first data collection unit (311) included in the user terminal (310) described with reference to FIG. 3 receives the second evaluation data from the server (320), a display unit (312) included in the user terminal (310) provides an image corresponding to the second evaluation data to the user, and an input unit (313) included in the user terminal (310) receives voice data from the user.

[0152] Additionally, the method of FIG. 5 may include the step of generating a first treatment protocol (S530). For example, the step of generating a first treatment protocol (S530) may be substantially the same or similar to the operation in which a second data collection unit (321) included in the server (320) described with reference to FIG. 3 and FIG. 4 receives response data from a user terminal (310), and a control unit (323) generates a first treatment protocol (TP1) based on the response data.

[0153] Additionally, the method of FIG. 5 may include the step of generating a second treatment protocol (S540). For example, the step of generating a second treatment protocol (S540) may be substantially the same or similar to the operation in which a second data collection unit (321) included in the server (320) described with reference to FIG. 3 and FIG. 4 receives voice data from a user terminal (310), and a control unit (323) determines the difficulty of the first treatment protocol (TP1) based on the voice data, and / or generates a second treatment protocol (TP2) by modifying (or changing, altering) at least one treatment module included in the first treatment protocol (TP1).

[0154] Additionally, the method of FIG. 5 may include the step of providing a treatment protocol to a user (S550). For example, the step of providing a treatment protocol to a user (S550) may be substantially the same or similar to the operation in which a treatment protocol generated from the control unit (323), for example, a second treatment protocol (TP2), is provided to the user terminal (310) and provided to the user by the display unit (312) of the user terminal (310).

[0155] FIG. 6 is a conceptual diagram of module assignment based on the survey evaluation and recording evaluation results of a system according to one embodiment of the present invention.

[0156] FIG. 7 is a detailed diagram of the selection of a treatment module according to the evaluation items of a system and the evaluation contents of each speech-voice function sub-item according to an embodiment of the present invention.

[0157] Referring to Figures 6 and 7, a survey is first conducted to select a module for each user. The survey asks about monotony of intonation, fast speech speed, stuttering, or inability to speak for long periods, difficulty with eating or drinking, and difficulty reading long texts. If there are no problems with any of these, the user is assigned to the basic module; if there is monotony of intonation, the user is assigned to the intonation module; if there is no monotony of intonation but fast speech speed, stuttering, or inability to speak for long periods, the user is assigned to the speech speed control module; if there are no problems with intonation or speech speed but difficulty with eating and drinking, the user is assigned to the swallowing module; and if there are no problems with eating and drinking but difficulty reading long texts, the user is assigned to the illiteracy module. Multiple modules can be assigned. For example, if a user responds to the survey stating that they have difficulty with eating and drinking and difficulty reading long texts, both the swallowing module and the illiteracy module may be assigned. In the final item of the survey, the patient is asked to select multiple interests, which are then reflected in determining the content of the words and sentences to be read during speech practice.

[0158] In the recording evaluation following the survey assessment, the first step involves measuring the phonation time during vowel sustain, and the difficulty level of treatment is determined based on this result. The patient's treatment goals vary depending on the difficulty level. For example, the goal for a high difficulty level might be reading long paragraphs, while the goal for a low difficulty level might be reading individual words. Secondly, the pitch range is measured through the voice's frequency range during vowel pronouncements from low to high pitches; if the set value is not met, even a patient previously assigned to the basic module is reassigned to the intonation module. Thirdly, the number of syllables per second is measured during paragraph reading; if the set value is not met, the speech rate control module is assigned. As with the survey assessment, multiple modules can be assigned simultaneously.

[0159] A personalized treatment protocol is finally determined through the process described above.

[0160] In common, all users are provided with visual and auditory stimuli through a screen to assist with vocalization and speech during the first week of treatment, but as the weeks progress, the stimuli are gradually reduced so that users develop the ability to reach the treatment goal of vocalization and speech on their own without cues.

[0161] Meanwhile, the various embodiments according to the present invention described above may be implemented in the form of program instructions that can be executed through various computer components and recorded on a computer-readable recording medium. The computer-readable recording medium may include program instructions, data files, data structures, etc., either individually or in combination. The program instructions recorded on the computer-readable recording medium may be those specifically designed and configured for the present invention, or they may be those known and available to those skilled in the art of computer software. Examples of computer-readable recording media may include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical recording media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, and flash memory. Examples of program instructions may include machine code, such as that generated by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc. The hardware device may be configured to operate as one or more software modules to perform processing according to the present invention, and vice versa.

[0162] Meanwhile, at least some of the methods described above (e.g., the method of FIG. 5) may be implemented by hardware, software, firmware, middleware, microcode, a hardware description language, or a combination of two or more of the above. Where at least some of the methods described above are implemented by software, firmware, middleware, or microcode, program code or code segments for performing the necessary tasks may be stored on a machine or computer-readable medium, such as a storage medium, thereby enabling a processor to perform the necessary tasks.

[0163] In order to provide speech-voice disorder evaluation and user-customized treatment, the present invention evaluates (diagnoses) the user's speech-voice function by detailed evaluation item through a preset automated process and can provide a treatment protocol to the user by detailed treatment module based on the evaluation results.

[0164] For example, the present invention may generate a first treatment protocol based on user response data for first evaluation data for survey evaluation through a system including a user terminal and a server, determine the difficulty of the first treatment protocol based on user voice data for second evaluation data for recording evaluation or text-reading evaluation, and / or generate a second treatment protocol by modifying (or modifying, changing) at least one treatment module included in the first treatment protocol, and provide the same to the user.

[0165] Accordingly, the present invention can provide non-pharmacological treatment services to users and can improve treatment effectiveness and accessibility for users.

[0166] In addition, the present invention can provide a user-customized treatment protocol through multidimensional detailed evaluation rather than a standardized treatment protocol.

[0167] Although the present invention has been described above with reference to embodiments thereof, those skilled in the art will understand that various modifications and changes can be made to the present disclosure without departing from the spirit and scope of the disclosure as set forth in the claims.

[0168]

[0169] [Explanation of the symbol]

[0170] 100, 200, 300: System

[0171] 111: Processor

[0172] 112: Communication module

[0173] 113: Input Module

[0174] 114: Display Module

[0175] 115: Audio output module

[0176] 116: Audio Module

[0177] 117: Camera module

[0178] 118: Subscriber Identification Module

[0179] 119: Memory

[0180] 110, 210: Electronic devices

[0181] 120, 220: Server

[0182] 130, 230: Network

[0183] 310: User terminal

[0184] 311: 1st Data Collection Unit

[0185] 312: Display unit

[0186] 313: Input section

[0187] 314: 1st Data Transmission Unit

[0188] 320: Server

[0189] 321: 2nd Data Collection Unit

[0190] 322: Storage section

[0191] 323: Control unit

[0192] 3231: 1st Evaluation Department

[0193] 3232: 1st Treatment Protocol Determination Unit

[0194] 3233: 2nd Evaluation Department

[0195] 3234: 2nd Treatment Protocol Decision Unit

[0196] 324: Second data transmission unit

[0197]

[0198] The present invention evaluates (diagnoses) a user's speech-voice function according to detailed evaluation items through a preset automated process for speech-voice disorders, and provides a treatment protocol to the user according to detailed treatment modules based on the evaluation results. Accordingly, the present invention can provide non-pharmacological treatment services to the user and significantly improve the treatment effectiveness and accessibility for the user. Furthermore, the present invention can provide a user-customized treatment protocol through multi-dimensional detailed evaluation rather than a standardized treatment protocol, thereby significantly improving the efficiency and reliability of treatment. Therefore, the present invention is widely applicable in related medical industries, including the medical device industry, and thus has industrial applicability.

Claims

1. A user terminal that displays a first image corresponding to first evaluation data and a second image corresponding to second evaluation data, and receives and outputs answer data corresponding to the first evaluation data and voice data corresponding to the second evaluation data; and A system comprising a server that generates a first treatment protocol based on the above-mentioned answer data and converts the first treatment protocol based on the above-mentioned voice data to generate a second treatment protocol.

2. In Paragraph 1, A system in which the server determines the difficulty of at least one treatment module included in the first treatment protocol based on the answer data and determines whether the at least one treatment module included in the first treatment protocol is activated to generate the second treatment protocol.

3. In Paragraph 1, The above first evaluation data includes information on at least one evaluation item, and Information regarding at least one evaluation item above includes evaluation items regarding whether the intonation is monotonous, whether there is stuttering, whether there is a fast speech rate or inability to speak for a long time, whether there is difficulty eating or drinking, and whether there is difficulty reading long texts, a system.

4. In Paragraph 1, The above second evaluation data includes information on at least one text for a user's text-reading evaluation, and Information regarding at least one of the above texts includes text relating to a monophthong or a diphthong, in a system.

5. In Paragraph 1, A system in which the server generates at least one analysis result data based on the answer data, and selects one of a plurality of treatment modules based on the at least one analysis result data to generate the first treatment protocol.

6. In Paragraph 5, The above plurality of treatment modules include a basic module, an intonation module, a speech rate control module, a swallowing module, and a literacy module, and The above server is, (i) Activate the above basic module and deactivate the above intonation module, the above speech speed control module, the above swallowing module and the above illiteracy module, or (ii) A system that generates a first treatment protocol by deactivating the basic module and activating at least one of the intonation module, the speech rate control module, the swallowing module and the illiteracy module.

7. In Paragraph 5, The above server is a system that determines the content of any one of word text, sentence text, and paragraph text included in the first treatment protocol based on at least one analysis result data.

8. In Paragraph 2, A system in which the server extracts the user’s pronunciation time for a first text composed of a monophthong or a diphthong based on the voice data, and determines the difficulty of the at least one treatment module included in the first treatment protocol based on the user’s pronunciation time.

9. In Paragraph 2, A system in which the server extracts the frequency range of a user's voice for a second text composed of a monophthong or a diphthong based on the voice data, and determines whether to activate the at least one treatment module included in the first treatment protocol based on the frequency range of the user's voice.

10. In Paragraph 2, A system in which the server extracts the number of syllables pronounced by the user per unit time for a third text based on the voice data, and determines whether to activate the at least one treatment module included in the first treatment protocol based on the number of syllables pronounced by the user per unit time.

11. In Paragraph 1, The above user terminal is a system that displays treatment content corresponding to the second treatment protocol.

12. In Paragraph 1, The above user terminal provides feedback data regarding the treatment result according to the above second treatment protocol to the server, and The above server is a system that modifies at least one part of at least one treatment module included in the second treatment protocol based on the feedback data.

13. A step of displaying a first image corresponding to the first evaluation data; A step of displaying a second image corresponding to the second evaluation data; A step of collecting answer data corresponding to the first evaluation data above; A step of collecting voice data corresponding to the second evaluation data above; A step of generating a first treatment protocol based on the above answer data; and A method comprising the step of converting the first treatment protocol based on the voice data to generate a second treatment protocol.

14. An application stored on a computer-readable medium, which, when executed by a computer system, the computer system, A step of displaying a first image corresponding to the first evaluation data; A step of displaying a second image corresponding to the second evaluation data; A step of collecting answer data corresponding to the first evaluation data above; A step of collecting voice data corresponding to the second evaluation data above; A step of generating a first treatment protocol based on the above answer data; and An application comprising instructions for performing a method including the step of converting the first treatment protocol based on the voice data to generate a second treatment protocol.

Images