Oral cavity function evaluation method, oral cavity function evaluation device, and program

The oral function evaluation method automates the assessment of speech and oral function by analyzing audio information, simplifying the process and providing detailed evaluations of speech parameters.

JP7592948B2Active Publication Date: 2024-12-03EXAWIZARDS INC
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2023044665
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2023-03-20
Publication Date
2024-12-03
Estimated Expiration
2043-03-20

AI Technical Summary

Technical Problem

Conventional oral diadochokinesis requires the person being evaluated to utter each syllable and count the number of times, burdening both the assessee and the evaluator.

Method used

An oral function evaluation method that includes acquiring audio information of a person repeating a predetermined phrase with multiple syllables, evaluating the utterance based on this information, and automatically assessing speech and oral function using an evaluation system.

Benefits of technology

Enables easy performance of oral diadochokinesis by eliminating the need for manual counting and allows detailed evaluation of multiple speech and oral function parameters.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007592948000001
    Figure 0007592948000001
  • Figure 0007592948000002
    Figure 0007592948000002
  • Figure 0007592948000003
    Figure 0007592948000003
Patent Text Reader

Abstract

To enable oral diadochokinesis to be easily performed.SOLUTION: An oral function evaluation method executed by an oral function evaluation system includes: acquisition processing for acquiring voice information obtained by repeatedly uttering a prescribed phrase including a plurality of syllables by an evaluation object person; and evaluation processing for evaluating the utterance on the basis of the voice information.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an oral cavity function evaluation method, an oral cavity function evaluation device, and a program. [Background technology]

[0002] Oral diadochokinesis is a method for evaluating oral function. In oral diadochokinesis, the oral function of a person is evaluated based on how many times the person can repeatedly utter a single syllable, such as "pa," "ta," or "ka," in 10 seconds.

[0003] When performing oral diadochokinesis, the assessor counts the number of "pa"s spoken, for example, by marking dots on a piece of paper with a writing implement in time with the subject's speech. Cited Document 1 also discloses a technology that automatically counts the number of "pa"s by using speech recognition on the speech data spoken by the subject. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2013-235134 A Summary of the Invention [Problem to be solved by the invention]

[0005] In conventional oral diadochokinesis, the subject had to speak each syllable, such as "pa," "ta," and "ka," and the number of times each was counted. In other words, three utterances and three counts were required. This was a burden for both the subject and the evaluator.

[0006] The present invention has been made in consideration of the above problems, and aims to make oral diadochokinesis easily performable. [Means for solving the problem]

[0007] An oral function evaluation method in one embodiment is an oral function evaluation method executed by an oral function evaluation system, and includes an acquisition process that acquires audio information in which a person being evaluated repeatedly speaks a predetermined phrase containing multiple syllables, and an evaluation process that evaluates the speech based on the audio information. Effect of the Invention

[0008] According to one embodiment, oral diadochokinesis can be easily performed. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of an oral cavity function evaluation system. [Diagram 2] FIG. 2 illustrates an example of a hardware configuration of an information processing device. [Diagram 3] FIG. 2 is a diagram illustrating an example of a functional configuration of an oral cavity function evaluation apparatus. [Figure 4] FIG. 11 is a diagram showing an example of evaluation result information. [Diagram 5] 13 is a flowchart illustrating an example of processing executed by the oral cavity function evaluation system. [Figure 6] FIG. 11 is a diagram illustrating an example of voice information. [Figure 7] FIG. 13 is a diagram showing an example of an evaluation result display screen. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, each embodiment of the present invention will be described with reference to the accompanying drawings. In the description of the specification and drawings of each embodiment, components having substantially the same functional configuration are designated by the same reference numerals, and redundant description will be omitted.

[0011] <Configuration of oral function evaluation system> First, an overview of the oral function evaluation system (hereinafter referred to as the "evaluation system") according to this embodiment will be described. The evaluation system according to this embodiment is an information processing system for performing oral diadochokinesis. Oral diadochokinesis is a test for evaluating the oral function of a person being evaluated by having the person being evaluated repeatedly speak syllables such as "pa," "ta," and "ka," and observing the person's speech. Oral diadochokinesis is performed, for example, in medical institutions, nursing homes, rehabilitation facilities, and at home.

[0012] In this embodiment, the person being evaluated repeatedly speaks a predetermined phrase including three or more syllables from among "pa", "ta", "ka" and "ra". The phrase may be three syllables from among "pa", "ta", "ka" and "ra" arranged one by one in any order, or four syllables from among "pa", "ta", "ka" and "ra" arranged one by one in any order. The phrase may also include syllables other than "pa", "ta", "ka" and "ra".

[0013] In the following, an example will be described in which the phrase is "pataka". That is, in this embodiment, the assessee repeatedly utters the three-syllable phrase "pataka". However, as described above, the phrase is not limited to "pataka".

[0014] In the following, the person being evaluated will repeatedly utter a predetermined phrase ten times. That is, in this embodiment, the person being evaluated will utter "patakapatakapatakapatakapatakapatakapatakapatakapatakapataka." However, the number of times the person being evaluated utters the predetermined phrase can be set arbitrarily. The person being evaluated may also repeatedly utter the predetermined phrase for a predetermined period of time (e.g., 10 seconds).

[0015] Fig. 1 is a diagram showing an example of the configuration of an evaluation system according to this embodiment. As shown in Fig. 1, the evaluation system according to this embodiment includes an oral function evaluation device 1 (hereinafter referred to as "evaluation device 1") and a user terminal 2, which are communicatively connected to each other via a network N. The network N is, for example, a wired LAN (Local Area Network), a wireless LAN, the Internet, a public line network, a mobile data communication network, or a combination of these. In the example of Fig. 1, the evaluation system includes one evaluation device 1 and one user terminal 2, but may include multiple of each.

[0016] The evaluation device 1 is an information processing device that evaluates the oral function of the person to be evaluated based on the voice information 121 in which the person to be evaluated repeatedly speaks a phrase. More specifically, the evaluation device 1 evaluates the speech by calculating the measurement values ​​of one or more evaluation items related to the speech based on the voice information 121 and evaluating the speech, thereby evaluating the oral function of the person to be evaluated. The evaluation items are, for example, but are not limited to, speech speed, speech rhythm, breathing and pronunciation during speech. The evaluation device 1 is, for example, but is not limited to, a PC (Personal Computer), a smartphone, a tablet terminal, a server device, or a microcomputer. The evaluation device 1 will be described in detail later.

[0017] The user terminal 2 is an information processing device used by a user of the evaluation system. The user may be the person being evaluated, or a third party different from the person being evaluated. In the following, an example will be described in which the user is a third party different from the person being evaluated. The user uses the user terminal 2 to acquire voice information 121 of the person being evaluated and transmit it to the evaluation device 1, and receives evaluation result information 123 from the evaluation device 1 to display the evaluation result. The user terminal 2 is, for example, a PC, a smartphone, or a tablet terminal, but is not limited to these.

[0018] <Hardware configuration of information processing device> Next, a description will be given of a hardware configuration of the information processing device 100. Fig. 2 is a diagram showing an example of a hardware configuration of the information processing device 100. As shown in Fig. 2, the information processing device 100 includes a processor 101, a memory 102, a storage 103, a communication I / F 104, an input / output I / F 105, and a drive device 106, which are connected to each other via a bus B.

[0019] The processor 101 controls each component of the information processing device 100 and realizes the functions of the information processing device 100 by expanding in the memory 102 various programs including an OS (Operating System) stored in the storage 103 and executing them. The processor 101 is, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), an ASIC (Application Specific Integrated Circuit), a DSP (Digital Signal Processor), or a combination of these.

[0020] The memory 102 is, for example, a Read Only Memory (ROM), a Random Access Memory (RAM), or a combination thereof. The ROM is, for example, a Programmable ROM (PROM), an Erasable Programmable ROM (EPROM), an Electrically Erasable Programmable ROM (EEPROM), or a combination thereof. The RAM is, for example, a Dynamic RAM (DRAM), a Static RAM (SRAM), or a combination thereof.

[0021] The storage 103 stores various programs including an OS and data. The storage 103 is, for example, a flash memory, a hard disk drive (HDD), a solid state drive (SSD), a storage class memory (SCM), or a combination of these.

[0022] The communication I / F 104 is an interface for connecting the information processing device 100 to an external device via the network N and controlling communication. The communication I / F 104 is, for example, an adapter conforming to Bluetooth (registered trademark), Wi-Fi (registered trademark), ZigBee (registered trademark), Ethernet (registered trademark), or optical communication, but is not limited thereto.

[0023] The input / output I / F 105 is an interface for connecting an input device 107 and an output device 108 to the information processing device 100. The input device 107 is, for example, a mouse, a keyboard, a touch panel, a microphone, a scanner, a camera, various sensors, an operation button, or a combination of these. The output device 108 is, for example, a display, a projector, a printer, a speaker, a vibrator, or a combination of these.

[0024] The drive device 106 reads and writes data from and to the disk medium 109. The drive device 106 is, for example, a magnetic disk drive, an optical disk drive, a magneto-optical disk drive, or a combination of these. The disk medium 109 is, for example, a compact disc (CD), a digital versatile disc (DVD), a floppy disk (FD), a magneto-optical disk (MO), a Blu-ray (registered trademark) disc (BD), or a combination of these.

[0025] In this embodiment, the program may be written into memory 102 or storage 103 during the manufacturing stage of the information processing device 100, or may be provided to the information processing device 100 via the network N, or may be provided to the information processing device 100 via a non-transitory computer-readable recording medium such as disk media 109.

[0026] <Functional configuration of the oral function evaluation device 1> Next, a description will be given of a functional configuration of the evaluation device 1. Fig. 3 is a diagram showing an example of the functional configuration of the evaluation device 1. As shown in Fig. 3, the evaluation device 1 includes a communication unit 11, a storage unit 12, and a control unit 13.

[0027] The communication unit 11 is realized by the communication I / F 104. The communication unit 11 transmits and receives information to and from the user terminal 2 via the network N. The communication unit 11 transmits voice information 121 of the person to be evaluated to the evaluation device 1 and receives evaluation result information 123 from the evaluation device 1.

[0028] The storage unit 12 is realized by the memory 102 and the storage 103. The storage unit 12 stores therein voice information 121, text information 122, evaluation result information 123, evaluation information 124, and advice information 125.

[0029] The audio information 121 is audio information in which the assessee repeatedly speaks a predetermined phrase. In this embodiment, the audio information 121 is audio information in which the assessee repeatedly speaks "pataca" ten times. Note that the audio information 121 may be audio information in which the assessee repeatedly speaks a predetermined phrase a predetermined number of times. The audio information 121 may also be audio information in which the assessee repeatedly speaks a predetermined phrase for a predetermined period of time.

[0030] The text information 122 is information indicating text generated by voice recognition from the voice information 121. If the assessee correctly speaks "patakapataka...", the text information 122 is information indicating the text "patakapataka...".

[0031] The evaluation result information 123 is information indicating the evaluation result of the oral cavity function of the person to be evaluated by the evaluation device 1. The evaluation result information 123 is stored in association with the voice information 121.

[0032] Fig. 4 is a diagram showing an example of the evaluation result information 123. The evaluation result information 123 in Fig. 4 includes, as information items, "evaluation item", "measurement target", "measurement value", "score", "evaluation", and "advice".

[0033] The "evaluation items" are evaluation items for speech and oral function. In the example of Fig. 4, the "evaluation items" include "speed", "rhythm", "breathing", "pronunciation (pa)", "pronunciation (ta)", "pronunciation (ka)", and "overall".

[0034] "Speed" is an evaluation item for evaluating the speed of speech. By evaluating the speed of speech, the smoothness of the mouth and tongue movements of the person being evaluated can be evaluated.

[0035] "Rhythm" is an evaluation item that evaluates the rhythm of speech. By evaluating the "rhythm" of speech, the endurance of the muscles around the mouth of the person being evaluated can be evaluated.

[0036] "Breathing" is an evaluation item that evaluates breathing while speaking. By evaluating breathing while speaking, the lung capacity of the person being evaluated can be evaluated.

[0037] "Pronunciation (pa)" is an evaluation item that evaluates the pronunciation of the syllable "pa." By evaluating the pronunciation of "pa," the strength of the lips of the person being evaluated can be evaluated.

[0038] "Pronunciation (ta)" is an evaluation item that evaluates the pronunciation of the syllable "ta." By evaluating the pronunciation of "ta," the strength of the front of the tongue of the person being evaluated can be evaluated.

[0039] "Pronunciation (Ka)" is an evaluation item that evaluates the pronunciation of the syllable "Ka." By evaluating the pronunciation of "Ka," the strength of the back of the tongue of the person being evaluated can be evaluated.

[0040] "Overall" is an evaluation item for evaluating oral function. "Overall" is a comprehensive evaluation of the oral function of the subject based on the evaluation items of each speech.

[0041] The "measurement object" is a measurement object for evaluating the evaluation items. The "measurement object" includes "time (s)", "stability (%)", "number of breaths (times)", and "number of correct answers (times)".

[0042] "Time (s)" is the measurement of the evaluation item "speed," and is the time it takes to repeat "pataca" 10 times. The shorter the "time (s)," the smoother the movement of the mouth and tongue, and the higher the oral function is evaluated.

[0043] "Stability (%)" is the measurement of the evaluation item "rhythm," and is the stability of the rhythm when "pataca" is spoken 10 times. "Stability (%)" takes a value between 0 and 100, and the more stable the rhythm of the speech, the higher the value. A higher "stability (%)" indicates higher endurance of the muscles around the mouth, and oral function is evaluated highly.

[0044] "Breath count" is the measurement of the evaluation item "breathing" and is the number of breaths taken when uttering "pataka" 10 times. The lower the "breath count", the larger the lung capacity is, and the higher the oral function is evaluated.

[0045] "Number of correct answers (times)" is the measurement target for the evaluation items "Pronunciation (pa)," "Pronunciation (ta)," and "Pronunciation (ka)," and is the number of times that "pa," "ta," and "ka" were correctly pronounced when "pata-ka" was pronounced 10 times. "Number of correct answers (times)" takes a value between 0 and 10, and the more accurate the pronunciation, the higher the number. The more "number of correct answers (times)" for "pronunciation (pa)" is, the stronger the power of the lips are, and the higher the oral function is evaluated. The more "number of correct answers (times)" for "pronunciation (ta)" is, the stronger the power of the front of the tongue is, and the higher the oral function is evaluated. The more "number of correct answers (times)" for "pronunciation (ka)" is, the stronger the power of the back of the tongue is, and the higher the oral function is evaluated.

[0046] The "measurement value" is a value of the "measurement object" calculated based on the voice information 121 and the text information 122. In the example of Fig. 4, the measurement value of "speed" is "15.42", the measurement value of "rhythm" is "21", the measurement value of "breathing" is "9", the measurement value of "pronunciation (pa)" is "5", the measurement value of "pronunciation (ta)" is "7", and the measurement value of "pronunciation (ka)" is "9".

[0047] "Score" is the evaluation value (quantitative evaluation) of "evaluation item" evaluated based on "measurement value". In the example of Figure 4, the score for "speed" is "0", the score for "rhythm" is "0", the score for "breathing" is "0", the score for "pronunciation" is "21", and the score for "overall" is "21". The score for "overall" is the sum of the scores for each evaluation item of speech. The score for "speech" is the sum of the number of correct answers for "speech (pa)", "speech (ta)", and "speech (ka)".

[0048] "Evaluation" is a qualitative evaluation of "evaluation items" based on "measurements" or "scores." In the example of Figure 4, the evaluation of "Pronunciation (pa)" is "Your pronunciation is disturbed," the evaluation of "Pronunciation (ta)" is "Your pronunciation is sometimes disturbed," the evaluation of "Pronunciation (ka)" is "Your pronunciation is good!", and the evaluation of "Overall" is "Your pronunciation seems good!".

[0049] "Advice" is advice for an "evaluation item" that is provided based on a "measurement value" or a "score." In the example of Figure 4, the "overall" advice is "It's taking a long time to finish speaking..."

[0050] The evaluation result information 123 is not limited to the above example. The evaluation result information 123 may not include some of the above information items, or may include information items other than those described above. For example, the evaluation result information 123 may include evaluation items other than those described above. Furthermore, the measurement targets of the evaluation items are not limited to the above example.

[0051] The evaluation information 124 is text information indicating a qualitative evaluation of the “evaluation item.” The evaluation information 124 is stored in association with a “measurement value” or a “score.”

[0052] The advice information 125 is text information indicating advice for an "evaluation item." The advice information 125 is stored in association with a "measurement value" or a "score."

[0053] The control unit 13 is realized by the processor 101 reading and executing a program from the memory 102 and cooperating with other hardware configurations. The control unit 13 controls the overall operation of the evaluation device 1. The control unit 13 includes an acquisition unit 131, a generation unit 132, and an evaluation unit 133.

[0054] The acquisition unit 131 acquires the speech information 121 of the assessee from the user terminal 2. The acquisition unit 131 stores the acquired speech information 121 in the storage unit 12.

[0055] The generation unit 132 generates the text information 122 from the voice information 121 by voice recognition. When the person to be evaluated correctly utters "patakapataka...", the generation unit 132 generates the text information 122 indicating the text "patakapataka...". The generation unit 132 may generate the text information 122 by voice recognition processing using, for example, an acoustic model, a language model, a pronunciation dictionary, and the like. The generation unit 132 may also generate the text information 122 from the voice information 121 by using an AI model that converts voice into text. The generation unit 132 stores the generated text information 122 in the storage unit 12.

[0056] The evaluation unit 133 evaluates the speech and oral function of the person to be evaluated based on the voice information 121 and the text information 122. The evaluation of the speech and oral function here includes calculation of a measurement value, calculation of a score, selection of an evaluation, and selection of an advice for each evaluation item. The evaluation method by the evaluation unit 133 will be described in detail later.

[0057] The functional configuration of the evaluation device 1 is not limited to the above example. For example, the evaluation device 1 may have a part of the functional configuration described above, and the user terminal 2 may have the rest. The evaluation device 1 may also have functional configurations other than those described above. As described above, each functional configuration of the evaluation device 1 may be realized by software, or may be realized by hardware such as an IC chip, a SoC (System on Chip), an LSI (Large Scale Integration), or a microcomputer.

[0058] <Processing performed by the oral function evaluation system> Next, a process executed by the evaluation system according to this embodiment will be described with reference to a flowchart shown in FIG 5.

[0059] (Step S101) First, the user asks the person to be evaluated to repeatedly speak a predetermined phrase, and the user terminal 2 acquires the speech information (step S101). Here, the speech information acquired is the speech information in which the person to be evaluated repeatedly speaks "pataca" ten times. The user terminal 2 may acquire video information including the speech information instead of the speech information.

[0060] When the user acquires the voice information, the user operates the user terminal 2 to transmit the acquired voice information from the user terminal 2 to the evaluation device 1 in association with the information of the person to be evaluated. The user may transmit the voice information of the person to be evaluated that is stored in advance in the user terminal 2 to the evaluation device 1.

[0061] (Step S102) When the acquisition unit 131 of the evaluation device 1 receives the voice information from the user terminal 2, it acquires the received voice information as voice information 121 and stores it in the storage unit 12 in association with the information of the person to be evaluated (step S102).

[0062] (Step S103) When the voice information 121 is stored in the storage unit 12, the generation unit 132 generates text information 122 from the stored voice information 121 by voice recognition, and stores the text information 122 in the storage unit 12 in association with the voice information 121 (step S103). If the person being evaluated correctly utters "patakapataka...", the text information 122 will be information indicating the text "patakapataka...".

[0063] (Step S104) When the voice information 121 and the text information 122 are saved, the evaluation unit 133 evaluates the speech and oral function of the person to be evaluated based on the voice information 121 and the text information 122, and saves the evaluation result information 123 in the storage unit 12 in association with the voice information 121 (step S104). The evaluation unit 133 transmits the saved evaluation result information 123 to the user terminal 2 in association with the voice information 121.

[0064] FIG. 6 is a diagram showing a schematic example of the audio information 121. In the example of FIG. 6, the horizontal axis represents time, and the vertical axis represents amplitude. The audio information 121 in FIG. 6 includes waveforms corresponding to ten "patakas." Note that the actual audio information 121 also includes other information such as frequency. Below, an explanation will be given of the evaluation methods for the five evaluation items of "speed," "rhythm," "breathing," "pronunciation," and "overall."

[0065] (1) How to evaluate "speed" When the assessee repeatedly utters a predetermined phrase a predetermined number of times, the evaluation unit 133 calculates the time required for the assessee to repeatedly utter the predetermined phrase a predetermined number of times as the "measured value (required time)" of "speed" based on the voice information 121. In the example of Fig. 6, the evaluation unit 133 calculates the time required for repeatedly uttering "pata ka" ten times, that is, the time T from the start time t1 of the waveform of the first "pa" to the end time t2 of the waveform of the tenth "ka", as the "measured value" of "speed".

[0066] Next, the evaluation unit 133 determines a "score" for the "speed" based on the "measurement value". The evaluation unit 133 may calculate a "score" for the "speed" based on the "measurement value" of the "speed". The evaluation unit 133 may also refer to a correspondence table of "scores" and "measurement values" to select a "score" for the "speed" that corresponds to the "measurement value".

[0067] Furthermore, the evaluation unit 133 refers to a correspondence table between "scores" and "evaluations" included in the evaluation information 124 to determine the "evaluation" of "speed" corresponding to the "score." Instead of the correspondence table between "scores" and "evaluations," a correspondence table between "measured values" and "evaluations" may be prepared. Also, if an "evaluation" of "speed" is not necessary, a correspondence table for "evaluations" does not need to be prepared.

[0068] Furthermore, the evaluation unit 133 refers to a correspondence table between "scores" and "advice" included in the advice information 125, and determines "advice" for "speed" corresponding to the "score." Instead of the correspondence table between "scores" and "advice," a correspondence table between "measurements" and "advice" may be prepared. Also, if "advice" for "speed" is not necessary, a correspondence table for "advice" does not need to be prepared.

[0069] The evaluation unit 133 stores the "measured value", "score", "evaluation" and "advice" of "speed" thus determined in the storage unit 12 as evaluation result information 133. In the example of Fig. 4, the "measured value" of "speed" is "15.42", the "score" is "0", the "evaluation" is "-", and the "advice" is "-".

[0070] In addition, when the person being evaluated repeatedly speaks a specified phrase for a specified period of time, the evaluation unit 133 may calculate, based on the audio information 121, the number of times the person being evaluated repeatedly speaks the specified phrase within the specified period of time as a "measured value" of "speed."

[0071] (2) Evaluation method for "rhythm" When the person being evaluated repeatedly utters a predetermined phrase a predetermined number of times, the evaluation unit 133 calculates the stability of the rhythm while the person being evaluated repeatedly utters the predetermined phrase as a "measurement value (stability)" of "rhythm" based on the voice information 121. The stability of the rhythm may be the smallness of the variation (such as variance) of the speech interval for each syllable ("pa", "ta", or "ka"), or the smallness of the variation of the speech interval for adjacent syllables. In addition, the stability of the rhythm may be the number or the ratio of syllables included in a predetermined range based on the average value among the speech interval for each syllable or the speech interval for adjacent syllables. In either case, the more constant the speech interval, the higher the stability.

[0072] Next, the evaluation unit 133 determines a "score" for the "rhythm" based on the "measurement value". The evaluation unit 133 may calculate the "score" for the "rhythm" based on the "measurement value" of the "rhythm". The evaluation unit 133 may also refer to a correspondence table of "scores" and "measurement values" to select the "score" for the "rhythm" that corresponds to the "measurement value".

[0073] Furthermore, the evaluation unit 133 refers to a correspondence table between "scores" and "evaluations" included in the evaluation information 124 to determine the "evaluation" of the "rhythm" that corresponds to the "score." Instead of the correspondence table between "scores" and "evaluations," a correspondence table between "measurements" and "evaluations" may be prepared. Also, if an "evaluation" of the "rhythm" is not necessary, a correspondence table for "evaluations" does not need to be prepared.

[0074] Furthermore, the evaluation unit 133 refers to a correspondence table between "scores" and "advice" included in the advice information 125, and determines "advice" for "rhythm" that corresponds to the "score." Instead of a correspondence table between "scores" and "advice," a correspondence table between "measurements" and "advice" may be prepared. Also, if "advice" for "rhythm" is not necessary, a correspondence table for "advice" does not need to be prepared.

[0075] The evaluation unit 133 stores the thus determined "measurement value," "score," "evaluation," and "advice" for "rhythm" in the storage unit 12 as evaluation result information 133. In the example of Fig. 4, the "measurement value" for "rhythm" is "21," the "score" is "0," the "evaluation" is "-," and the "advice" is "-."

[0076] In addition, when the person being evaluated repeatedly speaks a specified phrase for a specified period of time, the evaluation unit 133 may calculate, based on the audio information 121, the stability of the rhythm of the person being evaluated speaking the specified phrase for the specified period of time as a "measurement value" of the "rhythm."

[0077] (3) How to evaluate "breathing" Based on the voice information 121, the evaluation unit 133 calculates the number of breaths taken while the subject repeatedly utters a predetermined phrase as the "measured value (number of breaths)" of "breathing". In the example of FIG. 6, the evaluation unit 133 calculates the number of breaths taken while repeatedly uttering "pata ka" 10 times, that is, the number of breaths taken from the start time t1 of the waveform of the first "pa" to the end time t2 of the waveform of the tenth "ka" as the "measured value" of "breathing". For example, the evaluation unit 133 detects a period in which the amplitude is equal to or less than a threshold value for a predetermined period or more in the voice information 121 as a period in which the subject took a breath. Note that the method of detecting a breath is not limited to this and is arbitrary.

[0078] Next, the evaluation unit 133 determines a "score" for "breathing" based on the "measurement value". The evaluation unit 133 may calculate a "score" for "breathing" based on the "measurement value" for "breathing". The evaluation unit 133 may also select a "score" for "breathing" corresponding to the "measurement value" by referring to a correspondence table of "scores" and "measurement values".

[0079] Furthermore, the evaluation unit 133 refers to a correspondence table between "scores" and "evaluations" included in the evaluation information 124 to determine an "evaluation" of "breathing" corresponding to the "score." Instead of the correspondence table between "scores" and "evaluations," a correspondence table between "measurements" and "evaluations" may be prepared. Also, if an "evaluation" of "breathing" is not necessary, a correspondence table for "evaluations" does not need to be prepared.

[0080] Furthermore, the evaluation unit 133 refers to a correspondence table between "scores" and "advice" included in the advice information 125, and determines "advice" for "breathing" that corresponds to the "score." Instead of the correspondence table between "scores" and "advice," a correspondence table between "measurements" and "advice" may be prepared. Also, if "advice" for "breathing" is not necessary, a correspondence table for "advice" does not need to be prepared.

[0081] The evaluation unit 133 stores the thus determined "measurement value," "score," "evaluation," and "advice" for "breathing" in the storage unit 12 as evaluation result information 123. In the example of Fig. 4, the "measurement value" for "breathing" is "9," the "score" is "0," the "evaluation" is "-," and the "advice" is "-."

[0082] In addition, when the person being evaluated repeatedly speaks a specified phrase for a specified period of time, the evaluation unit 133 may calculate, based on the audio information 121, the number of breaths taken by the person being evaluated while repeatedly speaking the specified phrase for the specified period of time as a "measurement value" of "breathing."

[0083] (4) Evaluation method for "Pronunciation" When the assessee repeatedly utters a predetermined phrase a predetermined number of times, the evaluation unit 133 calculates the number of times each syllable is correctly pronounced while the assessee repeatedly utters the predetermined phrase a predetermined number of times as a "measurement value (number of correct answers)" of "pronunciation" based on the text information 122. In the example of Fig. 6, the evaluation unit 133 calculates the number of times "pa", "ta", and "ka" are correctly pronounced while "pataka" is repeatedly uttered 10 times as the "measurement values" of "pronunciation (pa)", "pronunciation (ta)", and "pronunciation (ka)", respectively.

[0084] The number of times "pa" is pronounced correctly is the number of times that the syllable "pa" in the phrase "pataka" is recognized as "pa" in the text information 122. This is because when "pa" is pronounced correctly, it is recognized as "pa" by the voice recognition, whereas when "pa" is pronounced incorrectly, it is recognized as a syllable other than "pa" by the voice recognition. The same applies to "ta" and "ka."

[0085] In the example of Fig. 6, in the text information 122, the speech information 121 is recognized as "patakahasakakatasapatakapakahatakapatakapakakakatakakataka." If the 10 syllables that should be pronounced as "pa" are extracted, they become "pa-ha-ka-pa-pa-ha-pa-pa-ka-ka," and 5 out of the 10 syllables that should be pronounced as "pa" are recognized as "pa." Therefore, in the example of Fig. 6, the number of correct answers for "pronunciation (pa)" is 5. Similarly, the number of correct answers for "pronunciation (ta)" is 7, and the number of correct answers for "pronunciation (ka)" is 9.

[0086] The "measurement value" of "pronunciation" may be the percentage of correct answers instead of the number of correct answers. In this case, the percentage of correct answers for correctly pronouncing "pa" is the number of correct answers for "pa" divided by the number of times "pata-ka" was repeated. The same applies to "ta" and "ka." In the example of FIG. 6, the percentage of correct answers for "pronunciation (pa)" is 50%, the percentage of correct answers for "pronunciation (ta)" is 70%, and the percentage of correct answers for "pronunciation (ka)" is 90%.

[0087] Next, the evaluation unit 133 determines a "score" for "pronunciation" based on the "measurement value." The evaluation unit 133 may calculate a "score" for "pronunciation" based on the "measurement value" for "pronunciation." The evaluation unit 133 may also refer to a correspondence table of "scores" and "measurement values" to select a "score" for "pronunciation" that corresponds to the "measurement value." The "score" for "pronunciation" may be determined for each syllable, or may be determined as a total score for all syllables.

[0088] Furthermore, the evaluation unit 133 refers to a correspondence table between "scores" and "evaluations" included in the evaluation information 124 to determine the "evaluation" of "pronunciation" corresponding to the "score." Instead of the correspondence table between "scores" and "evaluations," a correspondence table between "measurements" and "evaluations" may be prepared. Also, if an "evaluation" of "pronunciation" is not necessary, a correspondence table for "evaluations" does not need to be prepared.

[0089] Furthermore, the evaluation unit 133 refers to a correspondence table between "scores" and "advice" included in the advice information 125 to determine "advice" for "pronunciation" that corresponds to the "score." Instead of a correspondence table between "scores" and "advice," a correspondence table between "measurements" and "advice" may be prepared. Also, if "advice" for "pronunciation" is not necessary, a correspondence table for "advice" does not need to be prepared.

[0090] The evaluation unit 133 stores the "measurement value," "score," "evaluation," and "advice" for "pronunciation" thus determined in the storage unit 12 as evaluation result information 123. In the example of FIG. 4, the "measurement value" for "pronunciation (pa)" is "5," the "evaluation" is "your pronunciation is disturbed," and the "advice" is "-." The "measurement value" for "pronunciation (ta)" is "7," the "evaluation" is "your pronunciation is sometimes disturbed," and the "advice" is "-." The "measurement value" for "pronunciation (ka)" is "9," the "evaluation" is "your pronunciation is good!" and the "advice" is "-." The "score" for "pronunciation" is "21."

[0091] (5) Evaluation method for "Overall" The evaluation unit 133 determines the "total" "score" based on the "score" of each "evaluation item" of the utterance. The evaluation unit 133 may calculate the "total" "score" based on the "score" of each "evaluation item" of the utterance. The evaluation unit 133 may also select the "total" "score" by referring to a correspondence table of the "score" of each "evaluation item" of the utterance and the "total" "score". The evaluation unit 133 may determine the "total" "score" based on the "measurement value" of each "evaluation item" of the utterance instead of the "score" of each "evaluation item" of the utterance.

[0092] Next, the evaluation unit 133 refers to a correspondence table between "scores" and "evaluations" included in the evaluation information 124 to determine an "overall" "evaluation" that corresponds to the "score." Instead of the correspondence table between "overall" "scores" and "evaluations," a correspondence table between "scores" or "measurements" for each "evaluation item" of an utterance and "evaluations" may be prepared. Also, if an "overall" "evaluation" is not necessary, a correspondence table for "evaluations" does not need to be prepared.

[0093] Furthermore, the evaluation unit 133 refers to a correspondence table between "scores" and "advice" included in the advice information 125, and determines "overall" "advice" corresponding to the "score". Instead of a correspondence table between "scores" and "advice", a correspondence table between "scores" or "measurements" for each "evaluation item" of an utterance and "advice" may be prepared. Also, if "overall" "advice" is not necessary, a correspondence table for "advice" does not need to be prepared.

[0094] The evaluation unit 133 stores the "total" "score," "evaluation," and "advice" thus determined in the storage unit 12 as evaluation result information 123. In the example of Fig. 4, the "total" "score" is "21," the "evaluation" is "Your pronunciation sounds good!...," and the "advice" is "It's taking a while to finish speaking...".

[0095] The "evaluation items", "measurement targets", "measurements", "scores", "evaluations" and "advice" for speech and oral functions are not limited to the above examples. The evaluation result information 123 may not include some of the above information, or may include information other than the above information.

[0096] (Step S106) When the user terminal 2 receives the evaluation result information 123 from the evaluation device 1, it displays the evaluation result indicated by the evaluation result information 123 on the evaluation result display screen (step S106).

[0097] Fig. 7 is a diagram showing an example of an evaluation result display screen. The evaluation result display screen in Fig. 7 displays the measured value (15.42 seconds) and score (0 / 30 points) of "speed", the measured value (21%) and score (0 / 30 points) of "rhythm", the measured value (9 times) and score (0 / 30 points) of "breathing", the score (5 points) and evaluation (your pronunciation is disturbed), the score (7 points) and evaluation (your pronunciation is sometimes disturbed), the score (9 points) and evaluation (your pronunciation is good!), and the score (21 points / 30) and evaluation (your pronunciation is good!...) and advice (it's taking a long time to finish speaking...).

[0098] The person being evaluated can know the state of his / her own speech and oral function by looking at such an evaluation result display screen. Note that the evaluation results displayed on the evaluation result display screen are not limited to the above examples.

[0099] <Summary> As described above, the evaluation system according to the present embodiment evaluates the speech and oral function of the person being evaluated based on the audio information of the person being evaluated repeatedly uttering a predetermined phrase including multiple syllables such as "pata-ka". This allows the person being evaluated to receive an evaluation of the speech of multiple syllables in one utterance. In addition, the evaluator can evaluate the speech of multiple syllables of the person being evaluated simply by acquiring the audio information of the person being evaluated's one utterance. In other words, when performing oral diadochokinesis, it is not necessary for the person being evaluated to utter and record each of the syllables such as "pa", "ta" and "ka", or for the evaluator to count the number of times each syllable is spoken. As a result, oral diadochokinesis can be easily performed by using this evaluation system.

[0100] In addition, the evaluation system can automatically evaluate multiple evaluation items such as "speed," "rhythm," "breathing," "pronunciation," and "overall" based on the audio information of repeated utterance of a specific phrase. This allows for a more detailed evaluation of the speech and oral function of the person being evaluated compared to when oral diadochokinesis is performed manually.

[0101] <Additional Notes> The present embodiment includes the following disclosure.

[0102] (Appendix 1) An oral function evaluation method executed by an oral function evaluation system, An acquisition process for acquiring speech information in which the subject repeatedly speaks a predetermined phrase including a plurality of syllables; an evaluation process for evaluating the speech based on the voice information; A method for evaluating oral function comprising:

[0103] (Appendix 2) The phrase contains three or more syllables among pa, ta, ka, and ra. A method for evaluating oral function as described in Appendix 1.

[0104] (Appendix 3) The phrase is Pataca A method for evaluating oral function as described in Appendix 1.

[0105] (Appendix 4) The acquisition process acquires voice information in which the phrase is repeatedly spoken a predetermined number of times. A method for evaluating oral function as described in Appendix 1.

[0106] (Appendix 5) The acquisition process acquires voice information in which the phrase is repeatedly spoken for a predetermined period of time. A method for evaluating oral function as described in Appendix 1.

[0107] (Appendix 6) The evaluation process evaluates the speech rate based on the voice information. A method for evaluating oral function as described in Appendix 1.

[0108] (Appendix 7) The evaluation process calculates the time required to repeat the phrase the predetermined number of times based on the voice information. A method for evaluating oral function as described in Appendix 1.

[0109] (Appendix 8) The evaluation process evaluates the rhythm of speech based on the voice information. A method for evaluating oral function as described in Appendix 1.

[0110] (Appendix 9) The evaluation process calculates a stability of the rhythm of the speech based on the voice information. A method for evaluating oral function as described in Appendix 1.

[0111] (Appendix 10) The evaluation process evaluates breathing during speech based on the voice information. A method for evaluating oral function as described in Appendix 1.

[0112] (Appendix 11) The evaluation process calculates the number of breaths taken during speech based on the voice information. A method for evaluating oral function as described in Appendix 1.

[0113] (Appendix 12) A generation process of generating text information from the voice information by voice recognition is further included. The evaluation process evaluates the pronunciation based on the text information. A method for evaluating oral function as described in Appendix 1.

[0114] (Appendix 13) A generation process of generating text information from the voice information by voice recognition is further included. The evaluation process calculates the number of correct pronunciations based on the text information. A method for evaluating oral function as described in Appendix 1.

[0115] (Appendix 14) On the computer, An acquisition process for acquiring speech information in which the subject repeatedly speaks a predetermined phrase including a plurality of syllables a predetermined number of times; an evaluation process for evaluating the speech based on the voice information; A program for executing an oral function evaluation method including the steps of:

[0116] (Appendix 15) An acquisition unit that acquires speech information in which an assessee repeatedly speaks a predetermined phrase including a plurality of syllables a predetermined number of times; an evaluation unit that evaluates the utterance based on the voice information; An oral function evaluation system comprising:

[0117] The embodiments disclosed herein are illustrative in all respects and should not be considered as limiting. The scope of the present invention is indicated by the claims, not by the above meaning, and is intended to include all modifications within the meaning and scope of the claims. The present invention is not limited to the above-mentioned embodiments, and various modifications are possible within the scope of the claims, and embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present invention. [Explanation of symbols]

[0118] 1: Evaluation device 2: User terminal 11: Communications Department 12: Storage part 13: Control unit 101: Processor 102: Memory 103: Storage 104: Communication I / F 105: Input / Output I / F 106: Drive device 107: Input device 108: Output device 109:Disk media 121: Audio information 122: Text information 123: Evaluation result information 124: Evaluation information 125:Advice information 131: Acquisition Department 132: Generation part 133: Evaluation section

Claims

1. An oral function evaluation method executed by an oral function evaluation system, comprising: An acquisition process for acquiring speech information in which the subject repeatedly speaks a predetermined phrase including a plurality of syllables; an evaluation process of calculating the number of breaths taken during speech based on the voice information and evaluating breathing during speech; A method for evaluating oral function comprising:

2. The phrase includes three or more syllables among pa, ta, ka, and ra. The method for evaluating oral function according to claim 1 .

3. The phrase is Pataca The method for evaluating oral function according to claim 1 .

4. The acquisition process acquires voice information in which the phrase is repeatedly spoken a predetermined number of times. The method for evaluating oral function according to claim 1 .

5. The acquisition process acquires voice information in which the phrase is repeatedly spoken for a predetermined period of time. The method for evaluating oral function according to claim 1 .

6. The evaluation process further includes a process of evaluating a speech rate based on the voice information. The method for evaluating oral function according to claim 1 .

7. the evaluation process further includes a process of calculating a time required to repeat the phrase a predetermined number of times based on the voice information. The method for evaluating oral function according to claim 1 .

8. The evaluation process further includes a process of calculating a stability of the rhythm of the speech based on the voice information. The method for evaluating oral function according to claim 1 .

9. The method further includes a generation process for generating text information from the voice information by voice recognition, The evaluation process further includes a process of evaluating pronunciation based on the text information. The method for evaluating oral function according to claim 1 .

10. The method further includes a generation process for generating text information from the voice information by voice recognition, The evaluation process further includes a process of calculating the number of correct pronunciations based on the text information. The method for evaluating oral function according to claim 1 .

11. A computer comprising: An acquisition process for acquiring speech information in which the subject repeatedly speaks a predetermined phrase including a plurality of syllables a predetermined number of times; an evaluation process of calculating the number of breaths taken during speech based on the voice information and evaluating breathing during speech; A program for executing an oral function evaluation method including the steps of:

12. An acquisition unit that acquires speech information in which an assessee repeatedly speaks a predetermined phrase including a plurality of syllables a predetermined number of times; an evaluation unit that calculates the number of breaths taken during speech based on the voice information and evaluates breathing during speech; An oral function evaluation system comprising:

Citation Information

Patent Citations

  • Language therapy robot and language therapy system

    JP2013235134A

  • Information processor, information processing method and information processing program

    JP2018010261A

  • Cognitive function evaluation apparatus, cognitive function evaluation system, cognitive function evaluation method, and program

    JP2019083903A

  • Information processing device, information processing system, and program

    JP2020081088A

  • System and device for supporting functional improvement

    JP2021026650A