Computer program for terminal device, terminal device, and method executed by terminal device

Abstract

To provide a technology capable of appropriately displaying each voice of a user who does not have articulation disorder and the user who has the articulation disorder as a character string.SOLUTION: In a communication system, a portable terminal, when supplying first information for requiring first character-string data corresponding to voice of a user who does not have articulation disorder to a voice recognition server which is a voice recognition engine, acquires the first character-string data from the voice recognition server, according to usage of a first voice recognition model for the user who does not have the articulation disorder by the voice recognition server. The portable terminal, when supplying second information for requiring second character-string data corresponding to the voice of the user who has the articulation disorder to the voice recognition server, acquires the second character-string data from the voice recognition server, according to the usage of a second voice recognition model for the user who has the articulation disorder by the voice recognition server.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] This specification discloses a technique related to speech recognition. [Background technology]

[0002] Patent Document 1 discloses an application that recognizes speech and displays character strings. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2019-016206 Summary of the Invention [Problem to be solved by the invention]

[0004] The above-mentioned technology does not disclose anything about recognizing speech by distinguishing between users without dysarthria and users with dysarthria. This specification provides a technology that can appropriately display the speech of users without dysarthria and users with dysarthria as character strings. [Means for solving the problem]

[0005] This specification discloses a computer program for a terminal device. The computer program may cause a computer of the terminal device to function as the following units: a first supply unit that supplies a speech recognition engine with information indicating whether the speech is that of a user without an articulation disorder or that of a user with an articulation disorder, a second supply unit that, when speech input is detected, supplies the speech recognition engine with speech data corresponding to the speech, an acquisition unit that acquires character string data corresponding to the speech data from the speech recognition engine, and a first display control unit that displays a first screen including character strings corresponding to the character string data on a display unit of the terminal device. The acquisition unit may acquire the first character string data from the speech recognition engine in response to a first speech recognition model for the user without an articulation disorder being used by the speech recognition engine when first information for requesting first character string data corresponding to a speech of the user without an articulation disorder is supplied to the speech recognition engine, and may acquire the second character string data from the speech recognition engine in response to a second speech recognition model for the user with an articulation disorder being used by the speech recognition engine when second information for requesting second character string data corresponding to the speech of the user with an articulation disorder is supplied to the speech recognition engine.

[0006] According to the above configuration, the terminal device supplies the speech recognition engine with either first information for requesting first character string data corresponding to the speech of a user without an articulation disorder or second information for requesting second character string data corresponding to the speech of a user with an articulation disorder, thereby enabling acquisition of an appropriate speech recognition result according to the user. Therefore, the terminal device can appropriately display the speech of each of the user without an articulation disorder and the user with an articulation disorder as a character string.

[0007] A computer-readable recording medium storing the computer program is also novel and useful. The terminal device itself and a method executed by the terminal device are also novel and useful. A communication system including the terminal device and a voice recognition engine is also novel and useful. [Brief explanation of the drawings]

[0008] [Figure 1] 1 shows the configuration of a communication system. [Figure 2] 3 shows a sequence diagram of each process executed by the mobile terminal and the voice recognition server. [Figure 3] The sequence diagram for Case B is shown below. [Figure 4] 10 shows an example of a screen displayed on the mobile terminal. DETAILED DESCRIPTION OF THE INVENTION

[0009] (Configuration of communication system 2: Figure 1) 1, a communication system 2 includes a mobile terminal 10 and a speech recognition server 100. In this embodiment, a technique is disclosed in which the mobile terminal 10 displays character strings corresponding to the speech of a user without an articulation disorder and a user with an articulation disorder.

[0010] (Configuration of mobile terminal 10) The mobile terminal 10 is a portable user terminal device such as a smartphone, tablet PC, or mobile phone. In a modified example, a stationary user terminal device may be used instead of the mobile terminal 10. The mobile terminal 10 includes an operation unit 12, a display unit 14, a microphone 16, a communication interface 18, and a control unit 30.

[0011] The operation unit 12 is a user interface for the user to input various information and includes, for example, hardware keys. The display unit 14 is a display for displaying various information. The display unit 14 functions as a touch panel. That is, the display unit 14 also functions as the operation unit 12. The microphone 16 is a device for inputting the user's voice. The communication interface 18 is a wireless interface in this embodiment, but may be a wired interface in a modified example. The communication interface 18 may be an interface for connecting to a wireless local area network (LAN) 4, or may be an interface for performing wireless communication such as 4G or 5G. The mobile terminal 10 can communicate with the voice recognition server 100 via the communication interface 18.

[0012] The control unit 30 includes a CPU 32 and a memory 34. The memory 34 includes a volatile memory and a non-volatile memory. The volatile memory includes RAM and cache memory. The non-volatile memory may be a ROM, a flash memory, a solid state drive (SSD), a hard disk drive (HDD), or a combination thereof. The non-volatile memory stores programs 40 and 42. The programs 40 and 42 stored in the non-volatile memory are loaded into the volatile memory, and the programs 40 and 42 are executed by the CPU 32 to realize various processes.

[0013] The OS program 40 is a program for realizing basic operations of the mobile terminal 10. The voice display application 42 is installed on the mobile terminal 10, for example, from a server (not shown) on the Internet. Hereinafter, the voice display application 42 will be simply referred to as "application 42." When detecting a user's voice input to the microphone 16, the application 42 transmits voice data corresponding to the voice to the voice recognition server 100 and receives character string data corresponding to the voice data from the voice recognition server 100. The application 42 then displays a screen including a character string corresponding to the character string data on the display unit 14.

[0014] (Configuration of speech recognition server 100) The speech recognition server 100 is installed on the Internet 6. The speech recognition server 100 functions as a speech recognition engine. The speech recognition server 100 receives speech data from an external device (e.g., a mobile terminal 10), generates character string data corresponding to the speech data, and transmits the character string data to the external device. The speech recognition server 100 may be a single server or a collection of multiple servers. Hereinafter, the speech recognition server 100 will be simply referred to as "server 100."

[0015] The server 100 includes a communication interface 118 and a control unit 130. The communication interface 118 is an interface for communicating with an external device (e.g., the mobile terminal 10). The control unit 130 includes a CPU 132 and a memory 134. The CPU 132 executes various processes in accordance with a program 140 stored in the memory 134. The memory 134 includes a volatile memory and a non-volatile memory. The program 140 stored in the non-volatile memory is loaded into the volatile memory, and the program 140 is executed by the CPU 132, thereby realizing various processes. The memory 134 further stores voice recognition model data 150.

[0016] The speech recognition model data 150 is data for converting speech data into character string data. The speech recognition model data 150 includes a disability-free speech recognition model 152, which is a general-purpose model for users without articulation disorders. The speech recognition model data 150 further includes, for each of a plurality of users with articulation disorders, a user ID for identifying the user and a speech recognition model for the user. For example, user ID "001" is associated with speech recognition model 154, and user ID "002" is associated with speech recognition model 156. Note that, hereinafter, the disability-free speech recognition model 152 will be simply referred to as "model 152," and the speech recognition model 154 (or 156) will be simply referred to as "model 154 (or 156)."

[0017] A user with an articulation disorder, for example, a person who owns the mobile terminal 10, accesses the server 100 in advance using the app 42 and registers a user ID "001" in the server 100. The user further inputs various voices of the user into the mobile terminal 10 and provides the server 100 with voice data corresponding to the voices. The server 100 then generates a model 154 for the user based on the voice data and stores the generated model 154 in association with the user ID "001."

[0018] After storing the user ID "001" and the model 154 in association with each other, the server 100 further transmits to the mobile terminal 10 model identification information for identifying the model 152, the user ID "001", and the model identification information for identifying the model 154. As a result, the application 42 of the mobile terminal 10 stores the user ID "001" and the model identification information.

[0019] (Processing performed by each device 10, 100: Figure 2) Next, the processing executed by each of the devices 10 and 100 will be described with reference to Fig. 2. In the following description, for ease of understanding, the operations realized by the CPU 32 and 132 of each device will be described mainly with respect to the mobile terminal 10 and the server 100, rather than mainly with respect to the CPU.

[0020] The mobile device 10 is owned by a user with an articulation disorder (hereinafter referred to as the "disabled user"). The disabled user is with a person without an articulation disorder (hereinafter referred to as the "non-disabled user") and wishes to communicate with the non-disabled user. In this case, the disabled user launches the app 42 at T10. As a result, the mobile device 10 executes the following processes in accordance with the app 42.

[0021] At T12, the mobile terminal 10 displays a login screen on the display unit 14. At T14, the mobile terminal 10 accepts an input operation of login information including the user ID "001" from the disabled user. The login information may further include a password. If authentication of the login information is successful, the mobile terminal 10 displays an initial talk screen SC0 (see FIG. 4) on the display unit 14 at T20. Below, the case is divided into Case A and Case B (see FIG. 3) depending on whether the first user to speak after the app 42 is launched is a non-disabled user or a disabled user.

[0022] (Case A) First, we will explain Case A, in which a non-disabled user speaks first after the app 42 is launched. As shown in FIG. 4, the initial talk screen SC0 includes a start icon IC1 and a microphone icon IC2. The start icon IC1 is an icon that should be selected before a non-disabled user speaks, and the microphone icon IC2 is an icon that should be selected before a disabled user speaks. In Case A, the mobile terminal 10 accepts a selection operation of the start icon IC1 at T22. This selection operation may be performed by either the disabled user or the non-disabled user.

[0023] When the mobile terminal 10 accepts the selection operation of the start icon IC1 at T22, the mobile terminal 10 transmits, at T24, to the server 100 an activation request indicating model identification information that identifies the model 152. The activation request is a command requesting the server 100 to perform speech recognition using the model 152, and will be referred to below as a "model 152 activation request." In this way, when the mobile terminal 10 accepts the selection operation of the start icon IC1 included in the initial talk screen SC0, it can transmit to the server 100 a model 152 activation request for requesting character string data corresponding to the speech of the non-disabled user.

[0024] When the mobile terminal 10 transmits a request to activate the model 152 to the server 100, the model 152 is activated in the server 100, and thereafter, speech recognition is performed using the model 152. Then, at T26, the mobile terminal 10 receives a response from the server 100 indicating that the model 152 has been activated.

[0025] After that, the non-disabled user speaks. In this case, the mobile terminal 10 detects voice input via the microphone 16 at T30, and transmits voice data corresponding to the voice detected at T30 to the server 100 at T32.

[0026] When the server 100 receives the voice data from the mobile terminal 10 in T32, the server 100 performs voice recognition in T34. Specifically, the server 100 generates character string data from the voice data using the model 152 in response to the request to activate the model 152. Then, the server 100 transmits the character string data to the mobile terminal 10 in T36.

[0027] When the mobile terminal 10 receives the character string data from the server 100 at T36, at T40, the mobile terminal 10 displays on the display unit 14 an updated talk screen SC1 that describes a character string corresponding to the character string data. As shown in FIG. 4, the updated talk screen SC1 includes the character string "Hello." By looking at the character string, the disabled user can know what the non-disabled user said. The updated talk screen SC1 also includes a microphone icon IC2. The microphone icon IC2 included in the updated talk screen SC1 is the same as the microphone icon IC2 included in the initial talk screen SC0.

[0028] At T42, the mobile terminal 10 accepts a selection operation of the microphone icon IC2 included in the updated talk screen SC1. The selection operation may be performed by a disabled user or a non-disabled user. In this case, at T44, the mobile terminal 10 transmits to the server 100 an activation request indicating model identification information that identifies the model 154. The activation request is a command requesting the server 100 to perform speech recognition using the model 154, and will be referred to below as a "model 154 activation request."

[0029] When the mobile terminal 10 transmits a request to activate the model 154 to the server 100, the model 154 is activated in the server 100, and thereafter, speech recognition is performed using the model 154. Then, at T46, the mobile terminal 10 receives a response from the server 100 indicating that the model 154 has been activated.

[0030] After that, the disabled user speaks. In this case, the mobile terminal 10 detects voice input via the microphone 16 at T50, and transmits voice data corresponding to the voice detected at T50 to the server 100 at T52.

[0031] When server 100 receives voice data from mobile terminal 10 in T52, server 100 performs voice recognition in T54. Specifically, server 100 generates character string data from the voice data using model 154 in response to the model 154 activation request. Then, server 100 transmits the character string data to mobile terminal 10 in T56. In this way, in a situation where server 100 stores multiple models 154, 156, etc. corresponding to multiple disabled users, when server 100 receives a model 154 activation request from mobile terminal 10, server 100 performs voice recognition using model 154 in response to the model 154 activation request. Therefore, server 100 can perform voice recognition using an appropriate model for the disabled user, and as a result, can provide appropriate voice recognition results to mobile terminal 10.

[0032] When the mobile terminal 10 receives the character string data from the server 100 in T56, the mobile terminal 10 displays, on the display unit 14 in T60, an updated talk screen SC2 on which a character string corresponding to the character string data is written. As shown in FIG. 4, the updated talk screen SC2 includes the character string "How are you (question mark)" below the character string "Hello." By looking at the character string, a non-disabled user can know what the disabled user has said.

[0033] Here, the color of the background region of the box containing the string "How are you (question mark)" is different from the color of the background region of the box containing the string "Hello." This allows each user to easily recognize which string corresponds to which user's voice. In a variant, instead of changing the color of the background region of each user's box, the color of the frame of each user's box may be changed, or the color of each user's string may be changed. In another variant, nothing may be changed for each user.

[0034] The updated talk screen SC2 further includes a stop icon IC3. In this way, when a new character string corresponding to the speech of a disabled user is written, the stop icon IC3 is displayed. The stop icon IC3 is an icon that should be selected before a non-disabled user speaks, and has a different shape from either of the icons IC1 or IC2 included in the initial talk screen SC0.

[0035] In T62, the mobile terminal 10 accepts a selection operation of the stop icon IC3 included in the updated talk screen SC2. This selection operation may be performed by either the disabled user or the non-disabled user. In this case, in T64, the mobile terminal 10 transmits a request to activate the model 152 to the server 100, and in T66, receives a response indicating that the model 152 has been activated from the server 100. Thereafter, the non-disabled user speaks. In this case, in T70, the mobile terminal 10 detects voice input via the microphone 16, and in T72, transmits voice data corresponding to the voice detected in T70 to the server 100.

[0036] When the server 100 receives the voice data from the mobile terminal 10 in T72, the server 100 performs voice recognition in T74. T74 is the same as T34. Then, the server 100 transmits the character string data to the mobile terminal 10 in T76.

[0037] When the mobile terminal 10 receives the character string data from the server 100 in T76, in T80, the mobile terminal 10 displays an updated talk screen SC3 on the display unit 14, in which a character string corresponding to the character string data is described. As shown in FIG. 4, the updated talk screen SC3 includes the character string "I'm fine, thank you." below the character string "How are you (question mark)." By looking at the character string, the disabled user can know what the non-disabled user said.

[0038] The updated talk screen SC3 further includes a microphone icon IC2. In this way, when a new character string corresponding to the voice of a non-disabled user is written, the microphone icon IC2 is displayed. By repeating the same operations and utterances, the disabled user and the non-disabled user can communicate with each other.

[0039] (Case B: Figure 3) Next, with reference to FIG. 3 , a case B will be described in which a user with a disability speaks first after the app 42 is launched. In case B, the mobile device 10 accepts a selection operation of the microphone icon IC2 included in the initial talk screen SC0 at T122. This selection operation may be performed by a user with a disability or a user without a disability. In this case, the mobile device 10 transmits a request to launch the model 154 to the server 100 at T124, and receives a response from the server 100 indicating that the model 154 has been launched at T126. In this way, when the mobile device 10 accepts a selection operation of the microphone icon IC2 included in the initial talk screen SC0, the mobile device 10 can transmit a request to launch the model 154 to the server 100 to request character string data corresponding to the voice of the user with a disability.

[0040] After that, the disabled user speaks. In this case, the mobile terminal 10 detects voice input via the microphone 16 at T130, and transmits voice data corresponding to the voice detected at T130 to the server 100 at T132.

[0041] When the server 100 receives the voice data from the mobile terminal 10 in T132, in T134, the server 100 generates character string data from the voice data using the model 154 in response to the request to activate the model 154. Then, in T136, the server 100 transmits the character string data to the mobile terminal 10.

[0042] When the mobile terminal 10 receives the character string data from the server 100 at T136, at T40, the mobile terminal 10 displays an updated talk screen SC4 on the display unit 14, which contains a character string corresponding to the character string data. As shown in FIG. 4, the updated talk screen SC4 includes the character string "My name is Tom." By viewing the character string, a non-disabled user can know what the disabled user has said. The updated talk screen SC4 also includes a stop icon IC3.

[0043] In T142, the mobile device 10 accepts a selection operation of the stop icon IC3 included in the updated talk screen SC4. This selection operation may be performed by a disabled user or a non-disabled user. In this case, in T144, the mobile device 10 transmits a request to activate the model 152 to the server 100, and in T146, receives a response indicating that the model 152 has been activated from the server 100. Thereafter, the non-disabled user speaks. In this case, in T140, the mobile device 10 detects a voice input via the microphone 16, and in T150, transmits voice data corresponding to the voice detected in T140 to the server 100.

[0044] When the server 100 receives the voice data from the mobile terminal 10 in T152, in T154, the server 100 generates character string data from the voice data using the model 152 in response to the request to start the model 152. Then, in T156, the server 100 transmits the character string data to the mobile terminal 10.

[0045] When the mobile terminal 10 receives the character string data from the server 100 at T156, it displays an updated talk screen SC5 on the display unit 14 at T60, which contains a character string corresponding to the character string data. As shown in FIG. 4, the updated talk screen SC5 includes the character string "May I help you (question mark)" below the character string "My name is Tom." By looking at the character string, the disabled user can know what the non-disabled user has said. By repeating similar operations and utterances thereafter, the disabled user and the non-disabled user can communicate with each other.

[0046] As shown in the above cases A and B, each updated talk screen SC1 to SC5 is displayed when a disabled user and a non-disabled user speak using the same mobile terminal 10. This allows the disabled user and the non-disabled user to easily recognize what the other has said and to communicate appropriately with each other.

[0047] (Effects of this embodiment) According to this embodiment, mobile terminal 10 provides server 100 with either a model 152 activation request for requesting character string data corresponding to the speech of a non-disabled user or a model 154 activation request for requesting character string data corresponding to the speech of a disabled user (T24, T44, T64 in FIG. 2, T124, T144 in FIG. 3), thereby enabling acquisition of appropriate speech recognition results for each user (T36, T56, T76 in FIG. 2, T136, T156 in FIG. 3). As a result, mobile terminal 10 can appropriately display the speech of each of the non-disabled user and the disabled user as character strings (T40, T60, T80 in FIG. 2, T140, T160 in FIG. 3).

[0048] (Correspondence) The mobile terminal 10 and the server 100 are examples of a "terminal device" and a "voice recognition engine," respectively. Model 152 and model 154 are examples of a "first voice recognition model" and a "second voice recognition model," respectively. The updated talk screens SC1 to SC5 are examples of a "first screen." The initial talk screen SC0 is an example of a "second screen." The character string data of T36 in FIG. 2 and the character string data of T136 in FIG. 3 are examples of "first character string data" and "second character string data," respectively. The start icon IC1 and the microphone icon IC2 included in the initial talk screen SC0 are examples of a "first icon" and a "second icon," respectively. The selection operation of the start icon IC1 and the selection operation of the microphone icon IC2 are examples of a "first operation" and a "second operation," respectively. The microphone icon IC2 included in the updated talk screen SC1 is an example of a "third icon." The stop icon IC3 included in the updated talk screen SC4 is an example of a "fourth icon."

[0049] T24, T44, and T64 in FIG. 2 and T124 and T144 in FIG. 3 are examples of processing executed by a "first supply unit." T32, T52, and T72 in FIG. 2 and T132 and T152 in FIG. 3 are examples of processing executed by a "second supply unit." T36, T56, and T76 in FIG. 2 and T136 and T156 in FIG. 3 are examples of processing executed by an "acquisition unit." T40, T60, and T80 in FIG. 2 and T140 and T160 in FIG. 3 are examples of processing executed by a "first display control unit." T20 in FIG. 2 is an example of processing executed by a "second display control unit."

[0050] Although specific examples of the present invention have been described above in detail, these are merely examples and do not limit the scope of the claims. The technology described in the claims includes various modifications and variations of the specific examples exemplified above. Modifications of the above-mentioned embodiments are listed below.

[0051] (Variation 1) Instead of providing the speech recognition server 100, the application 42 may perform speech recognition. In this variation, the application 42 may cause the CPU 32 to function as a detection module that detects speech input, a speech recognition engine, and a display module. The display module supplies the speech recognition engine with information indicating whether the speech is from a non-disabled user or a disabled user, in response to an icon selection operation on each of the above screens SC0 to SC5. When the detection module detects a speech input, it supplies the speech recognition engine with speech data. The display module then obtains character string data, which is the speech recognition result based on the above information and speech data, from the speech recognition engine and displays updated talk screens SC1 to SC5. In particular, in this variation, the speech recognition engine does not need to have multiple speech recognition models corresponding to multiple disabled users, and may have only one speech recognition model corresponding to a single disabled user who is the user of the mobile terminal 10. Generally speaking, the "speech recognition engine" does not need to have multiple second speech recognition models corresponding to multiple users with articulation disorders.

[0052] (Variation 2) In the above embodiment, the mobile terminal 10 transmits a model 152 activation request or a model 154 activation request to the server 100 in response to an operation on each of the icons IC1 to IC3. Alternatively, the mobile terminal 10 may transmit a model 152 activation request or a model 154 activation request to the server 100 in response to receiving a voice input indicating which activation request should be transmitted to the server 100. Generally speaking, the "first supply unit" may not supply the first information to the voice recognition engine in response to a first operation, and may not supply the second information to the voice recognition engine in response to a second operation. Furthermore, the "second display control unit" may be omitted.

[0053] (Variation 3) The shapes of the icons IC1 to IC3 can be changed as appropriate. For example, the updated talk screens SC1, SC3, and SC5 may include an icon having a different shape from the microphone icon IC2. The updated talk screens SC2 and SC4 may include an icon having a different shape from the stop icon IC3. Furthermore, the initial talk screen SC0 may include the microphone icon IC2, but the updated talk screen SC1 may include an icon having a different shape from the microphone icon IC2.

[0054] (Variation 4) For example, the mobile terminal 10 may not execute T24 and T26, but may simultaneously transmit the voice data and the request to activate the model 152 to the server 100 at T32. Generally speaking, the "first supply unit" and the "second supply unit" may supply the first information or the second information together with the voice data to the voice recognition engine.

[0055] (Variation 5) For example, at T44, instead of sending a request to activate model 154 to server 100, mobile terminal 10 may send user ID "001" to server 100. In this case, server 100 performs voice recognition using model 154 associated with user ID "001." In this variation, user ID "001" is an example of "second information." In yet another variation, mobile terminal 10 may send information indicating that the voice is that of a disabled user and user ID "001" to server 100.

[0056] (Variation 6) In the above embodiment, one mobile terminal 10 accepts voice inputs from both a disabled user and a non-disabled user, transmits each voice data to server 100, and receives each character string data from server 100. Alternatively, communication system 2 may be constructed by a mobile terminal 10 owned by a disabled user, another mobile terminal owned by a non-disabled user, and server 100. In this variation, mobile terminal 10 transmits a request to activate model 154 and the voice data of the disabled user to server 100, and the other mobile terminal transmits a request to activate model 152 and the voice data of the non-disabled user to server 100. Then, server 100 transmits each character string data corresponding to each voice data to mobile terminal 10 and the other mobile terminal. In this case, mobile terminal 10 and the other mobile terminal can each display the same talk screen including a character string corresponding to the voice of the disabled user and a character string corresponding to the voice of the non-disabled user. Generally speaking, the “second providing unit” does not need to transmit both the first voice data and the second voice data to the server 100 .

[0057] (Variation 7) In the above embodiment, the processes in FIGS. 2 and 3 are implemented by software, but at least one of these processes may be implemented by hardware such as a logic circuit.

[0058] Furthermore, the technical elements described in this specification or drawings exhibit technical utility either alone or in various combinations, and are not limited to the combinations described in the claims at the time of filing. Furthermore, the technologies illustrated in this specification or drawings simultaneously achieve multiple objectives, and achieving one of those objectives is itself technically useful.

[0059] In the scope of the claims at the time of filing, even if each claim depends on only some of the claims, it is not limited to the fact that each claim can depend on only those some of the claims. To the extent that there is no technical contradiction, each claim can also depend on other claims that were not dependent at the time of filing. In other words, the technology of each claim can be combined in various ways as follows: (Item 1) A computer program for a terminal device, comprising: The computer of the terminal device is composed of the following parts: a first supply unit that supplies information indicating whether the speech is that of a user without an articulation disorder or that of a user with an articulation disorder to a speech recognition engine; a second supply unit that, when a voice input is detected, supplies voice data corresponding to the voice to the voice recognition engine; an acquisition unit that acquires character string data corresponding to the voice data from the voice recognition engine; a first display control unit that causes a first screen including a character string corresponding to the character string data to be displayed on a display unit of the terminal device; The acquisition unit When first information for requesting first character string data corresponding to the voice of the user who does not have an articulation disorder is supplied to the voice recognition engine, in response to a first voice recognition model for the user who does not have an articulation disorder being utilized by the voice recognition engine, acquiring the first character string data from the voice recognition engine; and, when second information for requesting second character string data corresponding to the speech of the user with an articulation disorder is supplied to the speech recognition engine, acquiring the second character string data from the speech recognition engine in response to a second speech recognition model for the user with an articulation disorder being utilized by the speech recognition engine. (Item 2) The first supply unit includes: When a first operation is applied to the terminal device, the first information is supplied to the speech recognition engine; 2. The computer program of claim 1, wherein when a second operation different from the first operation is applied to the terminal device, the second information is supplied to the speech recognition engine. (Item 3) The computer program further causes the computer to: functioning as a second display control unit that causes the display unit to display a second screen including a first icon and a second icon; the first operation includes an operation of selecting the first icon included on the second screen, Item 3. The computer program of item 2, wherein the second operation includes an operation of selecting the second icon included on the second screen. (Item 4) the first screen displayed in response to an operation of the first icon included in the second screen includes a third icon; Item 4. The computer program of item 3, wherein the second operation further includes an operation of selecting the third icon included on the first screen. (Item 5) Item 5. The computer program of item 4, wherein the third icon has the same shape as the second icon. (Item 6) the first screen displayed in response to an operation of the second icon included in the second screen includes a fourth icon; 6. The computer program of any one of items 3 to 5, wherein the first operation further includes an operation of selecting the fourth icon included on the first screen. (Item 7) the speech recognition engine includes a plurality of second speech recognition models corresponding to the plurality of users with dysarthria; the second information includes information indicating a specific second speech recognition model corresponding to the specific user with an dysarthria; and 7. The computer program according to claim 1, wherein the acquisition unit acquires the second character string data from the speech recognition engine in response to the specific second speech recognition model being used by the speech recognition engine when the second information is supplied to the speech recognition engine. (Item 8) The second supply unit includes: providing first speech data corresponding to a first speech of the user without an dysarthria to the speech recognition engine; providing second speech data corresponding to a second speech of the user with an dysarthria to the speech recognition engine; The acquisition unit acquiring the first character string data corresponding to the first voice data from the voice recognition engine; acquiring the second character string data corresponding to the second voice data from the voice recognition engine; 8. The computer program according to claim 1, wherein the first display control unit causes the display unit to display the first screen including a first character string corresponding to the first character string data and a second character string corresponding to the second character string data. [Explanation of symbols]

[0060] 2: Communication system, 10: Mobile terminal, 12: Operation unit, 14: Display unit, 16: Microphone, 18: Communication interface, 30: Control unit, 32: CPU, 34: Memory, 40: OS program, 42: Voice display application, 100: Voice recognition server, 118: Communication interface, 130: Control unit, 132: CPU, 134: Memory, 140: Program, 150: Voice recognition model data, 152: Fault-free voice recognition model, 154, 156: User-specific voice recognition model

Claims

1. A computer program for a terminal device, comprising: The computer of the terminal device is composed of the following parts: a first supply unit that supplies information indicating whether the speech is that of a user without an articulation disorder or that of a user with an articulation disorder to a speech recognition engine; a second supply unit that supplies voice data corresponding to the voice to the voice recognition engine when a voice input is detected; an acquisition unit that acquires character string data corresponding to the voice data from the voice recognition engine; a first display control unit that causes a first screen including a character string corresponding to the character string data to be displayed on a display unit of the terminal device; The acquisition unit When first information for requesting first character string data corresponding to the voice of the user who does not have an articulation disorder is supplied to the voice recognition engine, acquiring the first character string data from the voice recognition engine in response to a first voice recognition model for the user who does not have an articulation disorder being utilized by the voice recognition engine; a computer program product that, when second information for requesting second character string data corresponding to the speech of the user with an articulation disorder is supplied to the speech recognition engine, acquires the second character string data from the speech recognition engine in response to a second speech recognition model for the user with an articulation disorder being utilized by the speech recognition engine.

2. The first supply unit includes: When a first operation is performed on the terminal device, the first information is supplied to the speech recognition engine; The computer program according to claim 1 , further comprising: when a second operation different from the first operation is applied to the terminal device, the second information is supplied to the voice recognition engine.

3. The computer program further causes the computer to: functioning as a second display control unit that causes the display unit to display a second screen including a first icon and a second icon; the first operation includes an operation of selecting the first icon included on the second screen, The computer program product according to claim 2 , wherein the second operation includes an operation of selecting the second icon included on the second screen.

4. the first screen displayed in response to an operation of the first icon included in the second screen includes a third icon; The computer program product according to claim 3 , wherein the second operation further includes an operation of selecting the third icon included on the first screen.

5. The computer program product of claim 4 , wherein the third icon has the same shape as the second icon.

6. the first screen displayed in response to an operation of the second icon included in the second screen includes a fourth icon; The computer program product according to claim 3 , wherein the first operation further includes an operation of selecting the fourth icon included on the first screen.

7. the speech recognition engine includes a plurality of second speech recognition models corresponding to the plurality of users with dysarthria; the second information includes information indicating a specific second speech recognition model corresponding to the specific user with an articulation disorder; 2. The computer program product according to claim 1, wherein the acquisition unit acquires the second character string data from the speech recognition engine in response to the specific second speech recognition model being used by the speech recognition engine when the second information is supplied to the speech recognition engine.

8. The second supply unit includes: providing first speech data corresponding to a first speech of the user without an dysarthria to the speech recognition engine; providing second speech data corresponding to a second speech of the user with an dysarthria to the speech recognition engine; The acquisition unit acquiring the first character string data corresponding to the first voice data from the voice recognition engine; acquiring the second character string data corresponding to the second voice data from the voice recognition engine; 2. The computer program product according to claim 1, wherein the first display control unit causes the display unit to display the first screen including a first character string corresponding to the first character string data and a second character string corresponding to the second character string data.

9. A terminal device, a first supply unit that supplies information indicating whether the speech is that of a user without an articulation disorder or that of a user with an articulation disorder to a speech recognition engine; a second supply unit that supplies voice data corresponding to the voice to the voice recognition engine when a voice input is detected; an acquisition unit that acquires character string data corresponding to the voice data from the voice recognition engine; a first display control unit that causes a first screen including a character string corresponding to the character string data to be displayed on a display unit of the terminal device; The acquisition unit When first information for requesting first character string data corresponding to the voice of the user who does not have an articulation disorder is supplied to the voice recognition engine, acquiring the first character string data from the voice recognition engine in response to a first voice recognition model for the user who does not have an articulation disorder being utilized by the voice recognition engine; a terminal device that, when second information for requesting second character string data corresponding to the voice of the user with an articulation disorder is supplied to the speech recognition engine, acquires the second character string data from the speech recognition engine in response to a second speech recognition model for the user with an articulation disorder being utilized by the speech recognition engine.

10. A method performed by a terminal device, comprising: a first supply step of supplying information indicating whether the speech is that of a user without an articulation disorder or that of a user with an articulation disorder to a speech recognition engine; a second supply step of supplying voice data corresponding to the voice to the voice recognition engine when a voice input is detected; an acquisition step of acquiring character string data corresponding to the voice data from the voice recognition engine; a first display control step of displaying a first screen including a character string corresponding to the character string data on a display unit of the terminal device, The obtaining step includes: When first information for requesting first character string data corresponding to the voice of the user who does not have an articulation disorder is supplied to the voice recognition engine, acquiring the first character string data from the voice recognition engine in response to a first voice recognition model for the user who does not have an articulation disorder being utilized by the voice recognition engine; and obtaining second string data from the speech recognition engine in response to a second speech recognition model for the user with an articulation disorder being utilized by the speech recognition engine when second information for requesting second string data corresponding to the speech of the user with an articulation disorder is supplied to the speech recognition engine.

Images