Communication support device, communication support method, and program

Abstract

To provide a communication support device, etc., that can improve the convenience of exchanging text messages when an information processing terminal cannot be used. [Solution] A communication support device according to one aspect of the present disclosure includes: a receiving means for receiving an acoustic signal from a telephone; a determining means for determining whether the acoustic signal is a signal representing an input text or a signal representing an input command; and a processing means for adding the input text to a transmission message, which is a message to be transmitted, if the acoustic signal is a signal representing the input text, and for processing the transmission message according to the input command if the acoustic signal is a signal representing the input command.

Description

Technical Field

[0001] The present disclosure relates to a transmission support device, a transmission support method, and a program.

Background Art

[0002] In an environment where an information processing terminal such as a personal computer and a smartphone cannot be used, it is impossible to exchange text messages through a system such as a chat system using the information processing terminal. The same applies when another person occupies the information processing terminal in an environment where multiple people share the information processing terminal.

[0003] Patent Document 1 describes a telephone server device that transmits text obtained by converting voice from a telephone to a cooperation device and transmits a text message converted to voice to the telephone.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] In the technology of Patent Document 1, even when an information processing terminal cannot be used, it enables the transmission of text messages and the recognition of the content of received messages. However, the technology of Patent Document 1 cannot improve the convenience of text message exchange when an information processing terminal cannot be used.

[0006] One object of the present disclosure is to provide a transmission support device, a transmission support method, and a program that can improve the convenience of text message exchange when an information processing terminal cannot be used.

Means for Solving the Problems

[0007] A communication support device according to one aspect of the present disclosure includes: a receiving means for receiving an acoustic signal from a telephone; a determining means for determining whether the acoustic signal is a signal representing an input text or a signal representing an input command; and a processing means for adding the input text to a transmission message, which is a message to be transmitted, if the acoustic signal is a signal representing the input text, and for processing the transmission message according to the input command if the acoustic signal is a signal representing the input command.

[0008] A communication support method according to one aspect of the present disclosure receives an acoustic signal from a telephone, determines whether the acoustic signal is a signal representing an input text or a signal representing an input command, adds the input text to a transmission message if the acoustic signal is a signal representing the input text, and processes the transmission message according to the input command if the acoustic signal is a signal representing the input command.

[0009] A program according to one aspect of this disclosure causes a computer to perform the following: receiving processing for receiving an acoustic signal from a telephone; determining whether the acoustic signal is a signal representing an input text or a signal representing an input command; and, if the acoustic signal is a signal representing the input text, adding the input text to a transmission message which is a message to be transmitted; and, if the acoustic signal is a signal representing the input command, performing processing on the transmission message according to the input command. One aspect of this disclosure can also be realized by a storage medium that stores the above-described program. [Effects of the Invention]

[0010] This disclosure has the effect of improving the convenience of exchanging text messages when an information processing terminal cannot be used. [Brief explanation of the drawing]

[0011] [Figure 1] Figure 1 is a block diagram showing an example of the configuration of the communication support device related to this disclosure. [Figure 2] Figure 2 is a flowchart illustrating an example of the operation of the communication support device according to this disclosure. [Figure 3] Figure 3 is a block diagram showing an example of the configuration of the communication support system related to this disclosure. [Figure 4] Figure 4 is a block diagram showing an example of the configuration of the communication support device according to this disclosure. [Figure 5] Figure 5 is a flowchart illustrating an example of the operation of the communication support device according to this disclosure. [Figure 6] Figure 6 is a flowchart illustrating an example of the operation of the communication support device according to this disclosure. [Figure 7] Figure 7 is a flowchart illustrating an example of the operation of the communication support device according to this disclosure. [Figure 8] Figure 8 is a diagram showing an example of a computer hardware configuration that can realize the transmission support device according to the embodiment of this disclosure. [Modes for carrying out the invention]

[0012] Next, embodiments of the present disclosure will be described in detail with reference to the drawings. In the drawings relating to the present disclosure, components that exchange information are connected by lines. However, the combinations of components that exchange information are not limited to combinations of components connected by lines.

[0013] <First Embodiment> A first embodiment of this disclosure will be described in detail with reference to the drawings.

[0014] <Structure> First, the configuration of the first embodiment of this disclosure will be described in detail with reference to the drawings.

[0015] FIG. 1 is a block diagram showing an example of the configuration of a transmission support device according to the present disclosure.

[0016] Hereinafter, the configuration of the transmission support device according to the first embodiment of the present disclosure will be described in detail using FIG. 1.

[0017] In the example shown in FIG. 1, the transmission support device 10 includes a reception unit 110, a determination unit 120, and a processing unit 130.

[0018] <Reception unit 110> The reception unit 110 receives an acoustic signal from a telephone. The acoustic signal will be described later.

[0019] <Determination unit 120> The determination unit 120 determines whether the acoustic signal is a signal representing the input text that has been input, or a signal representing the input command that has been input. The input text is the text that has been input. The input command is the command that has been input. This command is an instruction to the transmission support device 10.

[0020] <Processing unit 130> When the acoustic signal is a signal representing the input text, the processing unit 130 adds the input text to the transmission message, which is the message to be transmitted. When the acoustic signal is a signal representing the input command, the processing unit 130 performs processing on the transmission message according to the input command.

[0021] <Explanation> The above-described acoustic signal is a signal representing sound. Specifically, the acoustic signal is, for example, a signal representing the voice emitted by a user using a telephone. The above-described acoustic signal may be, for example, a signal representing an operation sound, which is a sound generated by a user using a telephone operating the buttons of the telephone.

[0022] The method by which the determination unit 120 determines whether an acoustic signal is a signal indicating input text (the input text) or a signal indicating input command (the input command) will be explained in detail later. Input commands will also be explained in detail later.

[0023] <Operation> First, the operation of the first embodiment of this disclosure will be described in detail with reference to the drawings.

[0024] Figure 2 is a flowchart illustrating an example of the operation of the communication support device according to this disclosure.

[0025] The operation of the transmission support device 10 according to the first embodiment of this disclosure will be described in detail below with reference to Figure 2.

[0026] In the example shown in Figure 2, first, the reception unit 110 receives an acoustic signal from the telephone (step S11). Next, the determination unit 120 determines whether the acoustic signal represents an input text signal. Determine whether the signal represents an input command (step S12).

[0027] If the acoustic signal represents the input text (referred to as "input text" in step S13), the processing unit 130 adds the input text to the transmission message (step S14).

[0028] If the acoustic signal represents an input command (referred to as "input command" in step S13), the processing unit 130 processes the transmission message according to the input command (step S15).

[0029] <Effects> This embodiment has the effect of improving the convenience of exchanging text messages when an information processing terminal cannot be used.

[0030] The reason for this is that the determination unit 120 determines whether the acoustic signal is a signal representing the input text or a signal representing the input command. Then, if the acoustic signal is a signal representing the input text, the processing unit 130 adds the input text to the transmission message, which is the message to be sent. Furthermore, if the acoustic signal is a signal representing an input command, the processing unit 130 processes the transmission message according to the input command. Thus, in this embodiment, the telephone user can input text to be added to the transmission message and input an input command that instructs the processing of the transmission message. In addition, in this embodiment, the telephone user does not need to instruct a switch in input mode, which is a switch between a mode that accepts input of text to be added to the transmission message and a mode that accepts input of an input command that instructs the processing of the transmission message. Furthermore, in this embodiment, processing of the transmission message is performed according to the input command. Therefore, compared to the case where only text is transmitted by converting the voice from the telephone into text, and an acoustic signal is transmitted by converting the text message into speech, this embodiment improves the convenience of text messaging when an information processing terminal cannot be used.

[0031] <Detailed example of the first embodiment> <Judgment unit 120> Generally, when a push-button telephone is pressed, it generates an acoustic signal (referred to as a push tone, push sound, etc.) that corresponds to the pressed number and symbol buttons. Hereinafter, the sound corresponding to the pressed button will be referred to as a push sound. The telephone transmits the acoustic signal representing the push sound via the telephone line. The user of the telephone also speaks into the microphone on the handset. The telephone transmits an acoustic signal representing the voice measured by the microphone via the telephone line. In the embodiments of this disclosure, the acoustic signal representing the push sound will be referred to as the operation sound signal. The acoustic signal representing the voice will be referred to as the voice signal.

[0032] In embodiments of this disclosure, the input of text to be added to the outgoing message (i.e., input text) is performed by the voice of the telephone user or by the operation of the telephone buttons by the telephone user. In addition, the input of input commands representing instructions such as operations on the outgoing message is performed by the voice of the telephone user or by the operation of the telephone buttons by the telephone user.

[0033] The determination unit 120 may determine whether an acoustic signal is a push tone acoustic signal using pre-obtained information on push tones that generate an acoustic signal when a button on the telephone is pressed. In this disclosure, the determination of whether an acoustic signal is a push tone acoustic signal may be referred to as sound type determination. The information on push tones that generate an acoustic signal when a button on the telephone is pressed is, for example, information on the acoustic signal of each push tone of the telephone button (i.e., information on the waveform of the acoustic signal).

[0034] If the acoustic signal is one of the push-button acoustic signals, the determination unit 120 determines that the input represented by the acoustic signal was made by operating a button on the telephone. In other words, the determination unit 120 determines that the acoustic signal is an operation sound signal. If the acoustic signal is not a push-button acoustic signal, the determination unit 120 determines that the input represented by the acoustic signal was made by voice emitted to the microphone on the telephone's handset. In other words, the determination unit 120 determines that the acoustic signal is a voice signal.

[0035] If the acoustic signal is determined to be a push-button acoustic signal (i.e., an operation sound signal), the determination unit 120 determines from the acoustic signal an operation on a telephone button (hereinafter also referred to as an execution operation) using, for example, the operation sound relationship described later. An execution operation is an operation on a telephone button by the user at the time the acoustic signal was generated. The operation sound relationship is the relationship between a telephone button and the push-button generated when the telephone button is pressed (i.e., the push-button represented by the acoustic signal generated when the telephone button is pressed). The operation sound relationship is provided to the determination unit 120 in advance. For example, the determination unit 120 determines the operation on a telephone button by determining which button was pressed and the order in which the buttons were pressed (i.e., information on the pressed buttons in chronological order, or in other words, the time series of the pressed buttons). The information on which button was pressed and the order in which the buttons were pressed is referred to as the information on the pressed button.

[0036] The communication support device 10 may initially be configured to receive an acoustic signal representing identification information entered using the buttons on the telephone. In this case, if the determination unit 120 determines that the first acoustic signal received after a call with the telephone has started is not an operation sound signal, the processing unit 130, described later, may play an audio prompt to input identification information. The determination unit 120 may determine the identification information from the acoustic signal, which is an operation sound signal, received after the playback of the audio prompting the input of identification information has started.

[0037] Specifically, the determination unit 120 determines the user's identification information from the information of the pressed button (i.e., the information of the execution operation described above), which is determined from the acoustic signal first received from the telephone after the connection with the telephone (in other words, a call with the telephone) has started. The user's identification information may be represented by numbers, for example. The determination unit 120 may use as the identification information a sequence of numbers entered from the time the input of numbers representing the identification information starts until just before a character (for example, "#") indicating the end of the input of the identification information is entered.

[0038] Identification information may be represented by alphabetic characters. In this case, the relationship between one or more input number sequences and alphabetic characters (hereinafter referred to as alphabetic conversion relationships) may be predetermined. The alphabetic conversion relationships may be set appropriately so that each alphabetic character is represented by a different number sequence. For example, the alphabetic conversion relationships may be set so that, for example, one "2" represents "a", two consecutive "2"s represent "b", three consecutive "2"s represent "c", and one "3" represents "d". The alphabetic conversion relationships include the relationships between other number sequences and other alphabetic characters. The alphabetic characters used in identification information may be lowercase. The alphabetic characters used in identification information may be uppercase. The alphabetic characters used in identification information may be both lowercase and uppercase. The alphabetic characters used in identification information may include symbols. In addition, a character (for example, "*") may be defined to represent the separator between number sequences (in other words, the separator between a number sequence representing one alphabetic character and a number sequence representing another character). In this case, the determination unit 120 may use an alphabet conversion relationship to determine the alphabet string represented by the sequence of numbers entered from the time the input of numbers representing the identification information begins until just before the character indicating the end of the input of identification information (for example, "#") is entered. The determination unit 120 may use the determined alphabet string as the identification information.

[0039] Identification information may be represented by a string of kana characters (i.e., at least one of hiragana and katakana). In this case, the relationship between one or more input number sequences and kana characters (hereinafter referred to as kana conversion relationships) may be predetermined. Kana conversion relationships may be predetermined as appropriate so that each kana character is represented by a different number sequence. For example, a kana conversion relationship may be set such that one "1" represents "あ", two consecutive "1"s represent "い", three consecutive "1"s represent "う", and one "2" represents "か". Kana conversion relationships include relationships between other number sequences and other kana characters. The kana characters used in identification information may be hiragana. The kana characters used in identification information may be katakana. The kana characters used in identification information may be both hiragana and katakana. The characters used in identification information may include symbols. Furthermore, a character (for example, "*") may be defined to represent a separator between sequences of numbers (in other words, a separator between a sequence of numbers representing one kana character and a sequence of numbers representing another character). In this case, the determination unit 120 may use the kana conversion relationship to determine the kana string represented by the sequence of numbers entered from the time the input of numbers representing the identification information begins until just before the character (for example, "#") indicating the end of the input of the identification information is entered. The determination unit 120 may use the determined kana string as the identification information.

[0040] Furthermore, the processing unit 130, described later, may be configured to play a voice prompting the user to input identification information (in other words, to send an audio signal of a voice prompting the user to input identification information to the telephone) when a connection to the telephone (in other words, a call with the telephone) is initiated. The determination unit 120 may determine the input command and input text described below after the user's identification information has been determined.

[0041] The determination unit 120 may perform user authentication. In this case, the determination unit 120 extracts authentication information from the acoustic signal received after the acoustic signal representing identification information. The determination unit 120 may use the sequence of numbers from the number entered immediately after the character indicating the end of input of identification information (e.g., "#") is entered, to the number entered immediately before the character indicating the end of input of authentication information (e.g., "#") is entered, as the sequence of numbers representing authentication information. Authentication information may be, for example, a PIN represented by a sequence of numbers. In this case, the determination unit 120 determines that the sequence of numbers representing authentication information is a PIN entered as authentication information. Authentication information may be, for example, a password represented by a string of letters. In this case, the determination unit 120 determines that the string of letters represented by the sequence of numbers representing authentication information is authentication information. In this case, the determination unit 120 uses the above-described alphabet conversion relationship to determine the string of letters represented by the sequence of numbers representing authentication information. Authentication information may be, for example, a password represented by a string of kana characters. In this case, the determination unit 120 determines that the kana string represented by the sequence of numbers representing the authentication information is the authentication information. In this case, the determination unit 120 uses the kana conversion relationship described above to determine the kana string represented by the sequence of numbers representing the authentication information.

[0042] The determination unit 120 compares the determined authentication information with the pre-registered authentication information of the user represented by the determined identification information. If the determined authentication information matches the pre-registered authentication information of the user represented by the determined identification information, the determination unit 120 determines that the user represented by the determined identification information is operating the telephone. In other words, if the determined authentication information matches the pre-registered authentication information of the user represented by the determined identification information, the determination unit 120 determines that authentication was successful. If the determined authentication information does not match the pre-registered authentication information of the user represented by the determined identification information, the determination unit 120 determines that authentication failed. If authentication is determined to have failed, the processing unit 130 may play an audio message indicating that authentication has failed. If authentication is determined to have failed, the reception unit 110 may further terminate the call with the telephone. If authentication is determined to have been successful, the reception unit 110 may accept a new audio signal from the telephone. The determination unit 120 may then perform a determination on the received new acoustic signal to determine whether it is an input command or input text, as described later.

[0043] Furthermore, the processing unit 130, described later, may be configured to play a voice prompting the user to enter authentication information after the user has entered identification information (in other words, to send an audio signal of the voice prompting the user to enter authentication information to the telephone). Then, as described above, the determination unit 120 may determine the user's authentication information and, after successful authentication using the authentication information, determine the input command and input text as described below.

[0044] In determining whether an input command or input text is represented (i.e., determining whether an acoustic signal represents an input command or input text), the determination unit 120 determines whether the information of the pressed button is one of the predetermined input commands. In other words, the determination unit 120 determines whether the information of the pressed button corresponds to the information of a button pressed when inputting a predetermined input command.

[0045] If the information of the pressed button matches the information of one of the buttons pressed when entering a predetermined input command, the determination unit 120 determines that the acoustic signal represents an input command. In this case, the determination unit 120 determines that the input command represented by the information of the pressed button has been entered.

[0046] If the information of the pressed button does not correspond to any of the predetermined information of buttons pressed when inputting an input command entered by a button, the determination unit 120 determines that the acoustic signal represents input text. In this case, the determination unit 120 uses the operation acoustic relationship to determine (in other words, estimate) the string represented by the information of the pressed button. The string represented by the information of the pressed button is a string of numbers and symbols (e.g., "*" and "#") indicating the pressed buttons, in the order in which the buttons were pressed. From the string represented by the information of the pressed button, the determination unit 120 determines the input text in kana characters, for example using the kana conversion relationship described above. The determination unit 120 may also be configured to determine the input text in alphabetic characters from the string represented by the information of the pressed button, for example using the alphabetic conversion relationship described above.

[0047] If the acoustic signal is determined to be a voice signal and not a push tone acoustic signal (i.e., an operation sound signal), the determination unit 120 recognizes the text represented by the voice represented by the acoustic signal by voice recognition (i.e., one of the existing voice recognition technologies). The text recognized by voice recognition is referred to as the recognized text.

[0048] The determination unit 120 determines whether the recognized text is one of the predetermined input commands that are entered by voice. The text of an input command entered by voice may be different from the text represented by the time sequence of buttons pressed, which represents an input command entered by a button that instructs the same operation as the input command.

[0049] The determination unit 120 may determine the user's identification information from the recognition text recognized from the first acoustic signal received from the telephone after the connection to the telephone (in other words, a call with the telephone) is initiated. As described above, for example, the processing unit 130 described later may be configured to play an audio prompt for the input of identification information (in other words, to send an audio signal of an audio prompt for the input of identification information to the telephone) when the connection to the telephone (in other words, a call with the telephone) is initiated. After the user's identification information has been determined, the determination unit 120 may perform the following determination of the input command and input text.

[0050] If the recognized text is one of the predetermined input commands that are input by voice, the determination unit 120 determines that the acoustic signal represents an input command. The determination unit 120 then determines that the input command represented by the recognized text has been input.

[0051] If the recognized text is not one of the predetermined voice-input commands, the determination unit 120 determines that the acoustic signal represents the input text. The determination unit 120 determines that the input text represented by the recognized text has been input.

[0052] The determination unit 120 may perform the above-described sound type determination (i.e., determination of whether or not the sound signal is a push tone sound signal) whenever a predetermined re-determination condition, which is a condition for performing sound type determination, is met. The re-determination condition may include, for example, the sound signal strength falling below a predetermined strength for a predetermined time, the sound being played back, the voice recognition failing, and the determination of the sound signal using the operation sound relationship failing. The re-determination condition is not limited to these examples.

[0053] <Processing Unit 130> If the acoustic signal is a signal representing input text, the processing unit 130 adds the input text to the transmission message, which is the message to be transmitted. If no transmission message exists, the processing unit 130 may generate a new transmission message with empty content and add the input text to the generated transmission message.

[0054] If the acoustic signal is a signal representing an input command, the processing unit 130 processes the transmission message according to the input command. Thus, the input command may be an instruction to process the transmission message. The input command may also be an instruction to process the received message, which is a received message. In other words, the input command may be an instruction to process a message (i.e., at least one of the transmission message or the received message). The input command may also be an instruction to play back an explanation of the operation (for example, the input command and the content of the instructions given by the input command). An instruction to play back an explanation of the operation means sending an audio signal to the telephone that represents the explanation of the operation as spoken audio.

[0055] As described above, the input command may be an operation command that, for example, indicates an instruction to manipulate a message (in other words, an instruction to operate on a message). An operation command may be, for example, an instruction to create a new outgoing message. If the input command is an instruction to create a new outgoing message, the processing unit 130 generates a new outgoing message. An operation command may be, for example, an instruction to read out the outgoing message, an instruction to send the outgoing message, an instruction to read out the received message, an instruction to read out the recipient of the outgoing message, or an instruction to read out the sender of the received message. In this case, the processing unit 130 performs the process of reading out the object to be read out (for example, the outgoing message, the received message, the recipient of the outgoing message, or the sender of the received message). Note that reading out means sending an audio signal to the telephone that represents the voiced audio of the object to be read out. The object to be read out is, for example, the outgoing message, the received message, the recipient of the outgoing message, the sender of the received message, etc. The telephone that receives the audio signal outputs the audio indicated by the audio signal. As a result, the telephone outputs the voiced audio of the object to be read out. The operation command may, for example, be an instruction to reply to a received message. If the input command is an instruction to reply to a received message, the processing unit 130 generates a message to send as a reply to the received message. That is, the processing unit 130 generates a message to send to, for example, the sender of the received message. In this case, the received message from which the reply is generated is, for example, the received message that was last read aloud. If there is no message to send that was last read aloud, the received message from which the reply is generated may, for example, be the most recent received message.

[0056] An input command may be a modification command, for example, a command that modifies the outgoing message (in other words, a command that makes changes to the outgoing message). Modification commands include, for example, commands to add a fixed text (in other words, a predetermined string) to the outgoing message, commands to delete characters, commands to delete sentences, and commands to undo the previous deletion. If the input command is a modification command, the processing unit 130 modifies the message to be sent according to the modification command (for example, adding standard text, deleting characters, deleting sentences, or undoing the previous deletion). A modification command that instructs the addition of standard text to the message to be sent is also referred to as a shortened input command. A shortened input command is a command that adds standard text, which is predetermined text, to the message to be sent. Multiple different shortened input commands may be predetermined. The standard text instructed to be added by different shortened input commands may be different texts.

[0057] The abbreviated input commands and the standard text added by the abbreviated input commands may be predetermined by, for example, the administrator of the communication support device 10. The abbreviated input commands and the standard text added by the abbreviated input commands may be predetermined for each user. A user may, for example, use an information processing device that is communicably connected to the communication support device 10 to pre-set the abbreviated input commands and the standard text added by the abbreviated input commands. The abbreviated input commands may be set so that the length of the text representing the modification command (also referred to as the command string) is shorter than the length of the standard text that the abbreviated input command instructs to add. An instruction to delete a character may be, for example, an instruction to delete the last character of the message to be sent. An instruction to delete a sentence may be, for example, an instruction to delete the last sentence of the message to be sent.

[0058] The input command may also be an instruction to terminate. If the input command is an instruction to terminate, for example, the processing unit 130 sends an instruction to the reception unit 110 to terminate the call with the telephone. When the reception unit 110 receives the instruction to terminate the call with the telephone, it terminates the call with the telephone.

[0059] Input commands are not limited to the examples above. Input commands do not have to include at least one of the examples above.

[0060] <Other examples of input commands> An input command may include input commands that are configured to be entered with the values ​​of one or more parameters. The input commands that are entered with parameter values ​​may be predetermined. Hereafter, input commands that are entered with parameter values ​​will be referred to as parameterized input commands.

[0061] If the input command is a parameterized input command, the determination unit 120 may use the text following the input command as the parameter value. The number of characters in the parameter value may be predetermined depending on the type of parameterized input command. There may be parameterized input commands for which the number of characters in the parameter value is not predetermined. For example, a character indicating the end of the parameter value (e.g., * or #) may be predetermined. The determination unit 120 may then use the string from the character following the parameterized input command for which the number of characters in the parameter value is not predetermined, up to the character before the character indicating the end of the parameter value, as the string representing the parameter value. The determination unit 120 extracts a predetermined number of strings representing the parameter values ​​for that input command from the string following the input command determined from the acoustic signal.

[0062] A parameterized input command may, for example, be an instruction to add a destination or an instruction to delete a destination. If the parameterized input command is an instruction to add a destination, the parameter is the destination to be added. The value of the parameter is information indicating the destination to be added. The information indicating the destination to be added is, for example, a character (or string) associated with the destination. Information representing the destination and the character (or string) associated with the destination is registered in advance for each user. The determination unit 120 adds the destination associated with the character (or string) represented by the parameter value to the destination of the outgoing message. If the parameterized input command is an instruction to delete a destination, the parameter is, for example, the destination to be deleted from among the destinations of the outgoing message. The value of the parameter when the parameterized input command is an instruction to delete a destination is, for example, a number representing the order of the destinations to be deleted from among the destinations of the outgoing message. In this case, the processing unit 130 deletes the destination in the order indicated by the parameter value from the destinations of the outgoing message.

[0063] A parameterized input command may be an instruction to delete a specified number of characters, or an instruction to delete a specified number of sentences. If the parameterized input command is an instruction to delete a specified number of characters, the parameter is, for example, the number of characters to delete. In this case, the value of the parameter is, for example, a number indicating the number of characters to delete. The processing unit 130 deletes the number of characters indicated by the parameter value from the end of the message to be sent. If the parameterized input command is an instruction to delete a specified number of sentences, the parameter is, for example, the number of sentences to delete. In this case, the value of the parameter is a number indicating the number of sentences to delete. The processing unit 130 deletes the number of sentences indicated by the parameter value from the end of the message to be sent.

[0064] A parameterized input command may also be an instruction to add a fixed text containing the information represented by the parameter to the outgoing message. Hereafter, an instruction to add a fixed text containing the information represented by the parameter to the outgoing message will also be referred to as a parameterized abbreviated input command. The information represented by the parameter may be, for example, a name, date, time, or location. The information entered as a parameter is not limited to these examples. There may be multiple parameters. There may be one parameter. The value of a parameter is represented by a string that can be entered by the telephone (at least one of the characters "number", "*", and "#"). The processing unit 130 then uses the relationship between the parameter value and the information represented by the parameter (specifically, the information indicated by the parameter value) (hereinafter referred to as conversion information) to identify the information represented by the parameter from the parameter value. The information represented by the parameter is represented by text. Hereafter, the information represented by the parameter will be referred to as parameter text. The processing unit 130 converts the parameter value into parameter text.

[0065] In the standard text added by the parameterized abbreviated input command described above, the location where the string represented by the parameter is embedded is predetermined. If the input command is a parameterized abbreviated input command, the processing unit 130 adds standard text to the end of the transmission message, in which the string represented by the parameter (i.e., the parameter text) is embedded in the predetermined location. Multiple different parameterized abbreviated input commands may be predetermined. Standard texts to be added by different parameterized abbreviated input commands may be different texts.

[0066] For example, when the parameter represents a date, the value of the parameter may be a character string in which a character string representing the year number, a character string representing the month, and a character string representing the day are concatenated. The character string representing the year number is, for example, a 4-digit numerical sequence representing the year number of the Gregorian calendar (e.g., 2024, etc.; hereinafter denoted as YYYY). The character string representing the month is a 2-digit numerical sequence representing the order of the months in a year (e.g., any one of 01, 02, ···, 12; hereinafter denoted as MM). The character string representing the day is, for example, a 2-digit numerical sequence representing the date (e.g., any one of 01, 02, ···, 31; hereinafter denoted as DD). And the value of the parameter may be an 8-digit numerical sequence represented by YYYYMMDD. In this case, the conversion information may represent a conversion rule for replacing an 8-digit numerical sequence represented by, for example, YYYYMMDD with a character string such as "YYYY year MM month DD day". Specifically, such a conversion rule is a rule for inserting the character "year" between the 4th digit and the 5th digit of a numerical sequence containing 8 digits, inserting the character "month" between the 6th digit and the 7th digit, and adding the character "day" after the 8th digit. The conversion rule in this case may also include a rule for replacing it with a character string (e.g., when the numerical sequence where MM starts with "0", deleting "0", and when the numerical sequence where DD starts with "0", deleting "0"). The processing unit 130 converts an 8-digit number (a sequence of 8 digits), which is the value of the parameter, into a parameter text in a format such as "YYYY year MM month DD day". Note that the conversion rule may be defined so as to convert a 4-digit numerical sequence representing the year of the Gregorian calendar into a text representing the year represented by the year number (e.g., Reiwa R year, etc. (where R is a numerical digit of 1 or more)). Then, the processing unit 130 adds the text in which the parameter text is embedded at a predefined location in the fixed-form text to the transmission message.

[0067] For example, if a parameter represents a location, the parameter value may be a sequence of numbers associated with a string representing the location (or a sequence of characters that can be entered by the telephone; here, both sequences of numbers and sequences of characters that can be entered by the telephone are collectively referred to as a sequence of numbers). The location may be, for example, a place name. The location may be, for example, the name of a conference room. The location may be the name of a building. The location is not limited to these examples. The sequence of numbers associated with the string representing the location is a sequence of a predetermined number of numbers. In this case, the conversion information described above is a combination of the sequence of numbers and the string representing the location that the sequence of numbers represents. This conversion information may be defined for each user. This conversion information may be defined for each organization using the communication support device 100. The processing unit 130 uses the conversion information to identify the string representing the location associated with the predetermined number of numbers, which is the value of the parameter, as the parameter text. Then, the processing unit 130 adds text in which the parameter text is embedded in a predetermined location in the standard text to the message to be sent.

[0068] For example, if a parameter represents a name, the parameter value may be a sequence of numbers associated with a string representing the name. The sequence of numbers associated with the string representing the name is a sequence of a predetermined number of numbers. In this case, the conversion information described above is a combination of the sequence of numbers and the string representing the name that the sequence of numbers represents. This conversion information may be defined for each user. This conversion information may be defined for each organization using the communication support device 100. The processing unit 130 uses the conversion information to identify the string representing the name associated with the sequence of numbers, which is the parameter value, as the parameter text. Then, the processing unit 130 adds text in which the parameter text is embedded in a predetermined location in the standard text to the message to be sent.

[0069] <Second Embodiment> Next, a second embodiment of the present disclosure will be described in detail with reference to the drawings.

[0070] <Structure> First, the configuration of the second embodiment of this disclosure will be described in detail with reference to the drawings.

[0071] Figure 3 is a block diagram showing an example of the configuration of the communication support system related to this disclosure.

[0072] In the following section, an example of the configuration of a communication support system according to the second embodiment of this disclosure will be described in detail with reference to Figure 3.

[0073] In the example shown in Figure 3, the communication support system 1 includes a communication support device 100, a telephone 200, and a message server 300. The communication support device 100 is communicated with both the telephone 200 and the message server 300.

[0074] <Telephone 200> Telephone 200 is a telephone used by the user. Telephone 200 is the same as the telephone in the first embodiment.

[0075] <Message Server 300> The message server 300 is a server that provides a messaging service, enabling multiple users to exchange messages. The messages are, for example, chat messages. The messages may also be other types of messages (e.g., email).

[0076] The message server 300 sends a message addressed to a user to the transmission support device 100 in response to a request from the transmission support device 100. The message server 300 receives a message from the transmission support device 100 in response to a request from the transmission support device 100 and sends the received message to the recipient of that message.

[0077] <Transmission support device 100> Next, the configuration of the transmission support device 100 according to the second embodiment of this disclosure will be described in detail with reference to the drawings.

[0078] Figure 4 is a block diagram showing an example of the configuration of the communication support device according to this disclosure.

[0079] The configuration of the transmission support device 100 according to the second embodiment of this disclosure will be described in detail below with reference to Figure 4.

[0080] In the example shown in Figure 4, the transmission support device 100 includes a reception unit 110, a determination unit 120, a processing unit 130, and an information storage unit 190. The processing unit 130 includes a processing control unit 140, an editing unit 150, a playback unit 160, an acquisition unit 170, and a transmission unit 180.

[0081] <Reception Desk 110> The reception unit 110 receives calls from telephone 200 when a call is made from telephone 200 to a specific telephone number. The reception unit 110 then initiates a call with telephone 200.

[0082] The reception unit 110 receives an audio signal from the telephone 200. The reception unit 110 has the same functions as the reception unit 110 of the first embodiment. The reception unit 110 operates in the same way as the reception unit 110 of the first embodiment. The reception unit 110 also transmits the audio signal generated by the processing unit 130 (specifically, the playback unit 160 which will be described in detail later) to the telephone 200.

[0083] <Judgment unit 120> The determination unit 120 determines whether the acoustic signal is a signal representing the input text or a signal representing the input command. The determination unit 120 has the same functions as the determination unit 120 of the first embodiment (for example, the functions of the determination unit 120 described in the detailed example of the first embodiment). The determination unit 120 operates in the same manner as the determination unit 120 of the first embodiment (for example, the determination unit 120 described in the detailed example of the first embodiment).

[0084] <Processing Unit 130> If the acoustic signal is a signal representing input text, the processing unit 130 adds the input text to the transmission message, which is the message to be transmitted. If the acoustic signal is a signal representing an input command, the processing unit 130 processes the transmission message according to the input command. The processing unit 130 has the same functions as the processing unit 130 of the first embodiment (for example, the functions of the processing unit 130 described in the detailed example of the first embodiment). The processing unit 130 operates similarly to the processing unit 130 of the first embodiment (for example, the processing unit 130 described in the detailed example of the first embodiment).

[0085] As described above, the processing unit 130 includes a processing control unit 140, an editing unit 150, a playback unit 160, an acquisition unit 170, and a transmission unit 180. Each of the parts included in the processing unit 130 will be described in detail later.

[0086] <Information storage section 190> The information storage unit 190 stores information about the input command.

[0087] The input command information may include, for example, information about a combination of an abbreviated input command and standard text to be added to the message sent when the abbreviated input command is entered. The input command information may also include, for example, information about a combination of a parameter value indicating an individual destination and the destination information indicated by that value. The input command information may also include, for example, a combination of an abbreviated input command, standard text in which the information represented by the parameter is embedded, and parameter conversion information. The standard text in which the information represented by the parameter is embedded may include standard text and information that identifies where the above-mentioned parameter text is embedded. The input command information may also include the above-mentioned conversion information that converts the parameter value into parameter text.

[0088] <Processing Control Unit 140> The processing control unit 140 controls the execution of processing in accordance with the input via the telephone 200, which is determined from the acoustic signal.

[0089] Specifically, the processing control unit 140 holds the transmission message if a transmission message has been generated. The processing control unit 140 holds the received message if a received message has been acquired. The processing control unit 140 determines which unit will perform processing according to the input determined from the acoustic signal. The processing control unit 140 transmits an instruction to perform processing represented by the input determined from the acoustic signal, and information used for processing according to the input determined from the acoustic signal, to the unit that will perform processing according to the input determined from the acoustic signal. The information used for processing according to the input determined from the acoustic signal is, for example, the message to be processed (transmission message or received message). The message includes the message body, information to the recipient of the message, and information to the sender of the message. The information used for processing according to the input determined from the acoustic signal may also include, for example, user identification information. The information used for processing according to the input determined from the acoustic signal may also include, for example, user identification information. If the processing according to the input determined from the acoustic signal is a process in which the transmission message is modified, the processing control unit 140 receives the modified transmission message from the unit that modified the transmission message (specifically, the editing unit 150). The processing control unit 140 replaces the original transmission message with the modified transmission message.

[0090] More specifically, for example, if the processing control unit 140 determines from the acoustic signal that the input via the telephone 200 is input text, it instructs the editing unit 150, which will be detailed later, to add the input text to the transmission message. Specifically, the processing control unit 140 sends the transmission message, the input text, and the instruction to add the input text to the transmission message to the editing unit 150. The processing control unit 140 receives the transmission message with the input text added from the editing unit 150.

[0091] Furthermore, if the processing control unit 140 determines from the acoustic signal that the input via the telephone 200 is an input command, it instructs the unit that executes the processing instructed by the input command to execute the processing instructed by the input command.

[0092] Specifically, for example, if the input command is an instruction to read a message aloud, the processing control unit 140 instructs the playback unit 160 to generate an audio signal representing the spoken content of the message that was instructed to be read aloud. More specifically, the processing control unit 140 transmits the message that was instructed to be read aloud and the instruction to generate an audio signal representing the spoken content of the message that was instructed to be read aloud to the playback unit 160.

[0093] As described above, the input command may also be an instruction to play back an explanation of the operation (for example, the input command and the content of the instructions given by the input command). An instruction to play back an explanation of the operation means to send an audio signal to the telephone that represents the spoken explanation of the operation. For example, if the input command is an instruction to play back an explanation of the operation, the processing control unit 140 may send to the playback unit 160 a pre-prepared text of the explanation of the operation and an instruction to play back the text. The text of the explanation of the operation is, for example, a text that explains the command and an overview of the instructions given by the command. When the playback unit 160 receives the text of the explanation of the operation and the instruction to play back the text, it plays back the text of the explanation of the operation. That is, the playback unit 160 sends an audio signal to the telephone 200 that represents the spoken explanation of the text of the explanation of the operation.

[0094] Furthermore, there may be input commands other than the command that instructs the playback of an overview of the operation (hereinafter also referred to as the operation help command) that instruct the playback of the operation explanation (hereinafter referred to as the help command). For example, there may be a help command that plays the value of a parameter indicating the destination and the destination information indicated by that value (for example, referred to as the destination help command). If the input command is a destination help command, the processing control unit 140 sends a predetermined text (hereinafter referred to as the destination parameter text) representing the value of the parameter indicating the destination and the destination information indicated by that value, along with an instruction to play that text, to the playback unit 160. When the playback unit 160 receives the destination parameter text and the instruction to play the destination parameter text, it plays the destination parameter text. That is, the playback unit 160 sends an audio signal of the destination parameter text converted into voice to the telephone 200.

[0095] For example, if abbreviated input commands are defined for each user, the text describing the operation may also be defined for each user. The text describing the operation may be set when the abbreviated input commands are configured. If the input command is a help command, the processing control unit 140 may generate the text describing the operation using the command information stored in the information storage unit 190.

[0096] For example, if the combination of a destination and the value of a parameter indicating the destination is defined for each user, the destination parameter text, which represents the value of the parameter indicating the destination and the destination information indicated by that value, may also be defined for each user. The destination parameter text may be set when the destination and the value of the parameter indicating the destination are set. If the input command is a destination help command, the processing control unit 140 may generate the destination help text using the command information stored in the information storage unit 190.

[0097] For example, if the input command is an instruction to retrieve a new message, the processing control unit 140 instructs the retrieval unit 170 to retrieve a new message addressed to the user from the message server 300. The processing control unit 140 may also instruct the retrieval unit 170 to retrieve a new message addressed to the user indicated by the determined identification information, in accordance with the determination of the user's identification information on the telephone 200 by the determination unit 120. A new message is a message managed by the message server 300 that has not been read. An unread message is a message that has not been retrieved by the transmission support device 100 (specifically, the retrieval unit 170) and has not been read by any other information processing device. When instructing the retrieval of a new message addressed to the user from the message server 300, the processing control unit 140 specifically transmits the user's identification information and an instruction to retrieve a new received message addressed to the user identified by that identification information to the retrieval unit 170. The processing control unit 140 retrieves incoming messages addressed to the user, which have been acquired from the message server 300 by the acquisition unit 170, from the acquisition unit 170.

[0098] For example, if the input command is an instruction to send a message, the processing control unit 140 instructs the transmission unit 180 to send the message. Specifically, the processing control unit 140 sends the message and the instruction to send the message to the transmission unit 180.

[0099] For example, if the input command is an instruction to modify the message to be sent, the processing control unit 140 instructs the editing unit 150 to modify the message to be sent according to the input command. Specifically, the processing control unit 140 sends the message to be sent and an instruction to make the changes to the message that the input command represents to the message to the editing unit 150. If the input command is a parameterized input command as described above, the processing control unit 140 sends the message to be sent, the parameter values, and an instruction to make the changes to the message that the input command represents to the message to the editing unit 150. The processing control unit 140 receives the modified message to be sent from the editing unit 150. The processing control unit 140 replaces the message it holds with the modified message to be sent.

[0100] If the input command is an input command that instructs the transmission message to be modified (i.e., a modification command), the processing control unit 140 may send the modification command to the editing unit 150 as an instruction to make the modification represented by the input command to the transmission message. If the input command is a parameterized input command, the processing control unit 140 may send the parameterized input command to the editing unit 150 as an instruction to make the modification represented by the input command to the transmission message. The processing control unit 140 sends the transmission message, the parameterized input command, and the parameter values ​​to the editing unit 150.

[0101] If the input command is an instruction to terminate, the processing control unit 140 sends an instruction to terminate the call with telephone 200 (in other words, an instruction to terminate the call with telephone 200) to the reception unit 110. When the reception unit 110 receives the instruction to terminate the call with telephone 200, it terminates the call with telephone 200.

[0102] <Editorial Department 150> The editing unit 150 modifies the message to be sent in response to instructions from the processing control unit 140, as instructed by input commands (i.e., the modification commands described above) that modify the message to be sent. Examples of instructions to modify the message to be sent include instructions to add standard text to the message to be sent, instructions to delete characters, instructions to delete sentences, and instructions to undo the previous deletion. The modification command may also be an input command with parameters as described above. In this case, the editing unit 150 modifies the message to be sent as instructed by the input command with parameters. The editing unit 150 may modify the message to be sent using information stored in the information storage unit 190 (i.e., information of the input commands described above).

[0103] The editorial unit 150 is equipped with a function of the processing unit 130, as described in the detailed example of the first embodiment, to modify the message to be sent when the input command is a change command. The editorial unit 150 performs the operation of the processing unit 130, as described in the detailed example of the first embodiment, to modify the message to be sent when the input command is a change command.

[0104] <Playback section 160> The playback unit 160 generates an audio signal of the message that has been instructed to be played back by the input command, in response to instructions from the processing control unit 140. The generated audio signal is then transmitted to the telephone 200 via the receiving unit 110. This message is either a transmission message or a reception message.

[0105] The playback unit 160 has the function of the processing unit 130, as described in the detailed example of the first embodiment, to read a message when the input command is an instruction to read a message. The playback unit 160 performs the operation of the processing unit 130, as described in the detailed example of the first embodiment, to read a message when the input command is an instruction to read a message. In other words, the playback unit 160 generates an audio signal of the voiced message. The playback unit 160 then transmits the generated audio signal to the telephone 200 via the receiving unit 110.

[0106] Furthermore, when the playback unit 160 receives text (for example, the operation explanation text or destination help text as described above) and an instruction to play that text from the processing control unit 140, it plays the text. In other words, the playback unit 160 generates an audio signal of the text as spoken. The playback unit 160 then transmits the generated audio signal to the telephone 200 via the reception unit 110.

[0107] Furthermore, the playback unit 160 may play an audio prompt for input from the telephone 200 while the transmission support device 100 and the telephone 200 are connected. In other words, the playback unit 160 may generate an audio signal of an audio prompt for input from the telephone 200 and transmit the generated audio signal to the telephone 200.

[0108] The voice prompting input from the telephone 200 is, for example, a voice prompting the input of user identification information. The voice prompting the input of user identification information is, for example, a voice representing a phrase such as "Please enter your identification information." For example, when a call to a predetermined telephone number is accepted, the playback unit 160 may play a voice prompting the telephone 200 that made the request to call the predetermined telephone number to input user identification information. After an acoustic signal representing user identification information is received, the playback unit 160 may play a voice prompting input. The voice prompting input is, for example, a voice explaining basic operations. Basic operations include, for example, reading a new received message (in other words, playing it back), creating a message to send (for example, creating a message to send as a reply to a received message), entering a message to send, and playing an explanation of operations. Basic operations are not limited to these examples. Basic operations do not have to include at least one of these examples.

[0109] The playback unit 160 may play a voice prompt for input if the input from the telephone 200 remains interrupted for a predetermined period of time. The state of interruption of input from the telephone 200 for a predetermined period of time means that the strength of the acoustic signal transmitted from the telephone 200 remains below a predetermined strength for a predetermined period of time. If the receiving unit 110 receives input (for example, an acoustic signal of a predetermined strength or higher) while the playback unit 160 is playing the voice prompt for input, the playback unit 160 may stop playing the voice prompt for input.

[0110] The playback unit 160 may play an audio prompt for parameter input if a predetermined time has elapsed since a parameterized input command was received without a parameter value being entered. The audio prompting parameter input may be, for example, an audio recording of a sentence describing the parameter's outline. Specifically, for example, if a predetermined time has elapsed since a parameterized input command was received without a parameter value being entered, the processing control unit 140 sends text prompting the input of the next parameter and an instruction to play that text to the playback unit 160. When the playback unit 160 receives the text prompting the input of the next parameter and the instruction to play that text, it plays an audio recording of the text prompting the input of the next parameter. Specifically, the playback unit 160 generates an audio signal of the audio recording of the text prompting the input of the next parameter and transmits the generated audio signal to the telephone 200 via the reception unit 110. The text prompting parameter input may be set when the parameterized input command is set. When the parameterized input command is set, information representing the parameter's outline may be stored in the information storage unit 190. Furthermore, if a predetermined time has elapsed since a parameterized input command was entered without any parameter values ​​being entered, the processing control unit 140 may estimate the parameter that is expected to be entered next based on the information from the parameterized input command. The processing control unit 140 may then use information representing an overview of the parameter that is expected to be entered next to generate text prompting the user to enter that parameter.

[0111] The voice prompts that encourage input will also be collectively referred to as guide voices.

[0112] <Acquisition part 170> The acquisition unit 170 acquires messages addressed to the user from the message server 300 in response to instructions from the processing control unit 140. Specifically, upon receiving user identification information and an instruction to acquire a new message, the acquisition unit 170 acquires a new message addressed to the user (i.e., a new received message) from the message server 300.

[0113] <Transmitter 180> The transmission unit 180 transmits the transmission message to the recipient of the transmission message in accordance with instructions from the processing control unit 140. Specifically, the transmission unit 180 instructs the message server 300 to transmit the transmission message to the recipient.

[0114] <Operation> Next, the operation of the second embodiment of this disclosure will be described in detail with reference to the drawings.

[0115] Figures 5, 6, and 7 are flowcharts illustrating examples of the operation of the communication support device according to this disclosure.

[0116] The operation of the communication support device according to the second embodiment of this disclosure will be described in detail below with reference to Figures 5, 6, and 7. The communication support device 100 starts the operation shown in Figure 5 when a call is received at a predetermined telephone number.

[0117] In the example shown in Figure 5, the reception unit 110 receives a call to a predetermined telephone number (step S101). Next, the playback unit 160 plays an audio prompt to input identification information (step S102). In other words, the playback unit 160 transmits an audio signal of the audio prompting the input of identification information to the telephone 200. The reception unit 110 receives an acoustic signal representing the identification information from the telephone 200 (step S103). The determination unit 120 determines whether the received acoustic signal is an audio signal or an operation sound signal (step S104).

[0118] If the acoustic signal is an audio signal (referred to as "audio signal" in step S105), the determination unit 120 uses speech recognition to determine identification information from the acoustic signal. If the acoustic signal is an operation sound signal (referred to as "operation sound signal" in step S105), the determination unit 120 uses operation sound relationships to determine identification information from the acoustic signal (step S107). The transmission support device 100 then performs the operation shown in Figure 6.

[0119] In the example shown in Figure 6, the playback unit 160 then plays an audio prompt for input (step S111). In other words, the playback unit 160 transmits an audio signal of the prompt for input to the telephone 200. The receiving unit 110 receives an audio signal from the telephone 200 (step S112).

[0120] If the acoustic signal is an audio signal (referred to as "audio signal" in step S114), the determination unit 120 uses speech recognition to recognize the recognition text indicated by the acoustic signal (step S115). That is, the determination unit 120 recognizes the recognition text represented by the voice uttered by the user. If the acoustic signal is an operation sound signal (referred to as "operation sound signal" in step S114), the determination unit 120 uses operation sound relationships to recognize the recognition text indicated by the acoustic signal (step S116). That is, the determination unit 120 uses operation sound relationships to identify the string entered by the user using the telephone 200 from the acoustic signal. Here, the string entered by the user using the telephone 200, as identified by the determination unit 120, is also referred to as the recognition text.

[0121] Next, the determination unit 120 determines whether the recognized text is input text or an input command (step S117). The transmission support device 100 then performs the operation shown in Figure 7.

[0122] In the example shown in Figure 7, if the recognized text is the input text (referred to as "input text" in step S121), the processing unit 130 (specifically, the editing unit 150) adds the input text to the transmission message (step S122). The transmission support device 100 then repeats the operations from step S111 onwards, as shown in Figure 6.

[0123] If the recognized text is an input command (referred to as "input command" in step S121), the processing unit 130, for example, determines whether the input command is an instruction to terminate (step S123). If the input command is not an instruction to terminate (referred to as NO in step S124), the processing unit 130 executes the processing according to the input command (step S125). The transmission support device 100 then repeats the operations from step S111 onwards as shown in Figure 6.

[0124] If the input command is an instruction to terminate (YES in step S124), the reception unit 110 terminates the call with the telephone 200 (step S126). Then, the transmission support device 100 terminates the operations shown in Figures 5, 6, and 7.

[0125] Furthermore, if the line to the telephone 200 is disconnected during the operation shown in Figures 5, 6, and 7 (i.e., if the call to the telephone 200 ends), the communication support device 100 will terminate its operation after finishing the processing it is currently performing.

[0126] <Effects> This embodiment has the same effects as the first embodiment. The reason for this is the same as the reason for the effects of the first embodiment.

[0127] <Other Embodiments> A transmission support device according to the embodiments of this disclosure can be implemented by a computer including a memory into which a program read from a storage medium is loaded, and a processor that executes the program. A transmission support device according to the embodiments of this disclosure can also be implemented by dedicated hardware. A transmission support device according to the embodiments of this disclosure can also be implemented by a combination of the aforementioned computer and dedicated hardware.

[0128] Figure 8 is a diagram showing an example of the hardware configuration of a computer 1000 that can realize a communication support device according to the embodiment of this disclosure. In the example shown in Figure 8, the computer 1000 includes a processor 1001, a memory 1002, a storage device 1003, and an I / O (Input / Output) interface 1004. The computer 1000 can also access a storage medium 1005. The memory 1002 and the storage device 1003 are, for example, storage devices such as RAM (Random Access Memory) and hard disks. The storage medium 1005 is, for example, a storage device such as RAM and hard disks, ROM (Read Only Memory), and a portable storage medium. The storage device 1003 may also be the storage medium 1005. The processor 1001 can read and write data and programs to the memory 1002 and the storage device 1003. The processor 1001 can access, for example, a telephone 200 and a message server 300 via the I / O interface 1004. The processor 1001 can access the storage medium 1005. The storage medium 1005 stores a program that causes the computer 1000 to operate as a transmission support device according to the embodiment of this disclosure.

[0129] The processor 1001 loads into the memory 1002 a program stored in the storage medium 1005 that causes the computer 1000 to operate as a transmission support device according to the embodiment of this disclosure. The processor 1001 then executes the program loaded into the memory 1002, causing the computer 1000 to operate as a transmission support device according to the embodiment of this disclosure.

[0130] The reception unit 110, determination unit 120, processing unit 130, processing control unit 140, editing unit 150, playback unit 160, acquisition unit 170, and transmission unit 180 can be implemented, for example, by a processor 1001 that executes a program loaded into memory 1002. The information storage unit 190 can be implemented by a storage device 1003 such as memory 1002 or a hard disk drive included in the computer 1000. Some or all of the reception unit 110, determination unit 120, processing unit 130, processing control unit 140, editing unit 150, playback unit 160, acquisition unit 170, transmission unit 180, and information storage unit 190 can be implemented by dedicated circuits that realize the functions of each unit.

[0131] Furthermore, some or all of the above embodiments may also be described as follows, but are not limited to the following.

[0132] (Note 1) A receiving mechanism for receiving acoustic signals from a telephone, A determination means for determining whether the aforementioned acoustic signal is a signal representing the input text or a signal representing the input command, If the acoustic signal is a signal representing the input text, the processing means adds the input text to the transmission message, which is the message to be transmitted; if the acoustic signal is a signal representing the input command, the processing means performs processing on the transmission message according to the input command. A communication support device equipped with the following features.

[0133] (Note 2) If the input command is a modification command representing an instruction to change the transmission message, the processing means modifies the transmission message according to the instruction represented by the input command, and if the input command is an operation command representing an instruction to perform an operation on the message, the processing means performs the operation represented by the input command on the message. The transmission support device described in Appendix 1.

[0134] (Note 3) The determination means performs a sound type determination to determine whether the acoustic signal is an audio signal representing speech or an operation sound signal generated by an operation on the telephone. If the acoustic signal is an audio signal, it uses speech recognition to determine which of the input text and input command the acoustic signal represents. If the acoustic signal is an operation sound signal, it uses the operation sound relationship, which is the relationship between an operation on the telephone and the sound emitted by the telephone when the operation is performed, to determine which of the input text and input command the acoustic signal represents. A transmission support device as described in Appendix 1 or 2.

[0135] (Note 4) The determination means performs the sound type determination each time a predetermined re-determination condition is met. The transmission support device described in Appendix 3.

[0136] (Note 5) The re-evaluation conditions include any of the following: the strength of the acoustic signal falls below a predetermined strength and a predetermined time elapses; audio playback occurs; speech recognition fails; and the evaluation of the acoustic signal using the operation sound relationship fails. The transmission support device described in Appendix 4.

[0137] (Note 6) The determination means, if the acoustic signal is the voice signal, generates a recognized text from the acoustic signal by voice recognition and determines whether the recognized text represents the input text or the input command. If the acoustic signal is the operation sound signal, it estimates the execution operation that was performed when the acoustic signal was generated, using the relationship between the operation on the telephone and the sound emitted by the telephone when the operation is performed, and determines whether the estimated execution operation represents the input text or the input command. The transmission support device described in Appendix 3.

[0138] (Note 7) The determination means determines that if the recognized text is one of the predetermined commands, the command indicated by the recognized text is the input command, and if the recognized text is not one of the predetermined commands, it determines that the recognized text is the input text. The transmission support device described in Appendix 6.

[0139] (Note 8) The determination means determines that if the operation is one of the predetermined commands, the command indicated by the operation is the input command; if the operation is not one of the predetermined commands, it estimates the text entered by the operation as the input text. The transmission support device described in Appendix 7.

[0140] (Note 9) The aforementioned modification command includes a shortened input command that represents the addition of a predetermined string by a command string shorter than the predetermined string, If the input command is the abbreviated input command, the processing means adds the predetermined string represented by the abbreviated input command to the message. The transmission support device described in Appendix 2.

[0141] (Note 10) The aforementioned modification command includes the abbreviated input command which represents the addition of a parameter and the predetermined string by the command string, The processing means, when the abbreviated input command represents the addition of the parameter and the predetermined string, plays a guide voice prompting the input of the parameter. The receiving means receives the acoustic signal after the guide voice has been played as the acoustic signal representing the parameter, The determination means determines the value of the parameter indicated by the acoustic signal representing the parameter, The processing means adds a string to the message that includes the predetermined string and the value of the parameter inserted at a predetermined position in the predetermined string. The transmission support device described in Appendix 9.

[0142] (Note 11) The determination means determines the user identification information indicated by the acoustic signal, The processing means is If the operation indicated by the input command is to play back a received message, the received message, which is the message received by the user indicated by the identification information, is obtained from the management server that manages the received message, and an audio recording representing the content of the obtained received message is played back. If the operation indicated by the input command is the creation of a new message, then create the message to send, If the operation indicated by the input command is a reply to the received message, the sender of the received message creates the outgoing message to which the recipient is: If the operation indicated by the input command is to play the transmitted message, then the audio representing the content of the transmitted message is played. If the operation indicated by the input command is to send a message, the message to be sent and an instruction to send the message, in which the user indicated by the identification information is the sender, are sent to the management server. A transmission support device as described in Appendix 1 or 2.

[0143] (Note 12) It receives an acoustic signal from the telephone. Determine whether the aforementioned acoustic signal is a signal representing the input text or a signal representing the input command. If the acoustic signal is a signal representing the input text, the input text is added to the transmission message, which is the message to be transmitted. If the acoustic signal is a signal representing the input command, processing is performed on the transmission message according to the input command. Communication support methods.

[0144] (Note 13) If the input command is a modification command representing an instruction to change the message to be sent, the process involves modifying the message to be sent according to the instruction represented by the input command. If the input command is an operation command representing an instruction to perform an operation on the message, the process involves performing the operation represented by the input command on the message. The communication support method described in Appendix 12.

[0145] (Note 14) The system performs a sound type determination to determine whether the sound signal is a voice signal or an operation sound signal generated by an operation on the telephone. If the sound signal is a voice signal, it performs voice recognition to determine which of the input text and input command the sound signal represents. If the sound signal is an operation sound signal, it uses the operation sound relationship, which is the relationship between an operation on the telephone and the sound emitted by the telephone when that operation is performed, to determine which of the input text and input command the sound signal represents. Communication support methods as described in Appendix 12 or 13.

[0146] (Note 15) Each time the predetermined re-evaluation conditions are met, the sound type determination is performed. Communication support methods as described in Appendix 14.

[0147] (Note 16) The re-evaluation conditions include any of the following: the strength of the acoustic signal falls below a predetermined strength and a predetermined time elapses; audio playback occurs; speech recognition fails; and the evaluation of the acoustic signal using the operation sound relationship fails. Communication support methods as described in Appendix 15.

[0148] (Note 17) If the acoustic signal is an audio signal, speech recognition is used to generate a recognized text from the acoustic signal that represents the audio, and it is determined whether the recognized text represents the input text or the input command. If the acoustic signal is an operation sound signal, the relationship between the operation on the telephone and the sound emitted by the telephone when the operation is performed is used to estimate the execution operation that was performed when the acoustic signal was generated, and from the estimated execution operation, it is determined whether the execution operation represents the input text or the input command. Communication support methods as described in Appendix 14.

[0149] (Note 18) If the recognized text is one of the predetermined commands, it is determined that the command indicated by the recognized text is the input command; if the recognized text is not one of the predetermined commands, it is determined that the recognized text is the input text. Communication support methods as described in Appendix 17.

[0150] (Note 19) If the operation is one of the predetermined commands, it is determined that the command indicated by the operation is the input command; if the operation is not one of the predetermined commands, the text entered by the operation is estimated to be the input text. Communication support methods as described in Appendix 18.

[0151] (Note 20) The aforementioned modification command includes a shortened input command that represents the addition of a predetermined string by a command string shorter than the predetermined string, If the input command is the abbreviated input command, the predetermined string represented by the abbreviated input command is added to the message. Communication support methods as described in Appendix 13.

[0152] (Note 21) The aforementioned modification command includes the abbreviated input command which represents the addition of a parameter and the predetermined string by the command string, If the aforementioned abbreviated input command represents the addition of the parameter and the predetermined string, a guide voice prompting the input of the parameter is played. The acoustic signal after the guide audio has been played is received as the acoustic signal representing the parameter. Determine the value of the parameter indicated by the acoustic signal representing the parameter, The message is to be added a string that includes the predetermined string and the value of the parameter inserted at a predetermined position in the predetermined string. Communication support methods as described in Appendix 20.

[0153] (Note 22) The user identification information indicated by the aforementioned acoustic signal is determined, If the operation indicated by the input command is to play back a received message, the received message, which is the message received by the user indicated by the identification information, is obtained from the management server that manages the received message, and an audio recording representing the content of the obtained received message is played back. If the operation indicated by the input command is the creation of a new message, then create the message to send, If the operation indicated by the input command is a reply to the received message, the sender of the received message creates the outgoing message to which the recipient is: If the operation indicated by the input command is to play the transmitted message, then the audio representing the content of the transmitted message is played. If the operation indicated by the input command is to send a message, the message to be sent and an instruction to send the message, in which the user indicated by the identification information is the sender, are sent to the management server. Communication support methods as described in Appendix 12 or 13.

[0154] (Note 23) A reception process that receives an acoustic signal from a telephone, A determination process to determine whether the aforementioned acoustic signal is a signal representing the input text or a signal representing the input command, If the acoustic signal is a signal representing the input text, the process execution process adds the input text to the transmission message, which is the message to be transmitted; if the acoustic signal is a signal representing the input command, the process execution process performs processing on the transmission message according to the input command. A program that causes a computer to execute something.

[0155] (Note 24) If the input command is a modification command representing an instruction to change the transmission message, the process shall modify the transmission message according to the instruction represented by the input command; if the input command is an operation command representing an instruction to perform an operation on the message, the process shall perform the operation represented by the input command on the message. The program described in Appendix 23.

[0156] (Note 25) The determination process performs a sound type determination to determine whether the acoustic signal is an audio signal representing speech or an operation sound signal generated by an operation on the telephone. If the acoustic signal is an audio signal, speech recognition determines whether the acoustic signal represents the input text or the input command. If the acoustic signal is an operation sound signal, the operation sound relationship, which is the relationship between an operation on the telephone and the sound emitted by the telephone when the operation is performed, is used to determine whether the acoustic signal represents the input text or the input command. The program described in Appendix 23 or 24.

[0157] (Note 26) The aforementioned determination process performs the sound type determination each time a predetermined re-determination condition is met. The program described in Appendix 25.

[0158] (Note 27) The re-evaluation conditions include any of the following: the strength of the acoustic signal falls below a predetermined strength and a predetermined time elapses; audio playback occurs; speech recognition fails; and the evaluation of the acoustic signal using the operation sound relationship fails. The program described in Appendix 26.

[0159] (Note 28) The determination process, if the acoustic signal is the voice signal, generates a recognized text from the acoustic signal by voice recognition and determines whether the recognized text represents the input text or the input command. If the acoustic signal is the operation sound signal, it estimates the execution operation that was performed when the acoustic signal was generated, using the relationship between the operation on the telephone and the sound emitted by the telephone when the operation is performed, and determines whether the estimated execution operation represents the input text or the input command. The program described in Appendix 25.

[0160] (Note 29) The determination process determines that if the recognized text is one of the predetermined commands, the command indicated by the recognized text is the input command, and if the recognized text is not one of the predetermined commands, it determines that the recognized text is the input text. The program described in Appendix 28.

[0161] (Note 30) The determination process determines that if the operation is one of the predetermined commands, the command indicated by the operation is the input command; if the operation is not one of the predetermined commands, it estimates the text entered by the operation as the input text. The program described in Appendix 29.

[0162] (Note 31) The aforementioned modification command includes a shortened input command that represents the addition of a predetermined string by a command string shorter than the predetermined string, The aforementioned processing execution process, if the input command is the abbreviated input command, adds the predetermined string represented by the abbreviated input command to the message. The program described in Appendix 24.

[0163] (Note 32) The aforementioned modification command includes the abbreviated input command which represents the addition of a parameter and the predetermined string by the command string, The aforementioned processing execution process, when the abbreviated input command represents the addition of the parameter and the predetermined string, plays a guide voice prompting the input of the parameter. The reception process receives the acoustic signal after the guide voice has been played as the acoustic signal representing the parameter, The determination process determines the value of the parameter indicated by the acoustic signal representing the parameter, The aforementioned processing execution process adds a string to the message that includes the predetermined string and the value of the parameter inserted at a predetermined position in the predetermined string. The program described in Appendix 31.

[0164] (Note 33) The aforementioned determination process determines the user identification information indicated by the acoustic signal, The aforementioned processing execution process is: If the operation indicated by the input command is to play back a received message, the received message, which is the message received by the user indicated by the identification information, is obtained from the management server that manages the received message, and an audio recording representing the content of the obtained received message is played back. If the operation indicated by the input command is the creation of a new message, then create the message to send, If the operation indicated by the input command is a reply to the received message, the sender of the received message creates the outgoing message to which the recipient is: If the operation indicated by the input command is to play the transmitted message, then the audio representing the content of the transmitted message is played. If the operation indicated by the input command is to send a message, the message to be sent and an instruction to send the message, in which the user indicated by the identification information is the sender, are sent to the management server. The program described in Appendix 23 or 24.

[0165] Although the present disclosure has been described above with reference to embodiments, the present disclosure is not limited to the embodiments described above. Various modifications to the structure and details of the present disclosure can be understood by those skilled in the art within the scope of the present disclosure. [Explanation of Symbols]

[0166] 1. Communication Support System 10. Transmission support device 100 Transmission support device 110 Reception Department 120 Judgment section 130 Processing Unit 140 Processing Control Unit 150 Editorial Department 160 Playback Department 170 Acquisition Department 180 Transmitter 190 Information storage section 200 telephones 300 message servers 1000 computers 1001 Processor 1002 memory 1003 Storage device 1004 I / O Interface 1005 Storage medium

Claims

1. A receiving mechanism for receiving acoustic signals from a telephone, A determination means for determining whether the aforementioned acoustic signal is a signal representing the input text or a signal representing the input command, If the acoustic signal is a signal representing the input text, the processing means adds the input text to the transmission message, which is the message to be transmitted; if the acoustic signal is a signal representing the input command, the processing means performs processing on the transmission message according to the input command. A communication support device equipped with the following features.

2. If the input command is a modification command representing an instruction to change the transmission message, the processing means modifies the transmission message according to the instruction represented by the input command, and if the input command is an operation command representing an instruction to perform an operation on the message, the processing means performs the operation represented by the input command on the message. The transmission support device according to claim 1.

3. The determination means performs a sound type determination to determine whether the acoustic signal is an audio signal representing speech or an operation sound signal generated by an operation on the telephone. If the acoustic signal is an audio signal, it uses speech recognition to determine which of the input text and input command the acoustic signal represents. If the acoustic signal is an operation sound signal, it uses the operation sound relationship, which is the relationship between an operation on the telephone and the sound emitted by the telephone when the operation is performed, to determine which of the input text and input command the acoustic signal represents. The transmission support device according to claim 1 or 2.

4. The determination means performs the sound type determination each time a predetermined re-determination condition is met. The transmission support device according to claim 3.

5. The re-evaluation conditions include any of the following: the strength of the acoustic signal falls below a predetermined strength and a predetermined time elapses; audio playback occurs; speech recognition fails; and the evaluation of the acoustic signal using the operational audio relationship fails. The transmission support device according to claim 4.

6. The determination means, if the acoustic signal is the voice signal, generates a recognized text from the acoustic signal by voice recognition and determines whether the recognized text represents the input text or the input command. If the acoustic signal is the operation sound signal, it estimates the execution operation that was performed when the acoustic signal was generated, using the relationship between the operation on the telephone and the sound emitted by the telephone when the operation is performed, and determines whether the estimated execution operation represents the input text or the input command. The transmission support device according to claim 3.

7. The aforementioned modification command includes a shortened input command that represents the addition of a predetermined string by a command string shorter than the predetermined string, If the input command is the abbreviated input command, the processing means adds the predetermined string represented by the abbreviated input command to the message. The transmission support device according to claim 2.

8. The determination means determines the user identification information indicated by the acoustic signal, The processing means is If the operation indicated by the input command is to play back a received message, the received message, which is the message received by the user indicated by the identification information, is obtained from the management server that manages the received message, and an audio recording representing the content of the obtained received message is played back. If the operation indicated by the input command is the creation of a new message, create the message to send, If the operation indicated by the input command is a reply to the received message, the sender of the received message creates the outgoing message to which the recipient is: If the operation indicated by the input command is to play the transmitted message, then the audio representing the content of the transmitted message is played. If the operation indicated by the input command is to send a message, the message to be sent and an instruction to send the message, in which the user indicated by the identification information is the sender, are sent to the management server. The transmission support device according to claim 1 or 2.

9. It receives an acoustic signal from the telephone. Determine whether the aforementioned acoustic signal is a signal representing the input text or a signal representing the input command. If the acoustic signal is a signal representing the input text, the input text is added to the transmission message, which is the message to be transmitted. If the acoustic signal is a signal representing the input command, processing is performed on the transmission message according to the input command. Communication support methods.

10. A reception process that receives an acoustic signal from a telephone, A determination process to determine whether the aforementioned acoustic signal is a signal representing the input text or a signal representing the input command, If the acoustic signal is a signal representing the input text, the process execution process adds the input text to the transmission message, which is the message to be transmitted; if the acoustic signal is a signal representing the input command, the process execution process performs processing on the transmission message according to the input command. A program that causes a computer to execute something.

Images