Program, terminal and method for assisting users who cannot speak during online meetings
The program and terminal assist users in online conferences by converting chat text to voice and using conversation gap detection and similarity calculation to ensure their input is integrated seamlessly into the discussion.
Patent Information
- Application Number
- JP2022014504
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-02-01
- Publication Date
- 2024-11-05
- Estimated Expiration
- 2042-02-01
AI Technical Summary
Participants in online conferences who cannot speak due to their environment often struggle to contribute their opinions, as they may not be noticed in text chats and can miss timely opportunities to speak.
A program and terminal that synthesize and transmit chat text input as voice data at appropriate times, using speech synthesis, conversation gap detection, and similarity calculation to match the conversation flow, with filler audio to assist in speaking opportunities.
Enables users to effectively convey their opinions during online conferences by ensuring their input is heard at the right moments, enhancing participation regardless of their location.
Smart Images

Figure 0007577700000001 
Figure 0007577700000002 
Figure 0007577700000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a technology for an online conference system in which a plurality of users participate using terminals. [Background technology]
[0002] Online conference systems that allow multiple users to hold a conference at the same time using terminals such as smartphones and personal computers are becoming widespread. Videos of multiple users are displayed on the display of the terminal, audio of the conference is output from the terminal's speaker, and the users' speech is picked up by the terminal's microphone. Online conference systems also generally have a function that allows users to post text chats.
[0003] 2. Description of the Related Art Conventionally, there are techniques for achieving smooth communication when a dialogue system that converses with a person speaks by itself. For example, there is a technique in which a dialogue system analyzes the acoustic and linguistic features of the content of a user's utterance to determine the end state of the utterance and the presence or absence of the speaking authority (see, for example, Patent Document 1). This technique enables the dialogue system to detect the appropriate timing to speak to the user. There is also a technique in which a dialogue system expresses its intention to speak by making breathing sounds when it is about to speak, thereby hinting to those around it that it is about to speak (see, for example, Patent Document 2). [Prior art documents] [Non-patent literature]
[0004] [Patent Document 1] JP 2021-051172 A [Patent Document 2] Patent No. 6712303 Summary of the Invention [Problem to be solved by the invention]
[0005] In the case of an online conference system, the members participating in the conference can freely speak and discuss with each other. However, some members may be in an environment where they cannot speak. In such a case, the members usually only listen to the discussions that other members speak. In order to make their own opinions known, they must post them in a text chat, for example.
[0006] FIG. 1 is a schematic diagram of an online conference system in the prior art. According to Fig. 1, during an online conference, it is assumed that users @b and @c are in an environment where they can speak, but user @a is in an environment where he cannot speak. User @a may be traveling by train, for example. User @a in such an environment can hear the discussion of the online conference, but it is difficult for him to speak himself.
[0007] FIG. 2 is a screen diagram of the online conference system corresponding to FIG. According to Figure 2, the following utterances are exchanged during the online conference: " " is the spoken voice data. User @c: "X company's equipment is cheap." User @b: "But company y's management features are excellent." User @a "..." In this case, user @a can write his / her own opinion in the text chat field even during the online conference. {} is the entered chat text. User @c{Even though it is expensive, considering the maintenance, we should choose company y}
[0008] However, even during online meetings, not all participants are always paying attention to the text chat, so not only will your message go unnoticed, but if the topic quickly changes, you will miss the timing altogether.
[0009] In response to this, the inventors of the present application wondered whether it would be possible to assist users who cannot speak during online conferences. In particular, they wondered whether it would be possible to inform all members of the opinions of users who are in an environment where they cannot speak as soon as possible.
[0010] Therefore, an object of the present invention is to provide a program, a terminal, and a method that can assist a user who cannot speak during an online conference. [Means for solving the problem]
[0011] According to the present invention, there is provided a program for causing a computer installed in a terminal that exchanges voice data in real time via an online conference server to function, the program comprising: a chat text input means for accepting input of a chat text by a user's operation; A voice synthesis means for synthesizing chat text into chat voice data; a chat voice data transmission means for transmitting chat voice data to an online conference server at a predetermined timing; to make the computer function 、 When a predetermined timing occurs while the user is inputting chat text to the chat text input means, The chat voice data transmission means transmits chat voice data generated by voice synthesis only for the chat text that has already been input to the online conference server, and The speech synthesis means controls the speech synthesis speech tempo to be slowed down in consideration of the text chat that will be input subsequently. Make your computer function like this It is characterized by: According to the present invention, there is also provided a program for causing a computer installed in a terminal that exchanges voice data in real time via an online conference server to function, the program comprising: a chat text input means for accepting input of a chat text by a user's operation; A voice synthesis means for synthesizing chat text into chat voice data; a chat voice data transmission means for transmitting chat voice data to an online conference server at a predetermined timing; A speech recognition means for converting conference speech data received from an online conference server into speech text; a similarity calculation means for calculating a similarity between appearing word strings as a degree of agreement between the contents of the conversation between the spoken voice text and the chat text; a filler voice data transmitting means for transmitting different filler voice data according to the similarity before the chat voice data transmitting means transmits the chat voice data; to make the computer function The filler audio data transmitting means includes: When the similarity is determined to be equal to or greater than a predetermined threshold, a first filler voice data based on a filler word that is desired to be spoken in accordance with the current topic is transmitted; When the answer is false, a second filler voice data based on a filler word indicating a desire to return to the previous topic is transmitted. The present invention is characterized in that the computer further functions as follows.
[0012] According to another embodiment of the program of the present invention, The method further comprises: detecting a conversation gap during which the speech voice data of the conference received from the online conference server is not received for a predetermined period of time or longer; The chat voice data transmitting means transmits the chat voice data to the online conference server when a conversation gap is detected as the predetermined timing. It is also preferable to function the computer in such a manner.
[0013] According to another embodiment of the program of the present invention, The terminal is further equipped with a microphone that can be turned on / off by the user to pick up the user's speech data, When the microphone is turned off, the voice synthesis means and the chat voice data transmission means function. It is also preferable to function the computer in such a manner.
[0014] According to another embodiment of the program of the present invention, The terminal is further equipped with a motion detection sensor, When the movement detection sensor determines that the user is moving, the voice synthesis means and the chat voice data transmission means function. It is also preferable to make the computer further function as described above.
[0017] According to another embodiment of the program of the present invention, A speech recognition means for converting conference speech data received from an online conference server into speech text; a speech request determination means for determining whether or not a predetermined keyword that requests a speech to the user of the terminal is included in the speech text; It is also preferable to make the computer further function as follows.
[0019] According to the present invention, there is provided a terminal for exchanging voice data in real time via an online conference server, comprising: a chat text input means for accepting input of a chat text by a user's operation; A voice synthesis means for synthesizing chat text into chat voice data; a chat voice data transmission means for transmitting chat voice data to an online conference server at a predetermined timing; Have death, When a predetermined timing occurs while the user is inputting chat text to the chat text input means, The chat voice data transmission means transmits chat voice data generated by voice synthesis only for the chat text that has already been input to the online conference server, and The speech synthesis means controls the speech synthesis speech tempo to be slowed down in consideration of the text chat that will be input subsequently. It is characterized by: According to the present invention, there is also provided a terminal for exchanging voice data in real time via an online conference server, comprising: a chat text input means for accepting input of a chat text by a user's operation; A voice synthesis means for synthesizing chat text into chat voice data; a chat voice data transmission means for transmitting chat voice data to an online conference server at a predetermined timing; A speech recognition means for converting conference speech data received from an online conference server into speech text; a similarity calculation means for calculating a similarity between appearing word strings as a degree of agreement between the contents of the conversation between the spoken voice text and the chat text; a filler voice data transmitting means for transmitting different filler voice data according to the similarity before the chat voice data transmitting means transmits the chat voice data; having The filler audio data transmitting means includes: When the similarity is determined to be equal to or greater than a predetermined threshold, a first filler voice data based on a filler word that is desired to be spoken in accordance with the current topic is transmitted; When the answer is false, a second filler voice data based on a filler word indicating a desire to return to the previous topic is transmitted. It is characterized by:
[0020] According to the present invention, there is provided a chat voice data transmission method for terminals exchanging voice data in real time via an online conference server, comprising the steps of: The terminal is A first step of accepting input of chat text by a user operation; a second step of synthesizing the chat text into chat voice data; a third step of transmitting chat voice data to an online conference server at a predetermined timing; Run death, Regarding the first step, when a predetermined timing occurs while the user is inputting chat text, In the third step, chat voice data generated by voice synthesis only for the chat text already input is transmitted to an online conference server, In the second step, the speech synthesis tempo is slowed down to take into account the text chat that will follow. It is characterized by: According to the present invention, there is also provided a chat voice data transmission method for terminals exchanging voice data in real time via an online conference server, comprising the steps of: The terminal is A first step of accepting input of chat text by a user operation; a second step of synthesizing the chat text into chat voice data; a third step of transmitting chat voice data to an online conference server at a predetermined timing; A fourth step of converting the conference speech voice data received from the online conference server into speech text; A fifth step of calculating a similarity between the word strings appearing in the speech text and the chat text as a degree of agreement between the contents of the conversation; Regarding the third step, before transmitting the chat voice data, a sixth step of transmitting different filler voice data according to the similarity; Run Regarding the sixth step, When the similarity is determined to be equal to or greater than a predetermined threshold, a first filler voice data based on a filler word that is desired to be spoken in accordance with the current topic is transmitted; When the answer is false, a second filler voice data based on a filler word indicating a desire to return to the previous topic is transmitted. It is characterized by: Effect of the Invention
[0021] According to the program, terminal and method of the present invention, it is possible to assist a user who is unable to speak during an online conference. [Brief description of the drawings]
[0022] [Figure 1] FIG. 1 is a schematic diagram of an online conference system according to the prior art. [Diagram 2] FIG. 2 is a screen diagram of the online conference system shown in FIG. 1. [Diagram 3] FIG. 2 is a first functional configuration diagram of a terminal according to the present invention. [Figure 4] FIG. 2 is a screen diagram of the online conference system according to the present invention. [Diagram 5] FIG. 2 is a second functional configuration diagram of a terminal according to the present invention. [Figure 6] FIG. 3 is a third functional configuration diagram of the terminal according to the present invention. [Figure 7] FIG. 4 is an explanatory diagram showing the transmission of filler audio data in the present invention. [Figure 8] FIG. 4 is a fourth functional configuration diagram of a terminal according to the present invention. [Figure 9] FIG. 2 is an explanatory diagram showing detection of a speech request in the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0023] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
[0024] FIG. 3 is a first functional configuration diagram of a terminal according to the present invention. FIG. 4 is a screen diagram of the online conference system according to the present invention.
[0025] 3, terminal 1 is operated by a user who will be a participating member of the online conference. An application for an online conference system is pre-installed in terminal 1. The application of terminal 1 functions as a user interface for the online conference, and also communicates with online conference server 2 to exchange voice data in real time with other members of the conference.
[0026] The terminal 1 has a touch panel display 101, an audio output unit (speaker or audio output terminal) 102, and a microphone 103 as a user interface. The touch panel display 101 displays images of the members participating in the online conference through an application, and also displays an input interface for chat text that can be input by the user (see FIG. 4, for example). The audio output unit 102 outputs audio data uttered between the members participating in the online conference to the user as an audio signal by the application. For example, as shown in Fig. 1, in an environment where the user cannot speak, such as when the user is traveling on a train, the user can use earphones to listen to the discussion between the members of the online conference. Of course, when the user is in an environment where he or she can speak, the audio of the online conference can also be heard from a speaker. The microphone 103 collects voice data uttered by the user who operates the terminal 1. The microphone 103 can be turned on / off by the user. For example, in an environment where the user cannot speak, the microphone 103 is turned off.
[0027] 3, the terminal 1 has a chat text input unit 11, a voice synthesis unit 12, a chat voice data transmission unit 13, a conversation gap detection unit 14, and a chat text transmission unit 15. These functional components are realized by executing a program that causes a computer installed in the terminal to function. The process flow of these functional components can also be understood as a voice data transmission method of the terminal.
[0028] [Chat text input section 11] The chat text input unit 11 accepts input of chat text by a user operation. As shown in FIG. 4, the user can input chat text in the right column. The input chat text is output to the voice synthesis unit 12.
[0029] [Speech synthesis section 12] The voice synthesis unit 12 synthesizes the chat text into chat voice data. This is, for example, an existing technology called Text to Speech, and converts the text into real voice. In particular, the quality of the voice is converted into a voice that sounds natural, like a human speaking. At this time, it is preferable to generate a synthetic voice that is close to the characteristics of the user's voice (male / female, high / low pitch, etc.). The synthesized chat voice data is output to the chat voice data transmission unit 13.
[0030] [Chat voice data transmission part 13] The chat voice data sending unit 13 sends the chat voice data to the online conference server 2 at a predetermined timing. Here, the "predetermined timing" may be a suitable timing for a user to speak, using techniques such as those disclosed in Patent Documents 1 and 2 described above as conventional techniques.
[0031] According to the display screen of the online conference in Fig. 4, chat text entered by user @a is displayed in the right column, and a synthetic voice that sounds like user @a is spoken at a predetermined timing. The synthetic voice spoken during the online conference can be heard by other members as if it were spoken by user @a.
[0032] 3, it is preferable that the voice synthesis unit 12 and the chat voice data transmission unit 13 function only when the microphone is turned off. If the microphone is turned off, it can be determined that the user @a is in an environment where he or she cannot speak, even though he or she is participating in an online conference.
[0033] [Conversation Gap Detection Unit 14] The conversation gap detection unit 14 detects a "conversation gap" when conference speech voice data received from the online conference server 2 has not been received for a predetermined period of time or more. That is, it detects a moment (a gap) during a conference when the discussion among multiple members stops for an instant. This moment is deemed to be a suitable timing for the user to speak. This moment is notified to the chat voice data transmission unit 13 as a predetermined timing. Thereby, the chat voice data sending unit 13 sends the chat voice data to the online conference server 2 when a conversation gap is detected as the predetermined timing.
[0034] [Chat text sending part 15] The chat text transmission unit 15 transmits the chat text to the online conference server 2. The chat text transmission unit 15 may function only when the microphone is off, or may function normally whether the microphone is on or off.
[0035] As another embodiment of Fig. 3, the predetermined timing may occur while the user is inputting chat text. In such a case, the chat voice data sending unit 13 may send chat voice data that is generated by voice synthesis only for the chat text that has already been input to the online conference server 2. Whether chat text is being input can also be determined based on whether a character input interface is active. For example, when the chat text input screen is at the top, the character input interface may also be active.
[0036] According to Fig. 4, for example, the following can be spoken during an online conference: " " is spoken voice data, and {} is input chat text. User @c: "X company's equipment is cheap." User @b: "But company y's management features are excellent." User @a{Even though it's expensive, considering the maintenance,}... <Detecting conversation gaps> User @a: "Even though it's expensive, when you consider the maintenance..." In this way, for example, during a gap in conversation (predetermined timing), the user can quickly speak out the opinion that he or she inputted in the chat text during the conference.
[0037] At this time, it is also preferable that the voice synthesis unit 12 controls the speech synthesis to slow down the speech tempo, taking into consideration the text chat that will be input subsequently. User @a{Even though it's expensive, considering the maintenance,} <Detecting conversation gaps> User @a: "It may be expensive, but considering the maintenance..." User @a{select company y} User @a: "Select company y" *Slow speech tempo User @a{should} User @a: "Yes, you should." In this way, for example, by slowing down the speech tempo of the voice synthesis, it is possible to assist in the slowness of the user's chat text. In other words, even if the pauses in speech are extended, the user can speak the opinions he is inputting in the chat text as much as possible in the conference. For example, the voice synthesis unit 12 temporarily buffers the input chat text and converts it into synthetic voice, but it may also be a unit that detects the free space of this buffer. The closer the buffer is to being empty, the slower the input of the user's chat text is, so voice synthesis is performed to slow down the speech tempo.
[0038] FIG. 5 is a second functional configuration diagram of the terminal according to the present invention.
[0039] 5, compared to FIG. 3, the terminal 1 is further equipped with a movement detection sensor 104. The movement detection sensor 104 may be an acceleration sensor or a positioning sensor such as a GPS (Global Positioning System). This allows the terminal 1 to determine that it is in an environment where the user cannot speak in a conference. The voice synthesis unit 12 and the chat voice data transmission unit 13 function when the movement detection sensor 104 determines that the user is moving.
[0040] FIG. 6 is a third functional configuration diagram of a terminal according to the present invention.
[0041] 6, compared to FIG. 3, a voice recognition unit 16, a similarity calculation unit 17, and a filler voice data transmission unit 18 are further included.
[0042] [Voice Recognition Section 16] The speech recognition unit 16 converts the utterance voice data of the conference received from the online conference server 2 into utterance voice text. The converted utterance voice text is output to the similarity calculation unit 17.
[0043] [Similarity calculation unit 17] The similarity calculation unit 17 calculates the similarity of the word strings that appear as a degree of agreement between the conversation content of the spoken voice text (text spoken by other members in the conference) and the chat text (text entered by a user who is in an environment where he or she cannot speak). This is a common language processing technique that breaks down a text into multiple words using morphological analysis, converts each text into a vector, and then determines whether the similarity between the vectors is equal to or greater than a predetermined threshold.
[0044] For example, each unique word can be vectorized using Word2vec (registered trademark). "Word2vec" refers to a technology that compresses the dimension by expressing words as vectors in order to grasp the meaning and grammar of the words. Alternatively, it may be possible to use Bag of Words to express only the frequency of occurrence of each word contained in a sentence as a vector. Of course, it is preferable to compare the similarity between the entire text (group of unique words) rather than the match rate between the unique words.
[0045] It is not limited to Word2vec or Bag of Words, but may be possible to convert each word into a feature vector by analyzing the part of speech or the meaning of each word. For the spoken voice text, topic segmentation may be performed by, for example, TextTiling, and the segmented text may be vectorized. S(a,b)=cosθ=(Va·Vb) / (|Va||Vb|) S(a,b): Cosine similarity Va: Text of speech by other members of the meeting Vb: Chat text entered by the user The cosine similarity S(a, b) is a value between 0 and 1, and the higher the similarity, the closer it is to 1.
[0046] [Filler audio data transmission section 18] A filler voice data transmitting unit 18 transmits different filler voice data according to the degree of similarity before the chat voice data transmitting unit 13 transmits the chat voice data. Here, "filler" means something that fills in or fills something up, and in the field of language, it refers to words and phrases such as "um," "ah," and "hmm" that are inserted semi-unconsciously between gaps in a conversation. In the present invention, fillers are words that are spoken before speaking in a meeting.
[0047] The filler audio data transmitting unit 18 uses different fillers as follows depending on whether the similarity is equal to or greater than a predetermined threshold (true) or not (false). True: If the similarity is equal to or greater than a predetermined threshold, it means that the topic of the speech text of other members in the conference is the same as the chat text entered by the user. In that case, the first filler speech data based on the filler words that the user wishes to make in line with the current topic is sent. For example, "May I make a comment?", "Can I just say something?", etc. False: If the similarity is not greater than the threshold, it means that the topic of the chat text entered by the user is behind the speech text of other members in the meeting. In this case, a second filler voice data based on a filler word that indicates a desire to return to the previous topic is sent. For example, "May I make a comment about the previous matter?", "I'm going back," etc.
[0048] Of course, if the user has not yet completed inputting chat text despite the fact that filler voice data has been sent, it is preferable to prompt the user to complete input on the text input screen, so that the user can express their opinions in the conference as quickly as possible.
[0049] FIG. 7 is an explanatory diagram showing the transmission of filler audio data in the present invention.
[0050] According to Fig. 7(a), filler voice data is sent, for example, as follows: " " is spoken voice data, and {} is input chat text. User @c: "It's expensive, but considering the maintenance..." User @b: "Company Y's management features are excellent." User @a{Even though it is expensive, considering the maintenance, we should choose company y} *The speech text of other members in the conference and the chat text of user @a are determined to have a high degree of similarity (above a predetermined threshold). User@a (filler audio data) "May I speak?" User @a: "Even though it's expensive, I think you should choose company y, considering the maintenance."
[0051] According to FIG. 7(b), for example, filler audio data is transmitted as follows: User @c: "It's expensive, but considering the maintenance..." User @b: "Company Y's management features are excellent." User @c: "By the way, how's the situation with company w going?" User @b: "I've already contacted W company." User @a{Even though it is expensive, considering the maintenance, we should choose company y} *The speech text of other members in the conference and the chat text of user @a are determined to have a low similarity (less than a predetermined threshold). User@a (filler audio data) "May I speak about what we discussed earlier?" User @a: "Even though it's expensive, I think you should choose company y, considering the maintenance."
[0052] FIG. 8 is a fourth functional configuration diagram of the terminal according to the present invention.
[0053] 8, compared to Fig. 3, further includes a voice recognition unit 16 and a speech request determination unit 19. The voice recognition unit 16 is the same as that described above.
[0054] [Speech request determination section 19] The speech request determination unit 19 determines whether or not the uttered voice text contains a predetermined keyword that requests the user of the terminal to make a speech. The predetermined keyword may be registered in advance for each user.
[0055] FIG. 9 is an explanatory diagram showing detection of a speech request in the present invention.
[0056] 9, for example, a user's name [a] is registered in the speech request determination unit 19. For example, assume that the following spoken voice text is detected. " " is the spoken voice data, and {} is the input chat text. User @c: "X company's equipment is cheap." User @b: "But company y's management features are excellent." User @a{Even though it is expensive, considering the maintenance, we should choose company y} User @c: "What do you think, a?" At this time, the speech request determination unit 19 detects [a] and determines that a request to speak has been made to the user @a in the conference. Then, the speech request determination unit 19 instructs the chat voice data transmission unit 13 to transmit chat voice data. Then, chat voice data in the form of synthetic voice like the following will be spoken in the conference. User @c: "Even though it's expensive, if you consider the maintenance, you should choose company y."
[0057] As described above in detail, the program, terminal, and method of the present invention can assist users who cannot speak during an online conference. In particular, the opinions of users who are in an environment where they cannot speak can be communicated to all members as timely as possible.
[0058] Furthermore, this will make it possible, for example, to "provide online meetings regardless of where the user is," which will contribute to Goal 8 of the United Nations Sustainable Development Goals (SDGs) "Promote inclusive and sustainable economic growth, employment and decent work for all."
[0059] Regarding the various embodiments of the present invention described above, various changes, modifications, and omissions within the scope of the technical idea and perspective of the present invention can be easily made by those skilled in the art. The above description is merely an example and is not intended to be restrictive in any way. The present invention is limited only by the scope of the claims and their equivalents. [Explanation of symbols]
[0060] 1 Device 101 Touch Panel Display 102 Audio output section 103 Mike 104 Motion detection sensor 11 Chat text input section 12 Voice synthesis section 13 Chat voice data transmission unit 14 Conversation gap detection unit 15 Chat text sending section 16 Voice Recognition Unit 17 Similarity calculation part 18 Filler audio data transmission section 19 Comment Request Determination Department 2. Online conference server
Claims
1. A program for causing a computer installed in a terminal that exchanges voice data in real time via an online conference server to function, a chat text input means for accepting input of a chat text by a user's operation; A voice synthesis means for synthesizing chat text into chat voice data; a chat voice data transmission means for transmitting chat voice data to an online conference server at a predetermined timing; to make the computer function, When a predetermined timing occurs while the user is inputting chat text to the chat text input means, The chat voice data transmission means transmits chat voice data generated by voice synthesis only for the chat text that has already been input to the online conference server, and The speech synthesis means controls the speech synthesis speech tempo to be slowed down in consideration of the text chat that will be input subsequently. A program that causes a computer to function in such a manner.
2. A program for causing a computer installed in a terminal that exchanges voice data in real time via an online conference server to function, a chat text input means for accepting input of a chat text by a user's operation; A voice synthesis means for synthesizing chat text into chat voice data; a chat voice data transmission means for transmitting chat voice data to an online conference server at a predetermined timing; A speech recognition means for converting conference speech data received from an online conference server into speech text; a similarity calculation means for calculating a similarity between appearing word strings as a degree of agreement between the contents of the conversation between the spoken voice text and the chat text; a filler voice data transmitting means for transmitting different filler voice data according to the similarity before the chat voice data transmitting means transmits the chat voice data; to make the computer function The filler audio data transmitting means includes: When the similarity is determined to be equal to or greater than a predetermined threshold, a first filler voice data based on a filler word that is desired to be spoken in accordance with the current topic is transmitted; When the answer is false, a second filler voice data based on a filler word indicating a desire to return to the previous topic is transmitted. A program for causing a computer to further function as described above.
3. The method further comprises: detecting a conversation gap during which the speech voice data of the conference received from the online conference server is not received for a predetermined period of time or longer; The chat voice data transmitting means transmits the chat voice data to the online conference server when a conversation gap is detected as the predetermined timing.
3. The program according to claim 1, further comprising: a program for causing a computer to function as described above.
4. The terminal further includes a microphone that can be turned on / off by a user's operation to collect the user's speech data; When the microphone is turned off, the voice synthesis means and the chat voice data transmission means function.
4. The program according to claim 1, further comprising: a program for causing a computer to function in such a manner as to:
5. The terminal is further equipped with a motion detection sensor, When the movement detection sensor determines that the user is moving, the voice synthesis means and the chat voice data transmission means function.
4. The program according to claim 1, further causing the computer to function as follows:
6. A speech recognition means for converting conference speech data received from an online conference server into speech text; a speech request determination means for determining whether or not a predetermined keyword that requests a speech to the user of the terminal is included in the speech text; 6. The program according to claim 1, further causing the computer to function as follows:
7. A terminal for exchanging voice data in real time via an online conference server, a chat text input means for accepting input of a chat text by a user's operation; A voice synthesis means for synthesizing chat text into chat voice data; a chat voice data transmission means for transmitting chat voice data to an online conference server at a predetermined timing; having When a predetermined timing occurs while the user is inputting chat text to the chat text input means, The chat voice data transmission means transmits chat voice data generated by voice synthesis only for the chat text that has already been input to the online conference server, and The speech synthesis means controls the speech synthesis speech tempo to be slowed down in consideration of the text chat that will be input subsequently. A terminal characterized by:
8. A terminal for exchanging voice data in real time via an online conference server, a chat text input means for accepting input of a chat text by a user's operation; A voice synthesis means for synthesizing chat text into chat voice data; a chat voice data transmission means for transmitting chat voice data to an online conference server at a predetermined timing; A speech recognition means for converting conference speech data received from an online conference server into speech text; a similarity calculation means for calculating a similarity between appearing word strings as a degree of agreement between the contents of the conversation between the spoken voice text and the chat text; a filler voice data transmitting means for transmitting different filler voice data according to the similarity before the chat voice data transmitting means transmits the chat voice data; having The filler audio data transmitting means includes: When the similarity is determined to be equal to or greater than a predetermined threshold, a first filler voice data based on a filler word that is desired to be spoken in accordance with the current topic is transmitted; When the answer is false, a second filler voice data based on a filler word indicating a desire to return to the previous topic is transmitted. A terminal characterized by:
9. A chat voice data transmission method for terminals exchanging voice data in real time via an online conference server, comprising: The terminal is A first step of accepting input of chat text by a user operation; a second step of synthesizing the chat text into chat voice data; a third step of transmitting chat voice data to the online conference server at a predetermined timing; Run In the first step, when a predetermined timing occurs while the user is inputting chat text, In the third step, chat voice data generated by voice synthesis only for the chat text already input is transmitted to the online conference server, In the second step, the speech synthesis tempo is controlled to be slower, taking into account the text chat that will follow. A chat voice data transmission method for a terminal, comprising:
10. A chat voice data transmission method for terminals exchanging voice data in real time via an online conference server, comprising: The terminal is A first step of accepting input of chat text by a user operation; a second step of synthesizing the chat text into chat voice data; a third step of transmitting chat voice data to the online conference server at a predetermined timing; A fourth step of converting the conference speech voice data received from the online conference server into speech voice text; a fifth step of calculating a similarity between appearing word strings as a degree of agreement between the conversation contents of the spoken voice text and the chat text; A sixth step of transmitting different filler voice data according to the similarity before transmitting the chat voice data for the third step; Run Regarding the sixth step, When the similarity is determined to be equal to or greater than a predetermined threshold, a first filler voice data based on a filler word that is desired to be spoken in accordance with the current topic is transmitted; When the answer is false, a second filler voice data based on a filler word indicating a desire to return to the previous topic is transmitted. A chat voice data transmission method for a terminal, comprising:
Citation Information
Patent Citations
Communication system for building speech database for speech synthesis, relay device therefor, and relay method therefor
CN101515455A
Data communication controller, control method therefor and data communication system
JP2000023132A
System, device and method for processing speech
JP2004336292A
Call terminal, multi-user call system, multi-user call method, and program
JP2007243392A
Voice synthesis call system, communication terminal, and voice synthesis call method
JP2015231083A
