Information processing device, information processing method, and information processing program

Abstract

To provide a technology that enables a smooth electronic conference.SOLUTION: An information processing device used in a web conference system is provided with an acquisition unit, a voice recognition unit, a determination unit, and a voice output control unit. The acquisition unit acquires voice data based on input via an input device. The voice recognition unit performs voice recognition based on the voice data acquired by the acquisition unit. The determination unit determines whether the recognition result by the voice recognition unit satisfies a predetermined condition. The voice output control unit controls output of voice data via a network based on the determination result by the determination unit.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] An embodiment of the present invention relates to an information processing device, an information processing method, and an information processing program. [Background technology]

[0002] Electronic conference systems, such as video conference systems and web conference systems, which use multiple information processing devices connected via a network, are widely used. In electronic conference systems, if you want to stop audio output from a microphone, you usually need to manually stop the microphone.

[0003] In such an electronic conference system, if you forget to turn off the microphone when you do not want to communicate audio, private speech or confidential information that you do not want to transmit to other participants will be broadcast to all participants. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Special Publication No. 2013-534650 Summary of the Invention [Problem to be solved by the invention]

[0005] The problem to be solved by the embodiments of the present invention is to provide a technology that can prevent specific words from being transmitted and realize a smooth electronic conference. [Means for solving the problem]

[0006] In one embodiment, an information processing device used in a Web conferencing system includes an acquisition unit, a voice recognition unit, a determination unit, and a voice output control unit. The acquisition unit acquires voice data based on input via an input device. The voice recognition unit performs voice recognition based on the voice data acquired by the acquisition unit. The determination unit determines whether the recognition result by the voice recognition unit satisfies a predetermined condition. The voice output control unit controls output of the voice data via a network based on the determination result by the determination unit. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a block diagram illustrating a Web conference system according to an embodiment. [Figure 2] FIG. 2 is a diagram illustrating an example of the data structure of a keyword database included in the server according to the embodiment. [Figure 3] FIG. 3 is a flowchart illustrating an example of a procedure of a sound output control process by the first information processing apparatus according to the embodiment. [Figure 4] FIG. 4 is a diagram schematically illustrating an example of a vector space of a related word group according to the embodiment. [Figure 5] FIG. 5 is a diagram schematically illustrating another example of a vector space of related word groups according to the embodiment. [Figure 6] FIG. 6 is a flowchart illustrating the procedure of the related word group database generation process performed by the first information processing apparatus according to the embodiment. [Figure 7] FIG. 7 is a flowchart illustrating another example of the procedure of the audio output control process by the first information processing apparatus according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0008] Hereinafter, an embodiment will be described with reference to the drawings.

[0009] Hereinafter, the embodiments will be described with reference to the drawings. In the drawings, the same components are denoted by the same reference numerals whenever possible, and duplicated explanations will be omitted. FIG. 1 is a block diagram illustrating a Web conference system 100 according to an embodiment. The Web conference system 100 includes a server 1, a first information processing device 2, and a second information processing device 3. The server 1, the first information processing device 2, and the second information processing device 3 are connected to each other via a network so as to be able to communicate with each other freely. For example, the network is configured from one or more networks selected from various networks such as the Internet, a mobile communication network, and a LAN (Local Area Network). The one or more networks may include a wireless network or a wired network. Note that the Web conference system 100 may also refer to a system including at least two devices selected from the server 1, the first information processing device 2, and the second information processing device 3.

[0010] The server 1 is an electronic device that collects and processes data. The electronic device includes a computer. The server 1 is communicatively connected to a first information processing device 2 or a second information processing device 3 via a network. The first information processing device 2 and the second information processing device 3 are used, for example, by different users in different locations. The server 1 receives various data from the first information processing device 2 and the second information processing device 3, and outputs various data to the first information processing device 2 or the second information processing device 3. An example configuration of the server 1 will be described later.

[0011] The first information processing device 2 is an electronic device capable of communicating with other electronic devices. The first information processing device 2 is, for example, a device used by a participant in a web conference. For example, the first information processing device 2 is a PC (Personal Computer), a smartphone, a tablet terminal, or the like. The participant may be read as a user or a person. The first information processing device 2 is an example of an information processing terminal. An example configuration of the first information processing device 2 will be described later.

[0012] The second information processing device 3 is an electronic device capable of communicating with other electronic devices. The second information processing device 3 is, for example, a device used by a host or participant of a web conference. For example, the second information processing device 3 is a PC, a smartphone, a tablet terminal, or the like. The host or participant may be read as a user or a person. The second information processing device 3 is an example of an information processing terminal. An example configuration of the second information processing device 3 will be described later.

[0013] In the following description, when simply referring to an "information processing device," it may refer to either the first information processing device 2 or the second information processing device 3, or it may refer collectively to the first information processing device 2 and the second information processing device 3.

[0014] An example of the configuration of the server 1 will be described. The server 1 is an electronic device that includes a processor 11, a main memory 12, an auxiliary storage device 13, and a communication interface 14. The components that make up the server 1 are connected to each other so that signals can be input and output. In FIG. 1, the interface is indicated as "I / F."

[0015] The processor 11 corresponds to the central part of the server 1. The processor 11 is an element that constitutes the computer of the server 1. For example, the processor 11 is a CPU (Central Processing Unit), but is not limited to this. The processor 11 may be composed of various circuits. The processor 11 loads a program that is pre-stored in the main memory 12 or the auxiliary storage device 13 into the main memory 12. The program is a program that causes the processor 11 of the server 1 to realize each unit described below and execute the function of each unit. The processor 11 performs various operations by executing the program loaded into the main memory 12.

[0016] The main memory 12 corresponds to the main storage portion of the server 1. The main memory 12 is an element that constitutes the computer of the server 1. The main memory 12 includes a non-volatile memory area and a volatile memory area. The main memory 12 stores an operating system or programs in the non-volatile memory area. The main memory 12 uses the volatile memory area as a work area where data is rewritten by the processor 11 as appropriate. For example, the main memory 12 includes a ROM (Read Only Memory) as a non-volatile memory area. For example, the main memory 12 includes a RAM (Random Access Memory) as a volatile memory area. The main memory 12 stores programs.

[0017] The auxiliary storage device 13 corresponds to the auxiliary storage portion of the server 1. The auxiliary storage device 13 is an element that constitutes the computer of the server 1. The auxiliary storage device 13 is an EEPROM (registered trademark) (Electric Erasable Programmable Read-Only Memory), an HDD (Hard Disc Drive), an SSD (Solid State Drive), or the like. The auxiliary storage device 13 stores the above-mentioned programs, data used by the processor 11 when performing various processes, and data generated by the processes in the processor 11. The auxiliary storage device 13 stores the above-mentioned programs.

[0018] The auxiliary storage device 13 stores information about users of the first information processing device 2 and the second information processing device 3 who participate in a Web conference provided by the Web conference system 100. The user information includes user identification information, identification information of the information processing device used by the user, etc. The user identification information is unique identification information assigned to each user to identify the user individually. The information processing device identification information is unique identification information assigned to each information processing device to identify the information processing device individually. The information processing device identification information includes the IP address of the information processing device, etc.

[0019] The communication interface 14 includes various interfaces that connect the server 1 to other electronic devices via a network in accordance with a predetermined communication protocol so that they can communicate with each other.

[0020] The hardware configuration of the server 1 is not limited to the above configuration, and the server 1 allows the omission or modification of the above components and the addition of new components as appropriate.

[0021] An example of the configuration of the first information processing device 2 will be described. The first information processing device 2 is an electronic device including a processor 21, a main memory 22, an auxiliary storage device 23, a communication interface 24, a display device 25, a speaker 26, an input device 27, a microphone 28, and a camera 29. The components constituting the first information processing device 2 are connected to each other so as to be able to input and output signals.

[0022] The processor 21 corresponds to the central part of the first information processing device 2. The processor 21 is an element that constitutes the computer of the first information processing device 2. The processor 21 has the same hardware configuration as the above-mentioned processor 11. The processor 21 performs various operations by executing programs that are stored in advance in the main memory 22 or the auxiliary storage device 23.

[0023] The main memory 22 corresponds to the main storage portion of the first information processing device 2. The main memory 22 is an element that constitutes the computer of the first information processing device 2. The main memory 22 has the same hardware configuration as the above-mentioned main memory 12. The main memory 22 stores programs.

[0024] The auxiliary storage device 23 corresponds to the auxiliary storage portion of the first information processing device 2. The auxiliary storage device 23 is an element that constitutes the computer of the first information processing device 2. The auxiliary storage device 23 has the same hardware configuration as the above-mentioned auxiliary storage device 13. The auxiliary storage device 23 stores the above-mentioned programs.

[0025] The auxiliary storage device 23 stores information about the user of the first information processing device 2. The user information includes user identification information, identification information of the first information processing device 2, etc. The user identification information is unique identification information assigned to each user to identify the user individually. The identification information of the first information processing device 2 is unique identification information assigned to each first information processing device 2 to identify the first information processing device 2 individually. The identification information of the first information processing device 2 includes the IP address of the first information processing device 2, etc.

[0026] The auxiliary storage device 23 includes a keyword storage area 230. The keyword storage area 230 stores at least one keyword database (DB). The keyword DB is data including at least one specific word. The specific word indicates, for example, a word that is not desired to be transmitted to other participants. The specific word indicates, for example, negative words, inappropriate words, undesirable words, words containing confidential information, etc. The specific word is also referred to as a keyword. For example, the keyword DB may be composed of specific words with high versatility. The specific words with high versatility indicate words that are not desired to be transmitted to other participants regardless of the type of conference. Examples of the specific words with high versatility include "long-winded," "hungry," "sleepy," and "bored." The keyword DB may be managed in association with the type of conference. In this case, the specific words may include words that are not desired to be transmitted to other participants based on the type of conference, as well as words unrelated to the type of conference. The type of conference may include types based on, for example, industry, participants, agenda, topic, theme, etc. If the type of meeting is "industry," the keyword DB may be associated with, for example, "food service industry," "construction industry," etc. If the type of meeting is "participants," the keyword DB may be associated with, for example, "board of directors meeting," "departmental meeting," "external meeting," etc. If the type of meeting is "agenda," the keyword DB may be associated with, for example, "planning meeting," "sales report," etc. Specifically, if the type of meeting is "construction industry," the corresponding keyword DB includes keywords that are not closely related to the content of the meeting, such as "hungry" and "menu." The keyword DB may be associated with at least one type of meeting. The keyword DB may be set in advance, or may be set or updated as appropriate by an administrator, etc. In the following description, "words" may be interpreted as words, phrases, clauses, and sentences. Furthermore, "words, etc." includes words, phrases, clauses, clauses, and sentences.

[0027] The auxiliary storage device 23 includes a related word group storage area 231. The related word group storage area 231 stores at least one related word group database (DB). The related word group DB includes a related word group consisting of at least one related word. The related words indicate, for example, frequently used words in meetings, words related to the content of the meeting, etc. The related word group DB may be set for each type of meeting. The related word group DB is data in which each related word is associated with a word vector. The word vector is also called a word embedding. The word vector is a quantification of related words using known techniques such as Bag of Words and Word2Vec. Words included in a related word group are words with a short distance between them. Words with a short distance between them indicate words with a high degree of similarity between them. The distance between words is also called the similarity between words. The distance or similarity of words included in a related word group may be any value. The related word group DB may be set in advance, or may be set or updated as appropriate by an administrator, etc. The related word group DB may be generated during an ongoing meeting. In this case, a related word group DB may be generated by the conversion unit 212, which will be described later. The conversion unit 212 may store only words that are close to the related word group in the related word group DB. The related word group DB may include multiple related word groups. In the following description, "word" may be read as a word, phrase, clause, section, or sentence. Furthermore, "words, etc." includes words, phrases, clauses, sections, and sentences.

[0028] The communication interface 24 includes various interfaces that connect the first information processing device 2 to other devices via a network in accordance with a predetermined communication protocol so that the first information processing device 2 can communicate with other devices.

[0029] The display device 25 is a device capable of displaying various screens under the control of the processor 21. For example, the display device 25 is a liquid crystal display or an EL (Electroluminescence) display.

[0030] The speaker 26 is a device that can output sound under the control of the first information processing device 2.

[0031] The input device 27 is a device that can input data or instructions to the first information processing device 2. For example, the input device 27 includes a keyboard, a touch panel, or the like.

[0032] The microphone 28 is a device that can input voice to the first information processing device 2. For example, the microphone 28 may be a built-in microphone or an external microphone. The microphone 28 is an example of an input device.

[0033] The camera 29 is a device capable of acquiring photographic data of a photographic range. For example, the camera 29 may be a built-in camera or an external camera.

[0034] The hardware configuration of the first information processing device 2 is not limited to the above-described configuration. The first information processing device 2 may appropriately omit or change the above-described components and add new components.

[0035] Each unit implemented in the above-mentioned processor 21 will now be described.

[0036] The processor 21 realizes an acquisition unit 210, a voice recognition unit 211, a conversion unit 212, a determination unit 213, and a voice output control unit 214. Each unit realized in the processor 21 can also be referred to as each function. Each unit realized in the processor 21 can also be referred to as being implemented in a control unit including the processor 21 and the main memory 22.

[0037] The acquisition unit 210 acquires voice data corresponding to speech by the user of the first information processing device 2 based on input via the microphone 28. The acquisition unit 210 acquires voice data output via the speaker 26. The voice data output via the speaker 26 corresponds to voice data corresponding to speech by the user of the second information processing device 3 acquired from the second information processing device 3 via the communication interface 24. In the following description, "acquire" may be read as "receive".

[0038] The speech recognition unit 211 performs speech recognition based on the speech data acquired by the acquisition unit 210. The speech recognition includes, for example, converting the speech data into text data, segmenting the text data, and extracting words from the text data using known techniques. The speech recognition unit 211 may store the recognition result in the auxiliary storage device 23. The recognition result indicates, for example, text data based on the speech data.

[0039] The conversion unit 212 vectorizes the recognition result by the speech recognition unit 211. Vectorization includes, for example, using known technology to digitize text data based on its features. The features of the text data include the meaning, frequency of occurrence, importance, etc. of segmented words, etc. The vectorized words, etc. are mapped to coordinates in a multidimensional space. The conversion unit 212 may store the conversion result in the auxiliary storage device 23. The conversion result indicates, for example, the vectors of words, etc. included in the recognition result. The conversion unit 212 may update the corresponding related word group DB in real time every time it obtains a conversion result.

[0040] The determination unit 213 determines whether the recognition result by the speech recognition unit 211 satisfies a predetermined condition. In one example, the predetermined condition is that the recognition result contains a keyword. In another example, the predetermined condition is whether the distance between the conversion result by the conversion unit 212 and a predetermined word group is equal to or greater than a threshold. The predetermined word group is, for example, at least one related word group included in a related word group DB.

[0041] The audio output control unit 214 controls the output of audio data to the second information processing device 3 via the network based on the determination result by the determination unit 213. The audio output control unit 214 stops the output of audio data via the network based on the determination by the determination unit 213 that the recognition result by the audio recognition unit 211 satisfies a predetermined condition. The audio output control unit 214 may stop the output of only audio data corresponding to the recognition result that satisfies the predetermined condition. For example, when the determination unit 213 determines that the recognition result "long talk" satisfies the predetermined condition, the audio output control unit 214 may stop the output of audio data corresponding to "long talk." The audio output control unit 214 may stop the microphone 28 based on the determination by the determination unit 213 that the recognition result satisfies the predetermined condition. Stopping the microphone 28 includes changing the microphone 28 to a mute mode. For example, when the determination unit 213 determines that the recognition result "long talk" satisfies the predetermined condition, the audio output control unit 214 may stop the microphone 28. The audio output control unit 214 outputs audio data via a network when the determination unit 213 determines that the recognition result by the audio recognition unit 211 does not satisfy a predetermined condition. In the following description, "output" may be read as "transmit."

[0042] An example of the configuration of the second information processing device 3 will be described. The second information processing device 3 is an electronic device including a processor 31, a main memory 32, an auxiliary storage device 33, a communication interface 34, a display device 35, a speaker 36, an input device 37, a microphone 38, and a camera 39. The components constituting the second information processing device 3 are connected to each other so as to be able to input and output signals.

[0043] The processor 31 corresponds to the central part of the second information processing device 3. The processor 31 is an element that constitutes the computer of the second information processing device 3. The processor 31 has the same hardware configuration as the above-mentioned processor 11. The processor 31 performs various operations by executing programs that are pre-stored in the main memory 32 or the auxiliary storage device 33. Like the processor 21, the processor 31 realizes an acquisition unit 210, a voice recognition unit 211, a conversion unit 212, a determination unit 213, and a voice output control unit 214.

[0044] The main memory 32 corresponds to the main storage portion of the second information processing device 3. The main memory 32 is an element that constitutes the computer of the second information processing device 3. The main memory 32 has the same hardware configuration as the above-mentioned main memory 12. The main memory 32 stores programs.

[0045] The auxiliary storage device 33 corresponds to the auxiliary storage portion of the second information processing device 3. The auxiliary storage device 33 is an element that constitutes the computer of the second information processing device 3. The auxiliary storage device 33 has the same hardware configuration as the above-mentioned auxiliary storage device 13. The auxiliary storage device 33 stores the above-mentioned programs.

[0046] The auxiliary storage device 33 stores information about the user of the second information processing device 3. The user information includes user identification information, identification information of the second information processing device 3, etc. The user identification information is unique identification information assigned to each user to identify the user individually. The identification information of the second information processing device 3 is unique identification information assigned to each second information processing device 3 to identify the second information processing device 3 individually. The identification information of the second information processing device 3 includes the IP address of the information processing device, etc.

[0047] The auxiliary storage device 33, like the auxiliary storage device 23, includes a keyword storage area and a related word group storage area.

[0048] The communication interface 34 includes various interfaces that connect the second information processing device 3 to other devices so that they can communicate with each other via a network in accordance with a predetermined communication protocol.

[0049] The display device 35 is a device capable of displaying various screens under the control of the processor 31. For example, the display device 35 is a liquid crystal display or an EL display.

[0050] The speaker 36 is a device that can output sound under the control of the second information processing device 3.

[0051] The input device 37 is a device that can input data or instructions to the second information processing device 3. For example, the input device 37 includes a keyboard, a touch panel, or the like.

[0052] The microphone 38 is a device that can input voice to the second information processing device 3. For example, the microphone 38 may be a built-in microphone or an external microphone. The microphone 38 is an example of an input device.

[0053] The camera 39 is a device capable of acquiring photographic data of a photographic range. For example, the camera 39 may be a built-in camera or an external camera.

[0054] The hardware configuration of the second information processing device 3 is not limited to the above-described configuration. The second information processing device 3 allows the omission or modification of the above-described components and the addition of new components as appropriate.

[0055] An example of the configuration of the keyword database will be described. FIG. 2 is a diagram illustrating an example of the data structure of a keyword database included in the server 1 according to the embodiment.

[0056] The keyword DB includes at least one specific word. FIG. 2 shows a keyword DB associated with the meeting type "external meeting." The keyword DB shown in FIG. 2 includes keywords that you do not want to transmit to other participants, keywords that you do not want to transmit to external participants, etc. Specifically, it includes examples of keywords that you do not want to transmit to other participants, such as "too long to talk" and "I'm hungry," and examples of keywords that you do not want to transmit to external participants, such as "XX expenses." The server 1 updates the keyword DB as appropriate.

[0057] An example of the procedure of the audio output control process by the first information processing device 2 will be described. In the following description focusing on the server 1, the server 1 may be read as the processor 11. Similarly, in the following description focusing on the first information processing device 2, the first information processing device 2 may be read as the processor 21. In the following process, it is assumed that users of the first information processing device 2 and the second information processing device 3 participate in a web conference. The users of the first information processing device 2 and the second information processing device 3 log in to the web conference and transmit audio data between them.

[0058] The processing procedures described below are merely examples, and each process may be modified as much as possible. Furthermore, steps may be omitted, replaced, or added as appropriate depending on the embodiment.

[0059] FIG. 3 is a flowchart showing an example of the procedure of the audio output control process by the first information processing device 2 according to the embodiment.

[0060] First, the user of the first information processing device 2 selects a keyword DB to be used in a web conference. In the following process, it is assumed that the user of the first information processing device 2 participates in, for example, an external conference and uses the keyword DB shown in Fig. 2. In this example, the first information processing device 2 performs audio output control processing based on audio data uttered by the user of the first information processing device 2.

[0061] The acquisition unit 210 acquires voice data corresponding to speech by the user of the first information processing device 2 based on input via the microphone 28 (ACT1).

[0062] The voice recognition unit 211 performs voice recognition based on the voice data acquired by the acquisition unit 210 (ACT2). In ACT2, for example, the voice recognition unit 211 converts the voice data into text data. The voice recognition unit 211 acquires the text data as a recognition result. The voice recognition unit 211 may segment the text data into the smallest unit, such as a word. In this case, the voice recognition unit 211 may acquire the segmented words as an authentication result. The voice recognition unit 211 may store the recognition result in the auxiliary storage device 23.

[0063] The determination unit 213 determines whether the recognition result by the voice recognition unit 211 satisfies a predetermined condition (ACT 3). In ACT 3, for example, the determination unit 213 acquires the recognition result. The determination unit 213 determines whether the recognition result includes a keyword based on the keyword DB.

[0064] If the determination unit 213 determines that the recognition result includes a keyword (ACT3: YES), the process transitions from ACT3 to ACT4. If the determination unit 213 determines that the recognition result does not include a keyword (ACT3: NO), the process transitions from ACT3 to ACT5. The audio output control unit 214 controls the output of audio data to the second information processing device 3 via the network, based on the determination result by the determination unit 213.

[0065] The audio output control unit 214 controls the output of audio data via the network based on the determination by the determination unit 213 that the recognition result satisfies a predetermined condition (ACT4). In ACT4, for example, the audio output control unit 214 stops output of audio data to the second information processing device 3 via the network based on the determination by the determination unit 213 that the recognition result includes a keyword. In this case, the audio output control unit 214 stops output of only audio data corresponding to words, etc., in the recognition result that match the keyword. For example, a case will be described where the recognition result includes "long talk." Since the recognition result includes words, etc., that match the keyword "long talk" included in the keyword DB, the audio output control unit 214 stops output of audio data corresponding to "long talk" to the second information processing device 3. Note that the audio output control unit 214 may stop the microphone 28 in response to the determination that the recognition result includes a keyword.

[0066] The audio output control unit 214 outputs the audio data via the network based on the determination by the determination unit 213 that the recognition result does not satisfy a predetermined condition (ACT 5). In ACT 5, for example, the audio output control unit 214 outputs the audio data to the second information processing device 3 via the network based on the determination by the determination unit 213 that the recognition result does not include a keyword.

[0067] We will explain the vector space of related word groups. FIG. 4 is a diagram schematically illustrating an example of a vector space of a related word group according to the embodiment.

[0068] Figure 4 illustrates a vector space of a related word group included in a related word group DB associated with the meeting type "construction industry." The related word group includes frequently used words in meetings related to the "construction industry," as well as words related to the content of the meetings. For example, the related word group includes "construction," "building," "land," etc. Words included in the related word group are arranged in a multidimensional vector space as shown in Figure 4. Words included in the related word group are highly similar, so they are arranged in the same direction and form a single set. In Figure 4, the related word group is represented by a set surrounded by a dashed line. For example, words not included in the related word group, such as "long-winded," "hungry," and "XX cost," are arranged away from the set of related words.

[0069] FIG. 5 is a diagram schematically illustrating another example of a vector space of related word groups according to the embodiment.

[0070] FIG. 5 illustrates a vector space of a related word group included in a related word group DB associated with the meeting type "food service industry." The related word group includes frequently used words in meetings related to the "food service industry" and words related to the content of the meetings. For example, the related word group includes "spicy," "menu," and "hungry." In FIG. 5, the related word group is indicated by a set surrounded by a dashed line. For example, words not included in the related word group, such as "long-winded" and "XX cost," are positioned away from the related word group. The related word group DB associated with the meeting type "food service industry" differs from the related word group DB associated with the meeting type "construction industry" shown in FIG. 4 in that the related word group includes "hungry." Therefore, in FIG. 4, "hungry" is positioned away from the related word group, whereas when the related word group DB of FIG. 5 is used, "hungry" is positioned so as to be included in the related word group.

[0071] Although a two-dimensional space is shown in FIGS. 4 and 5, the present invention is not limited to this, and the related word group may be arranged in any multi-dimensional space.

[0072] The procedure of the related word group database generation process performed by the first information processing device 2 will be described. In the following description focusing on the server 1, the server 1 may be read as the processor 11. Similarly, in the following description focusing on the first information processing device 2, the first information processing device 2 may be read as the processor 21. In the following process, it is assumed that users of the first information processing device 2 and the second information processing device 3 participate in a web conference. The users of the first information processing device 2 and the second information processing device 3 log in to the web conference and transmit voice data between them. The first information processing device 2 acquires voice data corresponding to an utterance by the user of the second information processing device 3 output from the speaker 26, and generates a related word group DB. The voice data corresponding to the utterance by the user of the second information processing device 3 is obtained by executing a voice output control process by the second information processing device 3 that is similar to the voice output control process by the first information processing device 2 described below. Therefore, it is assumed that the voice data corresponding to the utterance by the user of the second information processing device 3 does not include voice data having word vectors located away from the set of related word groups.

[0073] The processing procedures described below are merely examples, and each process may be modified as much as possible. Furthermore, steps may be omitted, replaced, or added as appropriate depending on the embodiment.

[0074] FIG. 6 is a flowchart illustrating the procedure of the related word group database generation process performed by the first information processing apparatus 2 according to the embodiment.

[0075] The acquiring unit 210 acquires voice data (ACT 11). In ACT 11, for example, the acquiring unit 210 acquires voice data corresponding to an utterance by the second information processing device 3 outputted via the speaker .

[0076] The voice recognition unit 211 performs voice recognition based on the voice data acquired by the acquisition unit 210 (ACT 12). In ACT 12, for example, the voice recognition unit 211 performs voice recognition on the voice data and acquires the recognition result, similar to ACT 2. The voice recognition unit 211 may store the recognition result in the auxiliary storage device 23.

[0077] The conversion unit 212 vectorizes the recognition result by the speech recognition unit 211 (ACT13). In ACT13, for example, the conversion unit 212 uses a known technique to digitize words and the like included in the text data based on their features.

[0078] The conversion unit 212 stores the conversion result as a related word group DB in the auxiliary storage device 23 (ACT 14). The conversion unit 212 may update the related word group DB in real time every time it acquires a conversion result.

[0079] FIG. 7 is a flowchart showing another example of the procedure of the audio output control process by the first information processing device 2 according to the embodiment.

[0080] First, the user of the first information processing device 2 selects a related word group DB to be used in a web conference. In the following process, it is assumed that the user of the first information processing device 2 participates in a conference related to, for example, the "construction industry" and uses the related word group DB shown in Fig. 4. In this example, the first information processing device 2 performs voice output control processing based on voice data uttered by the user of the first information processing device 2.

[0081] The acquisition unit 210 acquires voice data corresponding to speech by the user of the first information processing device 2 based on input via the microphone 28 (ACT21).

[0082] The voice recognition unit 211 performs voice recognition based on the voice data acquired by the acquisition unit 210 (ACT22). In ACT22, for example, the voice recognition unit 211 converts the voice data into text data, as in ACT2. The voice recognition unit 211 acquires the text data as a recognition result. The voice recognition unit 211 may segment the text data into the smallest unit, such as a word. In this case, the voice recognition unit 211 may acquire the segmented words as an authentication result. The voice recognition unit 211 may store the recognition result in the auxiliary storage device 23.

[0083] The conversion unit 212 vectorizes the recognition result by the speech recognition unit 211 (ACT23). In ACT23, for example, the conversion unit 212 uses a known technique to digitize words and the like included in the text data based on their features, similar to ACT13. The conversion unit 212 may store the conversion result in the auxiliary storage device 23.

[0084] The determination unit 213 determines whether the recognition result by the speech recognition unit 211 satisfies a predetermined condition (ACT24). In ACT24, for example, the determination unit 213 acquires the conversion result by the conversion unit 212. The determination unit 213 determines whether the distance between the conversion result and the related word group is equal to or greater than a threshold based on the related word group DB. The determination unit 213 determines whether the distance between the conversion result and the related word group is equal to or greater than a threshold based on, for example, the distance from the outer edge of a set of related word groups arranged in a multidimensional vector space. The threshold may be set in advance or may be set as appropriate by an administrator or the like. The threshold may be set based on, for example, the type of meeting.

[0085] If the determination unit 213 determines that the distance between the conversion result and the related word group is equal to or greater than the threshold (ACT24: YES), the process proceeds from ACT24 to ACT 25. If the determination unit 213 determines that the distance between the conversion result and the related word group is not equal to or greater than the threshold (ACT24: NO), the process proceeds from ACT24 to ACT 26. The audio output control unit 214 controls the output of audio data to the second information processing device 3 via the network based on the determination result by the determination unit 213.

[0086] The voice output control unit 214 controls the output of voice data via the network based on the determination by the determination unit 213 that the recognition result satisfies a predetermined condition (ACT 25). In ACT 25, for example, the voice output control unit 214 stops output of voice data to the second information processing device 3 via the network based on the determination by the determination unit 213 that the distance between the conversion result and the related word group is equal to or greater than a threshold. In this case, the voice output control unit 214 stops output of only voice data corresponding to words, etc., having a conversion result whose distance from the related word group is determined to be equal to or greater than the threshold. For example, a case will be described in which the recognition result by the voice recognition unit 211 includes "long talk." The determination unit 213 calculates the distance from a position in a multidimensional vector space indicated by the conversion result obtained by vectorizing the recognition result "long talk" to a set of related word groups included in the related word group DB. If the determination unit 213 determines that the calculated distance is equal to or greater than a threshold, the voice output control unit 214 stops output of voice data corresponding to "long talk" to the second information processing device 3. The voice output control unit 214 may stop the microphone 28 in response to determining that the distance between the conversion result and the related word group is equal to or greater than a threshold value.

[0087] The voice output control unit 214 outputs voice data via the network based on the determination by the determination unit 213 that the recognition result does not satisfy a predetermined condition (ACT26). In ACT26, for example, the voice output control unit 214 outputs voice data to the second information processing device 3 via the network based on the determination by the determination unit 213 that the distance between the conversion result and the related word group is not equal to or greater than a threshold. In this case, the conversion unit 212 stores the conversion result in the related word group DB. The conversion unit 212 may update the related word group DB in real time based on the determination by the determination unit 213 that the recognition result does not satisfy a predetermined condition.

[0088] (effect) The first information processing device 2 used in the web conferencing system according to the embodiment can acquire voice data based on input via an input device, perform voice recognition based on the voice data, determine whether the recognition result satisfies a predetermined condition, and, based on the determination result, stop output of the voice data via a network. Therefore, the first information processing device 2 can control voice data that satisfies the predetermined condition so that it is not output to other information processing devices. For example, if the voice data that satisfies the predetermined condition contains words that are not desired to be transmitted to other participants or words that are inappropriate for a conference, it can prevent such words from being output to other information processing devices. This allows the first information processing device 2 to prevent specific words spoken by the user of the first information processing device 2 from being transmitted, thereby providing a technology that enables a smooth electronic conference.

[0089] The first information processing device 2 can determine whether the recognition result satisfies a predetermined condition based on whether the recognition result includes a keyword. Therefore, based on the keyword set at the start of the conference, if a keyword is included in words spoken by a user of the first information processing device 2, the first information processing device 2 can control so that voice data corresponding to the keyword is not output to other information processing devices. For example, if a keyword is a word that the user does not want to transmit to other participants or a word that is inappropriate for the conference, such a word can be prevented from being output to other information processing devices. In this way, the first information processing device 2 can provide a technology that prevents a keyword included in words spoken by the user of the first information processing device 2 from being transmitted, thereby realizing a smooth electronic conference.

[0090] The first information processing device 2 can vectorize the recognition result and determine whether the recognition result satisfies a predetermined condition based on whether the distance between the conversion result and a predetermined word group is equal to or greater than a threshold. Furthermore, the first information processing device 2 can update the predetermined word group in real time. Therefore, based on the related word group set at the start of the conference and the related word group updated in real time during the conference, the first information processing device 2 can control the output of voice data corresponding to a word spoken by a user of the first information processing device 2 so that the word is not output to other information processing devices if the word is far from the related word group. For example, a word far from the related word group is a word unrelated to the conference, a word inappropriate for the conference, or a word that is not desired to be transmitted to other participants. Therefore, the first information processing device 2 can prevent such a word from being output to other information processing devices. Furthermore, the first information processing device 2 can determine whether the recognition result satisfies a predetermined condition based on the related word group updated in real time. Therefore, frequently used words during a conference can be dynamically changed. This allows the first information processing device 2 to dynamically determine words, etc. that are not related to the meeting that are included in the words spoken by the user of the first information processing device 2, preventing words, etc. that are not related to the meeting from being transmitted as the meeting progresses, and providing technology that enables smoother electronic meetings.

[0091] In the above-described embodiment, an example in which the output of audio data is controlled by the audio output control unit 214 has been described, but the present invention is not limited to this. When audio data is input to the first information processing device 2 from the microphone 28 and the text data is output to and displayed in real time on the second information processing device 3, the audio output control unit 214 may control the output of the text data. In this case, the audio output control unit 214 controls the output of text data corresponding to the audio data via the network based on the determination result by the determination unit 213. In this example, the audio output control unit 214 functions as an output control unit for text data.

[0092] The information processing device may be realized by one device such as the first information processing device 2, or may be realized by a plurality of devices with distributed functions.

[0093] The program may be transferred in a state where it is stored in an electronic device, or in a state where it is not stored in an electronic device. In the latter case, the program may be transferred via a network, or in a state where it is recorded on a recording medium. The recording medium is a non-transitory tangible medium. The recording medium is a computer-readable medium. The form of the recording medium is not important as long as it is a medium that can store the program and is computer-readable, such as a CD-ROM or a memory card.

[0094] Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, and are also included in the scope of the invention and its equivalents as defined in the claims. [Explanation of symbols]

[0095] 1...server, 2...first information processing device, 3...second information processing device, 11...processor, 12...main memory, 13...auxiliary storage device, 14...communication interface, 21...processor, 22...main memory, 23...auxiliary storage device, 24...communication interface, 25...display device, 26...speaker, 27...input device, 28...microphone, 29...camera, 31...processor, 32...main memory, 33...auxiliary storage device, 34...communication interface, 35...display device, 36...speaker, 37...input device, 38...microphone, 39...camera, 100...web conferencing system, 210...acquisition unit, 211...speech recognition unit, 212...conversion unit, 213...determination unit, 214...audio output control unit, 230...keyword storage area, 231...related word group storage area.

Claims

1. An information processing device used in a web conference system, an acquisition unit that acquires voice data based on an input via an input device; a voice recognition unit that performs voice recognition based on the voice data acquired by the acquisition unit; a determination unit that determines whether a recognition result by the speech recognition unit satisfies a predetermined condition; an audio output control unit that controls output of the audio data via a network based on the determination result by the determination unit; a conversion unit that vectorizes the recognition result by the speech recognition unit; Equipped with the determination unit determines whether the recognition result satisfies a predetermined condition based on whether a distance between the conversion result by the conversion unit and a predetermined word group is equal to or greater than a threshold. Information processing device.

2. the determination unit determines whether the recognition result satisfies a predetermined condition based on whether the recognition result includes a keyword. The information processing device according to claim 1 .

3. The information processing device according to claim 1 , wherein the predetermined group of words is updated in real time.

4. An information processing method used in a web conference system, acquiring audio data based on input via an input device; performing speech recognition based on the speech data; determining whether the recognition result satisfies a predetermined condition; Controlling the output of the audio data via a network based on the determination result; vectorizing the recognition result; determining whether the recognition result satisfies a predetermined condition based on whether a distance between a vectorized conversion result of the recognition result and a predetermined group of words is equal to or greater than a threshold; An information processing method comprising:

5. On the computer, an acquisition function for acquiring voice data based on an input via an input device of an information processing device used in the web conference system; a voice recognition function that performs voice recognition based on the voice data acquired by the acquisition function; a determination function for determining whether a recognition result by the voice recognition function satisfies a predetermined condition; an audio output control function that controls output of the audio data via a network based on the determination result by the determination function; a conversion function for vectorizing the recognition result of the speech recognition function; An information processing program for executing the determination function determines whether the recognition result satisfies a predetermined condition based on whether a distance between the conversion result by the conversion function and a predetermined word group is equal to or greater than a threshold. Information processing program.

Images