Information processing device and information processing program

Abstract

To provide a technique capable of achieving a smooth electronic conference.SOLUTION: An information processing device used by a Web conference system comprises an audio output control unit, a first acquisition unit, an output unit, a second acquisition unit, a comparison unit, a display control unit, and an audio output control unit controlling the output of a prescribed audio via an audio output device. The first acquisition unit acquires first audio data containing audio data based on a prescribed audio via an audio input device. The output unit outputs the first audio data acquired by the first acquisition unit to another information processing device different from the information processing device. The second acquisition unit acquires second audio data corresponding to the first audio data from another information processing device. The comparison unit compares the first audio data with the second audio data acquired by the second acquisition unit. The display control unit displays the comparison results by the comparison unit on a display device.SELECTED DRAWING: Figure 5

Description

Technical Field

[0004] , , , , , , , , ,

[0006] , , , , ,

[0005] , , , , , , , , ,

[0003] , ,

[0001] Embodiments of the present invention relate to an information processing apparatus and an information processing program.

Background Art

[0002] Electronic conference systems such as video conference systems and Web conference systems that use a plurality of information processing apparatuses connected via a network are widely used. In an electronic conference system, in addition to input devices such as microphones and video cameras built into the information processing apparatus, externally connected input devices may be used.

[0003] In such an electronic conference system, if a user makes an incorrect selection of an input device or the selected input device malfunctions, multimedia data such as audio data and image data may not be correctly transmitted.

Prior Art Documents

Patent Documents

[0004] <00​​​​​​​​​​​​​​​​​​​​​​​​

[0007] In one embodiment, an information processing device used in a web conferencing system comprises an audio output control unit, a first acquisition unit, an output unit, a second acquisition unit, a comparison unit, a display control unit, and an audio output control unit that controls the output of a predetermined audio via an audio output device. The first acquisition unit acquires first audio data, including audio data based on a predetermined audio, via an audio input device. The output unit outputs the first audio data acquired by the first acquisition unit to another information processing device different from the information processing device. The second acquisition unit acquires second audio data corresponding to the first audio data from the other information processing device. The comparison unit compares the first audio data with the second audio data acquired by the second acquisition unit. The display control unit displays the comparison result from the comparison unit on a display device. [Brief explanation of the drawing]

[0008] [Figure 1] Figure 1 is a block diagram illustrating a web conferencing system according to the first embodiment. [Figure 2] Figure 2 is a flowchart illustrating the information processing procedure by the first information processing device according to the first embodiment. [Figure 3] Figure 3 is a flowchart illustrating the information processing procedure by the second information processing device according to the first embodiment. [Figure 4] Figure 4 is a flowchart illustrating the information processing procedure by the server according to the first embodiment. [Figure 5] Figure 5 is a block diagram illustrating a web conferencing system according to the second embodiment. [Figure 6] Figure 6 is a diagram illustrating the waveform of audio data according to the second embodiment. [Figure 7] Figure 7 is a flowchart illustrating the information processing procedure by the first information processing device according to the second embodiment. [Modes for carrying out the invention]

[0009] [First Embodiment] [Example Configuration] The first embodiment will be described below with reference to the drawings. In each drawing, the same reference numerals are used for the same components whenever possible, and redundant explanations are omitted. Figure 1 is a block diagram illustrating a web conferencing system 100 according to the first embodiment. The web conferencing system 100 includes a server 1, a first information processing device 2, and a second information processing device 3. The server 1, the first information processing device 2, and the second information processing device 3 are connected to each other via a network. For example, the network consists of one or more networks from among various networks such as the Internet, a mobile communication network, and a LAN (Local Area Network). The one or more networks may include wireless networks or wired networks. Note that the web conferencing system 100 may also refer to a system including at least two of the devices from the server 1, the first information processing device 2, and the second information processing device 3.

[0010] Server 1 is an electronic device that collects and processes data. The electronic device includes a computer. Server 1 is connected to the first information processing device 2 and the second information processing device 3 via a network, allowing for seamless communication. The first information processing device 2 and the second information processing device 3 are used, for example, by different users in separate locations. Server 1 receives various data from the first information processing device 2 and the second information processing device 3 and outputs various data to the first information processing device 2 and the second information processing device 3. An example configuration of Server 1 will be described later.

[0011] The first information processing device 2 is an electronic device capable of communicating with other electronic devices. The first information processing device 2 is, for example, a device used by participants in a web conference. For example, the first information processing device 2 could be a PC (Personal Computer), a smartphone, or a tablet device. "Participant" can be read as "user" or "person." The first information processing device 2 is an example of an information processing terminal. An example configuration of the first information processing device 2 will be described later.

[0012] The second information processing device 3 is an electronic device capable of communicating with other electronic devices. The second information processing device 3 is, for example, a device used by a host or participant in a web conference. For example, the second information processing device 3 is a PC, smartphone, or tablet device. "Host or participant" may be replaced with "user" or "person." The second information processing device 3 is an example of an information processing terminal. An example configuration of the second information processing device 3 will be described later.

[0013] In the following explanation, when the term "information processing device" is used, it may refer to either the first information processing device 2 or the second information processing device 3, or it may refer to both the first information processing device 2 and the second information processing device 3 collectively.

[0014] This section describes an example configuration for Server 1. Server 1 is an electronic device that includes a processor 11, main memory 12, auxiliary storage device 13, and communication interface 14. Each component of Server 1 is connected to the others so that signals can be input and output. In Figure 1, the interface is labeled "I / F".

[0015] Processor 11 corresponds to the central part of Server 1. Processor 11 is an element that constitutes the computer of Server 1. For example, Processor 11 is a CPU (Central Processing Unit), but is not limited thereto. Processor 11 may be composed of various circuits. Processor 11 expands a program stored in advance in the main memory 12 or the auxiliary storage device 13 into the main memory 12. The program is a program that causes the processor 11 of Server 1 to realize or execute each part described later. Processor 11 executes various operations by executing the program expanded in the main memory 12.

[0016] Main memory 12 corresponds to the main storage part of Server 1. Main memory 12 is an element that constitutes the computer of Server 1. Main memory 12 includes a non-volatile memory area and a volatile memory area. In the non-volatile memory area, main memory 12 stores an operating system or a program. Main memory 12 uses the volatile memory area as a work area where data can be appropriately rewritten by processor 11. For example, main memory 12 includes ROM (Read Only Memory) as a non-volatile memory area. For example, main memory 12 includes RAM (Random Access Memory) as a volatile memory area. Main memory 12 stores a program.

[0017] Auxiliary storage device 13 corresponds to the auxiliary storage part of Server 1. Auxiliary storage device 13 is an element that constitutes the computer of Server 1. Auxiliary storage device 13 is an EEPROM (registered trademark) (Electric Erasable Programmable Read-Only Memory), HDD (Hard Disc Drive), SSD (Solid State Drive), or the like. Auxiliary storage device 13 stores the above-described program, data used by processor 11 to perform various processes, and data generated by the processes in processor 11. Auxiliary storage device 13 stores the above-described program.

[0018] The auxiliary memory device 13 stores information of users of the first information processing device 2 and the second information processing device 3 that participate in the Web conference provided by the Web conference system 100. The user information includes user identification information, identification information of the information processing device used by the user, and the like. The user identification information is unique identification information assigned to each user to individually identify the user. The identification information of the information processing device is unique identification information assigned to each information processing device to individually identify the information processing device. The identification information of the information processing device includes the IP address of the information processing device and the like.

[0019] The communication interface 14 includes various interfaces that connect the server 1 to other electronic devices via a network in accordance with a predetermined communication protocol so as to be communicable.

[0020] Note that the hardware configuration of the server 1 is not limited to the above-described configuration. The server 1 can appropriately omit and change the above-described components and add new components.

[0021] Each part realized in the above-described processor 11 will be described. The processor 11 realizes a first acquisition unit 110, a second acquisition unit 111, a first output unit 112, and a second output unit 113. Each part realized in the processor 11 can also be referred to as each function. Each part realized in the processor 11 can also be said to be realized in a control unit including the processor 11 and the main memory 12.

[0022] The first acquisition unit 110 acquires first multimedia data acquired from the first information processing device 2 via the communication interface 14 based on input via the input device in the first information processing device 2. The first multimedia data includes at least one of audio data and image data acquired based on input via the input device in the first information processing device 2. The image data includes still image data and video data. The input device includes devices capable of acquiring audio or images, such as a built-in microphone, an external microphone, a built-in camera, and an external microphone. In the following description, "acquisition" may be read as "reception".

[0023] The second acquisition unit 111 acquires second multimedia data corresponding to the first multimedia data acquired by the second information processing device 3 via the communication interface 14 from the second information processing device 3. The second information processing device 3 processes the first multimedia data acquired from the server 1 and outputs it in the second information processing device 3. The second multimedia data indicates data corresponding to the first multimedia data output by the second information processing device 3. The second acquisition unit 111 may also acquire second multimedia data corresponding to the first multimedia data stored in the second information processing device 3. Here, multimedia data of the same content are conveniently referred to as first multimedia data and second multimedia data, respectively, as data that corresponds to each other. The multimedia data acquired by the first information processing device 2 and transmitted to the second information processing device 3 via the network is referred to as first multimedia data. The multimedia data transmitted from the first information processing device 2 to the second information processing device 3 via the network and returned from the second information processing device 3 to the first information processing device 2 is referred to as second multimedia data. The second multimedia data may be interpreted as the first multimedia data transmitted from the first information processing device 2 to the second information processing device 3 via the network.

[0024] The first output unit 112 outputs the first multimedia data acquired by the first acquisition unit 110 to the second information processing device 3 via the communication interface 14. In the following description, "output" may be read as "transmission".

[0025] The second output unit 113 outputs the second multimedia data acquired by the second acquisition unit 111 to the first information processing device 2 via the communication interface 14.

[0026] An example configuration of the first information processing device 2 will be described. The first information processing device 2 is an electronic device that includes a processor 21, main memory 22, auxiliary storage device 23, communication interface 24, input interface 25, display device 26, speaker 27, and input device 28. Each component of the first information processing device 2 is connected to each other so that signals can be input and output.

[0027] The processor 21 is the central part of the first information processing device 2. The processor 21 is an element that constitutes the computer of the first information processing device 2. The processor 21 has the same hardware configuration as the processor 11 described above. The processor 21 performs various operations by executing programs that are pre-stored in the main memory 22 or the auxiliary storage device 23.

[0028] Main memory 22 corresponds to the main memory portion of the first information processing device 2. Main memory 22 is an element that constitutes the computer of the first information processing device 2. Main memory 22 has the same hardware configuration as main memory 12 described above. Main memory 22 stores programs.

[0029] The auxiliary storage device 23 corresponds to the auxiliary storage portion of the first information processing device 2. The auxiliary storage device 23 is an element that constitutes the computer of the first information processing device 2. The auxiliary storage device 23 has the same hardware configuration as the auxiliary storage device 13 described above. The auxiliary storage device 23 stores the program described above.

[0030] The auxiliary storage device 23 stores user information of the first information processing device 2. User information includes user identification information, identification information of the first information processing device 2, etc. User identification information is unique identification information assigned to each user in order to identify each user individually. Identification information of the first information processing device 2 is unique identification information assigned to each first information processing device 2 in order to identify each first information processing device 2 individually. Identification information of the first information processing device 2 includes the IP address of the first information processing device 2, etc.

[0031] The communication interface 24 includes various interfaces that enable the first information processing device 2 to communicate with other devices via a network, in accordance with a predetermined communication protocol.

[0032] The input interface 25 is an interface for connecting the first information processing device 2 to external devices. The external devices include external microphones 251-1 to 251-mi (where mi is an integer of 1 or more) capable of inputting audio, and external cameras 252-1 to 252-nj (where nj is an integer of 1 or more) capable of acquiring shooting data of the shooting range. The input interface 25 is, for example, USB (Universal Serial Bus). The external microphones 251-1 to 251-mi and the external cameras 252-1 to 252-nj are examples of input devices.

[0033] The display device 26 is a device capable of displaying various screens under the control of the processor 21. For example, the display device 26 may be a liquid crystal display or an electroluminescent (EL) display.

[0034] Speaker 27 is a device capable of outputting sound under the control of the first information processing device 2. Speaker 27 is an example of an audio output device.

[0035] The input device 28 is a device capable of inputting data or instructions to the first information processing device 2. For example, the input device 28 includes a built-in microphone 281 capable of inputting voice, and a built-in camera 282 capable of acquiring captured data of the shooting range. The input device 28 may also include a keyboard or a touch panel. The microphone 281 is an example of a voice input device.

[0036] The hardware configuration of the first information processing device 2 is not limited to the configuration described above. The first information processing device 2 allows for the omission and modification of the above-described components, as well as the addition of new components, as appropriate.

[0037] The various components implemented in the aforementioned processor 21 will now be described. The processor 21 implements a first acquisition unit 210, a second acquisition unit 211, a mode change unit 212, an output unit 213, and an output control unit 214. Each part implemented in the processor 21 can also be called a function. Each part implemented in the processor 21 can also be said to be implemented in the control unit which includes the processor 21 and the main memory 22.

[0038] The first acquisition unit 210 acquires first multimedia data based on input via a user-selected input device of the first information processing device 2. The user-selected input device refers to an input device selected by the user. The user-selected input device includes at least one of a user-selected microphone and a user-selected camera. The user-selected microphone includes a built-in microphone 281 and a microphone selected from external microphones 251-1 to 251-mi. The user-selected camera includes a built-in camera 282 and a camera selected from external cameras 252-1 to 252-nj. The first multimedia data includes at least one of audio data acquired by the user-selected microphone and image data acquired by the user-selected camera.

[0039] The second acquisition unit 211 acquires second multimedia data corresponding to the first multimedia data acquired by the second information processing device 3 via the server 1. The second multimedia data includes at least one of the audio data and image data corresponding to at least one of the audio data and image data included in the first multimedia data.

[0040] The mode change unit 212 changes the operation mode to confirmation mode based on the user's operation of the first information processing device 2. Confirmation mode is an operation mode for confirming the operation of the input device selected by the user. Operation confirmation includes confirming whether the input device is working correctly. For example, operation confirmation includes confirming the input level, volume, sound quality, etc. of the microphone, and the image quality, field of view, shooting range, etc. of the camera. User operation includes selecting or changing the input device by the user. The input device selected or changed by the user's operation corresponds to the selected microphone or selected camera. The mode change unit 212 may also change the operation mode to confirmation mode in response to an instruction to change to confirmation mode input by the user. The mode change unit 212 terminates confirmation mode in response to the user selecting to use the selected input device of the first information processing device 2. In the following description, "in response" may be read as "based on".

[0041] The output unit 213 outputs the first multimedia data acquired by the first acquisition unit 210 to the second information processing device 3 via the server 1.

[0042] The output control unit 214 causes the second multimedia data acquired by the second acquisition unit 211 to be output to the output device. The output device includes at least one of the display device 26 and the speaker 27. The output control unit 214 causes the display device 26 to output a selection notification for the user to indicate whether or not to use a selected input device based on the second multimedia data. The selection notification includes, for example, a text message such as "Do you want to use the selected microphone?", "Do you want to change the selected microphone?", "Do you want to use the selected camera?", or "Do you want to change the selected camera?".

[0043] The output control unit 214 may output the first multimedia data and the second multimedia data acquired by the first acquisition unit 210 to the output device. In this case, the output control unit 214 may output the first multimedia data and the second multimedia data to the output device simultaneously, or it may output the first multimedia data or the second multimedia data with a predetermined time delay. The predetermined time is, for example, 5 seconds or 10 seconds. The output control unit 214 may output a selection notification to the display device 26 for the user to indicate whether or not to use the selection input device based on the first multimedia data and the second multimedia data.

[0044] An example configuration of the second information processing device 3 will be described. The second information processing device 3 is an electronic device that includes a processor 31, main memory 32, auxiliary storage device 33, communication interface 34, input interface 35, display device 36, speaker 37, and input device 38. Each component of the second information processing device 3 is connected to each other so that signals can be input and output.

[0045] The processor 31 corresponds to the central part of the second information processing device 3. The processor 31 is an element that constitutes the computer of the second information processing device 3. The processor 31 has the same hardware configuration as the processor 11 described above. The processor 31 performs various operations by executing programs that are pre-stored in the main memory 32 or auxiliary storage device 33. The processor 31 implements the first acquisition unit 210, the second acquisition unit 211, the mode change unit 212, the output unit 213, and the output control unit 214, similar to the processor 21.

[0046] Main memory 32 corresponds to the main memory portion of the second information processing device 3. Main memory 32 is an element that constitutes the computer of the second information processing device 3. Main memory 32 has the same hardware configuration as the main memory 12 described above. Main memory 32 stores programs.

[0047] The auxiliary storage device 33 corresponds to the auxiliary storage portion of the second information processing device 3. The auxiliary storage device 33 is an element that constitutes the computer of the second information processing device 3. The auxiliary storage device 33 has the same hardware configuration as the auxiliary storage device 13 described above. The auxiliary storage device 33 stores the program described above.

[0048] The auxiliary storage device 33 stores user information of the second information processing device 3. User information includes user identification information, identification information of the second information processing device 3, etc. User identification information is unique identification information assigned to each user in order to identify each user individually. Identification information of the second information processing device 3 is unique identification information assigned to each second information processing device 3 in order to identify each second information processing device 3 individually. Identification information of the second information processing device 3 includes the IP address of the information processing device, etc.

[0049] The communication interface 34 includes various interfaces that enable the second information processing device 3 to communicate with other devices via a network, in accordance with a predetermined communication protocol.

[0050] The input interface 35 is an interface for connecting the second information processing device 3 to external devices. The external devices include external microphones 351-1 to 351-m (where m is an integer of 1 or more) capable of inputting audio, and external cameras 352-1 to 352-n (where n is an integer of 1 or more) capable of acquiring shooting data of the shooting range. The input interface 25 is, for example, USB. The external microphones 351-1 to 351-m and the external cameras 352-1 to 352-n are examples of input devices.

[0051] The display device 36 is a device capable of displaying various screens under the control of the processor 31. For example, the display device 36 may be a liquid crystal display or an EL display.

[0052] Speaker 37 is a device capable of outputting sound under the control of the second information processing device 3. In the following description, when "output device" is used, it shall include at least one of the display device 36 and speaker 37.

[0053] The input device 38 is a device capable of inputting data or instructions to the second information processing device 3. For example, the input device 38 includes a built-in microphone 381 capable of inputting voice, and a built-in camera 382 capable of acquiring image data of the shooting range. The input device 38 may also include a keyboard or a touch panel.

[0054] The hardware configuration of the second information processing device 3 is not limited to the configuration described above. The second information processing device 3 allows for the omission and modification of the above-described components, as well as the addition of new components, as appropriate.

[0055] [Example of operation] This document describes the processing procedure using the web conferencing system 100. In the following explanation focusing on Server 1, you may substitute Server 1 for Processor 11. Similarly, in the explanation focusing on the First Information Processing Unit 2, you may substitute the First Information Processing Unit 2 for Processor 21. In the explanation focusing on the Second Information Processing Unit 3, you may substitute the Second Information Processing Unit 3 for Processor 31. In the following process, the users of the first information processing device 2 and the second information processing device 3 will participate in a web conference. The users of the first information processing device 2 and the second information processing device 3 will log in to the web conference and select the input device to be used. First, the user of the first information processing device 2 will select an input device and verify the operation of the selected input device. In this case, the second information processing device 3 will receive the multimedia data input by the user of the first information processing device 2 and output the received multimedia data in the second information processing device 3.

[0056] The processing procedure described below is merely an example, and each process may be modified as much as possible. Furthermore, depending on the embodiment, steps in the processing procedure described below may be omitted, replaced, or added as appropriate.

[0057] Figure 2 is a flowchart illustrating the information processing procedure by the first information processing device 2 according to the first embodiment. The processor 21 detects the selection of an input device based on the user's operation of the first information processing device 2 (ACT1). In ACT1, for example, the processor 21 detects the selected input device chosen by the user.

[0058] The mode change unit 212 changes the operation mode to confirmation mode (ACT2) based on the user's operation of the first information processing device 2. In ACT2, for example, the mode change unit 212 starts confirmation mode in response to the processor 21 detecting a selected input device. The mode change unit 212 outputs a confirmation mode start instruction to the server 1 to start confirmation mode. Changing the operation mode to confirmation mode includes starting confirmation mode. The mode change unit 212 may also change the operation mode to confirmation mode in response to an instruction to change to confirmation mode input by the user. In this case, the server 1 outputs a confirmation mode start instruction to the second information processing device 3 in response to receiving the confirmation mode start instruction.

[0059] The first acquisition unit 210 acquires first multimedia data based on input via an input device selected by the user of the first information processing device 2 (ACT3). In ACT3, for example, the first acquisition unit 210 acquires first multimedia data based on user input via a selected input device detected by the processor 21.

[0060] The output unit 213 outputs the first multimedia data acquired by the first acquisition unit 210 to the second information processing device 3 via the server 1 (ACT4). In ACT4, for example, the output unit 213 outputs the first multimedia data acquired by the first acquisition unit 210 to the server 1.

[0061] Here, Server 1 outputs the first multimedia data output by the output unit 213 to the second information processing device 3. The second information processing device 3 acquires the first multimedia data. The second information processing device 3 outputs the second multimedia data corresponding to the first multimedia data via the output device. The second information processing device 3 outputs the second multimedia data to Server 1. The second information processing device 3 outputs the second multimedia data corresponding to the first multimedia data output by the output unit 213 to Server 1.

[0062] In confirmation mode, the second acquisition unit 211 acquires second multimedia data corresponding to the first multimedia data acquired by the second information processing device 3 via the server 1 (ACT5). In ACT5, for example, the second acquisition unit 211 acquires the second multimedia data output from the second information processing device 3 from the server 1. The second acquisition unit 211 may also store the second multimedia data in the auxiliary storage device 23.

[0063] The output control unit 214 causes the second multimedia data acquired by the second acquisition unit 211 to be output to the output device (ACT6). In one example, the output control unit 214 causes the second multimedia data acquired by the second acquisition unit 211 to be output to the output device. In another example, the output control unit 214 causes the first multimedia data and the second multimedia data to be output to the output device. The output control unit 214 causes the first multimedia data acquired by the first acquisition unit 210 and the second multimedia data corresponding to the first multimedia data acquired by the second acquisition unit 211 to be output to the output device. In this case, the output control unit 214 may output the first multimedia data and the second multimedia data simultaneously. If the first multimedia data includes audio data, the output control unit 214 may output the second multimedia data with a predetermined time delay.

[0064] The output control unit 214 outputs a selection notification (ACT7) based on the second multimedia data, allowing the user to instruct whether or not to use the selection input device selected by the user. In one example, the output control unit 214 outputs the selection notification to the display device 26 based on the second multimedia data acquired by the second acquisition unit 211. In another example, the output control unit 214 outputs a selection notification based on the first multimedia data and the second multimedia data, allowing the user to instruct whether or not to use the selection input device. The output control unit 214 outputs the selection notification to the display device 26 based on the first multimedia data acquired by the first acquisition unit 210 and the second multimedia data corresponding to the first multimedia data acquired by the second acquisition unit 211. The output control unit 214 may also output the selection notification as audio data to the speaker 27.

[0065] The processor 21 determines whether there has been a change in the selected input device based on the user's operation (ACT8). In ACT8, for example, the processor 21 receives instructions from the user regarding a selection notification. Based on the instructions regarding the selection notification, the processor 21 determines whether the user has changed at least one of the selected microphone and the selected camera.

[0066] If the processor 21 determines that there has been a change in the selected input device (ACT8: YES), the process transitions from ACT8 to ACT3. In this case, the processor 21 detects the user's selection of a new input device. The processor 21 detects at least one of the selected microphone and the selected camera. In ACT3, the first acquisition unit 210 acquires first multimedia data based on the input via the selected input device.

[0067] If processor 21 determines that there is no change in the selected input device (ACT8:NO), the process transitions from ACT8 to ACT9. The absence of a change in the selected input device corresponds to the selection to use the selected input device.

[0068] The mode change unit 212 terminates the confirmation mode (ACT9) in response to the user of the first information processing device 2 selecting to use a selected input device. In ACT9, for example, the mode change unit 212 terminates the confirmation mode in response to the processor 21 determining that there is no change in the input device based on the user's selection notification. The mode change unit 212 changes the operation mode from confirmation mode to normal mode. Normal mode is the operation mode for running a web conference. The mode change unit 212 outputs a confirmation mode termination instruction to the second information processing device 3 via the server 1.

[0069] Note that the output control unit 214 may omit the process of outputting a selection notification (ACT7). In this case, in ACT8, the processor 21 determines whether or not there has been a change in the selected input device based on whether or not it has detected that a new input device has been selected by the user. The processor 21 determines that there has been a change in the input device in response to detecting a new selected input device (ACT8: YES). In ACT3, the first acquisition unit 210 acquires the first multimedia data based on the input via the selected input device. The processor 21 determines that there has been no change in the selected input device in response to not detecting a new selected input device (ACT8: NO). The mode change unit 212 terminates the confirmation mode based on the processor 21's determination that there has been no change in the selected input device.

[0070] Figure 3 is a flowchart illustrating the information processing procedure by the second information processing device 3 according to the first embodiment.

[0071] The following processes shall be executed in the first information processing device 2 based on the change in operation mode to confirmation mode.

[0072] Processor 31 starts confirmation mode (ACT11). In ACT11, for example, processor 31 receives confirmation mode start instruction from first information processing device 2 via server 1. Processor 31 receives confirmation mode start instruction from server 1.

[0073] The processor 31 acquires the first multimedia data output from the first information processing device 2 via the server 1 (ACT 12). In ACT 12, for example, the processor 31 acquires the first multimedia data from the server 1. The processor 31 may store the first multimedia data in the auxiliary storage device 33.

[0074] The processor 31 outputs second multimedia data corresponding to the first multimedia data to the output device (ACT 13). The output device includes at least one of a display device 36 and a speaker 37. In ACT 13, for example, the processor 31 outputs second multimedia data, which is the result of processing the first multimedia data, to the output device.

[0075] Processor 31 outputs the second multimedia data to the first information processing device 2 via server 1 (ACT 14). In ACT 14, for example, processor 31 outputs the second multimedia data to server 1. Server 1 outputs the second multimedia data to the first information processing device 2.

[0076] The processor 31 terminates the confirmation mode in response to the confirmation mode termination instruction from the first information processing device 2 (ACT 15). In ACT 15, for example, the processor 31 receives the confirmation mode termination instruction from the first information processing device 2 via the server 1. The processor 31 receives the confirmation mode termination instruction from the server 1. In response to the confirmation mode termination instruction, the processor 31 changes the operation mode from confirmation mode to normal mode.

[0077] Figure 4 is a flowchart illustrating the information processing procedure performed by Server 1 according to the first embodiment.

[0078] The following processes shall be executed in the first information processing device 2 based on the change in operation mode to confirmation mode.

[0079] Processor 11 starts confirmation mode (ACT21). In ACT21, for example, processor 11 receives a confirmation mode start instruction from the first information processing device 2. Processor 11 outputs the confirmation mode start instruction to the second information processing device 3.

[0080] The first acquisition unit 110 acquires first multimedia data acquired from the first information processing device 2 based on input via the selection input device in the first information processing device 2 (ACT22). In ACT22, for example, the first acquisition unit 110 acquires first multimedia data acquired from the first information processing device 2 based on user input via the selection input device.

[0081] The first output unit 112 outputs the first multimedia data acquired by the first acquisition unit 110 to the second information processing device 3 (ACT23).

[0082] The second acquisition unit 111 acquires second multimedia data from the second information processing device 3 that corresponds to the first multimedia data acquired by the second information processing device 3 (ACT24).

[0083] The second output unit 113 outputs the second multimedia data acquired by the second acquisition unit 111 to the first information processing device 2 (ACT25).

[0084] Processor 11 exits confirmation mode (ACT26). In ACT26, for example, processor 11 receives a confirmation mode exit instruction from the first information processing device 2. In response to the confirmation mode exit instruction, processor 11 changes the operation mode from confirmation mode to normal mode.

[0085] [effect] The first information processing device 2 used in the web conferencing system according to the first embodiment can acquire first multimedia data based on input via an input device, output the first multimedia data to another information processing device different from the information processing device, acquire second multimedia data corresponding to the first multimedia data from the other information processing device, and output the second multimedia data. For example, in a web conferencing system, the first multimedia data output from the first information processing device 2 is output by other information processing devices. The first information processing device 2 can obtain second multimedia data corresponding to the first multimedia data from the other information processing devices. Therefore, the first information processing device 2 can output the multimedia data output by the other information processing devices to its output device. This allows the user of the first information processing device 2 to confirm how the first multimedia data was output by the other information processing devices. The first multimedia data may be degraded during transmission from the first information processing device 2 to the second information processing device 3 due to network interference. In this way, the first information processing device 2 can realize smooth electronic conferencing by receiving multimedia data corresponding to the multimedia data output to other information processing devices and allowing the user to confirm it.

[0086] The first information processing device 2 according to the first embodiment can output a selection notification for the user to indicate whether or not to use an input device based on second multimedia data. Furthermore, the first information processing device 2 can output first multimedia data and second multimedia data, and output a selection notification for the user to indicate whether or not to use an input device based on the first multimedia data and second multimedia data. As a result, the user of the first information processing device 2 can choose whether or not to use an input device based on the second multimedia data. Alternatively, the user of the first information processing device 2 can choose whether or not to use an input device based on a comparison of the first multimedia data and the second multimedia data. Therefore, the first information processing device 2 can prompt the user to select an input device based on the second multimedia data, thereby enabling smooth electronic conferencing.

[0087] The first information processing device 2 according to the first embodiment can change the operation mode to confirmation mode based on user operation and acquire second multimedia data in confirmation mode. Furthermore, the first information processing device 2 can terminate the confirmation mode in response to the user selecting to use an input device. As a result, the first information processing device 2 can acquire second multimedia data only when the operation mode is confirmation mode. Therefore, the first information processing device 2 can realize smooth electronic conferencing while reducing the processing load.

[0088] [Differentiation] Although the first information processing device 2 and the second information processing device 3 have been described as being equipped with multiple microphones and multiple cameras, they are not limited to this configuration. The first information processing device 2 and the second information processing device 3 may be equipped with at least one microphone and at least one camera.

[0089] The information processing device according to the first embodiment described above can be configured as follows. [1] An information processing device used in a web conferencing system, A first acquisition unit that acquires first multimedia data based on input via an input device, An output unit that outputs the first multimedia data acquired by the first acquisition unit to another information processing device different from the information processing device, A second acquisition unit that acquires second multimedia data corresponding to the first multimedia data from the other information processing device, An output control unit that outputs the second multimedia data acquired by the second acquisition unit, An information processing device equipped with the following features.

[0090] [2] The output control unit outputs a selection notification based on the second multimedia data for the user to indicate whether or not to use the input device. [1] The information processing device described above.

[0091] [3] The output control unit outputs the first multimedia data and the second multimedia data. The output control unit outputs a selection notification to indicate to the user whether or not to use the input device, based on the first multimedia data and the second multimedia data. [1] The information processing device described above.

[0092] [4] The system further includes a mode change unit that changes the operation mode to confirmation mode based on user operation, The second acquisition unit acquires the second multimedia data in the confirmation mode. The information processing device described in [2] or [3].

[0093] [5] The mode change unit terminates the confirmation mode in response to the user selecting to use the input device. [4] The information processing device described above.

[0094] [6] Computers, A first acquisition function that acquires first multimedia data based on input via an input device of an information processing device used in a web conferencing system, An output function that outputs the first multimedia data acquired by the first acquisition function to another information processing device different from the information processing device, A second acquisition function for acquiring second multimedia data corresponding to the first multimedia data from the other information processing device, An output control function that outputs the second multimedia data acquired by the second acquisition function, An information processing program to execute an action.

[0095] [Second Embodiment] The second embodiment will be described below with reference to the drawings.

[0096] Components similar to those in the first embodiment are denoted by the same reference numerals, and their descriptions are omitted. In the second embodiment, the differences from the first embodiment will be described primarily. In each drawing, identical components are denoted by the same reference numerals whenever possible, and redundant descriptions are omitted.

[0097] [Example Configuration] Figure 5 is a block diagram illustrating a web conferencing system according to the second embodiment. The web conferencing system 100 includes a server 1, a first information processing device 2, and a second information processing device 3. The server 1, the first information processing device 2, and the second information processing device 3 are connected to each other via a network. For example, the network consists of one or more networks from among various networks such as the internet, mobile communication networks, and LANs. The one or more networks may include wireless networks or wired networks. Note that the web conferencing system 100 may also refer to a system including at least two of the devices from the server 1, the first information processing device 2, and the second information processing device 3.

[0098] The configuration example for Server 1 is the same as in the first embodiment.

[0099] An example configuration of the first information processing device 2 will be described. The first information processing device 2 is an electronic device that includes a processor 21, main memory 22, auxiliary storage device 23, communication interface 24, input interface 25, display device 26, speaker 27, and input device 28. Each component of the first information processing device 2 is connected to each other so that signals can be input and output.

[0100] The configuration of the processor 21, main memory 22, auxiliary storage device 23, communication interface 24, input interface 25, display device 26, speaker 27, and input device 28 is the same as in the first embodiment.

[0101] The auxiliary storage device 23 stores audio data having a specific frequency. Audio data having a specific frequency is, for example, audio data that a user cannot hear. Audio data having a specific frequency may also be audio data that is difficult for a user to hear. Audio data that is difficult for a user to hear includes, for example, audio data that can only be heard by young people. Audio data having a specific frequency is, for example, audio data having a waveform such as a square wave, sawtooth wave, triangle wave, or sine wave, as shown in Figure 6. The specific frequency includes frequencies outside the range of human hearing. The range of human hearing is, for example, 20Hz-20kHz. The specific frequency includes frequencies near the upper and lower limits of the range of human hearing. The specific frequency includes frequencies below the sampling rate that can be processed by the first information processing device 2. For example, the sampling rate is 48kHz. For example, audio data having a specific frequency is a sine wave or square wave with a frequency of 20kHz, etc. Audio data having a specific frequency may be multiple types of audio data.

[0102] The hardware configuration of the first information processing device 2 is not limited to the configuration described above. The first information processing device 2 allows for the omission and modification of the above-described components, as well as the addition of new components, as appropriate.

[0103] The various components implemented in the processor 21 will now be described. The processor 21 implements an audio output control unit 220, a first acquisition unit 221, a second acquisition unit 222, a mode change unit 223, an output unit 224, a comparison unit 225, and a display control unit 226. Each part implemented in the processor 21 can also be called a function. Each part implemented in the processor 21 can also be said to be implemented in the control unit which includes the processor 21 and the main memory 22.

[0104] The audio output control unit 220 controls the output of a predetermined sound via the speaker 27. The audio output control unit 220 acquires audio data having a specific frequency from the auxiliary storage device 23. The audio output control unit 220 causes the speaker 27 to output a predetermined sound based on the audio data having a specific frequency.

[0105] The first acquisition unit 221 acquires first audio data, which includes audio data based on a predetermined voice, via a microphone selected by the user of the first information processing device 2. The microphone includes a built-in microphone 281 and a microphone selected from external microphones 251-1 to 251-mi. The first audio data is audio data based on voice input to the microphone selected by the user. The voice input to the microphone includes a predetermined voice output via the speaker 27. The voice input to the microphone may include the voice of speech made by the user of the first information processing device 2. The audio data based on the predetermined voice is, for example, audio data obtained by A / D conversion of the predetermined voice output via the speaker 27. The audio data based on the predetermined voice is data of a specific frequency. The first audio data may include audio data based on the voice of speech made by the user of the first information processing device 2. The audio data based on the voice of speech is, for example, audio data obtained by A / D conversion of the voice of speech. The first acquisition unit 221 may store the first audio data in the auxiliary storage device 23.

[0106] The second acquisition unit 222 acquires second audio data corresponding to the first audio data acquired by the second information processing device 3 via the server 1. The second acquisition unit 222 may store the second audio data in the auxiliary storage device 23.

[0107] The mode change unit 223 changes the operation mode to confirmation mode based on the user's operation of the first information processing device 2. The mode change unit 223 may also change the operation mode to confirmation mode in response to an instruction to change to confirmation mode entered by the user. The mode change unit 223 exits confirmation mode in response to the user of the first information processing device 2 selecting to use the selection input device.

[0108] The output unit 224 outputs the first audio data acquired by the first acquisition unit 221 to the second information processing device 3 via the server 1.

[0109] The comparison unit 225 compares the first audio data with the second audio data acquired by the second acquisition unit 222. The comparison unit 225 may, for example, acquire the first audio data from the auxiliary storage device 23. The comparison unit 225 may also acquire the second audio data from the auxiliary storage device 23. The comparison unit 225 determines whether the second audio data matches the first audio data. The comparison unit 225 may, for example, determine whether the second audio data has data of the same specific frequency as audio data based on a predetermined sound included in the first audio data. If the second audio data has data of the specific frequency, the comparison unit 225 may determine that the second audio data matches the first audio data. If the second audio data does not have data of the specific frequency, the comparison unit 225 may determine that the second audio data does not match the first audio data.

[0110] In another example, the comparison unit 225 may determine the ratio of the temporal length of data of a specific frequency contained in the second audio data to the temporal length of audio data based on a predetermined sound contained in the first audio data (hereinafter also referred to as the "ratio of the second audio data matching the first audio data"). Due to the status of the second information processing device 3 or the influence of the network, the second audio data may temporarily not contain data of a specific frequency. In this case, the comparison unit 225 may determine that the second audio data matches the first audio data if, for example, the ratio of the second audio data matching the first audio data is 100%. The comparison unit 225 may determine that the second audio data does not match the first audio data if the ratio of the second audio data matching the first audio data is not 100%.

[0111] In yet another example, the comparison unit 225 may determine the degree of agreement between the second audio data and the first audio data in stages based on the proportion of the second audio data that matches the first audio data. In this case, for example, the comparison unit 225 may determine the degree of agreement as "excellent" if the proportion of the second audio data that matches the first audio data is 90% or more. For example, the comparison unit 225 may determine the degree of agreement as "good" if the proportion of the second audio data that matches the first audio data is 50% or more but less than 90%. For example, the comparison unit 225 may determine the degree of agreement as "poor" if the proportion of the second audio data that matches the first audio data is less than 50%. The stages of agreement are not limited to the three stages of "excellent," "good," and "poor," but may be any number of stages. The comparison unit 225 may also determine the degree of agreement as a numerical value such as "100%" or "50%."

[0112] The display control unit 226 displays the comparison result from the comparison unit 225 on the display device 26. The display control unit 226 may display a notification on the display device 26 indicating that the second audio data matches the first audio data, or a notification indicating that it does not match. A notification indicating a match is also called a match notification. A notification indicating a mismatch is also called a mismatch notification. The display control unit 226 may display a notification on the display device 26 that shows the degree of match between the second audio data and the first audio data in stages. A notification showing the degree of match in stages is also called a match degree notification. The display control unit 226 may display a notification indicating a mismatch only if the second audio data does not match the first audio data. The display control unit 226 may display a notification on the display device 26 only if the second audio data does not match the first audio data, and only if the degree of match is low. The display control unit 226 may display different notifications in a distinguishable manner. For example, the display control unit 226 may display match notifications and mismatch notifications in different display manners. The display control unit 226 may display the match degree notification in different display modes depending on the match degree. The display modes include character decoration such as character color, size, font, enclosed characters, brightness or luminance, background color, background brightness or luminance, background pattern, frame color, flashing display, etc. The display control unit 226 may display the match notification, mismatch notification, and match degree notification as pop-up notifications. The display control unit 226 may display at least one of the match notification, mismatch notification, and match degree notification based on the user's settings.

[0113] The configuration example of the second information processing device 3 is the same as that of the first embodiment. The hardware configuration of the second information processing device 3 is not limited to the configuration described above. The second information processing device 3 allows for the omission and modification of the above-described components, as well as the addition of new components, as appropriate.

[0114] [Example of operation] This document describes the processing procedure using the web conferencing system 100. In the following explanation focusing on Server 1, you may substitute Server 1 for Processor 11. Similarly, in the explanation focusing on the First Information Processing Unit 2, you may substitute the First Information Processing Unit 2 for Processor 21. In the explanation focusing on the Second Information Processing Unit 3, you may substitute the Second Information Processing Unit 3 for Processor 31. In the following process, as in the first embodiment, the users of the first information processing device 2 and the second information processing device 3 will participate in the web conference. The users of the first information processing device 2 and the second information processing device 3 will log in to the web conference and select the input device to be used.

[0115] In the following process, the user of the first information processing device 2 selects microphone 281 as the input device and verifies the operation of microphone 281. In this case, the second information processing device 3 receives the audio data input via microphone 281 by the user of the first information processing device 2 via server 1. The second information processing device 3 controls the output of audio based on the audio data received via server 1 through the speaker.

[0116] The processing procedure described below is merely an example, and each process may be modified as much as possible. Furthermore, depending on the embodiment, steps in the processing procedure described below may be omitted, replaced, or added as appropriate.

[0117] Figure 7 is a flowchart illustrating the information processing procedure by the first information processing device 2 according to the second embodiment. The mode change unit 223 changes the operation mode to confirmation mode (ACT31) based on the user's operation of the first information processing device 2. The user's operation is, for example, an operation in which the user selects the microphone 281. The user's operation may also be an operation in which the user transitions to confirmation mode. In ACT31, for example, the mode change unit 223 starts confirmation mode in response to the processor 21 detecting the selection of the microphone 281. The mode change unit 223 outputs a confirmation mode start instruction to the server 1 to start confirmation mode. Changing the operation mode to confirmation mode includes starting confirmation mode. The mode change unit 223 may also change the operation mode to confirmation mode in response to an instruction to change to confirmation mode input by the user. In this case, the server 1 outputs a confirmation mode start instruction to the second information processing device 3 in response to receiving the confirmation mode start instruction.

[0118] The audio output control unit 220 controls the output of a predetermined sound via the speaker 27 (ACT32). In ACT32, for example, the audio output control unit 220 acquires audio data having a specific frequency from the auxiliary storage device 23. The audio data having a specific frequency may be audio data having a preset frequency, or audio data having a frequency set by the user or the like. The audio output control unit 220 may acquire multiple audio data having specific frequencies from the auxiliary storage device 23. The audio output control unit 220 performs D / A conversion on the acquired audio data having specific frequencies. Based on the D / A conversion, the audio output control unit 220 outputs a predetermined sound from the speaker 27.

[0119] The first acquisition unit 221 acquires first audio data, including audio data based on a predetermined voice, via the microphone 281 (ACT 33). In ACT 33, for example, the first acquisition unit 221 performs A / D conversion on the voice input to the microphone. Based on the A / D conversion, the first acquisition unit 221 acquires first audio data. When a predetermined voice output from the speaker 27 is input to the microphone 281, the first acquisition unit 221 performs A / D conversion on the predetermined voice input to the microphone 281. Based on the A / D conversion, the first acquisition unit 221 acquires audio data, including audio data based on the predetermined voice, as first audio data. When the voice of a user's utterance is input to the microphone 281, the first acquisition unit 221 performs A / D conversion on the utterance voice input to the microphone 281. Based on the A / D conversion, the first acquisition unit 221 may acquire audio data, including audio data based on the utterance voice, as first audio data. The first acquisition unit 221 stores the first audio data in the auxiliary storage device 23.

[0120] The output unit 224 outputs the first audio data acquired by the first acquisition unit 221 to the second information processing device 3 via the server 1 (ACT34). In ACT34, for example, the output unit 224 outputs the first audio data acquired by the first acquisition unit 221 to the server 1.

[0121] Here, Server 1 outputs the first audio data output by the output unit 224 to the second information processing device 3. The second information processing device 3 acquires the first audio data. The second information processing device 3 controls the output of audio based on the second audio data corresponding to the first audio data via the speaker. The second information processing device 3 outputs the second audio data corresponding to the first audio data output by the output unit 224 to Server 1. Server 1 outputs the second audio data to the first information processing device 2.

[0122] The second acquisition unit 222 acquires second audio data corresponding to the first audio data acquired by the second information processing device 3 via the server 1 (ACT 35). In ACT 35, for example, the second acquisition unit 222 acquires second audio data output from the second information processing device 3 from the server 1. The second acquisition unit 222 may store the second audio data in the auxiliary storage device 23.

[0123] The comparison unit 225 compares the first audio data with the second audio data acquired by the second acquisition unit 222 (ACT 36). In ACT 36, for example, the comparison unit 225 acquires the first audio data from the auxiliary storage device 23. The comparison unit 225 may also acquire the second audio data from the auxiliary storage device 23. The comparison unit 225 determines whether the second audio data matches the first audio data. The comparison unit 225 may determine the degree of match based on the proportion of the second audio data that matches the first audio data.

[0124] The display control unit 226 displays the comparison result from the comparison unit 225 on the display device 26 (ACT37). In ACT37, for example, the display control unit 226 displays a notification indicating the comparison result on the display device 26. The notification indicating the comparison result includes, for example, a match notification, a mismatch notification, a degree of match notification, etc. The display control unit 226 may change the display mode of the match notification, mismatch notification, degree of match notification, etc., depending on the comparison result. The display control unit 226 may also change the display mode of the match notification, mismatch notification, degree of match notification, etc., based on user settings.

[0125] The mode change unit 223 terminates the confirmation mode (ACT38) in response to the user of the first information processing device 2 selecting to use the microphone 281. The mode change unit 223 changes the operation mode from confirmation mode to normal mode. The mode change unit 223 outputs a confirmation mode termination instruction to the second information processing device 3 via the server 1.

[0126] The mode change unit 223 may change the operation mode to confirmation mode without user operation of the first information processing device 2. The mode change unit 223 may periodically repeat the confirmation mode. For example, the mode change unit 223 may repeat the confirmation mode based on a period set by the user. In this case, the processor 21 repeats the processing of ACT32 to ACT37. The mode change unit 223 may change the operation mode from confirmation mode to normal mode based on user operation of the first information processing device 2. User operation is, for example, an operation by the user to terminate the confirmation mode. The mode change unit 223 may terminate the confirmation mode based on the elapsed period of repeating the confirmation mode set by the user. The mode change unit 223 may terminate the confirmation mode if the first audio data and the second audio data match for a predetermined period.

[0127] The information processing procedure by the second information processing device 3 is the same as in the first embodiment. In the second embodiment, in the processing of ACT11 to ACT15 of the first embodiment, "multimedia data" shall be read as "audio data".

[0128] The procedure for information processing by Server 1 is the same as in the first embodiment. In the second embodiment, in the processing of ACT21 to ACT26 of the first embodiment, "multimedia data" shall be read as "audio data".

[0129] [effect] The first information processing device 2 used in the web conferencing system according to the second embodiment can control the output of predetermined audio via a speaker. The first information processing device 2 can acquire first audio data, including audio data based on predetermined audio, via a microphone. The first information processing device 2 can output the acquired first audio data to another information processing device different from itself. The first information processing device 2 can acquire second audio data corresponding to the first audio data from the other information processing device. The first information processing device 2 can compare the first audio data with the acquired second audio data. The first information processing device 2 can display the comparison result on a display device. For example, in a web conferencing system, the first audio data output from the first information processing device 2 is output by another information processing device. The first information processing device 2 obtains the second audio data corresponding to the first audio data from the other information processing device. The first information processing device 2 can display the comparison result between the first audio data and the second audio data. Therefore, the first information processing device 2 can confirm whether the output audio data matches the audio data output by the other information processing device. This allows the user of the first information processing device 2 to confirm whether the first audio data was accurately output by the other information processing device. The first audio data may be degraded during transmission from the first information processing device 2 to the second information processing device 3 due to network interference. The user of the first information processing device 2 can check the comparison result between the first audio data and the second audio data to confirm whether the audio is reaching the other party. Furthermore, since the first information processing device 2 controls the output of a predetermined audio via a speaker, it is possible to confirm whether the audio is reaching the other party without actually requiring speech or other audio from the user of the first information processing device 2. In this way, the first information processing device 2 can realize smooth electronic conferencing.

[0130] The first information processing device 2 according to the second embodiment can output sound based on sound data having a specific frequency. As a result, the first information processing device 2 can easily compare the first sound data and the second sound data because it has identified the frequency of the sound data.

[0131] The first information processing device 2 according to the second embodiment can output sound based on audio data having a frequency below the sampling rate that can be processed by the first information processing device 2. If the sampling rate, which is the period for acquiring audio data, is significantly lower than the frequency of the audio data, the audio data cannot be acquired accurately. However, if the sampling rate is sufficiently higher than the frequency of the audio data, the audio data can be acquired accurately. Therefore, the first information processing device 2 can acquire audio data more accurately by using audio data having a frequency below the sampling rate.

[0132] The first information processing device 2 according to the second embodiment can output audio based on audio data having frequencies outside the range of human hearing. This allows the first information processing device 2 to compare the first audio data and the second audio data based on audio that is inaudible to the user of the first information processing device 2 or participants in a web conference. Therefore, it is possible to confirm whether or not the audio is reaching the other party without interfering with the conduct of the web conference. In this way, the first information processing device 2 can realize smooth electronic conferences.

[0133] [Differentiation] Although the first information processing device 2 and the second information processing device 3 have been described as being equipped with multiple microphones and multiple cameras, they are not limited to this configuration. The first information processing device 2 and the second information processing device 3 may be equipped with at least one microphone and at least one camera.

[0134] [Other embodiments] The information processing device may be implemented as a single electronic device, such as the first information processing device 2, or as multiple electronic devices with distributed functions.

[0135] The program may be transferred while stored on an electronic device, or it may be transferred without being stored on an electronic device. In the latter case, the program may be transferred via a network, or it may be transferred while recorded on a recording medium. The recording medium is a non-temporary, tangible medium. The recording medium is a computer-readable medium. The recording medium can be any medium that is capable of storing a program and is readable by a computer, such as a CD-ROM or memory card, and its form is not limited.

[0136] In addition, several embodiments of the present invention have been described, but these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be carried out in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims of the invention and its equivalents. [Explanation of symbols]

[0137] 1…Server, 2…First information processing device, 3…Second information processing device, 11…Processor, 12…Main memory, 13…Auxiliary storage device, 14…Communication interface, 20kHz…Frequency, 21…Processor, 22…Main memory, 23…Auxiliary storage device, 24…Communication interface, 25…Input interface, 26…Display device, 27…Speaker, 28…Input device, 31…Processor, 32…Main memory, 33…Auxiliary storage device, 34…Communication interface, 35…Input interface, 36…Display device, 37…Speaker, 38…Input device, 100…Web conferencing system Mu, 110...First acquisition unit, 111...Second acquisition unit, 112...First output unit, 113...Second output unit, 210...First acquisition unit, 211...Second acquisition unit, 212...Mode change unit, 213...Output unit, 214...Output control unit, 220...Audio output control unit, 221...First acquisition unit, 222...Second acquisition unit, 223...Mode change unit, 224...Output unit, 225...Comparison unit, 226...Display control unit, 251-1~251-mi...Microphone, 252-1~252-nj...Camera, 281...Microphone, 282...Camera, 351-1~351-m...Microphone, 352-1~352-n...Camera, 381...Microphone, 382...Camera.

Claims

1. An information processing device used in a web conferencing system for verifying the operation of a voice input device selected by the user, A sound output control unit that outputs a predetermined sound via a sound output device, A first acquisition unit that acquires first audio data including audio data based on a predetermined voice via the audio input device, An output unit that outputs the first audio data acquired by the first acquisition unit to another information processing device different from the information processing device, A second acquisition unit acquires second audio data corresponding to the first audio data output via the audio output device of the other information processing device from the other information processing device, A comparison unit compares the first audio data with the second audio data acquired by the second acquisition unit and determines whether the second audio data matches the first audio data. A display control unit that displays the comparison results from the comparison unit on a display device, An information processing device equipped with the following features.

2. The aforementioned predetermined sound is a sound based on sound data having a specific frequency. The information processing apparatus according to claim 1.

3. The aforementioned specific frequency is a frequency less than or equal to the sampling rate that can be processed by the information processing device. The information processing apparatus according to claim 2.

4. The aforementioned specific frequency is a frequency outside the range of human hearing. The information processing apparatus according to claim 2.

5. An information processing device used in a web conferencing system for verifying the operation of an input device selected by a user, A first acquisition unit that acquires first multimedia data based on input via an input device, An output unit that outputs the first multimedia data acquired by the first acquisition unit to another information processing device different from the information processing device, A second acquisition unit acquires second multimedia data corresponding to the first multimedia data output via the output device of the other information processing device from the other information processing device, An output control unit that causes the second multimedia data acquired by the second acquisition unit to be output to an output device including at least one of a speaker and a display device, An information processing device equipped with the following features.

6. On the computer, A voice output control function that outputs a predetermined sound via the voice output device of an information processing device used in a web conferencing system in order to verify the operation of the voice input device selected by the user, A first acquisition function that acquires first audio data including audio data based on a predetermined voice via the audio input device, An output function that outputs the first audio data acquired by the first acquisition function to another information processing device different from the information processing device, A second acquisition function that acquires second audio data corresponding to the first audio data output via the audio output device of the other information processing device from the other information processing device, A comparison function that compares the first audio data with the second audio data acquired by the second acquisition function and determines whether the second audio data matches the first audio data, A display control function that displays the comparison results obtained by the comparison function on a display device, An information processing program to execute an action.

Images