Conference system, conference method, and conference program

Abstract

To provide a conference system, a conference method, and a conference program that make it possible for participants to hear a user's speech appropriately.SOLUTION: A conference system includes a conferencing state determining unit that determines whether or not a first user and a second user are in a direct conferencing state capable of conversing directly without a call system and an output control unit that controls whether or not to have the call system output a first acquired voice from a second speaker on the basis of a determination result of the conferencing state determining unit.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to a conference system, a conference method, and a conference program. [Background technology]

[0002] Conventionally, a conference system that allows multiple users (conference participants) to hold a conference at multiple locations is known. For example, Patent Document 1 discloses a conference system that holds a conference by connecting wireless devices installed at each location to a network and transmitting and receiving audio data between the locations. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 10-136100 Summary of the Invention [Problem to be solved by the invention]

[0004] In recent years, there are cases where each user has their own PC (user terminal) and participates in a conference. In such a conference, the following problems may occur. For example, when user A speaks among users A and B who are at the same location (conference room), user B can directly hear user A's remarks (speech). Furthermore, user B's user terminal can use a conference application to output user A's speech, picked up by the microphone of user A's user terminal, from the speaker of the terminal. In this case, a problem occurs where user B hears a double voice, the voice heard directly from user A and the voice heard from the user terminal, which are the same voice.

[0005] An object of the present invention is to provide a conference system, a conference method, and a conference program that enable a user's spoken voice to be properly heard. [Means for solving the problem]

[0006] A conference system according to one embodiment of the present invention is a conference system in which a microphone and a speaker are assigned to each of a plurality of users, including a first user and a second user, and the plurality of users hold a conference using the microphones and speakers assigned to them, the system comprising a call system in which a first microphone assigned to the first user acquires a first acquired sound and outputs the first acquired sound from a second speaker assigned to the second user, and a second microphone assigned to the second user acquires a second acquired sound and outputs the second acquired sound from the first speaker assigned to the first user, a conversation state determination unit that determines whether the state of the first user and the second user is a direct conversation state in which they can talk directly without going through the call system, and an output control unit that controls the call system to output the first acquired sound from the second speaker based on the determination result of the conversation state determination unit.

[0007] Another aspect of the present invention is a conferencing method in which a microphone and a speaker are assigned to each of a plurality of users, including a first user and a second user, and the plurality of users hold a conference using the microphones and speakers assigned to them, wherein one or more processors execute a call step in which a first microphone assigned to the first user acquires a first acquired sound and outputs the first acquired sound from a second speaker assigned to the second user, and a second microphone assigned to the second user acquires a second acquired sound and outputs the second acquired sound from the first speaker assigned to the first user, a determination step in which the first user and the second user are in a direct conversation state in which they can converse directly without going through the call step, and a control step in which, based on the determination result in the determination step, control whether or not to output the first acquired sound from the second speaker in the call step.

[0008] A conference program according to another aspect of the present invention is a conference program in which a microphone and a speaker are assigned to each of a plurality of users including a first user and a second user, and the plurality of users hold a conference using the microphones and speakers assigned to them, the program causing one or more processors to execute the following steps: a call step in which a first microphone assigned to the first user acquires a first acquired sound and outputs the first acquired sound from a second speaker assigned to the second user, and a second microphone assigned to the second user acquires a second acquired sound and outputs the second acquired sound from the first speaker assigned to the first user; a determination step in which the state of the first user and the second user is a direct conversation state in which they can converse directly without going through the call step; and a control step in which, based on the determination result in the determination step, control whether or not to output the first acquired sound from the second speaker in the call step. Effect of the Invention

[0009] According to the present invention, there are provided a conference system, a conference method, and a conference program that enable a user's spoken voice to be properly heard. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a schematic diagram showing a schematic configuration of a conference system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a functional block diagram showing the configuration of the conference system according to the embodiment of the present invention. [Diagram 3] FIG. 3 is a diagram showing an example of conference room information used in the conference system according to the embodiment of the present invention. [Figure 4] FIG. 4 is a diagram showing an example of user information used in the conference system according to the embodiment of the present invention. [Diagram 5] FIG. 5 is a diagram showing an example of conference information used in the conference system according to the embodiment of the present invention. [Figure 6] FIG. 6 is a schematic diagram showing a method of outputting audio in a conventional conference system. [Figure 7] FIG. 7 is a schematic diagram showing an example of a sound output method in the conference system according to an embodiment of the present invention. [Figure 8] FIG. 8 is a schematic diagram showing an example of a sound output method in the conference system according to an embodiment of the present invention. [Figure 9] FIG. 9 is a schematic diagram showing an example of a sound output method in the conference system according to an embodiment of the present invention. [Figure 10] FIG. 10 is a flowchart for explaining an example of a procedure of a conference process executed in the conference system according to the embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings. Note that the following embodiment is an example of the present invention, and does not limit the technical scope of the present invention.

[0012] The conference system according to the present invention can be applied to a conference in which one or more users participate at multiple locations (conference rooms). For example, in the conference system according to the present embodiment, a user terminal used by each user participating in the conference and a display device for displaying various information such as the display screen of the user terminal are arranged in each conference room. In addition, each user terminal is equipped with a microphone and a speaker.

[0013] [Conference System 100] Fig. 1 is a diagram showing a schematic configuration of a conference system according to an embodiment of the present invention. The conference system 100 includes a conference server 1, a user terminal 2, and a display device DP. For example, as shown in Fig. 1, a user terminal 2a used by a user A who is a participant in the conference, a user terminal 2b used by a user B who is a participant in the conference, and a display device DP1 are arranged in a conference room R1, and a user terminal 2c used by a user C who is a participant in the conference, a user terminal 2d used by a user D who is a participant in the conference, and a display device DP2 are arranged in a conference room R2.

[0014] The conference system 100 is a system in which a microphone and a speaker are assigned to each of a plurality of users including a first user and a second user, and the plurality of users hold a conference using the microphone and speaker assigned to each of them. For example, the microphone and speaker of the user terminal 2a are assigned to the user A, and the microphone and speaker of the user terminal 2b are assigned to the user B.

[0015] The conference system 100 also includes a call system in which a first microphone assigned to the first user acquires a first acquired voice and outputs the first acquired voice from a second speaker assigned to the second user, and a second microphone assigned to the second user acquires a second acquired voice and outputs the second acquired voice from the first speaker assigned to the first user. For example, the conference system 100 outputs the speech voice of user A acquired by the microphone of a user terminal 2a assigned to user A from a speaker of a user terminal 2c assigned to user C, and outputs the speech voice of user C acquired by the microphone of the user terminal 2c assigned to user C from the speaker of the user terminal 2a assigned to user A.

[0016] [Conference Server 1] 2, the conference server 1 includes a control unit 11, a storage unit 12, an operation display unit 13, and a communication unit 14. The conference server 1 may be one or more virtual servers (cloud servers), or may be one or more physical servers.

[0017] The communication unit 14 is a communication interface that connects the conference server 1 to the network N1 via a wired or wireless connection, and performs data communication with other devices (e.g., a user terminal 2, a display device DP) via the network N1 in accordance with a predetermined communication protocol.

[0018] The operation display unit 13 is a user interface that includes a display unit, such as a liquid crystal display or an organic EL display, that displays various information, and an operation unit, such as a mouse, a keyboard, or a touch panel, that accepts operations.

[0019] The storage unit 12 is a non-volatile storage unit such as a flash memory, a hard disk drive (HDD), or a solid state drive (SSD) that stores various information. The storage unit 12 stores a control program such as a conference program for causing the control unit 11 to execute a conference process (see FIG. 10) described below. For example, the conference program may be non-temporarily recorded on a computer-readable recording medium such as a CD or DVD, read by a reading device (not shown) such as a CD drive or DVD drive provided in the conference server 1, and stored in the storage unit 12.

[0020] The storage unit 12 also stores data such as conference room information D1, user information D2, and conference information D3.

[0021] An example of the conference room information D1 is shown in Fig. 3. In the conference room information D1, information such as the corresponding "conference room ID" and "conference room name" are registered for each conference room in association with each other. The "conference room ID" is information for identifying the conference room. The "conference room name" is the name of the conference room, and the room number, etc. are registered.

[0022] FIG. 4 shows an example of user information D2. In the user information D2, information such as the corresponding "user ID," "user name," and "password" are registered for each user in association with each other. Information on all users who have the authority to use the conference system 100, not just users who will participate in the conference, is registered in advance in the user information D2. For example, information on all employees of a company is registered in the user information D2. The "user ID" is user identification information, and the "user name" is the user's name. The "user ID" and "password" are information used for the login process when a user participates in a conference.

[0023] For example, when starting a conference, a user who wishes to participate in the conference starts a conference application on his / her own user terminal 2 and inputs the login information, that is, the user ID and the password, into the login screen. The conference server 1 performs login processing (authentication processing) based on the login information. Once the user has logged in, he / she is able to participate in the conference using the conference application.

[0024] FIG. 5 shows an example of the conference information D3. In the conference information D3, information (reservation information) such as the corresponding "conference ID", "conference name", "conference room ID", "start date and time", "end date and time", "participant ID", and "file ID" are registered in association with each other for each conference. The "conference ID" is identification information of the conference, and the "conference name" is the name (subject) of the conference. The "start date and time" is the scheduled start date and time of the conference, and the "end date and time" is the scheduled end date and time of the conference. The "participant ID" is identification information (user ID) of a user participating in the conference. The "file ID" is identification information of a file (material) used in the conference, and file data corresponding to the file ID is stored in the storage unit 12 or a database (not shown). The conference information D3 is registered in advance by a person in charge or the like when the schedule for holding the conference is decided.

[0025] In addition, some or all of the information such as conference room information D1, user information D2, and conference information D3 may be stored in either the conference server 1, the user terminal 2, or another server (not shown), or may be stored in a distributed manner across multiple of these devices.

[0026] The control unit 11 has control devices such as a CPU, a ROM, and a RAM. The CPU is a processor that executes various arithmetic operations. The ROM stores in advance control programs such as a BIOS and an OS for causing the CPU to execute various processes. The RAM stores various information, and is used as a temporary storage memory (work area) for the various processes executed by the CPU. The control unit 11 controls the conference server 1 by causing the CPU to execute various control programs that are pre-stored in the ROM or the memory unit 12.

[0027] The control unit 11 functions as the various processing units by executing various processes according to the control program with the CPU. In addition, some or all of the processing units included in the control unit 11 may be configured with electronic circuits. The control program may be a program for causing a plurality of processors to function as the various processing units.

[0028] Specifically, the control unit 11 registers conference room information D1, user information D2, and conference information D3. The control unit 11 registers each piece of information in advance in the storage unit 12 based on a registration operation by the user. For example, when a user performs an operation to register user information D2 and conference information D3 on his / her own user terminal 2, the control unit 11 accepts the operation and registers the user information D2 and conference information D3 in the storage unit 12. Also, for example, when an administrator of a conference room performs an operation to register conference room information D1 on his / her own user terminal 2 or management terminal, the control unit 11 accepts the operation and registers the conference room information D1 in the storage unit 12.

[0029] In addition, the control unit 11 executes a login process (authentication process) for a user who will participate in the conference. For example, when a user who will attend the conference inputs the login information, that is, the user ID and the password, into a login screen, the control unit 11 executes the login process by referring to the user information D2 and the conference information D3.

[0030] Furthermore, when the conference starts, the control unit 11 acquires voice data from the user terminal 2 and outputs the acquired voice data to each user terminal 2. For example, when the control unit 11 acquires voice data of an utterance voice Va uttered by user A from the user terminal 2a, it outputs the voice data to the user terminal 2c and the user terminal 2d. Also, for example, when the control unit 11 acquires voice data of an utterance voice Vc uttered by user C from the user terminal 2c, it outputs the voice data to the user terminal 2a and the user terminal 2b.

[0031] [User device 2] As shown in Fig. 2, the user terminal 2 includes a control unit 21, a storage unit 22, an operation display unit 23, a microphone 24, a speaker 25, and a communication unit 26. Fig. 1 illustrates a user terminal 2a and a user terminal 2b arranged in a conference room R1, and a user terminal 2c and a user terminal 2d arranged in a conference room R2. The user terminals 2a to 2d have the same functions.

[0032] The operation display unit 23 is a user interface that includes a display unit, such as a liquid crystal display or an organic EL display, that displays various information, and an operation unit, such as a mouse, a keyboard, or a touch panel, that accepts operations.

[0033] Microphone 24 collects the speech of the user of user terminal 2. Data of the speech (voice data) collected by microphone 24 is input to control unit 21. Speaker 25 outputs (emits) sound based on an instruction from control unit 21. For example, speaker 25 outputs the voice of the voice data acquired by user terminal 2 via conference server 1 to the outside in accordance with an instruction from control unit 21.

[0034] The communication unit 26 is a communication interface for connecting the user terminal 2 to the network N1 via a wired or wireless connection, and for executing data communication with other devices (such as the conference server 1) via the network N1 in accordance with a predetermined communication protocol.

[0035] The storage unit 22 is a non-volatile storage unit such as a flash memory, HDD, or SSD that stores various information. The storage unit 22 stores a control program such as a conference program for causing the control unit 21 to execute a conference process (see FIG. 10) described below. For example, the conference program may be non-temporarily recorded on a computer-readable recording medium such as a CD or DVD, read by a reading device (not shown) such as a CD drive or DVD drive provided in the user terminal 2, and stored in the storage unit 22.

[0036] The control unit 21 has control devices such as a CPU, a ROM, and a RAM. The CPU is a processor that executes various arithmetic operations. The ROM stores in advance control programs such as a BIOS and an OS for causing the CPU to execute various processes. The RAM stores various information, and is used as a temporary storage memory (work area) for the various processes executed by the CPU. The control unit 21 controls the user terminal 2 by executing, by the CPU, various control programs that are stored in advance in the ROM or the memory unit 22.

[0037] However, when each user has his / her own user terminal 2 and participates in a conference, the following problem may occur. For example, as shown in FIG. 6, when user A speaks out of users A and B in the same conference room R1, user B can directly hear the speech voice Va uttered by user A. In addition, the user terminal 2b of user B can output the speech voice Va of user A collected by the microphone 24 of the user terminal 2a of user A from the speaker 25 of the user terminal 2b via the conference server 1 using a conference application. In this case, a problem occurs in that user B hears the same voice twice, the voice directly heard from user A and the voice heard from the user terminal 2b. In response to this, the conference system 100 according to this embodiment makes it possible to make the user's speech voice be properly heard.

[0038] Specifically, as shown in Fig. 2, the control unit 21 includes various processing units such as a voice acquisition unit 211, a conversation state determination unit 212, an output control unit 213, and a position acquisition unit 214. The control unit 21 functions as the various processing units by executing various processes according to the control program with the CPU. Some or all of the processing units included in the control unit 21 may be configured with electronic circuits. The control program may be a program for causing a plurality of processors to function as the various processing units.

[0039] The voice acquisition unit 211 acquires voice data of the spoken voice collected by the microphone 24. For example, when the microphone 24 of the user terminal 2a collects the spoken voice Va uttered by the user A, the voice acquisition unit 211 of the user terminal 2a acquires the voice data of the spoken voice Va from the microphone 24 of the user terminal 2a. The control unit 21 outputs the voice data acquired by the voice acquisition unit 211 to the conference server 1.

[0040] Here, for example, as shown in Fig. 7, when user terminal 2b is near user A, microphone 24 of user terminal 2b collects speech voice Va uttered by user A. In this case, voice acquisition unit 211 of user terminal 2b acquires voice data of the speech voice Va from microphone 24 of user terminal 2b. In addition, voice acquisition unit 211 of user terminal 2b acquires voice data of the speech voice Va output from conference server 1 (see Fig. 7).

[0041] The conversation state determination unit 212 determines whether the first user and the second user are in a direct conversation state in which they can talk to each other directly. For example, if the first user and the second user are close to each other in the same conference room, they can talk to each other directly. In this case, the first user and the second user are in a direct conversation state. The first user and the second user are, for example, user A and user B in conference room R1, or user C and user D in conference room R2.

[0042] Specifically, the conversation state determination unit 212 of the user terminal 2 of the first user determines whether or not the first acquired voice acquired (collected) by the microphone 24 of the user terminal 2 of the first user includes the speech voice of the second user. For example, the conversation state determination unit 212 of the user terminal 2 of the first user compares the first acquired voice acquired by the microphone 24 of the user terminal 2 of the first user with the second acquired voice acquired by the microphone 24 of the user terminal 2 of the second user, and determines whether or not the first acquired voice includes the speech voice of the second user based on the comparison result.

[0043] For example, the conversation state determination unit 212 of the user terminal 2b compares the voice acquired by the microphone 24 of the user terminal 2b (first acquired voice) with the voice acquired by the microphone 24 of the user terminal 2a (second acquired voice), and if the two voices match, determines that the first acquired voice contains the speech voice of the second user.

[0044] When the conversation state determination unit 212 determines that the first acquired voice includes the speech voice of the second user, the conversation state determination unit 212 determines that the states of the first user and the second user are in the direct conversation state. For example, when the conversation state determination unit 212 of the user terminal 2b determines that the first acquired voice acquired by the microphone 24 of the user terminal 2b includes the speech voice Va of the user A, the conversation state determination unit 212 determines that the states of the users A and B are in the direct conversation state.

[0045] Similarly, the conversation state determination unit 212 of the user terminal 2 of the second user determines whether or not the second acquired voice acquired (collected) by the microphone 24 of the user terminal 2 of the second user includes the speech voice of the first user. For example, the conversation state determination unit 212 of the user terminal 2 of the second user compares the second acquired voice acquired by the microphone 24 of the user terminal 2 of the second user with the first acquired voice acquired by the microphone 24 of the user terminal 2 of the first user, and determines whether or not the second acquired voice includes the speech voice of the first user based on the comparison result.

[0046] For example, the conversation state determination unit 212 of the user terminal 2a compares the voice acquired by the microphone 24 of the user terminal 2a (second acquired voice) with the voice acquired by the microphone 24 of the user terminal 2b (first acquired voice), and if the two voices match, determines that the second acquired voice contains the speech voice of the first user.

[0047] When the conversation state determination unit 212 determines that the second acquired voice includes the speech voice of the first user, it determines that the states of the first user and the second user are in the direct conversation state. For example, when the conversation state determination unit 212 of the user terminal 2a determines that the second acquired voice acquired by the microphone 24 of the user terminal 2a includes the speech voice Vb of user B, it determines that the states of user A and user B are in the direct conversation state.

[0048] 8, for example, conversation state determination unit 212 of user terminal 2b determines that the voice captured by microphone 24 of user terminal 2b does not include the speech voice Vc of user C because microphone 24 of user terminal 2b does not capture the speech voice Vc of user C. In this case, conversation state determination unit 212 of user terminal 2b determines that the states of users B and C are not in the direct conversation state.

[0049] The output control unit 213 controls whether or not the first acquired voice is to be output from the speaker 25, based on the determination result of the conversation state determination unit 212.

[0050] Specifically, when the conversation state determination unit 212 determines that the states of the first user and the second user are in the direct conversation state, the output control unit 213 does not output the first acquired voice from the speaker 25. For example, as shown in Fig. 9, when the conversation state determination unit 212 of the user terminal 2b determines that the states of the users A and B are in the direct conversation state, the output control unit 213 of the user terminal 2b does not output the speech voice Va of the user A acquired from the conference server 1 from the speaker 25 of the user terminal 2b. For example, the output control unit 213 of the user terminal 2b cancels the speech voice Va by superimposing an opposite-phase voice signal on the voice signal of the speech voice Va of the user A acquired from the conference server 1.

[0051] Furthermore, when the conversation state determination unit 212 determines that the states of the first user and the second user are not in the direct conversation state, the output control unit 213 outputs the first acquired voice from a speaker. For example, as shown in Fig. 8, when the conversation state determination unit 212 of the user terminal 2b determines that the states of the users B and C are not in the direct conversation state, the output control unit 213 of the user terminal 2b outputs the speech voice Vc of the user C acquired from the conference server 1 from the speaker 25 of the user terminal 2b.

[0052] Similarly, the output control unit 213 controls whether or not to output the second acquired voice from the speaker 25 based on the determination result of the conversation state determination unit 212 .

[0053] Specifically, when the conversation state determination unit 212 determines that the states of the first user and the second user are in the direct conversation state, the output control unit 213 does not output the second acquired voice from the speaker 25. For example, when the conversation state determination unit 212 of the user terminal 2a determines that the states of the users A and B are in the direct conversation state, the output control unit 213 of the user terminal 2a does not output the speech voice Vb of the user B acquired from the conference server 1 from the speaker 25 of the user terminal 2a. For example, the output control unit 213 of the user terminal 2a cancels the speech voice Vb by superimposing an opposite-phase voice signal on the voice signal of the speech voice Vb of the user B acquired from the conference server 1.

[0054] Furthermore, when the conversation state determination unit 212 determines that the states of the first user and the second user are not in the direct conversation state, the output control unit 213 outputs the second acquired voice from a speaker. For example, when the conversation state determination unit 212 of the user terminal 2c determines that the states of the users B and C are not in the direct conversation state, the output control unit 213 of the user terminal 2c outputs the speech voice Vb of the user B acquired from the conference server 1 from the speaker 25 of the user terminal 2c.

[0055] [Conference Processing] Hereinafter, an example of a procedure of a conference process executed in the conference system 100 will be described with reference to FIG.

[0056] The present invention can be understood as an invention of a conferencing method (one example of the conferencing method of the present invention) that executes one or more steps included in the conferencing process. One or more steps included in the conferencing process described here may be omitted as appropriate. The steps in the conferencing process may be executed in a different order as long as the same operational effect is achieved. Furthermore, although an example is described here in which the control unit 21 of the user terminal 2 included in the conferencing system 100 executes each step in the conferencing process, in other embodiments, one or more processors may execute each step in the conferencing process in a distributed manner.

[0057] The conference process is, for example, executed individually and in parallel in each user terminal 2. Here, the conference process executed in the user terminal 2b of user B will be described as an example.

[0058] First, in step S1, the control unit 21 of the user terminal 2b of the user B determines whether or not a voice has been acquired. For example, the control unit 21 of the user terminal 2b acquires the voice of the first user in the voice data output from the conference server 1 and the voice of the second user collected by the microphone 24 of the user terminal 2b.

[0059] Next, in step S2, control unit 21 of user terminal 2b determines whether the acquired voice includes the speech voice (microphone voice) of a second user (e.g., user A) acquired by microphone 24 of user terminal 2b. If the acquired voice includes the speech voice of user A (S2: Yes) (see FIG. 7), the process proceeds to step S3. On the other hand, if the acquired voice does not include the speech voice of user A (S2: No), the process proceeds to step S21.

[0060] In step S3, the control unit 21 of the user terminal 2b determines that the state of the users A and B is a direct conversation state. After that, the process proceeds to step S4.

[0061] In step S4, the control unit 21 of the user terminal 2b does not output the speech voice of user A from the speaker 25 of the user terminal 2b. For example, as shown in Fig. 9, when the control unit 21 of the user terminal 2b determines that the states of users A and B are in the direct conversation state, it does not output the speech voice Va of user A acquired from the conference server 1 from the speaker 25 of the user terminal 2b. For example, the control unit 21 of the user terminal 2b cancels the speech voice Va of user A by superimposing an opposite-phase audio signal on the audio signal of the speech voice Va. Then, the process returns to step S1.

[0062] In contrast, for example, if the voice acquired in step S1 is the voice of user C (first user) output from the conference server 1, control unit 21 of user terminal 2b determines in step S21 that user B and user C are not in a direct conversation state. For example, when control unit 21 of user terminal 2b acquires speech voice Vc of user C from the conference server 1, it determines that user B and user C are not in a direct conversation state. Then, the process proceeds to step S22.

[0063] In step S22, control unit 21 of user terminal 2b outputs speech voice Vc of user C (first user) acquired from conference server 1 from speaker 25 of user terminal 2b (see FIG. 8). After that, the process returns to step S1.

[0064] The control unit 21 of each user terminal 2 repeatedly executes the above-mentioned conference processing.

[0065] As described above, the conference system 100 according to the present embodiment is a system in which a microphone and a speaker are assigned to each of a plurality of users including a first user and a second user, and the plurality of users hold a conference using the microphones and speakers assigned to them. In addition, in the conference system 100, a first microphone assigned to the first user acquires a first acquired voice and outputs the first acquired voice from a second speaker assigned to the second user, and a second microphone assigned to the second user acquires a second acquired voice and outputs the second acquired voice from the first speaker assigned to the first user. In addition, the conference system 100 determines whether the state of the first user and the second user is a direct conversation state in which the first user and the second user can talk directly without going through the call system, and controls whether or not to cause the call system to output the first acquired voice from the second speaker based on the determination result of the conversation state determination unit.

[0066] As a result, for example, when user A and user B participate in a conference in the same conference room R1, when user A speaks, the user terminal 2b does not output the speech of user A, and user B can directly hear the speech of user A. This prevents the problem of user A's speech being heard twice.

[0067] The conference system of the present invention is not limited to the above-mentioned embodiment. For example, as another embodiment of the present invention, the conversation state determination unit 212 may execute a specification process for specifying a speaker of a speech voice included in a microphone voice acquired by the microphone 24, and determine whether or not the microphone voice includes a speech voice of a first user based on the result of the specification process. For example, the conversation state determination unit 212 of the user terminal 2b specifies a speaker based on a microphone voice acquired by the microphone 24 of the user terminal 2b. For example, the conversation state determination unit 212 specifies a speaker by referring to a database (speaker list) that stores voice identification information for each user. When the conversation state determination unit 212 of the user terminal 2b specifies user A as the speaker of the voice acquired by the microphone 24 of the user terminal 2b, it determines that the microphone voice includes the speech voice of user A. In this case, the conversation state determination unit 212 determines that the state of users A and B is the direct conversation state.

[0068] Similarly, conversation state determination unit 212 of user terminal 2a identifies the speaker based on the microphone voice acquired by microphone 24 of user terminal 2a. When conversation state determination unit 212 of user terminal 2a identifies user B as the speaker of the voice acquired by microphone 24 of user terminal 2a, it determines that the microphone voice includes the speech voice of user B. In this case, conversation state determination unit 212 determines that the states of users A and B are in the direct conversation state.

[0069] As another embodiment of the present invention, the control unit 21 may include a position acquisition unit 214 (see FIG. 2) that acquires position information of a first user and position information of a second user. In this case, the conversation state determination unit 212 determines that the state of the first user and the second user is the direct conversation state when the position of the first user and the position of the second user are in a predetermined positional relationship.

[0070] For example, when the distance between the position of the first user and the position of the second user is equal to or less than a predetermined distance, the conversation state determination unit 212 determines that the state of the first user and the second user is the direct conversation state. Also, when the position of the first user and the position of the second user are in the same room (conference room), the conversation state determination unit 212 determines that the state of the first user and the second user is the direct conversation state.

[0071] In the above embodiment, the conference system 100 corresponds to the conference system of the present invention, but the conference system of the present invention is not limited to this. For example, the conference system of the present invention may be configured by the user terminal 2 alone, may be configured by the conference server 1 alone, or may be configured by the user terminal 2 and the conference server 1. For example, the conference server 1 may have the functions of the voice acquisition unit 211, the conversation state determination unit 212, the output control unit 213, and the position acquisition unit 214 of the user terminal 2.

[0072] Moreover, the user terminal 2 including the microphone 24, the speaker 25, and the communication unit 26, the conference server 1, and the network N1 are an example of a call system of the present invention. That is, the call system of the present invention includes a plurality of components for realizing a conversation by transmitting and receiving voice data using a communication function.

[0073] Furthermore, the conference system of the present invention can be constructed by freely combining the embodiments described above, or by appropriately modifying or omitting parts of each embodiment, within the scope of the invention described in each claim. [Explanation of symbols]

[0074] 1: Conference server 2: User device 21: Control section 22: Storage section 23: Operation display section 24:Mike 25: Speaker 26: Communications Department 100: Conference system 211: Voice acquisition unit 212: Conversation state determination unit 213: Output control section 214: Position acquisition part

Claims

1. A conference system in which a microphone and a speaker are assigned to each of a plurality of users including a first user and a second user, and the plurality of users hold a conference using the microphone and the speaker assigned to each of the users, a communication system in which a first microphone assigned to the first user acquires a first acquired sound and outputs the first acquired sound from a second speaker assigned to the second user, and a second microphone assigned to the second user acquires a second acquired sound and outputs the second acquired sound from the first speaker assigned to the first user; a conversation state determination unit that determines whether the first user and the second user are in a direct conversation state in which the first user and the second user can talk to each other directly without going through the communication system; an output control unit that controls the telephone system to output the first acquired voice from the second speaker based on a determination result of the conversation state determination unit; Equipped with the conversation state determination unit determines that a state of the first user and the second user is in the direct conversation state when the first acquired sound acquired from the first microphone and the second acquired sound acquired from the second microphone match, and determines that a state of the first user and the second user is not in the direct conversation state when the first acquired sound and the second acquired sound do not match, The output control unit is When the conversation state determination unit determines that the state of the first user and the second user is the direct conversation state, the communication system is not caused to output the first acquired voice from the second speaker, A conference system that causes the call system to output the first acquired voice from the second speaker when the conversation state determination unit determines that the state of the first user and the second user is not the direct conversation state.

2. the output control unit controls the telephone system to output the second acquired voice from the first speaker based on a determination result of the conversation state determination unit. The conference system according to claim 1 .

3. The output control unit is When the conversation state determination unit determines that the state of the first user and the second user is the direct conversation state, the communication system is not caused to output the second acquired voice from the first speaker, When the conversation state determination unit determines that the state of the first user and the second user is not the direct conversation state, the communication system is caused to output the second acquired voice from the first speaker. The conference system according to claim 2 .

4. the conversation state determination unit determines whether or not the first acquired sound includes a speech voice of the second user, and when it is determined that the first acquired sound includes the speech voice of the second user, determines that a state of the first user and the second user is the direct conversation state. The conference system according to any one of claims 1 to 3.

5. the conversation state determination unit identifies a speaker of an utterance voice included in the first acquired voice, and determines whether or not the first acquired voice includes the utterance voice of the second user based on a result of the identification. The conference system according to claim 4.

6. the conversation state determination unit determines whether or not the second acquired sound includes a speech voice of the first user, and when it is determined that the second acquired sound includes the speech voice of the first user, determines that a state of the first user and the second user is the direct conversation state. The conference system according to any one of claims 1 to 3.

7. the conversation state determination unit identifies a speaker of an utterance voice included in the second acquired voice, and determines whether or not the second acquired voice includes the utterance voice of the first user based on a result of the identification. The conference system according to claim 6.

8. A conferencing method in which a microphone and a speaker are assigned to each of a plurality of users including a first user and a second user, and the plurality of users hold a conference using the microphone and the speaker assigned to each of the users, One or more processors a call step in which a first microphone assigned to the first user acquires a first acquired sound and outputs the first acquired sound from a second speaker assigned to the second user, and a second microphone assigned to the second user acquires a second acquired sound and outputs the second acquired sound from the first speaker assigned to the first user; a determination step of determining whether or not the first user and the second user are in a direct conversation state in which the first user and the second user can talk to each other directly without going through the call step; a control step of controlling whether or not to output the first acquired voice from the second speaker in the call step based on a result of the determination step; Run In the determination step, when the first acquired sound acquired from the first microphone and the second acquired sound acquired from the second microphone match, it is determined that the state of the first user and the second user is the direct conversation state, and when the first acquired sound and the second acquired sound do not match, it is determined that the state of the first user and the second user is not the direct conversation state; In the control step, When it is determined in the determining step that the state of the first user and the second user is the direct conversation state, the first acquired voice is not output from the second speaker, A conferencing method, comprising: outputting the first acquired voice from the second speaker when it is determined in the determining step that the state of the first user and the second user is not the direct conversation state.

9. A conference program in which a microphone and a speaker are assigned to each of a plurality of users including a first user and a second user, and the plurality of users hold a conference using the microphone and the speaker assigned to each of the users, a call step in which a first microphone assigned to the first user acquires a first acquired sound and outputs the first acquired sound from a second speaker assigned to the second user, and a second microphone assigned to the second user acquires a second acquired sound and outputs the second acquired sound from the first speaker assigned to the first user; a determination step of determining whether or not the first user and the second user are in a direct conversation state in which the first user and the second user can talk to each other directly without going through the call step; a control step of controlling whether or not to output the first acquired voice from the second speaker in the call step based on a result of the determination step; on one or more processors, In the determination step, when the first acquired sound acquired from the first microphone and the second acquired sound acquired from the second microphone match, it is determined that the state of the first user and the second user is in the direct conversation state, and when the first acquired sound and the second acquired sound do not match, it is determined that the state of the first user and the second user is not in the direct conversation state; In the control step, When it is determined in the determining step that the state of the first user and the second user is the direct conversation state, the first acquired voice is not output from the second speaker, a conference program that outputs the first acquired voice from the second speaker when it is determined in the determining step that the first user and the second user are not in the direct conversation state;

Images