Remote conferencing control device

Abstract

To keep quality of conversation voice in a remote conference.SOLUTION: In a remote conference system 1, a microphone of a user terminal 10 (a first user terminal) used by a user who participates in a certain remote conference collects voice from a speaker of a user terminal 10 (a second user terminal) used by another user who participates in the conference. When the collected voice is re-output from the speaker of the user terminals 10 (the first and the second user terminals), a problem of howling may occur. Thus, a server device 20 includes: a determination section 222 for determining whether two or more users exist in a common space among a plurality of users who participates in one remote conference; and an invalidation processing section 223 for invalidate voice collection of the microphone corresponding to the user who is not speaking among the two or more users when it is determined that the two or more users among the plurality of users in the one remote conference exist in the common space.SELECTED DRAWING: Figure 4

Description

Technical Field

[0001] The present invention relates to a technology for holding a remote conference.

Background Art

[0002] In recent years, the popularity of a remote conference system in which users at remote locations share information while conversing via a telecommunication system has been increasing. In this remote conference system, there may occur a problem of howling, in which the microphone used by a user participating in the remote conference picks up the sound from the speaker and the picked-up sound is output again from the speaker. Further, there is also a problem that the voice of a user participating in a certain remote conference is picked up by the microphone used by a user who is another participant in a different remote conference and is near the former user, so that voices of different remote conferences are mixed.

[0003] For example, regarding howling suppression in a single conference terminal, Patent Document 1 discloses a mechanism for performing echo cancellation processing between an audio signal decoded from audio data and an audio signal supplied from an audio switch to prevent the occurrence of howling during communication.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] As described above, there are various problems regarding the quality of conversation voices in a remote conference. Therefore, an object of the present invention is to maintain the quality of conversation voices in a remote conference.

Means for Solving the Problems

[0006] To solve the above problems, the present invention includes a determination unit that determines whether two or more users among multiple users participating in one remote conference are in the same space, and a disabling processing unit that, if it is determined that two or more users among the multiple users of the one remote conference are in the same space, disables the microphone pickup corresponding to the user who is not speaking among those two or more users. The determination unit obtains the reception level of the wireless signals transmitted and received between terminals used by each user for remote conferencing from each terminal, and if the obtained reception level is above a threshold, it determines that multiple users are in the same space. The present invention provides a remote conferencing control device characterized by [this feature]. [Effects of the Invention]

[0008] According to the present invention, it is possible to maintain the quality of conversational audio in remote conferences. [Brief explanation of the drawing]

[0009] [Figure 1] This figure shows an example of the configuration of a remote conferencing system 1 according to the first embodiment of the present invention. [Figure 2] A block diagram showing an example of the hardware configuration of a user terminal 10 according to the first embodiment. [Figure 3] This block diagram shows an example of the hardware configuration of the server device 20 according to the first embodiment. [Figure 4] This is a block diagram showing an example of the functional configuration of the remote conferencing system 1 according to the first embodiment. [Figure 5] This figure illustrates the data stored in the storage unit 221 of the server device 20 according to the first embodiment. [Figure 6] This is a flowchart showing an example of the operation of the server device 20 according to the first embodiment. [Figure 7] This is a block diagram showing an example of the functional configuration of the remote conferencing system 1 according to the second embodiment. [Figure 8] This is a flowchart illustrating an example of the operation of the server device 20 according to the second embodiment. It is a diagram illustrating the relationships between the components. [Modes for carrying out the invention]

[0010] [First Embodiment] Figure 1 shows an example of the remote conferencing system 1 of this embodiment. This remote conferencing system 1 comprises a plurality of user terminals 10a, 10b, and 10c (hereinafter collectively referred to as user terminals 10), each functioning as a "terminal" according to the present invention, such as a smartphone, tablet, wearable device, or personal computer, and a server device 20 that functions as a "remote conferencing control device" according to the present invention. Network 2 connects these user terminals 10 and server device 20 so that they can communicate with each other. Network 2 is, for example, a LAN (Local Area Network) or a WAN (Wide Area Network), or a combination thereof, and includes a wired section or a wireless section. It is desirable that network 2 be a network compliant with the fifth-generation mobile communication system, which is characterized by low latency, but it is not necessarily limited to this. Although Figure 1 shows three user terminals, 10a, 10b, and 10c, there may be four or more of these.

[0011] In the remote conferencing system 1, multiple users participating in a remote conference can communicate and share information via voice between user terminals 10 via a network 2, even though they are in different locations. Each user terminal 10 used by multiple users participating in the same remote conference (hereinafter referred to as "the same conference") picks up the voice spoken by the user and transmits the voice data representing that voice to the server device 20 via the network 2. The server device 20 transmits the voice data received via the network 2 from one user's terminal 10 participating in the same conference to the user terminals 10 of other users participating in the same conference via the network 2. Each user terminal 10 outputs voice corresponding to the voice data transmitted from the server device 20. This enables each user to communicate via voice.

[0012] In remote conferencing systems, if two or more users are in close proximity to each other while participating in a remote conference, a problem called feedback can occur. This can happen when the microphone on one user's terminal (the first user's terminal) picks up sound from the speaker on the other user's terminal (the second user's terminal), and then outputs that sound back through the speaker on the second user's terminal.

[0013] Therefore, in the first embodiment of the present invention, it is determined whether two or more users among the multiple users participating in one remote conference are in the same space, and if it is determined that two or more users are in the same space, the sound pickup of the microphone corresponding to the user who is not speaking among those two or more users is disabled to resolve this feedback problem. In other words, the remote conferencing system 1 according to the first embodiment has as its main purpose the prevention of feedback when multiple users are participating in the same conference in the same place.

[0014] Figure 2 shows an example of the hardware configuration of a user terminal 10 according to the first embodiment. Physically, the user terminal 10 is configured as a computer device including a processor 1001, memory 1002, storage 1003, communication device 1004, input device 1005, output device 1006, and a bus connecting them. In the following description, the term "device" can be read as a circuit, device, unit, etc. The hardware configuration of the user terminal 10 may include one or more of the devices shown in the figure, or it may be configured without some of the devices.

[0015] Each function in the user terminal 10 is realized by loading predetermined software (programs) onto hardware such as the processor 1001 and memory 1002, which allows the processor 1001 to perform calculations, control communication by the communication device 1004, and control at least one of data reading and writing in the memory 1002 and storage 1003.

[0016] Processor 1001 controls the entire computer by operating, for example, an operating system. Processor 1001 may be constituted by a central processing unit (CPU: Central Processing Unit) including an interface with peripheral devices, a control device, an arithmetic device, registers, and the like. Further, for example, a baseband signal processing unit, a call processing unit, and the like may be realized by Processor 1001.

[0017] Processor 1001 reads programs (program codes), software modules, data, etc. from at least one of storage 1003 and communication device 1004 into memory 1002, and executes various processes according to these. As the program, a program for causing a computer to execute at least a part of the operations described later is used. The functional blocks of user terminal 10 may be stored in memory 1002 and realized by a control program operating in Processor 1001. Various processes may be executed by one Processor 1001, or may be executed simultaneously or sequentially by two or more Processors 1001. Processor 1001 may be implemented by one or more chips. Note that the program may be transmitted from network 2 to user terminal 10 via a telecommunication line.

[0018] Memory 1002 is a computer-readable recording medium and may be constituted by at least one of, for example, ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable ROM), RAM (Random Access Memory), and the like. Memory 1002 may be referred to as a register, a cache, a main memory (main storage device), and the like. Memory 1002 can store programs (program codes), software modules, etc. executable for implementing the method according to the present embodiment.

[0019] Storage 1003 is a computer-readable recording medium, which may be constituted by at least one of, for example, optical discs such as CD-ROM (Compact Disc ROM), hard disk drives, flexible disks, magneto-optical disks (e.g., compact discs, digital versatile discs, Blu-ray (registered trademark) discs), smart cards, flash memories (e.g., cards, sticks, key drives), floppy (registered trademark) disks, magnetic strips, etc. Storage 1003 may be referred to as an auxiliary storage device. Storage 1003 stores a performance evaluation program and a group of musical score data described later.

[0020] Communication device 1004 is hardware (a transmission / reception device) for performing communication between computers via at least one of a wired network or a wireless network, and is also referred to as, for example, a network device, a network controller, a network card, a communication module, etc. Communication device 1004 may be configured to include, for example, a high-frequency switch, a duplexer, a filter, a frequency synthesizer, etc. in order to implement at least one of frequency division duplex (FDD: Frequency Division Duplex) and time division duplex (TDD: Time Division Duplex). For example, a transmission / reception antenna, an amplifier section, a transmission / reception section, a transmission line interface, etc. may be realized by communication device 1004. The transmission / reception section may be physically or logically separated into a transmission section and a reception section.

[0021] Input device 1005 is an input device (e.g., keys, switches, buttons, sensors, etc.) that receives external input and includes at least a microphone. Output device 1006 is an output device (e.g., a display, an LED light, etc.) that performs external output and includes at least a speaker. Note that input device 1005 and output device 1006 may have an integrated configuration (e.g., a touch screen).

[0022] The short-range wireless communication device 1007 is hardware (transceiver / receiver device) that performs wireless communication according to a communication standard such as UWB (Ultra Wide Band) or BTLE (Bluetooth Low Energy / registered trademark). These communication standards include a distance measuring function that determines the distance between the short-range wireless communication devices 1007. In the first embodiment, this distance measuring function is used to estimate the distance between the user terminals 10.

[0023] Each device, such as the processor 1001 and memory 1002, is connected by a bus for communicating information. The bus may be configured using a single bus, or different buses may be used for each device.

[0024] Furthermore, the user terminal 10 may be configured to include hardware such as a microprocessor, a digital signal processor (DSP), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), and an FPGA (Field Programmable Gate Array), and some or all of each functional block may be realized by such hardware. For example, the processor 1001 may be implemented using at least one of these hardware components.

[0025] Figure 3 shows the hardware configuration of the server device 20 according to the first embodiment. The hardware configuration of the server device 20 may include one or more of the devices shown in Figure 3, or it may be configured without some of the devices. Alternatively, multiple devices with different enclosures may be connected to each other to constitute the server device 20.

[0026] The server device 20 is physically configured as a computer device including a processor 2001, memory 2002, storage 2003, communication device 2004, input device 2005, output device 2006, and a bus connecting them. Each function in the server device 20 is realized by loading predetermined software (programs) onto hardware such as the processor 2001 and memory 2002, which causes the processor 2001 to perform calculations, control communication by the communication device 2004, and control at least one of the reading and writing of data in the memory 2002 and storage 2003. The processor 2001, memory 2002, storage 2003, communication device 2004, input device 2005, output device 2006, and the bus connecting them are hardware similar to the processor 1001, memory 1002, storage 1003, communication device 1004, input device 1005, output device 1006, and the bus connecting them described for the user terminal 10, so their description is omitted. However, the communication device 2004 does not need to be hardware for communication according to wireless communication standards, but may be hardware (transmitting / receiving device) for communication between computers via network 2 according to any wired communication standard.

[0027] Figure 4 is a block diagram showing an example of the functional configuration of the remote conferencing system 1 according to the first embodiment. As shown in Figure 4, the server device 20 includes an acquisition unit 21 that acquires various data, such as user voice data, from each user terminal 10 via the network 2, and an audio control unit 22 that performs various controls related to the audio of the remote conferencing on each user terminal 10. The audio control unit 22 includes the functions of a storage unit 221, a determination unit 222, and an invalidation processing unit 223, and the determination unit 222 further includes the function of a threshold setting unit 2221.

[0028] As illustrated in Figure 5, the storage unit 221 stores information about each user participating in the remote conference and the user terminal 10 used by that user. As shown in Figure 5, the conference ID, which is the identification information assigned to each remote conference, the user ID, which is the identification information assigned to each user participating in that remote conference, and the terminal ID, which is the identification information assigned to that user's user terminal 10, are stored in association in the storage unit 221. In the example in Figure 5, for example, users with user IDs "U012", "U002", and "U215" are participating in the remote conference with conference ID "M0001". Furthermore, user "U012" is participating in the remote conference using user terminal 10 with terminal ID "D1245", user "U002" is participating in the remote conference using user terminal 10 with terminal ID "D3225", and user "U215" is participating in the remote conference using user terminal 10 with terminal ID "D0126". The server device 20 identifies which user is participating in which remote conference by referring to the contents stored in the memory unit 221. The user ID and terminal ID can be any type of identification information that can identify each user and each user terminal 10, respectively.

[0029] Returning to the explanation of Figure 4, the determination unit 222 determines whether two or more of the multiple users participating in a remote conference are in the same space. More specifically, the determination unit 222 obtains the reception level of the wireless signals transmitted and received between the short-range wireless communication devices 1007 of the user terminals 10 used by each user for the remote conference from each user terminal 10, and determines that the multiple users are in the same space if the reception level is above a threshold. On the other hand, the determination unit 222 obtains the reception level of the wireless signals transmitted and received between the short-range wireless communication devices 1007 of the user terminals 10 used by each user for the remote conference from each user terminal 10, and determines that the multiple users are not in the same space if the reception level is below a threshold.

[0030] It is known that wireless signals transmitted and received between short-range wireless communication devices 1007 are greatly attenuated by obstacles such as walls and doors, and that they attenuate rapidly beyond a certain distance. Therefore, by appropriately setting the threshold, it is possible to determine whether each user terminal 10 is in a common space (for example, the same room or a space large enough to cause problems with voice quality). The threshold setting unit 2221 sets (stores) the threshold according to the specifications of, for example, the administrator of the remote conferencing system 1.

[0031] If the determination unit 222 determines that two or more users of a remote conference are in the same space, the invalidation processing unit 223 disables the microphone pickup for users who are not speaking. Specifically, if the volume level of the audio acquired by the acquisition unit 21 from each user terminal 10 is below a standard value, the invalidation processing unit 223 determines that the user using that user terminal 10 is not speaking and does not transmit the audio data acquired from that user terminal 10 to the user terminals 10 of other users participating in the same conference. On the other hand, if the volume level of the audio acquired by the acquisition unit 21 from each user terminal 10 is above the standard value, the invalidation processing unit 223 determines that the user using that user terminal 10 is speaking and transmits the audio data acquired from that user terminal 10 to the user terminals 10 of other users participating in the same conference.

[0032] Next, the operation of the server device 20 according to the first embodiment will be described with reference to Figure 6. The procedures for each process shown in Figure 6 are described in the program stored in the server device 20.

[0033] In Figure 6, when a remote conference is started (step S11), the acquisition unit 21 acquires various data, such as audio data, from each of the user terminals 10 of the multiple users participating in the remote conference. This data includes data corresponding to the reception level of the wireless signals transmitted and received between the short-range wireless communication devices 1007 of each user terminal 10, and data corresponding to the volume level of the audio picked up by the user terminal 10.

[0034] The determination unit 222 compares data corresponding to the reception level of the above-mentioned wireless signal with thresholds stored in the threshold setting unit 2221 to determine whether two or more users among the multiple users participating in the same conference are in the same space (step S12).

[0035] If it is determined that two or more users among the multiple users participating in the same meeting are in the same space (Step S12; YES), the invalidation processing unit 223 compares data corresponding to the volume level of the sound picked up by the user terminal 10 with a reference value to determine whether or not at least one of those two or more users is not speaking (Step S13).

[0036] If it is determined that the user is not speaking (step S13; YES), the invalidation processing unit 223 performs an audio invalidation process, which means that the audio data acquired from that user's user terminal 10 is not sent to the user terminals 10 of other users participating in the same conference (step S14).

[0037] In contrast, if it is determined that none of the users participating in the same conference are in the same physical space (Step S12; NO), the server device 20 performs normal remote conference control by sending the audio data transmitted from each user terminal 10 of the users participating in the same conference to the user terminals 10 of the other users participating in the same conference (Step S15). Also, in Step S13, if there is a user speaking among two or more users in the same physical space (Step S13; NO), the server device 20 performs normal remote conference control by sending the audio data transmitted from that user's user terminal 10 to the user terminals 10 of the other users participating in the same conference (Step S15).

[0038] According to the first embodiment described above, howling that occurs when the microphone of a user terminal 10 (first user terminal) used by a user participating in a remote conference picks up sound from the speaker of another user terminal 10 (second user terminal) used by another user participating in the conference, and then outputs the picked-up sound again from the speaker of that user terminal 10 (second user terminal), is eliminated, and in other words, the quality of conversational audio in a remote conference can be maintained.

[0039] [Second Embodiment] Next, a second embodiment of the present invention will be described. In a remote conference, the voice of a user participating in one remote conference (referred to as the first remote conference) may be picked up by a microphone used by a user who is nearby and participating in another remote conference (referred to as the second remote conference). The voice picked up at this time will be transmitted to the user of the second remote conference via the server device 20, but since this voice is related to the first remote conference and not to the second remote conference, it becomes so-called noise. Therefore, the remote conference system 1 according to the second embodiment has as its main purpose the elimination of voice interference when multiple users are participating in different remote conferences at the same location.

[0040] The system configuration and hardware configuration of each device of the remote conferencing system 1 according to the second embodiment are the same as those of the first embodiment, so their description is omitted. In the following description and drawings, components that are the same as those of the first embodiment are denoted by the same reference numerals.

[0041] Figure 7 is a block diagram showing an example of the functional configuration of the remote conferencing system 1 according to the second embodiment. As shown in Figure 7, the server device 20 includes an acquisition unit 21 that acquires various data, such as user voice data, from each user terminal 10 via the network 2, and an audio control unit 220 that performs various controls related to remote conferencing on each user terminal 10. The audio control unit 220 includes the functions of a storage unit 221, a judgment unit 224, and a subtraction processing unit 225, and the judgment unit 224 further includes the function of a threshold setting unit 2221.

[0042] Similar to the first embodiment, the storage unit 221 stores in association the following: a conference ID, which is identification information assigned to each remote conference; a user ID, which is identification information assigned to each user participating in that remote conference; and a terminal ID, which is identification information assigned to the user's terminal 10.

[0043] The determination unit 224 determines whether a user participating in one remote conference (the first remote conference) and a user participating in another remote conference (the second remote conference) are in the same space. More specifically, the determination unit 224 obtains the reception level of the wireless signals transmitted and received between the short-range wireless communication devices 1007 of the user terminals 10 used by each user for the remote conference from each user terminal 10, and determines that the multiple users are in the same space if the reception level is above a threshold. On the other hand, the determination unit 224 obtains the reception level of the wireless signals transmitted and received between the short-range wireless communication devices 1007 of the user terminals 10 used by each user for the remote conference from each user terminal 10, and determines that the multiple users are not in the same space if the reception level is below a threshold.

[0044] The difference between the first and second embodiments is that in the first embodiment, it was determined whether multiple users participating in the same meeting were in the same space, whereas in the second embodiment, it is determined whether multiple users participating in different meetings are in the same space. The threshold setting unit 2221 sets (stores) the threshold according to the specifications of, for example, the administrator of the remote conferencing system 1, similar to the first embodiment.

[0045] The subtraction processing unit 225 performs a subtraction operation when the determination unit 224 determines that a user participating in the first remote conference and a user participating in the second remote conference are in the same space, by subtracting the audio component corresponding to the audio picked up by the microphone corresponding to the first user from the audio picked up by the microphone corresponding to the other user (second user) during the period when at least one of the users (first user) is speaking. Specifically, the subtraction processing unit 225 determines that the user using the user terminal 10 (first user) is speaking if the volume level of the audio acquired by the acquisition unit 21 from each user terminal 10 is above a reference value. Then, the subtraction processing unit 225 subtracts the audio component corresponding to the audio data of the audio picked up by the microphone of the user terminal 10 used by the user (first user) from the audio data of the audio picked up by the microphone of the user terminal 10 used by the user (second user) who is in the same space as the user (first user) and participating in the second remote conference. This eliminates the voice of the first user that is mixed in with the audio picked up by the microphone of the user terminal 10 used by the user participating in the second remote meeting (the second user).

[0046] Next, with reference to Figure 8, the operation of the server device 20 according to the second embodiment will be described. The procedures for each process shown in Figure 8 are described in the program stored in the server device 20.

[0047] In Figure 8, when two or more remote conferences are started (step S21), the acquisition unit 21 acquires various data, such as audio data, from each of the user terminals 10 of the multiple users participating in each remote conference. This data includes data corresponding to the reception level of the wireless signals transmitted and received between the short-range wireless communication devices 1007 of each user terminal 10, and data corresponding to the volume level of the audio picked up by the user terminal 10.

[0048] The determination unit 222 compares data corresponding to the reception level of the above-mentioned wireless signal with threshold values ​​stored in the threshold setting unit 2221 to determine whether the users participating in the first remote conference and the users participating in the second remote conference are in the same space (step S22).

[0049] If it is determined that the users participating in the first remote conference and the users participating in the second remote conference are in the same space (step S22; YES), the subtraction processing unit 225 compares data corresponding to the volume level of the sound picked up at each of these users' user terminals 10 with a reference value to determine whether at least one of these users is speaking (step S23).

[0050] If it is determined that at least one of these users is speaking (Step S23; YES), the system performs a process to subtract the speech component corresponding to the speech picked up by the microphone corresponding to the first user from the speech picked up by the microphone corresponding to the other user (second user) during the speaking period of the speaking user (first user) (Step S24).

[0051] In contrast, if it is determined that none of the users participating in different remote conferences are in the same space (step S22; NO), the server device 20 performs normal remote conference control (step S25). Also, in step S23, if there are two or more users in the same space but no one is speaking (step S23; NO), the server device 20 performs normal remote conference control (step S25).

[0052] According to the second embodiment described above, when multiple users are participating in different remote meetings from the same location, it is possible to eliminate audio interference equivalent to noise, that is, to maintain the quality of conversational audio in remote meetings.

[0053] [Differentiation] The present invention is not limited to the first and second embodiments described above. The first and second embodiments described above may be modified as follows. Furthermore, two or more of the following modifications may be combined and implemented. [Example 1] In the second embodiment, for example, if two or more users who are participating in different remote conferences and are in the same space are speaking simultaneously, the voice of one user will be picked up by the microphone corresponding to that user and by the microphone corresponding to the other user, while the voice of the other user will be picked up by the microphone corresponding to the other user and by the microphone corresponding to the first user. In this case, the voice of one user picked up by the microphone corresponding to the other user should be excluded as noise, and at the same time, the voice of the other user picked up by the microphone corresponding to the first user should also be excluded as noise.

[0054] Therefore, the subtraction processing unit 225 should subtract the audio component corresponding to the voice with the highest volume among the voices picked up by the microphone corresponding to the first user from the voice picked up by the microphone corresponding to the second user. In other words, since it is presumed that the voice with the highest volume among the voices picked up by the microphone corresponding to the first user is the voice of the first user, the audio component corresponding to the voice of the first user with the highest volume should be subtracted from the voice picked up by the microphone corresponding to the second user (a mixture of the voice spoken by the first user and the voice spoken by the second user). In this way, it is possible to eliminate voice interference when two or more users who are participating in different remote conferences and are in the same space are speaking at the same time.

[0055] [Differentiation 2] In the second embodiment, as in the modified example 1 above, when two or more users are participating in different remote conferences and are in the same space and speaking simultaneously, the subtraction processing unit 225 may subtract from the audio picked up by the microphone corresponding to the second user an audio component of the audio picked up by the microphone corresponding to the first user, the audio component of which is corresponding to the distance between the user terminals 10 used by the first user and the second user. Specifically, the subtraction processing unit 225 adjusts the volume of the audio data of the audio picked up by the microphone of the user terminal 10 used by the first user according to the distance measured between the user terminal 10 used by the first user and the user terminal 10 used by the second user, and subtracts the audio component corresponding to the adjusted audio data. For example, if the distance between the user terminal 10 used by the first user and the user terminal 10 used by the second user is shorter, the audio of the first user will be picked up at a higher volume by the microphone of the user terminal 10 used by the second user. On the other hand, if the distance between the user terminal 10 used by the first user and the user terminal 10 used by the second user is long, the voice of the first user will be picked up by the microphone of the user terminal 10 used by the second user at a lower volume. Therefore, the shorter the distance between these user terminals 10, the lower the volume of the voice data picked up by the microphone of the user terminal 10 used by the first user should be adjusted, and then subtracted from the voice picked up by the microphone corresponding to the second user.

[0056] [Difference 3] In the above modified example 2, the volume of the audio data of the voice picked up by the microphone of the user terminal 10 used by the first user was adjusted according to the distance between the user terminals 10, and the audio component corresponding to that audio data was subtracted from the voice picked up by the microphone corresponding to the second user. In contrast, for example, if the first user and the second user are using wireless microphones or wireless earphones and wireless devices that transmit and receive voice wirelessly, the subtraction processing unit 225 may perform the subtraction according to the distance between the wireless microphones or wireless earphones and wireless devices. The wireless device referred to here is, for example, a smartphone or personal computer that interposes between the wireless microphone or wireless earphone and the network 2 and exchanges voice data wirelessly with the wireless microphone or wireless earphone.

[0057] [Differentiation Example 4] In the first and second embodiments described above, the threshold used to determine whether or not users are in a common space may be set automatically. Specifically, the threshold setting unit 2221 uses the results of measuring the distance between user terminals 10 used by each user for remote conferencing using means such as a measuring tape, and the measurement results of the reception level of wireless signals transmitted and received between user terminals 10 used by each user for remote conferencing, to set a threshold corresponding to the reception level corresponding to a predetermined distance between user terminals 10 (a distance at which problems related to audio quality may occur). This makes it possible to easily set an appropriate threshold.

[0058] [Difference 5] In the first and second embodiments described above, the distance measuring function of the short-range wireless communication device 1007 equipped with the user terminal 10 was used as a method for determining whether or not a user is in a common space, but the method is not limited to this. For example, the method may be to determine whether or not a user is in a common space by taking an image of the space in which multiple users are present and identifying each user by image recognition.

[0059] [Modification 6] Although a server device 20 is shown as an example of a remote conferencing control device according to the present invention, the present invention can be applied to any computer that implements the functional blocks illustrated in Figure 4.

[0060] [Other variations] The block diagrams used in the description of the above embodiments show functional units. These functional blocks (components) are realized by any combination of at least one of hardware and software. Furthermore, the method of realizing each functional block is not particularly limited. That is, each functional block may be realized using one device that is physically or logically coupled, or it may be realized using two or more physically or logically separated devices that are directly or indirectly connected (for example, using wired or wireless connections). A functional block may also be realized by combining the above one device or the above multiple devices with software.

[0061] Functions include, but are not limited to, judgment, decision, judgment, calculation, calculation, processing, derivation, investigation, exploration, confirmation, reception, transmission, output, access, resolution, selection, selection, establishment, comparison, assumption, expectation, assumption, broadcasting, notifying, communicating, forwarding, configuring, reconfiguring, allocating (mapping), and assigning. For example, a functional block (configuration part) that enables transmission is called a transmitting unit or transmitter. As mentioned above, the method of implementation is not particularly limited.

[0062] For example, the user terminal 10 in one embodiment of the present disclosure may function as a computer that processes the wireless communication method of the present disclosure.

[0063] Information notification is not limited to the embodiments described herein and may be carried out by other means. For example, information notification may be carried out by physical layer signaling (e.g., DCI (Downlink Control Information), UCI (Uplink Control Information)), upper layer signaling (e.g., RRC (Radio Resource Control) signaling, MAC (Medium Access Control) signaling, broadcast information (MIB (Master Information Block), SIB (System Information Block))), other signals, or combinations thereof. RRC signaling may also be called RRC messages, and may be, for example, RRC Connection Setup messages, RRC Connection Reconfiguration messages, etc.

[0064] Each aspect / embodiment described in this disclosure may be applied to at least one of the following systems: LTE (Long Term Evolution), LTE-A (LTE-Advanced), SUPER 3G, IMT-Advanced, 4G (4th generation mobile communication system), 5G (5th generation mobile communication system), FRA (Future Radio Access), NR (new Radio), W-CDMA (registered trademark), GSM (registered trademark), CDMA2000, UMB (Ultra Mobile Broadband), IEEE 802.11 (Wi-Fi (registered trademark)), IEEE 802.16 (WiMAX (registered trademark)), IEEE 802.20, UWB (Ultra-WideBand), Bluetooth (registered trademark), and other appropriate systems, as well as next-generation systems extended based thereon. Furthermore, multiple systems may be applied in combination (for example, a combination of at least one of LTE and LTE-A with 5G).

[0065] The processing procedures, sequences, flowcharts, etc., of each aspect / embodiment described herein may be reordered, provided they are consistent with each other. For example, the methods described herein present various step elements in an exemplary order and are not limited to that specific order.

[0066] Information can be output from a higher layer (or lower layer) to a lower layer (or higher layer). Input and output may also occur via multiple network nodes.

[0067] Input and output information may be stored in a specific location (e.g., memory) or managed using a management table. Input and output information may be overwritten, updated, or appended to. Output information may be deleted. Input information may be transmitted to other devices.

[0068] The determination may be made by a value represented by 1 bit (0 or 1), by a boolean value (true or false), or by a numerical comparison (for example, a comparison with a predetermined value).

[0069] Each aspect / embodiment described herein may be used individually, in combination, or switched between as needed during implementation. Furthermore, notification of specific information (e.g., notification that "X is") is not limited to explicit notification, but may also be implicit (e.g., by not providing such notification).

[0070] Although the present disclosure has been described in detail above, it will be clear to those skilled in the art that the present disclosure is not limited to the embodiments described herein. The present disclosure can be implemented in modified and altered forms without departing from the intent and scope of the present disclosure as defined by the claims. Therefore, the descriptions in the present disclosure are illustrative and not intended to be restrictive in any way.

[0071] Software should be broadly interpreted to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, execution threads, procedures, functions, and so on, whether they are called software, firmware, middleware, microcode, hardware description languages, or by any other name. Furthermore, software, instructions, information, etc., may be transmitted and received via a transmission medium. For example, if software is transmitted from a website, server, or other remote source using at least one of wired technology (such as coaxial cable, fiber optic cable, twisted pair, or digital subscriber line (DSL)) and wireless technology (such as infrared or microwave), then at least one of these wired and wireless technologies is included in the definition of a transmission medium.

[0072] The information, signals, etc. described in this disclosure may be represented using any of the various different techniques. For example, the data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description may be represented by voltage, current, electromagnetic waves, magnetic fields or magnetic particles, optical fields or photons, or any combination thereof. In addition, terms used in this disclosure and terms necessary for understanding this disclosure may be replaced with terms having the same or similar meanings. For example, at least one of the channel and symbol may be a signal (signaling). Also, a signal may be a message. Furthermore, a component carrier (CC) may be called a carrier frequency, cell, frequency carrier, etc.

[0073] The terms “system” and “network” as used in this disclosure are interchangeable.

[0074] Furthermore, the information, parameters, etc., described in this disclosure may be expressed using absolute values, relative values ​​from a given value, or other corresponding information. For example, wireless resources may be indicated by an index. The names used for the parameters described above are not restrictive in any way. Furthermore, the formulas and other expressions using these parameters may differ from those expressly disclosed in this disclosure. Various channels (e.g., PUCCH, PDCCH, etc.) and information elements can be identified by any suitable name, and therefore, the various names assigned to these various channels and information elements are not restrictive in any way.

[0075] In this disclosure, terms such as “Mobile Station (MS),” “user terminal 10,” “User Equipment (UE),” and “terminal” may be used interchangeably. A mobile station may also be referred to by those skilled in the art as a subscriber station, mobile unit, subscriber unit, wireless unit, remote unit, mobile device, wireless device, wireless communication device, remote device, mobile subscriber station, access terminal, mobile terminal, wireless terminal, remote terminal, handset, user agent, mobile client, client, or several other appropriate terms.

[0076] The user terminal may also be called a transmitting device, receiving device, communication device, etc. At least one of the user terminals may be a device mounted on a mobile body, the mobile body itself, etc. The mobile body may be a vehicle (e.g., a car, an airplane, etc.), an unmanned mobile body (e.g., a drone, an autonomous vehicle, etc.), or a robot (manned or unmanned). The user terminal may also include devices that do not move during communication operations. For example, the user terminal may be an IoT (Internet of Things) device such as a sensor.

[0077] The terms "determining" and "decision" can encompass a wide variety of actions. "Determining" and "decision" can include, for example, judging, calculating, computing, processing, deriving, investigating, looking up, searching, inquiry (e.g., searching in tables, databases, or other data structures), and ascertaining. Furthermore, "determining" and "decision" can also include receiving (e.g., receiving information), transmitting (e.g., sending information), input, output, and accessing (e.g., accessing data in memory). Furthermore, "judgment" and "decision" can include considering something as having been "judged" or "decided" after resolving, selecting, choosing, establishing, comparing, etc. In other words, "judgment" and "decision" can include considering something as having been "judged" or "decided" after some action. Also, "judgment (decision)" can be reinterpreted as "assuming," "expecting," or "considering."

[0078] The terms “connected,” “coupled,” or any variation thereof, mean any direct or indirect connection or coupling between two or more elements, and may include the presence of one or more intermediate elements between two elements that are “connected” or “coupled” with each other. The coupling or connection between elements may be physical, logical, or a combination thereof. For example, “connection” may be reinterpreted as “access.” As used in this disclosure, two elements may be considered to be “connected” or “coupled” with each other using at least one of one or more wires, cables, and printed electrical connections, and, in some non-limiting and non-exclusive examples, electromagnetic energy having wavelengths in the radio frequency domain, microwave domain, and optical (both visible and invisible) domain.

[0079] In this disclosure, the phrase "based on" does not mean "based solely on" unless otherwise specified. In other words, the phrase "based on" means both "based solely on" and "based at least on."

[0080] Any reference to elements using the designations “first,” “second,” etc., as used in this disclosure does not generally limit the quantity or order of those elements. These designations may be used in this disclosure as a convenient way to distinguish between two or more elements. Accordingly, references to the first and second elements do not imply that only two elements may be employed, or that the first element must precede the second element in any way.

[0081] In the configuration of each of the above devices, "means" may be replaced with "part," "circuit," "device," etc.

[0082] Where the terms “include,” “including,” and variations thereof are used in this disclosure, these terms are intended to be inclusive, as is the term “comprising.” Furthermore, the term “or” as used in this disclosure is not intended to mean exclusive OR.

[0083] In this disclosure, if articles are added through translation, such as a, an, and the in English, this disclosure may include the fact that the noun following these articles is plural.

[0084] In this disclosure, the term "A and B are different" may mean "A and B are different from each other." The term may also mean "A and B are each different from C." Terms such as "separate" and "combine" may be interpreted similarly to "different." [Explanation of Symbols]

[0085] 1... Remote conferencing system, 2... Network, 10... User terminal, 1001... Processor, 1002... Memory, 1003... Storage, 1004... Communication device, 1005... Input device, 1006... Output device, 1007... Short-range wireless communication device, 20... Server device, 21... Acquisition unit, 22, 220... Voice control unit, 221... Memory unit, 222... Decision unit, 2221... Threshold setting unit, 223... Invalidation processing unit, 224... Decision unit, 225... Subtraction processing unit, 2001... Processor, 2002... Memory, 2003... Storage, 2004... Communication device, 2005... Input device, 2006... Output device.

Claims

1. A determination unit that determines whether two or more of the multiple users participating in the remote meeting are in the same space, If it is determined that two or more users of the remote conference described in item 1 are in the same space, a disabling processing unit will disable the microphone pickup corresponding to the user who is not speaking among those two or more users. Equipped with, The determination unit obtains the reception level of wireless signals transmitted and received between terminals used by each user for remote conferencing from each terminal, and determines that multiple users are in the same space if the obtained reception level is above a threshold. A remote conferencing control device characterized by the following features.

2. The system includes a threshold setting unit for setting the aforementioned threshold. The remote conferencing control device according to claim 1.

3. The threshold setting unit sets the threshold using the results of distance measurement between terminals used by each user for remote conferencing and the measurement results of the reception level of wireless signals transmitted and received between terminals used by each user for remote conferencing. The remote conferencing control device according to claim 2.

Images