Web conferencing system, terminal device, and web conferencing method

Abstract

To provide a WEB conference system, a terminal device, and a WEB conference method, capable of reducing a risk that secret information is leaked in a WEB conference.SOLUTION: A WEB conference system 1 comprises: a WEB conference server 2; and a plurality of terminal devices 3 connected to the server. The server acquires device type information indicating a type of a sound output device in a use in the terminal device from the plurality of terminal devices, determines whether or not a voice is output from a voice output device in the used in the terminal device on the basis of the device type information of each terminal device held in the holding device, or controls a sound volume output from the terminal device. For example, a terminal device of which the type of the voice output device in the use is a headphone type is determined as a transmission destination of a voice data.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a WEB conference system, a terminal device, and a WEB conference method.

Background Art

[0002] Conventionally, various technologies related to the management of WEB conferences have been disclosed. For example, in a WEB conference system, a technology for displaying information indicating who the speaker is on a screen has been disclosed (such as Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In recent years, the number of employees working remotely has increased, and the opportunities to use WEB conferences have also increased. While WEB conferences offer a high degree of freedom and convenience in the hosting environment, the risk of leakage of confidential information increases. For example, when a participant in a WEB conference installs a terminal device outside a private room and outputs audio from the speaker of the terminal device, there is a possibility that the audio will be heard by unintended persons around, and confidential information may leak.

[0005] Under such circumstances, there is a desire to provide a technology that can reduce the risk of leakage of confidential information in WEB conferences.

Means for Solving the Problems

[0006] Among the inventions disclosed in the present application, a brief summary of representative ones is as follows.

[0007] A typical embodiment is a web conferencing system comprising a server and a plurality of terminal devices connected to the server, wherein the web conferencing system includes a holding device that acquires and holds device type information indicating the type of audio output device being used in the terminal devices from the plurality of terminal devices, a control device that determines whether or not to output audio from the audio output device being used in each terminal device, or controls the volume output from the terminal devices, based on the device type information for each terminal device held in the holding device, and a transmitting device that transmits the device type information for each terminal device to the plurality of terminal devices, and the terminal devices include a display device and a display control device that controls the display device so that the received device type information for each terminal device is displayed. The features of other embodiments will be understood from the contents shown in each claim. [Effects of the Invention]

[0008] According to a typical embodiment, the risk of confidential information being leaked during a web conference can be reduced. [Brief explanation of the drawing]

[0009] [Figure 1] This diagram shows the configuration of the web conferencing system according to Embodiment 1. [Figure 2] This diagram shows the hardware configuration of the web conferencing server. [Figure 3] This diagram shows the hardware configuration of the terminal device. [Figure 4] This diagram shows the configuration of a web conferencing server using functional blocks. [Figure 5] This diagram shows a simulated meeting management table in Embodiment 1. [Figure 6] This diagram shows a simulated participant management table in Embodiment 1. [Figure 7] This diagram shows a table that explains how to determine the destination of audio data. [Figure 8] This diagram shows the configuration of the terminal device by functional blocks. [Figure 9] It is a diagram that simulates the input / output device management table. [Figure 10] It is a diagram that simulates an example of the display screen of the terminal device. [Figure 11] It is a diagram that simulates an example of a screen with text displayed. [Figure 12] It is a diagram that simulates an example of a screen with text displayed. [Figure 13] It is a diagram that shows an overview of the processing flow of the WEB conference system according to Embodiment 1. [Figure 14] It is a diagram that shows an example of the flow of the device management table creation process. [Figure 15] It is a diagram that shows an example of the flow of the meeting reservation process. [Figure 16] It is a diagram that shows an example of the flow of the meeting start process. [Figure 17] It is a diagram that shows an example of the flow of the participation / withdrawal process. [Figure 18] It is a diagram that shows an example of the flow of the audio output device management process. [Figure 19] It is a diagram that shows an example of the flow of the individual security type setting management process. [Figure 20] It is a diagram that shows an example of the flow of the video and audio distribution process. [Figure 21] It is a diagram that shows an example of the flow of the meeting continuation end determination process. [Figure 22] It is a diagram that simulates the meeting management table in Embodiment 2. [Figure 23] It is a diagram that simulates the participant management table in Embodiment 2. [Figure 24] It is a diagram that shows a table for explaining the method of determining the transmission destination of audio data. [Figure 25] It is a diagram that shows an example of the flow of the video and audio distribution process according to Embodiment 3. [Figure 26] It is a diagram that shows a table for explaining the method of determining the target of low-frequency quantization control.

Mode for Carrying Out the Invention

[0010] The embodiments are described below. Note that each embodiment is merely an example of how to realize the present invention and does not limit the technical scope of the present invention.

[0011] Furthermore, in the following embodiments, components having the same function are denoted by the same reference numerals, and repeated descriptions thereof are omitted unless particularly necessary.

[0012] (Embodiment 1) A web conferencing system according to Embodiment 1 will be described.

[0013] <Overview of the web conferencing system according to Embodiment 1> The web conferencing system according to Embodiment 1 acquires and stores device type information indicating the type of audio output device being used in each terminal device from multiple terminal devices, and determines whether or not to output audio from the audio output device being used in each terminal device based on the device type information for each terminal device that is stored.

[0014] Furthermore, the web conferencing system according to Embodiment 1 determines the terminal device to which the speaker's voice data will be sent, based on the device type information for each terminal device.

[0015] <Web conferencing system hardware configuration> The configuration of the web conferencing system according to Embodiment 1 will be described below.

[0016] Figure 1 is a diagram showing the configuration of a web conferencing system according to Embodiment 1. As shown in Figure 1, the web conferencing system 1 according to Embodiment 1 comprises a web conferencing server 2 and a plurality of terminal devices 3. The web conferencing server 2 and the plurality of terminal devices 3 are connected via a network 4 and perform various processes collaboratively while communicating with each other. The connection to the network 4 may be either wired or wireless. The web conferencing server 2 is an example of a server in the present invention. The plurality of terminal devices 3 is also an example of a plurality of terminal devices in the present invention.

[0017] Web conferencing server 2 is a computer server that performs various processes necessary for hosting a web conference. Multiple terminal devices 3 are terminal devices used by multiple participants taking part in the web conference. Multiple participants include the host and participants other than the host. Terminal devices 3 are, for example, desktop computers, laptop computers, and information processing terminals. Information processing terminals are, for example, smartphones and tablet devices. Network 4 is a wide-area communication network, for example, the internet.

[0018] Figure 2 shows the hardware configuration of the web conferencing server. As shown in Figure 2, the web conferencing server 2 includes storage 2a, memory 2b, processor 2c, wireless communication unit 2d, wired communication unit 2e, video control unit 2f, audio control unit 2g, operation control unit 2h, power control unit 2j, display unit 2k, camera 2m, wireless interface (in Figure 2, "interface" is abbreviated as "IF" for convenience) 2n, wired interface 2p, speaker 2r, microphone 2s, operation input unit 2t, and power interface 2w. The web conferencing server 2 also has a communication bus 2z. The storage 2a to power control unit 2j that constitute the web conferencing server 2 are connected via the communication bus 2z and can communicate with each other.

[0019] Storage 2a stores various programs and data. These programs include, for example, an operating system (hereinafter also referred to as OS) A1, a web conferencing program (hereinafter also referred to as a web conferencing application) A2, and device drivers. The data includes, for example, a meeting management table T1 for managing web conferences and a participant management table T2 for managing participants. Storage 2a is non-volatile memory and is comprised of, for example, an SSD (Solid State Drive), HDD (Hard Disk Drive), eMMC (embedded Multi Media Card), UFS (Universal Flash Storage), SD (Secure Digital) card, USB (Universal Serial Bus) flash drive, or optical disc.

[0020] Memory 2b temporarily stores data processed by processor 2c. Memory 2b is composed of semiconductor memory such as RAM (Random Access Memory). Memory 2b may also be shared by storage 2a.

[0021] The processor 2c performs various arithmetic and data processing. By executing programs stored in storage 2a using memory 2b, it functions as various functional blocks. The processor 2c is composed of, for example, an MPU (Micro-Processing Unit) and a CPU (Central Processing Unit). The processor 2c may also control each control unit.

[0022] The wireless communication unit 2d is connected to the wireless interface 2n. The wireless communication unit 2d converts data into electrical signals and outputs them to the wireless interface 2n, and converts electrical signals received by the wireless interface 2n into data. The wireless communication unit 2d communicates with external devices or access points of the network 4 via the wireless interface 2n. The wireless communication unit 2d and the wireless interface 2n are compatible with standards such as Wi-Fi (registered trademark) or Bluetooth (registered trademark).

[0023] The wired communication unit 2e is connected to the wired interface 2p. The wired communication unit 2e converts data into electrical signals and outputs them to the wired interface 2p, and also converts electrical signals received by the wired interface 2p into data. The wired communication unit 2e communicates with external devices via the wired interface 2p.

[0024] The 2-pin wired interface can be, for example, a USB port, a LAN port, or a 3- or 4-pin phone jack. The LAN port supports standards such as 1000BASE-T, 100BASE-TX, and 10BASE-T. The phone jack supports standards such as OMTP (Open Mobile Terminal Platform) and CTIA (Cellular Telephone Industry Association).

[0025] The video control unit 2f is connected to the display unit 2k and the camera 2m. The video control unit 2f converts video data or image data into electrical signals and outputs them to the display unit 2k, and also converts electrical signals received by the camera 2m into video data or image data.

[0026] The display unit 2k displays images or text information on its screen. The display unit 2k is composed of, for example, a liquid crystal display, an organic electro-luminescence (OLED) display, or a touch panel display. The camera 2m captures images of the operator of the web conferencing server 2.

[0027] The audio control unit 2g is connected to the speaker 2r and microphone 2s built into the web conferencing server 2. The audio control unit 2g converts audio data into electrical signals and outputs them to the speaker 2r, and also converts electrical signals generated by the microphone 2s into audio data.

[0028] Furthermore, if headphones, a headset, a speaker, a microphone, etc., are connected to the wireless interface 2n or the wired interface 2p, the audio control unit 2g processes the audio data in cooperation with the wireless communication unit 2d or the wired communication unit 2e. For example, the audio control unit 2g transmits audio data to the wireless communication unit 2d or the wired communication unit 2e, and the wireless communication unit 2d or the wired communication unit 2e outputs audio to the connected headphones, headset, speaker, etc., based on the received audio data. Alternatively, for example, the wireless communication unit 2d or the wired communication unit 2e converts the electrical signals representing the audio picked up by the connected headset or microphone into audio data and transmits it to the audio control unit 2g, which then processes the received audio data.

[0029] The operation control unit 2h is connected to the operation input unit 2t. The operation control unit 2h receives operation signals input by the operation input unit 2t, converts them into operation data, and processes them. The operation input unit 2t can be, for example, a keyboard, mouse, touchpad, or touch panel.

[0030] Furthermore, if a keyboard, mouse, touchpad, touch panel, etc., is connected to the wireless interface 2n or wired interface 2p, the operation control unit 2h processes operation data in cooperation with the wireless communication unit 2d or wired communication unit 2e. For example, the wireless communication unit 2d or wired communication unit 2e converts electrical signals representing operations received by the connected keyboard, mouse, touchpad, touch panel, etc., into operation data and transmits it to the operation control unit 2h, which then processes the received operation data.

[0031] The power control unit 2j is connected to the power interface 2w. The power interface 2w is, for example, an inlet, i.e., a power plug. Power is supplied to the power control unit 2j by connecting the inlet to an outlet, i.e., a power outlet, that outputs AC 100V to 240V. The power control unit 2j converts the supplied power to DC and distributes it to each component of the web conferencing server 2.

[0032] Figure 3 shows the hardware configuration of the terminal device. As shown in Figure 3, the terminal device 3 includes a storage unit 3a, a memory unit 3b, a processor 3c, a wireless communication unit 3d, a wired communication unit 3e, a video control unit 3f, an audio control unit 3g, an operation control unit 3h, a power supply control unit 3j, a display unit 3k, a camera 3m, a wireless interface 3n, a wired interface 3p, a speaker 3r, a microphone 3s, an operation input unit 3t, and a power supply interface 3w. The terminal device 3 further includes a communication bus 3z. The storage unit 3a to the power supply control unit 3j that constitute the terminal device 3 are connected via the communication bus 3z and can communicate with each other. The display unit 3k is an example of a display device in the present invention.

[0033] The storage devices 3a to power interface 3w that constitute terminal device 3 correspond to the storage devices 2a to power interface 2w that constitute web conferencing server 2, and have similar functions. Therefore, the functions of each of the storage devices 3a to power interface 3w will not be explained here.

[0034] However, storage 3a includes, as various programs to be stored, an operating system A1, a web conferencing program A2, and a browser A3. Furthermore, storage 3a includes, as various data to be stored, an input / output device management table T3 for managing the input / output devices of its own terminal device 3. In addition, terminal device 3 may have a battery 3x. The battery 3x can supply power to each component of terminal device 3 in place of the power supply connected to the power interface 3w.

[0035] When an audio output device is connected to the wireless interface 3n or wired interface 3p of terminal device 3, the function of the connected audio output device is basically turned on, and the function of the audio output device built into terminal device 3 (for example, speaker 3r) is turned off.

[0036] Furthermore, if a microphone or headset is connected to the wireless interface 3n or wired interface 3p of terminal device 3, the microphone function of the connected microphone or headset will be turned on, and the function of the microphone 2s built into terminal device 3 will be basically turned off.

[0037] Camera 3m captures images of subjects located in front of terminal device 3. Generally, camera 3m captures images of the faces of users using terminal device 3, i.e., participants in a web conference, and outputs an image signal or video signal.

[0038] <Functional Block Structure of the Web Conferencing System> The functional configuration of the web conferencing system 1 according to Embodiment 1 will now be described. Each functional block of the web conferencing server 2 and terminal device 3 is realized by executing a predetermined program stored in its own storage using a processor, memory, etc., and coordinating with the hardware.

[0039] Figure 4 is a diagram showing the configuration of a web conferencing server by its functional blocks. As shown in Figure 4, the web conferencing server 2 has, as functional blocks, a conference management device 21, a participant management device 22, a video and audio distribution control device 23, and a server-side data processing device 24. The conference management device 21 is an example of a setting reception device in the present invention. The participant management device 22 is an example of a holding device, request reception device, and transmission device in the present invention. The video and audio distribution control device 23 is an example of a control device in the present invention.

[0040] The conference management device 21 creates, maintains, and updates the conference management table T1. The conference management table T1 is a table that shows the schedule and various settings of the web conferences to be held.

[0041] Figure 5 is a diagram illustrating a meeting management table in Embodiment 1. As shown in Figure 5, the meeting management table T11 has the following items: "Meeting ID", "Date and Time", "Meeting Name", "Organizer ID", and "Meeting Security Type".

[0042] The "Meeting ID" is an ID used to identify a meeting and is automatically assigned when a meeting is booked. The "Meeting Date and Time" is information indicating the date and time of the booked meeting. The "Meeting Name" is the title of the meeting and can be entered or changed by the person authorized to book and set up the meeting. The "Organizer ID" is a personal ID that identifies the organizer of the meeting.

[0043] The "Meeting Security Type" setting determines the level of confidentiality of the meeting. In this embodiment, the "Meeting Security Type" is set to two levels: "High" and "Normal". Note that in the meeting management table T11 shown in Figure 5, the "Normal" display is omitted in the "Meeting Security Type" column to make the "High" display easier to read.

[0044] If "Meeting Security Type" is set to "High," the meeting is highly confidential and requires a high level of security for audio output. On the other hand, if "Meeting Security Type" is set to "Normal," the meeting is of average confidentiality and does not require a high level of security for audio output.

[0045] Setting "High" to "Meeting Security Type" means that secure mode has been set for that meeting. In a meeting where secure mode is set, the destination of the speaker's audio data is limited to terminal device 3, which is considered to have a low risk of information leakage due to audio output. Details on how the destination of audio data is determined will be described later. The meeting management device 21 accepts the setting of "Meeting Security Type," i.e., secure mode, for the web conference to be held from the person who has the authority to reserve and set up the meeting.

[0046] The participant management device 22 creates, maintains, and updates the participant management table T2. The participant management table T2 is created for each ongoing web conference and contains items related to each participant participating in the web conference or the terminal device 3 used by the participant. The participant management device 22 creates the participant management table T2 by obtaining various information from the terminal device 3 used by the participant, that is, the terminal device 3 connected to the web conference server 2.

[0047] Furthermore, the participant management device 22 identifies each participant's facial image or registered icon, participant's name, and type of audio output device used by the terminal device 3, based on various information obtained from the terminal device 3 connected to the web conferencing server 2, and distributes this participant information to each terminal device 3. This distribution may be performed voluntarily by the participant management device 22 or in response to a request from a participant.

[0048] Figure 6 is a diagram illustrating a participant management table in Embodiment 1. As can be seen from participant management table T21 shown in Figure 6, participant management table T2 has the following items: "Organizer", "Participant ID", "Terminal ID", "Audio Output Device in Use", "Audio Output Device Type in Use", "Classification", "Exception", and "Individual Security Type". The contents of these items are determined based on various data collected from each terminal device 3. Note that the items "Audio Output Device Type in Use" or "Classification" are examples of device type information in this invention. The following describes each item of the participant management table.

[0049] The "Organizer" field indicates whether the participant is the organizer of the web conference. A "○" is set in the "Organizer" field if the participant is the organizer. The organizer can be easily identified by looking at the "Organizer" column.

[0050] The "Participant ID" is an item that indicates the participant's personal ID. Typically, the "Participant ID" is the ID used when logging into terminal device 3, or the ID used when logging into the web conference. Participants in the web conference are identified based on the "Participant ID".

[0051] The "Terminal ID" is an item that indicates a unique ID for the terminal device 3 used by the participant. The "Terminal ID" may be, for example, an account assigned to each terminal device 3, or the serial number of terminal device 3. Based on the "Terminal ID," it is possible to identify which terminal device 3 the participant is using to participate.

[0052] "Audio output device in use" is an item that indicates the name, model name, or model number of the audio output device currently in use on terminal device 3. "Audio output device in use" is used, for example, to identify or verify the "Type of audio output device in use".

[0053] In this embodiment, audio output devices are classified into two types: the first type is a headphone type device, and the second type is a speaker type device.

[0054] Headphone-type devices are a general term for devices designed so that the output sound is barely audible to those nearby, and are considered to have a low risk of information leakage through sound output. Examples of headphone-type devices include headphones, earphones, headsets, earsets, head-mounted displays, bone conduction speakers, and smartphone call speakers.

[0055] Speaker-type devices are a general term for devices whose output sound is highly likely to be heard by those nearby, and are considered to pose a high risk of information leakage through sound output. Examples of speaker-type devices include speakers externally connected to terminal devices, speakers built into terminal devices such as personal computers or tablet devices, and hands-free speakers in smartphones.

[0056] The "Type of Audio Output Device in Use" item indicates the type of audio output device currently in use on terminal device 3. The "Type of Audio Output Device in Use" item can be set to, for example, "Built-in speaker," "External speaker," "Headphones / Speaker (phone jack connection)," "Headphones," "Bone conduction headphones," "Smartphone / Call speaker," "Smartphone / Hands-free speaker," or "Unknown," as shown in Figure 6. "External speaker," "Headphones," etc., can be identified by monitoring the USB or Bluetooth connection status.

[0057] If the participant management device 22 cannot identify or is unsure of the "audio output device in use" or "type of audio output device in use," it will initiate a query to the participant on the terminal device 3. For example, the participant management device 22 will send a query to the terminal device 3 asking whether the "type of audio output device in use" is a "headphone type device" or a "speaker type device." If the participant on the terminal device 3 responds to the query, the participant management device 22 will set the "audio output device in use" or "type of audio output device in use" item on the terminal device 3 based on the response. On the other hand, if there is no response to the query, the participant management device 22 will set the "audio output device in use" or "type of audio output device in use" item to "unknown."

[0058] Furthermore, if the participant management device 22 detects that the "Type of audio output device in use" of terminal device 3 is unknown, but at least it is connected via a phone jack, it will set the "Type of audio output device in use" item to "Headphones / Speakers (phone jack connection)". "Headphones / Speakers (phone jack connection)" means that either headphones or speakers are connected using the phone jack terminal of terminal device 3.

[0059] Furthermore, if the participant management device 22 detects that an input / output device, particularly an audio output device, has been externally connected to the terminal device 3, it obtains the device information of the externally connected input / output device from the terminal device 3 and updates the participant management table T2.

[0060] Participants may also choose to voluntarily send information representing the settings to be configured in the "Audio Output Device in Use" or "Type of Audio Output Device in Use" fields to the web conferencing server 2 by operating their own terminal device 3.

[0061] The "Classification" is determined according to the "Type of audio output device in use" and represents the security level related to audio output. In this embodiment, the "Classification" is set to two levels: "1" and "2". "1" indicates a high security level, and "2" indicates a low security level. If the "Type of audio output device in use" is the "headphone-type device" described above, the "Classification" is set to "1". On the other hand, if the "Type of audio output device in use" is the "speaker-type device" described above, the "Classification" is set to "2".

[0062] The "Exception" field indicates whether or not an audio data recipient will receive exceptional treatment when determining the destination of the audio data. "Exception" is set to "○" if an audio data recipient will receive exceptional treatment. Terminal device 3 with "Exception" set to "○" will receive the same treatment as terminal device 3 with "Classification" set to "1" when determining the destination of the audio data. For example, if the "Conference Security Type" is "High," terminal device 3 will be included as a destination for the audio data even if its "Classification" is "2."

[0063] Even if terminal device 3 is a speaker-type device, it may be placed in a secure environment where the possibility of audio being heard by anyone other than the participants is low. For example, it is conceivable that only designated company employees are participating in a web conference in a company conference room, using a single PC as terminal device 3 and outputting audio from an externally connected speaker. Alternatively, it is conceivable that one participant is participating in a web conference in a private room at home, using a smartphone as terminal device 3 and outputting audio from the smartphone's built-in hands-free speaker. In such cases, even if terminal device 3 is classified as "2," it can be treated the same as terminal device 3 classified as "1." The "exceptions" are provided to anticipate such situations.

[0064] This section explains how to set "exceptions". Setting "exceptions" is basically done based on requests from participants. If a participant is in a secure environment and wants their terminal device 3 to be treated the same as terminal device 3 with a "classification" of "1", they will perform an operation on their terminal device 3 to request the "exception" setting to "○". This operation sends a request signal for setting "exception" to "○" to the participant management device 22 of the web conferencing server 2. The participant management device 22 responds to the received request signal and accepts the request, sending an inquiry signal to the host's terminal device 3 to ask whether to allow the setting of "exception" to "○". Based on the received inquiry signal, the host's terminal device 3 performs a process to inquire to the host whether to allow the setting of "exception" to "○". If the host performs an operation on the host's terminal device 3 to allow the setting of "exception" to "○", an permission signal is sent to the participant management device 22 of the web conferencing server 2, and the "exception" item of the terminal device 3 that sent the request signal is set to "○".

[0065] The "Individual Security Type" setting determines the security level of the audio output when distributing audio data corresponding to the speaker's voice input into terminal device 3 to other participants' terminal devices 3. In this embodiment, the "Individual Security Type" is set to two levels: "High" and "Normal". Note that in the participant management table T21 shown in Figure 6, the "Normal" display is omitted in the "Individual Security Type" column to make the "High" display easier to see.

[0066] When a participant speaks using terminal device 3, where the "Individual Security Type" is set to "High," even if the "Meeting Security Type" is set to "Normal," the destination of the speaker's audio data is limited to terminal device 3 where the "Classification" is "1" or the "Exception" is "〇." In other words, the audio data is distributed only to terminal device 3, which has high security regarding audio output. Therefore, the "Individual Security Type" is an effective setting when a participant temporarily makes a highly confidential statement.

[0067] This section explains how to set the "Individual Security Type". The "Individual Security Type" is basically set based on requests from participants. If a participant wants their speech to be delivered only to other participants with a high audio output security level, they perform an operation on their terminal device 3 to request the "High" setting for the "Individual Security Type". This operation sends a request signal for the "High" setting of the "Individual Security Type" to the participant management device 22 of the web conferencing server 2. The participant management device 22 responds to the received request signal and accepts the request, sending an inquiry signal to the organizer's terminal device 3 to ask whether to allow the "High" setting for the "Individual Security Type".

[0068] Based on the received query signal, the organizer's terminal device 3 executes a process to query the organizer whether or not to allow the "Individual Security Type" to be set to "High". If the organizer performs the operation to allow the "Individual Security Type" to be set to "High" on the organizer's terminal device 3, a permission signal is sent to the participant management device 22 of the web conferencing server 2, and the "Individual Security Type" item on the terminal device 3 that sent the request signal is set to "High".

[0069] Furthermore, if a participant wishes to deactivate the "High" setting for "Individual Security Type" and revert it to "Normal," they perform an operation on their own terminal device 3 to request the "Normal" setting for "Individual Security Type." This operation sends a request signal for the "Normal" setting of "Individual Security Type" to the organizer's terminal device 3 via the participant management device 22 of the web conferencing server 2. When the organizer performs an operation on their terminal device 3 to allow the "Normal" setting, the "Individual Security Type" of the terminal device 3 that sent the request signal is set to "Normal."

[0070] Furthermore, the setting of "exceptions" and "individual security types" may be made automatically, without requiring permission from the organizer. Alternatively, the organizer may, at their discretion, set "exceptions" or "individual security types" for specific terminal devices 3, even without a request from a participant.

[0071] The video and audio distribution control device 23 distributes video data received from the terminal device 3 of a participant who has the right to share the video to all participants' terminal devices 3, in principle. The video and audio distribution control device 23 also manages whether any participant has the right to share the video. The destination of the video data may be determined by the organizer, or it may be limited to the terminal devices 3 of participants where the risk of information leakage via video is considered low. For example, a terminal device 3 whose installation location is unknown and whose video output device is set to a projector may be excluded from the destination of the video data.

[0072] Furthermore, the video and audio distribution control device 23 determines the destination of the audio data received from the speaker's terminal device 3 based on the conference management table T1 and the participant management table T2, and distributes the audio data only to the determined destination. The method for determining the destination will be explained in detail below.

[0073] Figure 7 shows a table illustrating the method for determining the destination of audio data. As can be understood from the audio data destination determination table DT1 shown in Figure 7, the video and audio distribution control device 23 determines the destination of audio data based on the setting of "Conference Security Type" and the setting of the speaker's "Individual Security Type". In principle, if the "Conference Security Type" in the Conference Management Table T1 is "High", the video and audio distribution control device 23 limits the destination of the speaker's audio data to terminal devices 3 whose "Classification" in the Participant Management Table T2 is "1" or whose "Exception" is "〇". In principle, if the "Conference Security Type" in the Conference Management Table T1 is "Normal", the video and audio distribution control device 23 determines the destination of the speaker's audio data to all terminal devices 3.

[0074] However, as mentioned above, if the speaker's "Individual Security Type" in participant management table T2 is set to "High," that setting takes precedence, and the destination of the speaker's audio data is limited to terminal device 3, where the "Classification" in participant management table T2 is "1" or the "Exception" is "〇." Conversely, if the speaker's "Individual Security Type" in participant management table T2 is set to "Normal," the destination of the speaker's audio data is determined according to the "Meeting Security Type" in meeting management table T1.

[0075] The server-side data processing device 24 performs processing on the web conferencing server other than that performed by the conference management device 21, the participant management device 22, and the video and audio distribution control device 23. For example, the server-side data processing device 24 performs processing related to terminal devices 3 joining / leaving web conferences, processing related to sending and receiving video or audio data, and processing related to starting / ending web conferences.

[0076] Figure 8 shows the configuration of the terminal device by its functional blocks. As shown in Figure 8, the terminal device 3 has, as functional blocks, an input / output device management device 31, a video / audio input / output control device 32, a display control device 33, and a terminal-side data processing device 34. Note that the display control device 33 is an example of a display control device in the present invention.

[0077] The input / output device management device 31 manages information about the input / output devices of its own terminal device. For example, the input / output device management device 31 maintains an input / output device management table.

[0078] Figure 9 is a diagram illustrating an input / output device management table. As can be seen from the input / output device management table T31 shown in Figure 9, the input / output device management table T3 has items such as "device type", "device ID", "audio / video input / output device type", and "currently in use".

[0079] The "Device Type" field indicates the type of audio or video input / output device built into or connected to terminal device 3. Examples of "Device Type" settings include "Audio Input," "Audio Output," "Video Input," and "Video Output."

[0080] The "Device ID" is an item that indicates a unique ID for audio or video input / output devices built into or connected to terminal device 3. For example, the "Device ID" may be a pre-assigned ID or a serial number.

[0081] The "Audio / Video Input / Output Device Type" item indicates whether the audio or video input device is built-in, externally connected, a headphone type, a speaker type, etc. Examples of "Audio / Video Input / Output Device Type" include "Headphones / Speaker (Phone Jack Connection)", "Headphones (USB Connection)", "Headphones (Bluetooth Connection)", "Built-in Speaker", "Speaker (Bluetooth Connection)", "Speaker (USB Connection)", "Bone Conduction Headphones", "Head-Mounted Display", "Built-in Microphone", and "Built-in Display". If terminal device 3 is a smartphone, "Audio / Video Input / Output Device Type" may also include "Smartphone / Call Speaker" and "Smartphone / Hands-Free Speaker".

[0082] The "Currently in Use" field indicates whether or not an input / output device is currently in use. For input / output devices that are currently in use, the "Currently in Use" field will be set to "○". For input / output devices that are not in use, the "Currently in Use" field will be left blank, or set to "-" or "×".

[0083] The organizer or participant can identify the available audio / video input / output devices and the audio / video input / output devices currently in use on terminal device 3 by referring to the input / output device management table T3 of terminal device 3. The participant management device 22 of the web conferencing server 2 can obtain information from the input / output device management table T3 on terminal device 3 and create the participant management table T2.

[0084] The information in the input / output device management table T3 may be voluntarily transmitted by terminal device 3 to the web conferencing server 2, or the web conferencing server 2 may collect it from terminal device 3. Furthermore, if there are any changes to the contents of the input / output device management table T3, the changes will be reflected in the participant management table T2. For example, the web conferencing server 2 may periodically refer to the input / output device management table T3 of each terminal device 3 to read the information. Alternatively, for example, if there are any changes to the contents of the input / output device management table T3 in terminal device 3, terminal device 3 may send the changes to the web conferencing server 2.

[0085] When the video and audio input / output control device 32 receives video data from the web conferencing server 2, it controls the video output device in use so that the video corresponding to the video data is displayed. In addition, when video is input to the video input device in use, for example, when the setting is made to share the screen with web conferencing participants, or when a subject is captured by the camera, the video and audio input / output control device 32 sends video data corresponding to the input video to the web conferencing server 2.

[0086] Furthermore, when the video / audio input / output control device 32 receives audio data from the web conferencing server 2, it controls the audio output device in use so that audio corresponding to the audio data is output. Also, when audio is input to the audio input device in use, the video / audio input / output control device 32 sends audio data corresponding to the input audio to the web conferencing server 2.

[0087] The display control device 33 controls the display unit 3k so that images or text information related to the web conference are displayed during the web conference. Data corresponding to the content displayed on the display unit 3k is obtained from the web conference server 2. Examples of the content to be displayed include video or images shared with participants in the web conference, information related to the operation of the web conference, and information related to the participants of the web conference.

[0088] Figure 10 is a diagram that simulates an example of a terminal device display screen. In the display screen D11 shown in Figure 10, for example, the "operation menu area" R1 is displayed at the top of the screen, the "video display area" R2 is displayed in the left center of the screen, and the "participant information area" R3 is displayed in the right center of the screen. The "participant information area" R3 has fields for "participant," "name," and "audio output" for each participant.

[0089] The "Participant" column displays an image (usually the participant's face) captured by the camera on the participant's terminal device 3. The "Participant" column may also display an image or icon that the participant has previously registered and associated with their participant ID.

[0090] The "Name" field displays the participant's name. This "Name" may be the name associated with the personal ID used by the participant when logging into terminal device 3, or it may be the name entered by the participant when joining the web conference.

[0091] The "Audio Output" column displays an icon corresponding to the "Audio Output Device Type in Use" of the participant's terminal device 3. If the "Audio Output Device Type in Use" is a "speaker-type device," an icon corresponding to a speaker, such as an icon containing an image resembling the shape of a speaker, will be displayed. If the "Audio Output Device Type in Use" is a "headphone-type device," an icon corresponding to headphones, such as an icon containing an image resembling the shape of headphones, will be displayed. If the "Audio Output Device Type in Use" is unknown, an icon corresponding to the unknown, such as an icon containing an image representing a question mark, will be displayed.

[0092] Furthermore, the display control device 33 controls the display unit 3k to display text on the screen that indicates warnings, cautions, status, etc., based on control signals or data obtained from the web conferencing server 2. The control signal is, for example, a control signal for displaying the text. The data is, for example, data indicating that the terminal device 3 that received the data is not among the destinations for audio data, or data containing only video data from video data and audio data (data indicating that it is not among the destinations for audio data). The text displayed on the screen is, for example, a message indicating that audio is being distributed only to terminal devices whose audio output device is a headphone type device, or a message prompting the user to switch the audio output device to a headphone type device. It may also be, for example, a message informing the user that their terminal device is not among the destinations for audio distribution.

[0093] Figures 11 and 12 are diagrams illustrating examples of screens displaying text. For example, as shown in the display screen D12 in Figure 11, message C1 reads, "Audio is being distributed only to terminal devices whose audio output device is a 'headphone type device'." Also, as shown in the display screen D13 in Figure 12, message C2 reads, "Please switch the audio output device to a 'headphone type device'."

[0094] Furthermore, if the web conferencing server 2 has a function to convert audio to text and outputs the text data converted from audio to the terminal device, the display control device 33 may control the display unit to display the text converted from audio, i.e., subtitles, on the screen.

[0095] The terminal-side data processing device 34 performs processing on the terminal device 3 other than that performed by the input / output device management device 31, the video / audio input / output control device 32, and the display control device 33. For example, the terminal-side data processing device 34 performs processing related to logging into the terminal device 3, processing related to sending and receiving audio data of speech from the terminal device 3, and processing related to joining and leaving web conferences.

[0096] <Processing flow of the web conferencing system according to Embodiment 1> The processing flow of the web conferencing system according to Embodiment 1 will be described below.

[0097] Figure 13 is a diagram illustrating the overview of the processing flow of the web conferencing system according to Embodiment 1. As shown in Figure 13, the web conferencing system 1 comprises steps S1 to S9 as an overview of the processing flow. Note that this processing flow is simplified so that the processing performed by the web conferencing system 1 can be easily understood. Therefore, in reality, various processes may be executed in a complex manner through server-client communication between the web conferencing server 2 and multiple terminal devices 3. For example, some processes may be executed in parallel, and some processes may be routinely executed repeatedly.

[0098] 《S1: Equipment Management Table Creation Process》 In step S1, the process of creating the equipment management table is executed.

[0099] Figure 14 shows an example of the flow of the device management table creation process. As shown in Figure 14, the device management table creation process in step S1 comprises steps S11 to S12.

[0100] In step S11, the input / output device management devices 31 of each terminal device 3 of the organizer and participants collect device information about input / output devices built into their own terminal device 3 or externally connected input / output devices.

[0101] In step S12, the input / output device management device 31 of each terminal device 3 creates an input / output device management table T3 based on the collected device information. This completes the device management table creation process in step S1.

[0102] The device management table creation process is usually executed automatically after the OS of terminal device 3 starts up. However, the device management table creation process may also be executed in response to user operations on terminal device 3.

[0103] S2: Meeting Reservation Processing In step S2, the meeting reservation process is executed.

[0104] Figure 15 shows an example of the meeting reservation process flow. As shown in Figure 15, the meeting reservation process in step S2 comprises steps S21 to S28.

[0105] In step S21, the terminal-side data processing device 34 of the terminal device used by the organizer launches the meeting application or browser based on the organizer's operation.

[0106] In step S22, the terminal-side data processing device 34 accepts input for the desired date and time of the web conference to be held, based on the organizer's operation.

[0107] In step S23, the terminal-side data processing device 34 accepts input for the conference security type of the web conference to be held, based on the organizer's operation.

[0108] In step S24, the terminal-side data processing device 34 sends a meeting reservation request signal to the web conferencing server 2 to request a meeting reservation based on the entered date and time and meeting security type.

[0109] In step S25, the conference management device 21 of the web conferencing server 2 receives the conference reservation request signal and accepts the request.

[0110] In step S26, the conference management device 21 updates the conference management table T1 by writing the conference reservation to the conference management table T1 based on the received conference reservation request signal.

[0111] In step S27, the meeting management device 21 sends a reservation completion notification to the organizer's terminal device 3.

[0112] In step S28, the terminal-side data processing device 34 on the organizer's terminal device 3 receives a reservation completion notification. This completes the meeting reservation process in step S2.

[0113] In the above embodiment, the organizer makes the meeting reservation request using the organizer's terminal device 3, but a participant who has the authority to make a meeting reservation may also make the meeting reservation request using their own terminal device 3.

[0114] 《S3: Meeting Start Process》 In step S3, the meeting start process is executed.

[0115] Figure 16 shows an example of the meeting initiation process flow. As shown in Figure 16, the meeting initiation process in step S3 comprises steps S31 to S35.

[0116] In step S31, the terminal-side data processing device 34 on the organizer's or participant's terminal device 3 determines whether an operation has been made by the participant to request to join the meeting for the first time or by the organizer to request to hold a meeting. If it is determined that such an operation has been made (S31: Yes), the process proceeds to step S32. On the other hand, if it is determined that such an operation has not been made (S31: No), the process returns to step S31.

[0117] In step S32, the terminal-side data processing device 34 sends a meeting request signal or a meeting participation request signal corresponding to the above operation to the web conferencing server 2.

[0118] In step S33, the server-side data processing device 24 of the web conferencing server 2 receives a meeting request signal or a meeting participation request signal.

[0119] In step S34, the server-side data processing unit 24 sets up a virtual web conference room on the network 4.

[0120] In step S35, the server-side data processing device 24 starts the meeting management process. Then, it proceeds to step S44 in the join / leave request process.

[0121] 《S4: Join / Leave Processing》 In step S4, the join / leave process is executed.

[0122] Figure 17 shows an example of the join / leave process flow. As shown in Figure 17, the join / leave process in step S4 comprises steps S41 to S410.

[0123] In step S41, the terminal-side data processing device 34 on the organizer's or participant's terminal device 3 determines whether or not an operation to join or leave has occurred. If it is determined that such an operation has occurred (S41: Yes), the process proceeds to step S42. On the other hand, if it is determined that no such operation has occurred (S41: No), the join / leave process is terminated.

[0124] In step S42, the terminal-side data processing device 34 sends a join / leave request signal to the web conferencing server 2.

[0125] In step S43, the server-side data processing unit 24 of the web conferencing server 2 receives the above-mentioned join / leave request signal, that is, accepts the join / leave request.

[0126] In step S44, the server-side data processing device 24 determines whether the received signal is a participation request signal, that is, whether it has accepted the participation request. If it is determined that the signal is a participation request signal (S44:Yes), the process proceeds to step S45. On the other hand, if it is determined that the signal is not a participation request signal, that is, a departure request signal (S44:No), the process proceeds to step S47.

[0127] In step S45, the server-side data processing device 24 sends a request signal to the terminal device 3 to request input / output device information.

[0128] In step S46, terminal device 3 responds to the request signal by sending its own input / output device information to web conferencing server 2.

[0129] In step S47, the participant management device 22 of the web conferencing server 2 updates the participant management table T2 based on the received input / output device information.

[0130] In step S48, the server-side data processing unit 24 sends a notification of completion of joining / leaving to the terminal device 3 that is joining / leaving. The server-side data processing unit 24 also distributes updated participant information to all participants' terminal devices 3.

[0131] In step S49, the terminal-side data processing device 34 of the terminal that is joining / leaving receives (acquires) a notification of completion of joining / leaving.

[0132] In step S410, the terminal-side data processing devices 34 in all participants' terminal devices 3 receive (acquire) the updated participant information. Also, the display control devices 33 in all participants' terminal devices 3 update the display in the "Participant Information Area" R3 on the display screen D11 of the terminal device 3 based on the received updated participant information. With this, the participation / departure process in step S4 is completed.

[0133] S5: Audio Output Device Management Processing In step S5, the audio output device management process is executed.

[0134] Figure 18 shows an example of the flow of the audio output device management process. As shown in Figure 18, the audio output device management process in step S5 comprises steps S51 to S58.

[0135] In step S51, the input / output device management device 31 on the organizer's or participant's terminal device 3 determines whether there has been a change in the audio output device currently in use on its terminal device. If it is determined that there has been a change (S51: Yes), the process proceeds to step S52. On the other hand, if it is determined that there has been no change (S51: No), the audio output device management process ends.

[0136] In step S52, the input / output device management device 31 updates the input / output device management table T3 of its terminal device 3 so that the change is reflected.

[0137] In step S53, the input / output device management device 31 sends change information indicating the changes to the web conferencing server 2.

[0138] In step S54, the participant management device 22 of the web conferencing server 2 receives the change information.

[0139] In step S55, the participant management device 22 updates the participant management table T2 based on the received change information.

[0140] In step S56, the server-side data processing device 24 distributes device change information to all terminal devices 3, based on the updated participant management table T2, indicating which terminal devices have changed their audio output device and the details of those changes.

[0141] In step S57, the terminal-side data processing devices 34 in all participants' terminal devices 3 receive the changed device information distributed from the web conferencing server 2.

[0142] In step S58, the display control device 33 on each participant's terminal device 3 updates the display in the "Audio Output" field in the "Participant Information Area" R3 of the display screen D11 based on the received change device information. With this, the audio output device management process in step S5 is completed.

[0143] S6: Individual Security Type Setting Management Process In step S6, the individual security type setting management process is executed.

[0144] Figure 19 shows an example of the flow of the individual security type setting management process. As shown in Figure 19, the individual security type setting management process in step S6 comprises steps S61 to S69.

[0145] In step S61, the terminal-side data processing device 34 on the participant's terminal device 3 determines whether or not an operation requesting the setting of "individual security type" has been performed on its own terminal device 3. If it is determined that such an operation has been performed (S61: Yes), the process proceeds to step S62. On the other hand, if it is determined that such an operation has not been performed (S61: No), the individual security type setting management process ends.

[0146] In step S62, the terminal-side data processing device 34 of the terminal device 3 that performed the operation sends a setting change request signal to the web conferencing server 2 to request a change in the individual security type setting. For example, a setting change request signal is sent requesting that the "Individual Security Type" setting be changed from "Normal" to "High".

[0147] In step S63, the participant management device 22 of the web conferencing server 2 receives the setting change request signal transmitted in step S62, that is, it accepts the setting request.

[0148] In step S64, the participant management device 22 sends an inquiry signal to the organizer's terminal device 3 regarding whether or not the setting change is permissible.

[0149] In step S65, the terminal-side data processing device 34 on the organizer's terminal device 3 sends a query to the organizer regarding whether to allow the setting change, based on the received query signal. For example, the terminal-side data processing device 34, in cooperation with the display control device 33, displays text such as "Participant AAAAA is requesting to set the individual security type to High. Do you allow it? (Yes / No)" on the screen of the terminal device 3. The organizer virtually presses the "Yes" button if they allow the setting change, or virtually presses the "No" button if they do not allow it. In response to this operation, the terminal-side data processing device 34 sends permission response information to the participant management device 22 of the web conferencing server 2.

[0150] In step S66, the participant management device 22 receives the permission / denial information and determines whether the response to the request for setting change is permission or denial. If it is determined to be permission (S66: Yes), the process proceeds to step S67. On the other hand, if it is determined to be denial (S66: No), the process proceeds to step S68.

[0151] In step S67, the participant management device 22 sets the "Individual Security Type" on the terminal device 3 of the participant who requested a setting change to "High" and updates the participant management table T2. Then, the process proceeds to step S68.

[0152] In step S68, the participant management device 22 notifies the terminal device 3 of the participant who requested the setting change of the result of the approval or rejection response from the organizer.

[0153] In step S69, the terminal-side data processing device 34 on the terminal device 3 of the participant who requested the setting change receives notification of the approval / rejection result, and the display control device 33 on the terminal device 3 displays the approval / rejection result on the screen. With this, the individual security type setting management process in step S6 is completed.

[0154] 《S7: Video and Audio Streaming Processing》 In step S7, video and audio distribution processing is performed.

[0155] Figure 20 shows an example of the video and audio distribution processing flow. As shown in Figure 20, the video and audio distribution processing in step S7 comprises steps S71 to S76.

[0156] In step S71, the video and audio input / output control device 32 in the speaker's terminal device 3 converts the speaker's voice into audio data via audio input devices such as a microphone and an AD converter, and sends it to the web conferencing server 2. In addition, the video and audio input / output control device 32 in the video provider's terminal device 3 converts the video to be provided and shared with participants, such as slide images displayed on the screen of their terminal device 3, into video data, and sends it to the web conferencing server 2.

[0157] In step S72, the video and audio distribution control device 23 of the web conferencing server 2 receives video data from the video provider's terminal device 3 and audio data from the speaker's terminal device 3.

[0158] In step S73, the video and audio distribution control device 23 determines the terminal device 3 to which the audio data will be sent, based on the contents of the conference management table T1 and the participant management table T2. In particular, the video and audio distribution control device 23 determines the destination of the audio data based on the setting of "Conference Security Type" in the conference management table T1, or "Type of Audio Output Device in Use" or "Classification" in the participant management table T2.

[0159] For example, if "High" is set for "Conference Security Type," the video and audio distribution control device 23 determines that the destination for audio data is terminal device 3, which has "1" set for "Classification." In other words, if secure mode is set for the ongoing web conference, the video and audio distribution control device 23 limits the destination to terminal device 3 whose audio output device is of the headphone type.

[0160] For example, if the speaker's "Individual Security Type" is set to "High," the video and audio distribution control device 23 determines that the destination of the audio data is terminal device 3 whose "Classification" is set to "1." In other words, if the terminal device 3 is set to allow secure transmission, the video and audio distribution control device 23 determines that the destination of the audio data is limited to terminal device 3 whose audio output device type is headphones.

[0161] In step S74, the video and audio distribution control device 23 distributes video data to all participants' terminal devices 3. The video and audio distribution control device 23 also distributes the speaker's audio data to the terminal device 3 designated as the recipient in step S73.

[0162] In step S75, the video and audio input / output control device 32 of each terminal device 3 receives video data or audio data distributed from the web conferencing server 2. The video and audio input / output control device 32 also works in conjunction with the display control device 33 to control the display unit 3k to display text on the screen that indicates warnings, cautions, status, etc., based on the control signals or data obtained from the web conferencing server 2. In terminal devices 3 that have not received audio data, the text displayed on the screen may be, for example, a message indicating that audio is being distributed only to terminal devices whose audio output device is a headphone type device, a message prompting the user to switch their audio output device to a headphone type device, or a message informing the user that their terminal device is not among the audio distribution destinations.

[0163] In step S76, the video and audio input / output control device 32 of each terminal device 3 works in conjunction with the display control device 33 to display the video represented by the received video data on the screen of the display unit 3k. In addition, the video and audio input / output control device 32 of each terminal device 3 controls the audio output device currently in use on its terminal device 3 to output the audio represented by the received audio data. With this, the video and audio distribution process in step S7 is completed.

[0164] Furthermore, in web conferences, there isn't always just one speaker; it's possible that multiple participants will speak simultaneously. When multiple participants speak at the same time, it's possible to create the illusion that the audio from multiple speakers is being broadcast almost simultaneously by dividing each speaker's voice into very short segments, converting them into audio data, and distributing them in rotation.

[0165] S8: Decision to terminate the meeting In step S8, the process for deciding to terminate the meeting is executed.

[0166] Figure 21 shows an example of the flow of the process for deciding whether to continue or terminate a meeting. As shown in Figure 21, the process for deciding whether to continue or terminate a meeting comprises steps S81 to S86.

[0167] In step S81, the terminal-side data processing device 34 on the organizer's terminal device 3 determines whether or not an operation to request the end of the meeting has been performed. If it is determined that such an operation has been performed (S81: Yes), the process proceeds to step S82. On the other hand, if it is determined that such an operation has not been performed (S81: No), the meeting continuation termination decision process ends.

[0168] In step S82, the terminal-side data processing device 34 of the organizer's terminal device 3 sends meeting termination request information indicating a request to end the meeting to the web conferencing server 2.

[0169] In step S83, the server-side data processing device 24 of the web conferencing server 2 receives meeting termination request information.

[0170] In step S84, in response to receiving a meeting termination request information from the server-side data processing device 24, the meeting management device 21 of the web conferencing server 2 decides to terminate the ongoing web conference. The meeting management device 21 also terminates the meeting management process, deletes the schedule of the ongoing web conference from the meeting management table T1, and updates the meeting management table T1.

[0171] In step S85, the server-side data processing device 24 sends a meeting end notification to all participants' terminal devices 3.

[0172] In step S86, the terminal-side data processing device 34 in each participant's terminal device 3 receives the meeting end notification and, in cooperation with the display control device 33, displays an image or text on the screen indicating the end of the meeting. With this, the meeting continuation termination decision process in step S8 is completed.

[0173] 《S9: Meeting End Determination Process》 In step S9, the meeting termination determination process is executed. Specifically, the meeting management device 21 of the web conferencing server 2 determines whether the meeting has ended or not. If it is determined that the meeting has ended (S9:Yes), the web conferencing system processing terminates. On the other hand, if it is determined that the meeting has not ended (S9:No), the process returns to step S4 and the web conferencing system processing continues.

[0174] <Effects of the web conferencing system according to Embodiment 1> As described above, in the web conferencing system according to Embodiment 1, in the video and audio distribution processing in step S7, particularly in step S73, the destination of the audio data is limited to terminal devices whose audio output device is a headphone type. This limits the destination of audio data that is likely to contain confidential information to terminal devices in an environment where the risk of unintended parties listening to the audio is low, thereby reducing the risk of confidential information leakage during web conferencing.

[0175] For example, even if a participant in a web conference forgets that their terminal device's audio output is set to the built-in speaker and joins the conference in a public place, there is no need to worry about their audio being unintentionally output and confidential information being overheard by others. Also, if participants are aware that the web conferencing system has such security features, their concerns about information leakage will be eliminated, and they can maintain a good state of mental well-being.

[0176] Furthermore, according to the web conferencing system of Embodiment 1, the decision of whether or not to restrict the destination of audio data is made based on the set "conference security type," so it is possible to choose whether or not to restrict the destination of audio data depending on the level of confidentiality of the web conference. For example, if the confidentiality of the web conference is low, the destination of the audio data can be not restricted, thereby reducing the burden on web conference participants.

[0177] Furthermore, according to the web conferencing system of Embodiment 1, if a terminal device whose "currently used audio output device type" is a speaker-type device and is excluded from the destination of audio data transmission, an output will be displayed indicating that audio distribution is limited to terminal devices whose "currently used audio output device type" is a headphone-type device. Alternatively, if a terminal device whose "currently used audio output device type" is a speaker-type device and is excluded from the destination of audio data transmission, information will be displayed prompting the user to switch their currently used audio output device to a headphone-type device. Therefore, it is possible to show participants using terminal devices that do not output audio due to restrictions on the destination of audio data, the reason why audio is not outputting, and to help them understand the measures to take to enable audio output.

[0178] The following describes a web conferencing system according to another embodiment. This web conferencing system according to another embodiment has the same hardware configuration and functional block configuration as the web conferencing system 1 according to Embodiment 1. On the other hand, in this web conferencing system according to another embodiment, some of the processing performed by the functional blocks and some of the data handled by the functional blocks differ from those in Embodiment 1. Therefore, in the following embodiments, the configuration of the web conferencing system will not be described, and the differences from Embodiment 1 will be explained, focusing on the processing performed by the functional blocks and the data handled by the functional blocks.

[0179] (Embodiment 2) <Overview of the web conferencing system according to Embodiment 2> In Embodiment 1, the "Meeting Security Type" item in the meeting management table and the "Classification" and "Individual Security Type" items in the participant management table T2 were each set at two levels. In Embodiment 2, the "Meeting Security Type," "Classification," and "Individual Security Type" items are each set at three levels. Each functional block constituting the web conferencing server 2 and terminal device 3 performs processing according to the three levels set for "Meeting Security Type," "Classification," and "Individual Security Type." The details of the processing performed by the functional blocks and the data handled by the functional blocks are described below.

[0180] <Functional blocks of the web conferencing system according to Embodiment 2> Figure 22 is a diagram illustrating a meeting management table in Embodiment 2. As shown in the meeting management table T12 in Figure 22, the "Meeting Security Type" is set to one of three levels: "High," "Middle," and "Normal." In setting the "Meeting Security Type," "High" corresponds to "high," "Middle" corresponds to "somewhat high," and "Normal" corresponds to "average."

[0181] Figure 23 is a diagram illustrating a participant management table in Embodiment 2. As shown in the participant management table T22 in Figure 23, the "Classification" item, which is determined according to the type of audio output device in use, is set to three levels: "1", "2", and "3". The level of security regarding audio output of the audio output device in use corresponds to "high" for "1", "normal" for "2", and "low" for "3". The "Individual Security Type" is set to three levels: "High", "Middle", and "Normal". Note that in the participant management table T22 shown in Figure 23, the "Normal" display is omitted in the "Individual Security Type" column to make the "High" and "Middle" displays easier to read. The level of security required when outputting audio data corresponds to "high" for "High", "Middle" for "somewhat high", and "Normal" for "Normal".

[0182] When configuring the meeting management table T1, the meeting management device 21 sets the "meeting security type" to one of three levels: "High," "Middle," or "Normal." The setting of the "meeting security type" is performed by the organizer or a person with equivalent authority.

[0183] Figure 24 is a diagram illustrating a table for determining the destination of audio data. As can be seen from the audio data destination determination table DT2 shown in Figure 24, the video and audio distribution control device 23 determines the destination of audio data based on the setting of the "conference security type" and the setting of the speaker's "individual security type".

[0184] If the "Meeting Security Type" in the meeting management table T1 is "High", the video and audio distribution control device 23 limits the destination of the speaker's audio data to terminal devices 3 whose "Classification" in the participant management table T2 is "1".

[0185] Furthermore, if the "Meeting Security Type" in the meeting management table T1 is "Middle", the video and audio distribution control device 23 will, in principle, limit the destination of the speaker's audio data to terminal devices 3 whose "Classification" in the participant management table T2 is "1" or "2", or whose "Exception" is "〇". However, if the speaker's "Individual Security Type" is "High", the destination of the speaker's audio data will be limited to terminal devices 3 whose "Classification" in the participant management table T2 is "1".

[0186] Furthermore, if the "Meeting Security Type" in the meeting management table T1 is "Normal", the video and audio distribution control device 23, in principle, determines that the destination of the speaker's audio data is all terminal devices 3. However, if the speaker's "Individual Security Type" is "High", the destination of the speaker's audio data is limited to terminal devices 3 whose "Classification" in the participant management table T2 is "1". Also, if the speaker's "Individual Security Type" is "Middle", the destination of the speaker's audio data is limited to terminal devices 3 whose "Classification" in the participant management table T2 is "1" or "2", or whose "Exception" is "〇".

[0187] <Effects of the web conferencing system according to Embodiment 2> As described above, according to the web conferencing system of Embodiment 2, the settings for "conference security type," "classification," and "individual security type" are set at three levels, which allows for more precise control over the determination of the destination of audio data.

[0188] (Embodiment 3) <Overview of the web conferencing system according to Embodiment 3> The web conferencing system according to Embodiment 3 involves a web conferencing server that acquires and stores device type information indicating the type of audio output device being used in each terminal device 3 from multiple terminal devices 3, and controls the volume of audio from the audio output device being used in each terminal device 3 based on the stored device type information for each terminal device 3.

[0189] In Embodiment 2, the video and audio distribution control device 23 limits the destination of audio data based on the "Meeting Security Type" in the meeting management table T1 and the "Individual Security Type," "Classification," and "Exception" in the participant management table T2. On the other hand, in Embodiment 3, the video and audio distribution control device 23 determines which terminal devices 3 are subject to volume reduction control so that the volume of the output audio is lower than a pre-set first volume level, based on the "Meeting Security Type," "Individual Security Type," "Classification," and "Exception." The first volume level is, for example, a volume level at which the output audio can be heard, but not clearly heard unless one is in the vicinity of the audio output device. For example, if the settable volume level is in the range of 0 to 10, the first volume level can be considered to be around 1 to 3. Alternatively, the first volume level can be considered to be 40% to 70% of the currently set volume level.

[0190] <Functional blocks and processing flow of the web conferencing system according to Embodiment 3> When setting up the meeting management table, the meeting management device 21 allows you to select one of three levels for "Meeting Security Type": "High," "Middle," and "Normal."

[0191] In Embodiment 3, the content of the video and audio distribution processing in step S7 differs slightly from the web conferencing system processing flow shown in Figure 9.

[0192] Figure 25 shows an example of the video and audio distribution processing flow according to Embodiment 3. As shown in Figure 25, the video and audio distribution processing in step S7a according to Embodiment 3 comprises steps S71-72 and S73a-76a.

[0193] In step S71, the video and audio input / output control device 32 in the speaker's terminal device 3 converts the speaker's voice into audio data via audio input devices such as a microphone and an AD converter, and sends it to the web conferencing server 2. In addition, the video and audio input / output control device 32 in the video provider's terminal device 3 converts the video to be provided and shared with participants, such as slide images displayed on the screen of their terminal device 3, into video data, and sends it to the web conferencing server 2.

[0194] In step S72, the video and audio distribution control device 23 of the web conferencing server 2 receives video data from the video provider's terminal device 3 and audio data from the speaker's terminal device 3.

[0195] In step S73a, the video and audio distribution control device 23 refers to the conference management table T1 and the participant management table T2 to determine the terminal device 3 to be subjected to volume reduction control.

[0196] In step S74a, the video and audio distribution control device 23 distributes video and audio data to all terminal devices and transmits a volume reduction control signal to the terminal device 3 that is subject to volume reduction control.

[0197] In step S75a, the video and audio input / output control device 32 of each terminal device 3 receives video data or audio data distributed from the web conferencing server 2. The terminal device 3 that is subject to volume reduction control also receives a volume reduction control signal.

[0198] In step S76a, the video and audio input / output control device 32 of each terminal device 3 works in conjunction with the display control device 33 to display the video represented by the received video data on the screen. The video and audio input / output control device 32 of each terminal device 3 also controls the audio output device in use to output the audio represented by the received audio data. Upon receiving the volume reduction control signal, the terminal device 3 controls the volume of the output audio based on the volume reduction control signal. With this, the video and audio distribution process in step S7 is completed.

[0199] Figure 26 is a diagram illustrating a table for determining the target of volume reduction control. As can be understood from the audio data transmission destination determination table DT3 shown in Figure 26, the video and audio distribution control device 23 determines the target of volume reduction control based on the setting of the "conference security type" and the setting of the speaker's "individual security type".

[0200] If the "Conference Security Type" in the conference management table T1 (see Figure 2 as appropriate) is "High", the video and audio distribution control device 23 determines that the targets for volume reduction control are the terminal devices 3 other than the terminal device 3 whose "Classification" in the participant management table T2 is "1".

[0201] Furthermore, if the "Conference Security Type" in the conference management table T1 is "Middle", the video and audio distribution control device 23, in principle, determines that the targets for volume reduction control are terminal devices 3, excluding terminal devices 3 whose "Classification" in the participant management table T2 (see Figure 2) is "1" or "2", and terminal devices 3 whose "Exception" is "〇". However, if the speaker's "Individual Security Type" is "High", the targets for volume reduction control are determined to be terminal devices 3, excluding terminal devices 3 whose "Classification" in the participant management table T2 is "1".

[0202] Furthermore, the video and audio distribution control device 23 will, in principle, not perform volume reduction control if the "Conference Security Type" in the conference management table T1 is "Normal". However, if the speaker's "Individual Security Type" is "High", the target of volume reduction control will be limited to terminal devices 3 from all terminal devices 3, excluding terminal devices 3 whose "Classification" in the participant management table T2 is "1". Also, if the speaker's "Individual Security Type" is "Middle", the target of volume reduction control will be determined to be terminal devices 3 from all terminal devices 3, excluding terminal devices 3 whose "Classification" in the participant management table T2 is "1" or "2", and terminal devices 3 whose "Exception" is "〇".

[0203] The video and audio distribution control device 23 transmits a volume reduction control signal to the terminal device 3 that is subject to volume reduction control, thereby reducing the volume.

[0204] <Effects of the web conferencing system according to Embodiment 3> As described above, according to the web conferencing system of Embodiment 3, terminal device 3 that is in an audio output state with a relatively high risk of leakage of confidential information is determined to be subject to volume reduction control based on the settings of "conference security type," "classification," "exception," and "individual security type," thereby reducing the risk of confidential information being overheard by unintended parties.

[0205] Furthermore, according to the web conferencing system of Embodiment 3, in terminal device 3, which is in an audio output state where the risk of leakage of confidential information is relatively high, audio is output at a low volume. Therefore, participants can understand that their terminal device 3 is in an audio output state where the risk of leakage of confidential information is relatively high.

[0206] Furthermore, according to the web conferencing system of Embodiment 3, even if terminal device 3 is in an audio output state where the risk of leakage of confidential information is relatively high, audio data is still delivered and audio is output, albeit at a low volume. Therefore, unlike in cases where no audio is output, participants do not need to suspect a malfunction or incorrect setting of the audio output device, and thus do not feel anxious.

[0207] Note that the volume reduction control may also be a control that sets the output volume level to 0. In this case, the situation will be the same as when no audio data is delivered.

[0208] (Embodiment 4) <Overview of the web conferencing system according to Embodiment 4> In embodiments 1 to 3, the distribution of audio data is controlled based on the "type of audio output device in use" of the terminal device 3. On the other hand, in embodiment 4, the audio input / output status of the terminal device 3 is monitored, and the distribution of audio data is controlled based on the monitoring results.

[0209] <Functional blocks of the web conferencing system according to Embodiment 4> The video and audio distribution control device 23 compares and analyzes the audio data picked up by the microphones 3s of each terminal device 3 to determine if the same audio is being received from multiple different terminal devices 3. If the video and audio distribution control device 23 determines, as a result of the analysis, that the same audio is being received from multiple terminal devices 3, it recognizes that the multiple terminal devices 3 are installed in close proximity to each other and determines that the risk of confidential information being leaked to unintended parties is low. The video and audio distribution control device 23 then transmits specific information identifying the multiple terminal devices 3 to the participant management device 22. Based on the received specific information, the participant management device 22 sets the "classification" of the multiple terminal devices 3 to "1".

[0210] <Effects of the web conferencing system according to Embodiment 4> According to the web conferencing system of Embodiment 4 described above, the system analyzes the sound picked up by the microphone 3s of each terminal device 3, identifies terminal devices 3 that are set to be close to each other, determines that the identified terminal devices 3 have a low risk of leakage of confidential information, and sets their "classification" to "1". Therefore, it is possible to automatically set the appropriate "classification" even without a request from the terminal device 3.

[0211] In each of the embodiments described above, any of the multiple terminal devices 3 constituting the web conferencing system 1 may also function as the web conferencing server 2. For example, the web conferencing system 1 may consist of one terminal device 3 that also functions as the web conferencing server 2, and one or more other terminal devices 3 connected via a network 4.

[0212] Although embodiments of the present invention have been described above, the present invention is not limited to the embodiments described above and includes various modifications. Furthermore, the embodiments described above are described in detail for the purpose of explaining the present invention in an easy-to-understand manner and are not necessarily limited to those having all the configurations described. It is also possible to replace a part of the configuration of one embodiment with the configuration of another embodiment, and it is also possible to add the configuration of another embodiment to the configuration of one embodiment. All of these are within the scope of the present invention. Moreover, the numbers and messages included in the text and figures are merely examples, and using different ones will not impair the effects of the present invention.

[0213] Furthermore, it is possible to add, delete, or replace some of the configurations in each embodiment with other configurations. Also, some or all of the above configurations, functions, processing units, processing means, etc., may be implemented in hardware, for example, by designing them as integrated circuits. Alternatively, the above configurations, functions, etc., may be implemented in software by a processor such as an MPU or CPU interpreting and executing programs that realize each function. Furthermore, the scope of functions implemented by software is not limited, and hardware and software may be used in combination. Information such as programs, tables, and files that realize each function can be stored in memory, a recording device such as a hard disk or SSD (Solid State Drive), or a recording medium such as an IC card, SD card, or DVD. [Explanation of Symbols]

[0214] 1…Web conferencing system, 2…Web conferencing server, 3…Terminal device, 4…Network, 2a,3a…Storage, 2b,3b…Memory, 2c,3c…Processor, 2d,3d…Wireless communication unit, 2e,3e…Wired communication unit, 2f,3f…Video control unit, 2g,3g…Audio control unit, 2h,3h…Operation control unit, 2j,3j…Power supply control unit, 2k,3k…Display unit, 2m,3m…Camera, 2n,3n…Wireless interface, 2p,3p…Wired interface, 2r,3r…Speaker, 2s,3s…Microphone, 2t,3t…Operation input unit, 2w,3w…Power interface, 3x… Battery, 21...Conference management device, 22...Participant management device, 23...Video and audio distribution control device, 24...Server-side data processing device, 31...Input / output device management device, 32...Video and audio input / output control device, 33...Display control device, 34...Terminal-side data processing device, A1...Operating system, A2...Web conferencing program, A3...Browser, D11, D12, D13...Display screen, T1, T11, T12...Conference management table, T2, T21, T22...Participant management table, T3, T31...Input / output device management table, DT1, DT2, DT3...Table for determining audio data transmission destination

Claims

1. A web conferencing system comprising a server and at least a first terminal device and a second terminal device connected to the server, The server includes a storage unit that acquires and stores device type information indicating the type of audio output device used in the first terminal device and the second terminal device, and participant information indicating the participants using the first terminal device and the second terminal device. It includes a transmission unit that transmits the device type information and participant information of the second terminal device acquired to the first terminal device, The first terminal device has a display unit that displays the device type information and participant information received from the second terminal device. If the server determines that the audio output device indicated by the device type information of the second terminal device received is unknown, the display unit will display an image indicating that it is unknown. Web conferencing system.

2. In the web conferencing system according to claim 1, The display unit displays an icon corresponding to headphones when the type of device information of the second terminal device indicates that it is a headphone type. If the type of the equipment information of the second terminal device is a speaker type, an icon corresponding to a speaker is displayed. If the server determines that the audio output device indicated by the device type information of the second terminal device received is unknown, the image displayed by the display unit indicating that it is unknown is an icon corresponding to a question mark. Web conferencing system.

3. In the web conferencing system according to claim 2, The aforementioned headphone-type device is at least one of headphones, earphones, headsets, earsets, head-mounted displays, bone conduction speakers, and smartphone call speakers. The speaker-type device is a speaker built into or externally connected to the first terminal device or the second terminal device. Web conferencing system.

4. In the web conferencing system according to claim 1, If the server determines that the type of audio output device indicated by the device type information of the second terminal device received by the server is unknown, the server will display a warning text on the second display unit of the second terminal device. Web conferencing system.

5. In the web conferencing system according to claim 1, The display unit displays an image captured by the imaging unit of the second terminal device as participant information of the second terminal device. Web conferencing system.

6. In the web conferencing system according to claim 1, The display unit further displays an image captured by the imaging unit of the first terminal device as participant information of the first terminal device. Web conferencing system.

7. In the web conferencing system according to claim 1, The display unit further displays icons that have been pre-registered as participant information for the first terminal device. Web conferencing system.

8. In the web conferencing system according to claim 1, The holding unit of the server updates the equipment type information of the second terminal device when the type of audio output device being used in the second terminal device changes. The transmission unit of the server transmits the updated device type information of the second terminal device to the first terminal device. The display unit of the first terminal device displays the updated device type information of the second terminal device on the screen. Web conferencing system.

9. A terminal device used for web conferencing, Information transmission and reception unit, It includes a display unit, The aforementioned information transmission and reception unit is The terminal device sends to the server information indicating the type of audio output device used by the terminal device and information indicating the participants using the terminal device to participate in the web conference. Furthermore, the server receives information from other terminal devices indicating the type of audio output device used by other terminal devices and information from other terminal participants indicating the participants using the other terminal devices. The display unit displays the received information on the type of other terminal device and the information on other terminal participants in association with each other. If the server determines that the audio output device indicated by the other terminal device type information received is unknown, it will display an image indicating that it is unknown. Terminal device.

10. In the terminal device according to claim 9, The display unit displays an icon corresponding to headphones when the type represented by the other terminal device type information is a headphone type. If the type represented by the aforementioned other terminal device type information is a speaker type, an icon corresponding to a speaker will be displayed. If the server determines that the audio output device indicated by the other terminal device type information received is unknown, the image indicating this unknown is an icon corresponding to a question mark. Terminal device.

11. In the terminal device according to claim 10, The aforementioned headphone-type device is at least one of headphones, earphones, headsets, earsets, head-mounted displays, bone conduction speakers, and smartphone call speakers. The speaker-type device is a speaker built into or externally connected to the terminal device or the other terminal device. Terminal device.

12. In the terminal device according to claim 9, The display unit displays an image captured by the imaging unit of the other terminal device as information of the other terminal participant. Terminal device.

13. In the terminal device according to claim 9, The display unit further displays an image captured by the imaging unit of the terminal device as the participant information of the terminal device. Terminal device.

14. In the terminal device according to claim 9, The display unit further displays icons that have been pre-registered as participant information for the terminal. Terminal device.

15. In the terminal device according to claim 9, The display unit will display the changed information about the other terminal device type on the screen if the type of audio output device being used by the other terminal device is changed. Terminal device.

16. In the terminal device according to claim 9, If the type of audio output device used by the terminal device is changed, the information transmission / reception unit transmits the changed terminal device type information to the server. Terminal device.

17. A web conferencing method executed on a terminal device, A transmission step of sending to a server information that indicates the type of audio output device used by the terminal device and information that indicates the participant using the terminal device. A receiving step of receiving from the server other terminal device type information indicating the type of audio output device used in other terminal devices and other terminal participant information indicating participants using the other terminal devices, The system includes a display step of displaying the received other terminal device type information and the other terminal participant information in association, and if the server determines that the audio output device indicated by the received other terminal device type information is unknown, it displays an image indicating that it is unknown. Web conferencing methods.

18. In the web conferencing method described in claim 17, The display step, when the type represented by the other terminal device type information is a headphone type, displays an icon corresponding to headphones. If the type represented by the aforementioned other terminal device type information is a speaker type, an icon corresponding to a speaker will be displayed. If the server determines that the audio output device indicated by the other terminal device type information received is unknown, the image indicating this unknown is an icon corresponding to a question mark. Web conferencing methods.

19. In the web conferencing method described in claim 18, The aforementioned headphone-type device is at least one of headphones, earphones, headsets, earsets, head-mounted displays, bone conduction speakers, and smartphone call speakers. The speaker-type device is a speaker built into or externally connected to the terminal device or the other terminal device. Web conferencing methods.

20. In the web conferencing method described in claim 17, The display step involves displaying an image captured by the imaging unit of the other terminal device as information of the other terminal participant. Web conferencing methods.

21. In the web conferencing method described in claim 17, The display step further displays an image captured by the imaging unit of the terminal device as the participant information of the terminal device. Web conferencing methods.

22. In the web conferencing method described in claim 17, The display step further displays an icon that has been pre-registered as participant information of the terminal. Web conferencing methods.

23. In the web conferencing method described in claim 17, If the type of audio output device used by the other terminal device is changed, the display step displays the changed type of the other terminal device on the screen. Web conferencing methods.

24. In the web conferencing method described in claim 17, If the type of audio output device used by the terminal device is changed, the transmission step transmits the changed terminal device type information to the server. Web conferencing methods.

Images