Web conference system, terminal device, and web conference method

Abstract

To provide a WEB conference system, a terminal device, and a WEB conference method, capable of reducing a risk that secret information is leaked in a WEB conference.SOLUTION: A WEB conference system 1 comprises: a WEB conference server 2; and a plurality of terminal devices 3 connected to the server. The server acquires device type information indicating a type of a sound output device in a use in the terminal device from the plurality of terminal devices, determines whether or not a voice is output from a voice output device in the used in the terminal device on the basis of the device type information of each terminal device held in the holding device, or controls a sound volume output from the terminal device. For example, a terminal device of which the type of the voice output device in the use is a headphone type is determined as a transmission destination of a voice data.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a web conference system, a terminal device, and a web conference method. [Background technology]

[0002] Various techniques for managing WEB conferences have been disclosed in the past. For example, a technique for displaying information on the screen of a WEB conference system that indicates who is speaking has been disclosed (Patent Document 1, etc.). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2003-339034 A Summary of the Invention [Problem to be solved by the invention]

[0004] In recent years, the number of employees working remotely has increased, and the number of opportunities to use web conferences has also increased. While web conferences are convenient and offer a high degree of freedom in the environment in which they are held, they also pose a higher risk of confidential information leaking. For example, if a participant in a web conference sets up a terminal device outside of a private room and outputs audio from the terminal device's speaker, the audio may be heard by unintended people nearby, and confidential information may be leaked.

[0005] Due to these circumstances, there is a need for technology that can reduce the risk of confidential information being leaked during web conferences. [Means for solving the problem]

[0006] Among the inventions disclosed in this application, a brief summary of representative inventions is as follows.

[0007] A representative embodiment is a WEB conference system including a server and a plurality of terminal devices connected to the server, the WEB conference system including a storage device that acquires and stores device type information indicating the type of audio output device in use in the terminal device from the plurality of terminal devices, a control device that determines whether to output audio from the audio output device in use in each of the terminal devices based on the device type information for each of the terminal devices stored in the storage device, or controls the volume output from the terminal device, and a transmission device that transmits the device type information for each of the terminal devices to the plurality of terminal devices, the terminal devices including a display device and a display control device that controls the display device so that the received device type information for each of the terminal devices is displayed. Features of other embodiments will be understood from the contents shown in each claim. Effect of the Invention

[0008] According to a representative embodiment, the risk of confidential information being leaked during a web conference can be reduced. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram showing a configuration of a Web conference system according to a first embodiment. [Diagram 2] FIG. 2 is a diagram illustrating a hardware configuration of a Web conference server. [Diagram 3] FIG. 2 is a diagram illustrating a hardware configuration of a terminal device. [Figure 4] FIG. 2 is a diagram showing a functional block configuration of a Web conference server. [Diagram 5] FIG. 4 is a diagram showing an example of a conference management table in the first embodiment. [Figure 6] FIG. 4 is a diagram showing an example of a participant management table in the first embodiment. [Figure 7] FIG. 13 is a diagram showing a table for explaining a method for determining a transmission destination of audio data. [Figure 8] FIG. 2 is a diagram showing a functional block configuration of a terminal device. [Figure 9] FIG. 11 is a diagram illustrating an input / output device management table; [Figure 10] FIG. 2 is a diagram showing a schematic example of a display screen of a terminal device. [Figure 11] FIG. 11 is a diagram showing a schematic example of a screen on which text is displayed. [Figure 12] FIG. 11 is a diagram showing a schematic example of a screen on which text is displayed. [Figure 13] FIG. 2 is a diagram showing an outline of a processing flow of the Web conference system according to the first embodiment. [Figure 14] FIG. 13 illustrates an example of a flow of a device management table creation process. [Figure 15] FIG. 11 is a diagram illustrating an example of a flow of a conference reservation process. [Figure 16] FIG. 11 is a diagram illustrating an example of a flow of a conference start process. [Figure 17] FIG. 11 is a diagram illustrating an example of a flow of a join / leave process. [Figure 18] FIG. 11 illustrates an example of a flow of an audio output device management process. [Figure 19] FIG. 13 illustrates an example of a flow of an individual security category setting management process. [Figure 20] FIG. 11 is a diagram illustrating an example of a flow of a video and audio distribution process. [Figure 21] FIG. 11 is a diagram illustrating an example of a flow of a conference continuation end determination process. [Figure 22] FIG. 11 is a diagram showing an example of a conference management table in the second embodiment. [Diagram 23] FIG. 11 is a diagram showing an example of a participant management table in the second embodiment. [Figure 24] FIG. 13 is a diagram showing a table for explaining a method for determining a transmission destination of audio data. [Diagram 25] FIG. 11 is a diagram showing an example of a flow of a video and audio distribution process according to the third embodiment. [Figure 26] FIG. 13 is a diagram showing a table for explaining a method for determining a target of volume reduction control. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, embodiments will be described. Note that each embodiment is an example for realizing the present invention, and does not limit the technical scope of the present invention.

[0011] In addition, in the following embodiments, components having the same functions are denoted by the same reference numerals, and repeated explanations thereof will be omitted unless particularly necessary.

[0012] (Embodiment 1) A web conference system according to a first embodiment will be described.

[0013] Overview of the Web conference system according to the first embodiment The WEB conferencing system of embodiment 1 acquires and retains device type information indicating the type of audio output device currently in use in each terminal device from multiple terminal devices, and determines whether or not to output audio from the audio output device currently in use in each terminal device based on the device type information retained for each terminal device.

[0014] Furthermore, the Web conference system according to the first embodiment determines the terminal device to which the voice data of the speaker is to be transmitted, based on the device type information for each terminal device.

[0015] <Web conferencing system hardware configuration> The configuration of the Web conference system according to the first embodiment will be described.

[0016] FIG. 1 is a diagram showing the configuration of a WEB conference system according to a first embodiment. As shown in FIG. 1, the WEB conference system 1 according to the first embodiment includes a WEB conference server 2 and a plurality of terminal devices 3. The WEB conference server 2 and the plurality of terminal devices 3 are connected via a network 4, and perform various processes in cooperation with each other while performing server-client communication. The connection to the network 4 may be either wired or wireless. The WEB conference server 2 is an example of a server in the present invention. The plurality of terminal devices 3 are an example of a plurality of terminal devices in the present invention.

[0017] The WEB conference server 2 is a computer server that executes various processes required to hold a WEB conference. The multiple terminal devices 3 are terminal devices used by multiple participants who join the WEB conference. The multiple participants include the organizer and participants other than the organizer. The terminal devices 3 are, for example, desktop personal computers, notebook computers, information processing terminals, etc. The information processing terminals are, for example, smartphones, tablet terminals, etc. The network 4 is a wide area communication network, for example, the Internet.

[0018] Fig. 2 is a diagram showing the hardware configuration of the Web conference server. As shown in Fig. 2, the Web conference server 2 has a storage 2a, a memory 2b, a processor 2c, a wireless communication unit 2d, a wired communication unit 2e, a video control unit 2f, a sound control unit 2g, an operation control unit 2h, a power control unit 2j, a display unit 2k, a camera 2m, a wireless interface (in Fig. 2, "interface" is written as "IF" for convenience) 2n, a wired interface 2p, a speaker 2r, a microphone 2s, an operation input unit 2t, and a power interface 2w. The Web conference server 2 further has a communication bus 2z. The storage 2a to the power control unit 2j constituting the Web conference server 2 are connected via the communication bus 2z and can communicate with each other.

[0019] The storage 2a stores various programs and various data. The various programs include, for example, an operating system (hereinafter also referred to as OS) A1, a web conference program (hereinafter also referred to as web conference application) A2, a device driver, and the like. The various data include, for example, a conference management table T1 for managing web conferences, a participant management table T2 for managing participants, and the like. The storage 2a is a non-volatile memory, and is configured, for example, with a solid state drive (SSD), a hard disk drive (HDD), an embedded multi media card (eMMC), universal flash storage (UFS), a secure digital (SD) card, a universal serial bus (USB) flash drive, an optical disk, and the like.

[0020] The memory 2b temporarily stores data to be processed by the processor 2c. The memory 2b is composed of, for example, a semiconductor memory such as a random access memory (RAM). The memory 2b may also be used as the storage 2a.

[0021] The processor 2c performs various arithmetic processing or various data processing. The processor 2c functions as various functional blocks by executing programs stored in the storage 2a using the memory 2b and the like. The processor 2c is composed of, for example, an MPU (Micro-Processing Unit), a CPU (Central Processing Unit), and the like. The processor 2c may also control each control unit.

[0022] The wireless communication unit 2d is connected to the wireless interface 2n. The wireless communication unit 2d converts data into an electrical signal and outputs it to the wireless interface 2n, and converts an electrical signal received by the wireless interface 2n into data. The wireless communication unit 2d is communicatively connected to an external device or an access point of the network 4 via the wireless interface 2n. The wireless communication unit 2d and the wireless interface 2n are compatible with standards such as Wi-fi (registered trademark) or Bluetooth (registered trademark), for example.

[0023] The wired communication unit 2e is connected to the wired interface 2p. The wired communication unit 2e converts data into an electrical signal and outputs it to the wired interface 2p, and converts an electrical signal received by the wired interface 2p into data. The wired communication unit 2e is communicatively connected to an external device via the wired interface 2p.

[0024] The wired interface 2p is, for example, a USB terminal, a LAN terminal, or a three- or four-terminal phone jack. The LAN terminal is compatible with standards such as 1000BASE-T, 100BASE-TX, and 10BASE-T. The phone jack is compatible with standards such as the Open Mobile Terminal Platform (OMTP) standard and the Cellular Telephone Industry Association (CTIA) standard.

[0025] The video control unit 2f is connected to the display unit 2k and the camera 2m. The video control unit 2f converts video data or image data into an electrical signal and outputs it to the display unit 2k, and converts an electrical signal received by the camera 2m into video data or image data.

[0026] The display unit 2k displays images or text information on a display screen. The display unit 2k is configured with, for example, a liquid crystal display, an organic EL (Organic Electro-Luminescence) display, a display with a touch panel, etc. The camera 2m captures an image of the operator of the WEB conference server 2.

[0027] The audio control unit 2g is connected to the speaker 2r and microphone 2s built into the WEB conference server 2. The audio control unit 2g converts audio data into an electrical signal and outputs it to the speaker 2r, and converts an electrical signal generated by the microphone 2s into audio data.

[0028] When headphones, a headset, a speaker, a microphone, or the like is connected to the wireless interface 2n or the wired interface 2p, the audio control unit 2g processes audio data in cooperation with the wireless communication unit 2d or the wired communication unit 2e. For example, the audio control unit 2g transmits audio data to the wireless communication unit 2d or the wired communication unit 2e, and the wireless communication unit 2d or the wired communication unit 2e outputs audio to the connected headphones, headset, speaker, or the like based on the received audio data. Also, for example, the wireless communication unit 2d or the wired communication unit 2e converts an electrical signal representing audio picked up by the connected headset or microphone into audio data and transmits it to the audio control unit 2g, and the audio control unit 2g processes the received audio data.

[0029] The operation control unit 2h is connected to the operation input unit 2t. The operation control unit 2h receives an operation signal inputted by the operation input unit 2t, converts it into operation data, and processes it. The operation input unit 2t is, for example, a keyboard, a mouse, a touch pad, a touch panel, or the like.

[0030] When a keyboard, mouse, touchpad, touch panel, or the like is connected to the wireless interface 2n or wired interface 2p, the operation control unit 2h processes operation data in cooperation with the wireless communication unit 2d or wired communication unit 2e. For example, the wireless communication unit 2d or wired communication unit 2e converts an electric signal representing an operation accepted by the connected keyboard, mouse, touchpad, touch panel, or the like into operation data and transmits it to the operation control unit 2h, and the operation control unit 2h processes the received operation data.

[0031] The power supply control unit 2j is connected to the power supply interface 2w. The power supply interface 2w is, for example, an inlet, i.e., a power plug. For example, power is supplied to the power supply control unit 2j by connecting the inlet to an outlet, i.e., a power outlet, that outputs AC 100V to 240V. The power supply control unit 2j converts the supplied power into DC and distributes it to each unit constituting the Web conference server 2.

[0032] Fig. 3 is a diagram showing the hardware configuration of a terminal device. As shown in Fig. 3, the terminal device 3 has a storage 3a, a memory 3b, a processor 3c, a wireless communication unit 3d, a wired communication unit 3e, a video control unit 3f, a sound control unit 3g, an operation control unit 3h, a power control unit 3j, a display unit 3k, a camera 3m, a wireless interface 3n, a wired interface 3p, a speaker 3r, a microphone 3s, an operation input unit 3t, and a power interface 3w. The terminal device 3 further has a communication bus 3z. The storage 3a to the power control unit 3j constituting the terminal device 3 are connected via the communication bus 3z and can communicate with each other. The display unit 3k is an example of a display device in the present invention.

[0033] The storage 3a through the power supply interface 3w constituting the terminal device 3 correspond to and have similar functions as the storage 2a through the power supply interface 2w constituting the WEB conference server 2. Therefore, here, a description of each function of the storage 3a through the power supply interface 3w will be omitted.

[0034] However, the storage 3a includes a browser A3 in addition to an operating system A1 and a Web conference program A2 as various programs stored therein. The storage 3a also includes an input / output device management table T3 for managing input / output devices of the terminal device 3 as various data stored therein. The terminal device 3 may also include a battery 3x. The battery 3x can supply power to each component of the terminal device 3 in place of a power source connected to the power interface 3w.

[0035] When an audio output device is connected to the wireless interface 3n or wired interface 3p of the terminal device 3, basically, the function of the connected audio output device is turned on, and the function of the audio output device built into the terminal device 3 (e.g., speaker 3r) is turned off.

[0036] In addition, when a microphone or a headset is connected to the wireless interface 3n or wired interface 3p of the terminal device 3, the function of the connected microphone or the microphone on the headset is turned on, and the function of the microphone 2s built into the terminal device 3 is basically turned off.

[0037] The camera 3m captures an image of a subject located in front of the terminal device 3. In general, the camera 3m captures an image of the face of a user who is using the terminal device 3, that is, a participant who is participating in a WEB conference, and outputs an image signal or a video signal.

[0038] <Web conferencing system functional block configuration> The following describes the functional configuration of the Web conference system 1 according to the embodiment 1. Each functional block of the Web conference server 2 and the terminal device 3 is realized by executing a predetermined program stored in its own storage using a processor, memory, etc., and by cooperating with hardware.

[0039] Fig. 4 is a diagram showing a functional block configuration of a Web conference server. As shown in Fig. 4, the Web conference server 2 has, as functional blocks, a conference management device 21, a participant management device 22, a video / audio distribution control device 23, and a server-side data processing device 24. The conference management device 21 is an example of a setting reception device in the present invention. The participant management device 22 is an example of a holding device, a request reception device, and a transmission device in the present invention. The video / audio distribution control device 23 is an example of a control device in the present invention.

[0040] The conference management device 21 creates, holds, and updates a conference management table T1. The conference management table T1 is a table that indicates the schedule or various settings of a Web conference to be held.

[0041] Fig. 5 is a diagram showing an example of a conference management table in embodiment 1. As shown in Fig. 5, the conference management table T11 has the following items: "conference ID", "date and time of holding", "conference name", "host ID", and "conference security type".

[0042] "Meeting ID" is an ID used to identify a conference, and is automatically assigned when a conference is booked. "Date and time of the conference" is information indicating the date and time of the reserved conference. "Meeting name" is the title of the conference, and can be entered or changed by anyone with the authority to book and set up conferences. "Organizer ID" is a personal ID that identifies the organizer of the conference.

[0043] "Conference security type" is an item that sets the level of confidentiality of the conference. In this embodiment, "conference security type" is set at two levels, "High" and "Normal." In the conference management table T11 shown in FIG. 5, "Normal" is omitted so that "High" can be easily seen in the "Conference security type" column.

[0044] When "High" is set in the "Conference Security Type", the confidentiality of the conference is high and a high security level is required for audio output. On the other hand, when "Normal" is set in the "Conference Security Type", the confidentiality of the conference is normal and a high security level is not required for audio output.

[0045] Setting "High" for the "conference security type" means that secure mode has been set for that conference. In a conference in which secure mode has been set, the destination of the speaker's voice data is determined to be limited to terminal devices 3 that are considered to have a low risk of information leakage due to voice output. Details of how the destination of voice data is determined will be described later. The conference management device 21 accepts the setting of the "conference security type", i.e., secure mode, for a Web conference to be held from a person who has the authority to reserve and set up a conference.

[0046] The participant management device 22 creates, holds, and updates a participant management table T2. The participant management table T2 is provided for each ongoing WEB conference and has items related to each participant participating in the WEB conference or the terminal device 3 used by the participant. The participant management device 22 obtains various information from the terminal device 3 used by the participant, i.e., the terminal device 3 connected to the WEB conference server 2, to create the participant management table T2.

[0047] Furthermore, the participant management device 22 identifies the face image or the icon registered by each participant, the name of the participant, and the type of audio output device being used by the terminal device 3 based on various information acquired from the terminal device 3 connected to the WEB conference server 2, and distributes this participant information to each terminal device 3. The participant management device 22 may distribute this information voluntarily, or in response to a request from a participant.

[0048] Fig. 6 is a diagram showing a schematic diagram of a participant management table in the first embodiment. As can be seen from the participant management table T21 shown in Fig. 6, the participant management table T2 has the following items: "host", "participant ID", "terminal ID", "audio output device in use", "type of audio output device in use", "category", "exception", and "individual security type". The contents of these items are obtained based on various data collected from each terminal device 3. The items "type of audio output device in use" and "category" are examples of device type information in the present invention. Each item of the participant management table will be explained below.

[0049] "Organizer" is an item that indicates whether or not the participant is the organizer of the Web conference. If the participant is the organizer, "◯" is set in "Organizer." The organizer can be easily identified by looking at the "Organizer" column.

[0050] "Participant ID" is an item that indicates the personal ID of a participant. Usually, the ID used when logging in to the terminal device 3 or the ID used when logging in to the WEB conference becomes the "participant ID". Participants in the WEB conference are identified based on the "participant ID".

[0051] "Terminal ID" is an item that indicates an ID unique to the terminal device 3 used by a participant. The "Terminal ID" may be, for example, an account assigned to each terminal device 3, or may be the serial number of the terminal device 3. Based on the "Terminal ID", it is identified which terminal device 3 the participant is using to participate.

[0052] "Audio output device in use" is an item indicating the name, model name, or model number of the audio output device in use in the terminal device 3. "Audio output device in use" is used, for example, to determine or check the "type of audio output device in use".

[0053] In this embodiment, audio output devices are classified into two types: the first type is a headphone type device, and the second type is a speaker type device.

[0054] A headphone-type device is a general term for devices that are designed so that the output sound is almost inaudible to those around and are considered to have a low risk of information leakage due to sound output. Examples of headphone-type devices include headphones, earphones, headsets, ear sets, head-mounted displays, bone conduction speakers, and smartphone call speakers.

[0055] A speaker-type device is a general term for devices that have a high possibility of outputting audio that can be heard by people in the vicinity, and are devices that are considered to have a high risk of information leakage due to audio output. Examples of speaker-type devices include speakers externally connected to a terminal device, speakers built into terminal devices such as personal computers or tablet terminals, and hands-free speakers of smartphones.

[0056] "Type of audio output device in use" is an item indicating the type of audio output device in use in the terminal device 3. For example, as shown in Fig. 6, the item "Type of audio output device in use" may be set to "Built-in speaker", "External speaker", "Headphone / Speaker (phone jack connection)", "Headphone", "Bone conduction headphone", "Smartphone call speaker", "Smartphone hands-free speaker", "Unknown", etc. "External speaker", "Headphone", etc. can be determined by monitoring the status of the USB connection or Bluetooth connection.

[0057] If the "audio output device in use" or "audio output device type in use" cannot be identified or is unknown, the participant management device 22 performs a process of inquiring of the participant of that terminal device 3. For example, the participant management device 22 transmits inquiry information to the terminal device 3 inquiring whether the "audio output device type in use" is a "headphone type device" or a "speaker type device". If the participant of the terminal device 3 responds to the inquiry, the participant management device 22 sets the "audio output device in use" or "audio output device type in use" item of the terminal device 3 based on the response result. On the other hand, if there is no response to the inquiry, the participant management device 22 sets the "audio output device in use" or "audio output device type in use" item to "unknown".

[0058] When the participant management device 22 detects that the "type of audio output device in use" of the terminal device 3 is unknown but is at least connected via a phone jack, it sets the "type of audio output device in use" item to "headphones / speakers (phone jack connection)." "Headphones / speakers (phone jack connection)" means that the device is either headphones or speakers connected via the phone jack terminal of the terminal device 3.

[0059] In addition, when the participant management device 22 detects that an input / output device, particularly an audio output device, has been externally connected to the terminal device 3, the participant management device 22 obtains device information of the externally connected input / output device from the terminal device 3 and updates the participant management table T2.

[0060] In addition, a participant may voluntarily send information indicating the content to be set in the "Audio output device in use" or "Type of audio output device in use" field to the WEB conference server 2 by operating his / her own terminal device 3.

[0061] "Classification" is a classification determined according to the "type of audio output device in use" and is an item that indicates the security level related to audio output. In this embodiment, "classification" is set to two levels, "1" and "2." "1" is a high security level and "2" is a low security level. If the "type of audio output device in use" is the above-mentioned "headphone type device," "classification" is set to "1." On the other hand, if the "type of audio output device in use" is the above-mentioned "speaker type device," "classification" is set to "2."

[0062] "Exception" is an item that indicates whether or not the device will be treated exceptionally when determining the destination of the audio data. "Exception" is set to "O" when the device will be treated exceptionally. A terminal device 3 with an "Exception" of "O" will be treated the same as a terminal device 3 with a "Classification" of "1" when determining the destination of the audio data. For example, if the "conference security type" is "High", even if the "Classification" of the audio output device in use is "2", the terminal device 3 will be included in the destination of the audio data.

[0063] Even if the "type of audio output device in use" of the terminal device 3 is a speaker-type device, the terminal device 3 may be placed in a safe environment where the audio is unlikely to be heard by anyone other than the participants. For example, a designated company employee may participate in a WEB conference in a company conference room using a single personal computer as the terminal device 3 and outputting audio from an externally connected speaker. In addition, a participant may participate in a WEB conference in a private room at home using a smartphone as the terminal device 3 and outputting audio from a hands-free speaker built into the smartphone. In such a case, even if the terminal device 3 has a "classification" of "2", there is no problem in treating it as a terminal device 3 having a "classification" of "1". The "exception" is provided assuming such a situation.

[0064] A method of setting an "exception" will be described. An "exception" is basically set based on a request from a participant. When a participant is in a safe environment and wants his / her terminal device 3 to be treated equally to a terminal device 3 with a "classification" of "1", he / she performs an operation on his / her terminal device 3 to request the setting of "exception" to "o". This operation transmits a request signal for setting "exception" to "o" to the participant management device 22 of the WEB conference server 2. In response to the received request signal, the participant management device 22 accepts the request and transmits an inquiry signal to the host's terminal device 3 to inquire whether or not to permit the setting of "exception" to "o". Based on the received inquiry signal, the host's terminal device 3 executes a process of inquiring of the host as to whether or not to permit the setting of "exception" to "o". When the host performs an operation to permit the setting of "exception" to "o" on the host's terminal device 3, an authorization signal is transmitted to the participant management device 22 of the WEB conference server 2, and the "exception" item of the terminal device 3 that transmitted the request signal is set to "o".

[0065] "Individual security type" is an item for setting the security level of the audio output when audio data corresponding to the speaker's voice input to the terminal device 3 is distributed to the terminal devices 3 of the other participants. In this embodiment, the "individual security type" is set at two levels, "High" and "Normal." In the participant management table T21 shown in FIG. 6, the display of "Normal" is omitted in the "individual security type" column so that the display of "High" is easier to see.

[0066] When a participant speaks using a terminal device 3 with an "individual security type" of "High", even if the "conference security type" is "Normal", the destination of the speaker's voice data is limited to terminal devices 3 with a "classification" of "1" or an "exception" of "○". In other words, the voice data is distributed only to terminal devices 3 with high security regarding voice output. Therefore, the "individual security type" is an effective setting when a participant temporarily makes a highly confidential statement.

[0067] A method for setting the "individual security type" will now be described. The "individual security type" is basically set based on a request from a participant. When a participant wants his / her remarks to be delivered only to other participants with a high security level for audio output, he / she performs an operation on his / her own terminal device 3 to request that the "individual security type" be set to "High". This operation causes a request signal for setting the "individual security type" to "High" to be sent to the participant management device 22 of the Web conference server 2. In response to the received request signal, the participant management device 22 accepts the request and sends an inquiry signal to the terminal device 3 of the organizer to inquire whether or not to allow the "individual security type" to be set to "High".

[0068] Based on the received inquiry signal, the host's terminal device 3 executes a process to inquire of the host as to whether or not to permit the "High" setting of the "individual security type." When the host performs an operation on the host's terminal device 3 to permit the "High" setting of the "individual security type," a permission signal is sent to the participant management device 22 of the Web conference server 2, and the "individual security type" item of the terminal device 3 that sent the request signal is set to "High."

[0069] Furthermore, if a participant wishes to cancel the "High" setting of the "individual security type" and return it to "Normal," the participant performs an operation on his / her own terminal device 3 to request that the "individual security type" be set to "Normal." This operation causes a request signal for setting the "individual security type" to "Normal" to be sent to the organizer's terminal device 3 via the participant management device 22 of the WEB conference server 2. When the organizer performs an operation on the organizer's terminal device 3 to permit the "Normal" setting, the "individual security type" of the terminal device 3 that sent the request signal is set to "Normal."

[0070] Regarding the settings of "exception" and "individual security type", the procedure for permission by the organizer may be omitted and all requests from participants may be automatically approved. Also, even if there is no request from a participant, the organizer may set "exception" or "individual security type" for a specific terminal device 3 at his / her own discretion.

[0071] The video and audio distribution control device 23 distributes video data received from the terminal device 3 of a participant who has the right to share the video to the terminal devices 3 of all participants in principle. The video and audio distribution control device 23 also manages whether any participant has the right to share the video. The destination of the video data may be determined by the organizer, or may be limited to the terminal devices 3 of participants who are considered to have a low risk of information leakage via the video. For example, a terminal device 3 where the location of a participant's terminal device 3 is unknown and the video output device is set to a projector may be excluded from the destination of the video data.

[0072] In addition, the video and audio distribution control device 23 determines a destination of the audio data received from the terminal device 3 of the speaker based on the conference management table T1 and the participant management table T2, and distributes the audio data only to the determined destination. The method of determining the destination will be specifically described below.

[0073] FIG. 7 is a diagram showing a table for explaining a method of determining a destination of audio data. As can be understood from the audio data destination determination table DT1 shown in FIG. 7, the video and audio distribution control device 23 determines a destination of audio data based on a setting of the "conference security type" and a setting of the "individual security type" of the speaker. In principle, when the "conference security type" in the conference management table T1 is "High", the video and audio distribution control device 23 limits the destination of the speaker's audio data to terminal devices 3 whose "classification" in the participant management table T2 is "1" or whose "exception" is "○". In addition, in principle, when the "conference security type" in the conference management table T1 is "Normal", the video and audio distribution control device 23 determines the destination of the speaker's audio data to all terminal devices 3.

[0074] However, as described above, if the "individual security type" of the speaker in the participant management table T2 is set to "High," this setting takes precedence, and the destination of the speaker's voice data is limited to terminal devices 3 whose "classification" in the participant management table T2 is "1" or whose "exception" is "○." In other words, if the "individual security type" of the speaker in the participant management table T2 is set to "Normal," the destination of the speaker's voice data is determined according to the "conference security type" in the conference management table T1.

[0075] The server-side data processing device 24 performs processes performed by the WEB conference server other than the processes performed by the conference management device 21, the participant management device 22, and the video / audio distribution control device 23. The server-side data processing device 24 performs, for example, processes related to the terminal device 3 joining / leaving a WEB conference, processes related to the sending and receiving of video data or audio data, and processes related to the opening / closing of a WEB conference.

[0076] Fig. 8 is a diagram showing a functional block configuration of a terminal device. As shown in Fig. 8, the terminal device 3 has, as functional blocks, an input / output device management device 31, a video / audio input / output control device 32, a display control device 33, and a terminal-side data processing device 34. The display control device 33 is an example of the display control device in the present invention.

[0077] The input / output device management device 31 manages information related to the input / output devices of its own terminal device. The input / output device management device 31 holds, for example, an input / output device management table.

[0078] Fig. 9 is a diagram showing an example of an input / output device management table. As can be seen from the input / output device management table T31 shown in Fig. 9, the input / output device management table T3 has, for example, items such as "device type", "device ID", "audio / video input / output device type", and "currently in use".

[0079] "Model type" is an item indicating the type of audio or video input / output device built into or connected to the terminal device 3. For example, "audio input," "audio output," "video input," "video output," etc. are set as "model type."

[0080] "Device ID" is an item indicating an ID unique to an audio or video input / output device built into or connected to the terminal device 3. For example, a pre-assigned ID or a serial number is set in the "device ID".

[0081] The "audio / video input / output device type" is an item indicating whether the audio or video input device is built-in, externally connected, headphone type, speaker type, etc. In the "audio / video input / output device type", for example, "headphone / speaker (phone jack connection)", "headphone (USB connection)", "headphone (Bluetooth connection)", "built-in speaker", "speaker (Bluetooth connection)", "speaker (USB connection)", "bone conduction headphones", "head mounted display", "built-in microphone", "built-in display", etc. are set. In the case where the terminal device 3 is a smartphone, the "audio / video input / output device type" is also set to "smartphone call speaker", "smartphone hands-free speaker", etc.

[0082] "Currently in use" is an item that indicates whether or not an input / output device is currently being used. "O" is set in the "Currently in use" item corresponding to an input / output device that is in use. Nothing is set in the "Currently in use" item corresponding to an input / output device that is not in use, or "-" or "X" is set.

[0083] The organizer or participant can identify the audio / video input / output devices available and the audio / video input / output devices currently in use in the terminal device 3 by referring to the input / output device management table T3 in the terminal device 3. The participant management device 22 of the WEB conference server 2 can obtain information from the input / output device management table T3 in the terminal device 3 and create the participant management table T2.

[0084] The information in the input / output device management table T3 may be sent spontaneously by the terminal device 3 to the WEB conference server 2, or the WEB conference server 2 may collect it from the terminal device 3. In addition, if there is a change in the contents of the input / output device management table T3, the changed contents are reflected in the participant management table T2. For example, the WEB conference server 2 may periodically refer to the input / output device management table T3 of each terminal device 3 and read the information. In addition, for example, if there is a change in the contents of the input / output device management table T3 in the terminal device 3, the terminal device 3 may send the changed contents to the WEB conference server 2.

[0085] When video data is received from the WEB conference server 2, the video audio input / output control device 32 controls the video output device in use so that video corresponding to the video data is displayed. When video is input to the video input device in use, for example, when a setting is made to share the screen with participants of the WEB conference, or when a subject is captured by a camera, the video audio input / output control device 32 transmits video data corresponding to the input video to the WEB conference server 2.

[0086] Furthermore, when audio data is received from the WEB conference server 2, the video and audio input / output control device 32 controls the audio output device in use so as to output audio corresponding to the audio data. Furthermore, when audio is input to an audio input device in use, the video and audio input / output control device 32 transmits audio data corresponding to the input audio to the WEB conference server 2.

[0087] The display control device 33 controls the display unit 3k so that images or text information related to the WEB conference are displayed during the WEB conference. Data corresponding to the content displayed on the display unit 3k is acquired from the WEB conference server 2. Examples of the content to be displayed include videos or images shared with participants in the WEB conference, information related to the operation of the WEB conference, and information related to the participants of the WEB conference.

[0088] Fig. 10 is a diagram showing an example of a display screen of a terminal device. In the display screen D11 shown in Fig. 10, for example, an "operation menu area" R1 is displayed at the top of the screen, a "video display area" R2 is displayed at the center left of the screen, and a "participant information area" R3 is displayed at the center right of the screen. In the "participant information area" R3, columns for "participant", "name", and "audio output" are provided for each participant.

[0089] The "Participant" field displays an image (usually an image of the participant's face) captured by the camera of the participant's terminal device 3. The "Participant" field may display an image or icon that the participant has registered in advance in association with the participant ID.

[0090] The "Name" field displays the name of the participant. The "Name" field may be a name associated with the personal ID used by the participant when logging in to the terminal device 3, or may be a name entered by the participant when joining the web conference.

[0091] In the "audio output" column, an icon corresponding to the "type of audio output device in use" of the participant's terminal device 3 is displayed. If the "type of audio output device in use" is a "speaker type device", an icon corresponding to a speaker, for example, an icon including an image imitating the shape of a speaker, is displayed. If the "type of audio output device in use" is a "headphone type device", an icon corresponding to headphones, for example, an icon including an image imitating the shape of headphones, is displayed. If the "type of audio output device in use" is unknown, an icon corresponding to unknown, for example, an icon including an image representing a question mark, is displayed.

[0092] Furthermore, the display control device 33 controls the display unit 3k to display text indicating a warning, caution, status, or the like on the screen based on a control signal or data acquired from the WEB conference server 2. The control signal is, for example, a control signal for displaying the text. The data is, for example, data indicating that the terminal device 3 that received the data is not a destination of audio data, or data including only video data out of video data and audio data (data indicating that the terminal device 3 is not a destination of audio data). The text displayed on the screen is, for example, a message indicating that audio is being distributed only to terminal devices whose audio output device is a headphone-type device, or a message urging the user to switch the audio output device to a headphone-type device. Alternatively, it may be, for example, a message informing the user that the terminal device 3 is not a destination of audio distribution.

[0093] 11 and 12 are diagrams showing examples of screens on which text is displayed. For example, a message C1 in a display screen D12 shown in FIG. 11 displays "Audio is being distributed only to terminal devices whose audio output device is a 'headphone type device'." Another message C2 in a display screen D13 shown in FIG. 12 displays "Please switch the audio output device to a 'headphone type device.'"

[0094] In addition, when the WEB conference server 2 has a function of converting voice into text and outputs the text data converted from the voice to a terminal device, the display control device 33 may control the display unit to display the text converted from the voice, i.e., subtitles, on the screen.

[0095] The terminal-side data processing device 34 performs processes among those performed by the terminal device 3, other than the processes performed by the input / output device management device 31, the video / audio input / output control device 32, and the display control device 33. The terminal-side data processing device 34 performs, for example, processes related to logging in the terminal device 3, processes related to sending and receiving audio data of comments from the terminal device 3, and processes related to joining and leaving a WEB conference.

[0096] <Processing flow of the Web conference system according to the first embodiment> The process flow of the Web conference system according to the first embodiment will be described.

[0097] Fig. 13 is a diagram showing an outline of the processing flow of the WEB conference system according to the first embodiment. As shown in Fig. 13, the WEB conference system 1 includes steps S1 to S9 as an outline of the processing flow. Note that the processing flow is simplified so that the processing executed by the WEB conference system 1 can be easily understood. Therefore, in reality, various processes may be executed in a complex manner by server-client communication between the WEB conference server 2 and multiple terminal devices 3. For example, some processes may be executed in parallel, and some processes may be routinely executed repeatedly.

[0098] S1: Device management table creation process In step S1, a device management table creation process is executed.

[0099] 14 is a diagram showing an example of a flow of the device management table creation process. As shown in FIG 14, the device management table creation process in step S1 includes steps S11 to S12.

[0100] In step S11, the input / output device management device 31 of each terminal device 3 of the organizer and participants collects device information about input / output devices built into the terminal device 3 itself or externally connected thereto.

[0101] In step S12, the input / output device management unit 31 of each terminal device 3 creates an input / output device management table T3 based on the collected device information. This completes the device management table creation process in step S1.

[0102] The device management table creation process is usually executed automatically after the OS of the terminal device 3 is started up. However, the device management table creation process may be executed in response to an operation of the terminal device 3 by a user.

[0103] S2: Conference reservation processing In step S2, a conference reservation process is executed.

[0104] 15 is a diagram showing an example of a flow of a conference reservation process. As shown in FIG. 15, the conference reservation process in step S2 includes steps S21 to S28.

[0105] In step S21, the terminal side data processing device 34 of the terminal device used by the organizer starts up a conference application or a browser based on the operation of the organizer.

[0106] In step S22, the terminal side data processor 34 accepts an input of a desired date and time for the Web conference to be held based on an operation by the organizer.

[0107] In step S23, the terminal side data processor 34 accepts input of the conference security type of the Web conference to be held based on the operation of the organizer.

[0108] In step S24, the terminal side data processor 34 transmits to the Web conference server 2 a conference reservation request signal for requesting a conference reservation based on the input date and time and conference security type.

[0109] In step S25, the conference management device 21 of the Web conference server 2 receives the conference reservation request signal and accepts the request.

[0110] In step S26, the conference management device 21 writes the conference reservation in the conference management table T1 based on the received conference reservation request signal, and updates the conference management table T1.

[0111] In step S27, the conference management device 21 transmits a reservation completion notice to the terminal device 3 of the organizer.

[0112] In step S28, the terminal side data processing device 34 in the terminal device 3 of the organizer receives the reservation completion notification. This ends the conference reservation process in step S2.

[0113] In the above embodiment, the organizer makes a conference reservation request using the organizer's terminal device 3. However, a participant who has the authority to make a conference reservation may make a conference reservation request using his / her own terminal device 3.

[0114] S3: Conference start process In step S3, a conference start process is executed.

[0115] 16 is a diagram showing an example of a flow of a conference start process. As shown in FIG 16, the conference start process in step S3 includes steps S31 to S35.

[0116] In step S31, the terminal data processing device 34 in the terminal device 3 of the organizer or participant determines whether or not an operation has been performed to request the first conference participation by a participant or a conference to be held by the organizer. If it is determined that such an operation has been performed (S31: Yes), the process proceeds to step S32. On the other hand, if it is determined that such an operation has not been performed (S31: No), the process returns to step S31.

[0117] In step S32, the terminal side data processor 34 transmits to the Web conference server 2 a conference opening request signal or a conference participation request signal in response to the above operation.

[0118] In step S33, the server-side data processing device 24 of the Web conference server 2 receives the conference opening request signal or the conference participation request signal.

[0119] In step S34, the server side data processing device 24 sets up a virtual WEB conference room on the network 4.

[0120] In step S35, the server side data processor 24 starts the conference management process, and then proceeds to step S44 in the join / leave request process.

[0121] S4: Join / Leave Processing In step S4, the join / leave process is executed.

[0122] Fig. 17 is a diagram showing an example of the flow of the join / leave process. As shown in Fig. 17, the join / leave process in step S4 includes steps S41 to S410.

[0123] In step S41, the terminal data processing device 34 in the terminal device 3 of the organizer or participant determines whether or not a join or leave operation has been performed. If it is determined that the operation has been performed (S41: Yes), the process proceeds to step S42. On the other hand, if it is determined that the operation has not been performed (S41: No), the join / leave process ends.

[0124] In step S42, the terminal side data processor 34 transmits a join / leave request signal to the Web conference server 2.

[0125] In step S43, the server side data processor 24 of the Web conference server 2 receives the join / leave request signal, that is, accepts the join / leave request.

[0126] In step S44, the server-side data processor 24 judges whether the received signal is a participation request signal, i.e., whether the participation request has been accepted. If it is judged that the signal is a participation request signal (S44: Yes), the process proceeds to step S45. On the other hand, if it is judged that the signal is not a participation request signal, i.e., a withdrawal request signal (S44: No), the process proceeds to step S47.

[0127] In step S45, the server-side data processor 24 transmits to the terminal device 3 a request signal for requesting input / output device information.

[0128] In step S46, the terminal device 3 transmits its own input / output device information to the Web conference server 2 in response to the request signal.

[0129] In step S47, the participant management device 22 of the Web conference server 2 updates the participant management table T2 based on the received input / output device information.

[0130] In step S48, the server-side data processing device 24 transmits a join / leave completion notification to the joining / leaving terminal device 3. In addition, the server-side data processing device 24 distributes the updated participant information to the terminal devices 3 of all participants.

[0131] In step S49, the terminal side data processor 34 of the joining / leaving terminal receives (acquires) the joining / leaving completion notification.

[0132] In step S410, the terminal side data processing devices 34 in the terminal devices 3 of all the participants receive (acquire) the updated participant information. Also, the display control devices 33 in the terminal devices 3 of all the participants update the display of the "participant information area" R3 on the display screen D11 of the terminal device 3 based on the received updated participant information. This ends the join / leave process of step S4.

[0133] S5: Audio output device management process In step S5, an audio output device management process is executed.

[0134] Fig. 18 is a diagram showing an example of a flow of an audio output device management process. As shown in Fig. 18, the audio output device management process in step S5 includes steps S51 to S58.

[0135] In step S51, the input / output device management device 31 in the terminal device 3 of the organizer or participant determines whether or not there has been a change in the audio output device being used in the terminal device itself. If it is determined that there has been a change (S51: Yes), the process proceeds to step S52. On the other hand, if it is determined that there has not been a change (S51: No), the audio output device management process ends.

[0136] In step S52, the input / output device management device 31 updates the input / output device management table T3 of its own terminal device 3 so as to reflect the change.

[0137] In step S53, the input / output device management device 31 transmits change information indicating the change content to the Web conference server 2.

[0138] In step S54, the participant management device 22 of the Web conference server 2 receives the change information.

[0139] In step S55, the participant management device 22 updates the participant management table T2 based on the received change information.

[0140] In step S56, the server-side data processing device 24 distributes device change information indicating the terminal device whose audio output device in use has been changed and the details of the change to all terminal devices 3 based on the updated participant management table T2.

[0141] In step S 57 , the terminal side data processors 34 in the terminal devices 3 of all the participants receive the changed device information distributed from the Web conference server 2 .

[0142] In step S58, the display control devices 33 in the terminal devices 3 of all the participants update the display of the "audio output" column in the "participant information area" R3 of the display screen D11 based on the received changed device information. This ends the audio output device management process in step S5.

[0143] S6: Individual security classification setting management process In step S6, an individual security category setting management process is executed.

[0144] Fig. 19 is a diagram showing an example of a flow of the individual security category setting management process. As shown in Fig. 19, the individual security category setting management process in step S6 includes steps S61 to S69.

[0145] In step S61, the terminal side data processing device 34 of the participant's terminal device 3 determines whether or not an operation for requesting setting of an "individual security type" has been performed on its own terminal device 3. If it is determined that such an operation has been performed (S61: Yes), the process proceeds to step S62. On the other hand, if it is determined that such an operation has not been performed (S61: No), the individual security type setting management process ends.

[0146] In step S62, the terminal-side data processing device 34 of the terminal device 3 on which the operation was performed transmits a setting change request signal for requesting a change in the setting of the individual security type to the Web conference server 2. For example, a setting change request signal is transmitted requesting that the setting of "individual security type" be changed from "Normal" to "High."

[0147] In step S63, the participant management device 22 of the Web conference server 2 receives the setting change request signal sent in step S62, that is, accepts the setting request.

[0148] In step S64, the participant management device 22 transmits an inquiry signal to the terminal device 3 of the organizer as to whether or not the setting change is acceptable.

[0149] In step S65, the terminal data processing device 34 in the terminal device 3 of the organizer makes an inquiry to the organizer about whether or not the setting change is acceptable based on the received inquiry signal. For example, the terminal data processing device 34, in cooperation with the display control device 33, displays text such as "Participant AAAAA is requesting that the individual security type be set to High. Do you want to allow this? (Yes / No)" on the screen of the terminal device 3. If the organizer allows the setting change, the organizer virtually presses the "Yes" button, and if not, the organizer virtually presses the "No" button. In response to this operation, the terminal data processing device 34 transmits availability response information indicating the availability response to the participant management device 22 of the WEB conference server 2.

[0150] In step S66, the participant management device 22 receives the yes / no answer information and determines whether the answer to the setting change request is permission or no. If it is determined that the request is permission (S66: Yes), the process proceeds to step S67. On the other hand, if it is determined that the request is no permission (S66: No), the process proceeds to step S68.

[0151] In step S67, the participant management device 22 sets the "individual security type" of the terminal device 3 of the participant who requested the setting change to "High" and updates the participant management table T2, and then proceeds to step S68.

[0152] In step S68, the participant management device 22 notifies the terminal device 3 of the participant who has requested the setting change of the yes / no response result from the organizer.

[0153] In step S69, the terminal side data processing device 34 of the terminal device 3 of the participant who requested the setting change receives the notification of the yes / no answer result, and the display control device 33 of the terminal device 3 displays the yes / no answer result on the screen. This ends the individual security category setting management process of step S6.

[0154] S7: Audio and video distribution processing In step S7, a video and audio distribution process is executed.

[0155] Fig. 20 is a diagram showing an example of a flow of the video and audio distribution process. As shown in Fig. 20, the video and audio distribution process in step S7 includes steps S71 to S76.

[0156] In step S71, the video / audio input / output control device 32 in the speaker's terminal device 3 converts the speaker's voice into audio data via audio input devices such as a microphone and an AD converter, and transmits it to the WEB conference server 2. Also, the video / audio input / output control device 32 in the video provider's terminal device 3 converts the video to be provided to and shared with participants, for example, a slide image or the like displayed on the screen of its own terminal device 3, into video data and transmits it to the WEB conference server 2.

[0157] In step S72, the video / audio distribution control device 23 of the Web conference server 2 receives the video data from the terminal device 3 of the video provider, and receives the audio data from the terminal device 3 of the speaker.

[0158] In step S73, the video and audio distribution control device 23 determines the terminal device 3 to which the audio data is to be transmitted, based on the contents of the conference management table T1 and the participant management table T2. The video and audio distribution control device 23 determines the destination of the audio data, particularly based on the setting of the "conference security type" in the conference management table T1, or the "type of audio output device in use" or "classification" in the participant management table T2.

[0159] For example, when the "conference security type" is set to "High", the video and audio distribution control device 23 determines the destination of audio data to be a terminal device 3 with "classification" set to "1". In other words, when the secure mode is set for the ongoing Web conference, the video and audio distribution control device 23 determines the destination to be limited to terminal devices 3 whose audio output device type is a headphone type.

[0160] Also, for example, when the "individual security type" of the speaker is set to "High", the video and audio distribution control device 23 determines the destination of the audio data to be a terminal device 3 with "classification" set to "1". In other words, when the permission of secure transmission is set for the terminal device 3, the video and audio distribution control device 23 determines the destination of the audio data to be limited to terminal devices 3 whose audio output device in use is a headphone type.

[0161] In step S74, the video / audio distribution control device 23 distributes the video data to all of the participants' terminal devices 3. In addition, the video / audio distribution control device 23 distributes the speaker's audio data to the terminal device 3 that is the destination determined in step S73.

[0162] In step S75, the video / audio input / output control device 32 of each terminal device 3 receives the video data or audio data distributed from the WEB conference server 2. In addition, the video / audio input / output control device 32, in cooperation with the display control device 33, controls the display unit 3k to display text indicating a warning, caution, status, etc. on the screen based on the control signal or data acquired from the WEB conference server 2. In a terminal device 3 that has not received audio data, the text displayed on the screen may be, for example, a message indicating that audio is being distributed only to terminal devices whose audio output device is a headphone-type device, a message urging the user to switch the audio output device to a headphone-type device, or a message informing the user that the terminal device itself has been removed from the audio distribution destination.

[0163] In step S76, the video / audio input / output control device 32 of each terminal device 3 cooperates with the display control device 33 to display the video represented by the received video data on the screen of the display unit 3k. Also, the video / audio input / output control device 32 of each terminal device 3 controls the audio output device in use in its own terminal device 3 to output the audio represented by the received audio data. This ends the video / audio distribution process of step S7.

[0164] In a web conference, there is not always only one speaker, and it is possible that multiple participants may speak at the same time. When multiple participants speak at the same time, each voice is divided into very short segments, converted into audio data, and distributed in rotation, making it appear as if the voices of multiple speakers are being distributed almost simultaneously.

[0165] S8: Conference Continuation End Decision Process In step S8, a conference continuation end determination process is executed.

[0166] 21 is a diagram showing an example of a flow of the conference continuation end decision process. As shown in FIG 21, the conference continuation end decision process includes steps S81 to S86.

[0167] In step S81, the terminal side data processing device 34 in the terminal device 3 of the organizer determines whether or not an operation to request the end of the conference has been performed. If it is determined that the operation has been performed (S81: Yes), the process proceeds to step S82. On the other hand, if it is determined that the operation has not been performed (S81: No), the conference continuation end decision process ends.

[0168] In step S82, the terminal data processing device 34 of the terminal device 3 of the organizer transmits to the Web conference server 2 conference end request information indicating a request to end the conference.

[0169] In step S83, the server side data processing device 24 of the Web conference server 2 receives the conference end request information.

[0170] In step S84, in response to the reception of the conference end request information by the server-side data processing device 24, the conference management device 21 of the Web conference server 2 decides to end the ongoing Web conference. The conference management device 21 also ends the conference management process, deletes the schedule of the ongoing Web conference from the conference management table T1, and updates the conference management table T1.

[0171] In step S85, the server side data processor 24 transmits a conference end notification to the terminal devices 3 of all the participants.

[0172] In step S86, the terminal side data processing device 34 in the terminal device 3 of each participant receives the conference end notification, and in cooperation with the display control device 33, displays an image or text notifying the end of the conference on the screen. This completes the conference continuation end decision process in step S8.

[0173] S9: Meeting End Determination Process In step S9, a conference end determination process is executed. Specifically, the conference management device 21 of the Web conference server 2 determines whether the conference has ended. If it is determined that the conference has ended (S9: Yes), the Web conference system process ends. On the other hand, if it is determined that the conference has not ended (S9: No), the process returns to step S4 and the Web conference system process continues.

[0174] Effects of the Web conference system according to the first embodiment As described above, according to the WEB conference system of the first embodiment, in the video and audio distribution process of step S7, particularly in step S73, the destination of the audio data is limited to the terminal device whose audio output device is a headphone type. This limits the destination of the audio data that is likely to include confidential information to the terminal device in the environment where the risk of the audio being heard by an unintended person is low, thereby reducing the risk of confidential information leaking in the WEB conference.

[0175] For example, even if a participant in a web conference forgets that the audio output device of the terminal device is set to the built-in speaker and ends up participating in a web conference in a public place, there is no need to worry about audio being unintentionally output and confidential information being overheard by others. Also, for example, if participants are aware that the web conference system is equipped with such a safety function, they will no longer be concerned about information leaks, and will be able to maintain good mental health.

[0176] Furthermore, according to the Web conference system of the first embodiment, whether or not to limit the destination of the voice data is determined depending on the set "conference security type," so whether or not to limit the destination of the voice data can be selected depending on the level of confidentiality of the Web conference. For example, if the confidentiality of the Web conference is low, the output destination of the voice data is not limited, reducing the burden on the participants of the Web conference.

[0177] In addition, according to the WEB conference system of the first embodiment, in a terminal device whose "used audio output device type" is a speaker type device and is not included in the destination of audio data, information is output that audio distribution is limited to terminal devices whose "used audio output device type" is a headphone type device. Alternatively, in a terminal device whose "used audio output device type" is a speaker type device and is not included in the destination of audio data, information is output that prompts switching the audio output device in use to a headphone type device. Therefore, for a participant using a terminal device that does not output audio due to the limitation of the output destination of audio data, it is possible to show the reason why audio is not output and to make the participant understand the measures to be taken to output audio.

[0178] A WEB conference system according to another embodiment will be described below. The WEB conference system according to the other embodiment has the same hardware configuration and function block configuration as the WEB conference system 1 according to the first embodiment. On the other hand, in the WEB conference system according to the other embodiment, some of the processes executed by the function blocks and some of the data handled by the function blocks are different from those in the first embodiment. Therefore, in the following embodiment, the description of the configuration of the WEB conference system will be omitted, and the description will focus on the differences from the first embodiment with respect to the processes executed by the function blocks and the data handled by the function blocks.

[0179] (Embodiment 2) Overview of the Web conference system according to the second embodiment In the first embodiment, the items "conference security type" in the conference management table, and "classification" and "individual security type" in the participant management table T2 are each set at two levels. In the second embodiment, the items "conference security type", "classification", and "individual security type" are each set at three levels. Each of the functional blocks constituting the Web conference server 2 and the terminal device 3 executes processing according to the three levels set for "conference security type", "classification", and "individual security type". Details of the processing executed by the functional blocks and the data handled by the functional blocks are explained below.

[0180] Functional blocks of the web conference system according to the second embodiment Fig. 22 is a diagram showing an example of a conference management table in the second embodiment. As shown in the conference management table T12 shown in Fig. 22, the "conference security type" is set at three levels: "High", "Middle", and "Normal". In the "conference security type" setting, the level of security required when outputting audio data is "High" corresponding to "high", "Middle" corresponding to "slightly high", and "Normal" corresponding to "normal".

[0181] FIG. 23 is a diagram showing a schematic view of a participant management table in the second embodiment. As shown in the participant management table T22 shown in FIG. 23, the item of "classification" determined according to the type of audio output device in use is set to three levels of "1", "2", and "3". The level of security regarding the audio output of the audio output device in use is set to three levels of "High", "Middle", and "Normal". In the participant management table T22 shown in FIG. 23, the display of "Normal" is omitted so that the display of "High" and "Middle" in the "individual security type" column is easy to see. The level of security required when outputting audio data is set to "High" corresponding to "High", "Middle" corresponding to "Slightly high", and "Normal" corresponding to "Normal".

[0182] When setting the conference management table T1, the conference management device 21 sets the "conference security type" as one of three options: "High," "Middle," and "Normal." The "conference security type" is set according to an operation by the organizer or a person with authority equivalent to that of the organizer.

[0183] Fig. 24 is a diagram showing a table for explaining a method for determining a destination of audio data. As can be seen from the audio data destination determination table DT2 shown in Fig. 24, the video and audio distribution control device 23 determines a destination of audio data based on the setting of the "conference security type" and the setting of the "individual security type" of the speaker.

[0184] When the "conference security type" in the conference management table T1 is "High", the video and audio distribution control device 23 limits the destination of the speaker's voice data to terminal devices 3 having a "classification" of "1" in the participant management table T2.

[0185] Furthermore, when the "conference security type" in the conference management table T1 is "Middle", the video and audio distribution control device 23 in principle limits the destination of the speaker's voice data to terminal devices 3 whose "classification" in the participant management table T2 is "1" or "2" or whose "exception" is "○". However, when the speaker's "individual security type" is "High", the destination of the speaker's voice data is limited to terminal devices 3 whose "classification" in the participant management table T2 is "1".

[0186] Furthermore, when the "conference security type" in the conference management table T1 is "Normal", the video and audio distribution control device 23 determines, in principle, that the destination of the speaker's voice data is all terminal devices 3. However, when the speaker's "individual security type" is "High", the destination of the speaker's voice data is limited to terminal devices 3 whose "classification" in the participant management table T2 is "1". When the speaker's "individual security type" is "Middle", the destination of the speaker's voice data is limited to terminal devices 3 whose "classification" in the participant management table T2 is "1" or "2", or whose "exception" is "○".

[0187] Effects of the Web conference system according to the second embodiment As described above, according to the WEB conferencing system of the above-mentioned embodiment 2, the settings for "conference security type," "classification," and "individual security type" can be set at three levels, thereby enabling more precise control over determining the destination of audio data.

[0188] (Embodiment 3) Overview of the Web conference system according to the third embodiment In the WEB conference system of embodiment 3, a WEB conference server acquires and stores device type information indicating the type of audio output device currently in use on each terminal device 3 from multiple terminal devices 3, and controls the volume of audio from the audio output device currently in use on each terminal device 3 based on the device type information stored for each terminal device 3.

[0189] In the second embodiment, the video / audio distribution control device 23 limits the destination of the audio data based on the "conference security type" in the conference management table T1 and the "individual security type", "classification", and "exception" in the participant management table T2. On the other hand, in the third embodiment, the video / audio distribution control device 23 determines the terminal device 3 to be subjected to the volume reduction control so that the volume of the output audio is lower than the first volume level set in advance based on the "conference security type", the "individual security type", the "classification", and the "exception". The first volume level is, for example, a volume level at which the output audio can be heard but cannot be clearly heard unless one is in the vicinity of the audio output device. For example, when the settable volume level is within the range of 0 to 10, the first volume level can be considered to be about 1 to 3. Also, for example, the first volume level can be considered to be 40 to 70% of the currently set volume level.

[0190] <Function blocks and processing flow of the Web conference system according to the third embodiment> When setting up the conference management table, the conference management device 21 sets up three levels of "conference security type" as options: "High," "Middle," and "Normal."

[0191] In the third embodiment, the contents of the video and audio distribution process in step S7 in the Web conference system process flow shown in FIG. 9 are partially different.

[0192] Fig. 25 is a diagram showing an example of the flow of video and audio distribution processing according to embodiment 3. As shown in Fig. 25, the video and audio distribution processing in step S7a according to embodiment 3 includes steps S71 to 72 and S73a to 76a.

[0193] In step S71, the video / audio input / output control device 32 in the speaker's terminal device 3 converts the speaker's voice into audio data via audio input devices such as a microphone and an AD converter, and transmits it to the WEB conference server 2. Also, the video / audio input / output control device 32 in the video provider's terminal device 3 converts the video to be provided to and shared with participants, for example, a slide image or the like displayed on the screen of its own terminal device 3, into video data and transmits it to the WEB conference server 2.

[0194] In step S72, the video / audio distribution control device 23 of the Web conference server 2 receives the video data from the terminal device 3 of the video provider, and receives the audio data from the terminal device 3 of the speaker.

[0195] In step S73a, the video and audio distribution control device 23 refers to the conference management table T1 and the participant management table T2 to determine the terminal device 3 that is to be the target of the volume reduction control.

[0196] In step S74a, the video / audio distribution control device 23 distributes the video data and audio data to all the terminal devices, and transmits a volume-low control signal to the terminal device 3 that is the target of the volume-low control.

[0197] In step S75a, the video / audio input / output control device 32 of each terminal device 3 receives the video data or audio data distributed from the WEB conference server 2. The terminal device 3 that is the target of the volume reduction control also receives the volume reduction control signal.

[0198] In step S76a, the video / audio input / output control device 32 of each terminal device 3 cooperates with the display control device 33 to display on the screen the video represented by the received video data. The video / audio input / output control device 32 of each terminal device 3 also controls the audio output device in use to output the audio represented by the received audio data. The terminal device 3 that has received the volume reduction control signal controls the volume of the audio to be output based on the volume reduction control signal. This ends the video / audio distribution process of step S7.

[0199] Fig. 26 is a diagram showing a table for explaining a method for determining a target of volume reduction control. As can be seen from the audio data transmission destination determination table DT3 shown in Fig. 26, the video and audio distribution control device 23 determines a target of volume reduction control based on the setting of the "conference security type" and the setting of the "individual security type" of the speaker.

[0200] When the "conference security type" in the conference management table T1 (see Figure 2 as appropriate) is "High," the video and audio distribution control device 23 determines that the target of volume reduction control is the other terminal devices 3, excluding terminal devices 3 whose "classification" in the participant management table T2 is "1."

[0201] Furthermore, when the "conference security type" in the conference management table T1 is "Middle", the video and audio distribution control device 23 determines, as a rule, the target of the volume reduction control to be the terminal devices 3 excluding the terminal devices 3 whose "classification" in the participant management table T2 (see FIG. 2) is "1" or "2" and the terminal devices 3 whose "exception" is "○". However, when the "individual security type" of the speaker is "High", the target of the volume reduction control is determined to be the terminal devices 3 excluding the terminal devices 3 whose "classification" in the participant management table T2 is "1" from all the terminal devices 3.

[0202] Furthermore, when the "conference security type" in the conference management table T1 is "Normal", the video and audio distribution control device 23 does not perform volume reduction control in principle. However, when the "individual security type" of the speaker is "High", the target of volume reduction control is limited to all terminal devices 3 excluding terminal devices 3 whose "classification" in the participant management table T2 is "1". When the "individual security type" of the speaker is "Middle", the target of volume reduction control is determined to be all terminal devices 3 excluding terminal devices 3 whose "classification" in the participant management table T2 is "1" or "2" and terminal devices 3 whose "exception" is "○".

[0203] The video / audio distribution control device 23 transmits a volume-lowering control signal for lowering the volume to the terminal device 3 that is the target of the volume-lowering control.

[0204] Effects of the Web conference system according to the third embodiment As described above, according to the WEB conferencing system of the above-mentioned embodiment 3, based on the settings of "conference security type," "classification," "exception," and "individual security type," terminal devices 3 in an audio output state in which the risk of confidential information leaking is relatively high are determined as targets for volume reduction control, thereby reducing the risk of confidential information being heard by unintended persons.

[0205] Furthermore, according to the WEB conferencing system of embodiment 3, audio is output at a low volume in a terminal device 3 in an audio output state in which the risk of confidential information leakage is relatively high, so that participants can understand that their own terminal device 3 is in an audio output state in which the risk of confidential information leakage is relatively high.

[0206] Furthermore, according to the WEB conference system of the third embodiment, even if the terminal device 3 is in an audio output state in which the risk of leaking confidential information is relatively high, audio data is distributed and audio is output, albeit at a low volume. Therefore, unlike when no audio is output, participants do not need to suspect that the audio output device is broken or the settings are incorrect, and they do not feel uneasy.

[0207] The volume reduction control may be a control to set the output volume level to 0. In this case, the situation is the same as when no audio data is distributed.

[0208] (Embodiment 4) Overview of the Web conference system according to the fourth embodiment In the first to third embodiments, the distribution of audio data is controlled based on the "type of audio output device in use" of the terminal device 3. On the other hand, in the fourth embodiment, the audio input / output status of the terminal device 3 is monitored, and the distribution of audio data is controlled based on the monitoring result.

[0209] <Functional blocks of the web conference system according to the fourth embodiment> The video and audio distribution control device 23 compares and analyzes the audio data picked up by the microphone 3s of each terminal device 3, and determines whether the same audio is being received from multiple different terminal devices 3. If the analysis results in the determination that the same audio is being received from multiple terminal devices 3, the video and audio distribution control device 23 recognizes that the multiple terminal devices 3 are installed in close proximity to each other, and determines that there is a low risk of confidential information leaking to unintended persons. Then, the video and audio distribution control device 23 transmits specific information identifying the multiple terminal devices 3 to the participant management device 22. Based on the received specific information, the participant management device 22 sets the "classification" of the multiple terminal devices 3 to "1."

[0210] Effects of the Web conference system according to the fourth embodiment According to the WEB conferencing system of the above-mentioned embodiment 4, the voices picked up by the microphone 3s of each terminal device 3 are analyzed, and the terminal devices 3 that are set close to each other are identified. The identified terminal devices 3 are determined to have a low risk of confidential information leakage, and the "classification" is set to "1." Therefore, it is possible to automatically set an appropriate "classification" even without a request from the terminal devices 3.

[0211] In each of the above-described embodiments, any one of the multiple terminal devices 3 constituting the WEB conference system 1 may also function as the WEB conference server 2. For example, the WEB conference system 1 may have a configuration in which one terminal device 3 also functioning as the WEB conference server 2 and one or more other terminal devices 3 are connected via a network 4.

[0212] Although each embodiment of the present invention has been described above, the present invention is not limited to the above-mentioned embodiments, and various modified examples are included. Furthermore, the above-mentioned embodiments have been described in detail to explain the present invention in an easy-to-understand manner, and are not necessarily limited to those having all of the configurations described. Furthermore, it is possible to replace a part of the configuration of one embodiment with the configuration of another embodiment, and it is also possible to add the configuration of another embodiment to the configuration of one embodiment. All of these belong to the scope of the present invention. Furthermore, the numerical values, messages, etc. contained in the text and figures are merely examples, and the effect of the present invention is not impaired even if different ones are used.

[0213] In addition, it is possible to add, delete, or replace a part of the configuration of each embodiment with another configuration. In addition, the above-mentioned configurations, functions, processing units, processing means, etc. may be realized in hardware by designing a part or all of them as an integrated circuit, for example. In addition, the above-mentioned configurations, functions, etc. may be realized in software by a processor such as an MPU or a CPU interpreting and executing a program that realizes each function. In addition, the range of functions realized by software is not limited, and hardware and software may be used together. Information such as programs, tables, files, etc. that realize each function can be stored in a memory, a recording device such as a hard disk or SSD (Solid State Drive), or a recording medium such as an IC card, an SD card, or a DVD. [Explanation of symbols]

[0214] 1...WEB conference system, 2...WEB conference server, 3...terminal device, 4...network, 2a, 3a...storage, 2b, 3b...memory, 2c, 3c...processor, 2d, 3d...wireless communication unit, 2e, 3e...wired communication unit, 2f, 3f...video control unit, 2g, 3g...audio control unit, 2h, 3h...operation control unit, 2j, 3j...power control unit, 2k, 3k...display unit, 2m, 3m...camera, 2n, 3n...wireless interface, 2p, 3p...wired interface, 2r, 3r...speaker, 2s, 3s...microphone, 2t, 3t...operation input unit, 2w, 3w...power interface, 3x... Battery, 21...conference management device, 22...participant management device, 23...video and audio distribution control device, 24...server side data processing device, 31...input / output device management device, 32...video and audio input / output control device, 33...display control device, 34...terminal side data processing device, A1...operating system, A2...WEB conference program, A3...browser, D11, D12, D13...display screen, T1, T11, T12...conference management table, T2, T21, T22...participant management table, T3, T31...input / output device management table, DT1, DT2, DT3...audio data transmission destination determination table

Claims

1. A web conference system comprising a server and a plurality of terminal devices connected to the server, The WEB conference system includes: a storage device that acquires device type information indicating a type of an audio output device being used in the terminal device from a plurality of the terminal devices and stores the device type information; a control device that determines whether or not to output sound from an audio output device currently in use in each of the terminal devices, based on the device type information for each of the terminal devices stored in the storage device, or controls a volume of sound output from the terminal devices; a transmitting device that transmits the device type information for each of the terminal devices to a plurality of the terminal devices, The terminal device includes a display device and a display control device that controls the display device so that the received device type information for each of the terminal devices is displayed. Web conferencing system.

2. In the web conference system according to claim 1, The control device determines the terminal device to which the audio data in the WEB conference is to be transmitted based on the device type information for each of the terminal devices. Web conferencing system.

3. 3. The web conference system according to claim 2, the control device determines a destination of the audio data to be the terminal device whose type of the audio output device in use is a headphone type; Web conferencing system.

4. In the web conference system according to claim 3, The web conference system includes a setting reception device that receives a secure mode setting for a web conference to be held, the control device determines, in the WEB conference in which the secure mode is set, a destination of the audio data to be the terminal device in which the type of the audio output device in use is the headphone type; Web conferencing system.

5. In the web conference system according to claim 3, The web conference system includes a request receiving device that receives a secure transmission request from the terminal device, the control device determines a transmission destination of the voice data input from the terminal device for which the secure transmission request has been accepted to be the terminal device whose type of the voice output device in use is the headphone type. Web conferencing system.

6. In the web conference system according to claim 1, the control device determines the terminal device for which a volume of the sound output from the audio output device in use is to be controlled to be lower than a first volume level, based on device type information for each of the terminal devices; Web conferencing system.

7. In the web conference system according to claim 1, the storage device detects that a type of the audio output device being used in any of the terminal devices has been changed, and updates the device type information for each of the terminal devices; the transmitting device transmits the updated device type information for each of the terminal devices; the display control device controls the display device so that the updated device type information for each of the terminal devices is displayed on a screen. Web conferencing system.

8. In the web conference system according to claim 1, the transmitting device transmits, to the plurality of terminal devices, participant information indicating a participant using each of the terminal devices; the display control device controls the display device to display the participant information and the device type information in association with each other for each terminal device. Web conferencing system.

9. 9. The web conference system according to claim 8, when the type represented by the device type information is a headphone type, the display control device displays an icon corresponding to headphones; when the type represented by the device type information is a speaker type, controlling the display device to display an icon corresponding to a speaker. Web conferencing system.

10. In the web conference system according to claim 4, The terminal device A display device and a display control device, the display control device controls the display device to display information indicating that, in the conference in which the secure mode is set, audio is output only from the terminal device whose type of audio output device in use is the headphone type. Web conferencing system.

11. In the web conference system according to claim 4, The terminal device A display device and a display control device, and when a type of the audio output device being used is different from the headphone type in the conference in which the secure mode is set, the display control device controls the display device to display information prompting the user to switch the type of the audio output device being used to the headphone type. Web conferencing system.

12. In the web conference system according to claim 1, the control device controls the terminal device such that a volume of the sound output from the audio output device becomes lower than a first volume level when a type of the audio output device in use represented by the device type information of the terminal device is other than a headphone type. Web conferencing system.

13. In the web conference system according to claim 3, The headphone-type device includes headphones, earphones, headsets, earsets, head-mounted displays, bone conduction speakers, and smartphone call speakers. Web conferencing system.

14. A terminal device connected to a server used in a web conference, One or more audio output devices; and a control unit that controls an output of the audio output devices. The control unit is Controlling the audio output device so that the audio of the WEB conference is output based on the acquired audio data; acquiring information on whether to output sound from the audio output device currently in use in the terminal device, or information on controlling the volume of sound output from the terminal device, the information being determined based on device type information indicating the type of the audio output device currently in use in the terminal device; The terminal device A display device; a display control device that controls the display device so that the acquired device type information for each terminal device connected to the server is displayed. Terminal device.

15. 15. The terminal device according to claim 14, The control unit is Based on the acquired data, the display device is controlled so that participant information indicating the participants of the WEB conference and device type information indicating the type of the audio output device being used in the terminal device of the participant are displayed in association with each participant. Terminal device.

16. The terminal device according to claim 14, The control unit is Controlling the display device based on the acquired control signal or data so as to display information indicating that sound is output only from the terminal device whose type of the sound output device being used is a headphone type. Terminal device.

17. 15. The terminal device according to claim 14, The control unit is and controlling the display device so that, when the type of the audio output device being used is different from a headphone type based on the acquired control signal or data, information prompting the user to switch the audio output device being used to the headphone type device is displayed. Terminal device.

18. A web conferencing method in a web conferencing system including a server and a plurality of terminal devices connected to the server, comprising: The WEB conference system includes: a storage step of acquiring device type information indicating a type of an audio output device being used in the terminal device from the plurality of terminal devices and storing the device type information; a control step of determining whether to output sound from an audio output device currently in use in each of the terminal devices, or controlling a volume of the sound, based on the device type information for each of the terminal devices that is stored; a transmission step of transmitting the device type information for each of the terminal devices to a plurality of the terminal devices; a display control step of controlling a display device of the terminal device so that the device type information for each of the terminal devices is displayed; How to hold a web conference.

19. 19. The web conferencing method according to claim 18, In the control step, a destination of the audio data in the WEB conference is determined to be the terminal device whose type of the audio output device in use is a headphone type. How to hold a web conference.

20. 20. The web conferencing method according to claim 19, The WEB conference system executes a request acceptance step of accepting a secure transmission request from the terminal device; In the control step, a destination of the voice data input from the terminal device for which the secure transmission request has been accepted is determined to be the terminal device whose type of the voice output device in use is the headphone type. How to hold a web conference.

Images