Online conference system and control method, terminal device and electronic device readable medium

Abstract

The invention discloses an online conference system, a control method, terminal devices and an electronic device readable medium. The online conference system comprises a first terminal device and a second terminal device. The first capturing module is used for capturing at least one of video data and audio data in a preset space. The second terminal device is arranged in the preset space, and the second terminal device is in communication coupling with the first terminal device. The second capturing module is used for capturing at least one of video data and audio data in the preset space. The first terminal device obtains a first score according to a scoring algorithm and the first acquisition module, and the second terminal device obtains a second score according to the scoring algorithm and the second acquisition module. When the first score is greater than the second score, the first terminal device obtains the agent authority and is responsible for transmitting the data obtained by the first capturing module and the data obtained by the second capturing module to the remote host. According to the scheme, the effect that the terminal device integrates input or output resource allocation can be achieved.

Description

Technical Field

[0001] This case relates to a conference system, a control method, a device, and a readable medium, and in particular to an online conference system, an online conference control method, a terminal device, and an electronic device readable medium. Background Art

[0002] Currently, some users purchase multiple video devices. This may be due to the need for larger meeting spaces, which require multiple video conferencing devices to capture or record the entire venue. Furthermore, the use of multiple video conferencing devices in a single space can also lead to issues that don't arise with standard video conferencing.

[0003] When multiple video products are receiving or playing audio from a remote location in a conference room, if the time of each video product is not synchronized, the audio transmission may be out of sync, resulting in a poor user experience. Summary of the Invention

[0004] This summary is intended to provide a simplified summary of the present disclosure so that readers can have a basic understanding of the present disclosure. This summary is not a complete overview of the present disclosure and is not intended to identify important / critical elements of the present invention or to define the scope of the present invention.

[0005] A technical aspect of the present case is about an online conference system. The online conference system includes a first terminal device and a second terminal device. The first terminal device is configured in a preset space, and the first terminal device has a first capture module, and the first capture module is used to capture at least one of the video data and audio data in the preset space. The second terminal device is configured in the preset space, and the second terminal device is communicatively coupled to the first terminal device. The second terminal device has a second capture module, and the second capture module is used to capture at least one of the video data and audio data in the preset space. The first terminal device obtains a first score according to a scoring algorithm and the first capture module, and the second terminal device obtains a second score according to the scoring algorithm and the second capture module. When the first score is greater than the second score, the first terminal device obtains agent authority and is responsible for transmitting the data obtained by the first capture module and the data obtained by the second capture module to a remote host.

[0006] In one embodiment, the first terminal device controls the second capture module of the second terminal device according to the agent authority.

[0007] In one embodiment, the first terminal device automatically synchronizes the time information of the second terminal device with the time information of the first terminal device according to the agent's authority, and the time information of the second terminal device or the time information of the first terminal device includes at least one of the set time zone information, time parameter information, time error information and camera reverse effect information.

[0008] In one embodiment, the first terminal device determines whether the network speed information of the network in the preset space is less than the network speed threshold information based on the network monitoring algorithm, and when the first terminal device determines that the network speed information of the network environment information is less than the network speed threshold information, the first terminal device sets a network resource of the network according to the agent authority to be provided to the first terminal device first.

[0009] In one embodiment, when the first terminal device obtains the agent authority, the first terminal device is responsible for managing all terminal devices in the preset space, and integrates the data captured by all terminal devices in the preset space and transmits it to the remote host.

[0010] Another technical aspect of this application relates to a method for controlling an online conference. The method includes the following steps: capturing at least one of video data and audio data in a preset space via multiple terminal devices arranged in the preset space; obtaining a score for each terminal device based on a scoring algorithm; and comparing the scores of the terminal devices. The terminal device with the highest score is designated as an agent responsible for managing all terminal devices in the preset space. The agent then integrates the data captured by all terminal devices in the preset space and transmits it to a remote host.

[0011] In one embodiment, the control method of the online conference further includes synchronizing the time information of all terminal devices in a preset space through an agent, wherein the time information includes at least one of set time zone information, time parameter information, time error information, and camera reverse effect information.

[0012] In one embodiment, the online conference control method further includes: setting the allocation of network resources through an agent; determining, through a first terminal device, whether network speed information of a network in a preset space is less than network speed threshold information based on a network monitoring algorithm; and when the first terminal device determines that the network speed information of the network environment information is less than the network speed threshold information, setting, through the first terminal device, network resources of the network according to the agent's authority to be provided preferentially to the first terminal device.

[0013] In one embodiment, the online conference control method further includes: integrating information captured by all terminal devices in a preset space through an agent; and transmitting the integrated captured information to a remote host through the agent.

[0014] Another technical aspect of the present case is about a terminal device. The terminal device is set in a preset space, and the terminal device is suitable for online meetings. The terminal device is communicatively coupled to another terminal device set in the preset space. The terminal device includes a capture module, a storage module, a communication module and a processing module. The capture module captures at least one of the video data and audio data in the preset space. The storage module stores at least one program code. The communication module is communicatively coupled to another terminal device in the preset space and a remote host. The processing module couples the capture module, the storage module and the communication module. When the processing module reads at least one program code, the following steps are performed: obtaining the score corresponding to the terminal device according to the algorithm; and when the score corresponding to the terminal device is higher than the score corresponding to another terminal device in the preset space, it is responsible for transmitting the data captured by the capture module and the data captured by another terminal device in the preset space to the remote host through the communication module.

[0015] In one embodiment, when the score corresponding to the terminal device is higher than the score corresponding to another terminal device in a preset space, the terminal device obtains agent authority, wherein when the terminal device obtains agent authority, the terminal device integrates and manages the data captured by the terminal device and the data captured by the other terminal device, wherein the terminal device automatically synchronizes the time information of the terminal device and the time information of the other terminal device according to the agent authority, and wherein the time information of the terminal device or the time information of the other terminal device includes at least one of the set time zone information, time parameter information, time error information and camera reverse effect information.

[0016] In one embodiment, the terminal device determines whether the network speed information of the network in the preset space is less than the network speed threshold information based on the network monitoring algorithm. When the terminal device determines that the network speed information of the network environment information is less than the network speed threshold information, the terminal device prioritizes providing network resources of the network to the terminal device based on the agent authority setting.

[0017] Another technical aspect of this invention relates to an electronic device-readable medium. The electronic device-readable medium stores at least one program code, and when the at least one program code is read, the electronic device-readable medium executes at least the following steps: capturing at least one of video data and audio data in a preset space via a terminal device located in the preset space; obtaining a score corresponding to the terminal device based on an algorithm; and, when the score corresponding to the terminal device is higher than the score corresponding to another terminal device in the preset space, transmitting the data captured by the terminal device in the preset space and the data captured by the other terminal device in the preset space to a remote host via a communication module of the terminal device.

[0018] In one embodiment, when the score corresponding to the terminal device is higher than the score corresponding to another terminal device in a preset space, the terminal device obtains agent authority, wherein when the terminal device obtains agent authority, the terminal device integrates and manages the data captured by the terminal device and the data captured by the other terminal device, wherein the terminal device automatically synchronizes the time information of the terminal device and the time information of the other terminal device according to the agent authority, and wherein the time information of the terminal device or the time information of the other terminal device includes at least one of the set time zone information, time parameter information, time error information and camera reverse effect information.

[0019] In one embodiment, the terminal device determines whether the network speed information of the network in the preset space is less than the network speed threshold information based on the network monitoring algorithm. When the terminal device determines that the network speed information of the network environment information is less than the network speed threshold information, the terminal device prioritizes providing network resources of the network to the terminal device based on the agent authority setting.

[0020] Therefore, according to the technical content of this case, the online conference system, online conference control method, terminal device and electronic device readable media shown in the embodiments of this case can obtain agent authority through a scoring algorithm to achieve the effect of integrating input or output resource allocation of the terminal device.

[0021] After reading the following detailed description, a person skilled in the art will readily understand the basic spirit and other objectives of the present invention, as well as the technical means and implementations employed in the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] To make the above and other objects, features, advantages and embodiments of the present invention more apparent and understandable, the accompanying drawings are described as follows:

[0023] Figure 1 is a block diagram illustrating an online conference system according to an embodiment of the present invention;

[0024] Figure 2 This is a diagram illustrating a usage scenario of an online conference system according to an embodiment of the present invention;

[0025] Figure 3 This is a diagram illustrating a usage scenario of an online conference system according to an embodiment of the present invention;

[0026] Figure 4A is a flowchart illustrating a method for controlling an online conference according to an embodiment of the present invention;

[0027] Figure 4B This is a flowchart illustrating a process for an agent to manage and integrate terminal devices in a preset space according to an embodiment of the present invention;

[0028] Figure 5 is a block diagram illustrating an online conference system according to an embodiment of the present invention;

[0029] Figure 6 FIG2 is a block diagram illustrating a terminal device of an online conference system according to an embodiment of the present invention.

[0030] According to conventional practice, the various features and components in the drawings are not drawn to scale. The drawing method is to best illustrate the specific features and components related to the present invention. In addition, the same or similar reference numerals are used to refer to similar components / parts in different drawings.

[0031]

Explanation of symbols

[0032] 100, 100A, 100B: Online conference system

[0033] 110, 110A, 110B: terminal devices

[0034] 111, 111B: Capture module

[0035] 120, 120A, 130A, 140A, 120B: Terminal devices

[0036] 121: Capture Module

[0037] DP, DPA, DPB: Preset space

[0038] SV: Video data

[0039] SS: Audio data

[0040] 90: Remote host

[0041] P1, P1A: User

[0042] 400: How to control online meetings

[0043] 410-440: Steps

[0044] 112B: Storage module

[0045] 113B: Communication module

[0046] 114B: Processing module DETAILED DESCRIPTION

[0047] To provide a more detailed and complete description of the present disclosure, the following provides illustrative descriptions of various embodiments and examples of the present invention; however, these descriptions are not intended to be the only way to implement or use the present invention. The detailed descriptions cover features of various embodiments and the method steps and sequences for constructing and operating these embodiments. However, other embodiments may also be used to achieve the same or equivalent functionality and step sequences.

[0048] Unless otherwise defined in this specification, scientific and technical terms used herein have the same meanings as those commonly understood and used by persons skilled in the art in the art to which this invention pertains. Furthermore, unless otherwise defined in this specification, singular nouns in this specification include the plural form of such nouns, and plural nouns in this specification also include the singular form of such nouns.

[0049] In addition, the term “coupled” or “connected” as used herein may refer to two or more elements being in direct physical or electrical contact with each other, or indirect physical or electrical contact with each other, or may refer to two or more elements operating or moving with each other.

[0050] In this document, the term “module” generally refers to an object composed of one or more inputs and / or one or more active and passive components connected in a certain manner to process signals.

[0051] Certain terms are used in the specification and claims to refer to specific components. However, those skilled in the art will understand that the same component may be referred to by different terms. The specification and claims do not distinguish components by name, but rather by their functional differences. The term "including" in the specification and claims is open-ended and should be interpreted as meaning "including, but not limited to."

[0052] Figure 1 FIG. 1 is a block diagram illustrating an online conference system according to an embodiment of the present invention. Figure 1 As shown, in one embodiment, an online conference system 100 includes a first terminal device 110 and a second terminal device 120. The first terminal device 110 has a first capture module 111, and the second terminal device 120 has a second capture module 121. The first terminal device 110 is disposed in a predetermined space DP, and the second terminal device 120 is disposed in a predetermined space DP. The second terminal device is communicatively coupled to the first terminal device.

[0053] For example, the first terminal device 110 and the second terminal device 120 can each be any type of video device, any type of conferencing device, a notebook computer, a desktop computer, a tablet, or a smartphone; the first capture module 111 and the second capture module 121 can each be any electronic module or component, such as a microphone or a camera; and the preset space DP can be any indoor space (e.g., a conference room or classroom, etc.), but the present disclosure is not limited thereto.

[0054] In some embodiments, the online conference system 100 further includes a remote host 90 , which is communicatively coupled to the first terminal device 110 .

[0055] For example, the remote host 90 can be any type of server, any type of electronic host, any type of video device, any type of conferencing device, a notebook computer, a desktop computer, a tablet computer, or a smart phone, but the present disclosure is not limited thereto.

[0056] In one embodiment, the first capture module 111 is used to capture at least one of the video data SV and the audio data SS in the preset space DP. In this embodiment, the second capture module 121 is used to capture at least one of the video data SV and the audio data SS in the preset space DP.

[0057] For example, the video data SV may be the body, appearance, or outline of the user or speaker, and the audio data SS may be the communication, speaking, or playing sounds of the user or speaker, but the present disclosure is not limited thereto.

[0058] In this embodiment, the first terminal device 110 obtains a first score according to the scoring algorithm and the first capturing module 111 , and the second terminal device 120 obtains a second score according to the scoring algorithm and the second capturing module 121 .

[0059] For example, the scoring algorithm may assign corresponding scores to the first terminal device 110 and the second terminal device 120 according to their respective hardware performance, capabilities, levels, or transmission speeds, but the present disclosure is not limited thereto.

[0060] In this embodiment, when the first score is greater than the second score, the first terminal device 110 obtains the agent authority and is responsible for transmitting the data obtained by the first capture module 111 and the data obtained by the second capture module 121 to the remote host 90 .

[0061] For example, the first score being greater than the second score may mean that the performance of the first terminal device 110 is better than that of the second terminal device 120, the first terminal device 110 obtains agent authority to become an agent, and the first terminal device 110 can transmit the video data SV and / or audio data SS respectively obtained by the first capture module 111 and / or the second capture module 121 to the remote host 90.

[0062] In some embodiments, the scoring algorithm may be related to a deep learning algorithm, a neural-like algorithm, a big data algorithm, or a pre-trained transformer, but the present disclosure is not limited thereto.

[0063] In one embodiment, the first capture module 111 includes at least one of a first processor, a first display, a first camera, a first speaker, and a first microphone.

[0064] For example, the first capturing module 111 may be any type of processor, any type of display, any type of lens, any type of speaker, and / or any type of microphone, but the present disclosure is not limited thereto.

[0065] In one embodiment, the first terminal device 110 controls the second capturing module 121 of the second terminal device 120 according to the proxy authority. The second capturing module 121 includes at least one of a second processor, a second display, a second camera, a second speaker, and a second microphone.

[0066] For example, the second capture module 121 can be any type of processor, any type of display, any type of lens, any type of speaker and / or any type of microphone. When the first terminal device 110 has agent authority, the first terminal device 110 can control or operate the second capture module 121, but the present disclosure is not limited to this.

[0067] In some embodiments, the video data captured by the first capture module 111 and the audio data captured by the second capture module 121 in the preset space DP may be different from each other.

[0068] In one embodiment, the first terminal device 110 and the second terminal device 120 are connected to each other via a communication path, which includes one of a wired network, a wireless network, Bluetooth communication, and Wi-Fi communication.

[0069] For example, the first terminal device 110 can be connected to the second terminal device 120 through electrical coupling, wired network, wireless network, Bluetooth communication, or Wi-Fi communication, but the present disclosure is not limited thereto.

[0070] In one embodiment, the scoring algorithm includes a scoring table including at least one of a hardware performance score, a feature detection score, and a user-defined score.

[0071] For example, a scoring table can be shown in Table 1 below. The hardware performance score, feature detection score, and user-defined score can be summed to form a feature score. The hardware performance score can be obtained from a performance table (e.g., Table 2 below), which can include hardware such as the processor, display, camera / lens, speaker, microphone, and their corresponding scores. When the first capture module 111 or the second capture module 121 detects a key person (e.g., a speaker), the first terminal device 110 or the second terminal device 120 can obtain a feature detection score (e.g., 30 points).

[0072] Furthermore, the user-defined score can be a score defined by the user. A speaker can move along a specific route within the venue, so the user can assign a user-defined score (e.g., 70 points) to the first terminal device 110 or the second terminal device 120 that will capture the speaker. Furthermore, if the speaker is giving a presentation at a specific location, the user-defined score can be set to 0 points, but the present disclosure is not limited to this.

[0073] Table 1.

[0074] project Fraction Hardware performance score xx Feature detection score xx User-defined score xx Feature score xx

[0075] Table 2.

[0076]

[0077]

[0078] In one embodiment, the first score of the first terminal device 110 is related to at least one of a hardware performance score, a feature detection score, and a user-defined score.

[0079] In some embodiments, the second score of the second terminal device 120 is related to at least one of a hardware performance score, a feature detection score, and a user-defined score.

[0080] For example, the first score or the second score can each be a feature score, which can be the sum of the hardware performance score, the feature detection score, and the user-defined score, but the present disclosure is not limited thereto. In some embodiments, the hardware performance score, the feature detection score, and the user-defined score can be derived using any mathematical method (e.g., addition, subtraction, multiplication, division, mathematical equation, or mathematical model), but the present disclosure is not limited thereto.

[0081] In one embodiment, the first terminal device 110 includes one of a video conferencing device, a computer device, and a handheld device.

[0082] For example, the first terminal device 110 or the second terminal device 120 may be a video conferencing device, a computer device, or a handheld device, but the present disclosure is not limited thereto. Furthermore, the first terminal device 110 or the second terminal device 120 may determine whether to act as an agent based on the information in Table 3 below, but the present disclosure is not limited thereto.

[0083] Table 3.

[0084]

[0085] As described above, when the first terminal device 110 is a video conferencing device, the first terminal device 110 can obtain the proxy authority first. When the first terminal device 110 is a computer device and the second terminal device 120 is a handheld device, the first terminal device 110 can obtain the proxy authority first.

[0086] In addition, when the first terminal device 110 is a computer device and the second terminal device 120 is a video conferencing device, a computer device, or a handheld device, the priority of becoming an agent can be further determined through a scoring algorithm.

[0087] In some embodiments, the first performance score corresponding to the video conferencing device is greater than the second performance score corresponding to the computer device. The second performance score corresponding to the computer device is greater than the third performance score corresponding to the handheld device.

[0088] For example, the first performance score may be 70 points, the second performance score may be 50 points, and the third performance score may be 30 points. The first performance score, the second performance score, and / or the third performance score may be actual representations of hardware performance, but the present disclosure is not limited thereto.

[0089] In some embodiments, the first capturing module 111 and / or the second capturing module 121 each captures different images and / or sounds within the preset space DP.

[0090] For example, the first terminal device 110 (or the first capture module 111) can capture the image and / or sound of user A in the preset space DP, and the second terminal device 120 (or the second capture module 121) can capture the image and / or sound of user B in the preset space DP, but the present disclosure is not limited to this.

[0091] In addition, the first terminal device 110 (or the first capturing module 111) can capture the image of user A in the preset space DP, and the second terminal device 120 (or the second capturing module 121) can capture the voice of user A in the preset space DP, but the present disclosure is not limited thereto.

[0092] Figure 2 This is a diagram illustrating a usage scenario of an online conference system according to an embodiment of the present invention. Figure 2 As shown, in some embodiments, an online conference system 100A includes a first terminal device 110A, a second terminal device 120A, a third terminal device 130A, and / or a fourth terminal device 140A. The first terminal device 110A, the second terminal device 120A, the third terminal device 130A, and / or the fourth terminal device 140A may be located within a predetermined space DPA. A user P1 is located near the first terminal device 110A.

[0093] For example, Figure 2 The first terminal device 110A and the second terminal device 120A may correspond to Figure 1 The first terminal device 110 and the second terminal device 120, Figure 2 The third terminal device 130A or the fourth terminal device 140A may also correspond to Figure 1 The second terminal device 120 is located at a distance of about 1 meter in radius from the first terminal device 110A, but the present disclosure is not limited thereto.

[0094] Figure 3 This is a diagram illustrating a usage scenario of an online conference system according to an embodiment of the present invention. Figure 3 As shown, in some embodiments, Figure 3 Hardware and Figure 2 The hardware is similar to that of the , so for the sake of simplicity, we will not go into details here. Figure 3 The user P1A is located near the second terminal device 120A.

[0095] For example, the user P1A may be located within a radius of about 1 meter from the second terminal device 120A, but the present disclosure is not limited thereto.

[0096] Please also refer to Figures 1 to 3In some embodiments, the third terminal device 130A is communicatively coupled to the first terminal device 110A and the second terminal device 120A. The third terminal device 130A includes a third capture module. The fourth terminal device 140A is communicatively coupled to the first terminal device 110A, the second terminal device 120A, and the third terminal device 130A. The fourth terminal device 140A includes a fourth capture module. The first terminal device 110A, the second terminal device 120A, the third terminal device 130A, and the fourth terminal device 140A are connected to each other via a communication path.

[0097] In this embodiment, the third terminal device 130A obtains a third score according to the scoring algorithm and the third capture module, and the fourth terminal device 140A obtains a fourth score according to the scoring algorithm and the fourth capture module.

[0098] In this embodiment, when the first score is greater than the second score, the third score, and the fourth score, the first terminal device obtains proxy authority. The first terminal device 110A controls the second capture module of the second terminal device 120A, the third capture module of the third terminal device 130A, and the fourth capture module of the fourth device 140A based on the proxy authority.

[0099] For example, Figure 2 and / or Figure 3 The operation of the online conference system 100A is similar to Figure 1 The operation of the online conference system 100 is concise and will not be described here in detail.

[0100] In some embodiments, the third capture module includes at least one of a third processor, a third display, a third camera, a third speaker, and a third microphone. The fourth capture module includes at least one of a fourth processor, a fourth display, a fourth camera, a fourth speaker, and a fourth microphone.

[0101] For example, the third capture module or the fourth capture module may correspond to Figure 1 The second capturing module 121 is provided, but the present disclosure is not limited thereto.

[0102] In some embodiments, the first score of the first terminal device 110A, the second score of the second terminal device 120A, the third score of the third terminal device 130A, and the fourth score of the fourth terminal device 140A are obtained through a scoring algorithm, and the scoring algorithm may correspond to Table 4 below, which is described in detail below.

[0103] Table 4.

[0104]

[0105]

[0106] As mentioned above, the first terminal device 110A may have a processor (model: Qualcomm 8-series SoC), a display, two cameras, a speaker and a microphone, and the hardware performance score may be 80 points. Figure 2 ) can be located near the first terminal device 110A. The first terminal device 110A can detect the features (e.g., face) of the user P1, so the feature detection score can be 30 points. Furthermore, the user has not set a custom score for the first terminal device 110A, so the user-defined score can be 0 points. The feature score can be 80 + 30 + 0 = 110 points, but the present disclosure is not limited to this.

[0107] Furthermore, the method for obtaining the feature scores of the second terminal device 120A, the third terminal device 130A, and the fourth terminal device 140A may be similar to the method for obtaining the feature score of the first terminal device 110A, and will not be further described for the sake of brevity.

[0108] In some embodiments, the first terminal device 110A obtains the agent authority, and the first terminal device 110A can display and control the display (Display), camera (Camera), speaker (Speaker) and microphone (Microphone) of the second terminal device 120A, the third terminal device 130A and / or the fourth terminal device 140A.

[0109] For example, the first terminal device 110A may have a display, and the user may control the second terminal device 120A, the third terminal device 130A, and / or the fourth terminal device 140A through the first terminal device 110A. Specifically, the first terminal device 110A may turn on the display, camera, and speaker of the first terminal device 110A, turn off the speaker and microphone of the second terminal device 120A and turn on the camera, turn on the camera of the third terminal device 130A, and turn on the microphone of the fourth terminal device 140A, but the present disclosure is not limited to this.

[0110] In some cases, when a space has multiple video conferencing devices, there is a need for easier management. This case discloses an "agent authority" system that sets a terminal device as an agent to further integrate input or output resource allocation.

[0111] For example, a space can correspond to Figure 2In the preset space DPA, multiple video conferencing devices can control the second terminal device 120A, the third terminal device 130A and / or the fourth terminal device 140A for the first terminal device 110A. When the first terminal device 110A has proxy authority, the first terminal device 110A can integrate the resources input or output by the second terminal device 120A, the third terminal device 130A and / or the fourth terminal device 140A, but the present disclosure is not limited to this.

[0112] In some embodiments, to facilitate user settings, the user can set "delegate permissions" to automatically unify other video conferencing devices.

[0113] For example, a user can configure settings on the first terminal device 110A, which has delegate permissions, such as the time zone, time, time parameters, and camera anti-banding. The first terminal device 110A can then transmit these settings to the second terminal device 120A, the third terminal device 130A, and / or the fourth terminal device 140A. Therefore, the online conferencing systems 100 and 100A of this embodiment can effectively standardize the settings of all video conferencing devices in a specific space, eliminating the need for users to worry about a particular video conferencing device not being configured with the same settings.

[0114] In some embodiments, the clock resolution of each video conferencing device has a slight error. Over time, this error may cause multiple video conferencing devices to become out of sync. Therefore, if a specific video conferencing device is used as a benchmark, the specific video conferencing device can be regularly aligned to minimize this error, thus preventing user discomfort.

[0115] For example, the first terminal device 110A may integrate and synchronize the time settings of the second terminal device 120A, the third terminal device 130A, and / or the fourth terminal device 140A, but the present disclosure is not limited thereto.

[0116] In some embodiments, when the video network environment is poor, the "proxy authority" system disclosed in this case will prioritize providing network resources to video conferencing devices that have obtained proxy authority.

[0117] For example, a user is giving a video presentation in a location with poor network conditions. The focus is on a specific video conferencing device transmitting the speaker's audio and video to the network. However, other video conferencing devices in the same space may be capturing the audience rather than the speaker. When the online conferencing system 100 or 100A detects that the network speed is below a set value (e.g., below 12 Mbps), the online conferencing system 100 or 100A can instruct other video conferencing devices in the same space to disable their cameras and / or microphones to avoid wasting resources by transmitting unnecessary images and audio to the network.

[0118] In some embodiments, when the first terminal device 110A obtains the agent authority, the first terminal device 110A may determine whether the network speed information of the network of the preset space DPA is less than a network speed threshold information through a network monitoring algorithm.

[0119] For example, the network may be a wired network or a wireless network, but the present disclosure is not limited thereto.

[0120] In some embodiments, when the first terminal device 110A obtains the agent authority, the first terminal device 110A may be considered as a streaming device, but the present disclosure is not limited thereto.

[0121] In some embodiments, please refer to Figures 1 to 3 The scoring algorithm is stored in the remote host 90, and each terminal host can transmit the obtained information to the remote host, and the remote host 90 performs the scoring and designates the proxy server.

[0122] For example, each terminal host may be a first terminal device 110A, a second terminal device 120A, a third terminal device 130A, and / or a fourth terminal device 140A. The remote host 90 may score each of the terminal hosts based on whether they have a display, a camera, a speaker, and / or a microphone, and the remote host 90 may designate the first terminal device 110A, the second terminal device 120A, the third terminal device 130A, or the fourth terminal device 140A as a proxy server, but the present disclosure is not limited thereto.

[0123] In addition, the remote host 90 may also receive the image information and / or audio information of each terminal host for scoring, but the present disclosure is not limited thereto.

[0124] In some embodiments, the scoring algorithm is stored in each terminal host, and each terminal host generates a score by itself and then transmits it to the remote host 90 , which then designates a proxy server.

[0125] For example, the first terminal device 110A, the second terminal device 120A, the third terminal device 130A, and the fourth terminal device 140A can be scored based on their respective displays, cameras, speakers, and / or microphones. The remote host 90 receives the scores corresponding to the terminal hosts and compares the scores corresponding to the terminal hosts to obtain the maximum score value. The remote host 90 designates the terminal device corresponding to the maximum score value (e.g., the first terminal device 110A) as a proxy server, but the present disclosure is not limited to this.

[0126] In some embodiments, the scoring algorithm is stored in each terminal host, and each terminal host performs its own scoring. Each terminal host then uses competitive recommendation or blockchain technology to determine which terminal host is the proxy server (ie, the agent mentioned above).

[0127] For example, the first terminal device 110A, the second terminal device 120A, the third terminal device 130A, and the fourth terminal device 140A can be scored based on their respective displays, cameras, speakers, and / or microphones. The first terminal device 110A, the second terminal device 120A, the third terminal device 130A, and the fourth terminal device 140A transmit their corresponding scores to the remote host 90, and the remote host 90 can have a competitive recommendation algorithm or a blockchain algorithm, but the present disclosure is not limited to this.

[0128] Furthermore, the remote host 90 may evaluate the most suitable terminal device to serve as a proxy server through competition, cooperation, recommendation, etc. In terms of competition, the remote host 90 may evaluate each terminal device (e.g., the first terminal device 110A, the second terminal device 120A, the third terminal device 130A, and / or the fourth terminal device 140A) with the best hardware equipment (i.e., the one with the highest score) to serve as the proxy server.

[0129] Furthermore, in terms of cooperation, the remote host 90 can also evaluate one of the two terminal devices with the best hardware compatibility as a proxy server. For example, the first terminal device 110A has a display and a microphone, and the second terminal device 120A has a camera. The user can set the priority of receiving clear sound to be higher than the priority of receiving clear images, so the remote host 90 selects the first terminal device 110A as the proxy server, but the present disclosure is not limited to this.

[0130] Then, in terms of recommendation, the user can set a terminal device with a specified component or device, and the remote host 90 directly recommends it as a proxy server. For example, the first terminal device 110A has a display, so the remote host 90 directly recommends the first terminal device 110A as a proxy server, but the present disclosure is not limited to this.

[0131] In some embodiments, the first terminal device 110A, the second terminal device 120A, the third terminal device 130A, and / or the fourth terminal device 140A can be directly connected to the blockchain. The first terminal device 110A, the second terminal device 120A, the third terminal device 130A, and / or the fourth terminal device 140A can also be connected to the blockchain through the remote host 90. The corresponding rating scores of the first terminal device 110A, the second terminal device 120A, the third terminal device 130A, and / or the fourth terminal device 140A can be recorded in the blockchain. The remote host 90 can select the best one as the proxy server based on the historical records of the corresponding rating scores of the first terminal device 110A, the second terminal device 120A, the third terminal device 130A, and / or the fourth terminal device 140A in the blockchain, but the present disclosure is not limited to this.

[0132] For example, in the blockchain records (e.g., daily records), the rating score of the first terminal device 110A is stable around 70 points, while the rating score of the second terminal device 120A fluctuates between 30 and 80 points. The user can set the priority to select the one with the stable rating score, so the remote host 90 can select the first terminal device 110A as the proxy server, but the present disclosure is not limited to this.

[0133] Arrange the above description as follows Figure 4A The flowchart of the control method of the online conference is shown. Figure 4A As shown, in some embodiments, the online conference control method 400 includes steps 410 to 440. The detailed description of steps 410 to 430 is as follows.

[0134] In step 410 , at least one of the video data and the audio data in the preset space is captured by a plurality of terminal devices arranged in the preset space.

[0135] by Figure 2 For example, the present disclosure captures at least one of the video data SV and the audio data SS in the preset space DPA through the terminal devices 110 , 120 , 130 , and 140 in the preset space DPA.

[0136] In step 420 , scores corresponding to each terminal device are obtained according to a scoring algorithm. For example, the terminal devices 110 , 120 , 130 and / or 140 may obtain their respective scores based on different parameters.

[0137] Next, as described in step 430, the scores corresponding to the terminal devices are compared, and the terminal device corresponding to the largest score is assigned as an agent (with agent authority) to be responsible for managing all terminal devices in the preset space (for example, terminal devices 110, 120, 130 and 140), and integrating the data captured by all terminal devices in the preset space and then transmitting it to the remote host.

[0138] Figure 4B This is a flow chart illustrating the steps of an agent managing and integrating terminal devices in a preset space according to an embodiment of the present invention. Figure 4B As shown in step S431, when the online meeting starts, the agent can synchronize the time information of all terminal devices in the preset space. Figure 2 For example, if terminal device 110 is designated as a proxy, it will use its own time information as a standard to synchronize the time information of other terminal devices 120, 130, and 140. In some embodiments, the time information includes at least one of time zone information, time parameter information, time error information, and camera rollback effect information.

[0139] In some embodiments, the time zone information may be the time zone of the agent's location; the time parameter information may be any time parameter related to time; the time error information may be the time error between at least two of the terminal devices 110, 120, 130, and 140, or the time error between the agent and another terminal device; and the camera rollback effect information may be any effect used to address bright and alternating textures in the video data SV. The above time information is merely exemplary and the present disclosure is not limited thereto.

[0140] Next, as described in step S441, the agent can set the allocation of network resources. Figure 2 For example, an agent, such as terminal device 110, can determine whether network speed information of a network in a predetermined space DP is less than a network speed threshold based on a network monitoring algorithm. When terminal device 110 determines that the network speed information in the network environment information is less than the network speed threshold, terminal device 110 can prioritize network resources of the network to serve the agent, such as terminal device 110, based on the agent's authority.

[0141] For example, the terminal device 110A may use the proxy authority to preferentially use network resources (eg, network bandwidth, network speed, or network upload and download capacity, etc.), but the present disclosure is not limited thereto.

[0142] Next, as described in step S451, the agent integrates the information captured by all terminal devices in the preset space, and then as described in step S461, the agent is responsible for transmitting the integrated captured information to the remote host. Figure 2 For example, an agent, such as the terminal device 110 , integrates at least one of the video data SV and the audio data SS captured by the other terminal devices 120 , 130 , and 140 .

[0143] For example, an agent, such as the terminal device 110, can integrate the video data SV captured by all terminal devices in the preset space DP into a spliced picture, which is then transmitted to the remote host by the terminal device 110. In some embodiments, the agent can use the clearest video data SV as the main picture, and the other captured video data SV as sub-pictures, and integrate the clearest audio data SS before transmitting it to the remote host. In other embodiments, the agent can also only integrate the clearest video data SV and the clearest audio data SS before transmitting it to the remote host. Those with ordinary knowledge in the art should know that the above description is for example only and is not intended to limit the present disclosure.

[0144] Although the above Figure 4B A flowchart for an agent to manage and integrate other terminal devices is provided. However, a person skilled in the art may change the order of the above process, or only perform one or part of the above steps, or perform other steps for managing and integrating terminal devices, without affecting the spirit of the present disclosure.

[0145] In addition, the first terminal device 110A can proxy the cameras and / or microphones of the second terminal device 120A, the third terminal device 130A, and the fourth terminal device 140A to avoid wasting resources by transmitting unnecessary images and sounds to the network, but the present disclosure is not limited thereto.

[0146] Figure 5 FIG1 is a block diagram illustrating an online conference system according to an embodiment of the present invention. Figure 6 FIG. 1 is a block diagram illustrating a terminal device of an online conference system according to an embodiment of the present invention. Figure 5 and Figure 6 As shown, in some embodiments, the online conference system 100B includes a terminal device 110B and another terminal device 120B.

[0147] For example, Figure 5 The online conference system 100B can correspond to Figure 1 The online conference system 100 is provided, but the present disclosure is not limited thereto.

[0148] In one embodiment, the terminal device 110B is disposed in the preset space DPB, and the terminal device 110B is suitable for an online conference.

[0149] For example, Figure 5 and / or Figure 6 The terminal device 110B may correspond to Figure 1 The terminal device 110, Figure 5 The preset space DPB can correspond to Figure 1 The preset space DP is provided, but the present disclosure is not limited thereto.

[0150] In this embodiment, the terminal device 110B is communicatively coupled to another terminal device 120B disposed in the predetermined space DPB.

[0151] In this embodiment, a terminal device 110B includes a capture module 111B, a storage module 112B, a communication module 113B, and a processing module 114B. The capture module 111B captures at least one of the video data SV and the audio data SS from the preset space DPB. The storage module 112B stores at least one program code. The communication module 113B is communicatively coupled to another terminal device 120B and a remote host 90B in the preset space DPB.

[0152] For example, Figure 5 The video data SV and audio data SS may each correspond to Figure 1 The video data SV and audio data SS in the preset space DPB may be captured by the capture module 111B or another terminal device 120B, but the present disclosure is not limited thereto.

[0153] Furthermore, the storage module 112B may be a hard disk drive (HDD), a solid state drive (SSD), or a non-volatile memory device, etc. The communication module 113B may be a Bluetooth transmitter, a Wi-Fi transmitter, an array antenna, a long-range or short-range antenna, and the at least one program code may be an application (APP), software, an algorithm, any computer-readable language, string, bit, code, or command, but the present disclosure is not limited thereto.

[0154] In this embodiment, processing module 114B is coupled to capture module 111B, storage module 112B, and communication module 113B. When processing module 114B reads at least one program code, it executes the following steps: It obtains a score corresponding to terminal device 110B based on an algorithm; and when the score corresponding to terminal device 110B is higher than the score corresponding to another terminal device 120B in the preset space DPB, it transmits the data captured by capture module 111B and the data captured by the other terminal device 120B in the preset space to remote host 90B via communication module 113B.

[0155] For example, the processing module 114B can be electrically connected or communicatively coupled to the capture module 111B, the storage module 112B, and the communication module 113B, and the processing module 114B can be a central processing unit (CPU), a graphics processing unit (GPU), an accelerated processing unit (APU), a microprocessor, a microcontroller, a digital signal processor (DSP), a field-programmable gate array (FPGA), an application-specific integrated circuit (ASIC), other processing elements, or a combination of the foregoing, but the present disclosure is not limited thereto.

[0156] also, Figure 5 The remote host 90B may correspond to Figure 1 The algorithm of the online conference system 100B may correspond to the scoring algorithm of the online conference system 100. The terminal device 110B and / or the other terminal device 120B may obtain the scores corresponding to the terminal device 110B and / or the other terminal device 120B according to the algorithm. When the score of the terminal device 110B is higher than that of the other terminal device 120B, the communication module 113B of the terminal device 110B may transmit the data captured by the capture module 111B and the data captured by the other terminal device 120B to the remote host 90B, but the present disclosure is not limited to this.

[0157] Furthermore, the higher score of the terminal device 110B than the other terminal device 120B may mean that the performance of the terminal device 110B is better than that of the other terminal device 120B, the terminal device 110B may obtain agent authority to become an agent, and the first terminal device 110 may transmit the video data SV and / or audio data SS obtained by the terminal device 110B and / or the other terminal device 120B to the remote host 90, but the present disclosure is not limited to this.

[0158] In some embodiments, Figure 5 The hardware composition and corresponding operation of the online conference system 100B can be similar to Figure 1 The hardware composition and corresponding operations of the online conference system 100 are concise instructions and will not be repeated here.

[0159] In some embodiments, when the score corresponding to the terminal device 110B is higher than the score corresponding to another terminal device 120B in the preset space, the terminal device 110B obtains the agent authority.

[0160] In this embodiment, when the terminal device 110B obtains the agent authority, the terminal device 110B integrates and manages the data captured by the terminal device 110B and the data captured by the other terminal device 120B.

[0161] In this embodiment, the terminal device 110B automatically synchronizes the time information of the terminal device 110B with the time information of another terminal device 120B according to the agent's authority. The time information includes at least one of the set time zone information, time parameter information, time error information, and camera rollback effect information.

[0162] In some embodiments, the terminal device 110B determines whether the network speed information of the network of the preset space DPB is less than the network speed threshold information according to the network monitoring algorithm.

[0163] In this embodiment, when the terminal device 110B determines that the network speed information of the network environment information is less than the network speed threshold information, the terminal device 110B sets the network resources of the network to be provided to the terminal device 110B first according to the agent authority.

[0164] In one embodiment, Figure 6 The storage module 112B includes an electronic device readable medium.

[0165] For example, the storage module 112B can be an electronic device readable medium, and the electronic device readable medium can be a read-only memory (ROM), a flash memory, a floppy disk, a hard disk, a compact disk (CD), a flash drive, a database accessible by a network, other types of non-transitory computer-readable media, or any other storage media with the same function known to a person of ordinary skill in the art to which the present disclosure belongs, but the present disclosure is not limited thereto.

[0166] In this embodiment, the electronic device can read a medium storing at least one program code, and the at least one program code is read to execute at least the following steps: capturing at least one of the video data SV and the audio data SS in the preset space DPB through a terminal device 110B set in the preset space DPB; obtaining a score corresponding to the terminal device 110B according to an algorithm; and when the score corresponding to the terminal device 110B is higher than the score corresponding to another terminal device 120B in the preset space DPB, it is responsible for transmitting the data captured by the terminal device 110B in the preset space DPB and the data captured by the other terminal device 120B in the preset space DPB to the remote host 90B through the communication module 113B of the terminal device 110B.

[0167] For example, the electronic device can read the media in conjunction with the terminal device 110B in a similar manner. Figure 5 The operation of the online conference system 100B is concise and will not be described in detail here.

[0168] In some embodiments, the electronic device readable medium may be located inside the terminal device 110B or the other terminal device 120B. In some embodiments, the electronic device readable medium may be located outside the terminal device 110B or the other terminal device 120B.

[0169] In one embodiment, the scoring algorithm includes a scoring table. The scoring table includes at least one of a hardware performance score, a feature detection score, and a user-defined score. For example, Figure 5 The operation of the online conference system 100B is similar to Figure 1 The operation of the online conference system 100 is concise and will not be described in detail here.

[0170] In some embodiments, the algorithm of the online conference system 100B can be used in conjunction with an artificial neural network (ANNs) algorithm, a big data algorithm, a generative pre-trained transformers (GPT) algorithm, or a customer service algorithm.

[0171] For example, the online conference system 100B can use a neural-like algorithm to instantly update or expand the content and scores in the scoring form to ensure that the hardware and corresponding scores in the scoring form are updated or expanded, but the present disclosure is not limited to this.

[0172] In one embodiment, the score of the terminal device 110B is related to at least one of a hardware performance score, a feature detection score, and a user-defined score. For example, Figure 5 The operation of the online conference system 100B is similar to Figure 1 The operation of the online conference system 100 is concise and will not be described in detail here.

[0173] In one embodiment, the terminal device 110B includes one of a video conferencing device, a computer device, and a handheld device. For example, Figure 5 The operation of the online conference system 100B is similar to Figure 1 The operation of the online conference system 100 is concise and will not be described in detail here.

[0174] As can be seen from the above-described embodiments of this invention, the following advantages are achieved: The online conference system, online conference control method, terminal device, and electronic device-readable media shown in this embodiment can obtain agent authority through a scoring algorithm, thereby achieving the effect of integrating input or output resource allocation of the terminal device.

[0175] Furthermore, the online conference system, online conference control method, terminal device, and electronic device readable media shown in the embodiments of this case can achieve the effect of timing unification of multiple video conferencing devices by using a specific video conferencing device as a benchmark.

[0176] Although the above embodiments disclose specific embodiments of the present invention, they are not intended to limit the present invention. Those skilled in the art may make various changes and modifications without departing from the principles and spirit of the present invention. Therefore, the scope of protection of the present invention shall be based on that defined by the appended claims.

Claims

1. An online conference system, characterized in that: Include: A first terminal device is disposed in a preset space and has a first capture module for capturing at least one of video data and audio data in the preset space; as well as a second terminal device disposed in the preset space and communicatively coupled to the first terminal device, the second terminal device having a second capture module for capturing at least one of the video data and the audio data in the preset space; The first terminal device obtains a first score according to a scoring algorithm and the first capture module, and the second terminal device obtains a second score according to the scoring algorithm and the second capture module; When the first score is greater than the second score, the first terminal device obtains an agent authority and is responsible for transmitting the data obtained by the first acquisition module and the data obtained by the second acquisition module to a remote host.

2. The online conference system according to claim 1, wherein: The first terminal device controls the second capture module of the second terminal device according to the agent authority.

3. The online conference system according to claim 1, wherein: The first terminal device automatically synchronizes the time information of the second terminal device with the time information of the first terminal device according to the agent's authority; The time information of the second terminal device or the time information of the first terminal device includes at least one of a set time zone information, a time parameter information, a time error information and a camera rollback effect information.

4. The online conference system according to claim 3, wherein: The first terminal device determines whether network speed information of a network in the preset space is less than a network speed threshold information according to a network monitoring algorithm; When the first terminal device determines that the network speed information of the network environment information is less than the network speed threshold information, the first terminal device sets a network resource of the network to be provided to the first terminal device first according to the agent authority.

5. The online conference system according to claim 1, wherein: When the first terminal device obtains the agent authority, the first terminal device is responsible for managing all the terminal devices in the preset space, and integrates the data captured by all the terminal devices in the preset space and transmits the data to the remote host.

6. A method for controlling an online conference, characterized in that: Include: Capturing at least one of a video data and an audio data in a preset space through a plurality of terminal devices arranged in the preset space; Obtaining a score corresponding to each terminal device according to a scoring algorithm; and The scores corresponding to the terminal devices are compared, and a first terminal device corresponding to the one with the largest score is assigned as an agent to manage all the terminal devices in the preset space, integrate the data captured by all the terminal devices in the preset space, and then transmit it to a remote host.

7. The online conference control method according to claim 6, characterized in that: Also includes: Synchronizing the time information of all the terminal devices in the preset space through the agent; The time information includes at least one of a set time zone information, a time parameter information, a time error information and a camera reverse effect information.

8. The online conference control method according to claim 7, wherein: Also includes: Setting an allocation of network resources through the agent; Determining, by the first terminal device according to a network monitoring algorithm, whether network speed information of a network in the preset space is less than a network speed threshold information; as well as When the first terminal device determines that the network speed information of the network environment information is less than the network speed threshold information, the network resource of the network is preferentially provided to the first terminal device according to the agent authority setting through the first terminal device.

9. The online conference control method according to claim 8, characterized in that: Also includes: Integrating the information captured by all the terminal devices in the preset space through the agent; and The agent is responsible for transmitting the integrated captured information to the remote host.

10. A terminal device, located in a preset space and suitable for an online conference, characterized in that: The terminal device is communicatively coupled to another terminal device disposed in the preset space, and the terminal device includes: a capture module for capturing at least one of video data and audio data in the preset space; a storage module storing at least one program code; a communication module, communicatively coupling the other terminal device in the preset space and a remote host; and A processing module is coupled to the capture module, the storage module, and the communication module. When the processing module reads the at least one program code, the processing module performs the following steps: Obtaining a score corresponding to the terminal device according to an algorithm; and When the score corresponding to the terminal device is higher than the score corresponding to the other terminal device in the preset space, the data captured by the capture module and the data captured by the other terminal device in the preset space are transmitted to the remote host through the communication module.

11. The terminal device according to claim 10, wherein When the score corresponding to the terminal device is higher than the score corresponding to the other terminal device in the preset space, the terminal device obtains an agent authority; When the terminal device obtains the agent authority, the terminal device integrates and manages the data captured by the terminal device and the data captured by the other terminal device; wherein the terminal device automatically synchronizes the time information of the terminal device with the time information of the other terminal device according to the agent's authority; The time information of the terminal device or the time information of the other terminal device includes at least one of a set time zone information, a time parameter information, a time error information and a camera rollback effect information.

12. The terminal device according to claim 11, wherein The terminal device determines whether network speed information of a network in the preset space is less than a network speed threshold information according to a network monitoring algorithm; When the terminal device determines that the network speed information of the network environment information is less than the network speed threshold information, the terminal device sets a network resource of the network to be provided to the terminal device in priority according to the agent authority.

13. An electronic device readable medium, characterized in that: The electronic device can read the medium storing at least one program code, and when the at least one program code is read by a processing module, the processing module executes the following steps: capturing at least one of a video data and an audio data in a preset space through a terminal device disposed in the preset space; Obtaining a score corresponding to the terminal device according to an algorithm; and When the score corresponding to the terminal device is higher than the score corresponding to another terminal device in the preset space, the data captured by the terminal device in the preset space and the data captured by the other terminal device in the preset space are transmitted to a remote host through a communication module of the terminal device.

14. The electronic device readable medium according to claim 13, wherein: When the score corresponding to the terminal device is higher than the score corresponding to the other terminal device in the preset space, the terminal device obtains an agent authority; When the terminal device obtains the agent authority, the terminal device integrates and manages the data captured by the terminal device and the data captured by the other terminal device; wherein the terminal device automatically synchronizes the time information of the terminal device with the time information of the other terminal device according to the agent's authority; The time information of the terminal device or the time information of the other terminal device includes at least one of a set time zone information, a time parameter information, a time error information and a camera rollback effect information.

15. The electronic device readable medium according to claim 14, wherein: The terminal device determines whether network speed information of a network in the preset space is less than a network speed threshold information according to a network monitoring algorithm; When the terminal device determines that the network speed information of the network environment information is less than the network speed threshold information, the terminal device sets a network resource of the network to be provided to the terminal device in priority according to the agent authority.

Images