Conference systems and conference equipment
Patent Information
- Application Number
- CN202580003224.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-03-14
- Publication Date
- 2026-11-17
Smart Images

Figure CN123125847A_ABST
Abstract
Description
Conference systems and conference equipment Technical Field
[0001] This application relates to the field of multimedia technology, and more specifically, to a conference system and conference equipment in the field of multimedia technology. Background Technology
[0002] A smart interactive flat panel is a device that integrates functions such as wireless internet access, wireless image transmission, microphone, and speaker. It includes a camera module, microphone module, router module, and main chip. If an external PC (Personal Computer) needs to implement wireless BYOM (Bring Your Own Meeting) functionality, it needs to utilize the camera or microphone module within the smart interactive flat panel. This requires the main chip to handle data forwarding, leading to data transmission latency and poor stability issues. Summary of the Invention
[0003] This application provides a conference system and conference equipment that can reduce the data transmission latency between modules within the conference equipment and improve the data transmission efficiency of the conference system.
[0004] In a first aspect, a conferencing system is provided, applied to a conferencing device. The conferencing device includes a data routing module, a functional module, and a first network communication module. The data routing module is connected to both the first network communication module and the functional module. The first network communication module serves as a wireless access point, enabling the electronic device to connect to the conferencing device on the same communication network via the wireless access point. The electronic device is configured to expose at least one first endpoint corresponding to the functional module. The data routing module is used to receive a first function call instruction sent by the electronic device via the communication network through the first network communication module, and forward the first function call instruction to the functional module. The functional module, upon receiving the first function call instruction, collects first media data, processes the first media data, and sends the processed first media data to the data routing module. The data routing module is used to receive the processed first media data and send the processed first media data via the communication network through the first network communication module to at least one first endpoint of the electronic device, so that the operating system of the electronic device captures the processed first media data and presents the processed first media data to a unified communications application running on the electronic device.
[0005] The above technical solution allows the electronic device to connect to the conference equipment via a wireless access point on the same communication network, enabling data transmission between the electronic device and the conference equipment within the same network. The electronic device is configured to expose at least one first endpoint corresponding to a functional module, allowing its operating system to capture first media data processed by the functional module through this first endpoint. Within the conference equipment, the functional module connects to a data routing module via a new link. The electronic device's first function call command to the functional module within the conference equipment can be transmitted to the functional module via the data routing module, and the first media data collected and processed by the functional module can also be transmitted to the electronic device via the data routing module. Neither the transmission of the first function call command nor the transmission of the processed first media data requires data forwarding through the main chip, reducing data transmission latency and improving data transmission efficiency.
[0006] In conjunction with the first aspect, in some possible implementations, the functional modules include an audio processing module having a first network interface, a data routing module having a second network interface and a third network interface, a first network communication module having a fourth network interface, the first network interface being connected to the second network interface, and the third network interface being connected to the fourth network interface.
[0007] In conjunction with the first aspect, in some possible implementations, the first network interface is one of MDI, PCIE, or RGMII.
[0008] In conjunction with the first aspect, in some possible implementations, the electronic device is configured to expose at least one audio endpoint corresponding to the audio processing module. The first function call instruction includes a first audio function call instruction. A data routing module is configured to receive the first audio function call instruction sent by the first network communication module via a third network interface, and send the first audio function call instruction to the audio processing module via a second network interface. The audio processing module, upon receiving the first audio function call instruction, collects first audio data, processes the first audio data, and sends the processed first audio data to the data routing module via the first network interface. The data routing module receives the processed first audio data and sends it to the first network communication module via the third network interface. The first network communication module sends the processed first audio data to at least one audio endpoint of the electronic device via a communication network, so that the operating system of the electronic device captures the processed first audio data and presents it to a unified communications application running on the electronic device.
[0009] In conjunction with the first aspect, in some possible implementations, the functional modules include a video processing module having a fifth network interface, a data routing module having a sixth and a seventh network interface, a first network communication module having an eighth network interface, the fifth network interface being connected to the sixth network interface, and the seventh network interface being connected to the eighth network interface.
[0010] In conjunction with the first aspect, in some possible implementations, the electronic device is configured to expose at least one video endpoint corresponding to the video processing module. The first function call instruction includes a first video function call instruction. A data routing module is configured to receive the first video function call instruction sent by the first network communication module through a seventh network interface and send the first video function call instruction to the video processing module through a sixth network interface. The video processing module is configured to, after receiving the first video function call instruction, acquire first video data, process the first video data, and send the processed first video data to the data routing module through a fifth network interface. The data routing module is configured to receive the processed first video data and send the processed first video data to the first network communication module through the seventh network interface. The first network communication module is configured to send the processed first video data to at least one video endpoint of the electronic device via a communication network, so that the operating system of the electronic device captures the processed first video data and presents the processed first video data to the unified communications application running on the electronic device.
[0011] In conjunction with the first aspect, in some possible implementations, the fifth network interface is one of MDI, PCIE, or RGMII.
[0012] In conjunction with the first aspect, in some possible implementations, the conference device further includes a processing module connected to the function module; the processing module is used to send a second function call instruction to the function module; the function module is used to collect second media data, process the second media data, and send the processed second media data to the application running on the conference device after receiving the second function call instruction.
[0013] In conjunction with the first aspect, in some possible implementations, the processing module includes a first processing submodule, which is connected to a data routing module. The first processing submodule is used to run a first operating system. The functional module has a first USB interface, which is connected to the first processing submodule. The functional module is configured as a USB device and presented to the first operating system.
[0014] In conjunction with the first aspect, in some possible implementations, the conference system also includes a second network communication module, which is used to connect to an external wireless network. The second network communication module is connected to a data routing module, which runs a second operating system. The network card driver corresponding to the second network communication module runs on the second operating system.
[0015] In conjunction with the first aspect, in some possible implementations, the first operating system is a Windows system, and the first operating system communicates with the data routing module through a virtual network card driver.
[0016] In conjunction with the first aspect, in some possible implementations, a first network communication module is connected to a first external functional module, and the electronic device is configured to expose at least one second endpoint corresponding to the first external functional module; a data routing module is used to receive a third function call instruction sent by the electronic device via a communication network through the first network communication module, and forward the third function call instruction to the first external functional module through the first network communication module; the first external functional module is used to collect third media data after receiving the third function call instruction, process the third media data, and send the processed third media data to the data routing module through the first network communication module; the data routing module is used to receive the processed third media data, forward the processed third media data to at least one second endpoint of the electronic device via a communication network through the first network communication module, so that the operating system of the electronic device captures the processed third media data and presents the processed third media data to the unified communication application running on the electronic device.
[0017] In conjunction with the first aspect, in some possible implementations, the data routing module is connected to a second external functional module, and the electronic device is configured to expose at least one third endpoint corresponding to the first external functional module. The data routing module is used to receive a fourth function call instruction sent by the electronic device via a communication network through a first network communication module, and forward the fourth function call instruction to the second external functional module. The second external functional module is used to collect fourth media data after receiving the fourth function call instruction, process the fourth media data, and send the processed fourth media data to the data routing module. The data routing module is used to receive the processed fourth media data, forward the processed fourth media data via a communication network through the first network communication module to at least one third endpoint of the electronic device, so that the operating system of the electronic device captures the processed fourth media data and presents the processed fourth media data to the unified communications application running on the electronic device.
[0018] In conjunction with the first aspect, in some possible implementations, a first network communication module is connected to a first external functional module, and the electronic device is configured to expose at least one fourth endpoint, which corresponds to the first external functional module and the fused media data of the functional module; a data routing module is used to receive a first composite function call instruction sent by the electronic device through the communication network via the first network communication module, send a fifth function call instruction to the functional module according to the first composite function call instruction, and send a sixth function call instruction to the first external functional module; the functional module is used to collect fourth media data after receiving the fourth function call instruction, process the fourth media data, and obtain processed fourth media data; the first external functional module is used to collect fifth media data after receiving the fifth function call instruction, and process the fifth media data... The system processes and sends the processed fifth media data to the data routing module via the first network communication module. The data routing module receives the processed fifth media data and sends it to the functional module. The functional module also receives the processed fifth media data, performs fusion processing on the processed fifth media data and the processed fourth media data to obtain fused media data, and sends the fused media data to the data routing module. The data routing module receives the fused media data and sends it via the first network communication module through the communication network to at least one fourth endpoint of the electronic device, so that the operating system of the electronic device can capture the fused media data and present it to the unified communications application running on the electronic device.
[0019] In conjunction with the first aspect, in some possible implementations, the data routing module is connected to a second external functional module, and the electronic device is configured to expose at least one fifth endpoint, which corresponds to the second external functional module and the fused media data of the functional module; the data routing module is used to receive a second composite function call instruction sent by the electronic device through a communication network via a first network communication module, send a seventh function call instruction to the functional module according to the second composite function call instruction, and send an eighth function call instruction to the second external functional module; the functional module is used to collect seventh media data after receiving the seventh function call instruction, process the seventh media data, and obtain processed seventh media data; the second external functional module is used to collect eighth media data after receiving the eighth function call instruction, and process the eighth media data... The data is processed, and the processed eighth media data is sent to the data routing module. The data routing module receives the processed eighth media data and sends it to the functional module. The functional module also receives the processed eighth media data, merges the processed seventh media data and the processed eighth media data to obtain merged media data, and sends the merged media data to the data routing module. The data routing module receives the merged media data and sends it through the communication network via the first network communication module to at least one fifth endpoint of the electronic device, so that the operating system of the electronic device can capture the merged media data and present it to the unified communication application running on the electronic device.
[0020] In conjunction with the first aspect, in some possible implementations, the data routing module has a ninth network interface, and the first processing submodule has a tenth network interface, with the ninth and tenth network interfaces connected; the first network communication module is used to receive screen-transmitted image data sent by the electronic device via the communication network, and to send the screen-transmitted image data to the seventh network interface of the data routing module via the eighth network interface; the data routing module is used to send the received screen-transmitted image data to the tenth network interface via the ninth network interface, so that the first processing submodule receives the screen-transmitted image data.
[0021] In conjunction with the first aspect, in some possible implementations, the conference device further includes: a switch; the processing module further includes a second processing submodule for running a third operating system, which is different from the first operating system; and a first USB interface that can be selectively connected to either the first or second processing submodule via the switch.
[0022] In conjunction with the first aspect, among some possible implementations, the third operating system is the Android system.
[0023] Secondly, a conferencing device is provided, comprising: an audio processing module having a first network interface; a data routing module having a second network interface and a third network interface, the second network interface being connected to the first network interface; and a first network communication module for establishing a communication connection with an electronic device, the first network communication module having a fourth network interface, the fourth network interface being connected to the third network interface.
[0024] Thirdly, a conferencing device is provided, including a data routing module, a functional module, and a first network communication module. The data routing module is connected to both the first network communication module and the functional module. The first network communication module serves as a wireless access point, enabling electronic devices to connect to the conferencing device on the same communication network via the wireless access point. The electronic device is configured to expose at least one first endpoint corresponding to the functional module. The functional module is used to collect first media data, process the first media data, and send the processed first media data to the data routing module via a first network protocol. The data routing module is used to receive the processed first media data and send it to the first network communication module via the first network protocol. The first network communication module is used to receive the processed first media data and send it to at least one first endpoint of the electronic device via a communication network through a second network protocol, so that the operating system of the electronic device captures the processed first media data and presents it to a unified communications application running on the electronic device. The second network protocol is a different network protocol from the first network protocol. Attached Figure Description
[0025] Figure 1 is a schematic diagram of a scenario for calling peripheral device functions according to an embodiment of this application;
[0026] Figure 2 is a schematic diagram of a network architecture for conferencing equipment in the prior art;
[0027] Figure 3 is a schematic diagram of the first architecture of the conference equipment provided in an embodiment of this application;
[0028] Figure 4 is a schematic diagram of a second architecture of the conference equipment provided in an embodiment of this application;
[0029] Figure 5 is a schematic diagram of a third architecture of the conference equipment provided in an embodiment of this application;
[0030] Figure 6 is a schematic diagram of the fourth architecture of the conference equipment provided in the embodiments of this application;
[0031] Figure 7 is a schematic diagram of the fifth architecture of the conference equipment provided in the embodiments of this application;
[0032] Figure 8 is a schematic diagram of the sixth architecture of the conference equipment provided in the embodiments of this application;
[0033] Figure 9 is a schematic diagram of the seventh architecture of the conference equipment provided in the embodiments of this application;
[0034] Figure 10 is a schematic diagram of the eighth architecture of the conference equipment provided in the embodiments of this application;
[0035] Figure 11 is a schematic diagram of the ninth architecture of the conference equipment provided in the embodiments of this application. Detailed Implementation
[0036] The technical solutions in this application will be clearly and thoroughly described below with reference to the accompanying drawings. In the description of the embodiments of this application, unless otherwise stated, " / " means "or," for example, A / B can mean A or B. "And / or" in the text is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Furthermore, in the description of the embodiments of this application, "multiple" refers to two or more than two.
[0037] Hereinafter, the terms "first" and "second" are used for descriptive purposes only and should not be construed as implying or suggesting relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature.
[0038] With the rapid development of information technology and the deepening of enterprise digital transformation, electronic meetings have become an important trend. Traditional meeting models often face limitations in time, location, and resources, failing to meet rapidly changing business needs and the requirements for efficient collaboration. The application of video conferencing, online collaboration platforms, and intelligent meeting systems has made cross-regional and cross-departmental communication more convenient.
[0039] Currently, users can conduct video conferences using unified communications software running on personal devices (such as personal computers). However, due to limitations in the performance of personal devices, the quality of their cameras, microphones, and speakers is often low, resulting in a poor meeting experience in large-scale conference scenarios. Commonly used unified communications software includes MyLink Meeting software developed by MyLink Corporation, ZOOM video conferencing software developed by Zoom Video Communications, Microsoft Teams developed by Microsoft Corporation, and Tencent Meeting software developed by Tencent Corporation. These software programs all have the ability to conduct audio and video calls with other participants.
[0040] Based on this, existing wireless screen sharing software or devices have developed a function to call peripheral devices (access peripherals). This function typically integrates seamlessly with the receiving end (such as a smart interactive whiteboard or audio / video equipment in a conference room), allowing users to access the receiving end's own or externally connected functional devices through the peripheral access function of the wireless screen sharing software or device. Users can then run unified communication software on their personal devices to use the accessed functional devices, enabling them to conduct online meetings using devices with superior performance compared to their own devices. This eliminates the limitations of the office location and provides a better online meeting experience.
[0041] Referring to Figure 1, a specific scenario for calling peripheral device functions is described. When multiple people participate in a meeting locally, and one or more people participate remotely via online conferencing software, as shown in Figure 1, which is a schematic diagram of an audio transmission method provided in this embodiment, the offline local users include user A, user B, user C, and user D, and the online remote user includes user E. The offline local users receive visual and auditory information through the conferencing device 104 (such as a smart interactive whiteboard or an all-in-one conferencing terminal). The online remote user's (e.g., user E's) computer and one of the offline terminal devices 101 (e.g., user A's computer) both run conferencing software. The offline microphone and camera collect data and transmit it to the online remote user via the offline terminal device 101 through the conferencing software, enabling the remote user to receive visual and auditory information. The screen projector 103 and the conferencing device 104 can be connected wirelessly or via a wired connection through the connecting cable 102. The connecting cable 102 can be detachably connected to the screen projector 103 or integrally formed with the screen projector 103. When User A needs to display audio and video data from their computer to local and remote users, they typically transmit the audio and video data currently displayed on their computer screen to a smart interactive whiteboard, which then shares it with remote users. This way, both local and remote users can see the content displayed on User A's computer screen. Alternatively, User A can plug a screen sharing device into their computer and transmit the audio and video data currently displayed on their computer screen to the smart interactive whiteboard, which then shares it. If the user wishes to access the microphone M1 within the conference equipment 104 via their computer, they can select the microphone M1 in the conference software, use the microphone M1 to collect audio data, and send it to the computer, thus enabling the computer to access the microphone M1 within the conference equipment 104.
[0042] Figure 2 is a schematic diagram of a network architecture for conferencing equipment in the prior art.
[0043] For example, as shown in Figure 2, the conference device 200 includes: a main chip 201, a camera 202 and a microphone 203 connected to the main chip 201, a wireless transmission module 204 connected to the main chip 201, a network forwarding device 205 connected to the main chip, and a wired transmission module 206 connected to the network forwarding device 205. Since the main chip 201 is connected to the camera 202 or microphone 203, when a computer uses wireless screen sharing software or a wireless screen sharing device to access the camera 202 or microphone 203 within the conference device 200, the main chip 201 is responsible for forwarding all data to be transmitted during the access process (such as access commands, data collected by the camera 202 or microphone 203). However, because the main chip 201 undertakes multiple tasks, including but not limited to operating system management, application processing, and network communication, its resource allocation may be insufficient when real-time forwarding of video and audio data is required, leading to increased data processing and transmission latency and low transmission stability.
[0044] To address the aforementioned issues of data transmission latency and poor stability, this application provides a conferencing system applied to conferencing equipment. The conferencing system may include conferencing equipment, electronic devices, and external functional devices. Within the conferencing equipment, functional modules are connected to a data routing module, which serves as the network data interaction center. When an external PC wants to access the camera or built-in microphone within the conferencing equipment, data forwarding through the main chip is no longer required, thus shortening the communication link. This helps reduce data transmission latency between modules within the conferencing equipment and improves data transmission efficiency.
[0045] Figure 3 is a schematic diagram of the first architecture of the conference equipment provided in the embodiments of this application.
[0046] As exemplarily shown in Figure 3, the conference device 300 includes a data routing module 301, a functional module 302, and a first network communication module 303. The data routing module 301 is connected to both the first network communication module 303 and the functional module 302. The first network communication module 303 serves as a wireless access point, enabling an electronic device 304 to connect to the conference device on the same communication network via the wireless access point. The electronic device 304 is configured to expose at least one first endpoint corresponding to the functional module 302.
[0047] The data routing module 301 is a chip or module dedicated to network data forwarding, with routing and network management functions. For example, the data routing module includes a SOC (System on Chip) core, a PCIe (Peripheral Component Interconnect Express) interface, a USB (Universal Serial Bus) interface, a LAN (Local Area Network) interface, an MDI (Medium Dependent Interface), and an RGMII (Reduced Gigabit Media Independent Interface).
[0048] There are generally two designs for the data routing module 301: using a dedicated routing module chip or a discrete chip solution to implement the routing module function. A dedicated routing module chip is a highly integrated chip specifically designed for routing modules, typically including functional modules such as a processor, switch, and Wi-Fi controller. These chips are usually provided by a single vendor and offer highly optimized performance and low power consumption. A discrete chip solution uses multiple independent chips to implement the routing module function. For example, a main control chip (responsible for processing data packets and route calculations), a data switching chip (responsible for forwarding data packets), and a Wi-Fi controller (responsible for wireless communication) can be used. These chips are independent and connected together via a bus or other interfaces. This embodiment does not specifically limit the design method of the data routing module 301.
[0049] Functional module 302 is a functional module inside the conference equipment 300, used to realize functions such as audio and video acquisition and processing.
[0050] In a specific implementation, functional module 302 and data routing module 301 can be connected through their respective network interfaces. It is understood that since functional module 302 is also connected to data routing module 301, functional module 302 can interact with other modules connected to data routing module 301.
[0051] The first network communication module 303 serves as a wireless access point, enabling electronic devices to establish communication connections with it. For example, the first network communication module can operate in AP mode to establish a communication connection with electronic device 304. In AP mode, the first network communication module 303 acts as a wireless access point, providing network connectivity services to other wireless devices, such as electronic device 304. Therefore, the first network communication module 303 can also be referred to as an AP network card module. The first network communication module 303 is connected to the data routing module 301 through their respective network interfaces.
[0052] In one possible implementation, the data routing module 301 and the first network communication module 303 can be two independent modules, or the data routing module 301 and the first network communication module 303 can be integrated together to form an integrated module. This embodiment does not specifically limit this.
[0053] The electronic device 304 can be an external PC, mobile phone or other device. The electronic device 304 is wirelessly connected to the first network communication module 303 so that the electronic device 304 and the conference equipment 300 are connected to the same communication network and wirelessly transmitted through the communication network.
[0054] As shown in Figure 3, the data routing module 301 is used to receive a first function call instruction sent by the electronic device 304 through the communication network via the first network communication module 303, and forward the first function call instruction to the function module 302. The first function call instruction is the instruction of the electronic device 304 to call the function module 302.
[0055] Understandably, the BYOM function is a common feature in video conferencing scenarios. Both the electronic device 304 and the conferencing device 300 support BYOM. The electronic device 304 can call upon the functional module 302 within the conferencing device 300. For example, when the camera and microphone functions of the electronic device 304 itself are weak, it can call upon the functional module 302 within the conferencing device 300.
[0056] In one possible scenario, when a user enables the BYOM function on electronic device 304, the selection button for function module 302 can be displayed on the interface of electronic device 304. If electronic device 304 detects that the user has triggered the selection button for function module 302, then electronic device 304 sends a first function call instruction to conference device 300. Specifically, when electronic device 304 detects that the user has triggered the selection button for function module 302, it sends a first function call instruction to first network communication module 303. First network communication module 303 sends the first function call instruction to data routing module 301, and data routing module 301 then forwards the received first function call instruction to function module 302.
[0057] Functional module 302 is used to collect first media data, process the first media data, and send the processed first media data to data routing module 301 after receiving the first function call instruction. Data routing module 301 is used to receive the processed first media data and send the processed first media data to electronic device 304 through first network communication module 303.
[0058] The functional module 302 can process the first media data by performing noise reduction, encoding, etc., and the electronic device 304 decodes and plays the processed first media data after receiving it.
[0059] Since the first function call instruction is sent by electronic device 304, indicating that electronic device 304 wants to call function module 302, data routing module 301 sends the processed first media data to electronic device 304 to realize the function module 302 call of electronic device 304.
[0060] The electronic device 304 can expose at least one first endpoint through hardware or software, and the first endpoint corresponds to the functional module 302. The first endpoint can be described as a data source or data trap, which can be implemented in hardware, such as by physically connecting the electronic device 304 to a peripheral device (e.g., a wireless screen sharing device). This peripheral device exposes the first endpoint corresponding to the functional module 302, allowing processed first media data to be exposed to the electronic device 304. The operating system of the electronic device can then capture the processed first media data and present it to the unified communication software running on the electronic device 304, enabling users to access the processed first media data through the unified communication software. Commonly used unified communication software includes Mylink Meeting software developed by Mylink Corporation, ZOOM video conferencing software developed by Zoom Video Communications, Microsoft Teams developed by Microsoft Corporation, and Tencent Meeting software developed by Tencent Corporation. These software programs all have the ability to conduct audio and video calls with other participants. The endpoint can be a USB endpoint, which can be defined through multiple descriptive fields. For example, a USB endpoint can be configured to support different transfer types, such as Control Transfer, Interrupt Transfer, Isochronous Transfer, and Bulk Transfer. In this embodiment, those skilled in the art can configure the first endpoint as different types of endpoints according to actual needs, such as control transmission endpoint, interrupt transmission endpoint, synchronous transmission endpoint, and bulk transmission endpoint.
[0061] Understandably, the first endpoint can be interpreted as a buffer that can be defined for either a physical or virtual device. Processed first media data can be stored at or transmitted from the first endpoint. The processed first media data stored at the endpoint can be presented to the unified communications software running on the transmitting electronic device 304. The first endpoint can also be implemented in software. For example, the operating system of the electronic device can generate a device corresponding to a functional module by loading a generic driver or vendor-customized driver installed on the electronic device. Alternatively, the operating system can generate a virtual UAC and / or UVC device by loading a generic driver or vendor-customized driver installed on the electronic device. The virtual UAC and / or UVC device can be understood as the first endpoint receiving the processed first media data. The conferencing device can send the processed first media data to the first endpoint via the communication network, allowing the processed first media data to be exposed to the electronic device 304. This enables the operating system of the electronic device to capture the processed first media data and present it to the unified communications software running on the electronic device 304, allowing the user to use the processed first media data through the unified communications software.
[0062] The above technical solution allows the electronic device to connect to the conference equipment via a wireless access point provided by the conference equipment, enabling data transmission between the electronic device and the conference equipment within the same communication network. The electronic device is configured to expose at least one first endpoint corresponding to a functional module, allowing the electronic device's operating system to capture first media data processed by the functional module through this first endpoint. Within the conference equipment, the functional module is connected to a data routing module via a new link. The electronic device's first function call command to the functional module within the conference equipment can be transmitted to the functional module via the data routing module, and the first media data collected and processed by the functional module can also be transmitted to the electronic device via the data routing module. Neither the transmission of the first function call command nor the transmission of the processed first media data requires data forwarding through the main chip, reducing data transmission latency and improving data transmission efficiency. Furthermore, since data forwarding through the main chip is unnecessary, the BYOM function is decoupled from the main chip. The main chip of the conference equipment may be a pluggable PC module. Because the BYOM function in this embodiment is decoupled from the main chip, the BYOM function can be used without a PC module.
[0063] Figure 4 is a schematic diagram of a second architecture of the conference equipment provided in an embodiment of this application.
[0064] In some embodiments, as shown in FIG4, the conferencing device 400 includes: a data routing module 301, a functional module 302, and a first network communication module 303. The functional module 302 includes an audio processing module 3021, which has a first network interface 11. The data routing module 301 has a second network interface 12 and a third network interface 13. The first network communication module 303 has a fourth network interface 14. The first network interface 11 is connected to the second network interface 12, and the third network interface 13 is connected to the fourth network interface 14.
[0065] Among them, the first network interface 11, the second network interface 12, the third network interface 13 and the fourth network interface 14 can follow the same type of network protocol, such as the IP network protocol, so as to avoid the need for network protocol conversion during audio-related data transmission and further improve the data transmission rate.
[0066] For example, the functional module can collect first media data, process the first media data, and send the processed first media data to the data routing module via a first network protocol; the data routing module is used to receive the processed first media data and send the processed first media data to the first network communication module via the first network protocol; the first network communication module is used to receive the processed first media data and send the processed first media data to at least one first endpoint of the electronic device via a communication network through a second network protocol, so that the operating system of the electronic device can capture the processed first media data and present the processed first media data to the unified communication application running on the electronic device. The second network protocol and the first network protocol are different network protocols. Among them, the network protocol between the functional module and the data routing module, and the network protocol between the data routing module and the first network communication module can both be IP network protocols. Compared with the prior art, where the transmission between the main chip and the data routing module uses the USB protocol, and the transmission between the data routing module and the first network communication module uses a network protocol, the first media data in this embodiment can directly use the same network protocol to flow between the functional module, the data routing module, and the first network communication module without the need for conversion according to different protocols, which can reduce the latency of the first media data transmission process. In addition, the network protocol between the first network communication module and the electronic device can be a wireless network protocol, such as the Wi-Fi protocol.
[0067] In some embodiments, the first network interface 11 is one of MDI, PCIE, or RGMII. As can be seen from the above, the interface of the data routing module 301 typically includes PCIE, MDI, RGMII, etc. Based on this, the audio processing module 3021 has an interface of the same type as the data routing module 301, enabling the audio processing module 3021 and the data routing module 301 to transmit data through the same type of network interface.
[0068] In some embodiments, the electronic device 304 is configured to expose at least one audio endpoint corresponding to the audio processing module 3021, the first function call instruction includes a first audio function call instruction, and the first media data includes first audio data; as shown in FIG4, the data routing module 301 is used to receive the first audio function call instruction sent by the first network communication module 303 through the third network interface 13, and send the first audio function call instruction to the audio processing module 3021 through the second network interface 12.
[0069] The audio processing module 3021 is used to collect first audio data after receiving the first audio function call instruction, process the first audio data, and send the processed first audio data to the data routing module 301 through the first network interface 11.
[0070] For example, the audio processing module 3021 includes an audio acquisition module and a DSP module (Digital Signal Processor). The audio acquisition module has the function of acquiring audio, specifically a microphone. The DSP module has the function of audio processing, which can process the first audio data acquired by the audio acquisition module.
[0071] The data routing module 301 is used to receive the processed first audio data and send the processed first audio data to the first network communication module 303 through the third network interface 13.
[0072] The first network communication module 303 is used to send the processed first audio data to at least one audio endpoint of the electronic device 304 via the aforementioned communication network, so that the operating system of the electronic device 304 can capture the processed first audio data and present the processed first audio data to the unified communications application running on the electronic device 304.
[0073] The electronic device 304 can expose at least one first audio endpoint through hardware or software. The at least one first audio endpoint corresponds to the audio processing module 3021. The first audio endpoint can be described as a data source or data trap, which can be implemented through hardware or software.
[0074] For example, electronic device 304 can physically connect to the USB interface of a peripheral device (such as a wireless screen sharing device) via a USB interface. The peripheral device is enumerated into audio devices (such as speaker devices or microphone devices) and presented to the electronic device via the USB interface. The first audio endpoint described in this application embodiment can be understood as the audio device or an endpoint of the audio device. The audio device can be used to receive processed first audio data sent by the conferencing device and present the processed first audio data to the unified communication software through the audio device, so that users can directly use the audio processing module 3021 of the conferencing device to start online meetings in the unified communication software. The first audio endpoint can be a USB endpoint, which can be defined by multiple descriptive fields. For example, the USB endpoint can be configured to support different transmission types, such as control transfer, interrupt transfer, isochronous transfer, and bulk transfer. In this embodiment, those skilled in the art can configure the first audio endpoint as different types of endpoints according to actual needs, such as control transfer endpoint, interrupt transfer endpoint, isochronous transfer endpoint, and bulk transfer endpoint.
[0075] Of course, the first audio endpoint can also be implemented in software, such as by the operating system of an electronic device loading a general audio driver or a vendor-customized audio driver installed on the electronic device to generate a virtual audio device corresponding to the audio processing module.
[0076] Understandably, the first audio endpoint can be understood as an audio buffer that can be defined for a physical or virtual device. The processed first audio data can be stored at or emitted from the first audio endpoint. The processed first audio data stored at the first audio endpoint can be presented to the unified communications software running on the transmitting electronic device 304.
[0077] In one possible scenario, when a user activates the BYOM function on electronic device 304, an audio selection button can be displayed on the interface of electronic device 304. If electronic device 304 detects that the user has triggered the selection button of audio processing module 3021, electronic device 304 sends a call command to audio processing module 3021 (i.e., a first audio function call command) to conferencing device 400. Specifically, when electronic device 304 detects that the user has triggered the selection button of audio processing module 3021, it sends a first audio function call command to first network communication module 303. First network communication module 303 sends the first audio function call command to third network interface 13 of data routing module 301 through fourth network interface 14. Data routing module 301 sends the received first audio function call command to audio processing module 3021 through second network interface 12. After receiving the first audio function call command, audio processing module 3021 collects first audio data, processes the first audio data, and sends the processed first audio data to data routing module 301 through first network interface 11. The data routing module 301 receives and processes the first audio data and sends it to the first network communication module 303 through the third network interface 13. Finally, the first network communication module 303 sends the processed first audio data to the electronic device 304, so that the electronic device 304 can call the audio processing module 3021.
[0078] In the above implementation, the audio processing module is connected to the data routing module via a new link. The first audio function call command from the electronic device to the built-in audio processing module can be transmitted to the audio processing module through the data routing module, and the first audio data collected and processed by the audio processing module can also be transmitted to the electronic device through the data routing module. Neither the transmission of the first audio function call command nor the transmission of the first audio data requires data forwarding through the main chip, which reduces audio data transmission latency and improves audio data transmission efficiency.
[0079] In some embodiments, as shown in FIG4, the functional module 302 includes a video processing module 3022, the video processing module 3022 having a fifth network interface 15, the data routing module 301 having a sixth network interface 16 and a seventh network interface 17, and the first network communication module 303 having an eighth network interface 18. The fifth network interface 15 is connected to the sixth network interface 16, and the seventh network interface 17 is connected to the eighth network interface 18.
[0080] Among them, the fifth network interface 15, the sixth network interface 16, the seventh network interface 17 and the eighth network interface 18 can follow the same network protocol to avoid the need for network protocol conversion during video-related data transmission and further improve the data transmission rate.
[0081] In some embodiments, the fifth network interface 15 is one of MDI, PCIE, or RGMII. As can be seen from the above, the interface of the data routing module 301 typically includes PCIE, MDI, RGMII, etc. Based on this, the video processing module 3022 has an interface of the same type as the data routing module 301, enabling the video processing module 3022 and the data routing module 301 to transmit data through the same type of network interface.
[0082] In some embodiments, the electronic device 304 is configured to expose at least one video endpoint corresponding to the video processing module 3022, the function call instruction includes a first video function call instruction, and the first media data includes first video data. As shown in FIG4, the data routing module 301 is used to receive the first video function call instruction sent by the first network communication module 303 through the seventh network interface 17, and to send the first video function call instruction to the video processing module 3022 through the sixth network interface 16.
[0083] The video processing module 3022 is used to collect first video data, process the first video data, and send the processed first video data to the data routing module 301 through the fifth network interface 15 after receiving the first video function call instruction.
[0084] For example, the video processing module 3022 includes a video acquisition module and an ISP module (Image Signal Processor). The video acquisition module has video acquisition function, specifically a camera, while the ISP module has video processing function, which can process the first video data acquired by the video acquisition function.
[0085] The data routing module 301 is used to receive the processed first video data and send the processed first video data to the first network communication module 303 through the seventh network interface 17.
[0086] The first network communication module 303 is used to send the processed first video data to at least one video endpoint of the electronic device 304 via the aforementioned communication network, so that the operating system of the electronic device 304 can capture the processed first video data and present the processed first video data to the unified communications application running on the electronic device 304.
[0087] Specifically, electronic device 304 can expose at least one first video endpoint through hardware or software means, and the at least one first video endpoint corresponds to video processing module 3022. The first video endpoint can be described as a data source or data trap, which can be implemented through hardware or software.
[0088] For example, electronic device 304 can physically connect to the USB interface of a peripheral device (such as a wireless screen sharing device) via a USB interface. The peripheral device is enumerated into video devices (such as camera devices) and presented to the electronic device through the USB interface. The first video endpoint described in this application embodiment can be understood as the video device or an endpoint of the video device. The video device can be used to receive processed first video data sent by the conferencing device and present the processed first video data to the unified communication software through the video device, so that users can directly use the video processing module 3022 of the conferencing device to start online meetings in the unified communication software. The first video endpoint can be a USB endpoint, which can be defined by multiple descriptive fields. For example, the USB endpoint can be configured to support different transmission types. In this embodiment, those skilled in the art can configure the first video endpoint as different types of endpoints according to actual needs, such as control transmission endpoint, interrupt transmission endpoint, synchronous transmission endpoint, and batch transmission endpoint.
[0089] Of course, the first video endpoint can also be implemented in software, such as by the operating system of an electronic device loading a general video driver or a vendor-customized video driver installed on the electronic device to generate a virtual video device corresponding to the video processing module.
[0090] Understandably, the first video endpoint can be understood as a video buffer that can be defined for a physical or virtual device. The processed first video data can be stored at or emitted from the first video endpoint. The processed first video data stored at the first video endpoint can be presented to the unified communications software running on the transmitting electronic device 304.
[0091] In one possible scenario, when a user activates the BYOM function on electronic device 304, a video selection button can be displayed on the interface of electronic device 304. If electronic device 304 detects that the user has triggered the selection button of video processing module 3022, electronic device 304 sends a call command to video processing module 3022 (i.e., a first video function call command) to conferencing device 400. Specifically, when electronic device 304 detects that the user has triggered the selection button of video processing module 3022, it sends a first video function call command to first network communication module 303. First network communication module 303 sends the first video function call command to seventh network interface 17 of data routing module 301 through eighth interface 18. Data routing module 301 sends the received first video function call command to video processing module 3022 through sixth network interface 16. After receiving the first video function call command, processing module 3022 collects first video data, processes the first video data, and sends the processed first video data to data routing module 301 through fifth network interface 15. The data routing module 301 sends the received processed first video data to the first network communication module 303 through the seventh network interface 17. Finally, the first network communication module 303 sends the processed first video data to the electronic device 304, so that the electronic device 304 can call the video processing module 3022.
[0092] In the above implementation, the video processing module is connected to the data routing module via a new link. The electronic device's first video function call command to the built-in video processing module can be transmitted to the video processing module through the data routing module, and the first video data acquired and processed by the video processing module can also be transmitted to the electronic device through the data routing module. Neither the transmission of the first video function call command nor the transmission of the first video data requires data forwarding through the main chip, which reduces video data transmission latency and improves video data transmission efficiency.
[0093] Figure 5 is a schematic diagram of the third architecture of the conference equipment provided in the embodiments of this application.
[0094] As exemplarily shown in Figure 5, the conference device 500 includes: a data routing module 301, a function module 302, a first network communication module 303, and a processing module 501, wherein the processing module 501 is connected to the function module 302. The processing module can be understood as the main chip of the conference device 500, and the processing module runs an operating system.
[0095] Processing module 501 is used to send a second function call instruction to function module 302; function module 302, upon receiving the second function call instruction, collects second media data, processes the second media data, and sends the processed second media data to an application running on the conferencing device, which can be video conferencing software. The second function call instruction is a call instruction from processing module 501 to function module 302.
[0096] In one possible scenario, the operating system of the conferencing device 500 runs in the processing module 501. When an application (such as video conferencing software, screen recording tools, etc.) needs to access media data, it can send a request to the processing module 501. After receiving the request, the processing module 501 sends a second function call instruction to the function module 302. For example, if the conferencing device 500 is a smart interactive whiteboard, and the user starts a video conferencing application on the whiteboard and selects "Join Meeting," the video conferencing application sends a request to the processing module 501 to enable the function module 302. After receiving the request, the processing module 501 sends a second function call instruction to the function module 302. After receiving the second function call instruction, the function module 302 collects and processes the second media data, and sends the processed second media data to the processing module 501, thus enabling the processing module 501 to call the function module 302.
[0097] In some embodiments, the second function call instruction includes a second audio function call instruction, and the second media data includes second audio data. The processing module 501 is configured to send the second audio function call instruction to the audio processing module within the function module. The audio processing module, upon receiving the second audio function call instruction, acquires the second audio data, processes the second audio data, and sends the processed second audio data to the processing module 501, thereby enabling the processing module 501 to call the audio processing module.
[0098] In some embodiments, the second function call instruction includes a second video function call instruction, and the second media data includes second video data. The processing module 501 is configured to send the second video function call instruction to the video processing module within the function modules. The video processing module, upon receiving the second video function call instruction, acquires the second video data, processes the second video data, and sends the processed second video data to the processing module 501, thereby enabling the processing module 501 to call the video processing module.
[0099] Figure 6 is a schematic diagram of the fourth architecture of the conference equipment provided in the embodiments of this application.
[0100] For example, as shown in Figure 6, the conference device 600 includes: a data routing module 301, a function module 302, a first network communication module 303, and a processing module 501. The processing module 501 includes a first processing submodule 5011, which is connected to the data routing module 301 and is used to run a first operating system. The function module 302 has a first USB interface 31, which is connected to the first processing submodule 5011. The function module 302 is configured as a USB device presented to the first operating system.
[0101] The primary operating system can be Windows or a domestically developed operating system, such as Kylin OS or UnionTech OS.
[0102] As shown in Figure 6, the first processing submodule 5011 has a second USB interface 32, which is connected to the first USB interface 31. Considering that some conferencing software may specify that the first operating system can only recognize USB devices, the functional module 302 is configured to present a USB device to the first operating system, which can meet the needs of conferencing software with special requirements.
[0103] In one possible implementation, as shown in Figure 6, the data routing module 301 has a ninth network interface 19, and the first processing submodule 5011 has a tenth network interface 10. The ninth network interface 19 and the tenth network interface 10 are connected. The first network communication module 303 is used to receive screen-transmitted image data sent by the electronic device 304 through the aforementioned communication network, and to send the screen-transmitted image data 304 to the seventh network interface 17 of the data routing module through the eighth network interface 18. The data routing module 301 is used to send the received screen-transmitted image data to the tenth network interface 10 through the ninth network interface 19, so that the first processing submodule 5011 can receive the screen-transmitted image data.
[0104] Figure 7 is a schematic diagram of the fifth architecture of the conference equipment provided in the embodiments of this application.
[0105] As exemplarily shown in Figure 7, the conference device 700 includes: a data routing module 301, a function module 302, a first network communication module 303, a processing module 501, and a switch 701. The function module 302 has a first USB interface 31. The processing module 501 includes a first processing submodule 5011 and a second processing submodule 5012. The second processing submodule 5012 is used to run a third operating system, which is different from the first operating system run by the first processing submodule 5011. The first USB interface 31 can be selectively connected to either the first processing submodule 5012 or the second processing submodule 5012 via the switch 701.
[0106] In one possible implementation, the third operating system is Android.
[0107] As shown in Figure 7, the first processing submodule 5011 has a second USB interface 32, and the second processing submodule 5012 has a third USB interface 33.
[0108] When the first operating system is running, the first USB interface 31 is connected to the second USB interface 32 via a switch 701, thereby connecting the first processing submodule 5011 and the function module 302 and enabling data transmission between them. Data transmission between the first processing submodule 5011 and the function module 302 may include: the first processing submodule 5011 sending a second function call command to the function module 302 via the second USB interface 32; upon receiving the second function call command, the function module 302 collecting second media data, processing the second media data, and sending the processed second media data back to the first processing submodule 5011 via the first USB interface 31 and the switch 701.
[0109] When the third operating system is running, the first USB interface 31 is connected to the third USB interface 33 via a switch 701, thereby connecting the second processing submodule 5012 and the function module 302 and enabling data transmission between them. Data transmission between the second processing submodule 5012 and the function module 302 may include: the second processing submodule 5012 sending a second function call command to the function module 302 via the third USB interface 33; upon receiving the second function call command, the function module 302 collecting second media data, processing the second media data, and sending the processed second media data to the second processing submodule 5012 via the first USB interface 31 and the switch 701.
[0110] Understandably, all submodules connected to the data routing module can communicate with each other based on network protocols. Since the first and second processing submodules are connected to the same data routing module, they are on the same IP address network segment. Therefore, no additional NAT (Network Address Translation) data forwarding configuration is required during data exchange, which is beneficial for improving data transmission efficiency and reducing network architecture complexity in a dual-operating system environment.
[0111] Figure 8 is a schematic diagram of the sixth architecture of the conference equipment provided in the embodiments of this application.
[0112] For example, as shown in Figure 8, the conference device 800 includes: a data routing module 301, a functional module 302, a first network communication module 303, and a second network communication module 801. The second network communication module 801 is used to connect to an external wireless network. The second network communication module 801 is connected to the data routing module 301, and the data routing module 301 runs a second operating system. The network card driver corresponding to the second network communication module 801 runs on the second operating system.
[0113] The second network communication module 801 provides wireless communication capabilities to the conference equipment 800. The second network communication module 801 can also be called an internet access card module, such as a WiFi module, Bluetooth module, or other wireless communication module, to provide WiFi, Bluetooth, and other wireless connectivity capabilities to the conference equipment. In Figure 8, the second network communication module 801 is wirelessly connected to an external router 802 to enable the conference equipment 800 to connect to the internet.
[0114] The second network communication module 801 typically operates in STATION mode (also known as client mode). STATION mode and AP mode are the two main operating modes of wireless network devices. In STATION mode, the second network communication module 801 connects to the external router 802 as the wireless access point, and the conference device 800 accesses network resources or the Internet through this external router 802 access point.
[0115] The second operating system can be a Linux operating system. Since the second network communication module 801 is connected to the data routing module 301, the network card driver corresponding to the second network communication module 801 runs on the Linux operating system. The network card driver corresponding to the second network communication module 801 can be understood as a software component running on the data routing module 301, responsible for communicating with the second network communication module 801 and handling tasks such as data transmission, hardware initialization, and parameter configuration. When the data routing module 301 starts up, its Linux operating system loads the network card driver corresponding to the second network communication module 801.
[0116] The above implementation connects the second network communication module to the data routing module. The data routing module runs a second operating system, and the network card driver corresponding to the second network communication module also runs on the second operating system. Since the data routing module generally runs a Linux operating system (the second operating system), and most existing network communication modules on the market support this Linux operating system, the problem of limited selection of the second network communication module is avoided, thus expanding the selection range of the second network communication module.
[0117] For example, the first operating system is a Windows system, and the first operating system communicates with the data routing module 301 through a virtual network card driver.
[0118] A virtual network interface driver (NIC) is a software-implemented network interface that simulates the behavior of a physical NIC within the first operating system. The NIC driver runs within the first operating system kernel, handling the sending and receiving of data packets and enabling communication between the first operating system and the data routing module 301.
[0119] Figure 9 is a schematic diagram of the seventh architecture of the conference equipment provided in the embodiments of this application.
[0120] For example, as shown in FIG9, the conference device 900 is similar to the conference device 300 described above, except that the first network communication module 303 in the conference device 900 is connected to a first external functional module 901. This first external functional module 901 is an external functional module of the conference device 900, and may specifically be an external device such as an external microphone, external speaker, or external camera. The electronic device 304 is configured to expose at least one second endpoint corresponding to the first external functional module 901.
[0121] In one possible implementation, as shown in Figure 9, the data routing module 301 is used to receive the third function call instruction sent by the electronic device 304 through the communication network via the first network communication module 303, and forward the third function call instruction to the first external function module 901 through the first network communication module 303. The third function call instruction is the call instruction from the electronic device 304 to the first external function module 901.
[0122] The first external function module 901 is used to collect third media data after receiving the third function call instruction, process the third media data, and send the processed third media data to the data routing module 301 through the first network communication module 303.
[0123] The data routing module 301 is used to receive the processed third media data, forward the processed third media data to at least one second endpoint of the electronic device 304 via the first network communication module 303 through the aforementioned communication network, so that the operating system of the electronic device 304 can capture the processed third media data and present the processed third media data to the unified communications application running on the electronic device 304.
[0124] The electronic device 304 can expose at least one second endpoint via hardware or software, and this second endpoint corresponds to the first external functional module 901. The second endpoint can be described as a data source or data trap, and can be implemented in hardware, such as by physically connecting the electronic device 304 to a peripheral device (e.g., a wireless screen mirroring device). This peripheral device exposes the second endpoint corresponding to the first external functional module 901, allowing the processed third media data to be exposed to the electronic device 304. The operating system of the electronic device can then capture the processed third media data and present it to the unified communication software running on the electronic device 304, enabling users to access the processed third media data through the unified communication software. The unified communication application is described above and will not be repeated here.
[0125] It is understandable that the second endpoint can be interpreted as a buffer that can be defined for physical or virtual devices. Processed third media data can be stored at or transmitted from the second endpoint. The processed third media data stored at the second endpoint can be presented to the unified communications software running on the transmitting electronic device 304. The second endpoint can also be implemented in software. For example, the operating system of the electronic device can generate a device corresponding to a functional module by loading a generic driver or vendor-customized driver installed on the electronic device. Alternatively, the operating system can generate a virtual UAC and / or UVC device by loading a generic driver or vendor-customized driver installed on the electronic device. The virtual UAC and / or UVC device can be understood as the second endpoint receiving the processed third media data. The conferencing device can send the processed third media data to the second endpoint via the communication network, allowing the processed third media data to be exposed to the electronic device 304 through the second endpoint. This enables the operating system of the electronic device to capture the processed third media data and present it to the unified communications software running on the electronic device 304, allowing the user to use the processed third media data through the unified communications software.
[0126] In the embodiment shown in Figure 9, the first network communication module 303 is wirelessly connected to the first external functional module 901, so that the first network communication module 303 and the first external functional module 901 can wirelessly transmit data, and the first external functional module 901 and the data routing module 301 can achieve wireless data transmission through the first network communication module 303.
[0127] In the above implementation method, the electronic device can choose to call only the first external function module according to actual needs, so as to realize data collection and processing over a large range, improve the performance of the conference equipment in a larger space, and help meet the personalized needs of users.
[0128] Figure 10 is a schematic diagram of the eighth architecture of the conference equipment provided in the embodiments of this application.
[0129] For example, as shown in Figure 10, the conference device 1000 is similar to the conference device 300 described above, except that the data routing module 301 in the conference device 1000 is connected to a second external functional module 1001. The connection between the data routing module 301 and the second external functional module 1001 is a wired connection, enabling wired data transmission between the second external functional module 1001 and the data routing module 301. The second external functional module 1001 is an external functional module of the conference device 800, specifically an external device such as an external microphone, external speaker, or external camera. The electronic device 304 is configured to expose at least one third endpoint corresponding to the second external functional module 1001.
[0130] In one possible implementation, as shown in Figure 10, the data routing module 301 is used to receive the fourth function call instruction sent by the electronic device 304 via the communication network through the first network communication module 303, and forward the fourth function call instruction to the second external function module. The fourth function call instruction is a call instruction from the electronic device 304 to the second external function module 1001. Since there is a wired connection between the data routing module 301 and the second external function module 1001, the data routing module 301 can directly send the fourth function call instruction to the second external function module 1001.
[0131] The second external function module 1001 is used to collect fourth media data, process the fourth media data, and send the processed fourth media data to the data routing module 301 after receiving the fourth function call instruction. The data routing module 301 is used to receive the processed fourth media data, forward the processed fourth media data to at least one third endpoint of the electronic device 304 through the communication network via the first network communication module 303, so that the operating system of the electronic device 304 can capture the processed fourth media data and present the processed fourth media data to the unified communication application running on the electronic device 304, so as to realize the call of the second external function module 1001 by the electronic device 304.
[0132] The electronic device 304 can expose at least one third endpoint through hardware or software, and the at least one third endpoint corresponds to the second external functional module 1001. The way the electronic device 304 exposes the third endpoint is similar to the way the electronic device 304 exposes the second endpoint, and will not be described again here to avoid repetition.
[0133] In the above implementation method, the electronic device can choose to call only the second external function module according to actual needs, so as to realize data collection and processing over a large range, improve the performance of the conference equipment in a larger space, and help meet the personalized needs of users.
[0134] In one possible implementation, as shown in Figure 9, the first network communication module 303 is connected to the first external functional module 901. The electronic device 304 is configured to expose at least one fourth endpoint, which corresponds to the fused media data of the first external functional module 901 and the functional module 302.
[0135] The data routing module 301 is used to receive the first composite function call instruction sent by the electronic device 304 through the communication network via the first network communication module 303, send the fifth function call instruction to the function module 302 according to the first composite function call instruction, and send the sixth function call instruction to the first external function module 901. Functional module 302 is used to collect fourth media data and process the fourth media data after receiving a fourth function call instruction to obtain processed fourth media data. First external functional module 901 is used to collect fifth media data, process the fifth media data, and send the processed fifth media data to data routing module 301 via a first network communication module after receiving a fifth function call instruction. Data routing module 301 is used to receive the processed fifth media data and send it to functional module 302. Functional module 302 is also used to receive the processed fifth media data, perform fusion processing on the processed fifth media data and the processed fourth media data to obtain fused media data, and send the fused media data to data routing module 301. Data routing module 301 is used to receive the fused media data and send it via the first network communication module 303 through the communication network to at least one fourth endpoint of electronic device 304, so that the operating system of electronic device 304 captures the fused media data and presents it to the unified communication application running on electronic device 304.
[0136] The electronic device 304 can expose at least one fourth endpoint through hardware or software. This fourth endpoint corresponds to the fused media data from the first external functional module 901 and functional module 302. The fourth endpoint can be described as a data source or data trap, and can be implemented in hardware, such as by physically connecting the electronic device 304 to a peripheral device (e.g., a wireless screen mirroring device). This peripheral device exposes the fourth endpoint corresponding to functional module 302, allowing the fused media data to be exposed to the electronic device 304. The operating system of the electronic device can then capture the fused media data and present it to the unified communication software running on the electronic device 304, enabling users to access the fused media data through the unified communication software. Commonly used unified communication software is described above and will not be repeated here.
[0137] It is understandable that the fourth endpoint can be interpreted as a buffer that can be defined for physical or virtual devices. The merged media data can be stored at or transmitted from the fourth endpoint. The merged media data stored at the endpoint can be presented to the unified communications software running on the transmitting electronic device 304. The fourth endpoint can also be implemented in software. For example, the operating system of the electronic device can generate a device corresponding to a functional module by loading a generic driver or vendor-customized driver installed on the electronic device. Alternatively, the operating system can generate a virtual UAC and / or UVC device by loading a generic driver or vendor-customized driver installed on the electronic device. The virtual UAC and / or UVC device can be understood as the fourth endpoint receiving the merged media data. The conferencing device can send the merged media data to the fourth endpoint via the communication network, allowing the merged media data to be exposed to the electronic device 304. This enables the operating system of the electronic device to capture the merged media data and present it to the unified communications software running on the electronic device 304, allowing the user to use the merged media data through the unified communications software.
[0138] In one possible scenario, considering the limited acquisition range of functional module 302 (e.g., acquiring media data within a 4-5 meter range), but if the meeting scene is large, the limited acquisition range of functional module 302 may be insufficient to cover the entire meeting scene. In this case, it can be combined with the first external functional module 901 to expand the acquisition range, enabling functional module 302 to acquire data from the entire meeting scene. Since functional module 302 and the first external functional module 901 are two independent devices, there may be a time difference between the data acquired by the two independent devices. Therefore, it is necessary to perform time synchronization processing on the data acquired by the two devices. The aforementioned fusion processing of the processed fifth media data and the processed fourth media data specifically involves performing time synchronization processing on the processed fifth media data and the processed fourth media data, using the synchronized media data as the fused media data.
[0139] In one possible scenario, when a user activates the BYOM function on electronic device 304, a function selection button, such as a multi-function selection button, can be displayed on the interface of electronic device 304. If electronic device 304 detects that the user has triggered the multi-function selection button, it indicates that both function module 302 and the first external function module 901 need to be invoked simultaneously. At this time, electronic device 304 sends a first multi-function call instruction to the first network communication module 303, which then sends the instruction to the data routing module 301. After receiving the instruction, the data routing module 301 sends a fifth function call instruction to function module 302 and a sixth function call instruction to the first external function module 901 via the first network communication module 303. The processing method of function module 302 after receiving the fifth instruction has been described above and will not be repeated here to avoid repetition. The processing method of the first external function module 901 after receiving the sixth instruction has also been described above and will not be repeated here to avoid repetition.
[0140] In one possible implementation, as shown in Figure 10, the data routing module 301 is connected to the second external functional module 1001. The electronic device 304 is configured to expose at least one fifth endpoint, which corresponds to the fused media data of the second external functional module 1001 and functional module 302.
[0141] The data routing module 301 is used to receive the second composite function call instruction sent by the electronic device 304 via the communication network through the first network communication module 303, and to send the seventh function call instruction to the function module 302 and the eighth function call instruction to the second external function module 1001 according to the second composite function call instruction. The data routing module 301 and the second external function module 1001 are connected by a wire, and the eighth function call instruction can be directly sent to the second external function module 1001 based on the wire connection. In this implementation, the second composite function call instruction indicates that the electronic device 304 wants to call both the second external function module 1001 and the function module 302 simultaneously.
[0142] Functional module 302 is used to collect seventh media data and process the seventh media data after receiving the seventh function call instruction to obtain processed seventh media data. Second external functional module 1001 is used to collect eighth media data, process the eighth media data, and send the processed eighth media data to the data routing module after receiving the eighth function call instruction. Data routing module 301 and second external functional module 1001 are wired together, allowing the processed eighth media data to be directly sent to data routing module 301 via the wired connection.
[0143] Data routing module 301 is used to receive the processed eighth media data and send it to functional module 302. Functional module 302 is also used to receive the processed eighth media data, perform fusion processing on the processed seventh media data and the processed eighth media data to obtain fused media data, and send the fused media data to data routing module 301. Data routing module 301 is used to receive the fused media data and send it through the communication network via the first network communication module 303 to at least one fifth endpoint of electronic device 304, so that the operating system of electronic device 304 can capture the fused media data and present it to the unified communication application running on electronic device 304. The fusion processing can be the synchronous processing described above, which will not be repeated here to avoid repetition.
[0144] Specifically, electronic device 304 can expose at least one fifth endpoint through hardware or software, and the at least one fifth endpoint corresponds to the media data after fusion processing of the second external functional module 1001 and functional module 302. The method by which electronic device 304 exposes the fifth endpoint is similar to the method by which electronic device 304 exposes the fourth endpoint, and will not be described again here to avoid repetition.
[0145] In the above technical solution, the electronic device can simultaneously call upon both internal functional modules and external functional modules (first external functional module / second external functional module) to achieve data acquisition and processing over a wider range. Furthermore, during the calling process, neither the transmission of calling commands nor the transmission of media data requires data forwarding through the main chip, thus reducing data transmission latency and improving data transmission efficiency.
[0146] It should be noted that the examples described above in the embodiments of this application are merely illustrative for ease of understanding and do not constitute a limitation on the technical solution of the present invention. Furthermore, to highlight the innovative aspects of this application, modules that are not closely related to solving the technical problems raised in this application have not been introduced in the embodiments of this application; however, this does not mean that other modules are absent from the conference system of this embodiment.
[0147] Figure 11 is a schematic diagram of the ninth architecture of the conference equipment provided in the embodiments of this application.
[0148] For example, as shown in FIG11, the conference device 1100 includes: an audio processing module 3021 having a first network interface 11; a data routing module 301 having a second network interface 12 and a third network interface 13, the second network interface 12 being connected to the first network interface 303; and a first network communication module 303 for establishing a communication connection with an electronic device 304, the first network communication module 303 having a fourth network interface 14 being connected to the third network interface 13.
[0149] In this example, the first network interface 11, the second network interface 12, the third network interface 13, and the fourth network interface 14 can follow the same type of network protocol, such as the IP network protocol, to avoid the need for network protocol conversion during the transmission of audio-related data within the conferencing system and to improve the data transmission rate.
[0150] The second network interface 12 is connected to the first network interface 303, enabling the audio processing module 3021 to connect to the data routing module 301. The fourth network interface 14 is connected to the third network interface 13, enabling the first network communication module 303 to connect to the data routing module 301. Under this connection, when data is transmitted between the electronic device 304 and the audio processing module 3021, there is no need for data forwarding through the main chip. For example, data sent by the electronic device 304 can be transmitted to the audio processing module 3021 by sequentially passing through the first network communication module 303 and the data routing module 301. Similarly, data sent by the audio processing module 3021 can be transmitted to the electronic device 304 by sequentially passing through the data routing module 301 and the first network communication module 303, reducing data transmission latency and improving data transmission efficiency. Furthermore, since there is no need for data forwarding through the main chip, the implementation of the BYOM function is decoupled from the main chip.
[0151] In the embodiments provided in this application, it should be understood that the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be electrical, mechanical or other forms.
[0152] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.
Claims
1. A conference system, characterized in that, The invention relates to a conferencing device, which includes a data routing module, a functional module, and a first network communication module. The data routing module is connected to the first network communication module and the functional module. The first network communication module is used as a wireless access point so that an electronic device can connect to the conferencing device on the same communication network through the wireless access point. The electronic device is configured to expose at least one first endpoint corresponding to the functional module. The data routing module is used to receive a first function call instruction sent by the electronic device through the communication network via the first network communication module, and forward the first function call instruction to the function module. The functional module is used to collect first media data after receiving the first function call instruction, process the first media data, and send the processed first media data to the data routing module. The data routing module is used to receive the processed first media data, and send the processed first media data to at least one first endpoint of the electronic device through the communication network via the first network communication module, so that the operating system of the electronic device can capture the processed first media data and present the processed first media data to the unified communications application running on the electronic device.
2. The conference system according to claim 1, characterized in that, The functional modules include an audio processing module with a first network interface, a data routing module with a second network interface and a third network interface, and a first network communication module with a fourth network interface. The first network interface is connected to the second network interface, and the third network interface is connected to the fourth network interface.
3. The conference system according to claim 2, characterized in that, The first network interface is one of MDI, PCIE, or RGMII.
4. The conference system according to claim 2, characterized in that, The electronic device is configured to expose at least one audio endpoint corresponding to the audio processing module, and the first function call instruction includes a first audio function call instruction; The data routing module is used to receive the first audio function call instruction sent by the first network communication module through the third network interface, and send the first audio function call instruction to the audio processing module through the second network interface; The audio processing module is used to collect first audio data after receiving the first audio function call instruction, process the first audio data, and send the processed first audio data to the data routing module through the first network interface. The data routing module is used to receive the processed first audio data and send the processed first audio data to the first network communication module through the third network interface; The first network communication module is used to send the processed first audio data to at least one audio endpoint of the electronic device via the communication network, so that the operating system of the electronic device can capture the processed first audio data and present the processed first audio data to the unified communications application running on the electronic device.
5. The conference system according to claim 1, characterized in that, The functional modules include a video processing module with a fifth network interface, a data routing module with a sixth and a seventh network interface, and a first network communication module with an eighth network interface. The fifth network interface is connected to the sixth network interface, and the seventh network interface is connected to the eighth network interface.
6. The conference system according to claim 5, characterized in that, The electronic device is configured to expose at least one video endpoint corresponding to the video processing module, and the first function call instruction includes a first video function call instruction. The data routing module is used to receive the first video function call instruction sent by the first network communication module through the seventh network interface, and send the first video function call instruction to the video processing module through the sixth network interface; The video processing module is used to collect first video data after receiving the first video function call instruction, process the first video data, and send the processed first video data to the data routing module through the fifth network interface; The data routing module is used to receive the processed first video data and send the processed first video data to the first network communication module through the seventh network interface; The first network communication module is used to send the processed first video data to at least one video endpoint of the electronic device via the communication network, so that the operating system of the electronic device can capture the processed first video data and present the processed first video data to the unified communications application running on the electronic device.
7. The conference system according to claim 5, characterized in that, The fifth network interface is one of MDI, PCIE, or RGMII.
8. The conference system according to claim 1, characterized in that, The conference equipment also includes a processing module, which is connected to the functional module; The processing module is used to send the second function call instruction to the function module; The functional module is used to collect second media data, process the second media data, and send the processed second media data to the application running on the conferencing device after receiving the second function call instruction.
9. The conference system according to claim 8, characterized in that, The processing module includes a first processing submodule, which is connected to the data routing module. The first processing submodule is used to run a first operating system. The functional module has a first USB interface, which is connected to the first processing submodule. The functional module is configured to be presented as a USB device to the first operating system.
10. The conference system according to claim 1, characterized in that, The conference equipment also includes a second network communication module, which is used to connect to an external wireless network. The second network communication module is connected to the data routing module, and the data routing module runs a second operating system. The network card driver corresponding to the second network communication module runs on the second operating system.
11. The conference system according to claim 10, characterized in that, The first operating system is a Windows system, and the first operating system communicates with the data routing module through a virtual network card driver.
12. The conference system according to claim 1, characterized in that, The first network communication module is connected to a first external functional module, and the electronic device is configured to expose at least one second endpoint corresponding to the first external functional module; The data routing module is used to receive a third function call instruction sent by the electronic device through the communication network via the first network communication module, and forward the third function call instruction to the first external function module through the first network communication module. The first external function module is used to collect third media data after receiving the third function call instruction, process the third media data, and send the processed third media data to the data routing module through the first network communication module. The data routing module is used to receive the processed third media data, forward the processed third media data to at least one second endpoint of the electronic device via the communication network through the first network communication module, so that the operating system of the electronic device can capture the processed third media data and present the processed third media data to the unified communications application running on the electronic device.
13. The conference system according to claim 1, characterized in that, The data routing module is connected to a second external functional module, and the electronic device is configured to expose at least one third endpoint corresponding to the second external functional module. The data routing module is used to receive the fourth function call instruction sent by the electronic device through the communication network via the first network communication module, and forward the fourth function call instruction to the second external function module. The second external function module is used to collect fourth media data, process the fourth media data, and send the processed fourth media data to the data routing module after receiving the fourth function call instruction. The data routing module is used to receive the processed fourth media data, forward the processed fourth media data to at least one third endpoint of the electronic device via the communication network through the first network communication module, so that the operating system of the electronic device can capture the processed fourth media data and present the processed fourth media data to the unified communications application running on the electronic device.
14. The conference system according to claim 1, characterized in that, The first network communication module is connected to a first external functional module, and the electronic device is configured to expose at least one fourth endpoint, the fourth endpoint corresponding to the media data after fusion processing of the first external functional module and the functional module; The data routing module is used to receive a first composite function call instruction sent by the electronic device through the communication network via the first network communication module, send a fifth function call instruction to the function module according to the first composite function call instruction, and send a sixth function call instruction to the first external function module. The functional module is used to collect fourth media data after receiving the fourth function call instruction, process the fourth media data, and obtain processed fourth media data. The first external function module is used to collect fifth media data after receiving the fifth function call instruction, process the fifth media data, and send the processed fifth media data to the data routing module through the first network communication module. The data routing module is used to receive the processed fifth media data and send the processed fifth media data to the functional module. The functional module is also used to receive the processed fifth media data, perform fusion processing on the processed fifth media data and the processed fourth media data to obtain fused media data, and send the fused media data to the data routing module. The data routing module is used to receive the fused media data and send the fused media data to at least one fourth endpoint of the electronic device via the communication network through the first network communication module, so that the operating system of the electronic device can capture the fused media data and present the fused media data to the unified communications application running on the electronic device.
15. The conference system according to claim 1, characterized in that, The data routing module is connected to a second external functional module, and the electronic device is configured to expose at least one fifth endpoint, which corresponds to the media data after fusion processing by the second external functional module and the functional module. The data routing module is used to receive a second composite function call instruction sent by the electronic device through the communication network via the first network communication module, send a seventh function call instruction to the function module according to the second composite function call instruction, and send an eighth function call instruction to the second external function module. The functional module is used to collect seventh media data after receiving the seventh function call instruction, process the seventh media data, and obtain processed seventh media data. The second external function module is used to collect eighth media data, process the eighth media data, and send the processed eighth media data to the data routing module after receiving the eighth function call instruction; The data routing module is used to receive the processed eighth media data and send the processed eighth media data to the functional module. The functional module is also used to receive the processed eighth media data, perform fusion processing on the processed seventh media data and the processed eighth media data to obtain fused media data, and send the fused media data to the data routing module. The data routing module is used to receive the fused media data and send the fused media data to at least one fifth endpoint of the electronic device via the communication network through the first network communication module, so that the operating system of the electronic device can capture the fused media data and present the fused media data to the unified communications application running on the electronic device.
16. The conference system according to claim 9, characterized in that, The data routing module has a ninth network interface, and the first processing submodule has a tenth network interface, with the ninth network interface connected to the tenth network interface. The first network communication module is used to receive screen display data sent by the electronic device through the communication network, and send the screen display data to the seventh network interface of the data routing module through the eighth network interface; The data routing module is used to send the received screen-transfer data to the tenth network interface through the ninth network interface, so that the first processing submodule can receive the screen-transfer data.
17. The conference system according to claim 9, characterized in that, The conference equipment also includes a switch, and the processing module further includes a second processing submodule, which is used to run a third operating system, which is different from the first operating system. The first USB interface can be selectively connected to either the first processing submodule or the second processing submodule via the switch.
18. The conference system according to claim 17, characterized in that, The third operating system is Android.
19. A conference device, characterized in that, include: The audio processing module has a first network interface; The data routing module has a second network interface and a third network interface, wherein the second network interface is connected to the first network interface; as well as A first network communication module is used to establish a communication connection with an electronic device. The first network communication module has a fourth network interface, which is connected to the third network interface.
20. A conference device, characterized in that, The device includes a data routing module, a functional module, and a first network communication module. The data routing module is connected to the first network communication module and the functional module. The first network communication module is used as a wireless access point so that an electronic device can connect to the conferencing device on the same communication network through the wireless access point. The electronic device is configured to expose at least one first endpoint corresponding to the functional module. The functional module is used to collect first media data, process the first media data, and send the processed first media data to the data routing module through a first network protocol. The data routing module is used to receive the processed first media data and send the processed first media data to the first network communication module through the first network protocol; The first network communication module is used to receive the processed first media data and send the processed first media data to at least one first endpoint of the electronic device via the communication network through the second network protocol, so that the operating system of the electronic device can capture the processed first media data and present the processed first media data to the unified communication application running on the electronic device. The second network protocol is a different network protocol from the first network protocol.
