Virtual video conference system and conference method

Abstract

To provide a virtual video conference system and a conference method.SOLUTION: In a virtual video conference system and a conference method, the virtual video conference system includes a user terminal application and a server. The user terminal application is executed on user terminal equipment. The server is connected to one or more external AV devices and also connected wirelessly to the user terminal equipment on which the user terminal application has been executed. The user terminal application constructs a corresponding virtual interface on the basis of the external AV devices connected to the server, and receives wirelessly AV data of the external AV devices via the server. When the user terminal equipment executes video conference software, the user terminal equipment provides the AV data received through the virtual interface, the AV data serving as input data of the video conference software.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to a conferencing system and a conferencing method, and more particularly to a virtual video conferencing system and a virtual video conferencing method. [Background technology]

[0002] With the progress of science and technology and the development of the Internet, online video conferencing has become the mainstream way of holding meetings in recent years. By running video conferencing software on a computer, multiple users in different locations can simultaneously join an online virtual conference room and hold a video conference directly online, which is quite convenient.

[0003] However, when multiple people are holding a group meeting in the same conference room and at least one other user needs to join the meeting remotely via videoconferencing software at the same time, each participant must be required to use a computer running the videoconferencing software, ensuring that remote users can see and hear all participants.

[0004] As described above, existing online video conferencing methods mainly implement person-to-person video connections via computer video equipment, which is not suitable for multiple people sharing a conference, and it is not easy to meet the demand for group-to-group video connections. Summary of the Invention [Problem to be solved by the invention]

[0005] The main objective of the present invention is to provide a virtual video conferencing system and conferencing method, which can help users share a multi-person conference more effectively. [Means for solving the problem]

[0006] In order to achieve the above object, the virtual video conference system of the present invention comprises: A user terminal application that is installed and executed on the user terminal equipment; The system further includes a server that is wirelessly connected to the user terminal equipment and further electrically connected to at least one external AV device for receiving AV data from the external AV device. The user terminal application builds a corresponding virtual interface based on the device information of the external AV device connected to the server, and the user terminal device further Received AV data is provided, and the AV data is used as input data for the video conference software; a user terminal application synthesizes the plurality of AV data based on time stamps, and the plurality of AV data each has a corresponding time stamp so that the plurality of AV data are synthesized and synchronized; and the user terminal equipment uses the synthesized and synchronized plurality of AV data as input data for the video conference software.

[0007] To achieve the above object, the virtual video conferencing method of the present invention includes the following steps. a) The user terminal application establishes a wireless connection with the server via the user terminal equipment. b) The user terminal application searches for at least one external AV device connected to the server, and selects at least one external AV device. c) The user terminal application receives device information of the selected external AV device from the server, and further constructs a corresponding virtual interface according to the device information. d) The server starts streaming AV data from the external AV device to the user terminal application. e) User terminal equipment is connected via virtual interface ReceivedAV data is provided, and the AV data is used as input data for the video conference software; a user terminal application synthesizes the plurality of AV data based on time stamps, and the plurality of AV data each has a corresponding time stamp so that the plurality of AV data are synthesized and synchronized; and the user terminal equipment uses the synthesized and synchronized plurality of AV data as input data for the video conference software. Effect of the Invention

[0008] The present invention wirelessizes the video equipment of the user terminal equipment, and uses the AV data of the external AV equipment in the environment as input data for online video conferencing. Compared with the related art, the technical solution of the present invention can help users meet the demand for group online video conferencing with a minimum of user terminal equipment, thereby simplifying the equipment required for online video conferencing and reducing the complexity of online video conferencing. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a schematic diagram of a virtual video conference system according to a first specific example of the present embodiment. [Diagram 2] FIG. 2 is a second specific example of a schematic diagram of the virtual video conference system according to the present embodiment. [Diagram 3] FIG. 3 is a flowchart showing a first specific example of the conferencing method according to the present embodiment. [Figure 4] FIG. 4 is a block diagram showing a first specific example of a user terminal application according to the present embodiment. [Diagram 5] FIG. 5 is a block diagram showing a first specific example of a virtual video server according to the present embodiment. [Figure 6] FIG. 6 is a schematic diagram of a virtual video conference system according to a third specific example of the present embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Preferred embodiments of the present invention will now be described in detail as follows in conjunction with the drawings.

[0011] This embodiment discloses a virtual video conference system (hereinafter, in the specification, abbreviated as conference system), which can wirelessly connect one or more video devices in an environment (e.g., conference room) to user terminal equipment (e.g., personal computer, notebook computer, tablet terminal, etc.), and realizes wirelessization of the video devices of the user terminal equipment. In this way, when multiple users are in the same conference room at the same time and also hold an online video conference with a remote user in a group, it is not necessary to require all users to use an independent computer. Or, even if each user uses a computer, it is not necessary to require all users to use video conference software. This can effectively simplify the equipment required for online video conference and reduce the complexity of the program.

[0012] Please refer to Figures 1 and 2 at the same time. Figures 1 and 2 are respectively a first specific example and a second specific example of a schematic diagram of a virtual video conference system according to the present embodiment. As shown in Figures 1 and 2, the conference system according to the present embodiment mainly includes a virtual video server 1 and a virtual video user terminal application 4 (hereinafter, abbreviated as server 1 and user terminal application 4 in the specification), and the user terminal application 4 is installed and executed in a user terminal device 2.

[0013] As shown in Fig. 1, the server 1 of this embodiment is connected to at least one external AV device 3 in the environment, and is further used to receive AV data from the external AV devices 3. A user terminal application 4 establishes a wireless connection with the server 1 via a hardware element inside the user terminal equipment 2. This allows the user terminal equipment 2 to obtain AV data from one or more external AV devices 3 connected to the server 1 in a streaming manner, and further uses the obtained AV data as input data for the video conference software 5.

[0014] Take the environment as an example, a conference room (as shown in FIG. 1). Generally, the external AV equipment 3 is installed in the front of the conference room, so that the AV data includes audio data and video data covering all the people in the conference room. When a user terminal device 2 in the conference room runs the video conference software 5 and takes the AV data obtained from the server 1 as input data for the video conference software 5, it can be reliably guaranteed that other participants in the online video conference can obtain the audio data and video data of all the people in the conference room.

[0015] In the embodiment, the external AV equipment 3 may be, for example, a video camera 31, a communication device 32, or a display monitor 33, and the AV data may be video and audio, and the communication device 32 may include, but is not limited to, a speaker and a microphone. With the conference system of this embodiment, when a user holds an online video conference through a user terminal equipment 2, the user can choose to use the AV equipment built in the user terminal equipment 2 to obtain AV data, and can also choose to use one or more external AV equipment 3 connected to the server 1 to obtain AV data.

[0016] 2, the user terminal equipment 2 includes a processor 21, a storage device 22, an internal AV device 23, and a wireless transmission device 24, and the storage device 22, the internal AV device 23, and the wireless transmission device 24 are electrically connected to the processor 21. The user terminal equipment 2 stores a user terminal application 4 and video conference software 5 through the storage device 22. The user terminal equipment 2 executes the user terminal application 4 through the processor 21 to establish a wireless connection with the server 1, and further executes the video conference software 5 to conduct an online video conference with a remote user.

[0017] The internal AV equipment 23 refers to AV equipment built into the user terminal equipment 2 or connected to the user terminal equipment 2 by wire, such as, but not limited to, a display monitor, a video camera, and communication equipment (such as a speaker and a microphone). Generally, when an online video conference is held using the video conference software 5, the user terminal equipment 2 can obtain necessary AV data, such as a monitor screen, a user's video, and a user's voice, through the internal AV equipment 23 as input data for the video conference software 5. The technical problem that the present invention is intended to solve is that the AV data obtained by the internal AV equipment 23 is usually limited to a single user, which is disadvantageous for holding a group conference.

[0018] The wireless transmission device 24 may be, for example, a Wi-Fi transmission device, a Bluetooth (registered trademark) transmission device, a Near Field Communication (NFC) transmission device, a Zigbee (registered trademark) transmission device, etc. The user terminal equipment 2 can establish a wireless connection with the server 1 via the wireless transmission device 24 based on a request from a user terminal application 4. This allows the user terminal equipment 2 to obtain AV data from one or more external AV devices 3 connected to the server 1 in a streaming manner, and use the AV data as input data for the video conference software 5.

[0019] As shown in Fig. 1, an external AV device 3 installed remotely (e.g., at the front of a conference room) acquires AV data, which can reliably ensure that these AV data simultaneously cover all users in a specific environment (e.g., a conference room). In this embodiment, these AV data are used as input data for online video conferencing, and the purpose of group conferencing can be realized using only a single user terminal device 2.

[0020] As shown in Fig. 2, a particular environment may have multiple user terminal devices 2, and each of the user terminal devices 2 can be wirelessly connected to the server 1 via a user terminal application 4. As a result, each of the user terminal devices 2 can obtain AV data from one or more external AV devices 3 connected to the server 1 in a streaming manner, and can also hold online video conferences.

[0021] When the user terminal application 4 is executed, it mainly first issues a request to the server 1 to obtain device information of one or more external AV devices 3 currently connected to the server 1, such as, but not limited to, device name, device model, product number, communication protocol, etc. Then, the user terminal application 4 can build a virtual interface corresponding to the user terminal equipment 2 based on the obtained device information. For example, the user terminal application 4 can build a virtual video camera based on the device information of the video camera 31, build a virtual sound card based on the device information of the communication device 32, and further build a virtual display based on the device information of the display monitor 33. However, the above is merely an exemplary example of some specific implementations of the present embodiment, and is not limited thereto.

[0022] In this embodiment, when the user terminal application 4 establishes one or more virtual interfaces, the user terminal equipment 2 can set these virtual interfaces as additional AV data sources. When the user terminal equipment 2 runs the video conference software 5 to establish or participate in an online video conference, the user can select the virtual interfaces as AV data sources on the setting page of the user terminal equipment 2. In this way, the user terminal equipment 2 can use the AV data obtained from the server 1 as input data for the video conference software 5 to conduct an online video conference.

[0023] Please refer to Fig. 3 at the same time. Fig. 3 is a first specific example of a flow chart relating to the conference method of the present embodiment. Fig. 3 discloses a virtual video conference method (hereinafter, abbreviated as conference method in the specification) of the present embodiment, which mainly uses the conference system shown in Fig. 1 and Fig. 2, but is not limited thereto.

[0024] 3, to execute the conferencing method of this embodiment, a user must first install a user terminal application 4 in at least one user terminal device 2, and then connect the server 1 to one or more external AV devices 3 in the environment. Next, the user terminal device 2 executes the user terminal application 4, and the user terminal application 4 establishes a wireless connection with the server 1 via the user terminal device 2 (step S10).

[0025] When the user terminal application 4 establishes a wireless connection with the server 1, the user terminal application 4 can directly send a request to the server 1 to search for at least one external AV device 3 currently connected to the server 1 (step S12). In an embodiment, when the server 1 receives the request of the user terminal application 4, it can generate a device list based on all currently connected external AV devices 3, and can further return the device list to the user terminal application 4, thereby informing which external AV devices 3 are currently already connected and available. When the user terminal application 4 receives the device list, it can directly display the device list on the monitor of the user terminal equipment 2. Thus, the user can check the device list on the user terminal equipment 2, and further select at least one external AV device in the device list via the man-machine interface (e.g., keyboard, mouse, touch screen, etc.) of the user terminal equipment 2 (step S14).

[0026] After step S14, the server 1 obtains the device information of the corresponding external AV device according to the user's selection, and returns it to the user terminal application 4. The user terminal application 4 receives the device information from the server 1, and builds a virtual interface corresponding to the user terminal device 2 according to the received device information (step S16).

[0027] For example, if the user selects the video camera 31 connected to the server 1 in step S14, the user terminal application 4 constructs a corresponding virtual video camera based on the device information of the video camera 31 in step S16. If the user selects the communication device 32 connected to the server 1 in step S14, the user terminal application 4 constructs a corresponding virtual sound card based on the device information of the communication device 32 in step S16. If the user selects the display monitor 33 connected to the server 1 in step S14, the user terminal application 4 constructs a corresponding virtual display based on the device information of the display monitor 33 in step S16. However, the above are merely some exemplary specific implementations of the present embodiment, and the present invention is not limited to these.

[0028] After step S16, the user terminal application 4 further issues a service request to the server 1. Upon receiving the service request, the server 1 starts to transmit AV data of the selected one or more external AV devices 3 to the user terminal application 4 in a streaming manner, and the user terminal application 4 further receives the AV data via the wireless transmission device 24 of the user terminal equipment 2 (step S18). In this embodiment, the user terminal equipment 2 can regard the received AV data as data generated by the virtual interface itself, and further provides the AV data through the virtual interface as input data for the video conference software 5 (step S20).

[0029] Specifically, when the videoconferencing software 5 is executed, the user can select a source of AV data in a setting interface (not shown) of the videoconferencing software 5, and further set this source in the virtual interface constructed by the user terminal application 4. In this way, when an online videoconference is held at the user terminal equipment 2 using the videoconferencing software 5, one or more external AV devices 3 connected to the server 1 can be used as the source of AV data, without using the internal AV device 23.

[0030] In the process of executing the conferencing method of this embodiment, the user terminal application 4 continuously judges whether the connection with the server 1 is interrupted (step S22). Furthermore, before the connection is interrupted, steps S16 to S20 are continuously executed, thereby continuously executing the AV streaming program with the server 1.

[0031] It should be noted that, in addition to obtaining AV data of the external AV equipment 3 from the server 1, the user terminal equipment 2 can also transmit its own AV data to the server 1 in a streaming manner and output it via the external AV equipment 3. For example, the user terminal equipment 2 can capture a current monitor screen (step S24), and further transmit the monitor screen to the server 1 to be displayed on the display monitor 33 of the external AV equipment 3 connected to the server 1 (step S26). This allows all users in the environment where the display monitor 33 is located (e.g., a conference room) to check the monitor screen of the user terminal equipment 2 via the display monitor 33.

[0032] In an embodiment, the user terminal equipment 2 can realize the above steps S24 and S26 by a software method. For example, the user terminal equipment 2 can instantly capture the monitor screen currently displayed on the monitor through the user terminal application 4, and then wirelessly transmit it to the server 1 after image processing programs such as image setting, analysis and format conversion.

[0033] In another embodiment, the user terminal equipment 2 can realize the steps S24 and S26 by a hardware method. For example, the user terminal equipment 2 can be connected to a projection device (for example, the projection device 6 as shown in FIG. 6). In this embodiment, the user terminal equipment 2 is connected to the projection device 6 through a High Definition Multimedia Interface (HDMI) port, and can directly output a monitor screen to the projection device 6. Furthermore, the projection device 6 is connected to the server 1 through a Wi-Fi transmission interface or a Bluetooth transmission interface, and wirelessly transmits the acquired monitor screen to the server 1.

[0034] In this embodiment, the user terminal equipment 2 is connected to the projection device 6 through an HDMI (registered trademark) interface, that is, the user terminal equipment 2 directly outputs the monitor screen through the HDMI (registered trademark) interface. Therefore, the user terminal equipment 2 does not need an image processing program, such as image setting, analysis and format conversion, when executing the software capture program on the monitor screen. This can effectively reduce the operating load of the user terminal equipment 2 and at the same time simplify the complexity of the wireless projection program.

[0035] Similarly, in the process of executing the wireless projection program, the user terminal application 4 continuously determines whether the connection with the server 1 is interrupted (step S22), and further continuously executes steps S24 to S26 before the connection is interrupted. As a result, the monitor screen of the user terminal equipment 2 is continuously transmitted to the server 1 by streaming and displayed on the display monitor 33.

[0036] Please refer to FIG. 4 at the same time. FIG. 4 is a first specific example of a block diagram of a user terminal application of this embodiment. As shown in FIG. 4, the user terminal application 4 of this embodiment mainly includes, but is not limited to, a first device search module 41, a setting module 42, an AV streaming module 43, a register module 44, an AV synthesis module 45 and a virtual interface 46.

[0037] In this embodiment, a computer-executable source code is recorded in the user terminal application 4. When the user terminal application 4 is installed in the user terminal equipment 2 and the computer-executable source code is executed, the computer-executable source code can be logically divided (e.g., each subroutine therein) based on the function of the user terminal application 4, and the first device search module 41, the setting module 42, the AV streaming module 43, the register module 44, the AV synthesis module 45, and the virtual interface 46 are virtually generated. In other words, the above modules 41 to 46 in this embodiment may be software modules, but are not limited thereto. For example, in other embodiments, the register module 44 may be a part of a memory (not shown) inside the user terminal equipment 2, that is, the register module 44 may be a hardware module.

[0038] When the user terminal application 4 establishes a wireless connection with the server 1, it can issue a search request to the server 1 via the first device search module 41. When the server 1 receives the search request, it can detect device information of the currently connected external AV device 3 and further provide it to the user terminal application 4. In an embodiment, the user terminal application 4 requests a device list of currently available external AV devices 3 from the server 1 via the first device search module 41, and further, when the user selects a specific external AV device 3, it requests corresponding device information from the server 1 based on the user's selection.

[0039] When the user selects one or more external AV devices 3, the user terminal application 4 sends a service request to the server 1 via the AV streaming module 43, thereby receiving AV data of the selected external AV devices 3 in a streaming manner from the server 1. Specifically, the server 1 obtains the AV data of the corresponding external AV devices 3 according to the user's selection, and then continuously transmits the AV data to the AV streaming module 43 of the user terminal application 4 in a streaming manner.

[0040] When the user terminal application 4 receives AV data provided by the server 1 via the AV streaming module 43, it can first temporarily store it in the register module 44. If the server 1 simultaneously provides AV data from multiple external AV devices 3 (for example, simultaneously transmitting video data from the video camera 31 and audio data from the communication device 32), the user terminal application 4 further synthesizes the multiple AV data using the AV synthesis module 45.

[0041] Specifically, the multiple AV data received by the user terminal application 4 each have a corresponding timestamp, and the AV synthesis module 45 can synthesize multiple AV information based on the timestamp and synchronize the output AV data.

[0042] When the user terminal application 4 obtains the necessary device information of the external AV device 3, it can construct a corresponding virtual interface 46 via the setting module 42. In this embodiment, the user terminal application 4 controls the first device search module 41 and the AV streaming module 43 via the setting module 42, performs communication with the server 1, and further executes a control program for AV data output for the constructed virtual interface 46. In this embodiment, the virtual interface 46 is mainly used to output AV data processed by the AV synthesis module 45 to the user terminal equipment 2, and the virtual interface 46 is an AV data source of the user terminal equipment 2.

[0043] Please refer to Fig. 5 at the same time. Fig. 5 is a first specific example of a block diagram of a virtual video server of this embodiment. As shown in Fig. 5, the server 1 of this embodiment mainly includes an Internet module 11, a second device search module 12, a database 13, a setting interface 14, a device control module 15, a streaming AV server 16 and an AV processing module 17.

[0044] In this embodiment, the server 1 is a physical device that is actually connected to the external AV equipment 3 and further wirelessly connected to the user terminal equipment 2. In the embodiment, the modules 11 to 17 are physical devices installed inside the server 1. For example, the Internet module 11 can be realized by a wireless Internet device, the database 13 can be realized by a recording medium, and the second device search module 12, the setting interface 14, the device control module 15, the streaming AV server 16 and the AV processing module 17 can each be realized by a processor, but are not limited thereto.

[0045] In another embodiment, the modules 11 to 17 are software devices. Specifically, the server 1 may include a microprocessor (not shown), and when the microprocessor executes a source code executable by a specific computer, the modules 11 to 17 may be virtually generated based on required functions, but is not limited thereto.

[0046] In other embodiments, the modules 11-17 may be a combination of hardware and software devices.

[0047] The Internet module 11 can support various wireless communication protocols, such as Wi-Fi, Bluetooth, NFC, Zigbee, etc. The server 1 establishes a wireless connection with the user terminal equipment 2 through the Internet module 11, and transmits the device list, device information and AV data to the user terminal application 4.

[0048] The device control module 15 can support a communication protocol required by the user. The server 1 is connected to one or more external AV devices 3 via the device control module 15, controls the external AV devices 3, and obtains device information and AV data of the external AV devices 3.

[0049] In the embodiment, the device control module 15 is a control module that supports USB Video Class (UVC) and USB Audio Class (UAC), and further includes at least one USB port. In the embodiment, the video camera 31 and the communication device 32 of the external AV device 3 are connected to the server 1 via the USB port, and the server 1 manages and controls the video camera 31 and the communication device 32 via the device control module 15.

[0050] The second device search module 12 is connected to the Internet module 11, and further receives the search request of the user terminal application 4 through the Internet module 11. In this embodiment, when one or more external AV devices 3 are connected to the server 1, the server 1 immediately obtains the device information of the external AV devices 3, and further stores it in the database 13. When the server 1 receives the search request of the user terminal application 4, it can query the database through the second device search module 12 to obtain the corresponding device information, and further return it to the user terminal application 4 through the Internet module 11.

[0051] The setting interface 14 is connected to the Internet module 11, the device control module 15 and the database 13. In this embodiment, the setting interface 14 can provide a web graphical user interface (Web GUI), and a user can log in to the web graphical user interface via the Internet. In the web graphical user interface, a user can configure the external AV device 3 currently connected to the server 1, such as, but not limited to, setting the resolution of the video camera 31 or setting the volume of the communication device.

[0052] In the embodiment, the server 1 controls the device control module 15 via the setting interface 14 to obtain device information of the currently connected external AV device 3, and then records the device information in the database 13. However, the above is merely an exemplary embodiment of the present invention, and the present invention is not limited to this.

[0053] The AV processing module 17 can support communication protocols required by the user. The server 1 is connected to one or more external AV devices 3 via the AV processing module 17, controls the external AV devices 3, and obtains corresponding device information and AV data.

[0054] In the embodiment, the AV processing module 17 is a processing module that supports the HDMI protocol and further includes an HDMI port. In the embodiment, the display monitor 33 of the external AV device 3 is connected to the server 1 via the HDMI port, and the server 1 manages and controls the display monitor 33 via the AV processing module 17.

[0055] The streaming AV server 16 is connected to the Internet module 11, the device control module 15, and the AV processing module 17. In this embodiment, the server 1 controls the device control module 15 and the AV processing module 17 via the streaming AV server 16, obtains AV data from the connected external AV equipment 3, and transmits it to the user terminal equipment 2 via the Internet module 11 in a streaming manner.

[0056] In this embodiment, a user can use a user terminal equipment 2 to wirelessly connect to the server 1 within the wireless transmission range of the server 1, and further obtain AV data of one or more external AV devices 3 connected to the server 1. By setting one or more external AV devices 3 connected to the server 1 as an AV data source of the user terminal equipment 2, it is advantageous to use the user terminal equipment 2 to conduct an online group video conference through the video conference software 5.

[0057] Please refer to Fig. 6. Fig. 6 is a third specific example of a schematic diagram of the virtual video conference system of the present embodiment. Fig. 6 is used to specifically explain one of the use scenarios of the present embodiment.

[0058] In the embodiment of FIG. 6, a user makes a presentation at a conference through a user terminal device 2 in a conference room. The user terminal device 2 is connected to a projection device 6 (e.g., a Wireless Projection Server (WPS)). The projection device 6 uses the same wireless transmission protocol as the server 1 and can establish a wireless connection with the server 1. In this embodiment, the projection device 6 can directly acquire a monitor image 20 of the user terminal device 2, and then wirelessly transmit the monitor image 20 to the server 1.

[0059] In the embodiment, the user terminal equipment 2 is connected to the projection device 6 via an HDMI (registered trademark) port, and the projection device 6 directly acquires the monitor image 20 of the user terminal equipment 2 via the HDMI (registered trademark) interface. In other words, in the conference system of this embodiment, the projection device 6 wirelessly connects the HDMI (registered trademark) interface of the user terminal equipment 2, and the user terminal equipment 2 does not need to execute any image processing program on the monitor image 20, and the monitor image 20 is directly wirelessly transmitted to the server 1.

[0060] The server 1 is connected to multiple external AV devices 3 including a display monitor 33. In this embodiment, the server 1 receives the monitor video 20 from the user terminal equipment 2 by streaming, and further displays the monitor video 20 on the display monitor 33. This allows all participants in the conference room to check the monitor video 20 of the user terminal equipment 2, i.e., the contents of the presentation, from the display monitor 33.

[0061] When some participants are not in the same conference room and need to participate in the conference in the manner of online video conferencing, this embodiment can use the user terminal application 4, the server 1 and the projection device 6 in combination.

[0062] Specifically, at least one conference device 7 may be further provided in the conference room, such as, but not limited to, a personal computer, a notebook computer, or a tablet terminal. The above-mentioned user terminal application 4 is installed and executed in the conference device 7. When the conference device 7 executes the user terminal application 4, a wireless connection with the server 1 can be established. This allows the conference device 7 to obtain AV data of all external AV devices 3 (including the display monitor 33) currently connected to the server 1 in a streaming manner.

[0063] 6, the conference facility 7 can further execute the video conference software 5 to start or participate in one specific online video conference. Furthermore, the conference facility 7 can directly use AV data (e.g., monitor image 20) acquired from the server 1 as input data (e.g., conference screen 50) for the online video conference.

[0064] In this embodiment, the screen of the user being discussed in the conference room (i.e., the monitor image 20 displayed on the user terminal equipment 2 and the display monitor 33) can be used as input data for the online video conference in which the conference facility 7 is currently participating, and can then be transmitted to one or more remote devices 8 in the online video conference. Thus, the user of the remote device 8 can view the monitor image 20 on the conference screen 50 of the remote device 8. In this way, the remote user can also participate in the discussion in the conference room in the manner of an online video conference.

[0065] In an embodiment, to realize the above application scenario, it is necessary to at least have a user terminal equipment 2 used to provide a monitor image 20 in a conference room, and a conference equipment 7 used to participate in an online video conference. In another embodiment, the user terminal equipment 2 and the conference equipment 7 can be the same equipment.

[0066] When many users hold a group conference in the same environment (such as a conference room) and some remote users need to participate in the conference in the form of online video conference, the conference system and conference method of this embodiment allows users to simultaneously obtain the video, audio and presentation content of all participants in the conference room through the external AV equipment 3, and then transmit it to the remote participants through the video conference software 5. This eliminates the need to require each participant in the conference room to use a single computer to run the video conference software 5 separately. Furthermore, only one computer is needed to participate in the online video conference in the conference room, and the AV data of the external AV equipment 3 is used as the input data for the online video conference, allowing the remote user to obtain the video and audio of all participants in the conference room. In this way, the complexity of conducting a group video conference online can be effectively reduced.

[0067] The above description is merely a preferred embodiment of the present invention, and does not limit the scope of the present invention. Therefore, it is clearly indicated that any equivalent modifications made by utilizing the content of the present invention are also included in the scope of the present invention. [Explanation of symbols]

[0068] 1 Virtual Video Server 11 Internet Module 12 Second device search module 13 Database 14 Configuration Interface 15 Equipment Control Module 16 Streaming AV Server 17 AV Processing Module 2 User terminal equipment 20 Monitor image 21 Processors 22 Storage device 23 Internal AV equipment 24 Radio transmission equipment 3 External AV equipment 31 Video Camera 32 Communication Equipment 33 Display Monitor 4 Virtual Video User Terminal Application 41 First device search module 42 Configuration Module 43 AV Streaming Module 44 Register Module 45 AV synthesis module 46 Virtual Interfaces 5. Online Video Conferencing Software 50 Meeting screen 6 Projection device 7. Conference Facilities 8 Remote Devices S10~S26 Meeting process

Claims

1. a user terminal application installed and executed on a user terminal device; a server that is wirelessly connected to the user terminal equipment and further electrically connected to at least one external AV device and receives AV data from the external AV device; The user terminal application establishes a corresponding virtual interface according to device information of the external AV device connected to the server, and the user terminal device provides the AV data received through the virtual interface, and the AV data is input data for video conference software; A virtual video conferencing system, wherein the user terminal application synthesizes the plurality of AV data based on a timestamp, and each of the plurality of AV data has a corresponding timestamp so that the plurality of AV data are synthesized and synchronized, and further, the user terminal equipment uses the plurality of AV data after synthesis and synchronization as the input data of the video conferencing software.

2. 2. The virtual video conferencing system of claim 1, wherein the external AV device is a video camera, a communication device or a display monitor, and the virtual interface is a virtual display, a virtual video camera or a virtual sound card.

3. The user terminal application, a first device search module for requesting the device information of the external AV device from the server; an AV streaming module that receives the AV data provided by the server; The virtual video conference system according to claim 1 , further comprising: an AV synthesis module for synthesizing a plurality of said AV data.

4. The virtual video conferencing system of claim 3 , wherein the user terminal application is used to control communication between the first device search module and the AV streaming module and the server, and further includes a setting module for constructing and controlling the virtual interface.

5. The server, a device control module that controls the connected external AV device and acquires the device information of the external AV device; A database for recording the device information; a second device search module connected to the database, receiving a request from the user terminal application to query the database for the device information; The virtual video conferencing system of claim 3, further comprising an Internet module connected to the device control module and the second device search module, and further comprising: the server establishing a wireless connection with the user terminal equipment via the Internet module and providing the device information.

6. The virtual video conferencing system of claim 5 , wherein the server includes a configuration interface, the configuration interface providing a web graphical user interface by which a user configures the external AV equipment.

7. The server, an AV processing module connected to a display monitor of the external AV device; 6. The virtual video conferencing system of claim 5, further comprising: a streaming AV server connected to the Internet module, the device control module, and the AV processing module, for controlling the device control module and the AV processing module to receive the AV data of the external AV equipment, and for transmitting the AV data to the user terminal application in a streaming manner via the Internet module.

8. 6. The virtual video conferencing system of claim 5, wherein the device control module is a control module that supports USB Video Class (UVC) and USB Audio Class (UAC).

9. 2. The virtual video conferencing system of claim 1, further comprising a projection device connected to the user terminal equipment and wirelessly connected to the server, the projection device acquiring a monitor screen of the user terminal equipment and transmitting it to the server, and the server displaying the monitor screen on a display monitor of the external AV equipment.

10. 10. The virtual video conference system of claim 9, wherein the projection device is connected to the user terminal equipment through a High Definition Multimedia Interface (HDMI) port, and is further wirelessly connected to the server through a Wi-Fi transmission interface or a Bluetooth transmission interface.

11. A virtual video conferencing method for use in a virtual video conferencing system including at least a user terminal application and a server, comprising: installing and running the user terminal application on a user terminal device; a) the user terminal application establishing a wireless connection with the server via the user terminal equipment; b) the user terminal application searching for at least one external AV device currently connected to the server and selecting at least one of the external AV devices; c) the user terminal application receiving device information of the selected external AV device from the server, and constructing a corresponding virtual interface according to the device information; d) after step c, the user terminal application receives the AV data of the selected external AV device from the server in a streaming manner; and e) providing the AV data received by the user terminal equipment through the virtual interface, the AV data being input data of a video conference software, the user terminal application synthesizing a plurality of the AV data based on a time stamp, so that the plurality of the AV data are synthesized and synchronized, each of the plurality of the AV data having a corresponding time stamp, and the user terminal equipment further providing the plurality of the AV data after synthesis and synchronization as the input data of the video conference software; A virtual video conferencing method, comprising:

12. The virtual video conference system further includes a projection device electrically connected to the user terminal device and wirelessly connected to the server; f) the projection device acquiring a monitor screen of the user terminal equipment; and The virtual video conference method according to claim 11, further comprising the step of: g) transmitting the monitor screen from the projection device to the server in a streaming manner and displaying the monitor screen on a display monitor of the external AV device.

Images