Information processing method, system and equipment
Through one video conferencing application, it realizes video conferencing participation across applications, solves the problem of user installation of multiple applications and resource occupation, and improves terminal device performance and user experience.
Patent Information
- Application Number
- CN202411213765.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-31
- Publication Date
- 2024-11-19
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
The existing video conferencing technology requires all participating users to install the same video conferencing application, which leads to inconvenience between users. When different users use different applications, the terminal device needs to install multiple applications, occupy resources and affect performance.
Receive and forward video streams and audio streams of another application through one video conferencing application, allowing users to participate in conferences under multiple video conferencing applications, realizing cross-application video conferencing participation.
Users can synchronize the view and sound of conference speakers under other applications through a video conferencing application, solving the problem of user installation of multiple applications and resource occupation, and improving the performance and user experience of terminal devices.
Smart Images

Figure CN118984369A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of video conferencing, and in particular to an information processing method, system and device. Background Art
[0002] With the development of information technology, video conferencing technology has gradually become popular. Among them, video conferencing technology can transmit information such as voice, images, documents, etc. to remote conference terminals through the network, so that participants in different places can share multimedia services. This provides users with a more realistic, efficient, and real-time communication scenario.
[0003] At present, there are many video conferencing applications emerging. Different terminal devices may install different video conferencing applications. In the current technology, participating users must use the same video conferencing application to participate in the same video conference. This requires all participating users to install the same video application, which causes inconvenience to users. In addition, the current user may hold a video conference with different other users. If different users use different video conferencing applications, the terminal device of the current user needs to install multiple video conferencing applications, which causes the video conferencing application to occupy more resources of the terminal device of the current user, affecting the performance of the terminal device. Summary of the invention
[0004] The present invention provides an information processing method, system and device, which can enable a user to use a video conferencing application to participate in a video conference conducted in another video conferencing application, thereby enabling a user to use a video conferencing application to participate in video conferences under multiple video conferencing applications.
[0005] A first aspect of the present invention provides an information processing method, which is applied to a conference system, wherein the conference system includes a first terminal device, a second terminal device, and a third terminal device, wherein the second terminal device is installed with a first conference application and a second conference application, the second terminal device is in a first conference venue through the first conference application and the first terminal device, and the second terminal device is in a second conference venue through the second conference application and the third terminal device; the method includes: The second terminal device receives a first video stream and a first audio stream from the first terminal device through the first conference application installed on the second terminal device, wherein the first video stream includes a picture of a speaker at the first conference site, and the first audio stream includes a voice of a speaker at the first conference site; wherein the first conference application installed on the second terminal device displays the first video stream through a first display screen of the second terminal device to show the picture of the speaker to a user on the second terminal device side; and the first conference application installed on the second terminal device plays the voice of the speaker through a first audio playback device of the second terminal device to provide the voice of the speaker to a user on the second terminal device side; at the same time, The second terminal device sends a second video stream and a second audio stream to the third terminal device through the second conference application installed on the second terminal device; wherein the second video stream includes display content of the first display screen, and the second audio stream includes playback content of the first audio playback device, wherein the display content includes the speaker's screen displayed on the first display screen, and the playback content includes the speaker's voice played by the first audio playback device; Among them, the second conference application installed on the third terminal device plays the second video stream through the second display screen of the third terminal device to show the speaker's screen to the user on the third terminal device side; the second conference application installed on the third terminal device plays the second audio stream through the second audio playback device of the third terminal device to provide the speaker's voice to the user on the third terminal device side.
[0006] In some embodiments, the second terminal device includes a camera, the camera is used to capture the user screen on the second terminal device side, and the second video stream includes the user screen on the second terminal device side; The second conference application installed on the third terminal device plays the second video stream through the second display screen of the third terminal device to show the speaker's screen and the user's screen on the second terminal device side to the user on the third terminal device side.
[0007] In an example of this embodiment, the second conference application installed on the third terminal device is used to play the speaker's screen in the second video stream in the first area of the second display screen, and the second conference application installed on the third terminal device is used to play the user screen on the second terminal device side in the second video stream in the second area of the second display screen.
[0008] In another example of this embodiment, the second conference application installed on the third terminal device is used to provide a first interface and a second interface, the first interface is used to display the speaker's screen in the second video stream, and the second interface is used to display the user screen on the second terminal device side in the second video stream.
[0009] In some embodiments, the second terminal device further includes an audio collection device, and the audio collection device is used to collect the user voice on the second terminal device side; the second audio stream includes the user voice on the second terminal device side; The second conference application installed on the third terminal device plays the second audio stream through the second audio playback device of the third terminal device to provide the speaker's voice and the user's voice on the second terminal device side to the user on the third terminal device side.
[0010] In some embodiments, the method further includes: when the network load of the first terminal device is greater than a preset threshold, the first terminal device sending a forwarding notification to the second terminal device; The second terminal device sends the second video stream and the second audio stream to the third terminal device through the second conference application installed on the second terminal device, including: the second terminal device responds to the forwarding notification and sends the second video stream and the second audio stream to the third terminal device through the second conference application installed on the second terminal device.
[0011] In an example of this embodiment, the first terminal device is connected to multiple terminal devices, and the multiple terminal devices include the second terminal device and a third terminal device; wherein, among the multiple terminal devices, the network performance between the second terminal device and the first terminal device is the largest, and the network performance between the third terminal device and the first terminal device is the smallest.
[0012] In some embodiments, the third terminal device is also installed with the first conference application; the method further includes: When the network load of the first terminal device is less than or equal to a preset threshold, the first terminal device sends a stop notification to the second terminal device, and sends a reception notification to the third terminal device; The second terminal device responds to the stop notification and no longer sends the second video stream and the second audio stream to the third terminal device through the second conference application installed on the second terminal device; The third terminal device responds to the reception notification and receives a third video stream and a third audio stream from the first terminal device through the first conference application installed on the third terminal device, wherein the third video stream includes the speaker's image at the first venue, and the third audio stream includes the speaker's voice at the first venue; wherein the first conference application installed on the third terminal device displays the third video stream through the second display screen to show the speaker's image to the user on the third terminal device side; and the first conference application installed on the third terminal device plays the speaker's voice through the second audio playback device to provide the speaker's voice to the user on the third terminal device side.
[0013] In a second aspect, a conference system is provided, the conference system comprising a first terminal device, a second terminal device, and a third terminal device, wherein the second terminal device is installed with a first conference application and a second conference application, the second terminal device is in a first conference venue through the first conference application and the first terminal device, and the second terminal device is in a second conference venue through the second conference application and the third terminal device; The second terminal device is used to receive a first video stream and a first audio stream from the first terminal device through the first conference application installed on the second terminal device, wherein the first video stream includes a picture of a speaker at the first conference site, and the first audio stream includes a voice of a speaker at the first conference site; wherein the first conference application installed on the second terminal device displays the first video stream through a first display screen of the second terminal device to show the picture of the speaker to a user on the second terminal device side; and the first conference application installed on the second terminal device plays the voice of the speaker through a first audio playback device of the second terminal device to provide the voice of the speaker to a user on the second terminal device side; The second terminal device is used to send a second video stream and a second audio stream to the third terminal device through the second conference application installed on the second terminal device; wherein the second video stream includes display content of the first display screen, and the second audio stream includes playback content of the first audio playback device, wherein the display content includes the speaker's screen displayed on the first display screen, and the playback content includes the speaker's voice played by the first audio playback device; Among them, the second conference application installed on the third terminal device plays the second video stream through the second display screen of the third terminal device to show the speaker's screen to the user on the third terminal device side; the second conference application installed on the third terminal device plays the second audio stream through the second audio playback device of the third terminal device to provide the speaker's voice to the user on the third terminal device side.
[0014] In a third aspect, a second terminal device is provided, wherein the conference system in which the second terminal device is located includes a first terminal device and a third terminal device, wherein the second terminal device is installed with a first conference application and a second conference application, the second terminal device is in a first conference venue through the first conference application and the first terminal device, and the second terminal device is in a second conference venue through the second conference application and the third terminal device; the second terminal device includes: A receiving module, configured to receive a first video stream and a first audio stream from the first terminal device through the first conference application installed on the second terminal device, wherein the first video stream includes a picture of a speaker at the first venue, and the first audio stream includes a voice of the speaker at the first venue; wherein the first conference application installed on the second terminal device displays the first video stream through a first display screen of the second terminal device to show the picture of the speaker to a user on the second terminal device side; and the first conference application installed on the second terminal device plays the voice of the speaker through a first audio playback device of the second terminal device to provide the voice of the speaker to a user on the second terminal device side; A sending module, configured to send a second video stream and a second audio stream to the third terminal device through the second conference application installed on the second terminal device; wherein the second video stream includes the display content of the first display screen, and the second audio stream includes the playback content of the first audio playback device, wherein the display content includes the speaker's screen displayed on the first display screen, and the playback content includes the speaker's voice played by the first audio playback device; The second conference application installed on the third terminal device plays the second video stream through the second display screen of the third terminal device to display the speaker's screen to the user on the third terminal device side; the second conference application installed on the third terminal device plays the second audio stream through the second audio playback device of the third terminal device to provide the speaker's voice to the user on the third terminal device side. A fourth aspect of the present invention provides a computer-readable storage medium, including computer program instructions, and when the computer program instructions are executed by a computer device, the computer device executes the method described in the first aspect.
[0015] A fifth aspect of the present invention provides a computer program product comprising instructions, which, when executed by a computer device, causes the computer device to perform the method as described in the first aspect.
[0016] Through the solution provided by the embodiment of the present invention, a user can synchronously watch the screen of a conference speaker in other video conferencing applications and hear the speaker's voice through a video conferencing application, thereby participating in conferences in other video conferencing applications. BRIEF DESCRIPTION OF THE DRAWINGS
[0017] Figure 1 A structural schematic diagram of a conference system provided by an embodiment of the present invention;.
[0018] Figure 2 The present invention provides a flowchart of an information processing method. DETAILED DESCRIPTION
[0019] The following examples are used to illustrate the present invention but are not intended to limit the scope of the present invention.
[0020] Nowadays, users in different places can hold meetings through video conferencing. Due to the limitations of conference applications (for example, the number of participants in the same venue has an upper limit, and the number of participants is too large to exceed the upper limit) and network limitations (for example, there are too many people in the same venue, and the speaker's terminal device needs to send images and sounds to many terminal devices, causing the speaker's terminal device to be prone to network congestion), multiple users may not be able to participate in the meeting through the same conference application. Due to confidentiality and other factors, the image and sound of the conference speaker cannot be open to the public. Therefore, it is impossible to broadcast the speaker's image and sound to many users through live broadcast and other methods.
[0021] In view of this, an embodiment of the present invention provides an information processing method, which can solve the limitation of conference applications and networks on the number of participants while meeting confidentiality requirements.
[0022] See also Figure 1 The embodiment of the present invention provides a conference system 100. The conference system 100 can be used to implement the information processing method. The conference system 100 includes a first terminal device 110, a second terminal device 120, a third terminal device 130 and other terminal devices. Different terminal devices are located in different geographical locations. Different terminal devices can be connected through a network, such as the Internet.
[0023] Hereinafter, when no special distinction is made between the first terminal device 110 , the second terminal device 120 , and the third terminal device 130 , they may be referred to as terminal devices for short.
[0024] The terminal device may include a variety of hardware components, such as one or more processors (e.g., central processing unit (CPU)), one or more memories, etc. The terminal device provides data computing and data storage capabilities for the terminal device. Exemplarily, the terminal device may be a mobile phone, a tablet computer, a laptop computer, a smart TV, a vehicle-mounted terminal, a smart wearable device, etc.
[0025] The first terminal device 110 may be installed with the first conference application 210 , the second terminal device 120 may be installed with the first conference application 210 and the second conference application 210 , and the third terminal device 130 may be installed with the second conference application 210 .
[0026] In some embodiments, the first conference application 210 may be one of Tencent Conference, DingTalk Conference, Zoom Conference, etc., and the first conference application 210 may be another one of Tencent Conference, DingTalk Conference, Zoom Conference, etc.
[0027] like Figure 1 As shown, the second terminal device 120 is in the first conference venue through the first conference application 210 and the first terminal device 110 , and the second terminal device 120 is in the second conference venue through the second conference application 210 and the third terminal device 130 .
[0028] The first terminal device 110 is a terminal device on the speaker side of the first venue, which can collect the speaker's screen and send the speaker's screen to other terminal devices in the first venue, such as the second terminal device 120, through a video stream. The speaker's screen can be a presentation used by the speaker. The first terminal device 110 can also collect the speaker's voice and send the speaker's voice to other terminal devices in the first venue, such as the second terminal device 120, through an audio stream.
[0029] The above describes the conference system 100 provided by the embodiment of the present invention. Next, in conjunction with the conference system 100, the execution flow of the information processing method provided by the embodiment of the present invention is described. Figure 2 As shown, the method includes the following steps.
[0030] Step 201, the second terminal device 120 receives a first video stream and a first audio stream from the first terminal device 110 through the first conference application 210, wherein the first video stream includes the image of the speaker at the first venue, and the first audio stream includes the voice of the speaker at the first venue; wherein the first conference application 210 displays the first video stream through the first display screen of the second terminal device 120 to show the image of the speaker to the user on the second terminal device 120 side; and the first conference application 210 plays the voice of the speaker through the first audio playback device of the second terminal device 120 to provide the voice of the speaker to the user on the second terminal device 120 side.
[0031] The first display screen may be a display screen carried by the second terminal device 120 itself, or a display screen connected to the second terminal device 120 and located locally in the second terminal device 120. The first audio playback device may be an audio playback device carried by the second terminal device 120 itself, or an audio playback device connected to the second terminal device 120 and located locally in the second terminal device 120. The first audio playback device may be an audio playback device such as a speaker or a loudspeaker.
[0032] Through step 201 , the user at the second terminal device 120 can watch the image of the speaker at the first conference site and hear the speaker's voice.
[0033] While executing step 201, the second terminal device 120 can also execute step 202, and the second terminal device 120 sends a second video stream and a second audio stream to the third terminal device 130 through the installed second conference application 220; wherein the second video stream includes the display content of the first display screen, and the second audio stream includes the playback content of the first audio playback device, wherein the display content includes the speaker's screen displayed on the first display screen, and the playback content includes the speaker's voice played by the first audio playback device.
[0034] Among them, the second conference application 220 installed on the third terminal device 130 plays the second video stream through the second display screen of the third terminal device to show the speaker's screen to the user on the third terminal device side; the second conference application installed on the third terminal device 130 plays the second audio stream through the second audio playback device of the third terminal device to provide the speaker's voice to the user on the third terminal device side.
[0035] Among them, the second conference application 220 installed on the second terminal device 120 can share an interface with the second conference application 220 on the third terminal device 130, and the shared interface is the interface of the first conference application 210 of the second terminal device 120, that is, the interface that plays the screen of the speaker of the first venue. In this way, the second conference application 220 installed on the third terminal device 120 can play the interface of the screen of the speaker of the first venue shared by the second terminal device 120, so that the third terminal device 120 can play the screen of the speaker of the first venue without joining the first venue.
[0036] The second terminal device 120 can also send the sound played by the first audio playback device of the second terminal 120 to the third terminal device 130. For example, the second terminal device 120 can copy the audio stream to be played by the first audio playback device, and send the copied audio stream as the second audio stream to the third terminal device 130. Alternatively, the second terminal device 120 can use an audio collection device such as a recorder to collect the audio played by the first audio playback device, and send the collected audio as the second audio stream to the third terminal device 130. In this way, the third terminal device 130 can play the voice of the speaker in the first venue without joining the first venue.
[0037] Among them, the user on the second terminal device side can be an administrator of a department in a certain organization, and the user on the third terminal device side can be an ordinary member in the department. The speaker at the first venue can be a relevant person of the organization, and he transmits relevant information to each member of the organization through a video conference. Due to the large number of members in the organization, the upper limit of the number of people in the first conference application 210 may be exceeded. Alternatively, if the terminal devices of the members in the speaker's organization are all connected to the first venue, it may cause the terminal device on the speaker's side to send network congestion, etc. In this case, the administrators of each department can access the first venue, so that the speaker's picture and sound can be received through the first conference application 210. Then, the administrator of the department can share the speaker's picture and sound at the first venue with the members in the department through the second venue of the second conference application 210. So that each member in the organization can synchronously receive the relevant information transmitted by the speaker.
[0038] In some embodiments, the second terminal device 120 includes a camera, which is used to capture the user screen on the second terminal device 120 side, and the second video stream includes the user screen on the second terminal device 120 side; wherein the second conference application 210 installed on the third terminal device 130 plays the second video stream through the second display screen of the third terminal device 120 to display the speaker's screen and the user screen on the second terminal device side to the user on the third terminal device side.
[0039] In this embodiment, while the administrator of the department shares the image and sound of the speaker at the first venue with the members of the department, the administrator can also convey to the members of the department the administrator's views and comments on the information delivered by the speaker to help the members of the department better understand the information delivered by the speaker.
[0040] In an example of this embodiment, the second conference application 220 installed on the third terminal device 130 is used to play the speaker's screen in the second video stream in the first area of the second display screen, and the second conference application 220 installed on the third terminal device 130 is used to play the user screen on the second terminal device 120 side in the second video stream in the second area of the second display screen.
[0041] In this example, the third terminal device 130 can simultaneously play the speaker's screen and the screen on the second terminal 120 side to the user, so that the user on the third terminal device 130 side can simultaneously see the information delivered by the speaker and the information delivered by the target manager.
[0042] In another example of this embodiment, the second conference application 220 installed on the third terminal device 130 is used to provide a first interface and a second interface, the first interface is used to display the speaker's screen in the second video stream, and the second interface is used to display the user screen on the second terminal device 120 side in the second video stream.
[0043] In this example, the third terminal device 130 plays the speaker's screen and the screen on the second terminal 120 side in different interfaces, so that the user of the third terminal device 130 can choose to receive information delivered by the speaker or the target manager.
[0044] In some embodiments, the second terminal device 120 also includes an audio acquisition device, which is used to collect the user voice on the second terminal device 120 side; the second audio stream includes the user voice on the second terminal device 120 side; wherein the second conference application installed on the third terminal device 130 plays the second audio stream through the second audio playback device of the third terminal device 130 to provide the speaker's voice and the user voice on the second terminal device 120 side to the user on the third terminal device 130 side.
[0045] In this way, the user at the third terminal device 130 can receive the information transmitted by the speaker and the administrator of the department through sound.
[0046] In some embodiments, the method also includes: when the network load of the first terminal device 110 is greater than a preset threshold, the first terminal device 110 sends a forwarding notification to the second terminal device 120; the second terminal device 120 sends a second video stream and a second audio stream to the third terminal device 130 through the second conference application installed by the second terminal device 120, including: the second terminal device 120 responds to the forwarding notification, and sends the second video stream and the second audio stream to the third terminal device 130 through the second conference application installed by the second terminal device 120.
[0047] In this embodiment, if the number of terminal devices connected to the first venue is too large, resulting in a heavy network load on the first terminal device 110 on the speaker's side, the first terminal device 110 can instruct certain terminal devices (such as the second terminal device 120) to forward the speaker's picture and sound to other terminal devices (such as the third terminal device 130). In this way, the speaker's picture and sound are sent to each terminal device in a cascade manner, without the first terminal device 110 having to send the speaker's picture and sound to each terminal device, thereby reducing the network load of the first terminal device 110.
[0048] In an example of this embodiment, the first terminal device is connected to multiple terminal devices, and the multiple terminal devices include the second terminal device and a third terminal device; wherein, among the multiple terminal devices, the network performance between the second terminal device and the first terminal device is the largest, and the network performance between the third terminal device and the first terminal device is the smallest.
[0049] In some embodiments, the third terminal device 130 is also installed with the first conference application; the method further includes: when the network load of the first terminal device 110 is less than or equal to a preset threshold, the first terminal device 110 sends a stop notification to the second terminal device 120, and sends a reception notification to the third terminal device 130; the second terminal device 120 responds to the stop notification and no longer sends the second video stream and the second audio stream to the third terminal device 130 through the second conference application 210 installed on the second terminal device 120; the third terminal device 130 responds to the reception notification through the third terminal device 1 The first conference application 210 installed on the third terminal device 130 receives a third video stream and a third audio stream from the first terminal device 110, the third video stream including the speaker's picture at the first venue, and the third audio stream including the speaker's voice at the first venue; wherein the first conference application 210 installed on the third terminal device 130 displays the third video stream through the second display screen to show the speaker's picture to the user on the third terminal device 130 side; the first conference application installed on the third terminal device 130 plays the speaker's voice through the second audio playback device to provide the speaker's voice to the user on the third terminal device 130 side.
[0050] In this way, when the network load of the first terminal device 110 is relatively small, the first terminal device 110 directly sends the information delivered by the presenter to the third terminal device 130 without forwarding by the second terminal device.
[0051] In summary, through the information processing method provided by the embodiment of the present invention, a user can use one video conferencing application to participate in a video conference conducted in another video conferencing application, thereby allowing the user to participate in video conferences in multiple video conferencing applications through one video conferencing application.
[0052] An embodiment of the present invention further provides a conference system, the conference system comprising a first terminal device, a second terminal device, and a third terminal device, wherein the second terminal device is installed with a first conference application and a second conference application, the second terminal device is in a first conference venue through the first conference application and the first terminal device, and the second terminal device is in a second conference venue through the second conference application and the third terminal device; The second terminal device is used to receive a first video stream and a first audio stream from the first terminal device through the first conference application installed on the second terminal device, wherein the first video stream includes a picture of a speaker at the first conference site, and the first audio stream includes a voice of a speaker at the first conference site; wherein the first conference application installed on the second terminal device displays the first video stream through a first display screen of the second terminal device to show the picture of the speaker to a user on the second terminal device side; and the first conference application installed on the second terminal device plays the voice of the speaker through a first audio playback device of the second terminal device to provide the voice of the speaker to a user on the second terminal device side; The second terminal device is used to send a second video stream and a second audio stream to the third terminal device through the second conference application installed on the second terminal device; wherein the second video stream includes display content of the first display screen, and the second audio stream includes playback content of the first audio playback device, wherein the display content includes the speaker's screen displayed on the first display screen, and the playback content includes the speaker's voice played by the first audio playback device; Among them, the second conference application installed on the third terminal device plays the second video stream through the second display screen of the third terminal device to show the speaker's screen to the user on the third terminal device side; the second conference application installed on the third terminal device plays the second audio stream through the second audio playback device of the third terminal device to provide the speaker's voice to the user on the third terminal device side.
[0053] An embodiment of the present invention further provides a second terminal device, wherein the conference system in which the second terminal device is located includes a first terminal device and a third terminal device, wherein the second terminal device is installed with a first conference application and a second conference application, the second terminal device is in a first conference venue through the first conference application and the first terminal device, and the second terminal device is in a second conference venue through the second conference application and the third terminal device; the second terminal device includes: A receiving module, configured to receive a first video stream and a first audio stream from the first terminal device through the first conference application installed on the second terminal device, wherein the first video stream includes a picture of a speaker at the first venue, and the first audio stream includes a voice of the speaker at the first venue; wherein the first conference application installed on the second terminal device displays the first video stream through a first display screen of the second terminal device to show the picture of the speaker to a user on the second terminal device side; and the first conference application installed on the second terminal device plays the voice of the speaker through a first audio playback device of the second terminal device to provide the voice of the speaker to a user on the second terminal device side; A sending module, configured to send a second video stream and a second audio stream to the third terminal device through the second conference application installed on the second terminal device; wherein the second video stream includes the display content of the first display screen, and the second audio stream includes the playback content of the first audio playback device, wherein the display content includes the speaker's screen displayed on the first display screen, and the playback content includes the speaker's voice played by the first audio playback device; Among them, the second conference application installed on the third terminal device plays the second video stream through the second display screen of the third terminal device to show the speaker's screen to the user on the third terminal device side; the second conference application installed on the third terminal device plays the second audio stream through the second audio playback device of the third terminal device to provide the speaker's voice to the user on the third terminal device side.
[0054] An embodiment of the present invention provides a terminal device. The terminal device may include a processor and a memory, wherein the memory stores computer instructions, and when the processor executes the computer instructions, the terminal device may perform the operation performed by the first terminal device 110 described above, or perform the operation performed by the second terminal device 120 described above, or perform the operation performed by the third terminal device 130 described above.
[0055] An embodiment of the present invention further provides a computer-readable storage medium, comprising computer program instructions. When the computer program instructions are executed by a computer device, the computer device performs the operations performed by the second terminal device 120 described above, or performs the operations performed by the third terminal device 130 described above.
[0056] The embodiment of the present invention further provides a computer program product comprising instructions, which, when executed by a computer device, enables the computer device to perform the operations performed by the second terminal device 120 described above, or to perform the operations performed by the third terminal device 130 described above.
[0057] Although the present invention has been described in detail above by general description and specific embodiments, it is obvious to those skilled in the art that some modifications or improvements can be made to the present invention. Therefore, these modifications or improvements made without departing from the spirit of the present invention all belong to the scope of protection claimed by the present invention.
Claims
1. An information processing method, characterized in that: Applied to a conference system, the conference system includes a first terminal device, a second terminal device, and a third terminal device, wherein the second terminal device is installed with a first conference application and a second conference application, the second terminal device is in a first conference venue through the first conference application and the first terminal device, and the second terminal device is in a second conference venue through the second conference application and the third terminal device; the method includes: The second terminal device receives a first video stream and a first audio stream from the first terminal device through the first conference application installed on the second terminal device, wherein the first video stream includes a picture of a speaker at the first conference site, and the first audio stream includes a voice of a speaker at the first conference site; wherein the first conference application installed on the second terminal device displays the first video stream through a first display screen of the second terminal device to show the picture of the speaker to a user on the second terminal device side; and the first conference application installed on the second terminal device plays the voice of the speaker through a first audio playback device of the second terminal device to provide the voice of the speaker to a user on the second terminal device side; at the same time, The second terminal device sends a second video stream and a second audio stream to the third terminal device through the second conference application installed on the second terminal device; wherein the second video stream includes display content of the first display screen, and the second audio stream includes playback content of the first audio playback device, wherein the display content includes the speaker's screen displayed on the first display screen, and the playback content includes the speaker's voice played by the first audio playback device; Among them, the second conference application installed on the third terminal device plays the second video stream through the second display screen of the third terminal device to show the speaker's screen to the user on the third terminal device side; the second conference application installed on the third terminal device plays the second audio stream through the second audio playback device of the third terminal device to provide the speaker's voice to the user on the third terminal device side.
2. The method according to claim 1, characterized in that: The second terminal device includes a camera, the camera is used to collect a user screen on the second terminal device side, and the second video stream includes the user screen on the second terminal device side; The second conference application installed on the third terminal device plays the second video stream through the second display screen of the third terminal device to show the speaker's screen and the user's screen on the second terminal device side to the user on the third terminal device side.
3. The method according to claim 2, characterized in that The second conference application installed on the third terminal device is used to play the speaker's screen in the second video stream in the first area of the second display screen, and the second conference application installed on the third terminal device is used to play the user screen on the second terminal device side in the second video stream in the second area of the second display screen.
4. The method according to claim 2, characterized in that: The second conference application installed on the third terminal device is used to provide a first interface and a second interface, the first interface is used to display the speaker's screen in the second video stream, and the second interface is used to display the user screen on the second terminal device side in the second video stream.
5. The method according to any one of claims 1 to 4, characterized in that The second terminal device further includes an audio acquisition device, and the audio acquisition device is used to collect the user voice on the second terminal device side; the second audio stream includes the user voice on the second terminal device side; The second conference application installed on the third terminal device plays the second audio stream through the second audio playback device of the third terminal device to provide the speaker's voice and the user's voice on the second terminal device side to the user on the third terminal device side.
6. The method according to any one of claims 1 to 4, characterized in that The method further includes: when the network load of the first terminal device is greater than a preset threshold, the first terminal device sending a forwarding notification to the second terminal device; The second terminal device sends the second video stream and the second audio stream to the third terminal device through the second conference application installed on the second terminal device, including: the second terminal device responds to the forwarding notification and sends the second video stream and the second audio stream to the third terminal device through the second conference application installed on the second terminal device.
7. The method according to claim 6, characterized in that The first terminal device is connected to multiple terminal devices, and the multiple terminal devices include the second terminal device and a third terminal device; wherein, among the multiple terminal devices, the network performance between the second terminal device and the first terminal device is the largest, and the network performance between the third terminal device and the first terminal device is the smallest.
8. The method according to any one of claims 1 to 4, characterized in that The third terminal device is also installed with the first conference application; the method further includes: When the network load of the first terminal device is less than or equal to a preset threshold, the first terminal device sends a stop notification to the second terminal device, and sends a reception notification to the third terminal device; The second terminal device responds to the stop notification and no longer sends the second video stream and the second audio stream to the third terminal device through the second conference application installed on the second terminal device; The third terminal device responds to the reception notification and receives a third video stream and a third audio stream from the first terminal device through the first conference application installed on the third terminal device, wherein the third video stream includes the speaker's image at the first venue, and the third audio stream includes the speaker's voice at the first venue; wherein the first conference application installed on the third terminal device displays the third video stream through the second display screen to show the speaker's image to the user on the third terminal device side; and the first conference application installed on the third terminal device plays the speaker's voice through the second audio playback device to provide the speaker's voice to the user on the third terminal device side.
9. A conference system, characterized in that: The conference system includes a first terminal device, a second terminal device, and a third terminal device, wherein the second terminal device is installed with a first conference application and a second conference application, the second terminal device is in a first conference venue through the first conference application and the first terminal device, and the second terminal device is in a second conference venue through the second conference application and the third terminal device; The second terminal device is used to receive a first video stream and a first audio stream from the first terminal device through the first conference application installed on the second terminal device, wherein the first video stream includes a picture of a speaker at the first conference site, and the first audio stream includes a voice of a speaker at the first conference site; wherein the first conference application installed on the second terminal device displays the first video stream through a first display screen of the second terminal device to show the picture of the speaker to a user on the second terminal device side; and the first conference application installed on the second terminal device plays the voice of the speaker through a first audio playback device of the second terminal device to provide the voice of the speaker to a user on the second terminal device side; The second terminal device is used to send a second video stream and a second audio stream to the third terminal device through the second conference application installed on the second terminal device; wherein the second video stream includes display content of the first display screen, and the second audio stream includes playback content of the first audio playback device, wherein the display content includes the speaker's screen displayed on the first display screen, and the playback content includes the speaker's voice played by the first audio playback device; Among them, the second conference application installed on the third terminal device plays the second video stream through the second display screen of the third terminal device to show the speaker's screen to the user on the third terminal device side; the second conference application installed on the third terminal device plays the second audio stream through the second audio playback device of the third terminal device to provide the speaker's voice to the user on the third terminal device side.
10. A second terminal device, characterized in that: The conference system where the second terminal device is located includes a first terminal device and a third terminal device, wherein the second terminal device is installed with a first conference application and a second conference application, the second terminal device is in a first conference venue through the first conference application and the first terminal device, and the second terminal device is in a second conference venue through the second conference application and the third terminal device; the second terminal device includes: A receiving module, configured to receive a first video stream and a first audio stream from the first terminal device through the first conference application installed on the second terminal device, wherein the first video stream includes a picture of a speaker at the first venue, and the first audio stream includes a voice of the speaker at the first venue; wherein the first conference application installed on the second terminal device displays the first video stream through a first display screen of the second terminal device to show the picture of the speaker to a user on the second terminal device side; and the first conference application installed on the second terminal device plays the voice of the speaker through a first audio playback device of the second terminal device to provide the voice of the speaker to a user on the second terminal device side; A sending module, configured to send a second video stream and a second audio stream to the third terminal device through the second conference application installed on the second terminal device; wherein the second video stream includes the display content of the first display screen, and the second audio stream includes the playback content of the first audio playback device, wherein the display content includes the speaker's screen displayed on the first display screen, and the playback content includes the speaker's voice played by the first audio playback device; Among them, the second conference application installed on the third terminal device plays the second video stream through the second display screen of the third terminal device to show the speaker's screen to the user on the third terminal device side; the second conference application installed on the third terminal device plays the second audio stream through the second audio playback device of the third terminal device to provide the speaker's voice to the user on the third terminal device side.
