Cloud Conference Content Sharing Method, Device, Electronic Device and Storage Medium
By using the screen projection function to share large files in cloud meetings, the problem of low file upload efficiency is solved, and more efficient content sharing and improved user experience is achieved.
Patent Information
- Application Number
- CN202210685292.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-06-16
- Publication Date
- 2025-06-24
- Estimated Expiration
- 2042-06-16
AI Technical Summary
In cloud meetings, when attendees need to share larger files, file upload and sharing are inefficient, resulting in poor user experience.
By detecting the size of the content to be shared, when the size is greater than the threshold, participants are prompted to use the screen projection function to share the content. The cloud server receives the screen projection content and pushes it to other participating devices, so that content can be shared without uploading to the cloud server.
It improves the efficiency of sharing large files, improves the cloud meeting experience of participants, and reduces waiting time.
Smart Images

Figure CN115033197B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of cloud conferencing, and in particular to a method, device, electronic device and storage medium for sharing cloud conferencing content. Background Art
[0002] In some special cases, there is a need for remote conferencing. For example, many enterprises need to establish business bases in various places. Therefore, enterprises need to conduct discussions and communications through remote conferencing. Another example is that due to factors such as weather, environment, and health, practitioners cannot return to the workplace to work on time. In order to facilitate colleagues working from home to communicate and collaborate with leaders and colleagues within the organization in a timely manner, and to perform tasks such as extremely urgent R & D and release services, remote conferencing can be accessed. Remote conferencing refers to multiple individuals or groups in different geographical locations who, through the network, transmit voices, images, and document materials to achieve instant and interactive communication, which can be voice conferencing or video conferencing.
[0003] Currently, when participants in a cloud conferencing group want to share a certain file, they need to first upload the file to the cloud server and then load the file onto the cloud conferencing desktop for sharing. However, all participants are in the same group, and different participants may have different files to share. When the file to be shared is large, it will take a long time to complete the file upload, resulting in poor file sharing efficiency and a poor cloud conferencing experience for users. Summary of the Invention
[0004] Embodiments of the present application provide a method, device, electronic device and storage medium for sharing cloud conferencing content. When the shared content is large, participants are prompted to share the content through the screen mirroring function, which improves the sharing efficiency of large files and the cloud conferencing experience of users.
[0005] In a first aspect, embodiments of the present application provide a method for sharing cloud conferencing content, including:
[0006] Obtain the size of the content to be shared by a target participant in a cloud conferencing group;
[0007] When the size of the content to be shared is greater than a threshold, push a prompt message to the cloud conferencing desktop of the participant device of the target participant, where the prompt message is used to prompt the target participant to use the screen mirroring function to share the content to be shared;
[0008] When it is detected that the participant device of the target participant shares content using the screen mirroring function, receive the screen mirroring content from the participant device of the target participant, where the screen mirroring content includes the content to be shared;
[0009] When presenting the screen-cast content on the cloud conference desktop, push the screen-cast content to the participating devices of the remaining participants in the cloud conference group except the target participant.
[0010] In a second aspect, an embodiment of the present application provides a cloud conference content sharing device, including: a receiving module, a processing module, and a sending module;
[0011] The processing module obtains the size of the content to be shared of a target participant in the cloud conference group;
[0012] The processing module is configured to, when determining that the size of the content to be shared is greater than a threshold, control the sending module to push a prompt message to the cloud conference desktop of the participating device of the target participant, where the prompt message is used to prompt the target participant to use the screen-cast function to share the content to be shared;
[0013] The processing module is configured to, when detecting that the participating device of the target participant uses the screen-cast function to share content, control the receiving module to receive the screen-cast content from the participating device of the target participant, where the screen-cast content includes the content to be shared; and when determining to present the screen-cast content on the cloud conference desktop, control the sending module to push the screen-cast content to the participating devices of the remaining participants in the cloud conference group except the target participant.
[0014] In a third aspect, an embodiment of the present application provides an electronic device, including: a processor, the processor is connected to a memory, the memory is used to store a computer program, and the processor is used to execute the computer program stored in the memory so that the electronic device executes the method described in the first aspect.
[0015] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, the computer-readable storage medium stores a computer program, and the computer program enables a computer to execute the method described in the first aspect.
[0016] In a fifth aspect, an embodiment of the present application provides a computer program product, the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer is operable to enable a computer to execute the method described in the first aspect.
[0017] Implementing the embodiments of the present application has the following beneficial effects:
[0018] It can be seen that in the embodiments of the present application, when any participant shares content, the cloud server first detects the size of the content to be shared. When the size of the content to be shared is greater than the threshold, the participant is prompted with a prompt message to share the content using the screen mirroring function. After the cloud server receives the screen mirroring content of the participant, when demonstrating the shared content, the screen mirroring content can be directly streamed to the participating devices of the remaining participants in the cloud meeting group except the participant, realizing content sharing without uploading the shared content to the cloud server, thereby improving the sharing efficiency of large files and enhancing the cloud meeting experience of the participants. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] To more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the drawings in the following description are some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.
[0020] Figure 1 Schematic diagram of the architecture of a cloud meeting content sharing system provided by an embodiment of the present application;
[0021] Figure 2 Schematic diagram of the process of a cloud meeting content sharing method provided by an embodiment of the present application;
[0022] Figure 3 Schematic diagram of a cloud meeting desktop provided by an embodiment of the present application;
[0023] Figure 4 Schematic diagram of sharing content on a cloud meeting desktop provided by an embodiment of the present application;
[0024] Figure 5 Schematic diagram of another cloud meeting desktop provided by an embodiment of the present application;
[0025] Figure 6 Schematic diagram of demonstrating the shared content of participant A provided by an embodiment of the present application;
[0026] Figure 7 Schematic diagram of prompting to share content using the screen mirroring function through a prompt message provided by an embodiment of the present application;
[0027] Figure 8 Schematic diagram of sharing content using the screen mirroring function provided by an embodiment of the present application;
[0028] Figure 9 Schematic diagram of demonstrating the screen mirroring content on a cloud meeting desktop provided by an embodiment of the present application;
[0029] Figure 10 It is a block diagram of the functional units of a cloud conference content sharing device provided by an embodiment of the present application;
[0030] Figure 11 It is a schematic structural diagram of an electronic device provided by an embodiment of the present application. Specific embodiments
[0031] Next, the technical solutions in the embodiments of the present application will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all of the embodiments. According to the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.
[0032] The terms "first", "second", "third", "fourth", etc. in the specification and claims of the present application and the accompanying drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or device that includes a series of steps or units is not limited to the listed steps or units, but optionally further includes steps or units not listed, or optionally further includes other steps or units inherent to these processes, methods, products, or devices.
[0033] Referring to
[0034] Referring to Figure 1 , Figure 1 It is a schematic architecture diagram of a cloud conference content sharing system provided by an embodiment of the present application. The cloud conference content sharing system includes: a first user device 10, multiple second user devices 20, a third user device 30, and a cloud server 40.
[0035] Among them, the first user device 10 is the local device of the conference creator, and the conference creator can create a cloud conference group on the cloud server 40 through the first user device 10;
[0036] The second user device 20 is the local device of any participant (also referred to as the local device), and any participant can join the above cloud meeting group through the second user device 20 of that participant. It should be noted that the meeting creator can join the cloud meeting group as a participant or not join the cloud meeting group;
[0037] The third user device 30 is the local device of the target participant (also referred to as the local device). The target participant is the participant among all the participants in the above cloud meeting group who has a sharing requirement. Then the target participant can share content with the cloud server 40 through the third user device 30;
[0038] The cloud server 40 streams the shared content of the target participant to each second user device 20 so that each participant can view the above shared content through their respective local devices.
[0039] Based on the above system architecture, in an embodiment of the present application, the cloud server 40 obtains the size of the content to be shared by the target participant in the cloud meeting group; when the size of the content to be shared is greater than the threshold, the cloud server 40 pushes a prompt message to the meeting desktop of the participant device of the target participant. The prompt message is used to prompt the target participant to use the screen mirroring function to share the content to be shared; when the confirmation message for using the screen mirroring function sent by the participant device of the target participant is detected, the cloud server 40 receives the screen mirroring content from the participant device of the target participant; when demonstrating the screen mirroring content on the cloud meeting desktop, the cloud server 40 streams the screen mirroring content to the participant devices of the remaining participants in the cloud meeting group except the target participant.
[0040] It can be seen that in the embodiment of the present application, when any participant shares content, the cloud server 40 first detects the size of the content to be shared. When the size of the content to be shared is greater than the threshold, the participant is prompted to use the screen mirroring function to share the content through the prompt message. After the cloud server 40 receives the screen mirroring content of the participant, the screen mirroring content can be streamed to the participant devices of the remaining participants in the cloud meeting group except the participant, realizing content sharing without uploading the shared content to the cloud server 40, thereby improving the sharing efficiency of large files.
[0041] Refer to Figure 2 , Figure 2 which is a schematic flowchart of a cloud meeting content sharing method provided by an embodiment of the present application. This method is applied to Figure 1 the cloud meeting content sharing system shown. This method includes but is not limited to the following steps:
[0042] 201: The cloud server obtains the size of the content to be shared by the target participant in the cloud meeting group.
[0043] Exemplarily, the cloud server first creates a cloud conference group based on the conference creation requirements of the cloud conference creator. Then, each participant can join the cloud conference group through a local device, and the cloud conference interface is pushed to the participating devices of each participant for display. As Figure 3 shown, the participants in the cloud conference include Participant A, Participant B, Participant C, and Participant D. Then, the cloud server can set up demonstration windows for each participant and some function buttons on the cloud conference desktop. For example, a function button for viewing participating members, etc., and push such a cloud conference desktop to the participating devices of each participant. As Figure 3 shown, the cloud conference interface pushed by the cloud server includes demonstration windows of Participant A, Participant B, Participant C, and Participant D, and relevant information of the participant corresponding to the demonstration window is displayed in each demonstration window. For example, the login ID and login avatar of the participant, etc.
[0044] Optionally, when a target participant needs to share content, the target participant can share the content through the sharing function button on the cloud conference desktop displayed on the participating device of the target participant, where the target participant is a participant among all the participants, and the number of target participants is one or more. As Figure 4 shown, when the target participant clicks the sharing button, function buttons corresponding to various sharing types can be popped up, where the sharing types include but are not limited to files, pictures, videos, and website addresses. After the target participant selects the corresponding content for sharing, the participating device of the target participant will upload the shared content to the cloud server. After the cloud server receives the shared content of the target participant, it will store the shared content in the cloud space for subsequent display on the cloud conference desktop.
[0045] As Figure 5 shown, after the cloud server receives the shared content uploaded by the participating devices of each participant, it can display relevant information of the shared content in the demonstration window of each participant. For example, the icon information of the shared content. For example, if Participant A and Participant B are target participants, and the shared content of Participant A is a PDF document, then a file icon in the.PDF format can be displayed in the demonstration window of Participant A. If the shared content of Participant B is a video, then a video icon in the.mp4 format can be displayed in the demonstration window of Participant B.
[0046] Among them, the shared content of any participant can be a file (such as an office file, a CAD drawing file, an audio file, a video file), a document (such as a PPT, a PDF), a split-screen mirror image of the local device of the participant, and screen recording content, etc.
[0047] Further, when presenting the shared content of any participant, the host can full-screen display the presentation window of that participant to present the shared content of that participant. Here, the host is a person with the control permission of the cloud conference desktop, and the host can be any one of all the participants. Moreover, the host can transfer the control permission of the cloud conference desktop to any one of the participants. Therefore, when presenting the shared content of any participant, it can be presented by the host, or after the participant himself / herself obtains the control permission of the cloud conference desktop, he / she can present it independently. This application does not make any restrictions on this.
[0048] As Figure 6 shown, when presenting the shared content of Participant A, the host will click the full-screen display button of Participant A's presentation window to generate a full-screen display instruction for Participant A's presentation window. After receiving the full-screen display instruction, the cloud server will set the display content on the cloud conference desktop to only Participant A's presentation window, and will no longer display the presentation windows of other participants, and push the cloud conference desktop to the participating devices of each participant. Then, the host can click on any shared content of Participant A on the cloud conference desktop and generate a sharing instruction for that shared content, and the participating device of the host will send the sharing instruction to the cloud server. After receiving the sharing instruction, the cloud server will obtain the shared content indicated by the sharing instruction from the cloud space and push the shared content to the cloud conference desktops of each participating device for display. As Figure 6 shown, the host can click the icon of the PDF file shared by Participant A, so as to present the PDF document on the cloud conference desktop.
[0049] In the embodiment of this application, when detecting the shared content of the target participant, first obtain the size of the content to be shared by the target participant, rather than directly uploading the shared content by the participating device of the target person.
[0050] Exemplarily, when the participating device of the target participant detects the sharing requirement of the target participant, it will obtain the size of the content to be shared and send an indication message to the cloud server, where the indication message is used to indicate the size of the content to be shared by the target participant. Correspondingly, after receiving the indication message, the cloud server can determine the size of the content to be shared based on the indication message.
[0051] Exemplarily, obtain the audio information in the cloud meeting group within a preset time period, where the preset time period is the time period before the target participant shares the content to be shared. It should be understood that for a participant to share content, they need to first join the cloud meeting group. When a certain participant wants to share content, or is required to share content, the host will notify the participants in the cloud meeting to share the corresponding content. Correspondingly, the participant will share the content only after receiving the corresponding notification. Therefore, when detecting the operation of the target participant uploading the content to be shared, the audio information within the time period before uploading the content to be shared can be obtained from the cloud space. This time period can be the time period from the moment the host joins the cloud meeting group to the time when the target participant's operation of uploading the content to be shared is detected.
[0052] Further, extract the target audio segment related to the content to be shared from the audio information. Optionally, based on semantic analysis, segment the audio information to obtain multiple candidate audio segments. That is, regard the audio information with complete semantics as a candidate audio segment. Then, extract keywords from each candidate audio segment. When the extracted keywords meet the requirements, regard the candidate audio segment as the target audio segment, where the keywords meeting the requirements means that when the keywords contain preset keywords such as "share" or "sharing", it is determined that they meet the requirements. Optionally, the cloud server obtains the speaking moments of the host or the target participant within the preset time period, and based on the speaking moments of the host or the target participant, filters out the speaking audio of the host or the target participant from the audio information, and regards the speaking audio as the target audio segment.
[0053] Further, identify the target audio segment to obtain the size of the content to be shared. Specifically, identify the target audio segment to obtain the name and type of the content to be shared; determine the size of the content to be shared according to the name and type of the content to be shared. Exemplarily, perform text recognition on the target audio to obtain text information; then perform recognition on the text information to obtain the name and type of the content to be shared, where the type of the content to be shared includes one of file, video, picture, or website. Exemplarily, based on the name and type, obtain the average size of the file corresponding to the name and type, and regard the average size as the size of the content to be shared. For example, if the type is PDF and the name is "Product Instruction Manual", the average size of the PDF format product instruction manual can be obtained and regarded as the size of the content to be shared.
[0054] 202: When the size of the content to be shared is greater than the threshold, the cloud server pushes a prompt message to the meeting desktop of the target participant's participating device, and the prompt message is used to prompt the target participant to use the screen mirroring function to share the content to be shared.
[0055] Exemplarily, as Figure 7 shown, when the cloud server detects that the content to be shared is greater than the threshold, the cloud server separately sends a prompt message to the cloud conference desktop of the participating device of the target participant. The prompt message is used to prompt the target participant to use the screen mirroring function to share the content to be shared.
[0056] 203: When the cloud server detects the confirmation message for using the screen mirroring function sent by the participating device of the target participant, the cloud server receives the screen mirroring content from the participating device of the target participant.
[0057] Furthermore, when the target participant receives this prompt message, the target participant can share the content to be shared through the screen mirroring function. Exemplarily, as Figure 8 shown, after the target participant clicks the screen mirroring function button, the participating device of the target participant can perform screen capture, and send the captured content as the screen mirroring content to the cloud server. Correspondingly, the target participant only needs to open the content to be shared on the local desktop of the participating device of the target participant, and then the screen mirroring content includes the content to be shared.
[0058] 204: When demonstrating the screen mirroring content on the cloud conference desktop, the cloud server streams the screen mirroring content to the participating devices of the remaining participants in the cloud conference group except the target participant.
[0059] Optionally, after the cloud server receives this screen mirroring content, as Figure 9 shown, if there is no content being demonstrated on the cloud conference desktop at this time, the cloud server will merge this screen mirroring content with the shared content of other participants, and stream it to the cloud conference desktop to display the shared content of each participant in the demonstration windows of each participant. When a demonstration instruction for this screen mirroring content is detected, as Figure 9 shown, after participant A uploads the screen mirroring content to the cloud server, when a full-screen display instruction for the demonstration window of participant A is detected, the screen mirroring content can be demonstrated on the cloud conference desktop, and the cloud conference desktop is streamed to the participating devices of the remaining participants in the cloud conference group except the target participant, so as to realize streaming the screen mirroring content to the participating devices of the remaining participants in the cloud conference group except the target participant when demonstrating the screen mirroring content on the cloud conference desktop.
[0060] Optionally, after the cloud server receives this screen mirroring content, as Figure 9 shown, if the cloud conference desktop is demonstrating the shared content of other participants at this time, the cloud server will use this screen mirroring content as the demonstration content in the demonstration window of the target participant, and the shared content being shared by other participants will cover the above of this demonstration window. As Figure 9As shown in the figure, the presentation window of Participant B is being demonstrated on the cloud conference desktop, and the presentation window of Participant A will not be displayed. When it is necessary to demonstrate the screen mirroring content, the presentation windows of other participants will be minimized. For example, Figure 9 As shown in the figure, when an instruction to exit full-screen display of the presentation window of other participants is detected, the presentation window will be displayed on the cloud conference desktop at this time. When the cloud server detects a full-screen display instruction for the presentation window of Participant A, the screen mirroring content will be demonstrated on the conference desktop, and the cloud conference desktop will be streamed to the participating devices of the remaining participants in the cloud conference group except the target participant, so that when the screen mirroring content is demonstrated on the cloud conference desktop, the screen mirroring content will be streamed to the participating devices of the remaining participants in the cloud conference group except the target participant.
[0061] Optionally, after the cloud server receives the screen mirroring content, as Figure 9 shown in the figure, if the shared content being demonstrated on the cloud conference desktop at this time is also the shared content of the target participant, the display content will be directly replaced with the screen mirroring content, and the cloud conference desktop will be streamed to the participating devices of the remaining participants in the cloud conference group except the target participant, so that when the screen mirroring content is demonstrated on the cloud conference desktop, the screen mirroring content will be streamed to the participating devices of the remaining participants in the cloud conference group except the target participant.
[0062] It can be seen that in the embodiment of the present application, when any participant shares content, the cloud server first detects the size of the content to be shared. When the size of the content to be shared is greater than the threshold, the participant is prompted with a prompt message to share the content using the screen mirroring function. In this way, after the cloud server receives the screen mirroring content of the participant, when demonstrating the shared content, the screen mirroring content can be directly streamed to the participating devices of the remaining participants in the cloud conference group except this participant, realizing content sharing without uploading the shared content to the cloud server, thereby improving the sharing efficiency of large files and the cloud conference experience of the participants.
[0063] In an embodiment of the present application, the screen mirroring content is parsed; when it is determined that the screen mirroring content contains pop-up window information, the pop-up window information is blurred to obtain new screen mirroring content; the new screen mirroring content is streamed to the participating devices of other participants in the cloud conference group except the target participant.
[0064] Exemplarily, for the screen mirroring mode, if a pop-up window appears during screen mirroring, especially when privacy information appears in the pop-up window, if the screen mirroring content of the participating personnel is directly streamed to the participating devices of other participating personnel, the privacy information of the target participating personnel will be leaked to other participating personnel. Therefore, after obtaining the screen mirroring content, first identify the screen mirroring content to determine whether it contains a pop-up window, and perform blurring processing on the pop-up window information. For example, adding a mosaic or replacement processing, etc., to obtain a new screen mirroring content (data stream), and use the new screen mirroring content as the screen mirroring content of the participating device of the target participating personnel, and stream it to the participating devices of other participating personnel in the cloud conference group except the target participating personnel. Specifically, render the screen mirroring content of the target participating personnel to obtain a screenshot image; perform border recognition on the screenshot image to determine whether a pop-up window appears in the uppermost area of the screenshot image. If a pop-up window appears, it is determined that the screen mirroring content contains pop-up window information; obtain the first sub-data stream corresponding to the pop-up window content from the screen mirroring content, perform blurring processing on the sub-data stream to obtain a second sub-data stream; use the second sub-data stream to replace the first sub-data stream in the above screen mirroring content to obtain a new screen mirroring content.
[0065] It can be seen that in this embodiment, when sharing files through screen mirroring, first perform pop-up window recognition on the screen mirroring content and perform blurring protection on the pop-up window information, so as to realize sharing content through screen mirroring, improve the sharing efficiency of large files, protect the privacy of participating personnel, and further improve the cloud conference experience of users.
[0066] In an embodiment of the present application, when the number of the target participating personnel is multiple, before receiving the screen mirroring content from the participating devices of the target participating personnel, the method further includes: allocating corresponding uplink time-frequency resources for each target participating personnel from the uplink idle resources according to the content to be shared by each target participating personnel and the presentation order of each target participating personnel; then, receiving the screen mirroring content from the participating devices of each target participating personnel through the uplink time-frequency resources of each target participating personnel.
[0067] In an embodiment of the present application, the presentation duration of each target participant is determined according to the type and size of the content to be shared by each target participant. Exemplarily, according to the type of the content to be shared by each target participant, the preset browsing speed corresponding to each target participant is determined; according to the size of the content to be shared by each target participant and the preset browsing speed, the browsing duration of the content to be shared by each target participant is determined, and the browsing duration is used as the presentation duration of each target participant, where the browsing duration is the duration of browsing the content to be shared by each target participant at the normal browsing speed. Specifically, the corresponding relationship between the type of the shared content and the browsing speed is set in advance. For example, the browsing speed corresponding to the document is set to A pages per second, the browsing speed of the video is B frames per second (which can also be understood as the playback speed), and the browsing speed of the image is C frames per second. Therefore, when the content to be shared by a certain target participant is a document, the number of pages of the content to be shared can be determined based on the size of the content to be shared, and the browsing duration can be predicted based on the number of pages and the browsing speed corresponding to the document. When the content to be shared is a video, the number of frames of the content to be shared can be determined based on the size of the content to be shared, and the browsing duration can be predicted based on the number of frames and the browsing speed corresponding to the video. When the content to be shared is an image, the number of frames of the content to be shared can be determined based on the size of the content to be shared, and the browsing duration can be predicted based on the number of frames and the browsing speed corresponding to the image.
[0068] Further, according to the presentation order of each target participant and the presentation duration of each target participant, the presentation time period of each target participant is determined. That is, based on the presentation order of each target participant, they are sorted in the order from front to back, and then combined with the presentation duration of each target participant, the presentation time period of each target participant can be determined. According to the presentation time period of each target participant, the corresponding uplink time-domain resources are allocated for each target participant from the uplink idle resources. Exemplarily, based on the presentation time period of each target participant, the first total presentation time period of multiple target participants is determined, and the time-domain resources corresponding to the first total presentation time period in the uplink idle resources are used as the corresponding uplink time-domain resources allocated for each target participant. Further, in order to handle unexpected situations during the presentation of the target participants, for example, the presentation time period of some target participants is postponed, etc., an offset value (a positive value) can be added to the first total presentation time period to obtain the second total presentation time period, and the time-domain resources corresponding to the second total presentation time period can be used as the corresponding uplink time-domain resources allocated for each target participant.
[0069] Further, according to the type of the content to be shared by each target participant, determine the size of each frame of the screen projection content of each target participant. That is, according to the type of the participating device of each target participant and the type of the content to be shared, determine the size of each frame of the screen projection content, where the size of each frame of the screen projection content is the average size of each frame of the screen projection content when projecting the shared content of the above type using the participating device of the above type. According to the size of each frame of the screen projection content of each target participant and the demonstration time period, allocate corresponding uplink frequency domain resources for each target participant from the uplink idle resources. That is, according to the correspondence between the size of each frame of the screen projection content and the frequency domain resources, determine the uplink frequency domain resources of each target during the demonstration time period, that is, ensure that the target participant has sufficient frequency domain resources for demonstration during the demonstration process, so as to ensure the quality of its screen projection content. In addition, for any target participant, during its demonstration time period, preferentially allocate uplink frequency domain resources corresponding to the size of each frame of its screen projection content from the uplink frequency domain resources, and the remaining uplink frequency domain resources during this demonstration time period are shared by other target participants. Similarly, the uplink frequency domain resources of this target participant during other time periods are shared with the remaining participants except the target participants who are demonstrating during this other time period. In this way, corresponding uplink frequency domain resources are allocated for each target participant. Finally, according to the uplink time domain resources and uplink frequency domain resources of each target participant, obtain the uplink time-frequency resources of each target participant.
[0070] It can be seen that in the embodiment of the present application, when multiple people share content and all use the screen projection function for sharing, based on the type of the shared content of each target participant and the demonstration order, determine the dedicated uplink time-frequency resources of each target participant, so that the screen projection content of each target participant can be received using the dedicated uplink time-frequency resources, ensuring the screen projection quality of each participant and further improving the cloud meeting experience of the participants.
[0071] Refer to Figure 10 , Figure 10 which is a functional unit composition block diagram of a cloud meeting content sharing device provided by an embodiment of the present application. The cloud meeting content sharing device 1000 includes: a receiving module 1001, a processing module 1002, and a sending module 1003, where:
[0072] The processing module 1002 is configured to obtain the size of the content to be shared by the target participants in the cloud meeting group;
[0073] The processing module 1002 is configured to control the sending module 1003 to push a prompt message to the cloud conference desktop of the participant device of the target participant when it is determined that the size of the content to be shared is greater than a threshold, where the prompt message is used to prompt the target participant to use the screen mirroring function to share the content to be shared;
[0074] The processing module 1002 is configured to control the receiving module 1001 to receive the screen mirroring content from the participant device of the target participant when it detects that the participant device of the target participant shares content using the screen mirroring function, where the screen mirroring content includes the content to be shared; and when determining to demonstrate the screen mirroring content on the cloud conference desktop, control the sending module 1003 to push the screen mirroring content to the participant devices of the remaining participants in the cloud conference group except the target participant.
[0075] In some possible implementation manners, in terms of the processing module 1002 obtaining the size of the content to be shared of the target participant in the cloud conference group, the processing module 1002 is specifically configured to:
[0076] Control the receiving module 1001 to receive indication information from the participant device of the target participant, where the indication information is used to indicate the size of the content to be shared of the target participant;
[0077] Determine the size of the content to be shared of the target participant according to the indication information.
[0078] In some possible implementation manners, in terms of the processing module 1002 obtaining the size of the content to be shared of the target participant in the cloud conference group, the processing module 1002 is specifically configured to:
[0079] Obtain the audio information in the cloud conference group within a preset time period, where the preset time period is the time period before the target participant shares the content to be shared;
[0080] Extract a target audio segment related to the content to be shared from the audio information;
[0081] Identify the target audio segment to obtain the size of the content to be shared.
[0082] In some possible implementation manners, in terms of the processing module 1002 identifying the target audio segment to obtain the size of the content to be shared, the processing module 1002 is specifically configured to:
[0083] Identify the target audio segment to obtain the name and type of the content to be shared;
[0084] Determine the size of the content to be shared according to the name and type of the content to be shared.
[0085] In some possible embodiments, in terms of the processing module 1002 pushing the screen projection content to the participating devices of the remaining participating persons in the cloud conference group except the target participating person, the processing module 1002 is specifically configured to:
[0086] Parse the screen projection content;
[0087] When it is determined that the screen projection content contains pop-up window information, perform blurring processing on the pop-up window information to obtain new screen projection content;
[0088] Use the new screen projection content as the screen projection content.
[0089] In some possible embodiments, when the number of target participating persons is multiple, before receiving the screen projection content from the participating devices of the target participating persons, the processing module 1002 is further configured to:
[0090] Allocate corresponding uplink time-frequency resources for each target participating person from the uplink idle resources according to the content to be shared by each target participating person and the presentation order of each target participating person;
[0091] In terms of receiving the screen projection content from the participating devices of the target participating persons, the processing module 1002 is specifically configured to:
[0092] Control the receiving module 1001 to receive the screen projection content from the participating devices of each target participating person through the uplink time-frequency resources of each target participating person.
[0093] In some possible embodiments, in terms of allocating corresponding uplink time-frequency resources for each target participating person from the uplink idle resources according to the content to be shared by each target participating person and the presentation order of each target participating person, the processing module 1002 is specifically configured to:
[0094] Determine the presentation duration of each target participating person according to the type and size of the content to be shared by each target participating person;
[0095] Determine the presentation time period of each target participating person according to the presentation order of each target participating person and the presentation duration of each target participating person;
[0096] Allocate corresponding uplink time-domain resources for each target participating person from the uplink idle resources according to the presentation time period of each target participating person;
[0097] Determine the size of each frame of the screen projection content of each target participating person according to the type of the content to be shared by each target participating person;
[0098] Allocate corresponding uplink frequency-domain resources for each target participant from the uplink idle resources according to the screen-casting size of each target participant.
[0099] Obtain the uplink time-frequency resources of each target participant according to the uplink time-domain resources and uplink frequency-domain resources of each target participant.
[0100] See Figure 11 , Figure 11 which is a schematic structural diagram of an electronic device provided by an embodiment of the present application. As Figure 11 shown, the electronic device 1100 includes a transceiver 1101, a processor 1102, and a memory 1103. They are connected by a bus 1104. The memory 1103 is used to store computer programs and data, and can transmit the data stored in the memory 1103 to the processor 1102.
[0101] The processor 1102 is used to read the computer program in the memory 1103 and perform the following operations:
[0102] Obtain the size of the content to be shared of the target participant in the cloud conference group;
[0103] When it is determined that the size of the content to be shared is greater than the threshold, control the transceiver 1101 to push a prompt message to the cloud conference desktop of the participant device of the target participant, and the prompt message is used to prompt the target participant to use the screen-casting function to share the content to be shared;
[0104] When it is detected that the participant device of the target participant uses the screen-casting function to share content, control the transceiver 1101 to receive the screen-casting content from the participant device of the target participant, where the screen-casting content includes the content to be shared; and when it is determined to demonstrate the screen-casting content on the cloud conference desktop, control the transceiver 1101 to push the screen-casting content to the participant devices of the remaining participants in the cloud conference group except the target participant.
[0105] In some possible implementation manners, in terms of obtaining the size of the content to be shared of the target participant in the cloud conference group, the processor 1102 is specifically used to perform the following steps:
[0106] Control the transceiver 1101 to receive indication information from the participant device of the target participant, where the indication information is used to indicate the size of the content to be shared of the target participant;
[0107] Determine the size of the content to be shared of the target participant according to the indication information.
[0108] In some possible embodiments, in terms of obtaining the size of the content to be shared by the target participant in the cloud conference group, the processor 1102 is specifically configured to perform the following steps:
[0109] Obtain the audio information in the cloud conference group within a preset time period, where the preset time period is the time period before the target participant shares the content to be shared;
[0110] Extract a target audio segment related to the content to be shared from the audio information;
[0111] Identify the target audio segment to obtain the size of the content to be shared.
[0112] In some possible embodiments, in terms of identifying the target audio segment to obtain the size of the content to be shared, the processor 1102 is specifically configured to perform the following steps:
[0113] Identify the target audio segment to obtain the name and type of the content to be shared;
[0114] Determine the size of the content to be shared according to the name and type of the content to be shared.
[0115] In some possible embodiments, in terms of pushing the screen mirroring content to the participating devices of the remaining participants in the cloud conference group except the target participant, the processor 1102 is specifically configured to perform the following steps:
[0116] Parse the screen mirroring content;
[0117] When it is determined that the screen mirroring content includes pop-up window information, perform blurring processing on the pop-up window information to obtain new screen mirroring content;
[0118] Use the new screen mirroring content as the screen mirroring content.
[0119] In some possible embodiments, when the number of target participants is multiple, before receiving the screen mirroring content from the participating devices of the target participants, the processor 1102 is further configured to perform the following steps:
[0120] Allocate corresponding uplink time-frequency resources for each target participant from the uplink idle resources according to the content to be shared by each target participant and the presentation order of each target participant;
[0121] In terms of receiving the screen mirroring content from the participating devices of the target participants, the processor 1102 is specifically configured to perform the following steps:
[0122] Control the transceiver 1101 to receive the screen projection content from the participating devices of each target participant through the uplink time-frequency resources of each target participant.
[0123] In some possible implementation manners, in terms of allocating corresponding uplink time-frequency resources for each target participant from the uplink idle resources according to the content to be shared by each target participant and the presentation order of each target participant, the processor 1102 is specifically configured to perform the following steps:
[0124] Determine the presentation duration of each target participant according to the type and size of the content to be shared by each target participant;
[0125] Determine the presentation time period of each target participant according to the presentation order of each target participant and the presentation duration of each target participant;
[0126] Allocate corresponding uplink time-domain resources for each target participant from the uplink idle resources according to the presentation time period of each target participant;
[0127] Determine the size of each frame of the screen projection content of each target participant according to the type of the content to be shared by each target participant;
[0128] Allocate corresponding uplink frequency-domain resources for each target participant from the uplink idle resources according to the screen projection size of each target participant;
[0129] Obtain the uplink time-frequency resources of each target participant according to the uplink time-domain resources and uplink frequency-domain resources of each target participant.
[0130] Specifically, the above transceiver 1101 may be Figure 10 The receiving module 1001 and the sending module 1003 of the cloud conference content sharing device 1000 in the above embodiments, and the above processor 1102 may be Figure 10 The processing module 1002 of the cloud conference content sharing device 1000 in the above embodiments.
[0131] It should be understood that the user equipment of the present application (including the above first user equipment, second user equipment, and third user equipment) may include smart phones (such as Android phones, iOS phones, Windows Phone phones, etc.), tablet computers, palmtop computers, laptop computers, mobile Internet devices MID (Mobile Internet Devices, abbreviated as: MID), or wearable devices, etc. The above user equipment is only an example, not an exhaustive list, and includes but is not limited to the above electronic devices. In practical applications, the above user equipment may further include: intelligent vehicle terminals, computer devices, and the like.
[0132] It should be understood that the electronic device in this application is a cloud server. Among them, the cloud server can be an independent physical server, a server cluster or a distributed system, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, and big data and artificial intelligence platforms.
[0133] The embodiments of the present application also provide a computer-readable storage medium. The computer-readable storage medium stores a computer program, and the computer program is executed by a processor to implement part or all of the steps of any one of the cloud meeting content sharing methods described in the above method embodiments.
[0134] The embodiments of the present application also provide a computer program product. The computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute part or all of the steps of any one of the cloud meeting content sharing methods described in the above method embodiments.
[0135] It should be noted that for the foregoing method embodiments, for the sake of simple description, they are all expressed as a series of action combinations. However, those skilled in the art should know that this application is not limited by the described action sequence, because according to this application, certain steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all optional embodiments, and the actions and modules involved are not necessarily essential to this application.
[0136] In the above embodiments, the descriptions of each embodiment have their own emphases. For the parts not detailed in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
[0137] In several embodiments provided by the present application, it should be understood that the disclosed device can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point, the displayed or discussed mutual coupling or direct coupling or communication connection can be through some interfaces, and the indirect coupling or communication connection of the device or unit can be in an electrical or other form.
[0138] The unit described as a separation component may or may not be physically separated. The component shown as a unit may or may not be a physical unit, that is, it may be located in one place or distributed over multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0139] In addition, in each embodiment of the present application, each functional unit may be integrated in a processing unit, may exist physically alone for each unit, or two or more units may be integrated in one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of a software program module.
[0140] If the above-mentioned integrated unit is implemented in the form of a software program module and sold or used as an independent product, it can be stored in a computer-readable memory. Based on such an understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a memory and includes several instructions for causing a computer device (which may be a personal computer, a server or a network device, etc.) to execute all or part of the steps of the methods described in each embodiment of the present application. The aforementioned memory includes: USB flash drives, read-only memories (ROM, Read-Only Memory), random access memories (RAM, Random Access Memory), mobile hard disks, magnetic disks or optical disks and other media that can store program codes.
[0141] Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing relevant hardware through a program. This program can be stored in a computer-readable memory. The memory can include: flash drives, read-only memories (abbreviation: ROM), random access memories (abbreviation: RAM), magnetic disks or optical disks, etc.
[0142] The above has introduced the embodiments of the present application in detail. Specific examples are used in this article to elaborate on the principle and implementation manner of the present application. The description of the above embodiments is only used to help understand the method and its core idea of the present application; at the same time, for those of ordinary skill in the art, according to the idea of the present application, there will be changes in the specific implementation manner and application scope. In summary, the content of this specification should not be construed as a limitation to the present application.
Claims
1. A cloud conference content sharing method, characterized in that, Including: Obtaining the size of the content to be shared by a target participant in a cloud conference group, including: Obtaining audio information in the cloud conference group within a preset time period, where the preset time period is the time period before the target participant shares the content to be shared; extracting a target audio segment related to the content to be shared from the audio information; identifying the target audio segment to obtain the size of the content to be shared; When the size of the content to be shared is greater than a threshold, pushing a prompt message to the cloud conference desktop of the participant device of the target participant, where the prompt message is used to prompt the target participant to share the content to be shared using the screen mirroring function; When it is detected that the participant device of the target participant shares content using the screen mirroring function, receiving the screen mirroring content from the participant device of the target participant, where the screen mirroring content includes the content to be shared; When demonstrating the screen mirroring content on the cloud conference desktop, pushing the screen mirroring content to the participant devices of the remaining participants in the cloud conference group except the target participant.
2. The method according to claim 1, characterized in that, The identifying the target audio segment to obtain the size of the content to be shared includes: Identifying the target audio segment to obtain the name and type of the content to be shared; Determining the size of the content to be shared according to the name and type of the content to be shared.
3. The method according to claim 1 or 2, characterized in that, The pushing the screen mirroring content to the participant devices of the remaining participants in the cloud conference group except the target participant includes: Parsing the screen mirroring content; When it is determined that the screen mirroring content includes pop-up window information, performing blurring processing on the pop-up window information to obtain new screen mirroring content; Using the new screen mirroring content as the screen mirroring content.
4. The method according to claim 1 or 2, characterized in that, When the number of target participants is multiple, before receiving the screen mirroring content from the participant devices of the target participants, the method further includes: Allocating corresponding uplink time-frequency resources for each target participant from the uplink idle resources according to the content to be shared by each target participant and the presentation order of each target participant; The receiving the screen mirroring content from the participant devices of the target participants includes: Receiving the screen mirroring content from the participant devices of each target participant through the uplink time-frequency resources of each target participant.
5. The method according to claim 4, wherein The allocating corresponding uplink time-frequency resources for each target participant from the uplink idle resources according to the content to be shared by each target participant and the presentation order of each target participant includes: Determining the presentation duration of each target participant according to the type and size of the content to be shared by each target participant; Determining the presentation time period of each target participant according to the presentation order of each target participant and the presentation duration of each target participant; Allocating corresponding uplink time domain resources for each target participant from the uplink idle resources according to the presentation time period of each target participant; Determining the size of each frame of the screen mirroring content of each target participant according to the type of the content to be shared by each target participant. Allocate corresponding uplink frequency-domain resources for each target participant from the uplink idle resources according to the size of the screen projection content of each frame of each target participant and the presentation time period. Obtain the uplink time-frequency resources of each target participant according to the uplink time-domain resources and the uplink frequency-domain resources of each target participant.
6. A cloud conference content sharing device, characterized in that, Including: A receiving module, a processing module, and a transmitting module; The processing module is configured to obtain the size of the content to be shared of a target participant in a cloud meeting group, including: obtaining audio information in the cloud meeting group within a preset time period, where the preset time period is the time period before the target participant shares the content to be shared; extracting a target audio segment related to the content to be shared from the audio information; and identifying the target audio segment to obtain the size of the content to be shared. The processing module is configured to, when determining that the size of the content to be shared is greater than a threshold, control the transmitting module to push a prompt message to the cloud meeting desktop of the participant device of the target participant, where the prompt message is used to prompt the target participant to use the screen projection function to share the content to be shared. The processing module is configured to, when detecting that the participant device of the target participant shares content using the screen projection function, control the receiving module to receive the screen projection content from the participant device of the target participant, where the screen projection content includes the content to be shared; and when determining to present the screen projection content on the cloud meeting desktop, control the transmitting module to stream the screen projection content to the participant devices of the remaining participants in the cloud meeting group except the target participant.
7. An electronic device, characterized in that, Including: A processor and a memory, the processor is connected to the memory, the memory is used to store a computer program, and the processor is used to execute the computer program stored in the memory so that the electronic device executes the method according to any one of claims 1-5.
8. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, and the computer program is executed by a processor to implement the method according to any one of claims 1-5.
Citation Information
Patent Citations
Video data processing method and device, computer storage medium and electronic device
CN112511779A
Cloud conference live broadcast system, method, device, equipment and medium
CN114095671A