Layout switching method and system based on video communication desktop content

Abstract

The present invention provides a layout switching method and system based on video communication desktop content. The method comprises: capturing shared content and analyzing it to obtain shared content analysis results; a receiving end obtains a compressed code stream and shared content analysis results, and obtains the display time required for the shared content based on the shared content analysis results; the receiving end starts to display with a first layout, and counts down with the display time as the initial value, wherein the first layout is a layout in which the shared content is displayed on a large screen and the speaker's screen is displayed on a small screen or not; after the display time countdown ends, the receiving end automatically switches to a second layout, wherein the second layout is a layout in which the speaker is displayed on a large screen and the shared content is displayed on a small screen or not. The layout switching method of the present invention effectively realizes that the shared content and the speaker's screen are automatically switched to the optimal layout without manual intervention, achieving an excellent viewing experience and significantly reducing labor costs.

Description

Technical Field

[0001] The present invention relates to the field of communication technology, and in particular to a layout switching method and system based on video communication desktop content. Background Art

[0002] Internet-based video communication technology is widely used in video conferencing scenarios for work and life, especially in scenarios such as remote meetings and remote teaching and training, where it is often necessary to capture the computer desktop for content sharing. In this case, when the viewing end only has a single screen, there are several options for screen layout:

[0003] a. Use half the screen to watch the speaker and the other half to watch the shared content. The problem with this is that the content is too small, which may make the font unclear and the effect is not good.

[0004] b. The shared content is displayed on a large screen, while the speaker's screen is displayed on a small screen or there is no screen at all. In this case, the speaker's facial expressions and body language are less visible during the training, affecting the viewing experience.

[0005] c. The speaker is displayed on a large screen, while the shared content is displayed on a small screen. In this case, the shared content is too small to see the details clearly and the effect is not good.

[0006] Therefore, the layout of shared content and the speaker's screen greatly affects the user's viewing experience. In fact, the screen layout that can achieve the best user experience is: when the user needs to read the text and pictures in the shared content, the shared content is displayed on the large screen; when the user does not need to read the text and pictures in the shared content, the speaker's screen is displayed on the large screen.

[0007] Currently, existing technology implementations often require dedicated backstage directors or conference controllers to manually control the screen to guide viewers to the shared content or the speaker's screen. However, this solution is labor-intensive and requires close collaboration between the director and the speaker to achieve a good viewing experience. Summary of the Invention

[0008] The present invention provides a layout switching method and system based on video communication desktop content, which enables the images seen by the viewing end, i.e., the receiving end, to be automatically switched without manual intervention. This allows the user to clearly understand the shared content and appreciate the speaker's explanation process through the large screen, achieving an excellent viewing experience.

[0009] In a first aspect, the present invention provides a layout switching method based on video communication desktop content, characterized in that the method includes:

[0010] Capture and analyze shared content to obtain analysis results of shared content;

[0011] Compress and encode the shared content and the speaker's screen to obtain a compressed code stream;

[0012] The receiving end obtains the compressed code stream and the analysis result of the shared content;

[0013] The receiving end decodes the compressed code stream and obtains the required display time of the shared content according to the analysis result of the shared content;

[0014] The receiving end starts to display in a first layout and counts down with the display time as an initial value, wherein the first layout is a layout in which the shared content is displayed in a large screen and the speaker's screen is displayed in a small screen or not displayed;

[0015] After the presentation time countdown ends, the receiving end automatically switches to the second layout, wherein the second layout is a layout in which the speaker is displayed on a large screen and the shared content is displayed on a small screen or not.

[0016] In a second aspect, the present invention further provides a layout switching system based on video communication desktop content, characterized in that the system comprises:

[0017] An analysis device, which is used to capture and analyze shared content to obtain analysis results of the shared content;

[0018] A compression encoding device, which is used to perform video compression encoding on the shared content and the speaker's screen to obtain a compressed code stream;

[0019] A receiving end is used to obtain the compressed code stream and the shared content analysis result, decode the compressed code stream, and obtain the display time required for the shared content based on the shared content analysis result. The receiving end is also used to start displaying with a first layout and count down with the display time as the initial value, wherein the first layout is a layout in which the shared content is displayed on a large screen and the speaker's screen is displayed on a small screen or not. The receiving end is also used to automatically switch to a second layout after the countdown to the display time ends, wherein the second layout is a layout in which the speaker is displayed on a large screen and the shared content is displayed on a small screen or not.

[0020] The layout switching method based on video communication desktop content and the system provided by the present invention automatically and intelligently analyze the shared content to obtain the display time required for the shared content for reasonable layout of the shared content and the speaker's screen, thereby enabling users to clearly understand the shared content and appreciate the speaker's explanation process through the large screen, without the need for a special director or conference controller to perform manual screen control in the background. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0022] Figure 1 This is a flow chart of a layout switching method based on video communication desktop content provided by an embodiment of the present invention;

[0023] Figure 2 is a schematic diagram of a first layout according to an embodiment of the present invention;

[0024] Figure 3 This is a schematic diagram of a layout switching system based on video communication desktop content provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0025] The technical solution of the present invention is further described in detail below through the accompanying drawings and embodiments. SUMMARY OF THE INVENTION

[0027] As mentioned above, the present invention provides a flexible and intelligent layout switching method and system based on video communication desktop content, which realizes the automatic switching of the shared content and the speaker's screen at the receiving end to the optimal layout without manual intervention, so that the user at the receiving end can not only read the shared content clearly, but also appreciate the speaker's explanation process through the large screen when there is no need to read the shared content clearly, achieving an excellent viewing experience, wherein the intelligent switching function significantly reduces labor costs.

[0028] Exemplary Methods

[0029] Figure 1 1 is a flow chart of a layout switching method based on video communication desktop content provided by an embodiment of the present invention, which includes the following steps:

[0030] S101: Capture and analyze shared content to obtain analysis results of the shared content.

[0031] The shared content may include videos, images, PowerPoint presentations, Word documents, and / or PDF documents. The analysis focuses on the word count and image score of static content, such as a single PowerPoint presentation page without animated graphics or videos, images, or a specific screen in Word, as well as the playback duration of dynamic content, such as videos, animated graphics, or a single PowerPoint presentation page containing animated graphics or videos.

[0032] Specifically, the text displayed in the shared content is counted. For example, the editable text can be obtained by performing text recognition after taking a screenshot, and then further performing word count to obtain the number of characters in the shared content.

[0033] The images displayed in the shared content are counted and each image is scored to obtain a picture score. For example, if there are three images, A to C, in the shared content, each image is scored based on the ease of reading and the time required, with the easiest image being 1 point and the most difficult being 10 points. For example, if image a has a variety of color blocks, complex and abstract shapes, and mixed symbols, making it difficult to read, it would be scored 9 points; image b consists of only a desert, which is relatively simple and requires less reading time, so it would be scored 1 point; and image c also has a desert with camels and people in it, with rich movements and expressions, so it would be scored 3 points. The picture score of the shared content is the sum of the scores of the three images, 13 points.

[0034] Preferably, the sending end captures and analyzes the shared content to obtain analysis results. Because the present invention requires detailed analysis of shared content, such as text count and image scoring, the resolution of the shared content to be analyzed must be high. The higher the resolution, the more accurate the analysis results. As the sender of shared content, the sending end captures the highest resolution of shared content, and therefore, the present invention prefers the sending end as the analyzer of shared content.

[0035] In addition to using the sender as the analyzer for shared content, if the text and images in the shared content are relatively simple, or if the accuracy of the analysis results is low, the shared content can also be captured and analyzed by the server or receiver to obtain the shared content analysis results. For example, if the shared content is a flattened PPT with a single color background, no more than 10 words per page, and no images, the receiver can be selected to analyze the shared content. Even if the shared content received by the receiver is compressed and decompressed at a low resolution, it will not affect the counting of the small number of words in it.

[0036] S102: Perform video compression encoding on the shared content and the speaker's screen to obtain a compressed code stream.

[0037] Specifically, the sending end performs video compression encoding on the shared content and the speaker's screen to facilitate transmission and save bandwidth.

[0038] S103: The receiving end obtains the compressed code stream and the analysis result of the shared content.

[0039] In combination with the above, the shared content analysis results obtained by the receiving end here may come from the sending end, the receiving end itself, the server, etc.

[0040] S104: The receiving end decodes the compressed code stream and obtains the display time required for the shared content according to the analysis result of the shared content.

[0041] Specifically, if the shared content is static content, the display time required for the shared content is obtained based on the number of words and the score of the picture. For example, each receiving end defaults to that the user can read 80 words per minute and the score of the picture can be read per minute is 10 points. Assuming that the received shared content contains 160 words and the picture score is 30 points, the display time required for the shared content is 5 minutes; if the shared content is dynamic content, the playback time of the dynamic content is used as the display time required for the shared content. For example, if the shared content is a 5-minute short video, the display time is 5 minutes; if the shared content contains both static and dynamic content, for example, the shared content is a PPT page containing a video, where the video length is 3 minutes, and the rest of the PPT except the video part contains 80 words and a picture with a score of 20 points, then the display time required for this shared content is the sum of the time required for the video, text and picture, that is, 6 minutes.

[0042] And if the reading and viewing habits of the receiving user are different from the system default parameters, the user can also set the number of words that can be read per unit time and the picture score that can be read per unit time according to his own needs. After the setting is completed, the receiving end will no longer use the system default reading parameters, but will calculate the display time required for the user to read the shared content based on the number of words that can be read per unit time and the picture score that can be read per unit time set by the user, and based on the number of words contained in the shared content and the picture score.

[0043] For example, the system default settings assume that the reading speed is 80 words per minute and the picture score is 10 points. Since user A reads faster and can read 120 words per minute, and the picture score is 20 points, the user can set the reading parameters of the receiving end to 120 words per minute and 20 points for the picture. After the custom reading parameters are set, assuming that the received shared content contains 240 words and the picture score is 20 points, the display time for user A can be calculated as 3 minutes according to the parameters set by user A.

[0044] In addition, the display time in the present invention can also be obtained by machine learning. Here are two implementation methods:

[0045] Implementation method 1: Perform machine learning on shared content of various formats to obtain a shared content display time model; process the shared content to be analyzed based on the obtained display time model to obtain the display time required for the shared content.

[0046] For example, to train shared content and its corresponding display time, 500 volunteers were asked to count the reading time of four types of shared content with layout ratios of 1:1, 3:2, 16:9, and 9:16. There were 300 pieces of each type of shared content, and each piece of shared content was different. That is, each volunteer needed to read 1,200 pieces of shared content and obtain a total of 600,000 display times of shared content; then, these 1,200 shared contents and their corresponding 500 display times were subjected to machine learning to obtain a shared content display time model; finally, the obtained display time model can be used to directly process the shared content in the system to obtain the display time required for the corresponding shared content.

[0047] For example, the word count and picture score in shared content, as well as their corresponding display time, are trained. 500 volunteers are asked to count the reading time of four types of shared content with layout ratios of 1:1, 3:2, 16:9, and 9:16. There are 300 pieces of each type of shared content, and each shared content is different. That is, each volunteer needs to read 1,200 shared contents and obtain a total of 600,000 shared content display times; then the word count and picture score in these 1,200 shared contents and their corresponding 500 display times are machine learned to obtain a shared content display time model; finally, the obtained display time model can be used to directly process the shared content in the system to obtain the display time required for the corresponding shared content.

[0048] Implementation method 2: Train different types of user groups separately to obtain display time models for different types of groups; based on the type of user, select the display time model corresponding to the user to process the shared content to be analyzed to obtain the display time required for the shared content.

[0049] For example, 500 elementary school students were asked to count their reading time for four types of shared content with layout ratios of 1:1, 3:2, 16:9, and 9:16. Each type of shared content consisted of 300 pieces, and each piece of shared content was different. This meant each volunteer needed to read 1,200 pieces of shared content, resulting in a total of 600,000 display times for each shared content. Machine learning was then used to analyze these 1,200 pieces of shared content and their corresponding 500 display times to obtain a model for the display times of elementary school students' shared content. Finally, the obtained elementary school student display time model was used to directly process the shared content in the system and obtain display times suitable for elementary school students. Similarly, 500 junior high school, high school, and college students were asked to participate in the above activity, and finally, display times suitable for junior high school, high school, and college students were obtained.

[0050] Among them, the classification of different types of user groups can be divided by academic stage, such as elementary school students, junior high school students, high school students, etc.; it can also be divided by age, such as 4-6 years old, 7-10 years old, 11-15 years old, etc.; it can also be divided according to other standards such as intelligence level, which are not limited here.

[0051] In summary, Implementation Method 2 further divides user groups based on Implementation Method 1, and can obtain more accurate display time.

[0052] S105: The receiving end starts to display in a first layout and counts down with the display time as an initial value, wherein the first layout is a layout in which the shared content is displayed in a large screen and the speaker's screen is displayed in a small screen or not displayed.

[0053] Specifically, in the first layout, the shared content and the speaker's screen can be displayed without overlapping, for example, side by side, top by bottom, etc.; or the speaker's screen can be displayed overlapping the blank space or background part of the shared content so that it does not block the text or pictures (such as Figure 2 If the text in the shared content fills up the entire space, in addition to hiding the speaker's screen, you can also make the speaker's screen semi-transparent, that is, you can also see the text behind the speaker's screen through the speaker's screen.

[0054] S106: After the presentation time countdown ends, the receiving end automatically switches to a second layout, wherein the second layout is a layout in which the speaker is displayed on a large screen and the shared content is displayed on a small screen or not displayed.

[0055] Similar to the first layout, in the second layout, the shared content and the speaker's screen may be displayed without overlapping; or the shared content may be displayed overlapping a blank or background portion of the speaker's screen.

[0056] Preferably, the receiving end displays the countdown, and the receiving end user pauses, ends or extends the countdown according to needs: when the user pauses the countdown, the first layout is continued to be displayed; when the user ends the countdown, the second layout is switched to be displayed; when the user extends the countdown, the extended time is added to the current remaining time (such as Figure 2 shown).

[0057] For example, the receiving end where user A is located displays a countdown of 2 minutes, but the user has already finished reading the shared content. User A can directly click the countdown end button with the mouse to switch to the second layout, that is, the speaker's screen is displayed on the large screen.

[0058] In addition, the receiving user can also adjust the specific size and relative position of the large and small screens based on their needs. For example, a user with good eyesight can adjust the large and small screen sizes appropriately based on the default settings, save the settings, and retain the modified sizes unless modified. For another example, suppose the speaker's screen in the default first layout overlaps the shared content in the lower right corner, but user C is accustomed to the speaker's screen in the upper right corner. In this case, they can modify and maintain the speaker's screen position directly on their receiving device.

[0059] As an optional embodiment, if the core part of the shared content is updated before the display time countdown ends, re-analysis is performed and new shared content analysis results are obtained; the receiving end obtains the new shared content analysis results, and updates the required display time of the shared content based on the new shared content analysis results; the updated display time is used as the initial value of the countdown, and the countdown is restarted to display with the first layout.

[0060] For example, the display time countdown of receiving end A is 2 minutes. At this time, the shared content switches from the first paragraph to the second paragraph of the article. The number of words in the second paragraph is re-analyzed, and the display time required for the second paragraph is obtained to be 5 minutes. 5 minutes is used as the initial countdown value, and the countdown is restarted to display in the first layout.

[0061] More specifically, if new text or pictures are added to the core part of the shared content on the original basis before the countdown for the display time ends, it is only necessary to re-analyze and obtain the analysis results of the added part; the receiving end obtains the analysis results of the added part, and directly adds the display time required for the added part to the real-time countdown at this moment according to the analysis results of the added part, as the updated display time; the updated display time is used as the initial value of the countdown, and the countdown is restarted to display with the first layout.

[0062] For example, the display time countdown of receiving end B is 3 minutes. A picture with a score of 10 is added to the shared content, which requires an additional 1 minute of display time. The display time countdown is updated to 4 minutes, and 4 minutes is used as the initial countdown value. The countdown is restarted to display in the first layout.

[0063] As another optional embodiment, if the core part of the shared content is updated after the display time countdown ends, re-analysis is performed and new shared content analysis results are obtained; the receiving end obtains the new shared content analysis results, and determines the required display time of the shared content based on the new shared content analysis results; the determined display time is used as the initial value of the countdown, and the next round of countdown is started to display with the first layout.

[0064] For example, the countdown for the previous round of display time of receiving end A has ended, and its desktop layout is being displayed in the second layout. At this time, the shared content is switched from the first paragraph of the article to the second paragraph. The number of words in the second paragraph is re-analyzed, and the display time required for the second paragraph is obtained to be 5 minutes. 5 minutes is used as the initial value of the countdown, and the next round of countdown begins to be displayed in the first layout.

[0065] As another optional embodiment, if the presenter performs an operation on the shared content before the presentation time countdown ends, the countdown is paused or the presentation time is extended, and the first layout display is maintained. The presenter's operation on the shared content includes gesture operation, mouse movement, annotation, and / or laser pointer pointing.

[0066] For example, the presentation time countdown at the receiving end B is 3 minutes. The speaker starts to write on the blackboard while explaining the math problems in the shared PPT. At this time, the countdown is paused and the first layout display is maintained to facilitate the students at the receiving end B to read and understand the blackboard content synchronously. When the speaker stops writing on the blackboard, the first layout display is continued using 3 minutes as the countdown.

[0067] As another optional embodiment, if the speaker operates on the shared content after the presentation time countdown ends, the presentation is switched to the first layout, and the next countdown is started or the first layout is maintained until the speaker stops operating on the shared content.

[0068] For example, the countdown for the previous round of presentation time at the receiving end C has ended, and its desktop layout is being displayed in the second layout. At this time, the speaker starts to write on the blackboard while explaining the math problems in the shared PPT, and then switches to the first layout display to facilitate the students at the receiving end B to read and understand the blackboard content synchronously until the speaker stops writing on the blackboard.

[0069] In summary, the present invention primarily uses system intelligent analysis of shared content to determine the required display time for the shared content, thereby rationally arranging the shared content and the speaker's screen. This allows users to clearly understand the shared content while also appreciating the speaker's explanation process on a large screen, without requiring a dedicated backend director or conference controller to manually control the screen. Furthermore, based on the system's intelligent analysis of display time, the present invention combines the needs of the receiving user with the ability to implement customized settings through manual intervention, better suiting each user's reading and viewing habits.

[0070] Exemplary Systems

[0071] Correspondingly, an embodiment of the present invention also provides a layout switching system based on video communication desktop content. Figure 3Schematic diagram of a layout switching system 100 based on video communication desktop content provided by an embodiment of the present invention, such as Figure 3 As shown, the system provided in this embodiment includes:

[0072] An analysis device 101 is used to capture and analyze shared content to obtain analysis results of the shared content;

[0073] The compression encoding device 102 is used to perform video compression encoding on the shared content and the speaker's screen to obtain a compressed code stream;

[0074] The receiving end 103 is used to obtain the compressed code stream and the shared content analysis result, decode the compressed code stream, and obtain the display time required for the shared content based on the shared content analysis result. The receiving end 103 is also used to start displaying with a first layout and count down with the display time as the initial value, wherein the first layout is a layout in which the shared content is displayed on a large screen and the speaker's screen is displayed on a small screen or not. The receiving end 103 is also used to automatically switch to a second layout after the countdown of the display time ends, wherein the second layout is a layout in which the speaker is displayed on a large screen and the shared content is displayed on a small screen or not.

[0075] If the core part of the shared content is updated before the display time countdown ends, the analysis device 101 is also used to re-analyze and obtain new shared content analysis results; the receiving end 103 is also used to obtain the new shared content analysis results, and based on the new shared content analysis results, update the required display time of the shared content, use the updated display time as the countdown initial value, and restart the countdown to display in the first layout.

[0076] If the core part of the shared content is updated after the display time countdown ends, the analysis device 101 is also used to re-analyze and obtain new shared content analysis results; the receiving end 103 is also used to obtain the new shared content analysis results, and based on the new shared content analysis results, determine the display time required for the shared content, use the determined display time as the countdown initial value, and start the next round of countdown to display in the first layout.

[0077] The receiving end 103 includes a display unit 113, which is used to display the countdown.

[0078] The display unit 113 includes a pause module 123, an end module 133 and / or a delay module 153. The receiving end user pauses the countdown through the pause module 123 as needed, ends the countdown through the end module 133, and extends the countdown through the delay module 153. When the user pauses the countdown, the display continues to be displayed in the first layout. When the user ends the countdown, the display is switched to the second layout. When the user extends the countdown, the extended time is added to the current remaining time.

[0079] The analysis device 101 includes a counting and scoring unit 111, which is used to count the texts and pictures displayed in the shared content, and score each of the pictures to obtain a picture score.

[0080] The receiving end 103 includes a time calculation unit 143, which is used to obtain the display time required for the shared content according to the scores of the text and the picture.

[0081] The counting and scoring unit 111 further includes a reading parameter setting module 121 , through which the user of the receiving end 103 can set the number of words that can be read per unit time and the score of pictures that can be read per unit time according to needs.

[0082] The time calculation unit 143 is also used to calculate the display time required for the user to read the shared content based on the number of words that can be read per unit time and the picture score that can be read per unit time set by the user, and based on the number of words contained in the shared content and the picture score.

[0083] The system 100 further includes a machine learning device 104 for performing machine learning on shared content of various formats to obtain a shared content display time model, and processing the shared content to be analyzed based on the obtained display time model to obtain the display time required for the shared content.

[0084] The machine learning device 104 is also used to train different types of user groups to obtain display time models for various types of groups. Based on the type of user, the display time model corresponding to the user is selected to process the shared content to be analyzed to obtain the display time required for the shared content.

[0085] The display unit 113 further includes a delay module 153:

[0086] If the presenter operates on the shared content before the countdown of the presentation time ends, the countdown is paused by the pause module 123 or the presentation time is extended by the delay module 153 to maintain the first layout presentation;

[0087] If the presenter operates on the shared content after the presentation time countdown ends, the receiving end 103 is further configured to switch to the first layout presentation and start the next countdown or maintain the first layout presentation until the presenter stops operating on the shared content.

[0088] The first layout and the second layout include displaying the shared content and the speaker's screen without overlapping; or displaying the small screen overlapping a blank or background portion of the large screen.

[0089] It should be noted that although the operations of the layout switching method based on video communication desktop content of the present invention are described in a specific order in the accompanying drawings, this does not require or imply that these operations must be performed in this specific order, or that all illustrated operations must be performed to achieve the desired results. Additionally or alternatively, certain steps may be omitted, multiple steps may be combined into one step, and / or one step may be broken down into multiple steps.

[0090] Furthermore, although the above detailed description mentions several devices, units, or modules of the layout switching system based on video communication desktop content, this division is merely exemplary and not mandatory. In practice, according to embodiments of the present invention, the features and functions of two or more modules described above may be embodied in a single module. Conversely, the features and functions of a single module described above may be further divided and embodied by multiple modules.

[0091] Although the spirit and principles of the present invention have been described with reference to several specific embodiments, it should be understood that the present invention is not limited to the specific embodiments disclosed, and the division into various aspects does not mean that the features of these aspects cannot be combined to benefit. Such division is only for the convenience of expression. The present invention is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims.

[0092] The present invention provides:

[0093] 1. A layout switching method based on video communication desktop content, characterized in that the method comprises:

[0094] Capture and analyze shared content to obtain analysis results of shared content;

[0095] Compress and encode the shared content and the speaker's screen to obtain a compressed code stream;

[0096] The receiving end obtains the compressed code stream and the analysis result of the shared content;

[0097] The receiving end decodes the compressed code stream and obtains the required display time of the shared content according to the analysis result of the shared content;

[0098] The receiving end starts to display in a first layout and counts down with the display time as an initial value, wherein the first layout is a layout in which the shared content is displayed in a large screen and the speaker's screen is displayed in a small screen or not displayed;

[0099] After the presentation time countdown ends, the receiving end automatically switches to the second layout, wherein the second layout is a layout in which the speaker is displayed on a large screen and the shared content is displayed on a small screen or not.

[0100] 2. The layout switching method according to item 1, further comprising:

[0101] If before the countdown of the display time ends,

[0102] The core part of the shared content is updated, and a new shared content analysis result is obtained;

[0103] The receiving end obtains the new shared content analysis result, and updates the required display time of the shared content according to the new shared content analysis result;

[0104] Use the updated display time as the countdown initial value and restart the countdown to display in the first layout;

[0105] If the countdown for the display time ends,

[0106] The core part of the shared content is updated, and a new shared content analysis result is obtained;

[0107] The receiving end obtains the new shared content analysis result, and determines the required display time of the shared content according to the new shared content analysis result;

[0108] The determined display time is used as the countdown initial value to start the next round of countdown with the first layout display.

[0109] 3. The layout switching method according to item 1 or 2, further comprising:

[0110] The receiving end displays the countdown;

[0111] The receiving user pauses, ends or extends the countdown as needed. When the user pauses the countdown, the display continues in the first layout. When the user ends the countdown, the display switches to the second layout. When the user extends the countdown, the extended time is added to the current remaining time.

[0112] 4. The layout switching method according to any one of items 1 to 3 is characterized in that the step of capturing and analyzing the shared content to obtain the shared content analysis results includes: counting the text and pictures displayed in the shared content, and scoring each of the pictures separately to obtain a picture score.

[0113] 5. The layout switching method according to item 4, wherein the step of obtaining the display time required for the shared content based on the shared content analysis result comprises:

[0114] The display time required for the shared content is obtained according to the scores of the text and the picture.

[0115] 6. The layout switching method according to item 5 is characterized in that the receiving end user sets the number of words that can be read per unit time and the score of the pictures that can be read per unit time according to needs.

[0116] 7. The layout switching method according to item 6 is characterized in that the receiving end calculates the display time required for the user to read the shared content based on the number of words that can be read per unit time and the picture score that can be read per unit time set by the user, and based on the number of words contained in the shared content and the picture score.

[0117] 8. The layout switching method according to any one of items 1 to 7, further comprising: performing machine learning on shared content of various layouts to obtain a shared content display time model;

[0118] The shared content to be analyzed is processed based on the obtained display time model to obtain the display time required for the shared content.

[0119] 9. The layout switching method according to item 8, further comprising: training different types of user groups separately to obtain display time models for different types of groups;

[0120] Based on the type of user, a display time model corresponding to the user is selected to process the shared content to be analyzed, so as to obtain the display time required for the shared content.

[0121] 10. The layout switching method according to item 1, further comprising:

[0122] If before the countdown of the display time ends,

[0123] The speaker operates on the shared content, pausing the countdown or extending the presentation time;

[0124] Keep the first layout display;

[0125] If the countdown for the display time ends,

[0126] When the presenter operates on the shared content, the display is switched to the first layout, and the next round of countdown is started or the first layout display is maintained until the presenter stops operating on the shared content.

[0127] 11. The layout switching method according to item 10 is characterized in that the operations performed by the presenter on the shared content include gesture operations, moving the mouse, adding annotations and / or laser point indications.

[0128] 12. The layout switching method according to item 1, wherein the first layout and the second layout include:

[0129] Display the shared content and the speaker's screen without overlapping; or

[0130] Overlay the small image on the blank space or background of the large image.

[0131] 13. A layout switching system based on video communication desktop content, characterized in that the system includes:

[0132] An analysis device, which is used to capture and analyze shared content to obtain analysis results of the shared content;

[0133] A compression encoding device, which is used to perform video compression encoding on the shared content and the speaker's screen to obtain a compressed code stream;

[0134] A receiving end is used to obtain the compressed code stream and the shared content analysis result, decode the compressed code stream, and obtain the display time required for the shared content based on the shared content analysis result. The receiving end is also used to start displaying with a first layout and count down with the display time as the initial value, wherein the first layout is a layout in which the shared content is displayed on a large screen and the speaker's screen is displayed on a small screen or not. The receiving end is also used to automatically switch to a second layout after the countdown to the display time ends, wherein the second layout is a layout in which the speaker is displayed on a large screen and the shared content is displayed on a small screen or not.

[0135] 14. The layout switching system according to item 13, characterized in that:

[0136] If the core part of the shared content is updated before the countdown ends,

[0137] The analysis device is further used to reanalyze and obtain new analysis results of the shared content;

[0138] The receiving end is further configured to obtain the new shared content analysis result, and update the required display time of the shared content according to the new shared content analysis result, use the updated display time as the countdown initial value, and restart the countdown to display the content in the first layout;

[0139] If the core part of the shared content is updated after the display time countdown ends,

[0140] The analysis device is further used to reanalyze and obtain new analysis results of the shared content;

[0141] The receiving end is further used to obtain the new shared content analysis result, and determine the required display time of the shared content based on the new shared content analysis result, use the determined display time as the countdown initial value, and start the next round of countdown to display in the first layout.

[0142] 15. The layout switching system according to item 13 or 14, wherein the receiving end comprises a display unit for displaying the countdown;

[0143] The display unit includes a pause module, an end module and / or a delay module. The receiving end user pauses the countdown through the pause module according to needs, ends the countdown through the end module, and extends the countdown through the delay module. When the user pauses the countdown, the display continues to be displayed in the first layout. When the user ends the countdown, the display is switched to the second layout. When the user extends the countdown, the extended time is added to the current remaining time.

[0144] 16. The layout switching system according to any one of items 13-15 is characterized in that the analysis device includes a counting and scoring unit, which is used to count the text and pictures displayed in the shared content, and score each of the pictures separately to obtain a picture score.

[0145] 17. The layout switching system according to item 16 is characterized in that the receiving end includes a time calculation unit, which is used to obtain the display time required for the shared content according to the scores of the text and the picture.

[0146] 18. The layout switching system according to item 17 is characterized in that the counting and scoring unit further includes a reading parameter setting module, and the receiving end user sets the number of words that can be read per unit time and the score of the pictures that can be read per unit time according to needs through the reading parameter setting module.

[0147] 19. The layout switching system according to item 18 is characterized in that the time calculation unit is further used to calculate the display time required for the user to read the shared content based on the number of words that can be read per unit time and the score of the picture that can be read per unit time set by the user, and based on the number of words contained in the shared content and the picture score.

[0148] 20. The layout switching system according to any one of items 13 to 19 is characterized in that the system also includes a machine learning device, which is used to perform machine learning on shared content of various layouts to obtain a shared content display time model, and process the shared content to be analyzed based on the obtained display time model to obtain the display time required for the shared content.

[0149] 21. The layout switching system according to item 20 is characterized in that the machine learning device is also used to train different types of user groups separately to obtain display time models for various types of groups, and based on the type of user, select the display time model corresponding to the user to process the shared content to be analyzed to obtain the display time required for the shared content.

[0150] 22. The layout switching system according to item 13, wherein the display unit further comprises a delay module:

[0151] If the presenter operates on the shared content before the countdown of the presentation time ends, the countdown is paused by the pause module or the presentation time is extended by the delay module to maintain the first layout presentation;

[0152] If the presenter operates on the shared content after the presentation time countdown ends, the receiving end is further configured to switch to the first layout presentation and start the next countdown or maintain the first layout presentation until the presenter stops operating on the shared content.

[0153] 23. The layout switching system according to item 13 is characterized in that the first layout and the second layout include displaying the shared content and the speaker's screen without overlapping; or displaying the small screen overlapping the blank or background part of the large screen.

Claims

1. A layout switching method based on video communication desktop content, characterized in that: The method comprises: Capture and analyze shared content to obtain analysis results of shared content; Compress and encode the shared content and the speaker's screen to obtain a compressed code stream; The receiving end obtains the compressed code stream and the analysis result of the shared content; The receiving end decodes the compressed code stream and obtains the required display time of the shared content according to the analysis result of the shared content; The receiving end starts to display in a first layout and counts down with the display time as an initial value, wherein the first layout is a layout in which the shared content is displayed in a large screen and the speaker's screen is displayed in a small screen or not displayed; After the presentation time countdown ends, the receiving end automatically switches to the second layout, wherein the second layout is a layout in which the speaker is displayed on a large screen and the shared content is displayed on a small screen or not.

2. The layout switching method according to claim 1, wherein: The method further comprises: If before the countdown of the display time ends, The core part of the shared content is updated, and a new shared content analysis result is obtained; The receiving end obtains the new shared content analysis result, and updates the required display time of the shared content according to the new shared content analysis result; Use the updated display time as the countdown initial value and restart the countdown to display in the first layout; If the countdown for the display time ends, The core part of the shared content is updated, and a new shared content analysis result is obtained; The receiving end obtains the new shared content analysis result, and determines the required display time of the shared content according to the new shared content analysis result; The determined display time is used as the countdown initial value to start the next round of countdown with the first layout display.

3. The layout switching method according to claim 1 or 2, characterized in that: The method further comprises: The receiving end displays the countdown; The receiving user pauses, ends or extends the countdown as needed. When the user pauses the countdown, the display continues in the first layout. When the user ends the countdown, the display switches to the second layout. When the user extends the countdown, the extended time is added to the current remaining time.

4. The layout switching method according to claim 1 or 2, characterized in that: The steps of capturing and analyzing the shared content to obtain the shared content analysis results include: counting the text and pictures displayed in the shared content, and scoring each of the pictures to obtain a picture score.

5. The layout switching method according to claim 4, wherein: The step of obtaining the required display time of the shared content according to the shared content analysis result includes: The display time required for the shared content is obtained according to the scores of the text and the picture.

6. The layout switching method according to claim 5, wherein: The receiving end user sets the number of words that can be read per unit time and the score of pictures that can be read per unit time according to needs.

7. The layout switching method according to claim 6, wherein: The receiving end calculates the display time required for the user to read the shared content based on the number of words that can be read per unit time and the picture score that can be read per unit time set by the user, and based on the number of words contained in the shared content and the picture score.

8. The layout switching method according to claim 1 or 2, characterized in that: The method further includes: performing machine learning on shared content of various formats to obtain a shared content display time model; The shared content to be analyzed is processed based on the obtained display time model to obtain the display time required for the shared content.

9. The layout switching method according to claim 8, wherein: The method further includes: training different types of user groups separately to obtain display time models for different types of groups; Based on the type of user, a display time model corresponding to the user is selected to process the shared content to be analyzed, so as to obtain the display time required for the shared content.

10. The layout switching method according to claim 1, wherein: The method further comprises: If before the countdown of the display time ends, The speaker operates on the shared content, pausing the countdown or extending the presentation time; Keep the first layout display; If the countdown for the display time ends, When the presenter operates on the shared content, the display is switched to the first layout, and the next round of countdown is started or the first layout display is maintained until the presenter stops operating on the shared content.

11. The layout switching method according to claim 10, wherein: The operations performed by the presenter on the shared content include gesture operations, moving the mouse, adding annotations and / or laser point indication.

12. The layout switching method according to claim 1, wherein: The first layout and the second layout include: Display the shared content and the speaker's screen without overlapping; or Overlay the small image on the blank space or background of the large image.

13. A layout switching system based on video communication desktop content, characterized in that: The system comprises: An analysis device, which is used to capture and analyze shared content to obtain analysis results of the shared content; A compression encoding device, which is used to perform video compression encoding on the shared content and the speaker's screen to obtain a compressed code stream; A receiving end is used to obtain the compressed code stream and the shared content analysis result, decode the compressed code stream, and obtain the display time required for the shared content based on the shared content analysis result. The receiving end is also used to start displaying with a first layout and count down with the display time as the initial value, wherein the first layout is a layout in which the shared content is displayed on a large screen and the speaker's screen is displayed on a small screen or not. The receiving end is also used to automatically switch to a second layout after the countdown to the display time ends, wherein the second layout is a layout in which the speaker is displayed on a large screen and the shared content is displayed on a small screen or not.

14. The layout switching system according to claim 13, wherein: If the core part of the shared content is updated before the countdown ends, The analysis device is further used to reanalyze and obtain new analysis results of the shared content; The receiving end is further configured to obtain the new shared content analysis result, and update the required display time of the shared content according to the new shared content analysis result, use the updated display time as the countdown initial value, and restart the countdown to display the content in the first layout; If the core part of the shared content is updated after the display time countdown ends, The analysis device is further used to reanalyze and obtain new analysis results of the shared content; The receiving end is further used to obtain the new shared content analysis result, and determine the required display time of the shared content based on the new shared content analysis result, use the determined display time as the countdown initial value, and start the next round of countdown to display in the first layout.

15. The layout switching system according to claim 13 or 14, characterized in that: The receiving end includes a display unit for displaying the countdown; The display unit includes a pause module, an end module and / or a delay module. The receiving end user pauses the countdown through the pause module according to needs, ends the countdown through the end module, and extends the countdown through the delay module. When the user pauses the countdown, the display continues to be displayed in the first layout. When the user ends the countdown, the display is switched to the second layout. When the user extends the countdown, the extended time is added to the current remaining time.

16. The layout switching system according to claim 13 or 14, characterized in that: The analysis device includes a counting and scoring unit, which is used to count the text and pictures displayed in the shared content, and score each of the pictures to obtain a picture score.

17. The layout switching system according to claim 16, wherein: The receiving end includes a time calculation unit, which is used to obtain the display time required for the shared content according to the text and the picture scores.

18. The layout switching system according to claim 17, wherein: The counting and scoring unit further includes a reading parameter setting module, through which the receiving end user sets the number of words that can be read per unit time and the score of pictures that can be read per unit time according to needs.

19. The layout switching system according to claim 18, wherein: The time calculation unit is also used to calculate the display time required for the user to read the shared content based on the number of words that can be read per unit time and the picture score that can be read per unit time set by the user, and based on the number of words contained in the shared content and the picture score.

20. The layout switching system according to claim 13 or 14, characterized in that: The system also includes a machine learning device, which is used to perform machine learning on shared content of various formats to obtain a shared content display time model, and process the shared content to be analyzed based on the obtained display time model to obtain the display time required for the shared content.

21. The layout switching system according to claim 20, wherein: The machine learning device is also used to train different types of user groups separately to obtain display time models for various types of groups. Based on the type of user, the display time model corresponding to the user is selected to process the shared content to be analyzed to obtain the display time required for the shared content.

22. The layout switching system according to claim 15, wherein: The display unit further includes a delay module: If the presenter operates on the shared content before the countdown of the presentation time ends, the countdown is paused by the pause module or the presentation time is extended by the delay module to maintain the first layout presentation; If the presenter operates on the shared content after the presentation time countdown ends, the receiving end is further configured to switch to the first layout presentation and start the next countdown or maintain the first layout presentation until the presenter stops operating on the shared content.

23. The layout switching system according to claim 13, wherein: The first layout and the second layout include displaying the shared content and the speaker's screen without overlapping; or displaying the small screen overlapping a blank or background portion of the large screen.

Images