Screen projection processing method and device, screen projection receiving end and computer readable storage medium

Abstract

The embodiment of the invention discloses a screen projection processing method. The method comprises the following steps: receiving screen projection information sent by a plurality of screen projection sending ends with different operating systems; wherein communication connection is established between the screen projection receiving end and the screen projection transmitting end; based on a screen projection operation instruction, determining a first target screen projection style for the screen projection information; wherein the screen projection operation instruction is generated by the screen projection receiving end or the screen projection sending end; the first target screen projection style represents a screen projection layout of a screen projection window corresponding to the screen projection information; and displaying the screen projection information based on the first target screen projection style. The embodiment of the invention further discloses a screen projection processing device, a screen projection receiving end and a computer readable storage medium.

Description

Technical Field

[0001] The present application relates to the field of communication technology, and in particular to a screen projection processing method, device, screen projection receiving end and computer-readable storage medium. Background Art

[0002] Screen projection refers to the technology of projecting files, videos or audios on a certain device to another device for display; currently, the window management tools for screen projection windows in the related technologies usually include Snap Assist of Microsoft System (Window), Window Enhancement Manager (i.e. FancyZones) of Microsoft System and Snap Assist of Apple System (OS Mac); however, the related technologies are not compatible with multiple operating systems when projecting screens, and only support determining the target window layout template from the default window layout template through the screen projection receiving end, resulting in poor user control and ease of use of multi-screen projection. Summary of the invention

[0003] In order to solve the above-mentioned technical problems, the embodiments of the present application hope to provide a screen projection processing method, device, equipment and computer-readable storage medium, which can solve the problems of poor control and convenience of users in multi-screen projection in related technologies.

[0004] The technical solution of this application is implemented as follows:

[0005] A screen projection processing method, the method comprising:

[0006] Receiving screen projection information sent by multiple screen projection sending ends with different operating systems; wherein the screen projection receiving end establishes a communication connection with the screen projection sending end;

[0007] Based on the screen projection operation instruction, determine a first target screen projection style for the screen projection information; wherein the screen projection operation instruction is generated by the screen projection receiving end or the screen projection sending end; the first target screen projection style represents the screen projection layout of the screen projection window corresponding to the screen projection information;

[0008] The projection information is displayed based on the first target projection style.

[0009] In the above solution, the determining of the first target screen projection style for the screen projection information based on the screen projection operation instruction includes:

[0010] Receive a first style selection instruction sent by a screen projection sending end; wherein the screen projection operation instruction includes the first style selection instruction;

[0011] Based on the first style selection instruction, the first target screen projection style is determined from the screen projection styles to be selected in the screen projection receiving end.

[0012] In the above solution, the determining of the first target screen projection style for the screen projection information based on the screen projection operation instruction includes:

[0013] Based on the user's selection operation, a second style selection instruction is generated; wherein the screen projection operation instruction includes the second style selection instruction;

[0014] Based on the second style selection instruction, the first target screen projection style is determined from the screen projection styles to be selected in the screen projection receiving end.

[0015] In the above solution, the determining of the first target screen projection style for the screen projection information based on the screen projection operation instruction includes:

[0016] Generate a style creation instruction based on the user's creation operation; wherein the screen projection operation instruction includes the style creation instruction;

[0017] Based on the style creation instruction, create the first target screen projection style.

[0018] In the above solution, the screen projection processing method further includes:

[0019] For a to-be-projected screen window having to-be-projected screen information that is not displayed in the first target screen projection style, determining a to-be-replaced projection window from a plurality of the projection windows in the first target screen projection style;

[0020] Add the screen projection window to be projected to the position corresponding to the screen projection window to be replaced in the first target screen projection style.

[0021] In the above solution, the screen projection processing method further includes:

[0022] For the to-be-projected screen window having the to-be-projected screen information that is not displayed in the first target screen projection style, determining a second target screen projection style from the to-be-selected screen projection styles in the screen projection receiving end;

[0023] Add the window to be projected to the second target projection style; or

[0024] Determine a third target screen projection style from the screen projection styles to be selected in the screen projection receiving end;

[0025] Add the window to be projected and the projection window in the first target projection style to the third target projection style.

[0026] In the above scheme, after determining the first target screen projection style for the screen projection information based on the screen projection operation instruction, the method further includes:

[0027] Based on the window management processing instruction, window management processing is performed on the projection windows in the first target projection style and / or the second target projection style and / or the third target projection style to obtain the processed projection style.

[0028] In the above solution, the screen projection processing method further includes:

[0029] In the case where there are multiple target screen projection styles, receiving a pinning instruction sent by the screen projection client for pinning a screen projection style to be pinned among the multiple target screen projection styles or a target screen projection window among the multiple target screen projection styles; wherein the multiple target screen projection styles include the screen projection style to be pinned;

[0030] Based on the pin-to-top instruction, the target projection window is displayed in full screen or the projection style to be pinned to the top is displayed on the top layer of the display layer.

[0031] A screen projection processing device, applied to a screen projection receiving end, comprising:

[0032] A receiving unit, used to receive screen projection information sent by multiple screen projection sending ends with different operating systems; wherein the screen projection receiving end establishes a communication connection with the screen projection sending end;

[0033] A processing unit, configured to determine a first target screen projection style for the screen projection information based on a screen projection operation instruction; wherein the screen projection operation instruction is generated by the screen projection receiving end or the screen projection sending end; and the first target screen projection style represents a screen projection layout of a screen projection window corresponding to the screen projection information;

[0034] A display unit is used to display the projection information based on the first target projection style.

[0035] A screen projection receiving end, the screen projection receiving end comprising: a processor, a memory and a communication interface;

[0036] The communication interface is used to realize the communication between the screen projection receiving end and the external device;

[0037] The memory is used to store a screen projection processing program;

[0038] The processor is used to execute the screen projection processing program stored in the memory to implement the steps of the above-mentioned screen projection processing method.

[0039] A computer-readable storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the steps of the screen projection processing method as described above.

[0040] The screen projection processing method, device, screen projection receiving end and computer-readable storage medium provided in the embodiments of the present application first receive screen projection information sent by multiple screen projection sending ends with different operating systems, and the screen projection receiving end establishes a communication connection with the screen projection sending end, and then determines a first target screen projection style for the screen projection information based on the screen projection operation instruction, and the screen projection operation instruction is generated by the screen projection receiving end or the screen projection sending end, and the first target screen projection style represents the screen projection layout of the screen projection window corresponding to the screen projection information; then, the screen projection information is displayed based on the first target screen projection style, so that the screen projection receiving end can receive screen projections of multiple operating systems. The screen projection information is sent by the sending end, rather than the screen projection information sent by the screen projection sending end which is not compatible with multiple operating systems and cannot receive multiple operating systems as in the related art. In addition, the screen projection operation instructions can be generated by the screen projection receiving end itself, or sent by the screen projection sending end to the screen projection receiving end. In other words, the first target screen projection style can be determined by the screen projection sending end, or by the screen projection receiving end, instead of being limited to determining the target screen projection style by the screen projection receiving end as in the related art, thereby improving the user's sense of control over multi-screen projection and convenience of use. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] Figure 1 A flowchart of a screen projection processing method provided in an embodiment of the present application;

[0042] Figure 2 A schematic diagram of multi-screen projection information of multiple clients in a screen projection processing method provided in an embodiment of the present application;

[0043] Figure 3 A schematic diagram of a target screen projection style in a screen projection processing method provided in an embodiment of the present application;

[0044] Figure 4 A flowchart of another screen projection processing method provided in an embodiment of the present application;

[0045] Figure 5 A schematic diagram of creating a screen projection combination at a screen projection sending end in a screen projection processing method provided in an embodiment of the present application;

[0046] Figure 6 A schematic diagram of a window combination template of three windows in a screen projection processing method provided in an embodiment of the present application;

[0047] Figure 7 A schematic diagram of free screen projection information processing in a screen projection processing method provided in an embodiment of the present application;

[0048] Figure 8 A schematic diagram of performing window management processing on a window in a screen projection processing method provided in an embodiment of the present application;

[0049] Fig. 9 A schematic diagram of a top window and a combined window of a screen projection sending end in a screen projection processing method provided in an embodiment of the present application;

[0050] FIG10( a ) is a schematic diagram of a four-split screen in a screen projection processing method provided in an embodiment of the present application;

[0051] FIG10( b ) is a schematic diagram of a three-screen display in a screen projection processing method provided in an embodiment of the present application;

[0052] FIG10( c ) is a schematic diagram of a two-screen split in a screen projection processing method provided in an embodiment of the present application;

[0053] Fig.11 A schematic diagram of the structure of a screen projection processing device provided in an embodiment of the present application;

[0054] Fig.12 A structural schematic diagram of a screen projection receiving terminal provided in an embodiment of the present application. DETAILED DESCRIPTION

[0055] The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.

[0056] It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0057] It should be noted that 1. Snap Assist of Microsoft System (Window), among which, Snap Assist: It is developed on the basis of desktop special effects (Aero Snap). In Win7, when dragging a window to the left or right of the screen, only the current window will occupy half of the screen, and other windows will not be affected; in Win10, after performing the same operation, if there are other windows, you will be asked to select a window that occupies the other half of the screen. Corner Snap: It is an extension of AeroSnap, and its purpose is to adapt to the operation of high-resolution large-screen users. That is, as long as you drag the window to the four corners of the screen, the window will become a quarter of the screen size and dock in the corresponding corner, which allows large-size devices to arrange windows to occupy the screen space more efficiently; in addition, using Win key + direction keys (such as up key, down key, left key, right key) can also adjust the size and shape of the selected window, which is applicable to all the above-mentioned snap forms. Snap Fill: In Win8 / Win8.1, users can easily adjust the proportion of each application occupying the screen, but traditional desktop applications cannot achieve this automatic proportion adjustment, and users need to adjust it manually one by one to achieve it. In Win10, Microsoft will promote this smart mode to desktop applications. Specifically, when a window is operated in grab mode and then restored to its original size, the system will record the grab operation. At this time, if another window is operated in grab mode, the system will automatically arrange it to fill the currently available screen space, and in the case of the current window, the effect of this function is very obvious. Multi-monitor grabbing: In Win10, you can implement the grabbing function in multi-monitor mode, that is, each monitor edge is independent, and the grabbing window effect can be achieved on each monitor. This arrangement allows multi-monitor users to arrange windows more reasonably and conveniently. 2. Microsoft's system window enhancement manager (i.e. FancyZones) is used to arrange and align windows into efficient layouts to quickly improve workflows and restore layouts. A set of area locations can be defined to be used as targets for windows on the desktop. When you drag a window to an area or enter the associated keyboard shortcut, the window is reset and repositioned to fill the area. 3. Snap Assist of Apple (OSMac) system: Its window layout is: two side-by-side windows each occupy the same space, or the ratio of two windows side by side is 66% and 33% respectively; three side-by-side windows each occupy the same space, or one of the three windows occupies half of the screen space, and the other two share the remaining space vertically; four windows each occupy a quarter of the screen, or three windows are side by side, and the middle window occupies more space than the left and right two.

[0058] However, Snap Assist of Window system, FancyZones of Window system and SnapAssist of OS Mac system all have shortcomings. Specifically, the system-level function of Snap Assist of Window system is not compatible with multiple operating systems (such as Android, Linux, Mac OS, IOS), and only provides default full-screen, two-split screen, three-split screen, and four-split screen window combination templates, and does not support custom window combination templates; FancyZones is also not compatible with multiple operating systems (such as Win, Android, Linux, IOS), and only supports default window / layout templates, but does not support custom window / layout templates; the system-level function of Snap Assist of OS Mac system is not compatible with multiple operating systems (such as Win, Android, Linux, IOS), and the split-screen function does not support dynamic stretching, and there is no window combination template. Users need to use tools such as mouse or touchpad to perform a series of complex operations to achieve the application window arrangement and combination they want, and do not support custom window combination templates.

[0059] Based on this, the embodiment of the present application provides a screen projection processing method, which can be applied to the screen projection receiving end, referring to Figure 1 As shown, the method comprises the following steps:

[0060] Step 101: Receive screen projection information sent by multiple screen projection sending ends with different operating systems.

[0061] Among them, a communication connection is established between the screen projection receiving end and the screen projection sending end.

[0062] In the embodiments of the present application, different operating systems may include Win, Android, Linux, OS Mac, IOS, etc.; the screen projection sending end may refer to the client, and the screen projection receiving end may refer to the screen projection host; the screen projection information may refer to the information that the screen projection sending end needs to project to the screen projection receiving end; Figure 2 As shown, the screen projection receiving end can receive screen projection information sent by multiple screen projection sending ends with different operating systems, which means that the screen projection receiving end can simultaneously receive screen projection information sent by a sender with a Win system, a sender with an Android system, a sender with a Linux system and a sender with an OS Mac system; the screen projection receiving end establishes a communication connection with the screen projection sending end of each operating system through a communication protocol. Therefore, the screen projection receiving end can simultaneously receive screen projection information sent by multiple screen projection sending ends with different operating systems, thereby solving the problem of incompatibility with multiple operating systems in the related technology.

[0063] In a feasible implementation, the screen projection sending end can be a desktop computer, laptop computer, etc.; the screen projection receiving end can also be a desktop computer, laptop computer, etc.; the screen projection information can include files, videos, audio, etc.

[0064] Step 102: Based on the screen projection operation instruction, determine the first target screen projection style for the screen projection information.

[0065] Among them, the screen projection operation instruction is generated by the screen projection receiving end or the screen projection sending end; the first target screen projection style represents the screen projection layout of the screen projection window corresponding to the screen projection information.

[0066] In an embodiment of the present application, the screen projection operation instruction may be sent from the screen projection sending end to the screen projection receiving end, or may be generated by the screen projection receiving end itself; specifically, the screen projection operation instruction may be an instruction generated by a user operating on the display screen of the screen projection sending end, or may be an instruction generated by a user operating on the display screen of the screen projection receiving end. The first target screen projection style may include a target number of screen projection windows in a target arrangement; different screen projection styles may include multiple screen projection windows in different arrangements, that is, the number of screen projection windows and the arrangement of screen projection windows included in different screen projection styles are different.

[0067] In one possible implementation, Figure 3 As shown, the first target projection style may include two projection windows (i.e., a two-split screen window combination template), and the two side-by-side projection windows each occupy the same screen space; the first target projection style may include two projection windows, and the ratios of the two side-by-side projection windows are 66% and 33% respectively; the first target projection style may include three projection windows (i.e., a three-split screen window combination template), and the three side-by-side projection windows each occupy the same screen space; the first target projection style may include three projection windows, and among the three side-by-side projection windows, the middle projection window occupies more screen space than the left and right projection windows; the first target projection style may include three projection windows, and one of the three projection windows occupies half of the screen space, and the other two share the remaining screen space vertically; the first target projection style may include four projection windows (i.e., a four-split screen window combination template), and each projection window occupies one quarter of the screen space.

[0068] Step 103: Display the projection information based on the first target projection style.

[0069] In an embodiment of the present application, each projection window in the first target projection style can display one projection information; each projection information can be displayed in a predetermined projection window of the first target projection style, and each projection window is displayed in a limited screen area in different arrangements and combinations. In this way, the time for users to frequently drag windows with the help of a mouse or an air mouse in order to achieve an ideal window arrangement and combination is reduced; when the number of projection information is greater than the number of projection windows in the target projection style, the same number of projection information as the number of projection windows can be selected from multiple projection information for display according to one's own needs, and the projection information not displayed in the projection window of the target projection style becomes free projection information, which can then be displayed as needed.

[0070] With the screen projection processing method provided in the embodiment of the present application, the screen projection receiving end can receive the screen projection information sent by the screen projection sending end of multiple operating systems, instead of being unable to receive the screen projection information sent by the screen projection sending end of multiple operating systems due to the incompatibility with multiple operating systems as in the related art. In addition, the screen projection operation instructions can be generated by the screen projection receiving end itself, or sent by the screen projection sending end to the screen projection receiving end. In other words, the first target screen projection style can be determined by the screen projection sending end, or by the screen projection receiving end, instead of being limited to determining the target screen projection style by the screen projection receiving end as in the related art, thereby improving the user's sense of control over multi-screen projection and convenience of use.

[0071] Based on the above embodiments, the present application provides another method for screen projection processing. Figure 4 As shown, the method comprises the following steps:

[0072] Step 201: The screen projection receiving end receives screen projection information sent by multiple screen projection sending ends with different operating systems.

[0073] Among them, a communication connection is established between the screen projection receiving end and the screen projection sending end.

[0074] It should be noted that after step 201, steps 202 to 203 may be executed, after step 201, steps 204 to 205 may be executed, and after step 201, steps 206 to 207 may also be executed;

[0075] Step 202: The screen projection receiving end receives the first style selection instruction sent by the screen projection sending end.

[0076] Among them, the screen projection operation instruction includes a first style selection instruction.

[0077] Step 203: The screen projection receiving end determines a first target screen projection style from the screen projection styles to be selected in the screen projection receiving end based on the first style selection instruction.

[0078] In an embodiment of the present application, the first style selection instruction may refer to an instruction sent by the screen projection sending end for selecting a first target screen projection style; the screen projection style to be selected may refer to a default window combination template in the screen projection receiving end, and the screen projection styles to be selected include a variety of window combination templates, such as a two-split screen window combination template, a three-split screen window combination template, a four-split screen window combination template, etc.; the user of the screen projection sending end can select the first target screen projection style from the screen projection styles to be selected in the screen projection receiving end through the screen projection sending end, so that screen projection content management can be implemented on the client, which not only enhances the user's sense of control over multi-screen projection, but also improves the user's convenience of use; it should be noted that when the dual-screen extension mode is turned on, 2 first target screen projection styles can be selected, and the name of the first selected screen projection style defaults to "Screen Combination 1", and the name of the second screen projection style defaults to "Screen Combination 2"; and if Figure 5 As shown, only N applications (screen projection information) can be selected, and N is displayed differently according to different combinations, and the value of N can be 1, 2, 3 and 4; if the upper limit of selectable applications is reached, no more applications can be selected, and a prompt is displayed that the application upper limit has been reached.

[0079] It should be noted that the data structure of the default window combination template is as follows:

[0080] enum WINDOW_TYPE{ / / Window type

[0081] Single=0, / / Single projection link window

[0082] Combined = 1, / / Multi-screen projection link combination window

[0083] }

[0084] enum LAYOUT-TYPE{ / / Combined window layout type

[0085] L_R=0, / / left and right split screen

[0086] L_RT_RB=1, / / Three-part screen: left 1 / 2, upper right 1 / 4, lower right 1 / 4

[0087] LT_LB_R = 2, / / three-part screen, upper left 1 / 4, lower left 1 / 4, right 1 / 2

[0088] L_CR=3, / / Three-part screen left, center, right

[0089] LT_LB_RT_RB=4, / / four-split screen

[0090] }

[0091] It should be noted that the setting, parsing and mapping of the data structure to the display interface of the screen projection receiving end specifically include: customization of the data structure of the default window combination template, customization of the data structure of the user-defined exclusive window combination template, creation and parsing of the data structure object of the window combination template, mapping of the data structure object of the window combination template to the UI interface, and data transmission and sharing of the data structure of the window combination template between multiple devices.

[0092] Step 204: The screen projection receiving end generates a second style selection instruction based on the user's selection operation.

[0093] Among them, the screen projection operation instruction includes a second style selection instruction.

[0094] Step 205: The screen projection receiving end determines a first target screen projection style from the screen projection styles to be selected in the screen projection receiving end based on the second style selection instruction.

[0095] In the embodiment of the present application, the second style selection instruction is an instruction for selecting a first target projection style from the default projection style generated by the projection receiving end based on the user's selection operation at the projection receiving end; the user can directly select the first target projection style from the default window combination template at the projection receiving end to realize the arrangement of the fast projection screen window; Figure 6 It is shown that the user selects a window combination template with three projection windows (i.e., the first target projection style) from the default window combination template (i.e., the projection style to be selected) at the projection receiving end.

[0096] Step 206: The screen projection receiving end generates a style creation instruction based on the user's creation operation.

[0097] Among them, the screen projection operation instructions include style creation instructions.

[0098] Step 207: The screen projection receiving end creates a first target screen projection style based on the style creation instruction.

[0099] In an embodiment of the present application, at the screen projection receiving end, in addition to selecting the first target screen projection style from the default window combination template as mentioned above (i.e., steps 204 to 205), a first target screen projection style (i.e., a non-default window combination template) can also be created according to one's own needs. In this way, users can create new window combination templates that meet their own needs as needed, thereby increasing the diversity of screen projection styles.

[0100] It should be noted that after step 203, step 205 and step 207, steps 208 to 209, steps 210 to 211, or steps 212 to 213 may be performed;

[0101] Step 208: The screen projection receiving end determines a window to be replaced from multiple projection windows in the first target screen projection style for the screen window to be projected that has the screen projection information to be projected and is not displayed in the first target screen projection style.

[0102] Step 209: The screen projection receiving end adds the screen projection window to be projected to the position corresponding to the screen projection window to be replaced in the first target screen projection style.

[0103] In the embodiment of the present application, the screen information to be projected that is not displayed in the first target screen projection style is the above-mentioned free screen projection information, that is, it can support the addition of free screen projection information; the window to be replaced can refer to the window to be removed; Figure 7 As shown, if each projection window of the first target projection style has projection information, the projection window to be removed is determined from multiple projection windows, and then the window to be replaced is removed, and the window to be projected is added to the position of the original window to be replaced, that is, the window to be replaced is replaced with the window to be projected. At the same time, the original projection information in the window to be replaced is free projection information, and is placed after the first target projection style; it should be noted that it can also support the replacement of projection content between multiple projection windows in the first target projection, that is, it supports the replacement of projection window content within the window combination.

[0104] Step 210: The screen projection receiving end determines a second target screen projection style from the screen projection styles to be selected in the screen projection receiving end for the screen projection window to be projected that has the screen projection information to be projected and is not displayed in the first target screen projection style.

[0105] Step 211: The screen projection receiving end adds the screen projection window to be projected to the second target screen projection style.

[0106] In the embodiment of the present application, the second target projection style also represents the projection layout of the projection window corresponding to the projection information, and the second target projection style is selected from the selected projection styles when it is necessary to add a projection window with the projection information to be projected; that is, it can support adding a projection window in an empty window combination (second target projection style), such as Figure 7 As shown, the screen window to be projected can be overlapped with the second target projection style without projection information to 70% through the free pen, which can trigger the function of moving the screen window to be projected into the projection window of the second target projection style without projection information, and when a message prompt (such as a toast message) appears, the free pen can be released. At this time, the screen window to be projected is moved to the projection window of the second target projection style and displayed in maximized form.

[0107] Step 212: The screen projection receiving end determines a third target screen projection style from the screen projection styles to be selected in the screen projection receiving end.

[0108] Step 213: The screen projection receiving end adds the screen projection window to be projected and the screen projection window in the first target screen projection style to the third target screen projection style.

[0109] In an embodiment of the present application, the third target projection style also represents the projection layout of the projection window corresponding to the projection information, and the third target projection style is also selected from the selected projection styles when it is necessary to add a screen window to be projected with the information to be projected; for the screen window to be projected with the information to be projected that is not displayed in the first target projection style, the third target projection style can also be determined from the selected projection styles in the projection receiving end, and then the projection window and the screen window to be projected in the first target projection style are added to the third target projection style.

[0110] In a feasible implementation method, when the first target projection style has three projection windows, but four projection windows are to be displayed, a projection style with four projection windows (i.e., the third target projection style) can be reselected to display four projection windows.

[0111] It should be noted that step 214 may be performed after step 209, step 211 and step 213;

[0112] Step 214: The screen projection receiving end performs window management processing on the projection windows in the first target screen projection style and / or the second target screen projection style and / or the third target screen projection style based on the window management processing instruction to obtain a processed screen projection style.

[0113] In the embodiment of the present application, the window management process may include processes such as stretching windows, replacing windows, removing windows, and closing windows, and the window management process may be performed on the projection window by using a mouse or an air mouse. In this way, both the projection receiving end and the projection sending end may realize window combination, fast replacement of combination content, and adjustment of combination ratio, thereby enhancing the user's sense of control over multi-screen projection; Figure 8 As shown, each projection window in the first target projection style is provided with a "Close" button, and each projection window can be closed by clicking the "Close" button; a "position replacement" button is also provided between the projection windows in the first target projection style, and the "position replacement" button is displayed only after the free-hand pen is moved into the hot zone of the screen, and the projection information in the adjacent projection window can be replaced by clicking the "position replacement" button; there is a dividing line between the projection windows in the first target projection style, and when the free-hand pen is moved into the dividing line hot zone of the projection window, the function of adjusting the display space size of the projection window can be triggered;

[0114] Step 215: When there are multiple target projection styles, the screen projection receiving end receives a pinning instruction sent by the screen projection client, which is used to pin a screen projection style to be pinned among the multiple target projection styles or a target projection window among the multiple target projection styles.

[0115] Among them, the multiple target screen projection styles include the screen projection style to be placed on top.

[0116] Step 216: Based on the pinning instruction, the screen projection receiving end displays the target screen projection window in full screen or displays the screen projection style to be pinned on the top layer of the display layer.

[0117] In the embodiment of the present application, at the screen projection sending end, such as Fig. 9 As shown, multiple target screen projection styles may include a first target screen projection style, a second target screen projection style and a third target screen projection style; when multiple target screen projection styles include a first target screen projection style (i.e., screen combination 1) and a second target screen projection style (i.e., screen combination 2), and there are multiple screen projection windows in both the first target screen projection style and the second target screen projection style, the user can select the first target screen projection style that needs to be pinned or the first target screen projection style that needs to be pinned through the screen projection sending end; or select a target screen projection window in the first target screen projection style or the second target screen projection style, and then the screen projection receiving end displays the screen projection style to be pinned at the top layer of the screen after receiving the pinning instruction sent by the screen projection sending end, or displays the target screen projection window in full screen on the screen.

[0118] Step 217: The screen projection receiving end displays the projection information based on the first target screen projection style and / or the second target screen projection style and / or the third target screen projection style.

[0119] In an embodiment of the present application, when there is only the first target projection style, the projection information is displayed based on the first target projection style; when there are the first target projection style and the second target projection style, the projection information is displayed based on the first target projection style and the second target projection style, that is, the projection information in the two projection styles is displayed; when there are the first target projection style, the second target projection style and the third target projection style, the projection information is displayed based on the first target projection style, the second target projection style and the third target projection style together, that is, the projection information in the three projection styles is displayed.

[0120] In an embodiment of the present application, when there is only the first target screen projection style, and the first target screen projection style selected by the user includes 4 projection windows, the four-split screen displayed on the screen projection receiving end is as shown in Figure 10(a); when the first target screen projection style selected by the user includes 3 projection windows, the three-split screen displayed on the screen projection receiving end is as shown in Figure 10(b); when the first target screen projection style selected by the user includes 2 projection windows, the two-split screen displayed on the screen projection receiving end is as shown in Figure 10(c).

[0121] It should be noted that, for the description of the same steps and the same contents in this embodiment as those in other embodiments, reference can be made to the description in other embodiments and will not be repeated here.

[0122] The screen projection processing method provided in the embodiments of the present application is a method in which the screen projection receiving end can receive the screen projection information sent by the screen projection sending end of multiple operating systems, instead of being unable to receive the screen projection information sent by the screen projection sending end of multiple operating systems due to the incompatibility with multiple operating systems as in the related art. In addition, the screen projection operation instructions can be generated by the screen projection receiving end itself, or sent by the screen projection sending end to the screen projection receiving end. In other words, the first target screen projection style can be determined by the screen projection sending end, or by the screen projection receiving end, instead of being limited to determining the target screen projection style by the screen projection receiving end as in the related art, thereby improving the user's sense of control over multi-screen projection and convenience of use.

[0123] Based on the above embodiments, the present application provides a screen projection processing device, which can be applied to Figure 1 and Figure 4 In the screen projection processing method provided in the corresponding embodiment, refer to Fig.11 As shown, the screen projection processing device 3 may include: a receiving unit 31, a processing unit 32 and a display unit 33, wherein:

[0124] A receiving unit 31 is used to receive screen projection information sent by multiple screen projection sending ends with different operating systems; wherein a communication connection is established between the screen projection receiving end and the screen projection sending end;

[0125] The processing unit 32 is used to determine a first target screen projection style for the screen projection information based on the screen projection operation instruction; wherein the screen projection operation instruction is generated by the screen projection receiving end or the screen projection receiving end; and the first target screen projection style represents the screen projection layout of the screen projection window corresponding to the screen projection information;

[0126] The display unit 33 is used to display the projection information based on the first target projection style.

[0127] In other embodiments of the present application, the processing unit 32 is further configured to perform the following steps:

[0128] Receiving a first style selection instruction sent by a screen projection sending end; wherein the screen projection operation instruction includes the first style selection instruction;

[0129] Based on the first style selection instruction, a first target screen projection style is determined from the screen projection styles to be selected in the screen projection receiving end.

[0130] In other embodiments of the present application, the processing unit 32 is further configured to perform the following steps:

[0131] Based on the user's selection operation, a second style selection instruction is generated; wherein the screen projection operation instruction includes the second operation instruction;

[0132] Based on the second style selection instruction, the first target screen projection style is determined from the screen projection styles to be selected in the screen projection receiving end.

[0133] In other embodiments of the present application, the processing unit 32 is further configured to perform the following steps:

[0134] Generate a style creation instruction based on the user's creation operation; wherein the screen projection operation instruction includes the style creation instruction;

[0135] Based on the style creation instruction, create the first target screen projection style.

[0136] In other embodiments of the present application, the processing unit 32 is further configured to perform the following steps:

[0137] For a to-be-projected screen window having to-be-projected screen information that is not displayed in the first target screen projection style, determining a to-be-replaced projection window from a plurality of projection windows in the first target screen projection style;

[0138] Add the screen projection window to be projected to the corresponding position of the screen projection window to be replaced in the first target screen projection style.

[0139] In other embodiments of the present application, the processing unit 32 is further configured to perform the following steps:

[0140] For the to-be-projected screen window with the to-be-projected screen information that is not displayed in the first target screen projection style, determine the second target screen projection style from the to-be-selected screen projection styles in the screen projection receiving end;

[0141] Add the window to be projected to the second target projection style; or

[0142] Determine a third target screen projection style from the screen projection styles to be selected in the screen projection receiving end;

[0143] Add the window to be projected and the projection window in the first target projection style to the third target projection style.

[0144] In other embodiments of the present application, the processing unit 32 is further configured to perform the following steps:

[0145] Based on the window management processing instruction, window management processing is performed on the projection windows in the first target projection style and / or the second target projection style and / or the third target projection style to obtain the processed projection style.

[0146] In other embodiments of the present application, the processing unit 32 is further configured to perform the following steps:

[0147] In the case where there are multiple target screen projection styles, receiving a pinning instruction sent by the screen projection client for pinning a screen projection style to be pinned among the multiple target screen projection styles or a target screen projection window among the multiple target screen projection styles; wherein the multiple target screen projection styles include the screen projection style to be pinned;

[0148] Based on the pin-to-top instruction, the target projection window is displayed in full screen or the projection style to be pinned to the top is displayed on the top layer of the display layer.

[0149] It should be noted that the specific implementation process of the steps performed by each module in the embodiment of the present application can be referred to Figure 1 and Figure 4 The implementation process of the screen projection processing method provided in the corresponding embodiment will not be repeated here.

[0150] The screen projection processing device provided in the embodiment of the present application is a screen projection receiving end that can receive the screen projection information sent by the screen projection sending ends of multiple operating systems, instead of being unable to receive the screen projection information sent by the screen projection sending ends of multiple operating systems due to the incompatibility with multiple operating systems as in the related art. In addition, the screen projection operation instructions can be generated by the screen projection receiving end itself, or sent by the screen projection sending end to the screen projection receiving end. In other words, the first target screen projection style can be determined by the screen projection sending end, or by the screen projection receiving end, instead of being limited to determining the target screen projection style by the screen projection receiving end as in the related art, thereby improving the user's sense of control over multi-screen projection and convenience of use.

[0151] Based on the above embodiments, the embodiments of the present application provide a screen projection receiving terminal, which can be applied to Figure 1 and Figure 4 In the screen projection processing method provided in the corresponding embodiment, refer to Fig.12 As shown, the screen projection receiving end 4 may include: a processor 41, a memory 42 and a communication interface 43, wherein:

[0152] The communication interface 43 is used to realize the communication between the screen projection receiving end and the external device;

[0153] The processor 41 is used to execute the screen projection processing program in the memory 42 to implement the following steps:

[0154] Receive screen projection information sent by multiple screen projection sending ends with different operating systems; wherein a communication connection is established between the screen projection receiving end and the screen projection sending end;

[0155] Based on the screen projection operation instruction, determine a first target screen projection style for the screen projection information; wherein the screen projection operation instruction is generated by the screen projection receiving end or the screen projection sending end; the first target screen projection style represents the screen projection layout of the screen projection window corresponding to the screen projection information;

[0156] Display the projection information based on the first target projection style.

[0157] In other embodiments of the present application, the processor 41 is used to execute the projection operation instruction based on the projection processing program in the memory 42 to determine the first target projection style for the projection information, including:

[0158] Receiving a first style selection instruction sent by a screen projection sending end; wherein the screen projection operation instruction includes the first style selection instruction;

[0159] Based on the first style selection instruction, a first target screen projection style is determined from the screen projection styles to be selected in the screen projection receiving end.

[0160] In other embodiments of the present application, the processor 41 is used to execute the projection operation instruction based on the projection processing program in the memory 42 to determine the first target projection style for the projection information, including:

[0161] Based on the user's selection operation, a second style selection instruction is generated; wherein the screen projection operation instruction includes the second style selection instruction;

[0162] Based on the second style selection instruction, determine the first target screen projection style from the screen projection styles to be selected in the screen projection receiving end; or

[0163] Generate a style creation instruction based on the user's creation operation; wherein the screen projection operation instruction includes the style creation instruction;

[0164] Based on the style creation instruction, create the first target screen projection style.

[0165] In other embodiments of the present application, the processor 41 is used to execute the screen projection processing program in the memory 42:

[0166] For a to-be-projected screen window having to-be-projected screen information that is not displayed in the first target screen projection style, determining a to-be-replaced projection window from a plurality of projection windows in the first target screen projection style;

[0167] Add the screen projection window to be projected to the corresponding position of the screen projection window to be replaced in the first target screen projection style.

[0168] In other embodiments of the present application, the processor 41 is used to execute the screen projection processing program in the memory 42:

[0169] For the to-be-projected screen window with the to-be-projected screen information that is not displayed in the first target screen projection style, determine the second target screen projection style from the to-be-selected screen projection styles in the screen projection receiving end;

[0170] Add the window to be projected to the second target projection style; or

[0171] Determine a third target screen projection style from the screen projection styles to be selected in the screen projection receiving end;

[0172] Add the window to be projected and the projection window in the first target projection style to the third target projection style.

[0173] In other embodiments of the present application, the processor 41 is used to execute the screen projection processing program in the memory 42:

[0174] Based on the window management processing instruction, window management processing is performed on the projection windows in the first target projection style and / or the second target projection style and / or the third target projection style to obtain the processed projection style.

[0175] In other embodiments of the present application, the processor 41 is used to execute the screen projection processing program in the memory 42:

[0176] In the case where there are multiple target screen projection styles, receiving a pinning instruction sent by the screen projection client for pinning a screen projection style to be pinned among the multiple target screen projection styles or a target screen projection window among the multiple target screen projection styles; wherein the multiple target screen projection styles include the screen projection style to be pinned;

[0177] Based on the pin-to-top instruction, the target projection window is displayed in full screen or the projection style to be pinned to the top is displayed on the top layer of the display layer.

[0178] It should be noted that the specific description of the steps executed by the processor can be referred to Figure 1 and Figure 4 The implementation process of the screen projection processing method provided in the corresponding embodiment will not be repeated here.

[0179] The screen projection receiving end provided in the embodiment of the present application can receive the projection information sent by the screen projection sending end of multiple operating systems, instead of being unable to receive the projection information sent by the screen projection sending end of multiple operating systems due to the incompatibility with multiple operating systems as in the related art. In addition, the screen projection operation instructions can be generated by the screen projection receiving end itself, or sent by the screen projection sending end to the screen projection receiving end. In other words, the first target screen projection style can be determined by the screen projection sending end, or by the screen projection receiving end, instead of being limited to determining the target screen projection style through the screen projection receiving end as in the related art, thereby improving the user's sense of control over multi-screen projection and convenience of use.

[0180] Based on the foregoing embodiments, the embodiments of the present application provide a computer-readable storage medium, which stores one or more programs, and the one or more programs can be executed by one or more processors to implement Figure 1 and Figure 4 The steps in the screen projection processing method provided in the corresponding embodiment.

[0181] It should be noted that the above-mentioned computer-readable storage medium can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a magnetic random access memory (FRAM), a flash memory (Flash Memory), a magnetic surface memory, an optical disc, or a compact disc read-only memory (CD-ROM) and other memories; it can also be various electronic devices including one or any combination of the above-mentioned memories, such as mobile phones, computers, tablet devices, personal digital assistants, etc.

[0182] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0183] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0184] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course, by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0185] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products of the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0186] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0187] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0188] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A screen projection processing method, characterized in that: Applied to a screen projection receiving end, the method includes: Receiving screen projection information sent by multiple screen projection sending ends with different operating systems; wherein the screen projection receiving end establishes a communication connection with the screen projection sending end; Based on the screen projection operation instruction, determine a first target screen projection style for the screen projection information; wherein the screen projection operation instruction is generated by the screen projection receiving end or the screen projection sending end; the first target screen projection style represents the screen projection layout of the screen projection window corresponding to the screen projection information; The projection information is displayed based on the first target projection style.

2. The method according to claim 1, characterized in that The determining, based on the screen projection operation instruction, a first target screen projection style for the screen projection information includes: Receive a first style selection instruction sent by a screen projection sending end; wherein the screen projection operation instruction includes the first style selection instruction; Based on the first style selection instruction, the first target screen projection style is determined from the screen projection styles to be selected in the screen projection receiving end.

3. The method according to claim 1, characterized in that: The determining, based on the screen projection operation instruction, a first target screen projection style for the screen projection information includes: Based on the user's selection operation, a second style selection instruction is generated; wherein the screen projection operation instruction includes the second style selection instruction; Based on the second style selection instruction, determine the first target screen projection style from the screen projection styles to be selected in the screen projection receiving end; or Generate a style creation instruction based on the user's creation operation; wherein the screen projection operation instruction includes the style creation instruction; Based on the style creation instruction, create the first target screen projection style.

4. The method according to claim 3, characterized in that The method further comprises: For a to-be-projected screen window having to-be-projected screen information that is not displayed in the first target screen projection style, determining a to-be-replaced projection window from a plurality of the projection windows in the first target screen projection style; Add the screen projection window to be projected to the position corresponding to the screen projection window to be replaced in the first target screen projection style.

5. The method according to claim 3, characterized in that: The method further comprises: For the to-be-projected screen window having the to-be-projected screen information that is not displayed in the first target screen projection style, determining a second target screen projection style from the to-be-selected screen projection styles in the screen projection receiving end; Add the window to be projected to the second target projection style; or Determine a third target screen projection style from the screen projection styles to be selected in the screen projection receiving end; Add the window to be projected and the projection window in the first target projection style to the third target projection style.

6. The method according to claim 2 or 3, characterized in that: After determining the first target screen projection style for the screen projection information based on the screen projection operation instruction, the method further includes: Based on the window management processing instruction, window management processing is performed on the projection windows in the first target projection style and / or the second target projection style and / or the third target projection style to obtain a processed projection style.

7. The method according to claim 6, characterized in that The method further comprises: In the case where there are multiple target screen projection styles, receiving a pinning instruction sent by the screen projection client for pinning a screen projection style to be pinned among the multiple target screen projection styles or a target screen projection window among the multiple target screen projection styles; wherein the multiple target screen projection styles include the screen projection style to be pinned; Based on the pin-to-top instruction, the target projection window is displayed in full screen or the projection style to be pinned to the top is displayed on the top layer of the display layer.

8. A screen projection processing device, characterized in that: Applied to a screen projection receiving end, the device comprises: A receiving unit, used to receive screen projection information sent by multiple screen projection sending ends with different operating systems; wherein the screen projection receiving end establishes a communication connection with the screen projection sending end; A processing unit, configured to determine a first target screen projection style for the screen projection information based on a screen projection operation instruction; wherein the screen projection operation instruction is generated by the screen projection receiving end or the screen projection sending end; and the first target screen projection style represents a screen projection layout of a screen projection window corresponding to the screen projection information; A display unit is used to display the projection information based on the first target projection style.

9. A screen projection receiving terminal, characterized in that: The screen projection receiving end includes: a processor, a memory and a communication interface; The communication interface is used to realize the communication between the screen projection receiving end and the external device; The memory is used to store a screen projection processing program; The processor is used to execute the screen projection processing program in the memory to implement the steps of the screen projection processing method as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the steps of the screen projection processing method as described in any one of claims 1 to 7.

Images