Display method, electronic equipment and system

Abstract

The invention provides a display method, electronic equipment and a system. The method is applied to the shared device, the shared device is in screen projection connection with at least two screen projection devices, and the method comprises the following steps: acquiring screen projection data of the at least two screen projection devices; determining at least two display areas according to the screen projection data of the at least two screen projection devices and a screen projection layout mode, wherein the screen projection layout mode comprises one of the following modes: an intelligent screen splitting mode and a sequence priority mode; and displaying the at least two screen projection windows in the at least two display areas. According to the display method, the electronic equipment and the system, when the shared equipment is connected with the projection screen of the plurality of projection screen equipment, the display area corresponding to the projection screen equipment can be determined according to a certain projection screen layout mode in combination with the projection screen data of the projection screen equipment, and finally, the corresponding projection screen window is displayed in the display area. The projection screen window can utilize the display area of the shared device to the maximum extent, and various requirements of users are flexibly met.

Description

Technical Field

[0001] Embodiments of the present application relate to the field of electronic devices, and in particular, to a display method, electronic device, and system. Background Art

[0002] With the development of electronic technology and mobile Internet, users can process tasks through electronic devices such as mobile phones, smart screens, and personal computers. To facilitate users to process tasks, the interfaces of other electronic devices can be displayed on the screen of one electronic device, and users can simultaneously obtain information displayed by multiple electronic devices through the screen of one electronic device.

[0003] Therefore, how to fully display the interfaces of multiple electronic devices on one screen and adapt to the needs of users to actually handle tasks is a problem that needs to be solved urgently. Summary of the invention

[0004] The present application provides a display method, electronic device and system, which can fully display interfaces of multiple electronic devices on one screen as much as possible and flexibly adapt to the actual needs of current users.

[0005] In a first aspect, a display method is provided, characterized in that the method is applied to a shared device, which is connected to at least two projection devices for screen projection, including: obtaining projection data of the at least two projection devices, the projection data including screen data and / or application data; determining at least two display areas according to the projection data of the at least two projection devices and a projection layout mode, the projection layout mode including one of the following: a smart split-screen mode and a sequential priority mode; displaying at least two projection windows in the at least two display areas, the at least two projection windows corresponding to the at least two projection devices.

[0006] It is understandable that the sequence priority mode can be understood as a projection layout method that gives priority to displaying a certain projection window according to the projection order or according to the actual needs of the user's current scene. The smart split-screen mode can be understood as a projection layout method that allows multiple projection windows to occupy a larger display area. The sequence priority mode and the smart split-screen mode can be applied to different scenarios respectively. For example, when it is necessary to highlight a certain projection window through the screen of a shared device, the sequence priority mode can be used; when it is necessary to compare the contents of multiple projection windows, the smart split-screen mode can be used.

[0007] It should be noted that the correspondence between the projection window and the projection device can be understood as the specific content displayed in the projection window is the same as the content displayed on the projection device screen. For example, when the screen of the projection device is displayed as the main interface of the device, the projection window corresponding to the projection device on the shared device will also display the main interface of the device.

[0008] It should be noted that this application does not limit the screen projection connection method between the shared device and the projection device. For example, the shared device and the projection device are connected in the same local area network, and screen mirroring is achieved through the system-level distributed soft bus technology, so that the projection window is displayed on the screen of the shared device in real time, and the projection connection between the shared device and the projection device is achieved.

[0009] Exemplarily, the shared device can be an electronic device such as a smart screen or an electronic whiteboard. The screen projection device can be a personal device such as a mobile phone terminal, a personal computer or a tablet computer.

[0010] It can be understood that when the projection device projects the entire screen, at least two display areas can be determined based on the screen data; when the projection device projects the window of a certain application, at least two display areas can be determined based on the data of the application.

[0011] It should be noted that when the shared device receives new projection data, or the received projection data increases, or the resolution of the projection window that has established a projection connection with the shared device changes, the shared device can determine the projection layout mode.

[0012] Based on the above scheme, when a shared device is connected to multiple projection devices, the display area corresponding to the projection device can be determined according to a certain projection layout mode and combined with the projection data of the projection device, and finally the corresponding projection window is displayed in the display area. This allows the projection window to maximize the use of the display area of ​​the shared device and flexibly meet the specific needs of users.

[0013] In combination with the first aspect, in certain implementations of the first aspect, when the projection layout mode is the smart split-screen mode, at least two display areas are determined based on the projection data of the at least two projection devices and the projection layout mode, including: determining at least two display areas based on the projection data of the at least two projection devices and the display layout method, wherein the smart split-screen mode includes the display layout method, and the display layout method includes a left-right layout method and an up-down layout method.

[0014] It should be noted that the left-right layout can be understood as the width direction of at least two display areas being arranged along the width direction of the shared device screen; the top-bottom layout can be understood as the height direction of at least two areas being arranged along the height direction of the shared device screen.

[0015] Based on the above scheme, the smart split screen mode can further include display layout modes such as left-right layout mode and top-bottom layout mode. When the projection layout mode of the shared device is the smart split screen mode, at least two display areas need to be further determined according to the specific mode of the display layout.

[0016] In combination with the first aspect, in certain implementations of the first aspect, before determining at least two display areas based on the projection data of the at least two projection devices and the display layout method, the method also includes: determining the projection height based on the screen data of the at least two projection devices and the screen data of the shared device, wherein the screen data includes a screen pixel height and a screen pixel width; and determining the display layout method based on the projection height.

[0017] Based on the above solution, when the shared device is in smart split-screen mode, it is necessary to first determine the display layout mode. Specifically, the display layout mode can be determined based on the screen data of the projection device and the screen data of the shared device.

[0018] In combination with the first aspect, in certain implementations of the first aspect, the display layout mode is determined according to the projection screen height, including: based on the projection screen height being greater than half of the screen pixel height of the shared device, determining that the display layout mode is the left-right layout mode.

[0019] It should be noted that in the smart split screen mode, the aspect ratio of each projection window is consistent with the aspect ratio of the projection device, and the left-right layout can be given priority. Therefore, the calculation can be prioritized according to the left-right layout. When each projection window is laid out on the left and right, the height of each projection window is consistent, and the height of each projection window can be understood as the projection height.

[0020] Based on the above solution, when the projection screen height is greater than half of the pixel height of the screen of the shared device, the display layout can be determined as a left-right layout, and the projection screen windows are arranged in a certain order and displayed on the screen of the shared device.

[0021] In combination with the first aspect, in certain implementations of the first aspect, before displaying at least two projection windows in the at least two display areas, the method also includes: determining the size of the at least two projection windows based on screen data of the at least two projection devices, the screen pixel width of the shared device, and the projection height, and the size of the at least two display areas is the same as the size of the at least two projection windows.

[0022] Based on the above scheme, when the display layout is a left-right layout, the sum of the widths of the projection windows is less than or equal to the pixel width of the shared device. Based on this, the size of the projection window can be further determined so that when the projection windows are displayed in sequence from left to right, the display area of ​​the shared device can be maximized.

[0023] In combination with the first aspect, in certain implementations of the first aspect, the display layout method is determined according to the projection screen height, including: based on the projection screen height being less than or equal to half of the screen pixel height of the shared device, determining that the display layout method is the top-down layout method.

[0024] Based on the above solution, when the projection screen height is less than or equal to half of the screen pixel height of the shared device, even if two projection screen windows are arranged up and down, they will not exceed the screen pixel height of the shared device. Based on this, the up and down layout method can fully utilize the display area of ​​the shared device.

[0025] In combination with the first aspect, in certain implementations of the first aspect, when the display layout is in the top-bottom layout mode, the at least two display areas include a first split-screen display area and a second split-screen display area, and the height of the split-screen display area is half of the pixel height of the shared device; before displaying at least two projection windows in the at least two display areas, the method also includes: determining the size of the at least two projection windows based on screen data of the at least two projection devices, the screen pixel width of the shared device, and the height of the split-screen display area.

[0026] Based on the above scheme, when the shared device is arranged in a top-bottom layout, the height of at least two display areas can be the same as half of the pixel height of the shared device. In other words, the height of each projection window is half of the pixel height of the shared device. Based on this, the size of each projection window can be further determined to make full use of the display area of ​​the shared device.

[0027] In combination with the first aspect, in certain implementations of the first aspect, when the projection layout mode is the sequential priority mode, the at least two display areas are determined according to the projection data of the at least two projection devices and the projection layout mode, including: determining the at least two display areas according to the projection data of the at least two projection devices and the sequential priority mode, the at least two display areas including a first display area and a second display area; in response to the projection connection of the first projection device, the first display area displays a first projection window; in response to the projection connection of the second projection device, the first display area displays the second projection window, and the second display area displays the first projection window.

[0028] It is understandable that when the projection layout mode is the order priority mode, the time priority can be considered. That is, the projection device that is most recently connected to the shared device for projection has the highest time priority, and the projection window corresponding to the projection device with the highest time priority is displayed in the first display area.

[0029] Exemplarily, the first screen projection device is connected to the shared device for screen projection at time A, and the second screen projection device is connected to the shared device for screen projection at time B. Time A is earlier than time B. At this time, the second screen projection device can be regarded as the most recent screen projection device connected to the shared device for screen projection. The second screen projection device has the highest time priority. Therefore, the second screen projection window can be displayed in the first display area. Before that, the first screen projection window corresponding to the first screen projection device connected to the shared device for screen projection can be displayed in the second display area.

[0030] Exemplarily, the first display area can be understood as the main display area in the embodiment of the present application, and the second display area can be understood as the history display area in the embodiment of the present application.

[0031] Based on the above solution, users can display the projection windows in a sequential priority layout in a conference scenario, focusing on displaying the projection windows with high priority, which is more suitable for scenarios where users want to focus on introducing a certain solution in a meeting.

[0032] In combination with the first aspect, in certain implementations of the first aspect, the method also includes: in response to the user dragging the first projection window to the first display area, the first projection window is displayed in the first display area, and the second projection window is displayed in the second display area; or in response to the user dragging the second projection window to the second display area, the first projection window is displayed in the first display area, and the second projection window is displayed in the second display area.

[0033] Based on the above solution, the user can move the projection window on the screen of the shared device and select the projection window to be displayed in the first display area according to actual needs, so that participants can focus on displaying the solution in a certain projection window.

[0034] In combination with the first aspect, in certain implementations of the first aspect, when the projection layout mode is the sequential priority mode, the at least two display areas are determined according to the projection data of the at least two projection devices and the projection layout mode, including: determining the at least two display areas according to the projection data of the at least two projection devices and the sequential priority mode, the at least two display areas including a first display area and a second display area; in response to the projection connection of the first projection device, the first display area displays a first projection window; in response to the projection connection of the second projection device, the first display area displays the first projection window, and the second display area displays the second projection window.

[0035] It can be seen that even if the second screen projection device is the most recent device connected to the shared device for screen projection and has the highest time priority, its corresponding second screen projection window is displayed in the second display area.

[0036] In this implementation, when the projection window (first projection window) in the first display area is being displayed, the projection window corresponding to the projection device newly connected to the shared device will also be displayed in the second display area as a candidate. Among them, the first projection window is being displayed, which can be understood as in a meeting scenario, user A is presenting a solution through the first projection window. At this time, when the shared device is connected to a new projection device, the first display area still maintains the first projection window to avoid affecting the current user A's solution presentation process.

[0037] In combination with the first aspect, in certain implementations of the first aspect, the method also includes: in response to the user dragging the second projection window to the first display area, the second projection window is displayed in the first display area, and the first projection window is displayed in the second display area; or in response to the user dragging the first projection window to the second display area, the second projection window is displayed in the first display area, and the first projection window is displayed in the second display area.

[0038] It is understandable that the second projection device is the latest projection device connected to the shared device in terms of timing. Before the user performs certain operations to display the second projection window in the first display area, it can be considered that the projection window (first projection window) currently displayed in the first display area has not been completed. For example, in a meeting scenario, the user is presenting a solution through the first projection window.

[0039] Based on the above scheme, the projection window corresponding to the projection device that is most recently connected to the shared device will be displayed in the second display area. When the projection window in the first display area (first projection window) is displayed, the projection window can be moved by the user's operation to move the projection window. The projection window in the second display area (second projection window) can be moved to the first display area.

[0040] In summary, when the projection layout mode is the order priority mode, the following scenarios may exist:

[0041] Scenario 1: Multiple users attend a meeting and need to present solutions through the screen of a shared device in turn. Before user A presents the solution, user A's projection device is connected to the shared device. As the latest device connected to the shared device, user A's projection device has the highest time priority. Therefore, the projection window corresponding to user A's projection device can be displayed in the first display area. The windows corresponding to the projection devices of users B and C who have presented solutions before user A can be displayed in the second display area.

[0042] Scenario 2: Multiple users attend a meeting and need to present solutions through the screen of a shared device in turn. The shared device can pre-project the screen and connect to multiple projection devices. When user A presents the solution, the projection window corresponding to user A's solution has the highest priority, and the projection window corresponding to user A's solution can be displayed in the first display area. The projection windows corresponding to the projection devices of user B, who has presented the solution before user A, and user C, who will present the solution after user A, can be displayed in the second display area.

[0043] Scenario 3: User A, User B, and User C attend a meeting together, and the shared device has established a screen projection connection with the projection devices of User A and User B. At this time, User A has completed the presentation of his plan, User B is presenting his plan, and User C is about to present his plan. The first display area displays the projection window corresponding to User B's plan, and the second display area displays the projection window corresponding to User A's plan. While the first display area of ​​the shared device displays the projection window corresponding to User B's plan, it establishes a projection connection with User C's projection device. To avoid the projection window corresponding to User C's projection device having the highest time priority because User C's projection device will become the latest device to be connected to the shared device for projection, User C's projection window will be displayed in the first display area, thereby affecting the display of User B's projection window in the first display area, which is presenting the plan. At this time, the display priority is given priority, and User C's projection window is displayed in the second display area.

[0044] In combination with the first aspect, in certain implementations of the first aspect, the method also includes: when the shared device displays at least two projection windows in the at least two display areas in the sequence priority mode, the shared device displays at least one mode control in response to the user's first operation, and the at least one mode control displayed includes a smart split screen mode control and / or a full screen mode control; in response to the user's operation on the smart split screen mode control, the projection layout mode is switched from the sequence priority mode to the smart split screen mode; or in response to the user's operation on the full screen mode control, the projection layout mode is switched from the sequence priority mode to the full screen mode.

[0045] Based on the above solution, the sequential priority mode, smart split screen mode or other projection layout modes can be switched through the user's operation on the shared device screen. When the shared device switches the projection layout mode, the shared device can adjust the display area according to the new projection layout mode.

[0046] In combination with the first aspect, in certain implementations of the first aspect, the method also includes: the shared device displays a third projection window and a fourth projection window, the third projection window corresponds to the third projection device, and the fourth projection window corresponds to the fourth projection device; in response to the user's operation in the third projection window, the controls of the fourth projection device are displayed; in response to the user's operation on the controls of the fourth projection device, the fourth projection device is determined to be the target device, and the content displayed in the third projection window is the target file.

[0047] In combination with the first aspect, in certain implementations of the first aspect, the method further includes: in response to the user dragging the target file from the third projection window to the fourth projection window, the target file is displayed in the fourth projection window.

[0048] Based on the above solution, when a shared device displays multiple projection windows, files can be transferred between different projection devices through user operations on the shared device, thereby facilitating file sharing.

[0049] In combination with the first aspect, in certain implementations of the first aspect, the method also includes: in response to the user dragging the third projection window to the location of the fourth projection window, the positions of the third window and the fourth projection window are swapped; or in response to the user dragging the fourth projection window to the location of the third projection window, the positions of the third projection window and the fourth projection window are swapped.

[0050] Based on the above solution, the position of each projection window can be moved through the user's operations on the shared device, which can flexibly adapt to the user's actual needs.

[0051] In combination with the first aspect, in certain implementations of the first aspect, the method further includes: in response to the user dragging the third projection window to a preset area, the third projection window is displayed in the preset area as a floating window.

[0052] Based on the above solution, the projection window can be displayed as a floating window through the user's operation on the shared device, and the position of the floating window can also be flexibly moved to improve the user experience.

[0053] In a second aspect, an electronic device is provided, characterized in that it includes: one or more processors; one or more memories; the one or more memories store one or more computer programs, the one or more computer programs include instructions, the shared device is connected to at least two projection devices for projection, and when the instructions are executed by the one or more processors, the electronic device performs the following steps: obtaining projection data of the at least two projection devices, the projection data including screen data and / or application data; determining at least two display areas according to the projection data of the at least two projection devices and the projection layout mode, the projection layout mode including one of the following: smart split screen mode, sequential priority mode; displaying at least two projection windows in the at least two display areas, the at least two projection windows corresponding to the at least two projection devices.

[0054] In combination with the second aspect, in certain implementations of the second aspect, when the projection layout mode is the smart split-screen mode, at least two display areas are determined based on the projection data of the at least two projection devices and the projection layout mode. When the instruction is executed by the one or more processors, the electronic device performs the following steps: determining at least two display areas based on the projection data of the at least two projection devices and the display layout method, wherein the smart split-screen mode includes the display layout method, and the display layout method includes a left-right layout method and an up-down layout method.

[0055] In combination with the second aspect, in certain implementations of the second aspect, when the instruction is executed by the one or more processors, the electronic device performs the following steps: determining the projection height based on the screen data of the at least two projection devices and the screen data of the shared device, wherein the screen data includes the screen pixel height and the screen pixel width; determining the display layout method based on the projection height.

[0056] In combination with the second aspect, in certain implementations of the second aspect, the display layout mode is determined according to the projection height. When the instruction is executed by the one or more processors, the electronic device performs the following steps: based on the projection height being greater than half of the screen pixel height of the shared device, determining that the display layout mode is the left-right layout mode.

[0057] In combination with the second aspect, in certain implementations of the second aspect, when the instruction is executed by the one or more processors, the electronic device performs the following steps: determine the size of the at least two projection windows based on the screen data of the at least two projection devices, the screen pixel width of the shared device, and the projection height, and the size of the at least two display areas is the same as the size of the at least two projection windows.

[0058] In combination with the second aspect, in certain implementations of the second aspect, the display layout method is determined according to the projection screen height. When the instruction is executed by the one or more processors, the electronic device performs the following steps: based on the projection screen height being less than or equal to half of the screen pixel height of the shared device, determining that the display layout method is the top-down layout method.

[0059] In combination with the second aspect, in certain implementations of the second aspect, when the display layout is a top-down layout, the at least two display areas include a first split-screen display area and a second split-screen display area, and the height of the split-screen display area is half of the pixel height of the shared device; when the instruction is executed by the one or more processors, the electronic device performs the following steps: determine the size of the at least two projection windows based on the screen data of the at least two projection devices, the screen pixel width of the shared device, and the height of the split-screen display area.

[0060] In combination with the second aspect, in certain implementations of the second aspect, when the projection layout mode is the sequential priority mode, at least two display areas are determined based on the projection data of the at least two projection devices and the projection layout mode. When the instruction is executed by the one or more processors, the electronic device performs the following steps: determine the at least two display areas based on the projection data of the at least two projection devices and the sequential priority mode, the at least two display areas including a first display area and a second display area; in response to the projection connection of the first projection device, the first display area displays a first projection window; in response to the projection connection of the second projection device, the first display area displays the second projection window, and the second display area displays the first projection window.

[0061] In combination with the second aspect, in certain implementations of the second aspect, when the instruction is executed by the one or more processors, the electronic device performs the following steps: in response to the user dragging the first projection window to the first display area, the first projection window is displayed in the first display area, and the second projection window is displayed in the second display area; or in response to the user dragging the second projection window to the second display area, the first projection window is displayed in the first display area, and the second projection window is displayed in the second display area.

[0062] In combination with the second aspect, in certain implementations of the second aspect, when the projection layout mode is the sequential priority mode, at least two display areas are determined based on the projection data of the at least two projection devices and the projection layout mode. When the instruction is executed by the one or more processors, the electronic device performs the following steps: determine the at least two display areas based on the projection data of the at least two projection devices and the sequential priority mode, the at least two display areas including a first display area and a second display area; in response to the projection connection of the first projection device, the first display area displays a first projection window; in response to the projection connection of the second projection device, the first display area displays the first projection window, and the second display area displays the second projection window.

[0063] In combination with the second aspect, in certain implementations of the second aspect, when the instruction is executed by the one or more processors, the electronic device performs the following steps: in response to the user dragging the second projection window to the first display area, the second projection window is displayed in the first display area, and the first projection window is displayed in the second display area; or in response to the user dragging the first projection window to the second display area, the second projection window is displayed in the first display area, and the first projection window is displayed in the second display area.

[0064] In combination with the second aspect, in certain implementations of the second aspect, when the instruction is executed by the one or more processors, the electronic device performs the following steps: when the shared device displays at least two projection windows in the at least two display areas in the sequence priority mode, the shared device displays at least one mode control in response to the user's first operation, and the at least one mode control displayed includes a smart split screen mode control and / or a full screen mode control; in response to the user's operation on the smart split screen mode control, the projection layout mode is switched from the sequence priority mode to the smart split screen mode; or in response to the user's operation on the full screen mode control, the projection layout mode is switched from the sequence priority mode to the full screen mode.

[0065] In combination with the second aspect, in certain implementations of the second aspect, when the instruction is executed by the one or more processors, the electronic device performs the following steps: the shared device displays a third projection window and a fourth projection window, the third projection window corresponds to the third projection device, and the fourth projection window corresponds to the fourth projection device; in response to the user's operation in the third projection window, the controls of the fourth projection device are displayed; in response to the user's operation on the controls of the fourth projection device, the fourth projection device is determined to be the target device, and the content displayed in the third projection window is the target file.

[0066] In combination with the second aspect, in certain implementations of the second aspect, when the instruction is executed by the one or more processors, the electronic device performs the following steps: in response to the user dragging the target file from the third projection window to the fourth projection window, the target file is displayed in the fourth projection window.

[0067] In combination with the second aspect, in certain implementations of the second aspect, the method also includes: in response to the user dragging the third projection window to the location of the fourth projection window, the positions of the third projection window and the fourth projection window are swapped; or in response to the user dragging the fourth projection window to the location of the third projection window, the positions of the third projection window and the fourth projection window are swapped.

[0068] In combination with the second aspect, in certain implementations of the second aspect, when the instruction is executed by the one or more processors, the electronic device performs the following steps: in response to the user dragging the third projection window to a preset area, the third projection window is displayed in the preset area as a floating window.

[0069] In a third aspect, a display system is provided, which includes a shared device as in the first aspect and any possible implementation thereof and at least two screen projection devices.

[0070] In a fourth aspect, a display device is provided, comprising: a processor coupled to a memory, the memory being used to store a computer program, the processor being used to run the computer program, so that the display device executes the method in the first aspect and any possible implementation thereof.

[0071] In combination with the fourth aspect, in certain implementations of the fourth aspect, one or more of the memory and the transceiver are also included, and the transceiver is used to receive signals and / or send signals.

[0072] In a fifth aspect, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a computer, the computer implements the method in the first aspect and any possible implementation thereof.

[0073] In a sixth aspect, a computer program product comprising instructions is characterized in that when the computer program product is run on a computer, the computer is caused to execute the method in the first aspect and any possible implementation thereof.

[0074] In a seventh aspect, a chip is provided, comprising a processor and a data interface, wherein the processor reads instructions stored in a memory through the data interface to execute the method in the first aspect and any possible implementation thereof.

[0075] In combination with the seventh aspect, in one possible implementation, the processor is coupled to the memory via an interface.

[0076] In combination with the seventh aspect, in a possible implementation, the chip system also includes a memory, in which a computer program or computer instructions are stored. BRIEF DESCRIPTION OF THE DRAWINGS

[0077] Figure 1 It is a structural diagram of an electronic device.

[0078] Figure 2 It is a software structure diagram of an electronic device.

[0079] Figure 3 It is a schematic diagram of a scenario provided in an embodiment of the present application.

[0080] Figure 4 It is a schematic flow chart of a display method provided in an embodiment of the present application.

[0081] Figure 5 It is a schematic diagram of a screen projection layout mode provided in an embodiment of the present application.

[0082] Figure 6 It is a schematic diagram of switching screen projection layout modes provided in an embodiment of the present application.

[0083] Figure 7 This is a schematic flowchart of file sharing provided in an embodiment of the present application.

[0084] Figure 8 It is a schematic diagram of determining a target device provided in an embodiment of the present application.

[0085] Fig. 9 This is a schematic diagram of the movement of a projection window provided in an embodiment of the present application.

[0086] Fig.10 This is a schematic diagram of a projection window displayed as a floating window provided in an embodiment of the present application.

[0087] Fig.11 It is a schematic flowchart of a display method provided in an embodiment of the present application. DETAILED DESCRIPTION

[0088] The technical solution in this application will be described below in conjunction with the accompanying drawings.

[0089] The terms used in the following embodiments are only for the purpose of describing specific embodiments, and are not intended to be used as limitations on the present application. As used in the specification and the appended claims of the present application, the singular expressions "one", "a kind of", "said", "above", "the" and "this" are intended to also include expressions such as "one or more", unless there is a clear contrary indication in the context. It should also be understood that in the following embodiments of the present application, "at least one", "one or more" refer to one, two or more. The term "and / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist; for example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the objects associated before and after are in an "or" relationship.

[0090] References to "one embodiment" or "some embodiments" etc. described in this specification mean that a particular feature, structure or characteristic described in conjunction with the embodiment is included in one or more embodiments of the present application. Thus, the phrases "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear at different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0091] The following describes an electronic device, a user interface for such an electronic device, and embodiments for using such an electronic device. In some embodiments, the electronic device may be a portable electronic device that also includes other functions such as a personal digital assistant and / or a music player function, such as a mobile phone, a tablet computer, a wearable electronic device with wireless communication function (such as a smart watch), etc. Exemplary embodiments of portable electronic devices include but are not limited to devices equipped with Or a portable electronic device with other operating systems. The portable electronic device may also be other portable electronic devices, such as a laptop computer. It should also be understood that in some other embodiments, the electronic device may not be a portable electronic device, but a desktop computer. In some other embodiments, the electronic device may be an instrument for measurement, such as an oscilloscope.

[0092] For example, Figure 11 shows a schematic diagram of the structure of the electronic device 100. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0093] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0094] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0095] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0096] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0097] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0098] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0099] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0100] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0101] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0102] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0103] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0104] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0105] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0106] The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0107] ISP is used to process the data fed back by camera 193. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to ISP for processing and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, ISP can be set in camera 193.

[0108] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0109] The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the electronic device 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0110] Video codecs are used to compress or decompress digital videos. The electronic device 100 may support one or more video codecs. Thus, the electronic device 100 may play or record videos in a variety of coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0111] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of electronic device 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.

[0112] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.

[0113] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0114] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0115] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.

[0116] The speaker 170A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The electronic device 100 can listen to music or listen to a hands-free call through the speaker 170A.

[0117] The receiver 170B, also called a "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or voice message, the voice can be received by placing the receiver 170B close to the human ear.

[0118] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to microphone 170C to input the sound signal into microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the sound source, realize directional recording function, etc.

[0119] The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be set on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure based on the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the touch operation intensity according to the pressure sensor 180A. The electronic device 100 can also calculate the touch position based on the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example, when a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the alarm application icon, an instruction to create a new alarm is executed.

[0120] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to realize fingerprint unlocking, access application locks, fingerprint photography, fingerprint answering calls, etc. For example, when the mobile phone detects a user's touch operation on the lock screen interface, the mobile phone can collect the user's fingerprint information through the fingerprint sensor 180H, and match the collected fingerprint information with the fingerprint information preset in the mobile phone. If the match is successful, the mobile phone can enter the non-lock screen interface from the lock screen interface.

[0121] The touch sensor 180K is also called a "touch panel". The touch sensor 180K can be set on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the electronic device 100, which is different from the position of the display screen 194.

[0122] Figure 2 1 is a software structure diagram of the electronic device 100 of the embodiment of the present application. The layered architecture divides the software into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, namely, the application layer, the application framework layer, the Android runtime (Android runtime) and the system library, and the kernel layer. The application layer can include a series of application packages.

[0123] like Figure 2 As shown, the application layer may include camera, settings, skin module, user interface (UI), third-party applications, etc. Among them, the third-party applications may include gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.

[0124] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer may include some predefined functions.

[0125] like Figure 2 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0126] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc. The content provider is used to store and obtain data and make the data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0127] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. The display interface can be composed of one or more views.

[0128] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including connecting, hanging up, etc.).

[0129] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0130] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.

[0131] Android runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.

[0132] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0133] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0134] The system library may include multiple functional modules, such as surface manager, media libraries, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0135] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0136] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0137] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0138] A 2D graphics engine is a drawing engine for 2D drawings.

[0139] In addition, the system library may also include status monitoring service modules, such as a physical status recognition module for analyzing and identifying user gestures; a sensor service module for monitoring sensor data uploaded by various sensors at the hardware layer to determine the physical status of the electronic device 100.

[0140] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0141] The hardware layer can include various types of sensors, such as Figure 1 Various types of sensors introduced in.

[0142] Combined with the above Figure 1 and Figure 2 The electronic device introduced in the embodiment of the present application can be a mobile phone terminal, a tablet computer, or other device that can realize the screen projection function. The physical devices involved in the electronic device 100 mainly include hardware components such as sensors, decision support systems (DSS) display chips, touch screens, fingerprint recognition modules, etc.; as well as kernel software layers such as screen management modules, display drivers, fingerprint drivers, and anti-mistouch; application framework layer functions such as anti-mistouch input, screen control, always on display (AOD) services, and power management; as well as application layer services such as special adaptation applications (camera), third-party applications, system sleep, and AOD.

[0143] With the development of electronic device technology, one electronic device screen can display multiple electronic device interfaces, so that users can simultaneously obtain information from multiple interfaces, so that users can view, compare, and process information from multiple interfaces. The scenarios of viewing multiple electronic device interfaces through one electronic device screen include but are not limited to the following: Figure 3In the conference scenario shown, users usually need to view multiple solutions, compare and discuss multiple solutions, and users also need to have different requirements for the display methods of multiple solutions at different stages of the meeting. In the current conference scenario, multiple participants can carry multiple personal electronic devices, and the participants can connect their personal electronic devices to the public electronic devices of the conference in turn, so that other participants can view the participant's solution through the public electronic device screen. However, this method can only display the solution of one participant at a time, and it is not possible to view the solutions of multiple participants at the same time through the public electronic device screen, which cannot meet the needs of comparing and discussing multiple solutions, affecting the efficiency of the meeting. In order to be able to display multiple solutions on one screen, in the current conference scenario, public electronic devices can also support the projection display of multiple personal electronic devices, and participants can view multiple solutions at the same time, and compare and discuss multiple solutions. For example Figure 3 The conference scene shown includes a shared device 100 and a screen projection device 200. In the conference scene, the shared device 100 can be a public electronic device that can be used by multiple people. The screen projection device 200 can be a personal electronic device that can establish a data connection with the shared device 100 by accessing a wireless local area network (WLAN) or other means, so that the interface of the screen projection device 200 is displayed on the screen of the shared device 200. Specifically, the shared device 100 can be an electronic device such as a smart screen or an electronic whiteboard, which has a larger screen size, making it convenient for participants to view the plan in the conference scene; the screen projection device 200 can be a personal computer A, a mobile terminal B or a tablet computer C. Multiple screen projection devices 200 can be connected to the shared device 100 for screen projection, and the interfaces of personal computer A, mobile terminal B and tablet computer C can be displayed on the shared device 100. At present, on a shared device, display areas can be allocated to multiple projection devices according to a fixed grid template (for example, a grid allocation scheme). For example, if the number of projection devices is 4, the display area of ​​the shared device screen can be evenly divided into 4 parts, each corresponding to a projection window. However, since the size, shape, type and other parameters of each projection device may vary, allocating display areas to multiple projection devices according to a fixed grid template will result in the inability to fully utilize the display area of ​​the shared device screen, which will affect the projection display effect and is not convenient for flexible adaptation to user needs. Among them, the display area of ​​the shared device screen can also be the entire screen of the shared device.

[0144] Therefore, in order to solve the above problems, the embodiments of the present application provide a display method, an electronic device and a system. The method can display multiple projection windows according to a certain projection layout in the scenario where the projection windows corresponding to multiple projection devices are projected and displayed, so as to make full use of the display area of ​​the shared device screen, bring good display effects to users, and flexibly adapt to different needs of users.

[0145] like Figure 4 As shown, a schematic flow chart of a display method is shown, which can be applied to Figure 3 The method is described in detail below in the scenario where the shared device and the screen projection device are located.

[0146] S401, the sharing device establishes a connection with the screen projection device, and the sharing device obtains the screen projection data.

[0147] For example, the shared device can be an electronic device such as a smart screen or an electronic whiteboard set up in a public scene such as a conference room. The shared device can display the interfaces of multiple projection devices. The projection device can be a personal device such as a mobile phone terminal, a personal computer, or a tablet computer.

[0148] Exemplarily, a shared device establishes a connection with multiple projection devices, and the shared device can receive projection data from multiple projection devices. The projection data can be the screen data of the projection device, or the data of an application that the projection device can support the projection function. The projection device can be understood as a device that has established a projection connection with the shared device, or a device that is about to establish a projection connection with the shared device.

[0149] It should be noted that the shared device establishes a screen projection connection with the screen projection device. For example, the shared device and the screen projection device are connected in the same local area network, and screen mirroring is achieved through the system-level distributed soft bus technology, so that the screen projection window is mirrored and displayed on the screen of the shared device in real time, thereby realizing the screen projection connection between the shared device and the screen projection device. For another example, the screen projection device can send the screen projection data to the shared device through an application that supports the screen projection function (for example, a video playback application, a conference application, etc.), and the screen projection window is displayed on the screen of the shared device. In other words, the embodiment of the present application does not limit the specific method for establishing a screen projection connection between the shared device and the screen projection device. Any technician familiar with the technical field can easily think of changes or replacements within the technical scope of the above examples to achieve the specific method of establishing a screen projection connection, which should be covered within the scope of protection of the present application.

[0150] Exemplarily, a shared device can establish a screen projection connection with multiple screen projection devices, and the number of screen projection devices connected to the shared device can also change dynamically, that is, the number of screen projection devices connected to the shared device can be gradually increased. For example, in a meeting scenario, multiple participants can share solutions in turn, explain the solutions, and then compare the contents of different solutions to discuss the best solution. During the stage when participants share solutions, the screen projection devices of each participant can establish a screen projection connection with the shared device in turn. In the subsequent solution comparison stage, different screen projection windows can be viewed on the shared device. At this time, the shared device maintains simultaneous connection with multiple screen projection devices.

[0151] In one implementation, after the sharing device establishes a screen projection connection with the screen projection device, the sharing device receives the screen projection data from multiple screen projection devices and displays the screen projection window on the screen of the sharing device.

[0152] S402, the shared device determines the screen projection layout.

[0153] For example, in a conference scenario, participants may have different needs at different stages of the meeting. For example, when a participant shares a solution through a shared device, other participants need to focus on the solution shared by the participant, and the shared device at this time needs to display the solution shared by the participant as fully as possible. After all participants have shared their solutions, all solutions need to be compared and discussed. At this time, the shared device needs to display all solutions, and multiple projection windows need to be displayed as fully as possible. Therefore, the shared device needs to determine a projection layout that is more suitable for the current application scenario.

[0154] In one implementation, after receiving projection data from multiple projection devices, the sharing device can determine the projection layout based on the projection data. The projection data can be screen data such as the screen size and / or screen resolution of the projection device, or the resolution corresponding to the content area that can be projected by certain applications (for example, the resolution of the video window that can be projected by a video playback application).

[0155] Exemplarily, when the shared device determines the screen projection layout, it does not consider the screen projection data, and directly uses the grid allocation scheme to determine the display area of ​​each screen projection window, which will cause a certain degree of waste of the display area on the shared device screen. For example, if the shared device establishes a screen projection connection with the screen projection device personal computer and mobile phone terminal, without considering the screen projection data of the personal computer and the mobile phone terminal, the display area of ​​the shared device screen is evenly divided into two parts, one part of the display area is used to display the screen projection window of the personal computer, and the other part of the display area is used to display the screen projection window of the mobile phone terminal. But in fact, the screen size and / or screen resolution of the personal computer and the mobile phone terminal are different. If the same display area is configured, the screen projection window of the mobile terminal will have more black screen areas, resulting in a waste of display area, and the screen projection window of the mobile terminal and the screen projection window of the personal computer cannot be fully displayed.

[0156] Exemplarily, the screen projection layout mode may include a sequential priority mode and a smart split-screen mode.

[0157] It should be noted that configuring different projection layouts on the shared device can adapt to the projection needs of users at different stages. For example, when the shared device receives new projection data, or the received projection data increases, or the projection window resolution corresponding to the projection device that has established a projection connection with the shared device changes, the shared device can first determine the projection layout mode applicable to the current stage, and adjust the layout of the projection window according to the current projection layout mode.

[0158] Specifically, the screen projection layout method is introduced in detail below.

[0159] Method 1: Sequential priority mode.

[0160] It should be noted that the screen projection layout can be determined according to the order of screen projection. The display area of ​​the shared device can include a main display area and a historical display area. The main display area occupies most of the shared device display area, and the historical display area occupies a small part of the shared device display area. The main display area can display the projection window corresponding to the projection device that is most recently connected to the shared device for screen projection (which can be understood as the current projection window), and the historical display area can display the projection window corresponding to the historical projection device that is connected to the shared device for screen projection (which can be understood as the historical projection window).

[0161] Method 2: Smart split-screen mode.

[0162] It should be noted that the smart split-screen mode can maximize the use of the display area of ​​the shared device and can use the most reasonable screen projection layout to make multiple screen projection windows occupy as large a display area as possible.

[0163] For ease of understanding, Figure 5 As shown, the projection layout method provided by the embodiment of the present application is shown. Figure 5 Taking the shared device as a smart screen as an example, the above two screen projection layout modes are introduced respectively.

[0164] like Figure 5 As shown in (a) in the figure, a screen projection layout method in the sequential priority mode is shown. In the sequential priority mode, the display area of ​​the shared device includes a historical display area 501 and a main display area 502. The historical display area 501 displays multiple historical screen projection windows, for example, the screen projection window of the historical screen projection device A and the screen projection window of the historical screen projection device B. The main display area 502 displays the current screen projection window, for example, the screen projection window of the latest screen projection device C. The display area of ​​the shared device is divided into a historical display area 501 and a main display area 502 on the left and right, wherein the main display area 502 occupies most of the display area of ​​the shared device, and the historical display area 501 occupies a small part of the display area of ​​the shared device. The multiple historical screen projection windows in the historical display area 501 can be displayed in a list, and the sizes of the multiple historical screen projection windows can be the same.

[0165] It should be noted that the history display area 501 and the main display area 502 can be Figure 5 The method shown in (a) can be distributed left and right, or can be distributed up and down, and this embodiment of the present application is not limited to this.

[0166] In one implementation, the size of the main display area 502 and the size of the history display area 501 may be fixed, that is, no matter the resolution of the projection window of the projection device, it will not affect the size of the main display area 502 and the history display area 501. For example, whether the latest projection device C is a mobile phone terminal or a personal computer, it will not affect the size of the main display area 502 and the history display area 501.

[0167] In another implementation, the size of the main display area 502 and the size of the history display area 501 can be dynamically determined based on the projection data (e.g., screen data) of the projection device.

[0168] It should be noted that the screen data may be different for different projection devices. For the main display area 501, a default pixel resolution size may be preset, and the size of the main display area 502 may be adjusted according to the actual screen data of the projection device (e.g., screen pixel height, screen pixel width), so that the size of the history display area 501 may also be adjusted accordingly.

[0169] Take the entire screen of the projection device being projected and displayed in the main display area 502 of the shared device as an example. Specifically, the default aspect ratio of the main display area 502 is compared with the aspect ratio of the projection device screen, the smaller side of the height and width of the main display area 502 relative to the height and width of the projection device screen is determined, and the size of the projection window is determined based on the smaller side.

[0170] For example, the screen aspect ratio of the projection device is 16:9, and the aspect ratio of the main display area is 4:3. Since 4:3 is 12:9, the smaller side is determined by comparison to be the width (12 is less than 16). Therefore, since the width is smaller, the size of the projection window in the width direction can be compressed. At the same time, in order to ensure that the ratio of the projection window is 16:9, the size of the projection window in the height direction will also be compressed. There are two upper and lower shadow areas in the height direction of the projection window (for example, Figure 5 The shaded area shown in (a) in the figure) allows the compressed projection window to be fully displayed in the main display area.

[0171] It should be noted that, in the process of connecting a new projection device to a shared device, the shared device can dynamically determine the main display area and the historical display area.

[0172] In a meeting scenario, the user can also temporarily call the historical projection window in the historical display area while explaining the plan. The shared device can respond to the user's operation on the historical projection window, display the historical projection window in the main display area, and display the current projection window displayed in the main display area in the historical display area. In other words, the current projection window in the main display area and the historical projection window in the historical display area can swap positions according to the operation triggered by the user. It should be noted that the user is not limited to the specific operation of the historical projection window in the historical display area. For example, the user clicks and drags the projection window in the historical display area to move it to the main display area.

[0173] In addition, in order to facilitate users to compare solutions in the conference scene, the historical projection window and the current projection window can be displayed in the main display area 502. For example, the projection window of projection device A and the projection window of projection device C are displayed side by side in the main display area 502. In this case, the main display area can be understood as a screen and is split so that multiple projection windows can be displayed in split screen in the main display area. For example, the user clicks on the projection window of projection device A and drags it to the left position of the center line area of ​​the main display area 502 to release it. The projection window of projection device A will be displayed on the left side of the main display area 502, and the projection window of projection device C will be displayed on the right side of the main display area 502; the user clicks on the projection window of projection device A and drags it to the right position of the center line position of the main display area 502 to release it. The projection window of projection device A will be displayed on the right side of the main display area 502, and the projection window of projection device C will be displayed on the left side of the main display area 502. Furthermore, the user can display the projection window of the projection device B in the history display area 501 in the main display area 502 through similar operations as described above.

[0174] It should be noted that the historical projection windows displayed in the main display area and the display area occupied by the projection windows can also be adjusted according to user needs. For example, the projection window of the projection device A and the projection window of the projection device C are displayed in the main display area 502 on the left and right by default, and each occupies half of the display area of ​​the main display area 502. There is a boundary line between the projection window of the projection device A and the projection window of the projection device B. The user can change the display area occupied by the projection window of the projection device A and the projection window of the projection device B by dragging the boundary line.

[0175] like Figure 5 (b) to Figure 5 As shown in (d) in the figure, a projection layout method in the smart split-screen mode is shown. The smart split-screen mode can maximize the display of multiple projection windows in the display area of ​​the shared device to minimize the shadow area of ​​the shared device. When the shared device determines the projection layout through the smart split-screen mode, each time a new projection device is added and / or the aspect ratio of the projection window changes, the shared device needs to determine the latest projection layout.

[0176] It should be noted that when the shared device determines the projection layout according to the smart split screen mode, it mainly determines the projection height based on the aspect ratio of the screens of multiple projection devices and the aspect ratio of the screen of the shared device, and determines the display layout mode based on the relationship between the projection height and the screen pixel height of the shared device. Among them, the display layout modes include left-right layout and top-bottom layout.

[0177] It can be understood that when the projection screen height is greater than half of the screen pixel height of the shared device, the projection screen window is displayed in a left-right layout; when the projection screen height is less than or equal to half of the screen pixel height of the shared device, the projection screen window is displayed in a top-bottom layout. The following introduces the two display layout methods respectively.

[0178] like Figure 5 As shown in (b) of FIG. 1 , a schematic diagram of displaying a screen projection window in a left-right layout is shown. Screen projection device A, screen projection device B, and screen projection device C are connected to the shared device for screen projection. It can be understood that when the shared device maintains a screen projection connection with screen projection device A and screen projection device B, in response to the connection of screen projection device C, the shared device determines the latest screen projection layout such as Figure 5 As shown in (b) in .

[0179] Specifically, the process of the shared device determining the projection layout is as follows:

[0180] For example, the screen resolution of projection device A is 2800*1800, the screen resolution of projection device B is 1170*2532, the screen resolution of projection device C is 1688*2388, and the screen resolution of the shared device is 3840*2160.

[0181] Step 1: Determine the aspect ratio of the projection device and the shared device.

[0182] The aspect ratio of projection device A is: A1=2800 / 1800;

[0183] The aspect ratio of projection device B is: B1=1170 / 2532;

[0184] The aspect ratio of the projection device C is: C1 = 1688 / 2388;

[0185] The aspect ratio of the shared device is: X=3840 / 2160.

[0186] Step 2: Determine the projection height.

[0187] It should be noted that in the smart split screen mode, the aspect ratio of each projection window is consistent with the aspect ratio of the projection device, and the left-right layout of multiple projection windows is given priority. Therefore, the left-right layout is given priority for calculation. When the projection windows are arranged on the left and right, the height of each projection window is consistent. Among them, the height of each projection window can be understood as the projection height H.

[0188] According to the projection height and the aspect ratio of each projection device, the width of each projection window when it is displayed in left and right distribution is determined.

[0189] The projection window width of projection device A, K1 = A1*H;

[0190] The projection window width of projection device B, K2 = B1*H;

[0191] The projection window width of the projection device C, K3 = C1*H.

[0192] In order to maximize the display of each projection window in the shared device display area (which can be understood as the screen of the shared device), when the projection windows are distributed left and right, the sum of the widths of each projection window is consistent with the width of the shared device screen, that is, K1+K2+K3=3840. At the same time, the projection height H is less than or equal to the height of the shared device screen, that is, H is less than or equal to 2160.

[0193] Based on the above conditions, the width of the shared device screen is divided by the sum of the aspect ratios of each projection device, and the result is rounded up to get the projection height H. That is, H = 3840 / (A1+A2+A3), and H is 1410 after rounding.

[0194] Step 3: Determine the layout based on the projection screen height.

[0195] In the above step 2, the projection screen height H is calculated to be 1410, which is greater than half of the height of the shared device screen (1080). Therefore, the left-right layout is adopted.

[0196] Furthermore, the width of each projection window is determined (rounded up) based on the relationship between the projection window aspect ratio and the projection height.

[0197] The projection window width of projection device A, K1 = A1 * H = 2194;

[0198] The projection window width of projection device B, K2 = B1*H = 652;

[0199] The projection window width of the projection device C, K3 = C1*H = 997.

[0200] Step 4: Determine the size of the screen projection window.

[0201] Based on the projection height calculated above and the width of each projection window, the size of the projection window actually displayed by each projection device on the shared device is determined.

[0202] The projection window size of projection device A: 2194*1410;

[0203] The projection window size of projection device B: 652*1410;

[0204] The projection window size of projection device C is: 997*1410.

[0205] Step 5: Determine the position of the projection window based on its size and layout.

[0206] Based on the left-right distribution method, the positions of each projection window can be arranged in sequence. The embodiment of the present application does not limit the specific order of the projection window arrangement, and a default arrangement order can be preset. The closer the moment when the projection connection is first established is to the current moment, the closer its position is to the left side of the shared device screen. For example, the moment when projection device A establishes the projection connection is closest to the current moment, so the projection window 503 of projection device A is displayed on the far left of the shared device screen.

[0207] Based on the above steps, Figure 5 As shown in (b), the shared device screen can be distributed left and right, with the projection windows of projection device A, projection device B and projection device C displayed from left to right.

[0208] From the above process of determining the projection layout, it can be seen that the projection height is related to the resolution of the projection device screen. Therefore, for different projection devices, the projection layout may also be different. For example, when Figure 5 When the screen resolution of the projection device shown in (b) changes, the projection layout will change to the following: Figure 5 The method shown in (c) in .

[0209] like Figure 5 As shown in (c) of FIG. 1 , a schematic diagram of displaying a projection window in an up-down layout is shown. Projection device A, projection device B, and projection device C are connected to the shared device for projection. It can be understood that when the shared device maintains a projection connection with projection device A and projection device B, in response to the connection of projection device C, the shared device determines the latest projection layout such as Figure 5 As shown in (c) in .

[0210] Specifically, the process of the shared device determining the screen layout of the projection device is as follows:

[0211] For example, the screen resolution of projection device A is 2800*1800, the screen resolution of projection device B is 2532*1170, the screen resolution of projection device C is 2800*1800, and the screen resolution of the shared device is 3840*2160.

[0212] Step 1: Determine the aspect ratio of the projection device and the shared device.

[0213] The aspect ratio of projection device A is: A1=2800 / 1800;

[0214] The aspect ratio of projection device B is: B1=2532 / 1170;

[0215] The aspect ratio of the projection device C is: C1 = 2800 / 1800;

[0216] The aspect ratio of the shared device is: X=3840 / 2160.

[0217] Step 2: Determine the projection height.

[0218] The projection window width of projection device A, K1 = A1*H;

[0219] The projection window width of projection device B, K2 = B1*H;

[0220] The projection window width of the projection device C, K3 = C1*H.

[0221] Among them, K1+K2+K3=3840, and the projection screen height H is less than or equal to 2160.

[0222] Therefore, the projection screen height H = 3840 / (A1+A2+A3), and H is 728 after rounding.

[0223] Step 3: Determine the layout based on the projection screen height.

[0224] The projection screen height H calculated in step 2 is 728, which is less than half of the height of the shared device screen (1080). Therefore, a top-bottom layout is adopted.

[0225] In the top-bottom layout mode, the screen of the shared device is divided into two split-screen display areas, such as Figure 5 The upper split screen display area 504 and the lower split screen display area 505 shown in (c) of FIG. 1 can display the projection window in both split screen display areas. For example, the pixel height of the two split screen display areas is half the pixel height of the shared device screen (1080).

[0226] Exemplarily, it can be preset that at most two projection windows can be displayed in each split-screen display area.

[0227] When dividing the projection window in each split-screen display area, it can be evenly distributed by default, and the projection area with the same aspect ratio as the projection window is determined based on the pixel height H' of the split-screen display area (that is, half the pixel height H' of the shared device screen). In other words, when the projection window is displayed in a top-to-bottom layout, the width of the projection window is determined based on half the pixel height H' of the shared device screen; when the projection window is displayed in a left-right layout, the width of the projection window is determined based on the projection height H.

[0228] In one implementation, when it is calculated that the width of the projection area corresponding to the projection window is greater than half of the pixel width of the split-screen display area (that is, half of the pixel width of the shared device screen), the default average distribution method is adjusted so that the projection window with a projection area width greater than half of the pixel width of the split-screen display area occupies an area greater than half of the split-screen display area. At the same time, it is required that the sum of the width of another projection window in the same split-screen display area and the width of the projection window is less than or equal to the pixel width of the split-screen display area.

[0229] Furthermore, the width of each projection window is determined (rounded up) according to the relationship between the aspect ratio of the projection window and half the pixel height H' of the shared device screen.

[0230] The projection window width of projection device A, K1 = A1 * H' = 1680;

[0231] The projection window width of projection device B, K2 = B1*H' = 2337;

[0232] The projection window width of the projection device C, K3 = C1*H' = 1680.

[0233] Step 4: Determine the size of the screen projection window.

[0234] Based on the half pixel height H' of the shared device screen obtained by the above calculation and the width of each screen projection window, the size of the screen projection window actually displayed by each screen projection device on the shared device is determined.

[0235] The projection window size of projection device A: 1680*1080;

[0236] The projection window size of projection device B: 2337*1080;

[0237] The projection window size of projection device C is: 1680*1080.

[0238] Step 5: Determine the position of the projection window based on its size and layout.

[0239] Based on the width of each projection window determined in step 3 above, it can be known that the projection window width of projection device A is less than half of the pixel width of the shared screen (1920), the projection window width of projection device B is greater than half of the pixel width of the shared screen, and the projection window width of projection device C is less than half of the pixel width of the shared screen. If projection device A and projection device B are displayed in the same split-screen display area, the sum of the projection window width of projection device A and the projection window width of projection device B is greater than the pixel width of the split-screen display area (that is, greater than the pixel width of the shared device screen), which will prevent the projection window from being fully displayed in the split-screen display area. If the projection window is reduced in order to ensure that the projection window is fully displayed, this will reduce the clarity of the projection window. Therefore, the specific position of the projection window needs to be adjusted. For example, if Figure 5 As shown in (c), the projection window of projection device A and the projection window of projection device C are displayed side by side in the upper split-screen display area 504, and the projection window of projection device B is displayed in the lower split-screen display area 505.

[0240] Furthermore, in the above Figure 5 As shown in (c), on the basis of establishing a screen projection connection between the shared device and the screen projection device A, the screen projection device B and the screen projection device C, a new screen projection device D is added.

[0241] like Figure 5 As shown in (d) in the figure, a schematic diagram of displaying a projection window in an up-down layout is shown. Projection device A, projection device B, projection device C, and projection device D are connected to the shared device for projection. It can be understood that when the shared device maintains a projection connection with projection device A, projection device B, and projection device C, in response to the connection of projection device D, the shared device determines the latest projection layout such as Figure 5 As shown in (d) in .

[0242] Specifically, the process of the shared device determining the screen projection layout is as follows:

[0243] For example, the screen resolution of projection device A is 2800*1800, the screen resolution of projection device B is 2532*1170, the screen resolution of projection device C is 2800*1800, the aspect ratio of projection device D is 1170*2532, and the screen resolution of the shared device is 3840*2160.

[0244] Step 1: Determine the aspect ratio of the projection device and the shared device.

[0245] The aspect ratio of projection device A is: A1=2800 / 1800;

[0246] The aspect ratio of projection device B is: B1=2532 / 1170;

[0247] The aspect ratio of the projection device C is: C1 = 2800 / 1800;

[0248] The aspect ratio of the projection device D is: D = 1170 / 2532;

[0249] The aspect ratio of the shared device is: X=3840 / 2160.

[0250] Step 2: Determine the projection height.

[0251] The projection window width of projection device A, K1 = A1*H;

[0252] The projection window width of projection device B, K2 = B1*H;

[0253] The projection window width of projection device C, K3 = C1*H;

[0254] The projection window width of the projection device D, K4 = D1*H.

[0255] Among them, K1+K2+K3=3840, and the projection screen height H is less than or equal to 2160.

[0256] Therefore, the projection screen height H = 3840 / (A1+A2+A3), and H is 670 after rounding.

[0257] Step 3: Determine the layout based on the projection screen height.

[0258] The projection screen height H calculated in step 2 is 670, which is less than half of the height of the shared device screen (1080). Therefore, a top-bottom layout is adopted.

[0259] Furthermore, the width of each projection window is determined (rounded up) according to the relationship between the aspect ratio of the projection window and half the pixel width H' of the shared device screen.

[0260] The projection window width of projection device A, K1 = A1 * H' = 1680;

[0261] The projection window width of projection device B, K2 = B1*H' = 2337;

[0262] The projection window width of projection device C, K3 = C1*H' = 1680;

[0263] The projection window width of the projection device D is K4=D1*H'=500.

[0264] Step 4: Determine the size of the screen projection window.

[0265] Based on the half pixel width H' of the shared device screen obtained by the above calculation and the width of each screen projection window, the size of the screen projection window actually displayed by each screen projection device on the shared device is determined.

[0266] The projection window size of projection device A: 1680*1080;

[0267] The projection window size of projection device B: 2337*1080;

[0268] The projection window size of projection device C: 1680*1080;

[0269] The projection window size of projection device D is: 500*1080.

[0270] Step 5: Determine the position of the rear projection window based on the size and layout of the projection window.

[0271] Based on the width of each projection window determined in step 3 above, it can be known that if projection device B and projection device D are arranged side by side in a split-screen display area, the sum of the projection window width of projection device B and the projection window width of projection device D is 2837 (500+2337=2837), which is smaller than the pixel width of the split-screen display area of ​​3840 (that is, smaller than the pixel width of the shared device screen). Therefore, the projection windows of projection device B and projection device D do not need to occupy half of the area of ​​the split-screen display area in the default equal division method. The dividing line between the projection window of projection device B and the projection window of projection device D can be moved toward the direction of the projection window of projection device D, so that the projection windows of projection device B and projection device D can be clearly and completely displayed in the split-screen display area.

[0272] For example, Figure 5 As shown in (d) in the figure, the projection window of projection device A and the projection window of projection device C are displayed side by side in the upper split-screen display area 504, and the projection window of projection device B and the projection window of projection device D are displayed in the lower split-screen display area 505. The dividing line 506 between the projection window of projection device B and the projection window of projection device D does not divide the lower split-screen display area into two parts evenly, but is closer to the direction of the projection window of projection device D on the right.

[0273] Simply put, in smart split screen mode, the shared device can determine the layout rules of the projection window based on the aspect ratio of the projection device:

[0274] (1) In the case of left-right layout, multiple projection windows are arranged according to certain rules based on the calculated projection height. Figure 5 Description of (b) in .

[0275] (2) In the case of top-bottom layout, the width of each projection window is determined according to half of the pixel height of the shared device screen, and the position of the projection window is further determined according to the width of each projection window. Figure 5 (c) and Figure 5 Description of (d) in .

[0276] (3) In the case of top-bottom layout, when the sum of the widths of multiple projection windows in a split-screen display area is less than the pixel width of the shared device screen, the size of the projection window can be dynamically adjusted based on whether the width of each projection window is greater than half of the pixel width of the shared device screen, based on the pre-set average division of multiple projection windows in the split-screen display area. Figure 5 (d) shows the display mode of the projection windows of projection device B and projection device D in the split-screen display area below.

[0277] It should be noted that even for the same projection device, its aspect ratio may change depending on the posture of the projection device. Figure 5 The projection device B (2532*1170) and the projection device D (1170*2532) shown in (d) are mobile phone terminals of the same model with the same screen data, but the projection device B is in a horizontal posture and its projection window is a horizontal interface; the projection device D is in a vertical posture and its projection window is a vertical interface. The aspect ratios of the two projection devices are in an inverse relationship.

[0278] It should be noted that in the above description of the projection layout method, the projection window is taken as an example to represent the entire screen of the projection device. When the projection device projects part of the screen (for example, the window of the projection device and the window is not displayed in full screen), the screen resolution of the projection device in the above text can be replaced with the resolution of the projected part of the screen of the projection device.

[0279] S403, displaying the screen projection window on the shared device.

[0280] Exemplarily, after the shared device determines the projection layout, the projection window can be displayed in the display area of ​​the shared device. When the shared device is displayed in full screen, the display area of ​​the shared device can be understood as the screen of the shared device.

[0281] Furthermore, the sharing device can change the projection layout of the projection window in response to the user's operation of switching the projection layout mode.

[0282] It should be noted that the user can switch between the sequential priority mode, the smart split screen mode or other projection layout modes through operations on the screen of the shared device. When the shared device switches the projection layout mode, the shared device can adjust the projection layout of the projection window according to the new projection layout mode. The specific adjustment method can be referred to above and will not be repeated here.

[0283] Illustratively, the embodiments of the present application do not limit the user's operation of switching the projection layout mode. For example, the user triggers the switching of the projection layout mode through a specified gesture; or triggers a selection control of multiple projection layout modes through a specified operation, and clicks the corresponding selection control to switch the projection layout mode.

[0284] For ease of understanding, Figure 6 As shown, a schematic diagram of switching the screen projection layout mode is shown. The sharing device is connected to the screen projection device A, the screen projection device B and the screen projection device C, and the current screen projection layout mode is the sequential priority mode. There is a dividing line 601 between the main display area and the historical display area in the display area of ​​the shared device. In response to the user's long press operation on the dividing line 601, the sharing device displays the screen projection layout icon 602. Among them, the screen projection layout icon 602 includes a full-screen mode control and a smart split-screen mode control. When the user clicks the full-screen mode control, the screen projection layout mode of the shared device is switched from the sequential priority mode to the full-screen mode; when the user clicks the smart split-screen control, the screen projection layout mode of the shared device is switched from the sequential priority mode to the smart split-screen mode. Among them, the full-screen mode is more suitable for scenes with only one screen projection window. Similarly, if the current screen projection layout mode of the shared device is the smart split-screen mode, the shared device can respond to the user's long press operation on the dividing line between any two screen projection windows, and display the screen projection layout icon for the user to choose to switch to the new screen projection layout mode.

[0285] After the screen projection window is displayed on the shared device, in order to further meet the actual needs of users, interaction can also be achieved on the shared device. The specific interaction methods include the following scenarios.

[0286] Scenario 1: File sharing.

[0287] For example, the user can share files between multiple projection devices by operating on the screen of the shared device. Figure 7 , a method for file sharing is specifically introduced. The method can be applicable to a system including a sharing device, a screen projection device A and a screen projection device B, wherein the screen projection device B is a target device.

[0288] S701, the shared device determines the target file.

[0289] S702: The sharing device determines a target device.

[0290] It should be noted that the sharing device determines the target file and the target device in response to the user's operation. The user's operation on the sharing device can realize file sharing of different projection devices. The files included in the projection window can be used as candidates for the target file. For example, the projection windows of projection device A and projection device B are displayed on the sharing device. The files displayed in the projection window of projection device A and the files displayed in the projection window of projection device B can be used as candidates for the target file.

[0291] In one implementation, before the shared device determines the target file, the user needs to complete the screen projection operation on the screen of the projection device to display the projection window on the screen of the shared device. Furthermore, if the target file is not displayed on the projection window, the user can call the target file by operating on the projection device so that the target file can be displayed in the projection window.

[0292] For example, the main interface of the mobile terminal is displayed on the screen projection window, and the target file is a picture in the gallery of the mobile terminal. At this time, the user needs to open the gallery in the mobile terminal and call the picture so that the picture is displayed in the screen projection window.

[0293] In one implementation, the user triggers the sharing device to determine the target file and the operation of the target device may be continuous.

[0294] Exemplarily, multiple projection windows are displayed on the screen of the sharing device, and accordingly, multiple files (for example, file A and file B) are displayed in the multiple projection windows. In response to the user clicking on file A, the sharing device drags file A to the projection window corresponding to projection device B and releases it. The sharing device determines that the target file is file A and the target device is projection device B.

[0295] Exemplarily, the sharing device determines the target screen projection device in the following two ways, but is not limited to.

[0296] 1. Determine the target device based on the release location.

[0297] Exemplarily, on the shared device screen, there are displayed the projection window of projection device A and the projection window of projection device B. The user clicks on the file in the projection window of projection device A, drags the target file into the projection window of projection device B and releases it. The file in the projection window of projection device A is the target file, and projection device B is the target device.

[0298] 2. Determine the target device based on user selection.

[0299] Exemplarily, after the user long presses the target file and drags the target file in a certain direction for a certain distance, a thumbnail icon of the device to be selected can be displayed, and the user can select the target device from the thumbnail icons of the device to be selected. Among them, the thumbnail icon of the device to be selected can display icons of other projection devices in addition to the projection device corresponding to the target file, and can also display icons of other projection devices pointed to according to the dragging direction of the target file. The thumbnail icon of the device to be selected can be a thumbnail of the projection window, or it can be an icon that identifies the type of projection device (for example, the thumbnail of a mobile phone terminal is a mobile phone graphic). This application does not limit the specific form of the thumbnail icon of the device to be selected.

[0300] For ease of understanding, Figure 8 FIG. 1 shows a method of determining a target device according to a user selection.

[0301] like Figure 8 (a) in the figure shows the screen of the shared device. The shared device is connected to the projection device A, the projection device B and the projection device C. In response to the user clicking on the projection window of projection device A (or the target file in the window), dragging a certain distance to the upper right (not directly dragging to the projection window of projection device B), the thumbnail icon of the device to be selected is displayed. Among them, the thumbnail icons of the devices to be selected include icon 801 of projection device B and icon 802 of projection device C. When the user clicks on icon 801, the target device is determined to be projection device B; when the user clicks on icon 802, the target device is determined to be projection device C.

[0302] like Figure 8 (b) in the figure shows the screen of the shared device. The shared device is connected to the projection device A, the projection device B and the projection device C. In response to the user clicking on the projection window of projection device A (or the target file in the projection window), dragging a certain distance to the upper right (not directly dragging to the projection window of projection device B), the thumbnail icon of the device to be selected in the upper right is displayed. Among them, the thumbnail icon of the device to be selected in the upper right is the icon 801 of projection device B. Of course, if the user clicks on the projection window of projection device A (or the target file in the window), dragging a certain distance to the upper left (not directly dragging to the projection window of projection device C), the thumbnail icon of the device to be selected displayed will be the icon of projection device C.

[0303] After the shared device determines the target device, the target file can be transferred between different projection devices. The following takes the target file as the file in the projection window of projection device A and the target device as projection device B as an example to introduce the target file transfer process.

[0304] S703, the sharing device sends a file transfer request, and accordingly, the screen projection device A receives the file transfer request.

[0305] S704, the screen projection device A determines the target file according to the file transfer request and downloads the target file.

[0306] S705, the projection device A sends the file sharing service parameters, and correspondingly, the sharing device receives the file sharing service parameters.

[0307] That is to say, the projection device A determines the target file based on the file transfer request received from the sharing device, starts the target file download service, and completes the download of the target file.

[0308] Exemplarily, the file sharing service parameters include the Internet protocol (IP) address of the projection device A, the authentication key, the transmission method, etc.

[0309] It should be noted that the specific transmission methods of the target file may include the following two methods.

[0310] Method 1: Screen projection device A and screen projection device B directly transfer the target file.

[0311] S706, the sharing device sends the file sharing service parameters, and accordingly, the projection device B receives the file sharing service parameters.

[0312] S707, the screen projection device B determines the data channel according to the file sharing service parameters.

[0313] S708, the screen projection device A sends the target file, and correspondingly, the screen projection device B receives the target file.

[0314] That is to say, in method one, projection device B determines a data channel so that projection device A can send the target file to projection device B through the data channel.

[0315] In one implementation, when projection device B receives the target file, the target file can be displayed on the projection window of projection device B; or an icon of the target file can be displayed to indicate that projection device B has received the target file.

[0316] Method 2: The shared device is used as a transfer device to forward the target file.

[0317] S709: The sharing device generates file sharing parameters according to the file sharing service parameters.

[0318] S710, the sharing device sends file sharing parameters, and accordingly, the projection device B receives the file sharing parameters.

[0319] S711, the projection device B sends a file download request, and correspondingly, the sharing device receives the file download request.

[0320] S712, the sharing device sends a file download request, and accordingly, the screen projection device A receives the file download request.

[0321] S713, the projection device A sends the target file, and correspondingly, the sharing device receives the target file.

[0322] S714, the sharing device sends the target file, and accordingly, the projection device B receives the target file.

[0323] That is to say, in method 2, projection device A can transfer the target file to projection device B through the shared device.

[0324] It should be noted that when projection device A and projection device B are not in the same local area network, method 2 can be used to transfer the target file.

[0325] Scene 2: Moving the projection window.

[0326] Users can move the projection window on the shared device screen by operating on the shared device screen to flexibly adjust the position of the projection window.

[0327] Exemplarily, the projection layout mode of the shared device is the smart split-screen mode. When the left-right layout is adopted, each projection window is arranged horizontally along the width direction of the shared device screen, and the change of the projection window position will not affect the size of the projection window. When the top-bottom layout is adopted, if the position of the projection window in the upper split-screen display area is swapped with the projection window in the lower split-screen display area, it may affect the change of the projection window size.

[0328] For ease of understanding, Fig. 9 As shown, a schematic diagram of moving a projection window is shown.

[0329] like Fig. 9 (a) in the figure shows the screen of the shared device. The shared device is connected to the projection device A, the projection device B and the projection device C. In response to the user clicking on the projection window of the projection device B and dragging it to the area where the projection window of the projection device C is located and releasing it, the projection window of the projection device B and the projection window of the projection device C are swapped, as shown in FIG. Fig. 9 As shown in (b) in .

[0330] It should be noted that Fig. 9 The shared device shown in (a) is the projection window displayed according to the projection layout determined by the smart split screen mode described above. In other words, Fig. 9 The shared device shown in (a) maximizes the use of the display area.

[0331] For example, Fig. 9The screen resolution of the projection device A shown in (a) is 2800*1800, the screen resolution of the projection device B is 2532*1170, the screen resolution of the projection device C is 2800*1800, and the screen resolution of the shared device is 3840*2160. Figure 5 According to the description of (c) in FIG. 1 , the width of the projection window of projection device A is 1680, the width of the projection window of projection device B is 2337, and the width of the projection window of projection device C is 1680. When the positions of the projection windows of projection device B and projection device C are swapped, the projection windows of projection device A and projection device B are swapped as follows: Fig. 9 Arrange side by side as shown in (b) in the figure. If the size of the projection window remains unchanged, the sum of the widths of the projection window of projection device A and the projection window of projection device B (1680+2337=4017) is greater than the width of the shared device screen (3840). At this time, in order to fully display the projection window, the size of each projection window needs to be recalculated. Since the projection window of projection device A and the projection window of projection device B are displayed in the upper split-screen display area 901, it is necessary to redetermine the size of the projection window of projection device A and the projection window of projection device B according to the width of the upper split-screen display area 901. The specific calculation method can refer to the calculation process of the left and right distribution in the smart split-screen mode above, which will not be repeated here. In general, after the positions of the projection windows are swapped, the widths of the projection windows of projection device A and the projection windows of projection device B are reduced, so the height will also be reduced proportionally, and there are two upper and lower shadow areas in the upper split-screen display area (for example, as Fig. 9 The shaded area shown in (b)).

[0332] Scene 3: Floating projection window.

[0333] Users can display the projection window as a floating window by operating on the shared device screen. At the same time, the position of the floating window can be flexibly moved.

[0334] For ease of understanding, Fig.10 As shown, a schematic diagram of a screen projection window displayed in a floating window manner is shown.

[0335] like Fig.10 (a) in the figure shows a shared device. The shared device is connected to the projection device A, the projection device B and the projection device C. In response to the user clicking on the projection window of the projection device B and dragging it to the preset area 1001 in the upper left corner of the screen of the shared device and then releasing it, the projection window of the projection device B is displayed in the upper left corner of the screen of the shared device in the form of a floating window, as shown in FIG. Fig.10 The projection layout of the projection window of projection device A and the projection window of projection device C can be recalculated according to the above method, for example, Fig.10 As shown in (b), the projection window of projection device A and the projection window of projection device C are arranged in a left-right distribution manner in the smart split-screen mode.

[0336] It should be noted that the user can drag the floating window to any position on the shared device screen.

[0337] like Fig.11 As shown, a display method provided by an embodiment of the present application is shown, and the method can be applied to a communication system, wherein the system includes a sharing device and at least two projection devices. The method is described in detail below.

[0338] S1101, obtaining screen projection data of at least two screen projection devices.

[0339] It should be noted that the shared device is connected to at least two projection devices, and the shared device receives projection data from at least two projection devices. Exemplarily, the shared device can be an electronic device such as a smart screen or an electronic whiteboard. The projection device can be a personal device such as a mobile phone terminal, a personal computer or a tablet computer.

[0340] The embodiment of the present application does not limit the manner in which the shared device and the screen projection device establish a screen projection connection. For example, the shared device and the screen projection device are connected to the same local area network, and screen mirroring is achieved through system-level distributed soft bus technology, so that the screen projection window is mirrored and displayed on the screen of the shared device in real time, thereby achieving a screen projection connection between the shared device and the screen projection device. For another example, the screen projection device can send the screen projection data to the shared device through an application that supports the screen projection function (for example, a video playback application, a conference application, etc.), and the screen projection data is transferred through a cloud server. The screen projection device displays the screen projection window on the screen of the shared device.

[0341] Exemplarily, the screen projection data includes screen data and / or application data. The screen data may be screen data such as screen size, screen resolution, and screen aspect ratio. The application data may be data of an application that the screen projection device can support the screen projection function.

[0342] S1102, determining at least two display areas according to the screen projection data of at least two devices and the screen projection layout mode.

[0343] It can be understood that when the projection device projects the entire screen, at least two display areas can be determined based on the screen data; when the projection device projects the window of a certain application, at least two display areas can be determined based on the data of the application.

[0344] It should be noted that the screen projection layout mode includes one of the following: smart split-screen mode and sequential priority mode. Configuring different screen projection layout modes on the shared device can meet the user's screen projection needs at different stages. When the shared device receives new screen projection data, or the received screen projection data increases, or the resolution of the screen projection window corresponding to the screen projection device that has established a screen projection connection with the shared device changes, the shared device can first determine the screen projection layout mode, and determine at least two display areas according to the latest determined screen projection layout mode.

[0345] In one implementation, when the screen projection layout mode is a sequential priority mode, the sharing device determines at least two display areas based on the projection data of at least two projection devices and the sequential priority mode, and the at least two display areas include a first display area and a second display area; in response to the projection connection of the first projection device, the first display area displays the first projection window; in response to the projection connection of the second projection window, the first display area displays the second projection window, and the second display area displays the first projection window.

[0346] It is understandable that when the projection layout mode is the order priority mode, the time priority can be considered. That is, the projection device that is most recently connected to the shared device for projection has the highest time priority, and the projection window corresponding to the projection device with the highest time priority is displayed in the first display area.

[0347] Exemplarily, the first screen projection device is connected to the shared device for screen projection at time A, and the second screen projection device is connected to the shared device for screen projection at time B. Time A is earlier than time B. At this time, the second screen projection device can be regarded as the most recent screen projection device connected to the shared device for screen projection. The second screen projection device has the highest time priority. Therefore, the second screen projection window can be displayed in the first display area. Before that, the first screen projection window corresponding to the first screen projection device connected to the shared device for screen projection can be displayed in the second display area.

[0348] Based on the above solution, users can display the projection windows in a sequential priority layout in a conference scenario, focusing on displaying the projection windows with high priority, which is more suitable for scenarios where users want to focus on introducing a certain solution in a meeting.

[0349] Furthermore, in response to the user dragging the first projection window to the first display area, the first projection window is displayed in the first display area, and the second projection window is displayed in the second display area; or in response to the user dragging the second projection window to the second display area, the first projection window is displayed in the first display area, and the second projection window is displayed in the second display area.

[0350] That is to say, the user can move the projection window on the screen of the shared device and select the projection window to be displayed in the first display area according to actual needs, so that participants can focus on displaying the solution in a certain projection window.

[0351] In another implementation, when the screen projection layout mode is a sequential priority mode, at least two display areas are determined according to the projection data of at least two projection devices and the projection layout mode, including: at least two display areas are determined according to the projection data of at least two projection devices and the sequential priority mode, the at least two display areas including a first display area and a second display area; in response to the projection connection of the first projection device, the first display area displays a first projection window; in response to the projection connection of the second projection device, the first display area displays a first projection window, and the second display area displays a second projection window.

[0352] It can be seen that even if the second screen projection device is the most recent device connected to the shared device for screen projection and has the highest time priority, its corresponding second screen projection window is displayed in the second display area.

[0353] In this implementation, when the projection window (first projection window) in the first display area is being displayed, the projection window corresponding to the projection device newly connected to the shared device will also be displayed in the second display area as a candidate. Among them, the first projection window is being displayed, which can be understood as in a meeting scenario, user A is presenting a solution through the first projection window. At this time, when the shared device is connected to a new projection device, the first display area still maintains the first projection window to avoid affecting the current user A's solution presentation process.

[0354] Further, in response to the user dragging the second projection window to the first display area, the second projection window is displayed in the first display area, and the first projection window is displayed in the second display area; or in response to the user dragging the first projection window to the second display area, the second projection window is displayed in the first display area, and the first projection window is displayed in the second display area.

[0355] It is understandable that the second projection device is the latest projection device connected to the shared device in terms of timing. Before the user performs certain operations to display the second projection window in the first display area, it can be considered that the projection window (first projection window) currently displayed in the first display area has not been completed. For example, in a meeting scenario, the user is presenting a solution through the first projection window.

[0356] Based on the above scheme, the projection window corresponding to the projection device that is most recently connected to the shared device will be displayed in the second display area. When the projection window in the first display area (first projection window) is displayed, the projection window can be moved by the user's operation to move the projection window. The projection window in the second display area (second projection window) can be moved to the first display area.

[0357] For example, the order priority mode can be as follows Figure 5 As shown in (a) in the figure. The first display area can be understood as the main display area, and the second display area can be understood as the history display area. Among them, the main display area 502 occupies most of the shared device display area, and the history display area 501 occupies a small part of the shared device display area. The main display area can display the current projection window (first projection window), and the history display area can display the history projection window (second projection window).

[0358] For a detailed introduction to the sequential priority mode, see the above Figure 5 The description of (a) in FIG. 2 is not repeated here.

[0359] In another implementation, when the projection layout mode is a smart split-screen mode, the shared device determines at least two display areas based on the projection data of at least two projection devices and the display layout method, wherein the smart split-screen mode includes a display layout method, and the display layout method includes a left-right layout method and an up-down layout method.

[0360] It should be noted that the left-right layout can be understood as the width direction of at least two display areas being arranged along the width direction of the shared device screen; the top-bottom layout can be understood as the height direction of at least two areas being arranged along the height direction of the shared device screen.

[0361] In this case, before the sharing device determines at least two display areas according to at least two projection devices and the display layout, the sharing device first determines the display layout.

[0362] Specifically, the sharing device determines the projection screen height according to the screen data of at least two projection screen devices and the screen data of the sharing device, wherein the screen data includes the screen pixel height and the screen pixel width, and further determines the display layout mode according to the projection screen height.

[0363] The calculation method of projection screen height can refer to the above Figure 5 The description is not repeated here.

[0364] In one case, when the projection screen height is greater than half of the screen pixel height of the shared device, the display layout is determined to be a left-right layout.

[0365] For example, Figure 5 (b) in the figure shows a schematic diagram of a left-right layout. When at least two display areas are arranged in a left-right layout, the heights of at least two display areas are the same. In this case, the height of the display area is the projection screen height.

[0366] In another case, when the projection screen height is less than or equal to half of the screen pixel height of the shared device, the display layout mode is determined as the top-bottom layout mode.

[0367] For example, Figure 5 (c) in FIG. 1 is a schematic diagram of a top-bottom layout. The display area includes a first split-screen display area and a second split-screen display area. The height of the split-screen display area can be set to half the pixel height of the shared device by default. The first split-screen display area can be as follows: Figure 5 The upper split screen display area 504 shown in (c) of FIG. 1 and the second split screen display area may be as follows: Figure 5 The lower split screen display area 505 shown in (c) in FIG. It can be preset that at most two projection windows can be displayed in each split screen display area.

[0368] S1103, display at least two projection windows in at least two display areas.

[0369] It should be noted that at least two projection windows correspond to at least two projection devices. For example, the first projection window corresponds to the first projection device, the second projection window corresponds to the second projection device, the third projection window corresponds to the third projection device, and the fourth projection window corresponds to the fourth projection device. It is understandable that the specific content displayed in the projection window is the same as the content displayed on the projection device screen. For example, when the screen of the projection device is displayed as the main interface of the device, the projection window corresponding to the projection device on the shared device will also display the main interface of the device.

[0370] It should be noted that when the display layout is a left-right layout, before displaying at least two projection windows in at least two display areas, the sizes of the at least two projection windows need to be determined.

[0371] Exemplarily, the sharing device determines the size of at least two projection windows according to the screen data of at least two projection devices, the screen pixel width of the sharing device, and the projection height. In this case, the size of the display area is the same as the size of the projection window.

[0372] When the left and right distribution mode is used, the process of determining the size of each projection window can be found in the above description. Figure 5 The description of (b) in FIG. 1 is not repeated here.

[0373] It should be noted that when the display layout is a top-down layout, before displaying at least two projection windows in at least two display areas, the sizes of the at least two projection windows need to be determined.

[0374] Specifically, the sizes of at least two projection windows can be determined based on the screen data of at least two projection devices, the screen pixel width of the shared device, and the height of the split-screen display area.

[0375] In the up-down distribution mode, the process of determining the size of each projection window can be found in the above description. Figure 5 The description of (c) in FIG. 1 is not repeated here.

[0376] It should be noted that if Figure 5 As shown in (c) in the figure, when the screen is distributed up and down, the size of the projection window is not necessarily the same as the size of the display area. Generally speaking, the size of the projection window is less than or equal to the size of the display area.

[0377] It can be seen that when the screen is distributed left and right, the width of the projection window is determined according to the projection height, and the height of the projection window is the projection height, so the size of the projection window can be determined. When the screen is distributed up and down, the width of the projection window is determined according to the height of the split-screen display area (half the screen pixel height of the shared device), and the height of the projection window is half the screen pixel height of the shared device, so the size of the projection window can be determined.

[0378] In one implementation, when a sharing device displays at least two projection windows in at least two display areas in a sequential priority mode, the sharing device displays at least one mode control in response to a first operation of the user, wherein the at least one mode control includes a smart split-screen mode control and / or a full-screen mode control.

[0379] Exemplarily, in response to a user's operation on a smart split-screen mode control, the shared device switches the screen projection layout mode from the sequential priority mode to the smart split-screen mode; or, in response to a user's operation on a full-screen mode control, the shared device switches the screen projection layout mode from the sequential priority mode to the full-screen mode.

[0380] For example, sharing a device with Figure 6 The sequential priority mode shown has at least two projection areas, and the at least two projection display areas include a main display area and a history display area. There is a dividing line 601 between the main display area and the history display area. In response to the user's operation on the dividing line 601 (first operation), the shared device displays a projection layout icon 602. The projection layout icon 602 includes a full-screen mode control and a smart split-screen mode control. The shared device switches the projection layout mode in response to the user's operation on different controls. This enables the shared device projection layout mode to be flexibly adapted to the user's current needs.

[0381] It should be noted that when the projection window is displayed on the shared device, the user's interaction requirements can also be met.

[0382] Exemplarily, files are shared among multiple projection devices through user operations on a shared device.

[0383] In one implementation, the shared device displays a third projection window and a fourth projection window, the third projection window corresponds to the third projection device, and the fourth projection window corresponds to the fourth projection device; in response to the user's operation in the third projection window, the controls of the fourth projection device are displayed; in response to the user's operation on the controls of the fourth projection device, the fourth projection device is determined to be the target device, and the content displayed in the third projection window is the target file.

[0384] In one implementation, in response to the user dragging the target file from the third projection window to the fourth projection window, the sharing device displays the target file in the fourth projection window.

[0385] For example, Figure 8 As shown in (a) in the figure, the third projection device may be projection device A, and the fourth projection device may be projection device B. The user's operation in the third projection window may be that the user clicks on the projection window of projection device A and drags to the upper right to display the control of projection device B (for example, icon 801). When the user clicks icon 801, it indicates that the target device is selected as projection device B. The content displayed in the projection window of projection device A is the target file. For details, please refer to the above description of the projection window. Figure 8 The description is not repeated here.

[0386] Exemplarily, through the user's operation on the shared device, the projection window on the shared device can be moved.

[0387] In one implementation, in response to the user dragging the third projection window to the location of the fourth projection window, the third projection window and the fourth projection window are swapped; or in response to the user dragging the fourth projection window to the location of the third projection window, the third projection window and the fourth projection window are swapped.

[0388] For example, Fig. 9 As shown in (a), in response to the user clicking on the projection window of projection device B and dragging it to the area where the projection window of projection device C is located and releasing it, the projection window of projection device B and the projection window of projection device C are swapped.

[0389] It should be noted that when the position of the projection window changes, the size of the projection window may also change. For details, please refer to the above Fig. 9The description of (b) in FIG. 1 is not repeated here.

[0390] Exemplarily, through the user's operation on the shared device, the projection window on the shared device can be displayed as a floating window.

[0391] In one implementation, in response to the third projection window being dragged to a preset area, the sharing device displays the third projection window in the preset area as a floating window.

[0392] For example, Fig.10 As shown in (a), in response to the user clicking on the projection window of projection device B and dragging it to the preset area 1001 in the upper left corner of the sharing device and then releasing it, the projection window of projection device B is displayed in the upper left corner of the sharing device screen in the form of a floating window.

[0393] It should be noted that when the projection window is changed to a floating window display, the projection layout of other projection windows needs to be recalculated according to the above method.

[0394] The present application provides a display method, electronic device, and system. When a shared device establishes a screen projection connection with multiple screen projection devices, multiple screen projection windows can be fully displayed on the screen of the shared device according to the actual needs of the user at the moment. In addition, the user can realize multiple interactions on the shared device to improve the user experience.

[0395] The embodiment of the present application provides a computer program product, which, when executed on a device, enables the device to execute the technical solution in the above embodiment. Its implementation principle and technical effect are similar to those of the above method-related embodiments, and will not be described in detail here.

[0396] The embodiment of the present application provides a readable storage medium, which contains instructions. When the instructions are executed on a device, the device executes the technical solution of the above embodiment. The implementation principle and technical effect are similar and will not be repeated here.

[0397] The embodiment of the present application provides a chip, which is used to execute instructions. When the chip is running, the technical solution in the above embodiment is executed. The implementation principle and technical effect are similar and will not be repeated here.

[0398] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the embodiments of the present application.

[0399] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices and units (modules) can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0400] In the several embodiments provided in the present application, it should be understood that the disclosed devices, apparatuses and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the unit is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0401] The units described above as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0402] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0403] If the above functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

[0404] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A display method, characterized in that: The method is applied to a shared device, wherein the shared device is connected to at least two screen projection devices for screen projection, and includes: Acquire projection data of the at least two projection devices, where the projection data includes screen data and / or application data; At least two display areas are determined according to the projection data of the at least two projection devices and the projection layout mode, wherein the projection layout mode includes one of the following: Smart split-screen mode, sequential priority mode; At least two screen projection windows are displayed in the at least two display areas, and the at least two screen projection windows correspond to the at least two screen projection devices.

2. The method according to claim 1, characterized in that When the screen projection layout mode is the smart split screen mode, determining at least two display areas according to the screen projection data of the at least two screen projection devices and the screen projection layout mode includes: At least two display areas are determined based on the projection data of the at least two projection devices and the display layout method, wherein the smart split screen mode includes the display layout method, and the display layout method includes a left-right layout method and an up-down layout method.

3. The method according to claim 2, characterized in that Before determining at least two display areas according to the projection data and display layout of the at least two projection devices, the method further includes: Determine the projection screen height according to the screen data of the at least two projection devices and the screen data of the shared device, wherein the screen data includes a screen pixel height and a screen pixel width; The display layout mode is determined according to the projection screen height.

4. The method according to claim 3, characterized in that The determining the display layout mode according to the projection screen height includes: According to the projection screen height being greater than half of the screen pixel height of the shared device, the display layout mode is determined to be the left-right layout mode.

5. The method according to claim 4, characterized in that Before displaying at least two projection windows in the at least two display areas, the method further includes: Determine the sizes of the at least two screen projection windows according to the screen data of the at least two screen projection devices, the screen pixel width of the shared device, and the screen projection height; The size of the at least two display areas is the same as the size of the at least two projection windows.

6. The method according to claim 3, characterized in that The determining the display layout mode according to the projection screen height includes: According to the projection screen height being less than or equal to half of the screen pixel height of the shared device, the display layout mode is determined to be the top-bottom layout mode.

7. The method according to claim 6, characterized in that When the display layout is in the up-and-down layout mode, the at least two display areas include a first split-screen display area and a second split-screen display area, and the height of the split-screen display area is half of the pixel height of the shared device; Before displaying at least two projection windows in the at least two display areas, the method further includes: The sizes of the at least two projection windows are determined according to the screen data of the at least two projection devices, the screen pixel width of the shared device, and the height of the split-screen display area.

8. The method according to claim 1, characterized in that When the screen projection layout mode is the order priority mode, determining at least two display areas according to the screen projection data of the at least two screen projection devices and the screen projection layout mode includes: Determine the at least two display areas according to the projection data of the at least two projection devices and the sequence priority mode, wherein the at least two display areas include a first display area and a second display area; In response to the screen projection connection of the first screen projection device, the first display area displays a first screen projection window; In response to the screen projection connection of the second screen projection device, the first display area displays the second screen projection window, and the second display area displays the first screen projection window.

9. The method according to claim 8, characterized in that The method further comprises: In response to the user dragging the first projection window to the first display area, the first projection window is displayed in the first display area, and the second projection window is displayed in the second display area; or In response to the user dragging the second projection window to the second display area, the first projection window is displayed in the first display area, and the second projection window is displayed in the second display area.

10. The method according to claim 1, characterized in that When the screen projection layout mode is the order priority mode, determining at least two display areas according to the screen projection data of the at least two screen projection devices and the screen projection layout mode includes: Determine the at least two display areas according to the projection data of the at least two projection devices and the sequence priority mode, wherein the at least two display areas include a first display area and a second display area; In response to the screen projection connection of the first screen projection device, the first display area displays a first screen projection window; In response to the screen projection connection of the second screen projection device, the first display area displays the first screen projection window, and the second display area displays the second screen projection window.

11. The method according to claim 10, characterized in that The method further comprises: In response to the user dragging the second projection window to the first display area, the second projection window is displayed in the first display area, and the first projection window is displayed in the second display area; or In response to the user dragging the first projection window to the second display area, the second projection window is displayed in the first display area, and the first projection window is displayed in the second display area.

12. The method according to any one of claims 1 to 11, characterized in that The method further comprises: When the sharing device displays at least two projection windows in the at least two display areas in the sequential priority mode, the sharing device displays at least one mode control in response to a first operation of the user, wherein the at least one mode control includes a smart split-screen mode control and / or a full-screen mode control; In response to a user's operation on the smart split-screen mode control, the projection layout mode is switched from the sequential priority mode to the smart split-screen mode; or In response to a user's operation on the full-screen mode control, the projection layout mode is switched from the sequential priority mode to the full-screen mode.

13. The method according to any one of claims 1 to 12, characterized in that The method further comprises: The shared device displays a third screen projection window and a fourth screen projection window, the third screen projection window corresponds to the third screen projection device, and the fourth screen projection window corresponds to the fourth screen projection device; In response to a user operation in the third screen projection window, displaying a control of the fourth screen projection device; In response to the user's operation on the control of the fourth screen projection device, the fourth screen projection device is determined to be the target device, and the content displayed in the third screen projection window is the target file.

14. The method according to claim 13, characterized in that The method further comprises: In response to the user dragging the target file from the third projection window to the fourth projection window, the target file is displayed in the fourth projection window.

15. The method according to claim 13 or 14, characterized in that The method further comprises: In response to the user dragging the third projection window to the location of the fourth projection window, the third projection window and the fourth projection window are swapped; or In response to the user dragging the fourth projection window to the location of the third projection window, the positions of the third projection window and the fourth projection window are swapped.

16. The method according to any one of claims 13 to 15, characterized in that The method further comprises: In response to the user dragging the third projection window to the preset area, the third projection window is displayed in the preset area as a floating window.

17. An electronic device, characterized in that: include: one or more processors; one or more memories; display screen; the one or more memories store one or more computer programs, the one or more computer programs include instructions, when the instructions are executed by the one or more processors, the electronic device executes the method described in any one of claims 1 to 16.

18. A display system, characterized in that: The system comprises a sharing device as described in any one of claims 1 to 16 and at least two screen projection devices.

19. A display device, characterized in that: include: A processor coupled to a memory, wherein the memory is used to store a computer program, and the processor is used to run the computer program so that the display device performs the method according to any one of claims 1 to 16.

20. The display device according to claim 19, characterized in that Also included is one or more of the memory and the transceiver, wherein the transceiver is used to receive signals and / or send signals.

21. A computer-readable storage medium, characterized in that: A computer program is stored thereon, and when the computer program is executed by a computer, the computer is caused to implement the method according to any one of claims 1 to 16.

22. A computer program product comprising instructions, characterized in that When the computer program product is run on a computer, the computer is caused to perform the method according to any one of claims 1 to 16.

23. A chip, characterized in that: The chip includes a processor and a data interface, and the processor reads instructions stored in a memory through the data interface to execute the method according to any one of claims 1 to 16.

Images