Display method, electronic device and system

Abstract

Provided in the present application are a display method, an electronic device and a system. The method is applied to a shared device, which is connected to at least two casting devices so as to receive cast screens, the method comprising: acquiring cast data of the at least two casting devices; according to the cast data of the at least two casting devices and a casting layout mode, determining at least two display areas, the casting layout mode comprising one of the following: a smart split screen mode and a sequence priority mode; and displaying within the at least two display areas at least two casting windows. When the shared device is connected to the multiple casting devices so as to receive cast screens, on the basis of a certain casting layout mode and the cast data of the casting devices, the display method, the electronic device and the system of the present application can determine the display areas corresponding to the casting devices and finally display within the display areas the corresponding casting windows, such that the casting windows can use the display areas of the shared device to the greatest extent, thus flexibly satisfying various user requirements.

Description

Display method, electronic device, and system

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of China on August 4, 2023, with application number 202310977940.5 and invention name “Display Method, Electronic Device and System”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The embodiments of the present application relate to the field of electronic devices, and in particular to a display method, electronic device, and system. Background Art

[0003] With the development of electronic technology and mobile internet, users can now process tasks through electronic devices such as mobile phones, smart screens, and personal computers. To facilitate user tasks, the interfaces of other electronic devices can be displayed on the screen of one electronic device, allowing users to simultaneously access information displayed by multiple electronic devices through a single screen.

[0004] Therefore, how to fully display the interfaces of multiple electronic devices on one screen and adapt to the needs of users in actually processing tasks is a problem that needs to be solved urgently.

[0005] Summary of the Invention

[0006] The present application provides a display method, electronic device, and system, which can fully display the interfaces of multiple electronic devices on one screen as much as possible and flexibly adapt to the actual needs of current users.

[0007] In a first aspect, a display method is provided, characterized in that the method is applied to a shared device, which is connected to at least two projection devices for projection, including: obtaining projection data of the at least two projection devices, the projection data including screen data and / or application data; determining at least two display areas based on the projection data of the at least two projection devices and a projection layout mode, the projection layout mode including one of the following: smart split screen mode, sequential priority mode; displaying at least two projection windows in the at least two display areas, the at least two projection windows corresponding to the at least two projection devices.

[0008] It can be understood that the sequence priority mode can be understood as a projection layout method that prioritizes the display of a certain projection window according to the projection order or the actual needs of the user's current scene. The smart split-screen mode can be understood as a projection layout method that allows multiple projection windows to occupy a larger display area. The sequence priority mode and the smart split-screen mode can be applied to different scenarios respectively. For example, when it is necessary to highlight a certain projection window through the screen of a shared device, the sequence priority mode can be used; when it is necessary to compare the contents of multiple projection windows, the smart split-screen mode can be used.

[0009] It should be noted that the correspondence between the projection window and the projection device can be understood as follows: the specific content displayed in the projection window is the same as the content displayed on the projection device screen. For example, when the screen of the projection device is displayed as the main interface of the device, the projection window corresponding to the projection device on the shared device will also display the main interface of the device.

[0010] It should be noted that this application does not limit the screen projection connection method between the shared device and the projection device. For example, the shared device and the projection device are connected to the same local area network, and screen mirroring is achieved through system-level distributed soft bus technology, so that the projection window is mirrored and displayed on the screen of the shared device in real time, thus realizing the projection connection between the shared device and the projection device.

[0011] For example, the shared device can be an electronic device such as a smart screen or an electronic whiteboard. The screen projection device can be a personal device such as a mobile phone terminal, a personal computer, or a tablet computer.

[0012] It can be understood that when the projection device projects the entire screen, at least two display areas can be determined based on the screen data; when the projection device projects the window of a certain application, at least two display areas can be determined based on the data of the application.

[0013] It should be noted that when the sharing device receives new projection data, or the received projection data increases, or the resolution of the projection window that has established a projection connection with the sharing device changes, the sharing device can determine the projection layout mode.

[0014] Based on the above solution, when a shared device is connected to multiple projection devices, the display area corresponding to the projection device can be determined based on a specific projection layout mode and combined with the projection data of the projection device, and the corresponding projection window can be displayed in the display area. This allows the projection window to maximize the display area of ​​the shared device and flexibly meet the specific needs of users.

[0015] In combination with the first aspect, in certain implementations of the first aspect, when the projection layout mode is the smart split-screen mode, determining at least two display areas based on the projection data of the at least two projection devices and the projection layout mode includes: determining at least two display areas based on the projection data of the at least two projection devices and the display layout method, wherein the smart split-screen mode includes the display layout method, and the display layout method includes a left-right layout method and an up-down layout method.

[0016] It should be noted that the left-right layout can be understood as the width direction of at least two display areas being arranged along the width direction of the shared device screen; the top-bottom layout can be understood as the height direction of at least two areas being arranged along the height direction of the shared device screen.

[0017] Based on the above solution, the smart split-screen mode can further include display layout modes such as left-right layout mode and top-bottom layout mode. When the projection layout mode of the shared device is the smart split-screen mode, it is necessary to further determine at least two display areas based on the specific display layout mode.

[0018] In combination with the first aspect, in certain implementations of the first aspect, before determining at least two display areas based on the projection data and display layout method of the at least two projection devices, the method also includes: determining the projection height based on the screen data of the at least two projection devices and the screen data of the shared device, wherein the screen data includes screen pixel height and screen pixel width; and determining the display layout method based on the projection height.

[0019] Based on the above solution, when the shared device is in smart split-screen mode, it is necessary to first determine the display layout method. Specifically, the display layout method can be determined based on the screen data of the projection device and the screen data of the shared device.

[0020] In combination with the first aspect, in certain implementations of the first aspect, the display layout mode is determined according to the projection screen height, including: based on the projection screen height being greater than half of the screen pixel height of the shared device, determining that the display layout mode is the left-right layout mode.

[0021] It should be noted that in Smart Split Screen mode, the aspect ratio of each projection window is consistent with the aspect ratio of the projection device, and left-right layout can be prioritized. Therefore, calculations can be prioritized based on left-right layout. When each projection window is arranged left and right, the height of each projection window is consistent, and the height of each projection window can be understood as the projection height.

[0022] Based on the above solution, when the projection screen height is greater than half the pixel height of the shared device's screen, the display layout can be determined to be a left-right layout. The projection windows are then arranged in a certain order and displayed on the shared device's screen.

[0023] In combination with the first aspect, in certain implementations of the first aspect, before displaying at least two projection windows in the at least two display areas, the method also includes: determining the size of the at least two projection windows based on the screen data of the at least two projection devices, the screen pixel width of the shared device, and the projection height, and the size of the at least two display areas is the same as the size of the at least two projection windows.

[0024] Based on the above solution, when the display layout is a left-right layout, the sum of the widths of the individual projection windows is less than or equal to the pixel width of the shared device. Based on this, the size of the projection windows can be further determined so that when the projection windows are displayed in a left-right sequence, they can maximize the use of the shared device's display area.

[0025] In combination with the first aspect, in certain implementations of the first aspect, the display layout method is determined according to the projection screen height, including: based on the projection screen height being less than or equal to half of the screen pixel height of the shared device, determining that the display layout method is the top-down layout method.

[0026] Based on the above solution, if the projection height is less than or equal to half the pixel height of the shared device's screen, even if two projection windows are placed one above the other, they will not exceed the pixel height of the shared device's screen. Based on this, the top-and-bottom layout method can fully utilize the shared device's display area.

[0027] In combination with the first aspect, in certain implementations of the first aspect, when the display layout is a top-down layout, the at least two display areas include a first split-screen display area and a second split-screen display area, and the height of the split-screen display area is half the pixel height of the shared device; before displaying at least two projection windows in the at least two display areas, the method also includes: determining the size of the at least two projection windows based on the screen data of the at least two projection devices, the screen pixel width of the shared device, and the height of the split-screen display area.

[0028] Based on the above solution, when the shared devices are arranged in a top-down layout, the height of at least two display areas can be the same as half the pixel height of the shared device. In other words, the height of each projection window is half the pixel height of the shared device. Based on this, the size of each projection window can be further determined to fully utilize the display area of ​​the shared device.

[0029] In combination with the first aspect, in certain implementations of the first aspect, when the projection layout mode is the sequential priority mode, the at least two display areas are determined based on the projection data of the at least two projection devices and the projection layout mode, including: determining the at least two display areas based on the projection data of the at least two projection devices and the sequential priority mode, the at least two display areas including a first display area and a second display area; in response to the projection connection of the first projection device, the first display area displays a first projection window; in response to the projection connection of the second projection device, the first display area displays a second projection window, and the second display area displays the first projection window.

[0030] It is understandable that when the screen projection layout mode is in sequential priority mode, time priority can be taken into account. That is, the screen projection device that was most recently connected to the shared device has the highest time priority, and the screen projection window corresponding to the screen projection device with the highest time priority is displayed in the first display area.

[0031] For example, the first screen projection device is connected to the shared device for screen projection at time A, and the second screen projection device is connected to the shared device for screen projection at time B. Time A is earlier than time B. At this time, the second screen projection device can be regarded as the latest screen projection device connected to the shared device for screen projection. The second screen projection device has the highest time priority. Therefore, the second screen projection window can be displayed in the first display area. Before that, the first screen projection window corresponding to the first screen projection device connected to the shared device for screen projection can be displayed in the second display area.

[0032] Exemplarily, the first display area can be understood as the main display area in the embodiment of the present application, and the second display area can be understood as the history display area in the embodiment of the present application.

[0033] Based on the above solution, users can project the screen windows displayed in a sequential priority layout in a meeting scenario, focusing on displaying the screen windows with high priority, which is more suitable for scenarios where users want to focus on introducing a certain solution in a meeting.

[0034] In combination with the first aspect, in certain implementations of the first aspect, the method also includes: in response to the user dragging the first projection window to the first display area, the first projection window is displayed in the first display area, and the second projection window is displayed in the second display area; or in response to the user dragging the second projection window to the second display area, the first projection window is displayed in the first display area, and the second projection window is displayed in the second display area.

[0035] Based on the above solution, users can move the projection window on the screen of the shared device and select the projection window displayed in the first display area according to actual needs, so that participants can focus on displaying the solution in a certain projection window.

[0036] In combination with the first aspect, in certain implementations of the first aspect, when the projection layout mode is the sequential priority mode, the at least two display areas are determined based on the projection data of the at least two projection devices and the projection layout mode, including: determining the at least two display areas based on the projection data of the at least two projection devices and the sequential priority mode, the at least two display areas including a first display area and a second display area; in response to the projection connection of the first projection device, the first display area displays a first projection window; in response to the projection connection of the second projection device, the first display area displays the first projection window, and the second display area displays the second projection window.

[0037] It can be seen that even if the second screen projection device is the latest device connected to the shared device for screen projection, it has the highest time priority, and its corresponding second screen projection window is displayed in the second display area.

[0038] In this implementation, when the projection window (first projection window) in the first display area is being displayed, the projection window corresponding to the projection device newly connected to the shared device will also be displayed in the second display area as a candidate. Among them, the first projection window is being displayed, which can be understood as in a meeting scenario, user A is presenting a plan through the first projection window. At this time, when the shared device is connected to a new projection device, the first display area still maintains the first projection window to avoid affecting the process of the current user A presenting the plan.

[0039] In combination with the first aspect, in certain implementations of the first aspect, the method further includes: in response to the user dragging the second projection window to the first display area, the second projection window is displayed in the first display area, and the first projection window is displayed in the second display area; or in response to the user dragging the first projection window to the second display area, the second projection window is displayed in the first display area, and the first projection window is displayed in the second display area.

[0040] It is understandable that the second projection device is the most recent projection device connected to the shared device in terms of timing. Before the user performs certain operations to display the second projection window in the first display area, it can be considered that the projection window currently displayed in the first display area (the first projection window) has not completed the display. For example, in a meeting scenario, the user is presenting a plan through the first projection window.

[0041] Based on the above solution, the projection window corresponding to the projection device that is most recently connected to the shared device will be displayed in the second display area. When the projection window (first projection window) in the first display area is displayed, the projection window can be moved by the user's operation to move the projection window, so that the projection window (second projection window) in the second display area can be moved to the first display area.

[0042] In summary, when the projection layout mode is the sequential priority mode, the following scenarios may occur:

[0043] Scenario 1: Multiple users are participating in a meeting and need to present their plans one by one on a shared device. Before User A presents their plan, User A's projection device is connected to the shared device. As the most recently connected device, User A's projection device has the highest time priority. Therefore, the projection window corresponding to User A's projection device is displayed in the first display area. The projection windows of Users B and C, who presented their plans before User A, are displayed in the second display area.

[0044] Scenario 2: Multiple users are participating in a meeting. Before presenting their plans one by one through a shared device's screen, the shared device can pre-project its screen to multiple projection devices. When User A presents their plan, the projection window corresponding to User A's plan has the highest priority and can be displayed in the first display area. The projection windows corresponding to User B, who presented their plan before User A, and User C, who will present their plan after User A, can be displayed in the second display area.

[0045] Scenario 3: Users A, B, and C are attending a meeting together. The shared device has established a screen projection connection with the projection devices of users A and B. At this point, user A has finished presenting their proposal, user B is presenting their proposal, and user C is about to present their proposal. The first display area displays the projection window corresponding to user B's proposal, and the second display area displays the projection window corresponding to user A's proposal. While the first display area of ​​the shared device displays the projection window corresponding to user B's proposal, a screen projection connection is established with user C's projection device. To avoid the projection window corresponding to user C's projection device being the latest device to be connected to the shared device, causing user C's projection window to be displayed in the first display area, thereby affecting the projection window of user B, who is presenting his proposal, in the first display area, display priority is prioritized, and user C's projection window is displayed in the second display area.

[0046] In combination with the first aspect, in certain implementations of the first aspect, the method also includes: when the shared device displays at least two projection windows in the at least two display areas in the sequential priority mode, the shared device displays at least one mode control in response to the user's first operation, and the at least one mode control displayed includes a smart split-screen mode control and / or a full-screen mode control; in response to the user's operation on the smart split-screen mode control, the projection layout mode is switched from the sequential priority mode to the smart split-screen mode; or in response to the user's operation on the full-screen mode control, the projection layout mode is switched from the sequential priority mode to the full-screen mode.

[0047] Based on the above solution, users can switch between sequential priority mode, smart split screen mode, or other projection layout modes by operating the shared device screen. When the shared device switches the projection layout mode, the shared device can adjust the display area according to the new projection layout mode.

[0048] In combination with the first aspect, in certain implementations of the first aspect, the method also includes: the shared device displays a third projection window and a fourth projection window, the third projection window corresponds to the third projection device, and the fourth projection window corresponds to the fourth projection device; in response to the user's operation in the third projection window, the controls of the fourth projection device are displayed; in response to the user's operation on the controls of the fourth projection device, the fourth projection device is determined to be the target device, and the content displayed in the third projection window is the target file.

[0049] In combination with the first aspect, in certain implementations of the first aspect, the method further includes: in response to the user dragging the target file from the third projection window to the fourth projection window, the target file is displayed in the fourth screen window.

[0050] Based on the above solution, when a shared device displays multiple projection windows, files can be transferred between different projection devices through user operations on the shared device, facilitating file sharing.

[0051] In combination with the first aspect, in certain implementations of the first aspect, the method also includes: in response to the user dragging the third projection window to the location of the fourth projection window, the positions of the third window and the fourth projection window are swapped; or in response to the user dragging the fourth projection window to the location of the third projection window, the positions of the third projection window and the fourth projection window are swapped.

[0052] Based on the above solution, the position of each projection window can be moved through the user's operations on the shared device, which can flexibly adapt to the user's actual needs.

[0053] In combination with the first aspect, in certain implementations of the first aspect, the method further includes: in response to the user dragging the third projection window to a preset area, the third projection window is displayed in the preset area as a floating window.

[0054] Based on the above solution, the projection window can be displayed as a floating window through the user's operation on the shared device, and the position of the floating window can also be flexibly moved to improve the user experience.

[0055] According to a second aspect, an electronic device is provided, characterized in that it includes: one or more processors; one or more memories; the one or more memories store one or more computer programs, the one or more computer programs include instructions, the shared device is connected to at least two projection devices for projection, and when the instructions are executed by the one or more processors, the electronic device performs the following steps: obtaining projection data of the at least two projection devices, the projection data including screen data and / or application data; determining at least two display areas based on the projection data of the at least two projection devices and the projection layout mode, the projection layout mode including one of the following: smart split screen mode, sequential priority mode; displaying at least two projection windows in the at least two display areas, the at least two projection windows corresponding to the at least two projection devices.

[0056] In combination with the second aspect, in certain implementations of the second aspect, when the projection layout mode is the smart split-screen mode, at least two display areas are determined based on the projection data and the projection layout mode of the at least two projection devices. When the instruction is executed by the one or more processors, the electronic device performs the following steps: determining at least two display areas based on the projection data and the display layout method of the at least two projection devices, wherein the smart split-screen mode includes the display layout method, and the display layout method includes a left-right layout method and an up-down layout method.

[0057] In combination with the second aspect, in certain implementations of the second aspect, when the instruction is executed by the one or more processors, the electronic device performs the following steps: determining the projection height based on the screen data of the at least two projection devices and the screen data of the shared device, wherein the screen data includes the screen pixel height and the screen pixel width; determining the display layout method based on the projection height.

[0058] In combination with the second aspect, in certain implementations of the second aspect, the display layout mode is determined based on the projection screen height. When the instruction is executed by the one or more processors, the electronic device performs the following steps: based on the projection screen height being greater than half of the screen pixel height of the shared device, the display layout mode is determined to be the left-right layout mode.

[0059] In combination with the second aspect, in certain implementations of the second aspect, when the instruction is executed by the one or more processors, the electronic device performs the following steps: determining the size of the at least two projection windows based on the screen data of the at least two projection devices, the screen pixel width of the shared device, and the projection height, and the size of the at least two display areas is the same as the size of the at least two projection windows.

[0060] In combination with the second aspect, in certain implementations of the second aspect, the display layout method is determined based on the projection screen height. When the instruction is executed by the one or more processors, the electronic device performs the following steps: based on the projection screen height being less than or equal to half of the screen pixel height of the shared device, the display layout method is determined to be the top-down layout method.

[0061] In combination with the second aspect, in certain implementations of the second aspect, when the display layout is a top-down layout, the at least two display areas include a first split-screen display area and a second split-screen display area, and the height of the split-screen display area is half the pixel height of the shared device; when the instruction is executed by the one or more processors, the electronic device performs the following steps: determine the size of the at least two projection windows based on the screen data of the at least two projection devices, the screen pixel width of the shared device, and the height of the split-screen display area.

[0062] In combination with the second aspect, in certain implementations of the second aspect, when the projection layout mode is the sequential priority mode, at least two display areas are determined based on the projection data of the at least two projection devices and the projection layout mode. When the instruction is executed by the one or more processors, the electronic device performs the following steps: determining the at least two display areas based on the projection data of the at least two projection devices and the sequential priority mode, the at least two display areas including a first display area and a second display area; in response to the projection connection of the first projection device, the first display area displays a first projection window; in response to the projection connection of the second projection device, the first display area displays a second projection window, and the second display area displays the first projection window.

[0063] In combination with the second aspect, in certain implementations of the second aspect, when the instruction is executed by the one or more processors, the electronic device performs the following steps: in response to the user dragging the first projection window to the first display area, the first projection window is displayed in the first display area, and the second projection window is displayed in the second display area; or in response to the user dragging the second projection window to the second display area, the first projection window is displayed in the first display area, and the second projection window is displayed in the second display area.

[0064] In combination with the second aspect, in certain implementations of the second aspect, when the projection layout mode is the sequential priority mode, at least two display areas are determined based on the projection data of the at least two projection devices and the projection layout mode. When the instruction is executed by the one or more processors, the electronic device performs the following steps: determining the at least two display areas based on the projection data of the at least two projection devices and the sequential priority mode, the at least two display areas including a first display area and a second display area; in response to the projection connection of the first projection device, the first display area displays a first projection window; in response to the projection connection of the second projection device, the first display area displays the first projection window, and the second display area displays the second projection window.

[0065] In combination with the second aspect, in certain implementations of the second aspect, when the instruction is executed by the one or more processors, the electronic device performs the following steps: in response to the user dragging the second projection window to the first display area, the second projection window is displayed in the first display area, and the first projection window is displayed in the second display area; or in response to the user dragging the first projection window to the second display area, the second projection window is displayed in the first display area, and the first projection window is displayed in the second display area.

[0066] In combination with the second aspect, in certain implementations of the second aspect, when the instruction is executed by the one or more processors, the electronic device performs the following steps: when the shared device displays at least two projection windows in the at least two display areas in the sequential priority mode, the shared device displays at least one mode control in response to the user's first operation, and the at least one mode control displayed includes a smart split screen mode control and / or a full screen mode control; in response to the user's operation on the smart split screen mode control, the projection layout mode is switched from the sequential priority mode to the smart split screen mode; or in response to the user's operation on the full screen mode control, the projection layout mode is switched from the sequential priority mode to the full screen mode.

[0067] In combination with the second aspect, in certain implementations of the second aspect, when the instruction is executed by the one or more processors, the electronic device performs the following steps: the shared device displays a third projection window and a fourth projection window, the third projection window corresponds to the third projection device, and the fourth projection window corresponds to the fourth projection device; in response to the user's operation in the third projection window, the controls of the fourth projection device are displayed; in response to the user's operation on the controls of the fourth projection device, the fourth projection device is determined to be the target device, and the content displayed in the third projection window is the target file.

[0068] In combination with the second aspect, in certain implementations of the second aspect, when the instruction is executed by the one or more processors, the electronic device performs the following steps: in response to the user dragging the target file from the third projection window to the fourth projection window, the target file is displayed in the fourth projection window.

[0069] In combination with the second aspect, in certain implementations of the second aspect, the method also includes: in response to the user dragging the third projection window to the location of the fourth projection window, the positions of the third projection window and the fourth projection window are swapped; or in response to the user dragging the fourth projection window to the location of the third projection window, the positions of the third projection window and the fourth projection window are swapped.

[0070] In combination with the second aspect, in certain implementations of the second aspect, when the instruction is executed by the one or more processors, the electronic device performs the following steps: in response to the user dragging the third projection window to a preset area, the third projection window is displayed in the preset area as a floating window.

[0071] In a third aspect, a display system is provided, which includes a shared device as in the first aspect and any possible implementation thereof and at least two projection devices.

[0072] In a fourth aspect, a display device is provided, comprising: a processor coupled to a memory, the memory being used to store a computer program, the processor being used to run the computer program, so that the display device executes the method in the first aspect and any possible implementation thereof.

[0073] In combination with the fourth aspect, in certain implementations of the fourth aspect, one or more of the memory and the transceiver are further included, and the transceiver is used to receive signals and / or send signals.

[0074] In a fifth aspect, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a computer, the computer implements the method in the first aspect and any possible implementation thereof.

[0075] In a sixth aspect, a computer program product comprising instructions is characterized in that, when the computer program product is run on a computer, the computer is caused to execute the method as described in the first aspect and any possible implementation thereof.

[0076] In a seventh aspect, a chip is provided, which includes a processor and a data interface. The processor reads instructions stored in a memory through the data interface to execute the method in the first aspect and any possible implementation thereof.

[0077] In combination with the seventh aspect, in a possible implementation, the processor is coupled to the memory through an interface.

[0078] In combination with the seventh aspect, in a possible implementation, the chip system also includes a memory, in which a computer program or computer instructions are stored. BRIEF DESCRIPTION OF THE DRAWINGS

[0079] FIG1 is a schematic structural diagram of an electronic device.

[0080] FIG2 is a software structure block diagram of an electronic device.

[0081] FIG3 is a schematic diagram of a scenario provided in an embodiment of the present application.

[0082] FIG4 is a schematic flow chart of a display method provided in an embodiment of the present application.

[0083] Figure 5 is a schematic diagram of a screen projection layout mode provided in an embodiment of the present application.

[0084] Figure 6 is a schematic diagram of a switching screen projection layout mode provided in an embodiment of the present application.

[0085] FIG7 is a schematic flowchart of file sharing provided in an embodiment of the present application.

[0086] FIG8 is a schematic diagram of determining a target device provided by an embodiment of the present application.

[0087] Figure 9 is a schematic diagram of a projection window movement provided in an embodiment of the present application.

[0088] Figure 10 is a schematic diagram of a projection window displayed as a floating window provided in an embodiment of the present application.

[0089] FIG11 is a schematic flow chart of a display method provided in an embodiment of the present application. DETAILED DESCRIPTION

[0090] The technical solution in this application will be described below with reference to the accompanying drawings.

[0091] The terms used in the following embodiments are only for the purpose of describing specific embodiments and are not intended to limit the present application. As used in the specification of this application and the appended claims, the singular expressions "a", "an", "said", "above", "the" and "this" are intended to also include expressions such as "one or more", unless there is a clear contrary indication in the context. It should also be understood that in the following embodiments of the present application, "at least one", "one or more" refer to one, two or more. The term "and / or" is used to describe the association relationship of associated objects, indicating that three relationships can exist; for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and subsequent associated objects are in an "or" relationship.

[0092] References to "one embodiment" or "some embodiments" in this specification mean that a particular feature, structure, or characteristic described in conjunction with that embodiment is included in one or more embodiments of the present application. Thus, phrases such as "in one embodiment," "in some embodiments," "in other embodiments," and "in yet other embodiments" appearing in various places in this specification do not necessarily refer to the same embodiment, but rather mean "one or more but not all embodiments," unless otherwise specifically emphasized. The terms "including," "comprising," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0093] The following describes an electronic device, a user interface for such an electronic device, and embodiments for using such an electronic device. In some embodiments, the electronic device may be a portable electronic device that also includes other functions such as a personal digital assistant and / or a music player, such as a mobile phone, a tablet computer, a wearable electronic device with wireless communication functions (such as a smart watch), etc. Exemplary embodiments of portable electronic devices include but are not limited to devices equipped with Or a portable electronic device with other operating systems. The portable electronic device may also be other portable electronic devices, such as a laptop computer. It should also be understood that in some other embodiments, the electronic device may not be a portable electronic device, but a desktop computer. In some other embodiments, the electronic device may be an instrument for measurement, such as an oscilloscope.

[0094] 1 shows a schematic structural diagram of an electronic device 100. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display 194, and a subscriber identification module (SIM) card interface 195. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0095] It should be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0096] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0097] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0098] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0099] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.

[0100] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0101] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.

[0102] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0103] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0104] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0105] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with a network and other devices through wireless communication technologies. The wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0106] Electronic device 100 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0107] Display screen 194 is used to display images, videos, and the like. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, or a quantum dot light-emitting diode (QLED). In some embodiments, electronic device 100 may include one or N display screens 194, where N is a positive integer greater than one.

[0108] The electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.

[0109] The ISP processes data fed back by camera 193. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then passed to the ISP for processing and converted into a visible image. The ISP can also perform algorithmic optimization on image noise, brightness, and skin tone. It can also optimize parameters such as exposure and color temperature of the captured scene. In some embodiments, the ISP can be located within camera 193.

[0110] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0111] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0112] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. This allows electronic device 100 to play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.

[0113] The NPU is a neural network (NN) computing processor. Drawing on the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it rapidly processes input information and can continuously self-learn. The NPU can enable intelligent cognitive applications in electronic device 100, such as image recognition, face recognition, speech recognition, and text comprehension.

[0114] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.

[0115] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0116] The electronic device 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0117] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be provided in the processor 110, or some functional modules of the audio module 170 can be provided in the processor 110.

[0118] The speaker 170A, also called a "speaker", is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or listen to hands-free calls through the speaker 170A.

[0119] The receiver 170B, also called a "handset", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or a voice message, the user can place the receiver 170B close to the ear to hear the voice.

[0120] Microphone 170C, also known as "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to the microphone 170C to input the sound signal into the microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the source of sound, realize directional recording function, etc.

[0121] The pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, the pressure sensor 180A can be set on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. A capacitive pressure sensor can be a device comprising at least two parallel plates with conductive materials. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure based on the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the intensity of the touch operation based on the pressure sensor 180A. The electronic device 100 can also calculate the position of the touch based on the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example, when a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the alarm application icon, the instruction to create a new alarm is executed.

[0122] Fingerprint sensor 180H is used to collect fingerprints. Electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, accessing application locks, taking photos with fingerprints, answering calls with fingerprints, and so on. For example, when the phone detects a user's touch operation on the lock screen, the phone can collect the user's fingerprint information through fingerprint sensor 180H and match the collected fingerprint information with the fingerprint information pre-set in the phone. If the match is successful, the phone can enter the non-lock screen interface from the lock screen interface.

[0123] The touch sensor 180K is also called a "touch panel." The touch sensor 180K can be disposed on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen." The touch sensor 180K is used to detect touch operations applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operations to the application processor to determine the type of touch event. Visual output related to the touch operations can be provided via the display screen 194. In other embodiments, the touch sensor 180K can also be disposed on the surface of the electronic device 100, in a location different from that of the display screen 194.

[0124] Figure 2 is a software structure diagram of the electronic device 100 according to an embodiment of the present application. The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, namely, the application layer, the application framework layer, the Android runtime (Android runtime) and the system library, and the kernel layer, from top to bottom. The application layer can include a series of application packages.

[0125] As shown in Figure 2, the application layer may include camera, settings, skin modules, user interface (UI), third-party applications, etc. Among them, third-party applications may include gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.

[0126] The application framework layer provides an application programming interface (API) and a programming framework for applications in the application layer. The application framework layer may include some predefined functions.

[0127] As shown in FIG2 , the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.

[0128] The window manager manages windowed applications. It can determine the display size, determine whether a status bar is present, lock the screen, and take screenshots. Content providers store and retrieve data and make it accessible to applications. This data can include video, images, audio, incoming and outgoing calls, browsing history and bookmarks, and phone books.

[0129] The view system includes visual controls, such as controls for displaying text and images. The view system is used to build applications. A display interface can consist of one or more views.

[0130] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including answering, hanging up, etc.).

[0131] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0132] The Notification Manager allows applications to display notifications in the status bar. These messages can be displayed briefly and then disappear automatically without user interaction. For example, the Notification Manager is used to notify users of completed downloads and message reminders. The Notification Manager can also display notifications in the top status bar of the system as icons or scrolling text, such as notifications from background applications, or as dialog windows on the screen. Examples include text messages in the status bar, beeps, vibrations on electronic devices, and flashing indicator lights.

[0133] The Android runtime includes the core library and the virtual machine. The Android runtime is responsible for scheduling and management of the Android system.

[0134] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.

[0135] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.

[0136] The system library can include multiple functional modules, such as a surface manager, media libraries, a 3D graphics processing library (such as OpenGL ES), and a 2D graphics engine (such as SGL).

[0137] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.

[0138] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0139] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0140] A 2D graphics engine is a drawing engine for 2D drawings.

[0141] In addition, the system library can also include status monitoring service modules, such as a physical status recognition module for analyzing and identifying user gestures; a sensor service module for monitoring sensor data uploaded by various sensors at the hardware layer to determine the physical status of the electronic device 100.

[0142] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.

[0143] The hardware layer may include various sensors, such as the various sensors described in FIG1 .

[0144] In conjunction with the electronic devices described in Figures 1 and 2 above, in the embodiments of the present application, the electronic device can be a mobile phone terminal, a tablet computer, or other device that can realize the screen projection function. The physical devices involved in the electronic device 100 mainly include hardware components such as sensors, decision support systems (DSS) display chips, touch screens, fingerprint recognition modules, etc.; as well as kernel software layers such as screen management modules, display drivers, fingerprint drivers, and anti-mistouch; application framework layer functions such as anti-mistouch input, screen control, always on display (AOD) services, and power management; and application layer services such as special adaptation applications (camera), third-party applications, system sleep, and AOD.

[0145] With the development of electronic device technology, an electronic device screen can display the interfaces of multiple electronic devices, allowing users to obtain information from multiple interfaces at the same time, so that users can view, compare, and process the information of multiple interfaces. Scenarios for viewing multiple electronic device interfaces through a single electronic device screen include but are not limited to the conference scenario shown in Figure 3. In the conference scenario, users usually need to view multiple solutions, compare and discuss multiple solutions, and users also need to have different requirements for the display methods of multiple solutions at different stages of the meeting. In the current conference scenario, multiple participants can carry multiple personal electronic devices. Participants can connect their personal electronic devices to the conference public electronic device in turn, making it convenient for other participants to view the participant's solution through the public electronic device screen. However, this method can only display the solution of one participant at a time, and it is not possible to view the solutions of multiple participants at the same time through the public electronic device screen. It cannot meet the needs of comparing and discussing multiple solutions, which affects the efficiency of the meeting. In order to be able to display multiple solutions on one screen, in the current conference scenario, public electronic devices can also support the projection display of multiple personal electronic devices, so that participants can view multiple solutions at the same time and compare, discuss, and process multiple solutions. For example, the conference scene shown in Figure 3 includes a shared device 100 and a screen projection device 200. In the conference scene, the shared device 100 can be a public electronic device that can be used by multiple people. The screen projection device 200 can be a personal electronic device that can establish a data connection with the shared device 100 by accessing a wireless local area network (WLAN) or other methods, thereby displaying the interface of the screen projection device 200 on the screen of the shared device 200. Specifically, the shared device 100 can be an electronic device such as a smart screen or an electronic whiteboard, which has a larger screen size, making it convenient for participants to view the plan in a conference scene; the screen projection device 200 can be a personal computer A, a mobile terminal B or a tablet computer C. Multiple screen projection devices 200 can be connected to the shared device 100 for screen projection, and the interfaces of personal computer A, mobile terminal B and tablet computer C can be displayed on the shared device 100. At present, on a shared device, display areas can be allocated to multiple projection devices according to a fixed grid template (for example, a grid allocation scheme). For example, if the number of projection devices is 4, the display area of ​​the shared device screen can be divided into 4 equal parts, each corresponding to a projection window. However, since the size, shape, type and other parameters of each projection device may vary, allocating display areas to multiple projection devices according to a fixed grid template will result in the inability to fully utilize the display area of ​​the shared device screen, thereby affecting the projection display effect. At the same time, it is not convenient to flexibly adapt to user needs. Among them, the display area of ​​the shared device screen can also be the entire screen of the shared device.

[0146] Therefore, in order to solve the above problems, the embodiments of the present application provide a display method, an electronic device and a system. The method can display multiple projection windows according to a certain projection layout in the scenario where the projection windows corresponding to multiple projection devices are projected and displayed, so as to make full use of the display area of ​​the shared device screen, bring good display effects to users, and flexibly adapt to different needs of users.

[0147] As shown in FIG4 , a schematic flowchart of a display method is shown. The method can be applied to the scenario where the shared device and the screen projection device are located as shown in FIG3 . The method is described in detail below.

[0148] S401, the sharing device establishes a connection with the screen projection device, and the sharing device obtains the screen projection data.

[0149] For example, a shared device can be an electronic device such as a smart screen or electronic whiteboard installed in a public setting such as a conference room. The shared device can display the interfaces of multiple projection devices. The projection device can be a personal device such as a mobile phone, personal computer, or tablet computer.

[0150] For example, a shared device establishes a connection with multiple projection devices, and the shared device can receive projection data from multiple projection devices. The projection data can be the screen data of the projection device, or the data of an application that supports the projection function of the projection device. The projection device can be understood as a device that has established a projection connection with the shared device, or a device that is about to establish a projection connection with the shared device.

[0151] It should be noted that the shared device establishes a screen projection connection with the screen projection device. For example, the shared device and the screen projection device are connected in the same local area network, and screen mirroring is achieved through the system-level distributed soft bus technology, so that the screen projection window is mirrored and displayed on the screen of the shared device in real time, thereby realizing the screen projection connection between the shared device and the screen projection device. For another example, the screen projection device transfers the screen projection data through the cloud server through an application that supports the screen projection function (for example, a video playback application, a conference application, etc.). The screen projection device can send the screen projection data to the shared device, and the screen projection window is displayed on the screen of the shared device. In other words, the embodiment of the present application does not limit the specific method for establishing a screen projection connection between the shared device and the screen projection device. Any technician familiar with this technical field can easily think of changes or replacements within the technical scope of the above examples to achieve the specific method of establishing a screen projection connection, which should be covered within the scope of protection of this application.

[0152] Exemplarily, a shared device can establish a projection connection with multiple projection devices, and the number of projection devices connected to the shared device can also change dynamically, that is, the number of projection devices connected to the shared device can be gradually increased. For example, in a meeting scenario, multiple participants can share solutions in turn and explain the solutions, and then compare the contents of different solutions to discuss the best solution. During the stage where participants share solutions, the projection devices of each participant can establish a projection connection with the shared device in turn. In the subsequent solution comparison stage, different projection windows can be viewed on the shared device. At this time, the shared device maintains simultaneous connection with multiple projection devices.

[0153] In one implementation, after the sharing device establishes a screen projection connection with the screen projection device, the sharing device receives screen projection data from multiple screen projection devices and displays the screen projection window on the screen of the sharing device.

[0154] S402: The shared device determines the projection layout.

[0155] For example, in a conference scenario, participants may have different needs at different stages of the meeting. For example, when a participant shares a solution through a shared device, other participants need to focus on the solution shared by the participant. At this time, the shared device needs to display the solution shared by the participant as fully as possible. After all participants have shared their solutions, all solutions need to be compared and discussed. At this time, the shared device needs to display all solutions, and multiple projection windows need to be displayed as fully as possible. Therefore, the shared device needs to determine a projection layout that is more suitable for the current application scenario.

[0156] In one implementation, after receiving projection data from multiple projection devices, the sharing device can determine the projection layout based on the projection data. The projection data can be screen data such as the screen size and / or screen resolution of the projection device, or the resolution corresponding to the content area that can be projected by certain applications (for example, the resolution of the video window that can be projected by a video playback application).

[0157] For example, when the shared device determines the screen projection layout, it does not consider the screen projection data and directly uses the grid allocation scheme to determine the display area of ​​each screen projection window, which will cause a certain degree of waste of the display area on the shared device screen. For example, if the shared device establishes a screen projection connection with the screen projection device personal computer and mobile phone terminal, without considering the screen projection data of the personal computer and the mobile phone terminal, the display area of ​​the shared device screen is evenly divided into two parts, one part of the display area is used to display the screen projection window of the personal computer, and the other part of the display area is used to display the screen projection window of the mobile phone terminal. However, in fact, the screen size and / or screen resolution of the personal computer and the mobile phone terminal are different. If the same display area is configured, there will be more black screen areas in the screen projection window of the mobile phone terminal, resulting in a waste of display area, and the screen projection window of the mobile phone terminal and the screen projection window of the personal computer cannot be fully displayed.

[0158] Exemplarily, the screen projection layout mode may include a sequential priority mode and a smart split-screen mode.

[0159] It should be noted that configuring different projection layouts on a shared device can adapt to users' projection needs at different stages. For example, when a shared device receives new projection data, or the amount of projection data received increases, or the resolution of the projection window corresponding to a projection device with which the shared device has established a projection connection changes, the shared device can first determine the projection layout suitable for the current stage and adjust the layout of the projection window according to the current projection layout.

[0160] Specifically, the screen projection layout is introduced in detail below.

[0161] Method 1: Sequential priority mode.

[0162] It should be noted that the screen projection layout can be determined according to the order of screen projection. The display area of ​​the shared device can include a main display area and a historical display area. The main display area occupies most of the display area of ​​the shared device, and the historical display area occupies a small part of the display area of ​​the shared device. The main display area can display the projection window corresponding to the projection device that is most recently connected to the shared device for screen projection (which can be understood as the current projection window), and the historical display area can display the projection window corresponding to the historical projection device connected to the shared device for screen projection (which can be understood as the historical projection window).

[0163] Method 2: Smart split-screen mode.

[0164] It should be noted that the smart split-screen mode can maximize the use of the display area of ​​the shared device and can use the most reasonable screen projection layout to allow multiple screen projection windows to occupy as large a display area as possible.

[0165] For ease of understanding, as shown in Figure 5, the screen projection layout method provided by the embodiment of the present application is shown. In conjunction with Figure 5, the following two screen projection layout modes are introduced respectively, taking the shared device as a smart screen as an example.

[0166] As shown in (a) in Figure 5, a screen projection layout method in a sequential priority mode is shown. In the sequential priority mode, the display area of ​​the shared device includes a historical display area 501 and a main display area 502. The historical display area 501 displays multiple historical screen projection windows, for example, the screen projection window of the historical screen projection device A and the screen projection window of the historical screen projection device B. The main display area 502 displays the current screen projection window, for example, the screen projection window of the latest screen projection device C. The display area of ​​the shared device is divided into a historical display area 501 and a main display area 502 on the left and right, wherein the main display area 502 occupies most of the display area of ​​the shared device, and the historical display area 501 occupies a small part of the display area of ​​the shared device. The multiple historical screen projection windows in the historical display area 501 can be displayed in a list, and the sizes of the multiple historical screen projection windows can be the same.

[0167] It should be noted that the history display area 501 and the main display area 502 can be distributed left and right as shown in (a) in Figure 5, or can be distributed up and down, and this embodiment of the application is not limited to this.

[0168] In one implementation, the size of the primary display area 502 and the size of the history display area 501 can be fixed. That is, regardless of the resolution of the projection window of the projection device, it will not affect the size of the primary display area 502 and the history display area 501. For example, whether the latest projection device C is a mobile phone terminal or a personal computer, it will not affect the size of the primary display area 502 and the history display area 501.

[0169] In another implementation, the size of the main display area 502 and the size of the history display area 501 can be dynamically determined based on the projection data (e.g., screen data) of the projection device.

[0170] It should be noted that the screen data may vary for different projection devices. For the main display area 501, a default pixel resolution size can be pre-set, and the size of the main display area 502 can be adjusted according to the actual screen data of the projection device (for example, screen pixel height, screen pixel width), so that the size of the history display area 501 is also adjusted accordingly.

[0171] For example, the entire screen of the projection device is projected and displayed in the main display area 502 of the shared device. Specifically, the default aspect ratio of the main display area 502 is compared with the aspect ratio of the projection device screen, and the smaller side of the height and width of the main display area 502 relative to the height and width of the projection device screen is determined, and the size of the projection window is determined based on the smaller side.

[0172] For example, the screen aspect ratio of the projection device is 16:9, and the aspect ratio of the main display area is 4:3. Since 4:3 is 12:9, the smaller side is determined to be the width by comparison (12 is less than 16). Therefore, since the width is smaller, the size of the projection window in the width direction can be compressed. At the same time, in order to ensure that the ratio of the projection window is 16:9, the size of the projection window in the height direction will also be compressed. There are two upper and lower shadow areas in the height direction of the projection window (for example, the shadow area shown in (a) in Figure 5), so that the compressed projection window can be fully displayed in the main display area.

[0173] It should be noted that, during the process of connecting a new projection device to a shared device, the shared device can dynamically determine the main display area and the historical display area.

[0174] In a meeting scenario, the user can also temporarily call the historical projection window in the historical display area while explaining the plan. The shared device can respond to the user's operation on the historical projection window, display the historical projection window in the main display area, and display the current projection window displayed in the main display area in the historical display area. In other words, the current projection window in the main display area and the historical projection window in the historical display area can swap positions according to the operation triggered by the user. It should be noted that the user is not limited to the specific operation of the historical projection window in the historical display area. For example, the user clicks and drags the projection window in the historical display area to move it to the main display area.

[0175] In addition, in order to facilitate users to compare solutions in the conference scene, the historical projection window and the current projection window can be displayed in the main display area 502. For example, the projection window of projection device A and the projection window of projection device C are displayed side by side in the main display area 502. In this case, the main display area can be understood as a screen and split so that multiple projection windows can be displayed in split screen in the main display area. For example, the user clicks on the projection window of projection device A and drags it to the left position of the center line area of ​​the main display area 502 and releases it. The projection window of projection device A will be displayed on the left side of the main display area 502, and the projection window of projection device C will be displayed on the right side of the main display area 502; the user clicks on the projection window of projection device A and drags it to the right position of the center line of the main display area 502 and releases it. The projection window of projection device A will be displayed on the right side of the main display area 502, and the projection window of projection device C will be displayed on the left side of the main display area 502. Furthermore, the user can display the projection window of the projection device B in the history display area 501 in the main display area 502 through similar operations as described above.

[0176] It should be noted that the historical projection windows displayed in the primary display area and the display area occupied by the projection windows can also be adjusted according to user needs. For example, by default, the projection window of projection device A and the projection window of projection device C are displayed on the left and right sides of the primary display area 502, and each occupies half of the display area of ​​the primary display area 502. There is a boundary line between the projection window of projection device A and the projection window of projection device B. The user can change the display area occupied by the projection window of projection device A and the projection window of projection device B by dragging the boundary line.

[0177] As shown in (b) to (d) in Figure 5, a projection layout method in smart split-screen mode is shown. Smart split-screen mode can maximize the display of multiple projection windows in the display area of ​​the shared device to minimize the shadow area of ​​the shared device. When the shared device determines the projection layout through the smart split-screen mode, each time a new projection device is added and / or the aspect ratio of the projection window changes, the shared device needs to determine the latest projection layout.

[0178] It should be noted that when a shared device determines the projection layout in Smart Split Mode, it primarily determines the projection height based on the aspect ratio of the screens of the multiple projection devices and the aspect ratio of the shared device's screen. The display layout is then determined based on the relationship between the projection height and the pixel height of the shared device's screen. Display layouts include left-right and top-down.

[0179] It's understood that when the projection screen height is greater than half the pixel height of the shared device's screen, the projection window is displayed in a left-right layout; when the projection screen height is less than or equal to half the pixel height of the shared device's screen, the projection window is displayed in a top-down layout. The following describes each of these two display layouts.

[0180] As shown in (b) of Figure 5, a schematic diagram of displaying a screen projection window in a left-right layout is shown. Screen projection device A, screen projection device B, and screen projection device C are connected to the shared device for screen projection. It can be understood that when the shared device maintains a screen projection connection with screen projection device A and screen projection device B, in response to the connection of screen projection device C, the shared device determines the latest screen projection layout as shown in (b) of Figure 5.

[0181] Specifically, the process of the shared device determining the projection layout is as follows:

[0182] For example, the screen resolution of projection device A is 2800*1800, the screen resolution of projection device B is 1170*2532, the screen resolution of projection device C is 1688*2388, and the screen resolution of the shared device is 3840*2160.

[0183] Step 1. Determine the aspect ratio of the projection device and the shared device.

[0184] The aspect ratio of projection device A is: A1 = 2800 / 1800;

[0185] The aspect ratio of projection device B is: B1 = 1170 / 2532;

[0186] The aspect ratio of projection device C is: C1 = 1688 / 2388;

[0187] The aspect ratio of the shared device is: X=3840 / 2160.

[0188] Step 2: Determine the projection height.

[0189] It should be noted that in smart split-screen mode, the aspect ratio of each projection window is consistent with the aspect ratio of the projection device, and priority is given to the left-right layout of multiple projection windows. Therefore, the calculation is based on the left-right layout. When the projection windows are arranged left and right, the height of each projection window is consistent. Among them, the height of each projection window can be understood as the projection height H.

[0190] Based on the projection screen height and the aspect ratio of each projection device, the width of each projection screen window when displayed on the left and right is determined.

[0191] The projection window width of projection device A, K1 = A1 * H;

[0192] The projection window width of projection device B, K2 = B1 * H;

[0193] The projection window width of projection device C, K3 = C1 * H.

[0194] To maximize the display of each projection window on the shared device display area (which can be understood as the shared device screen), when the projection windows are distributed left and right, the sum of the widths of the projection windows is consistent with the width of the shared device screen, that is, K1 + K2 + K3 = 3840. At the same time, the projection height H is less than or equal to the height of the shared device screen, that is, H is less than or equal to 2160.

[0195] Based on the above conditions, divide the width of the shared device screen by the sum of the aspect ratios of the projection devices and round up to get the projection height H. That is, H = 3840 / (A1 + A2 + A3), and after rounding, H is 1410.

[0196] Step 3: Determine the layout based on the projection screen height.

[0197] The projection screen height H calculated in step 2 is 1410, which is greater than half the height of the shared device screen (1080). Therefore, a left-right layout is adopted.

[0198] Furthermore, the width of each projection window is determined (rounded up) based on the relationship between the projection window aspect ratio and the projection height.

[0199] The projection window width of projection device A is K1 = A1 * H = 2194;

[0200] The projection window width of projection device B is K2 = B1 * H = 652;

[0201] The projection window width of projection device C is K3 = C1 * H = 997.

[0202] Step 4: Determine the size of the projection window.

[0203] Based on the projection height calculated above and the width of each projection window, the actual projection window size displayed by each projection device on the shared device is determined.

[0204] The projection window size of projection device A is 2194*1410;

[0205] The projection window size of projection device B is 652*1410;

[0206] The projection window size of projection device C is: 997*1410.

[0207] Step 5: Determine the position of the projection window based on its size and layout.

[0208] Based on the left-right distribution method, the positions of each projection window can be arranged in sequence. The embodiment of the present application does not limit the specific order of the projection window arrangement, and a default arrangement order can be preset. The closer the moment when the projection connection is first established is to the current moment, the closer the projection window is to the left side of the shared device screen. For example, the moment when projection device A establishes the projection connection is closest to the current moment. Therefore, the projection window 503 of projection device A is displayed on the far left of the shared device screen.

[0209] Based on the above steps, as shown in (b) in Figure 5, the projection windows of projection device A, projection device B and projection device C can be displayed in sequence from left to right on the shared device screen in a left-right distribution manner.

[0210] As can be seen from the above process of determining the projection layout, the projection height is related to the resolution of the projection device screen. Therefore, the projection layout may also be different for different projection devices. For example, when the resolution of the projection device screen changes as shown in Figure 5 (b), the projection layout will change to the method shown in Figure 5 (c).

[0211] As shown in (c) of Figure 5, a schematic diagram of displaying a projection window in an up-down layout is shown. Projection device A, projection device B, and projection device C are connected to the shared device for projection. It can be understood that when the shared device maintains a projection connection with projection device A and projection device B, in response to the connection of projection device C, the shared device determines the latest projection layout as shown in (c) of Figure 5.

[0212] Specifically, the process of the shared device determining the projection layout of the projection device is as follows:

[0213] For example, the screen resolution of projection device A is 2800*1800, the screen resolution of projection device B is 2532*1170, the screen resolution of projection device C is 2800*1800, and the screen resolution of the shared device is 3840*2160.

[0214] Step 1. Determine the aspect ratio of the projection device and the shared device.

[0215] The aspect ratio of projection device A is: A1 = 2800 / 1800;

[0216] The aspect ratio of projection device B is: B1 = 2532 / 1170;

[0217] The aspect ratio of projection device C is: C1 = 2800 / 1800;

[0218] The aspect ratio of the shared device is: X=3840 / 2160.

[0219] Step 2: Determine the projection height.

[0220] The projection window width of projection device A, K1 = A1 * H;

[0221] The projection window width of projection device B, K2 = B1 * H;

[0222] The projection window width of projection device C, K3 = C1 * H.

[0223] Among them, K1+K2+K3=3840, and the projection screen height H is less than or equal to 2160.

[0224] Therefore, the projection screen height H = 3840 / (A1+A2+A3), and after rounding, H is 728.

[0225] Step 3: Determine the layout based on the projection screen height.

[0226] The projection screen height H calculated in step 2 is 728, which is less than half the height of the shared device screen (1080). Therefore, a top-bottom layout is adopted.

[0227] In the top-bottom layout, the shared device's screen is divided into two split-screen display areas, upper and lower, as shown in FIG5(c) , upper split-screen display area 504 and lower split-screen display area 505. Both split-screen display areas can display projection windows. For example, the pixel height of these two split-screen display areas is half the pixel height of the shared device's screen (1080).

[0228] For example, it can be preset that a maximum of two projection windows can be displayed in each split-screen display area.

[0229] When dividing the projection window within each split-screen display area, the default distribution can be equal, and the projection area with the same aspect ratio as the projection window is determined based on the pixel height H' of the split-screen display area (that is, half the pixel height H' of the shared device screen). In other words, when the projection window is displayed in a top-to-bottom layout, the width of the projection window is determined based on half the pixel height H' of the shared device screen; when the projection window is displayed in a left-to-right layout, the width of the projection window is determined based on the projection height H.

[0230] In one implementation, when it is calculated that the width of the projection area corresponding to the projection window is greater than half of the pixel width of the split-screen display area (that is, half of the pixel width of the shared device screen), the default average distribution method is adjusted so that the projection window with a projection area width greater than half of the pixel width of the split-screen display area occupies an area greater than half of the split-screen display area. At the same time, it is required that the sum of the width of another projection window in the same split-screen display area and the width of the projection window is less than or equal to the pixel width of the split-screen display area.

[0231] Furthermore, the width of each projection window is determined (rounded up) based on the relationship between the aspect ratio of the projection window and half the pixel height H' of the shared device screen.

[0232] The projection window width of projection device A is K1 = A1 * H' = 1680;

[0233] The projection window width of projection device B, K2 = B1 * H' = 2337;

[0234] The projection window width of projection device C is K3 = C1 * H' = 1680.

[0235] Step 4: Determine the size of the projection window.

[0236] Based on the half pixel height H' of the shared device screen obtained by the above calculation and the width of each projection window, the size of the projection window actually displayed by each projection device on the shared device is determined.

[0237] The projection window size of projection device A is 1680*1080;

[0238] The projection window size of projection device B is 2337*1080;

[0239] The projection window size of projection device C is: 1680*1080.

[0240] Step 5: Determine the position of the projection window based on its size and layout.

[0241] Based on the width of each projection window determined in step 3 above, it can be seen that the projection window width of projection device A is less than half the pixel width of the shared screen (1920), the projection window width of projection device B is greater than half the pixel width of the shared screen, and the projection window width of projection device C is less than half the pixel width of the shared screen. If projection device A and projection device B are displayed in the same split-screen display area, the sum of the projection window widths of projection device A and projection window widths of projection device B is greater than the pixel width of the split-screen display area (that is, greater than the pixel width of the shared device screen), which will prevent the projection window from being fully displayed in the split-screen display area. If the projection window is reduced to ensure that the projection window is fully displayed, this will reduce the clarity of the projection window. Therefore, it is necessary to adjust the specific position of the projection window. For example, as shown in (c) in Figure 5, the projection window of projection device A and the projection window of projection device C are displayed side by side in the upper split-screen display area 504, and the projection window of projection device B is displayed in the lower split-screen display area 505.

[0242] Furthermore, as shown in (c) in the above FIG. 5 , on the basis of establishing a screen projection connection between the sharing device and the screen projection device A, the screen projection device B and the screen projection device C, a new screen projection device D is added.

[0243] As shown in (d) of Figure 5, a schematic diagram of displaying the projection window in an up-down layout is shown. Projection device A, projection device B, projection device C, and projection device D are connected to the shared device for projection. It can be understood that when the shared device maintains a projection connection with projection device A, projection device B, and projection device C, in response to the connection of projection device D, the shared device determines the latest projection layout as shown in (d) of Figure 5.

[0244] Specifically, the process for the shared device to determine the screen projection layout is as follows:

[0245] For example, the screen resolution of projection device A is 2800*1800, the screen resolution of projection device B is 2532*1170, the screen resolution of projection device C is 2800*1800, the aspect ratio of projection device D is 1170*2532, and the screen resolution of the shared device is 3840*2160.

[0246] Step 1. Determine the aspect ratio of the projection device and the shared device.

[0247] The aspect ratio of projection device A is: A1 = 2800 / 1800;

[0248] The aspect ratio of projection device B is: B1 = 2532 / 1170;

[0249] The aspect ratio of projection device C is: C1 = 2800 / 1800;

[0250] The aspect ratio of the projection device D is: D = 1170 / 2532;

[0251] The aspect ratio of the shared device is: X=3840 / 2160.

[0252] Step 2: Determine the projection height.

[0253] The projection window width of projection device A, K1 = A1 * H;

[0254] The projection window width of projection device B, K2 = B1 * H;

[0255] The projection window width of projection device C, K3 = C1 * H;

[0256] The projection window width of the projection device D, K4 = D1 * H.

[0257] Among them, K1+K2+K3=3840, and the projection screen height H is less than or equal to 2160.

[0258] Therefore, the projection screen height H = 3840 / (A1+A2+A3), and after rounding, H is 670.

[0259] Step 3: Determine the layout based on the projection screen height.

[0260] The projection screen height H calculated in step 2 above is 670, which is less than half the height of the shared device screen (1080). Therefore, a top-bottom layout is adopted.

[0261] Furthermore, the width of each projection window is determined (rounded up) based on the relationship between the aspect ratio of the projection window and half the pixel width H' of the shared device screen.

[0262] The projection window width of projection device A is K1 = A1 * H' = 1680;

[0263] The projection window width of projection device B, K2 = B1 * H' = 2337;

[0264] The projection window width of projection device C, K3 = C1 * H' = 1680;

[0265] The projection window width of the projection device D is K4 = D1 * H' = 500.

[0266] Step 4: Determine the size of the projection window.

[0267] Based on the half pixel width H' of the shared device screen obtained by the above calculation and the width of each projection window, the size of the projection window actually displayed by each projection device on the shared device is determined.

[0268] The projection window size of projection device A is 1680*1080;

[0269] The projection window size of projection device B is 2337*1080;

[0270] The projection window size of projection device C is 1680*1080;

[0271] The projection window size of projection device D is: 500*1080.

[0272] Step 5: Determine the position of the rear projection window based on the size and layout of the projection window.

[0273] Based on the width of each projection window determined in step 3 above, it can be known that if projection device B and projection device D are distributed side by side in a split-screen display area, the sum of the projection window width of projection device B and the projection window width of projection device D is 2837 (500+2337=2837), which is smaller than the pixel width of the split-screen display area of ​​3840 (that is, smaller than the pixel width of the shared device screen). Therefore, the projection windows of projection device B and projection device D do not need to occupy half of the area of ​​the split-screen display area in the default equal division method. The dividing line between the projection window of projection device B and the projection window of projection device D can be moved toward the direction of the projection window of projection device D, so that the projection windows of projection device B and projection device D can be clearly and completely displayed in the split-screen display area.

[0274] For example, as shown in (d) of Figure 5 , the projection windows of projection device A and projection device C are displayed side by side in the upper split-screen display area 504, and the projection windows of projection device B and projection device D are displayed in the lower split-screen display area 505. The dividing line 506 between the projection windows of projection device B and projection device D does not divide the lower split-screen display area into two equal parts, but is closer to the direction of the projection window of projection device D on the right.

[0275] Simply put, in Smart Split Screen mode, the shared device can determine the layout rules of the projection window based on the aspect ratio of the projection device:

[0276] (1) In the case of a left-right layout, multiple projection windows are arranged according to a certain rule based on the calculated projection height, such as the description of (b) in Figure 5 above.

[0277] (2) In the case of a top-down layout, the width of each projection window is determined based on half the pixel height of the shared device screen, and the position of the projection window is further determined based on the width of each projection window. For example, the description of Figure 5 (c) and Figure 5 (d) above.

[0278] (3) In the case of a top-bottom layout, when the sum of the widths of multiple projection windows within a split-screen display area is less than the pixel width of the shared device screen, the size of the projection windows can be dynamically adjusted based on whether the width of each projection window is greater than half the pixel width of the shared device screen, based on the pre-set equal division of multiple projection windows within the split-screen display area. For example, the projection windows of projection devices B and D shown in (d) of Figure 5 above are displayed in the lower split-screen display area.

[0279] It should be noted that even for the same projection device, its aspect ratio may change depending on the device's posture. For example, as shown in Figure 5 (d), projection device B (2532*1170) and projection device D (1170*2532) are the same model mobile terminal with the same screen data, but projection device B is in landscape orientation and its projection window is a landscape interface; projection device D is in portrait orientation and its projection window is a portrait interface. The aspect ratios of the two projection devices are inversely proportional.

[0280] It should be noted that in the above description of the projection layout method, the projection window is used as an example to describe the entire screen of the projection device. When the projection device projects part of the screen (for example, the window of the projection device and the window is not displayed in full screen), the screen resolution of the projection device in the above text can be replaced with the resolution of the projection part of the screen of the projection device.

[0281] S403: Display the screen projection window on the shared device.

[0282] For example, after the shared device determines the projection layout, the projection window can be displayed in the display area of ​​the shared device. When the shared device is in full screen display, the display area of ​​the shared device can be understood as the screen of the shared device.

[0283] Furthermore, the sharing device can change the projection layout of the projection window in response to the user's operation of switching the projection layout mode.

[0284] It should be noted that the user can switch between sequential priority mode, smart split-screen mode, or other projection layout modes through operations on the shared device screen. When the shared device switches the projection layout mode, the shared device can adjust the projection layout of the projection window according to the new projection layout mode. The specific adjustment method can be referred to above and will not be repeated here.

[0285] For example, the embodiments of the present application do not limit the user's operation of switching the projection layout mode. For example, the user triggers the switching of the projection layout mode through a specified gesture; or triggers the selection control of multiple projection layout modes through a specified operation, and clicks the corresponding selection control to achieve the switching of the projection layout mode.

[0286] For ease of understanding, as shown in Figure 6, a schematic diagram of switching the screen projection layout mode is shown. The sharing device is connected to screen projection device A, screen projection device B, and screen projection device C for screen projection, and the current screen projection layout mode is sequential priority mode. There is a dividing line 601 between the main display area and the history display area in the display area of ​​the sharing device. In response to the user's long press operation on the dividing line 601, the sharing device displays the screen projection layout icon 602. Among them, the screen projection layout icon 602 includes a full-screen mode control and a smart split-screen mode control. When the user clicks the full-screen mode control, the screen projection layout mode of the sharing device switches from sequential priority mode to full-screen mode; when the user clicks the smart split-screen control, the screen projection layout mode of the sharing device switches from sequential priority mode to smart split-screen mode. Among them, the full-screen mode is more suitable for scenarios with only one screen projection window. Similarly, if the current screen projection layout mode of the sharing device is smart split-screen mode, the sharing device can display the screen projection layout icon in response to the user's long press operation on the dividing line between any two screen projection windows, so that the user can choose to switch to the new screen projection layout mode.

[0287] After the screen projection window is displayed on the shared device, interaction can be enabled on the shared device to further meet the user's actual needs. Specific interaction methods include the following scenarios.

[0288] Scenario 1: File sharing.

[0289] For example, a user can share files between multiple projection devices by operating on the shared device screen. The following is a detailed introduction to the file sharing method in conjunction with Figure 7. This method can be applied to a system including a sharing device, projection device A, and projection device B, where projection device B is the target device.

[0290] S701: The shared device determines a target file.

[0291] S702: The sharing device determines a target device.

[0292] It should be noted that the sharing device determines the target file and the target device in response to the user's operation. The user's operation on the sharing device can realize file sharing between different projection devices. The files included in the projection window can be used as candidates for the target file. For example, the projection windows of projection device A and projection device B are displayed on the sharing device. The files displayed in the projection window of projection device A and the files displayed in the projection window of projection device B can both be candidates for the target file.

[0293] In one implementation, before the shared device determines the target file, the user needs to complete the screen casting operation on the screen of the projection device, so that the projection window is displayed on the shared device's screen. Furthermore, if the target file is not displayed in the projection window, the user can call the target file by operating the projection device, so that the target file can be displayed in the projection window.

[0294] For example, if the main interface of a mobile phone terminal is displayed on the screen projection window, and the target file is a picture in the mobile phone terminal gallery, the user needs to open the gallery in the mobile phone terminal and call the picture so that the picture is displayed in the screen projection window.

[0295] In one implementation, the user triggering the sharing device to determine the target file and the operation of the target device may be continuous.

[0296] Exemplarily, multiple projection windows are displayed on the screen of the sharing device, and accordingly, multiple files (for example, file A and file B) are displayed in the multiple projection windows. The sharing device responds to the user clicking on file A and dragging file A to the projection window corresponding to projection device B and releasing it. The sharing device determines that the target file is file A and the target device is projection device B.

[0297] Exemplarily, the ways in which the sharing device determines the target screen projection device include but are not limited to the following two.

[0298] 1. Determine the target device based on the release location.

[0299] For example, on the shared device screen, there are two screen projection windows: projection device A and projection device B. The user clicks on a file in the projection window of projection device A, drags the target file into the projection window of projection device B, and releases it. The file in the projection window of projection device A becomes the target file, and projection device B becomes the target device.

[0300] 2. Determine the target device based on user selection.

[0301] Exemplarily, after the user long presses the target file and drags the target file in a certain direction for a certain distance, a thumbnail icon of the device to be selected can be displayed, and the user can select the target device from the thumbnail icons of the device to be selected. Among them, the thumbnail icon of the device to be selected can display icons of other projection devices in addition to the projection device corresponding to the target file, and can also display icons of other projection devices pointed to according to the dragging direction of the target file. The thumbnail icon of the device to be selected can be a thumbnail of the projection window, or an icon that identifies the type of projection device (for example, the thumbnail of a mobile phone terminal is a mobile phone graphic). This application does not limit the specific form of the thumbnail icon of the device to be selected.

[0302] For ease of understanding, FIG8 shows a method for determining a target device according to a user selection.

[0303] As shown in (a) in Figure 8, the screen of the shared device is shown. The shared device is connected to the projection device A, the projection device B, and the projection device C. In response to the user clicking on the projection window of projection device A (or the target file in the window), dragging a certain distance to the upper right (not directly dragging to the projection window of projection device B), the thumbnail icon of the device to be selected is displayed. Among them, the thumbnail icons of the devices to be selected include icon 801 of projection device B and icon 802 of projection device C. When the user clicks on icon 801, the target device is determined to be projection device B; when the user clicks on icon 802, the target device is determined to be projection device C.

[0304] As shown in (b) of Figure 8, the screen of the shared device is shown. The shared device is connected to the projection device A, the projection device B and the projection device C. In response to the user clicking on the projection window of projection device A (or the target file in the projection window), dragging it a certain distance to the upper right (not directly dragging it into the projection window of projection device B), the thumbnail icon of the device to be selected in the upper right is displayed. Among them, the thumbnail icon of the device to be selected in the upper right is the icon 801 of projection device B. Of course, if the user clicks on the projection window of projection device A (or the target file in the window), dragging it a certain distance to the upper left (not directly dragging it into the projection window of projection device C), the thumbnail icon of the device to be selected displayed will be the icon of projection device C.

[0305] Once the shared device determines the target device, you can transfer the target file between different projection devices. The following example uses the target file as a file in the projection window of projection device A and the target device as projection device B to explain the target file transfer process.

[0306] S703, the sharing device sends a file transfer request, and accordingly, the screen projection device A receives the file transfer request.

[0307] S704, the screen projection device A determines the target file according to the file transfer request and downloads the target file.

[0308] S705, the projection device A sends the file sharing service parameters, and accordingly, the sharing device receives the file sharing service parameters.

[0309] That is to say, the projection device A determines the target file based on the file transfer request received from the sharing device, starts the target file download service, and completes the download of the target file.

[0310] Exemplarily, the file sharing service parameters include the Internet protocol (IP) address of projection device A, authentication key, transmission method, etc.

[0311] It should be noted that the specific transmission methods of the target file can include the following two.

[0312] Method 1: Screen projection device A and screen projection device B directly transfer the target file.

[0313] S706, the sharing device sends the file sharing service parameters, and accordingly, the projection device B receives the file sharing service parameters.

[0314] S707, the screen projection device B determines the data channel according to the file sharing service parameters.

[0315] S708, the screen projection device A sends the target file, and correspondingly, the screen projection device B receives the target file.

[0316] That is to say, in method one, projection device B determines the data channel so that projection device A can send the target file to projection device B through the data channel.

[0317] In one implementation, when projection device B receives the target file, the target file can be displayed on the projection window of projection device B; or an icon of the target file can be displayed to indicate that projection device B has received the target file.

[0318] Method 2: The shared device acts as a transfer device to forward the target file.

[0319] S709: The sharing device generates file sharing parameters according to the file sharing service parameters.

[0320] S710, the sharing device sends file sharing parameters, and accordingly, the projection device B receives the file sharing parameters.

[0321] S711, the screen projection device B sends a file download request, and accordingly, the sharing device receives the file download request.

[0322] S712, the sharing device sends a file download request, and accordingly, the screen projection device A receives the file download request.

[0323] S713, the projection device A sends the target file, and correspondingly, the sharing device receives the target file.

[0324] S714, the sharing device sends the target file, and accordingly, the screen projection device B receives the target file.

[0325] That is to say, in method 2, projection device A can transfer the target file to projection device B through the shared device.

[0326] It should be noted that when projection device A and projection device B are not in the same local area network, method 2 can be used to transfer the target file.

[0327] Scenario 2: Moving the projection window.

[0328] Users can move the projection window on the shared device screen by operating on the shared device screen, thereby flexibly adjusting the position of the projection window.

[0329] For example, the shared device's projection layout mode is smart split-screen mode. When using a left-right layout, each projection window is arranged horizontally along the width of the shared device screen, and changes in the projection window position will not affect the projection window size. When using a top-bottom layout, swapping the projection window in the upper split-screen display area with the projection window in the lower split-screen display area may affect the projection window size.

[0330] For ease of understanding, as shown in FIG9 , a schematic diagram of the movement of the projection window is shown.

[0331] As shown in Figure 9 (a), the screen of the shared device is connected to projection devices A, B, and C. In response to the user clicking on the projection window of projection device B and dragging it to the area where the projection window of projection device C is located, the projection windows of projection device B and projection device C are swapped, as shown in Figure 9 (b).

[0332] It should be noted that the shared device shown in (a) of Figure 9 displays each projection window according to the projection layout determined by the smart split screen mode described above. In other words, the shared device shown in (a) of Figure 9 maximizes the use of the display area.

[0333] For example, the screen resolution of projection device A shown in FIG9 (a) is 2800*1800, the screen resolution of projection device B is 2532*1170, the screen resolution of projection device C is 2800*1800, and the screen resolution of the shared device is 3840*2160. According to the description of FIG5 (c) above, the width of the projection window of projection device A is 1680, the width of the projection window of projection device B is 2337, and the width of the projection window of projection device C is 1680. When the positions of the projection windows of projection device B and projection device C are swapped, the projection windows of projection device A and projection device B are arranged side by side as shown in FIG9 (b). If the size of the projection windows remains unchanged, the sum of the widths of the projection windows of projection device A and projection device B (1680+2337=4017) is greater than the width of the shared device screen (3840). At this time, in order to be able to fully display the projection window, the size of each projection window needs to be recalculated. Since the projection window of projection device A and the projection window of projection device B are displayed in the upper split-screen display area 901, it is necessary to redetermine the size of the projection window of projection device A and the projection window of projection device B according to the width of the upper split-screen display area 901. The specific calculation method can refer to the calculation process of the left and right distribution in the smart split-screen mode above, which will not be repeated here. In general, after the positions of the projection windows are swapped, the width of the projection window of projection device A and the projection window of projection device B are reduced, so the height will also be reduced proportionally, and there are two upper and lower shadow areas in the upper split-screen display area (for example, the shadow area shown in (b) in Figure 9).

[0334] Scene 3: Floating projection window.

[0335] Users can display the projection window as a floating window by operating on the shared device screen. At the same time, the position of the floating window can be flexibly moved.

[0336] For ease of understanding, as shown in FIG10 , a schematic diagram of a projection window displayed as a floating window is shown.

[0337] As shown in (a) in Figure 10, it is a shared device. The shared device is connected to the projection device A, the projection device B and the projection device C. In response to the user clicking on the projection window of the projection device B and dragging it to the preset area 1001 in the upper left corner of the shared device screen and then releasing it, the projection window of the projection device B is displayed in the upper left corner of the shared device screen as a floating window, as shown in (b) in Figure 10. The projection layout of the projection window of the projection device A and the projection window of the projection device C can be recalculated according to the aforementioned method. For example, as shown in (b) in Figure 10, the projection window of the projection device A and the projection window of the projection device C are arranged in the left and right distribution manner in the smart split screen mode.

[0338] It should be noted that the user can drag the floating window to any position on the shared device screen.

[0339] As shown in FIG11 , a display method provided by an embodiment of the present application is shown, which can be applied to a communication system including a sharing device and at least two projection devices. The method is described in detail below.

[0340] S1101, obtaining screen projection data of at least two screen projection devices.

[0341] It should be noted that the shared device is connected to at least two projection devices for screen projection, and the shared device receives projection data from at least two projection devices. For example, the shared device can be an electronic device such as a smart screen or electronic whiteboard. The projection device can be a personal device such as a mobile phone terminal, personal computer, or tablet computer.

[0342] The embodiment of the present application does not limit the way in which the shared device and the screen projection device establish a screen projection connection. For example, the shared device and the screen projection device are connected to the same local area network, and screen mirroring is achieved through system-level distributed soft bus technology, so that the screen projection window is mirrored and displayed on the screen of the shared device in real time, thereby achieving a screen projection connection between the shared device and the screen projection device. For another example, the screen projection device can send the screen projection data to the shared device through an application that supports the screen projection function (for example, a video playback application, a conference application, etc.) and transfers the screen projection data through a cloud server. The screen projection device displays the screen projection window on the screen of the shared device.

[0343] Exemplarily, the projection data includes screen data and / or application data. The screen data may include screen data such as screen size, screen resolution, and screen aspect ratio. The application data may include data of applications that the projection device supports the projection function.

[0344] S1102: Determine at least two display areas based on the projection data and projection layout mode of at least two devices.

[0345] It can be understood that when the projection device projects the entire screen, at least two display areas can be determined based on the screen data; when the projection device projects the window of a certain application, at least two display areas can be determined based on the data of the application.

[0346] It should be noted that the screen projection layout mode includes one of the following: smart split-screen mode and sequential priority mode. Configuring different screen projection layout modes on the shared device can use the user's screen projection needs at different stages. When the shared device receives new screen projection data, or the received screen projection data increases, or the resolution of the screen projection window corresponding to the screen projection device that has established a screen projection connection with the shared device changes, the shared device can first determine the screen projection layout mode and determine at least two display areas according to the latest determined screen projection layout mode.

[0347] In one implementation, when the projection layout mode is a sequential priority mode, the shared device determines at least two display areas based on the projection data of at least two projection devices and the sequential priority mode, and the at least two display areas include a first display area and a second display area; in response to the projection connection of the first projection device, the first display area displays the first projection window; in response to the projection connection of the second projection window, the first display area displays the second projection window, and the second display area displays the first projection window.

[0348] It is understandable that when the screen projection layout mode is in sequential priority mode, time priority can be taken into account. That is, the screen projection device that was most recently connected to the shared device has the highest time priority, and the screen projection window corresponding to the screen projection device with the highest time priority is displayed in the first display area.

[0349] For example, the first screen projection device is connected to the shared device for screen projection at time A, and the second screen projection device is connected to the shared device for screen projection at time B. Time A is earlier than time B. At this time, the second screen projection device can be regarded as the latest screen projection device connected to the shared device for screen projection. The second screen projection device has the highest time priority. Therefore, the second screen projection window can be displayed in the first display area. Before that, the first screen projection window corresponding to the first screen projection device connected to the shared device for screen projection can be displayed in the second display area.

[0350] Based on the above solution, users can project the screen windows displayed in a sequential priority layout in a meeting scenario, focusing on displaying the screen windows with high priority, which is more suitable for scenarios where users want to focus on introducing a certain solution in a meeting.

[0351] Furthermore, in response to the user dragging the first projection window to the first display area, the first projection window is displayed in the first display area, and the second projection window is displayed in the second display area; or in response to the user dragging the second projection window to the second display area, the first projection window is displayed in the first display area, and the second projection window is displayed in the second display area.

[0352] That is to say, the user can move the projection window on the screen of the shared device and select the projection window to be displayed in the first display area according to actual needs, so that participants can focus on displaying the solution in a certain projection window.

[0353] In another implementation, when the projection layout mode is a sequential priority mode, at least two display areas are determined based on the projection data of at least two projection devices and the projection layout mode, including: determining at least two display areas based on the projection data of at least two projection devices and the sequential priority mode, the at least two display areas including a first display area and a second display area; in response to the projection connection of the first projection device, the first display area displays a first projection window; in response to the projection connection of the second projection device, the first display area displays a first projection window, and the second display area displays a second projection window.

[0354] It can be seen that even if the second screen projection device is the latest device connected to the shared device for screen projection, it has the highest time priority, and its corresponding second screen projection window is displayed in the second display area.

[0355] In this implementation, when the projection window (first projection window) in the first display area is being displayed, the projection window corresponding to the projection device newly connected to the shared device will also be displayed in the second display area as a candidate. Among them, the first projection window is being displayed, which can be understood as in a meeting scenario, user A is presenting a plan through the first projection window. At this time, when the shared device is connected to a new projection device, the first display area still maintains the first projection window to avoid affecting the process of the current user A presenting the plan.

[0356] Furthermore, in response to the user dragging the second projection window to the first display area, the second projection window is displayed in the first display area, and the first projection window is displayed in the second display area; or in response to the user dragging the first projection window to the second display area, the second projection window is displayed in the first display area, and the first projection window is displayed in the second display area.

[0357] It is understandable that the second projection device is the most recent projection device connected to the shared device in terms of timing. Before the user performs certain operations to display the second projection window in the first display area, it can be considered that the projection window currently displayed in the first display area (the first projection window) has not completed the display. For example, in a meeting scenario, the user is presenting a plan through the first projection window.

[0358] Based on the above solution, the projection window corresponding to the projection device that is most recently connected to the shared device will be displayed in the second display area. When the projection window (first projection window) in the first display area is displayed, the projection window can be moved by the user's operation to move the projection window, so that the projection window (second projection window) in the second display area can be moved to the first display area.

[0359] Exemplarily, the sequential priority mode can be shown as (a) in Figure 5. The first display area can be understood as the main display area, and the second display area can be understood as the history display area. Among them, the main display area 502 occupies most of the shared device display area, and the history display area 501 occupies a small part of the shared device display area. The main display area can display the current projection window (first projection window), and the history display area can display the history projection window (second projection window).

[0360] For a detailed introduction to the sequence priority mode, please refer to the description of (a) in FIG5 above, which will not be repeated here.

[0361] In another implementation, when the projection layout mode is a smart split-screen mode, the shared device determines at least two display areas based on the projection data and display layout method of at least two projection devices, wherein the smart split-screen mode includes a display layout method, and the display layout method includes a left-right layout method and an up-down layout method.

[0362] It should be noted that the left-right layout can be understood as the width direction of at least two display areas being arranged along the width direction of the shared device screen; the top-bottom layout can be understood as the height direction of at least two areas being arranged along the height direction of the shared device screen.

[0363] In this case, before the sharing device determines at least two display areas according to the at least two projection devices and the display layout, the sharing device first determines the display layout.

[0364] Specifically, the sharing device determines the projection height based on the screen data of at least two projection devices and the screen data of the sharing device, wherein the screen data includes the screen pixel height and the screen pixel width, and further determines the display layout mode based on the projection height.

[0365] Among them, the calculation method of the projection screen height can be found in the description of Figure 5 above, and will not be repeated here.

[0366] In one case, when the projection screen height is greater than half of the screen pixel height of the sharing device, the display layout is determined to be a left-right layout.

[0367] For example, FIG5(b) shows a schematic diagram of a left-right layout. When at least two display areas are arranged in a left-right layout, the heights of at least two display areas are the same. In this case, the height of the display area is the projection height.

[0368] In another case, when the projection screen height is less than or equal to half of the screen pixel height of the sharing device, the display layout mode is determined as the top-bottom layout mode.

[0369] For example, as shown in (c) in FIG5 , there is a schematic diagram of an upper and lower layout method. The display area includes a first split-screen display area and a second split-screen display area. The height of the split-screen display area can be defaulted to half the pixel height of the shared device. The first split-screen display area can be the upper split-screen display area 504 as shown in (c) in FIG5 , and the second split-screen display area can be the lower split-screen display area 505 as shown in (c) in FIG5 . It can be preset that a maximum of two projection windows can be displayed in each split-screen display area.

[0370] S1103, display at least two projection windows in at least two display areas.

[0371] It should be noted that at least two projection windows correspond to at least two projection devices. For example, the first projection window corresponds to the first projection device, the second projection window corresponds to the second projection device, the third projection window corresponds to the third projection device, and the fourth projection window corresponds to the fourth projection device. It is understandable that the specific content displayed in the projection window is the same as the content displayed on the projection device screen. For example, when the screen of the projection device is displayed as the main interface of the device, the projection window corresponding to the projection device on the shared device will also display the main interface of the device.

[0372] It should be noted that when the display layout is a left-right layout, before displaying at least two projection windows in at least two display areas, the sizes of the at least two projection windows need to be determined.

[0373] Exemplarily, the sharing device determines the size of the at least two projection windows based on the screen data of the at least two projection devices, the screen pixel width of the sharing device, and the projection height. In this case, the size of the display area is the same as the size of the projection window.

[0374] In the left-right distribution mode, the process of determining the size of each projection window can be found in the description of (b) in Figure 5 above, and will not be repeated here.

[0375] It should be noted that when the display layout is a top-down layout, before displaying at least two projection windows in at least two display areas, the sizes of the at least two projection windows need to be determined.

[0376] Specifically, the sizes of at least two projection windows can be determined based on the screen data of at least two projection devices, the screen pixel width of the shared device, and the height of the split-screen display area.

[0377] In the up-and-down distribution mode, the process of determining the size of each projection window can be found in the description of (c) in Figure 5 above, and will not be repeated here.

[0378] It should be noted that, as shown in (c) of Figure 5, when distributed up and down, the size of the projection window is not necessarily the same as the size of the display area. Generally speaking, the size of the projection window is less than or equal to the size of the display area.

[0379] As you can see, when the screen is distributed horizontally, the width of the projection window is determined by the projection height, and the height of the projection window is the projection height, so the size of the projection window can be determined. When the screen is distributed vertically, the width of the projection window is determined by the height of the split-screen display area (half the pixel height of the shared device's screen), and the height of the projection window is half the pixel height of the shared device's screen, so the size of the projection window can be determined.

[0380] In one implementation, when a sharing device displays at least two projection windows in at least two display areas in a sequential priority mode, the sharing device displays at least one mode control in response to a first operation of the user, wherein the at least one mode control includes a smart split-screen mode control and / or a full-screen mode control.

[0381] Exemplarily, in response to the user's operation on the smart split-screen mode control, the shared device switches the screen projection layout mode from the sequential priority mode to the smart split-screen mode; or, in response to the user's operation on the full-screen mode control, the shared device switches the screen projection layout mode from the sequential priority mode to the full-screen mode.

[0382] For example, the sharing device displays at least two projection areas in a sequential priority mode as shown in Figure 6, and the at least two projection display areas include a main display area and a history display area. There is a dividing line 601 between the main display area and the history display area. In response to the user's operation on the dividing line 601 (first operation), the sharing device displays a projection layout icon 602. The projection layout icon 602 includes a full-screen mode control and a smart split-screen mode control. The sharing device switches the projection layout mode in response to the user's operation on different controls. This enables the projection layout mode of the shared device to be flexibly adapted to the user's current needs.

[0383] It should be noted that when the projection window is displayed on the shared device, it can also meet the user's interaction requirements.

[0384] For example, files can be shared among multiple projection devices through user operations on the shared device.

[0385] In one implementation, the shared device displays a third projection window and a fourth projection window, the third projection window corresponds to the third projection device, and the fourth projection window corresponds to the fourth projection device; in response to the user's operation in the third projection window, the controls of the fourth projection device are displayed; in response to the user's operation on the controls of the fourth projection device, the fourth projection device is determined to be the target device, and the content displayed in the third projection window is the target file.

[0386] In one implementation, in response to the user dragging the target file from the third projection window to the fourth projection window, the sharing device displays the target file in the fourth projection window.

[0387] For example, as shown in (a) in Figure 8, the third projection device may be projection device A, and the fourth projection device may be projection device B. The user's operation in the third projection window may be that the user clicks on the projection window of projection device A and drags it to the upper right to display the control of projection device B (for example, icon 801). When the user clicks icon 801, it means that the target device is selected as projection device B. The content displayed in the projection window of projection device A is the target file. For details, please refer to the description of Figure 8 above, which will not be repeated here.

[0388] For example, the projection window on the shared device can be moved through the user's operation on the shared device.

[0389] In one implementation, in response to the user dragging the third projection window to the location of the fourth projection window, the shared device swaps the positions of the third projection window and the fourth projection window; or in response to the user dragging the fourth projection window to the location of the third projection window, the third projection window and the fourth projection window swap their positions.

[0390] For example, as shown in (a) in Figure 9, in response to the user clicking on the projection window of projection device B and dragging it to the area where the projection window of projection device C is located and releasing it, the projection window of projection device B and the projection window of projection device C are swapped.

[0391] It should be noted that when the position of the projection window changes, the size of the projection window may also change. For details, please refer to the description of (b) in Figure 9 above, which will not be repeated here.

[0392] For example, through the user's operation on the shared device, the projection window on the shared device can be displayed as a floating window.

[0393] In one implementation, in response to the third projection window being dragged to a preset area, the sharing device displays the third projection window in the preset area as a floating window.

[0394] For example, as shown in (a) in Figure 10, in response to the user clicking on the projection window of projection device B and dragging it to the preset area 1001 in the upper left corner of the sharing device and then releasing it, the projection window of projection device B is displayed in the form of a floating window in the upper left corner of the sharing device screen.

[0395] It should be noted that when the projection window is changed to a floating window display, the projection layout of other projection windows needs to be recalculated according to the above method.

[0396] This application provides a display method, electronic device, and system. When a shared device establishes a screen projection connection with multiple projection devices, multiple projection windows can be fully displayed on the screen of the shared device according to the user's current actual needs. In addition, the user can achieve multiple interactions on the shared device, improving the user experience.

[0397] The present application provides a computer program product that, when executed on a device, enables the device to execute the technical solution in the above embodiment. The implementation principle and technical effects are similar to those of the above method-related embodiments and will not be described in detail here.

[0398] The present embodiment provides a readable storage medium containing instructions that, when executed on a device, cause the device to execute the technical solution of the above embodiment. The implementation principles and technical effects are similar and will not be further described here.

[0399] The present application provides a chip for executing instructions. When the chip is running, the technical solution in the above embodiment is executed. The implementation principle and technical effect are similar and will not be described in detail here.

[0400] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the embodiments of this application.

[0401] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices and units (modules) can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0402] In the several embodiments provided in this application, it should be understood that the disclosed devices, apparatuses and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the unit is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0403] The units described above as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0404] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0405] If the above functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0406] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A display method, characterized in that: The method is applied to a shared device, wherein the shared device is connected to at least two screen projection devices for screen projection, and includes: Acquire projection data of the at least two projection devices, where the projection data includes screen data and / or application data; At least two display areas are determined according to the projection data of the at least two projection devices and the projection layout mode, wherein the projection layout mode includes one of the following: Smart split-screen mode, sequential priority mode; At least two screen projection windows are displayed in the at least two display areas, and the at least two screen projection windows correspond to the at least two screen projection devices.

2. The method according to claim 1, characterized in that When the screen projection layout mode is the smart split screen mode, determining at least two display areas according to the screen projection data of the at least two screen projection devices and the screen projection layout mode includes: At least two display areas are determined based on the projection data of the at least two projection devices and the display layout method, wherein the smart split screen mode includes the display layout method, and the display layout method includes a left-right layout method and an up-down layout method.

3. The method according to claim 2, characterized in that Before determining at least two display areas according to the projection data and display layout of the at least two projection devices, the method further includes: Determine the projection screen height according to the screen data of the at least two projection devices and the screen data of the shared device, wherein the screen data includes a screen pixel height and a screen pixel width; The display layout mode is determined according to the projection screen height.

4. The method according to claim 3, characterized in that The determining the display layout mode according to the projection screen height includes: According to the projection screen height being greater than half of the screen pixel height of the shared device, the display layout mode is determined to be the left-right layout mode.

5. The method according to claim 4, characterized in that Before displaying at least two projection windows in the at least two display areas, the method further includes: Determine the sizes of the at least two screen projection windows according to the screen data of the at least two screen projection devices, the screen pixel width of the shared device, and the screen projection height; The size of the at least two display areas is the same as the size of the at least two projection windows.

6. The method according to claim 3, characterized in that The determining the display layout mode according to the projection screen height includes: According to the projection screen height being less than or equal to half of the screen pixel height of the shared device, the display layout mode is determined to be the top-bottom layout mode.

7. The method according to claim 6, characterized in that When the display layout is in the up-and-down layout mode, the at least two display areas include a first split-screen display area and a second split-screen display area, and the height of the split-screen display area is half of the pixel height of the shared device; Before displaying at least two projection windows in the at least two display areas, the method further includes: The sizes of the at least two projection windows are determined according to the screen data of the at least two projection devices, the screen pixel width of the shared device, and the height of the split-screen display area.

8. The method according to claim 1, characterized in that When the screen projection layout mode is the order priority mode, determining at least two display areas according to the screen projection data of the at least two screen projection devices and the screen projection layout mode includes: Determine the at least two display areas according to the projection data of the at least two projection devices and the sequence priority mode, wherein the at least two display areas include a first display area and a second display area; In response to the screen projection connection of the first screen projection device, the first display area displays a first screen projection window; In response to the screen projection connection of the second screen projection device, the first display area displays the second screen projection window, and the second display area displays the first screen projection window.

9. The method according to claim 8, characterized in that The method further comprises: In response to the user dragging the first screen projection window to the first display area, the first screen projection window is displayed in the first display area, and the second screen projection window is displayed in the second display area; or In response to the user dragging the second projection window to the second display area, the first projection window is displayed in the first display area. Window, the second projection window is displayed in the second display area.

10. The method according to claim 1, characterized in that When the screen projection layout mode is the order priority mode, determining at least two display areas according to the screen projection data of the at least two screen projection devices and the screen projection layout mode includes: Determine the at least two display areas according to the projection data of the at least two projection devices and the sequence priority mode, wherein the at least two display areas include a first display area and a second display area; In response to the screen projection connection of the first screen projection device, the first display area displays a first screen projection window; In response to the screen projection connection of the second screen projection device, the first display area displays the first screen projection window, and the second display area displays the second screen projection window.

11. The method according to claim 10, characterized in that The method further comprises: In response to the user dragging the second projection window to the first display area, the second projection window is displayed in the first display area, and the first projection window is displayed in the second display area; or In response to the user dragging the first projection window to the second display area, the second projection window is displayed in the first display area, and the first projection window is displayed in the second display area.

12. The method according to any one of claims 1 to 11, characterized in that The method further comprises: When the sharing device displays at least two projection windows in the at least two display areas in the sequential priority mode, the sharing device displays at least one mode control in response to a first operation of the user, wherein the at least one mode control includes a smart split-screen mode control and / or a full-screen mode control; In response to a user's operation on the smart split-screen mode control, the projection layout mode is switched from the sequential priority mode to the smart split-screen mode; or In response to a user's operation on the full-screen mode control, the projection layout mode is switched from the sequential priority mode to the full-screen mode.

13. The method according to any one of claims 1 to 12, characterized in that The method further comprises: The shared device displays a third screen projection window and a fourth screen projection window, the third screen projection window corresponds to the third screen projection device, and the fourth screen projection window corresponds to the fourth screen projection device; In response to a user operation in the third screen projection window, displaying a control of the fourth screen projection device; In response to the user's operation on the control of the fourth screen projection device, the fourth screen projection device is determined to be the target device, and the content displayed in the third screen projection window is the target file.

14. The method according to claim 13, characterized in that The method further comprises: In response to the user dragging the target file from the third projection window to the fourth projection window, the target file is displayed in the fourth projection window.

15. The method according to claim 13 or 14, characterized in that The method further comprises: In response to the user dragging the third projection window to the location of the fourth projection window, the third projection window and the fourth projection window are swapped; or In response to the user dragging the fourth projection window to the location of the third projection window, the positions of the third projection window and the fourth projection window are swapped.

16. The method according to any one of claims 13 to 15, characterized in that The method further comprises: In response to the user dragging the third projection window to the preset area, the third projection window is displayed in the preset area as a floating window.

17. An electronic device, characterized in that: include: one or more processors; one or more memories; display screen; the one or more memories store one or more computer programs, the one or more computer programs include instructions, when the instructions are executed by the one or more processors, the electronic device executes the method described in any one of claims 1 to 16.

18. A display system, characterized in that: The system comprises a sharing device as described in any one of claims 1 to 16 and at least two screen projection devices.

19. A display device, characterized in that: include: A processor coupled to a memory, wherein the memory is used to store a computer program, and the processor is used to run the computer program so that the display device performs the method according to any one of claims 1 to 16.

20. The display device according to claim 19, characterized in that Also included is one or more of the memory and the transceiver, wherein the transceiver is used to receive signals and / or send signals.

21. A computer-readable storage medium, characterized in that: A computer program is stored thereon, and when the computer program is executed by a computer, the computer is caused to implement the method according to any one of claims 1 to 16.

22. A computer program product comprising instructions, characterized in that When the computer program product is run on a computer, the computer is caused to perform the method according to any one of claims 1 to 16.

23. A chip, characterized in that: The chip includes a processor and a data interface, and the processor reads instructions stored in a memory through the data interface to execute the method according to any one of claims 1 to 16.

Images