A multi-screen display control method, device, equipment and readable storage medium

Abstract

The application discloses a multi-screen display control method and device, equipment and a readable storage medium, and belongs to the technical field of multi-screen equipment. The method comprises the following steps: acquiring the hardware type of a multi-screen equipment; when two or more than two applications are running on the multi-screen equipment, performing split-screen layout on the applications according to the hardware type and the horizontal screen frame data of the applications; simultaneously displaying the two or more than two applications on the display screen of the multi-screen equipment according to the split-screen layout result; and adjusting the split-screen layout of the display screen according to the hardware parameters of the multi-screen equipment and the interface data of the running applications, thereby improving the user experience.

Description

Technical Field

[0001] This article relates to the field of multi-screen device technology, and in particular to a multi-screen display control method, apparatus, device and readable storage medium. Background Technology

[0002] Foldable dual-screen phones have already been released, and flexible screens are also under development, providing strong technological support for the development of foldable devices. Currently, dual-screen foldable screens generally have two application modes: folded and unfolded. In the folded state, the user focuses on using the current screen, while the other screen is black. In the unfolded state, the user can use two applications simultaneously, displayed on both screens, or use the same application completely on both screens. However, the methods for adjusting the display layout of two or more applications used simultaneously on multi-screen devices are currently relatively limited. Android supports split-screen, treating the entire screen as a window and using a split-screen approach to place different applications within this window; in this approach, the split lines need to be manually adjusted by the user. Windows has adaptations for pane size, but this is generally achieved by dragging the borders or corners with a mouse. When used on portable devices, due to their smaller size and denser hot areas, this control method is not suitable for directly utilizing the touch operation of portable devices. Summary of the Invention

[0003] This article provides a multi-screen display control method, device, equipment, and readable storage medium, which adjusts the screen layout based on the hardware parameters of the multi-screen device and the interface data of the running application, thereby improving the user experience.

[0004] The technical solution adopted in this paper to solve the above-mentioned technical problems is as follows:

[0005] According to one aspect of this paper, a multi-screen display control method is provided, comprising:

[0006] Obtain the hardware type of the multi-screen device;

[0007] When two or more applications are running on the multi-screen device, the applications are arranged in a split-screen layout according to the hardware type and the landscape aspect ratio data of the applications.

[0008] Based on the split-screen layout result, the two or more applications are simultaneously displayed on the screen of the multi-screen device.

[0009] According to another aspect of this document, a multi-screen display control device is provided, comprising:

[0010] The acquisition module is used to obtain the hardware type of multi-screen devices;

[0011] The processing module is used to perform split-screen layout of the applications based on the hardware type and the landscape aspect ratio data of the applications when two or more applications are running on the multi-screen device.

[0012] The display module is used to simultaneously display two or more applications on the display screen of the multi-screen device according to the split-screen layout result.

[0013] According to another aspect of this document, an electronic device is provided, including a memory, a processor, and at least one application stored in the memory and configured to be executed by the processor, the application being configured to perform the multi-screen display control method described above.

[0014] According to another aspect of this document, a readable storage medium is provided on which a computer program is stored, which, when executed by a processor, implements the multi-screen display control method described above.

[0015] This invention discloses a multi-screen display control method, apparatus, device, and readable storage medium. The method includes: obtaining the hardware type of a multi-screen device; when two or more applications are running on the multi-screen device, performing a split-screen layout for the applications based on the hardware type and the landscape aspect ratio data of the applications; simultaneously displaying the two or more applications on the display screen of the multi-screen device according to the split-screen layout result; and adjusting the split-screen layout of the display screen according to the hardware parameters of the multi-screen device and the interface data of the running applications, thereby improving the user experience. Attached Figure Description

[0016] Figure 1 This is a flowchart of a multi-screen display control method provided in Embodiment 1 of the present invention;

[0017] Figure 2 This is a schematic diagram of the hardware type of the multi-screen device provided in Embodiment 1 of the present invention;

[0018] Figure 3 for Figure 1 A flowchart of one method for step S20;

[0019] Figure 4 This is a schematic diagram of a split-screen application corresponding to the seamless connection device for partially flexible screens during tiling provided in Embodiment 1 of the present invention.

[0020] Figure 5 This is a schematic diagram of a split-screen application corresponding to the seamless connection device for partially flexible screens during tiling provided in Embodiment 1 of the present invention;

[0021] Figure 6 This is a schematic diagram of a split-screen application corresponding to the seamless connection device of the overall flexible screen when tiling provided in Embodiment 1 of the present invention.

[0022] Figure 7 for Figure 1 Flowchart of another method for step S20;

[0023] Figure 8 This is a schematic diagram of a horizontal screen application corresponding to a device with seamless connection of partially flexible screens in a top-bottom layout, as provided in Embodiment 1 of the present invention.

[0024] Figure 9 This is a schematic diagram of a split-screen application corresponding to a horizontal screen application of a device with a seamless connection of an overall flexible screen in a top-bottom layout, as provided in Embodiment 1 of the present invention.

[0025] Figure 10 This is a schematic diagram of the split-screen operation corresponding to the activation of different applications provided in Embodiment 1 of the present invention;

[0026] Figure 11 This is an exemplary structural block diagram of a multi-screen display control device provided in Embodiment 2 of the present invention.

[0027] The objectives, features, and advantages of this document will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0028] To make the technical problems, solutions, and beneficial effects described herein clearer and more understandable, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this document.

[0029] Example 1

[0030] like Figure 1 As shown, in this embodiment, a multi-screen display control method includes:

[0031] Step S10: Obtain the hardware type of the multi-screen device;

[0032] Step S20: When two or more applications are running on the multi-screen device, the applications are split-screen based on the hardware type and the landscape aspect ratio data of the applications.

[0033] Step S30: Display the two or more applications simultaneously on the display screen of the multi-screen device according to the split-screen layout result.

[0034] In this embodiment, the split-screen layout of the display screen is adjusted according to the hardware parameters of the multi-screen device and the interface data of the running application, thereby improving the user experience.

[0035] In this embodiment, the multi-screen device is a terminal device that has multiple screen displays and supports opening different applications on each screen simultaneously.

[0036] In this embodiment, the hardware type of the multi-screen device includes, but is not limited to, seamless connection of rigid screens, such as... Figure 2 As shown in Figure -1, the flexible screens are seamlessly connected in certain areas, such as... Figure 2 As shown in Figure -2, it is seamlessly connected to the overall flexible screen, as... Figure 2 As shown in Figure 3.

[0037] In this embodiment, for multi-screen devices with seams between the rigid screens, due to the influence of the seam, regardless of the device's orientation (portrait or landscape) or whether the application is in landscape or non-landscape mode, each screen occupies a dual-screen space based on the middle gap. Therefore, no special processing is applied to current technologies, and this is outside the scope of this discussion. This embodiment only addresses seamless multi-screen devices, i.e., as... Figure 2 -2 and Figure 2 -3 shows the two screen types.

[0038] In this embodiment, when there are two applications, the display screen is divided into a first pane and a second pane. That is, the screen is divided into two windows, each corresponding to one application.

[0039] As another embodiment, when the number of applications is greater than two, the display screen is divided into multiple windows, each window corresponding to one application, and the subsequent processing method can be referred to this embodiment.

[0040] like Figure 3 As shown, in this embodiment, step S20 may include:

[0041] Step S21: When the multi-screen device is in a tiled state, obtain the landscape frame data of the application;

[0042] In this context, the tiled state refers to two applications occupying the left and right halves of the display screen, respectively, as shown in the diagram below. Figure 4 As shown, the corresponding layout is top and bottom, where the two applications occupy the top and bottom parts of the screen respectively.

[0043] Step S22: When the application includes a landscape application and a non-landscape application, set the second pane as the smallest effective display pane and place the non-landscape application in the second pane; set the remaining area of ​​the display screen as the first pane and place the landscape application in the first pane, the area of ​​the first pane being larger than that of the second pane;

[0044] Step S23: When the application includes two non-landscape applications, the display screen is divided into a first pane and a second pane, and the two non-landscape applications are placed in the first pane and the second pane respectively.

[0045] In this embodiment, when the hardware type of the multi-screen device is a partially flexible screen seamless connection, its landscape application split-screen diagram is as follows: Figure 4 As shown, the left pane is the first pane, which displays landscape applications such as video playback and landscape games, while the right pane is the second pane, which displays non-landscape applications such as chat windows and reading windows.

[0046] In this embodiment, the minimum effective display pane refers to the minimum pane size required for a non-landscape application to display normally. If the pane is too small, it will affect the display and use of the application.

[0047] In this embodiment, when neither application is a landscape application or both are landscape applications, the split-screen diagram is as follows: Figure 5 As shown, the two panes divide the display screen equally.

[0048] In this embodiment, when the hardware type of the multi-screen device is a seamless connection of an integral flexible screen, the aspect ratio of the display screen is calculated according to the unfolding angle of the multi-screen device, and the minimum effective display pane is set according to the aspect ratio.

[0049] In this embodiment, a schematic diagram of the split-screen application in landscape mode for a multi-screen device with a seamlessly connected overall flexible screen is shown below. Figure 6 As shown, the left pane is the first pane, which displays landscape applications such as video playback and landscape games, while the right pane is the second pane, which displays non-landscape applications such as chat windows and reading windows.

[0050] like Figure 7 As shown, in this embodiment, step S20 further includes:

[0051] Step S25: When the multi-screen device is in a vertical layout state, obtain the landscape frame data of the application;

[0052] Step S26: When the application includes a landscape application and a non-landscape application, set the first pane according to the size of the landscape application, place the landscape application in the first pane, set the remaining area of ​​the display screen as the second pane, and place the non-landscape application in the second pane.

[0053] Step S27: When the application includes two non-landscape applications, the display screen is divided into a first pane and a second pane, and the two non-landscape applications are placed in the first pane and the second pane respectively.

[0054] In this embodiment, when the hardware type of the multi-screen device is a partially flexible screen seamless connection, its landscape application split-screen diagram is as follows: Figure 8As shown, the top pane is the first pane, which displays landscape applications, such as video playback and landscape games, while the bottom pane is the second pane, which displays non-landscape applications, such as chat windows and reading windows.

[0055] In this embodiment, when the device orientation is such that applications are laid out vertically, and two applications are opened, one of which is suitable for landscape mode, it is first determined whether the layout required for the landscape application exceeds half the screen. If it does, the area of ​​the first pane is larger than that of the second pane. Figure 8 As shown in Figure -1, if the layout required by a landscape application does not exceed half of the screen, the remaining space is allocated to another application, such as... Figure 8 As shown in Figure 2.

[0056] In this embodiment, when the hardware type of the multi-screen device is a seamlessly connected flexible screen, its landscape application split-screen diagram is as follows: Figure 9 As shown, in particular, if a landscape application's size has already been height-fitted to fill the entire screen within the largest pane, another application can fully utilize the remaining space without being limited to the small pane display.

[0057] As another embodiment, if both currently open applications are landscape applications, they will be evenly distributed horizontally or vertically without any special adjustments.

[0058] like Figure 10 As shown in Figure 1, in this embodiment, when the landscape application is the currently active application, the second pane where the non-landscape application is located is the smallest effective display pane; as... Figure 10 As shown in Figure 2, when the non-landscape application is the currently active application, the area of ​​the first pane is reduced and the area of ​​the second pane is increased according to a preset ratio.

[0059] Example 2

[0060] like Figure 11 As shown, in this embodiment, a multi-screen display control device includes:

[0061] Module 10 is used to obtain the hardware type of the multi-screen device;

[0062] Processing module 20 is used to perform split-screen layout of the applications according to the hardware type and the landscape frame data of the applications when two or more applications are running on the multi-screen device.

[0063] Display module 30 is used to simultaneously display two or more applications on the display screen of the multi-screen device according to the split-screen layout result.

[0064] In this embodiment, the split-screen layout of the display screen is adjusted according to the hardware parameters of the multi-screen device and the interface data of the running application, thereby improving the user experience.

[0065] In this embodiment, the multi-screen device is a terminal device that has multiple screen displays and supports opening different applications on each screen simultaneously.

[0066] In this embodiment, the hardware type of the multi-screen device includes: a rigid screen with seamless connection, such as... Figure 2 As shown in Figure -1, the flexible screens are seamlessly connected in certain areas, such as... Figure 2 As shown in Figure -2, it is seamlessly connected to the overall flexible screen, as... Figure 2 As shown in Figure 3.

[0067] In this embodiment, for multi-screen devices with seams between the rigid screens, due to the influence of the seam, regardless of the device's orientation (portrait or landscape) or whether the application is in landscape or non-landscape mode, each screen occupies a dual-screen space based on the middle gap. Therefore, no special processing is applied to current technologies, and this is outside the scope of this discussion. This embodiment only addresses seamless multi-screen devices, i.e., as... Figure 2 -2 and Figure 2 -3 shows the two screen types.

[0068] In this embodiment, when there are two applications, the display screen is divided into a first pane and a second pane. That is, the screen is divided into two windows, each corresponding to one application.

[0069] As another embodiment, when the number of applications is greater than two, the display screen is divided into multiple windows, each window corresponding to one application, and the subsequent processing method can be referred to this embodiment.

[0070] Example 3

[0071] In this embodiment, an electronic device includes a memory, a processor, and at least one application stored in the memory and configured to be executed by the processor, the application being configured to perform the multi-screen display control method described in Embodiment 1.

[0072] Example 4

[0073] This invention provides a readable storage medium storing a computer program thereon, which, when executed by a processor, implements any of the method embodiments described in the above-described multi-screen display control method embodiments.

[0074] It should be noted that the above-mentioned device, equipment and readable storage medium embodiments and method embodiments belong to the same concept. For details of their specific implementation process, please refer to the method embodiments. Furthermore, the technical features in the method embodiments are all applicable to the device embodiments, and will not be repeated here.

[0075] This invention discloses a multi-screen display control method, apparatus, device, and readable storage medium. The method includes: obtaining the hardware type of a multi-screen device; when two or more applications are running on the multi-screen device, performing a split-screen layout for the applications based on the hardware type and the landscape aspect ratio data of the applications; simultaneously displaying the two or more applications on the display screen of the multi-screen device according to the split-screen layout result; and adjusting the split-screen layout of the display screen according to the hardware parameters of the multi-screen device and the interface data of the running applications, thereby improving the user experience.

[0076] Those skilled in the art will understand that all or some of the steps, systems, or devices disclosed above can be implemented as software, firmware, hardware, or suitable combinations thereof.

[0077] In hardware implementations, the division between functional modules / units mentioned in the above description does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be performed collaboratively by several physical components. Some or all physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application-specific integrated circuit. Such software may be distributed on a computer-readable medium, which may include computer storage media (or non-transitory media) and communication media (or transient media). As is known to those skilled in the art, the term computer storage media includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disc (DVD) or other optical disc storage, magnetic cartridges, magnetic tape, disk storage or other magnetic storage devices, or any other medium that can be used to store desired information and is accessible to a computer. Furthermore, as is known to those skilled in the art, communication media typically contain computer-readable instructions, data structures, program modules, or other data in modulated data signals such as carrier waves or other transmission mechanisms, and may include any information delivery medium.

[0078] The preferred embodiments of the present invention have been described above with reference to the accompanying drawings, but this does not limit the scope of the invention. Any modifications, equivalent substitutions, and improvements made by those skilled in the art without departing from the scope and spirit of the present invention should be within the scope of the present invention.

Claims

1. A multi-screen display control method, characterized in that, include: Obtain the hardware type of the multi-screen device; When two or more applications are running on the multi-screen device, the applications are divided into a split-screen layout according to the hardware type and the landscape aspect ratio data of the applications. The split-screen layout includes: when there are two applications, the display screen is divided into a first pane and a second pane. Based on the split-screen layout result, the two or more applications are simultaneously displayed on the display screen of the multi-screen device; The step of splitting the application into a split-screen layout based on the hardware type and the application's landscape aspect ratio data includes: When the multi-screen device is in a tiled state, obtain the landscape frame data of the application; When the application includes a landscape application and a non-landscape application, the second pane is set as the smallest effective display pane, and the non-landscape application is placed in the second pane; the remaining area of ​​the display screen is set as the first pane, and the landscape application is placed in the first pane; When the application includes two non-landscape applications, the display screen is divided into a first pane and a second pane, and the two non-landscape applications are placed in the first pane and the second pane, respectively.

2. The multi-screen display control method according to claim 1, characterized in that, The hardware types of the multi-screen devices include: seamless connection of partial flexible screens and seamless connection of overall flexible screens.

3. The multi-screen display control method according to claim 2, characterized in that, When the hardware type of the multi-screen device is a seamless connection of a flexible screen, the aspect ratio of the display screen is calculated based on the unfolding angle of the multi-screen device, and the minimum effective display pane is set based on the aspect ratio.

4. A multi-screen display control method according to any one of claims 1 or 3, characterized in that, When the landscape application is the currently active application, the second pane where the non-landscape application is located is the smallest effective display pane; when the non-landscape application is the currently active application, the area of ​​the first pane is reduced and the area of ​​the second pane is increased according to a preset ratio.

5. The multi-screen display control method according to claim 1, characterized in that, When the application includes two landscape applications, the display screen is divided into a first pane and a second pane, and the two landscape applications are placed in the first pane and the second pane, respectively.

6. A multi-screen display control method, characterized in that, include: Obtain the hardware type of the multi-screen device; When two or more applications are running on the multi-screen device, the applications are divided into a split-screen layout according to the hardware type and the landscape aspect ratio data of the applications. The split-screen layout includes: when there are two applications, the display screen is divided into a first pane and a second pane. Based on the split-screen layout result, the two or more applications are simultaneously displayed on the display screen of the multi-screen device; The step of splitting the application into a split-screen layout based on the hardware type and the application's landscape aspect ratio data includes: When the multi-screen device is in a vertical layout, obtain the landscape frame data of the application; When the application includes a landscape application and a non-landscape application, the first pane is set according to the size of the landscape application, the landscape application is placed in the first pane, the remaining area of ​​the display screen is set as the second pane, and the non-landscape application is placed in the second pane. When the application includes two non-landscape applications, the display screen is divided into a first pane and a second pane, and the two non-landscape applications are placed in the first pane and the second pane respectively. When the application includes two landscape applications, the display screen is divided into a first pane and a second pane, and the two landscape applications are placed in the first pane and the second pane, respectively.

7. The multi-screen display control method according to claim 6, characterized in that, The hardware types of the multi-screen devices include: seamless connection of partial flexible screens and seamless connection of overall flexible screens.

8. A multi-screen display control method according to claim 7, characterized in that, When the hardware type of the multi-screen device is a seamless connection of a flexible screen, the aspect ratio of the display screen is calculated based on the unfolding angle of the multi-screen device, and the minimum effective display pane is set based on the aspect ratio.

9. A multi-screen display control method according to claim 6, characterized in that, When the landscape application is the currently active application, the second pane where the non-landscape application is located is the smallest effective display pane; when the non-landscape application is the currently active application, the area of ​​the first pane is reduced and the area of ​​the second pane is increased according to a preset ratio.

10. A multi-screen display control device, characterized in that, include: The acquisition module is used to obtain the hardware type of multi-screen devices; The processing module is used to perform a split-screen layout for the applications based on the hardware type and the landscape aspect ratio data of the applications when two or more applications are running on the multi-screen device. The split-screen layout includes: when there are two applications, dividing the display screen into a first pane and a second pane. The display module is used to simultaneously display two or more applications on the display screen of the multi-screen device according to the split-screen layout result; The processing module is configured to: acquire the landscape aspect ratio data of the application when the multi-screen device is in a tiled state; when the application includes one landscape application and one non-landscape application, set the second pane as the minimum effective display pane and place the non-landscape application in the second pane; set the remaining area of ​​the display screen as the first pane and place the landscape application in the first pane; when the application includes two non-landscape applications, divide the display screen into the first pane and the second pane, and place the two non-landscape applications in the first pane and the second pane respectively.

11. A multi-screen display control device, characterized in that, include: The acquisition module is used to obtain the hardware type of multi-screen devices; The processing module is used to perform a split-screen layout for the applications based on the hardware type and the landscape aspect ratio data of the applications when two or more applications are running on the multi-screen device. The split-screen layout includes: when there are two applications, dividing the display screen into a first pane and a second pane. The display module is used to simultaneously display two or more applications on the display screen of the multi-screen device according to the split-screen layout result; The processing module is configured to: acquire the landscape aspect ratio data of the application when the multi-screen device is in a vertical layout; when the application includes one landscape application and one non-landscape application, set a first pane according to the size of the landscape application, place the landscape application in the first pane, set the remaining area of ​​the display screen as a second pane, and place the non-landscape application in the second pane; when the application includes two non-landscape applications, divide the display screen into a first pane and a second pane, and place the two non-landscape applications in the first pane and the second pane respectively; when the application includes two landscape applications, divide the display screen into a first pane and a second pane, and place the two landscape applications in the first pane and the second pane respectively.

12. An electronic device comprising a memory, a processor, and at least one application program stored in the memory and configured to be executed by the processor, characterized in that, The application is configured to perform the multi-screen display control method according to any one of claims 1-5 or any one of claims 6-9.

13. A readable storage medium, characterized in that, It stores a computer program that, when executed by a processor, implements the multi-screen display control method as described in any one of claims 1-5 or any one of claims 6-9.

Images