Split-screen display method, electronic device, readable storage medium and program product

Abstract

The present application provides a split-screen display method, an electronic device, a readable storage medium, and a program product, belonging to the technical field of electronic devices. The method is applied to an electronic device, which includes a physical screen. A display area is correspondingly set on the physical screen, and a window interface of an application is displayed in the display area. Among them, the window interface includes a window frame of the application and the surface content within the window frame. The method includes: The electronic device receives a split-screen operation; in response to the split-screen operation, the electronic device splits the display area into at least two logical display screens according to a preset size, and the at least two logical display screens all have fixed sizes; the electronic device readjusts the window interface of the application according to the size of the first logical display screen among the at least two logical display screens, and displays the adjusted window interface of the application on the first logical display screen. The method of the embodiment of the present application does not require the application to adapt to multiple sizes of split screens, and can ensure the normal display of the window interface.

Description

Technical Field

[0001] The present invention relates to the field of electronic technology, and in particular, to a split-screen display method, an electronic device, a readable storage medium, and a program product. Background Art

[0002] With the development of electronic technology, people have higher and higher requirements for the visual effects of electronic devices, and the size of the screen is getting larger and larger. At the same time, it is necessary to meet the operation of multiple applications on one screen. For example, through the split-screen method, multiple application windows can be displayed on one screen.

[0003] However, since split-screen operations require third-party applications to adapt to the ability of the system window to be variable. For example, full-screen window layouts, split-screen window layouts in portrait mode, and window layouts in landscape mode need to meet at least three forms of window sizes, so that the interface content of the application can be displayed normally when split-screen and full-screen. This requires electronic device manufacturers and third-party applications to be able to adapt to windows of multiple size forms, which is difficult to adapt and brings many inconveniences. If not adapted, when switching between full-screen and split-screen, it is easy for the window interface content in the application window to be disordered. Summary of the Invention

[0004] In view of this, the present invention provides a split-screen display method, an electronic device, and a computer-readable storage medium, which can reduce the adaptation requirements for third parties and avoid the problem that the window interface content is prone to disorder when switching between split-screen and full-screen.

[0005] Some embodiments of the present application provide a split-screen display method. The present application will be introduced from multiple aspects below, and the embodiments and beneficial effects of the following multiple aspects can be referred to each other.

[0006] In a first aspect, the present invention provides a split-screen display method for an electronic device. The electronic device includes a physical screen, and a display area is correspondingly set on the physical screen. The display area displays a window interface of an application. Among them, the window interface includes a window frame of the application and surface content within the window frame. The method includes: the electronic device receives a split-screen operation; in response to the split-screen operation, the electronic device splits the display area into at least two logical display screens according to a preset size, and the at least two logical display screens all have a fixed size; the electronic device adjusts the window interface of the application according to the size of the first logical display screen among the at least two logical display screens, so that the window frame and the surface content match the first logical display screen; the electronic device displays the adjusted window interface of the application on the first logical display screen, so that the window frame and the surface content match the first logical display screen.

[0007] The split-screen display method according to the embodiments of the present application, compared with the prior art, splits a display screen with a full-screen size into two logical display screens with fixed sizes. When switching from full screen to split screen, the application window and the corresponding window interface are laid out according to the size of the logical display screen, rather than a half-screen layout with the full-screen size, so there will be no abnormal interface situation.

[0008] As an embodiment of the first aspect of the present application, the electronic device includes a splitting management module.

[0009] The electronic device splits a display area into at least two logical display screens according to a preset size, including:

[0010] The splitting management module is used to split the display area into at least two logical display screens with a preset size.

[0011] As an embodiment of the first aspect of the present application, the electronic device further includes a window screen moving module.

[0012] The electronic device adjusts the window interface of the application according to the size of the first logical display screen and moves the window interface of the application to the logical display screen with the corresponding size for display, including:

[0013] The window screen moving module is used to obtain the size of the first logical display screen from the splitting management module and notify the application to re-adjust the window interface corresponding to the size according to the size of the first logical display screen;

[0014] The application re-adjusts the window interface according to the size of the first logical display screen and notifies the window screen moving module to move the adjusted window interface;

[0015] The window screen moving module receives the screen moving notification of the application and moves the adjusted window interface to the first logical display screen for display.

[0016] As an embodiment of the first aspect of the present application, in response to a split-screen operation, the electronic device splits the display area into at least two logical display screens according to a preset size, including: the electronic device determines the current landscape or portrait orientation, and splits the display area into logical display screens that conform to the orientation based on the orientation. The split-screen state obtained by this method, such as horizontal splitting or vertical splitting state, is more in line with the user's holding state.

[0017] As an embodiment of the first aspect of the present application, the electronic device displays the adjusted window interface of the application on the first logical display screen, including: the electronic device displays the window interface corresponding to the orientation on the first logical display screen according to the orientation. Further, it is ensured that when the user looks directly at the mobile phone, the window interface seen is also upright.

[0018] As an embodiment of the first aspect of the present application, the method further includes: the electronic device receives the first position coordinates of the touch point on the display area; based on the first position coordinates, determines the second position coordinates corresponding to the touch point on the logical display screen, so as to perform a touch operation corresponding to the second position coordinates of the touch point.

[0019] As an embodiment of the first aspect of the present application, based on the first position coordinates, determining the second position coordinates corresponding to the touch point on the logical display screen includes: the electronic device determines the second position coordinates of the first position coordinates of the touch point occurring in the display area within the logical display screen based on the conversion relationship between the physical position coordinates of the display area and the physical position coordinates of the logical display screen. After split-screen, when receiving the user's operation on split-screen, it can accurately identify the coordinate position of the touch point where the user touches the screen in the logical display screen.

[0020] As an embodiment of the first aspect of the present application, when there is an interval between at least two logical display screens, the electronic device further determines the second position coordinates of the first position coordinates within the logical display screen based on the interval. Ensure that in the case of an interval, the coordinate position of the touch point can be accurately identified.

[0021] As an embodiment of the first aspect of the present application, when the application is a camera application, the method further includes: the electronic device obtains the window direction corresponding to the camera application, and keeps the image direction collected by the camera consistent with the window direction on the logical display screen. This method can avoid the situation where after split-screen, the image direction collected by the camera is inconsistent with the direction of the user's eyes looking directly at the mobile phone.

[0022] As an embodiment of the first aspect of the present application, the electronic device includes a touch split management module and a touch conversion management module,

[0023] The touch split management module is used to receive the first position coordinates of the touch point on the display area and send the first position coordinates to the touch conversion management module;

[0024] The touch conversion management module is used to determine the conversion relationship between the physical position coordinates of the display area and the physical position coordinates of the logical display screen based on the physical position coordinates of the display area and the number of split logical display screens, and based on the conversion relationship, determine the second position coordinates of the first position coordinates of the touch point occurring in the display area within the logical display screen.

[0025] As an embodiment of the first aspect of the present application, in response to the split-screen operation, the electronic device draws a status display area on the display area, and the status display area is a display area independent of the logical display screen for displaying the status information of the electronic device. This method can avoid the situation where when split-screen, two split-screens simultaneously control the display area where the status bar is located, resulting in inconsistent background colors of the status bar.

[0026] As an embodiment of the first aspect of the present application, the electronic device further includes: a status display area independent of the display area, configured to display the status information of the electronic device. This method can avoid the situation where when in split-screen mode, two split-screens simultaneously control the display area where the status bar is located, resulting in inconsistent background colors of the status bar.

[0027] In a second aspect, the present application also provides an electronic device, including:

[0028] A physical screen, with a display area correspondingly set on the physical screen, and an application window interface is displayed in the display area, where the window interface includes a window frame of the application and the surface content within the window frame.

[0029] A memory, configured to store instructions executed by one or more processors of the device;

[0030] At least one processor, configured to execute instructions and to perform:

[0031] Receiving a split-screen operation;

[0032] In response to the split-screen operation, the processor splits the display area into at least two logical display screens according to a preset size, and the at least two logical display screens all have a fixed size;

[0033] The processor instructs the application to readjust the window interface of the application according to the size of the first logical display screen among the at least two logical display screens, and display the adjusted window interface of the application on the first logical display screen, so that the window frame and the surface content match the first logical display screen.

[0034] Compared with the prior art, the electronic device according to the embodiments of the present application splits a full-screen-sized display screen into two fixed-sized logical display screens. When switching from full-screen to split-screen, the application window and the corresponding window interface are laid out according to the size of the logical display screen, rather than a half-screen layout with the full-screen size, thus avoiding the situation of abnormal interfaces.

[0035] As an embodiment of the second aspect of the present application, the processor includes a splitting management module.

[0036] The splitting management module is configured to split the display area into at least two logical display screens with a preset size. As an embodiment of the second aspect of the present application, the processor further includes a window screen moving module, and the window screen moving module is configured to obtain the size of the first logical display screen from the splitting management module and notify the application to readjust the window interface corresponding to the size according to the size of the first logical display screen.

[0037] The application adjusts the window interface according to the size of the first logical display screen, and notifies the window screen moving module to move the adjusted window interface;

[0038] The window screen moving module receives the screen moving notification from the application, and moves the adjusted window interface to the first logical display screen for display.

[0039] The electronic device adjusts the window interface of the application according to the size of the first logical display screen, and moves the window interface of the application to the logical display screen corresponding to the size for display, including:

[0040] The window screen moving module is used to notify the application to adjust the window interface corresponding to the size according to the size of the first logical display screen;

[0041] The application adjusts the window interface according to the size of the first logical display screen, and notifies the window screen moving module to move the adjusted window interface;

[0042] The window screen moving module receives the screen moving notification from the application, and moves the adjusted window interface to the first logical display screen for display.

[0043] As an embodiment of the second aspect of the present application, the processor is used to determine the current landscape or portrait orientation, and split the display area into logical display screens that conform to the orientation based on the orientation. The split screen state obtained by this method, such as horizontal splitting or vertical splitting state, is more in line with the user's holding state.

[0044] As an embodiment of the second aspect of the present application, the processor is used to display the window interface corresponding to the orientation on the first logical display screen according to the orientation. Furthermore, it ensures that when the user faces the mobile phone directly, the window interface seen is also in the correct orientation.

[0045] As an embodiment of the second aspect of the present application, the processor is used to receive the first position coordinates of the touch point for the display area, and based on the first position coordinates, determine the second position coordinates of the touch point corresponding to the logical display screen, so as to execute the touch operation corresponding to the second position coordinates of the touch point.

[0046] As an embodiment of the second aspect of the present application, the processor determines the second position coordinates of the first position coordinates of the touch point occurring within the display area within the logical display screen based on the conversion relationship between the physical position coordinates of the display area and the physical position coordinates of the logical display screen. After splitting the screen, when receiving the user's operation on the split screen, it can accurately identify the coordinate position of the touch point where the user touches the screen within the logical display screen.

[0047] As an embodiment of the second aspect of the present application, when there is a gap between at least two logical display screens, the processor is further configured to determine a second position coordinate of the first position coordinate within the logical display screen based on the gap, ensuring that the coordinate position of the touch point can be accurately identified in the case of the existence of the gap.

[0048] As an embodiment of the second aspect of the present application, when the application is a camera application, the processor is configured to obtain the window direction corresponding to the camera application and keep the image direction collected by the camera consistent with the window direction on the logical display screen. This method can avoid the situation where the image direction collected by the camera is inconsistent with the direction of the human eye looking directly at the mobile phone after split-screen.

[0049] As an embodiment of the second aspect of the present application, the processor includes a touch split management module and a touch conversion management module.

[0050] The touch split management module is configured to receive the first position coordinate of the touch point for the display area and send the first position coordinate to the touch conversion management module.

[0051] The touch conversion management module is configured to determine the conversion relationship between the physical position coordinate of the display area and the physical position coordinate of the logical display screen based on the physical position coordinate of the display area and the number of split logical display screens, and determine the second position coordinate of the first position coordinate of the touch point occurring within the display area within the logical display screen based on the conversion relationship.

[0052] As an embodiment of the second aspect of the present application, in response to a split-screen operation, the processor draws a status display area on the display area, and the status display area is a display area independent of the logical display screen for displaying the status information of the electronic device.

[0053] This method can avoid the situation where when split-screen, two split-screens simultaneously control the display area where the status bar is located, resulting in inconsistent background colors of the status bar.

[0054] As an embodiment of the second aspect of the present application, the electronic device further includes: a status display area independent of the display area for displaying the status information of the electronic device. This method can avoid the situation where when split-screen, two split-screens simultaneously control the display area where the status bar is located, resulting in inconsistent background colors of the status bar.

[0055] In a third aspect, the present application provides a computer-readable storage medium storing a computer program, and when the computer program is run by an electronic device, the electronic device is caused to execute the method in the embodiment of the first aspect above.

[0056] Fourthly, the present application discloses a computer program product containing instructions, which, when running on a computer, enables the computer to execute the method in the embodiment of the first aspect above. Description of the Drawings

[0057] Figure 1 It is a scene diagram showing split - screen of a mobile phone;

[0058] Figure 2 It is a schematic interface diagram showing that the window interface corresponding to the application appears abnormally after splitting the screen from full - screen;

[0059] Figure 3 It is a schematic interface diagram showing that the window interface corresponding to the application appears abnormally after changing from split - screen to full - screen;

[0060] Figure 4a It is a schematic interface diagram of split - screen display when holding a mobile phone vertically in an embodiment of the present application;

[0061] Figure 4b It is a schematic interface diagram of split - screen display when holding a mobile phone horizontally in an embodiment of the present application;

[0062] Figure 4c It is another schematic interface diagram after splitting the screen of a mobile phone in an embodiment of the present application;

[0063] Figure 5 It is a schematic structural diagram of an electronic device in an embodiment of the present application;

[0064] Figure 6 It is a schematic software architecture diagram of an electronic device in an embodiment of the present application;

[0065] Figure 7 It is a flowchart of a split - screen display method in an embodiment of the present application;

[0066] Figure 8a It is a schematic interface diagram of split - screen selection of a mobile phone in an embodiment of the present application;

[0067] Figure 8b It is another schematic interface diagram of split - screen selection of a mobile phone in an embodiment of the present application;

[0068] Figure 9a It is a flowchart of a method for confirming the coordinate position after splitting the screen of a mobile phone in an embodiment of the present application;

[0069] Figure 9b It is a schematic diagram of the coordinate position where a user touches the display screen in an embodiment of the present application;

[0070] Figure 9c It is another schematic diagram of the coordinate position where a user touches the display screen in an embodiment of the present application;

[0071] Figure 10a Interaction flowchart of the split-screen display method executed by each module of a mobile phone according to an embodiment of the present application;

[0072] Figure 10b Interaction flowchart of each module of a mobile phone for confirming the position coordinates of a touch point according to an embodiment of the present application;

[0073] Figure 11a Schematic diagram of an interface with different colors appearing in the status bar after split-screen;

[0074] Figure 11b Schematic diagram of an interface of a mobile phone with a status display area according to an embodiment of the present application;

[0075] Figure 12a Schematic diagram of an interface for opening the camera after split-screen of a mobile phone;

[0076] Figure 12b Schematic diagram of an interface for opening the camera after split-screen of a mobile phone according to an embodiment of the present application;

[0077] Figure 13 Block diagram of a system on a chip according to some embodiments of the present application. Detailed implementation manners

[0078] Next, the technical solutions in the embodiments of the present application will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present application.

[0079] For the convenience of understanding the technical solutions of the present application, the following first explains the key terms that appear in the present application.

[0080] An application, that is, an application program (abbreviated as app), is simply referred to as an application, and is a software program that can implement one or more specific functions. For example, a text message application, a video application, a shopping application, an image shooting application, and so on. Usually, multiple applications can be installed on an electronic device. Multiple applications can also be opened on one screen of the electronic device.

[0081] An application window can also be referred to as a "window" framework. Each application corresponds to an application window framework for displaying the surface content (surface) of the application, and the size can be adjusted.

[0082] The window interface includes the window framework of the application and the surface content (surface) within the window framework. The surface content can include multiple controls of different sizes, and each control can have information such as text and images.

[0083] Split screen. The split screen in the embodiments of the present application refers to splitting the display area of a physical screen into multiple logical display screens of preset sizes (for example, 900 pixels × 2200 pixels) through software. When an application is opened, the window interface of the application can be displayed within the default or user-specified logical display screen, so as to enable multiple window interfaces of applications to be opened simultaneously on one physical screen.

[0084] Logical display screen refers to a display area with a fixed size on the physical display screen of an electronic device. When the electronic device receives a split-screen operation, it splits the display area of the physical screen of the electronic device into two or more logical display areas of a certain size, and each of these logical display areas can be used to display a window interface of an application. In the present application, it can be understood that in the case of splitting the display area (full screen) of the electronic device into multiple display areas, the display area before splitting can be called the full screen, and the split screen after splitting can be called the logical display screen, such as the first logical display screen, the second logical display screen, etc.

[0085] The technical solution of the present application will be described below with reference to the scenario diagrams.

[0086] Reference Figure 1 , Figure 1 shows a scenario diagram of mobile phone split screen. As shown in (a) of Figure 1 , the mobile phone is in a full-screen state, and the window A of the application is displayed full screen on the mobile phone interface. When the mobile phone receives a split-screen operation, the mobile phone performs the split-screen operation to achieve split screen. Among them, the split screen can include two split-screen methods in different directions. When the mobile phone is held vertically, vertical split screen is adopted. As shown in (b) of Figure 1 , when held vertically, the mobile phone can be divided into a left split screen and a right split screen. The window A of the mobile phone can be displayed on the default or user-selected right split screen, and the left split screen can be used to display other applications. When held horizontally, as shown in (c) of Figure 1 , the mobile phone can be divided into an upper split screen and a lower split screen. The window A in the mobile phone can be displayed on the default or user-selected upper split screen, and the lower split screen can be used to display other applications. Thus, multiple applications can be displayed on one physical screen to meet the user's need for simultaneous operation of multiple applications.

[0087] Next, the technical problems of the embodiments of the present application will be described in combination with the scenarios described in Figure 1 .

[0088] Under normal circumstances, before an application displays the corresponding window on the display screen (including full-screen display or split-screen display), the layout parameters generally include: the size of the display screen (expressed in pixels): width and height. The coordinate position of the display screen relative to the entire screen, and the sensor direction. Among them, for a full-screen window, the 0-degree direction of the sensor is the holding direction of the mobile phone. However, for an application, the 0-degree direction of the sensor is generally directly defaulted to the vertical holding direction. When the mobile phone switches from full-screen to split-screen or rotates, the above layout parameters will all change. As Figure 1 As shown in (a) of , when the mobile phone is in the vertical screen and full-screen display, the layout of window A is based on the full-screen size (pixels). For example, "size: width: 1800, height: 2200" is used for layout. Among them, "0,0" in the coordinates represents the starting point in the coordinate system of the full-screen display area, and also the starting point of the screen in the coordinate system. As Figure 1 shown in (a) of , the point at the upper left corner of the screen is used as the starting point of the coordinate axis. The coordinate "1800,2200" represents the coordinate of the point farthest from the starting point (the end point).

[0089] After split-screen, the window of the application needs to be displayed on the split-screen in the split-screen manner. As Figure 1 shown in (b) of , when in the vertical screen, the application window A is displayed on the right half (right split-screen) of the physical screen of the mobile phone. At this time, the corresponding window size (pixels) required is "width: 900 (the width is half of the full-screen), height: 2200". As Figure 1 shown in (c) of , when in the horizontal screen, the layout of window A is based on the full-screen size (pixels). For example, "size: width: 2200, height: 1800" is used for layout. When split-screen, window A is displayed in the upper half (upper split-screen) of the physical screen of the mobile phone, and the corresponding window size (pixels) required for window A is "width: 2200, height: 900 (the height is half of the full-screen)". The above two display screen sizes for the horizontal and vertical screens when full-screen, and the two sizes for the horizontal and vertical screens when split-screen are mentioned. When not split-screen, the application only needs to adapt to the sizes of the horizontal and vertical screens in full-screen. When split-screen is added, the application needs to adapt to these four sizes (the vertical and horizontal screen sizes in full-screen, the vertical and horizontal screen sizes in split-screen) in order to ensure that the window interface is normally displayed during the split-screen operation. The above embodiments are described by taking the example of splitting a single full-screen into two screens. In some embodiments, there can also be a scenario where one screen is split into more screens. Therefore, when the display state of the mobile phone changes from full-screen to split-screen, the application needs to adapt to at least four sizes, such as width × height (pixels) being: 1800×2200, 2200×1800, 900×2200, 2200×900, in order to meet the normal switching of the window interface in the application window between full-screen and split-screen. However, adapting to too many sizes will bring more workload to third-party manufacturers and cause many inconveniences. Therefore, sometimes not all applications can meet the multi-size adaptation.

[0090] Since third-party applications usually only consider their own full-screen layout (i.e., directly layout according to the screen size), when the application does not adapt the window sizes of the above-mentioned multiple sizes, during the display process, it is easy for the window interface corresponding to the application to appear abnormal.

[0091] The following describes the above-mentioned abnormal situations with reference to the accompanying drawings.

[0092] Reference Figure 2 , Figure 2 shows a schematic diagram of the abnormal interface of the window interface corresponding to the application after changing from full screen to split screen. As Figure 2 shown, when the mobile phone changes from full screen to split screen, Application A is displayed in the left split screen, and Application B is displayed in the right split screen. Since Application A is not adapted to the split screen size, during actual use, it is easy for the control 2 in the window interface of Application A to still be laid out according to the full screen size, resulting in a part of the control 2 being hidden under the window of Application B and unable to be normally displayed.

[0093] Reference Figure 3 , Figure 3 shows a schematic diagram of the abnormal interface of the window interface corresponding to the application after changing from split screen to full screen. As Figure 3 shown, when changing from split screen to full screen, although the application has used the window size of the split screen, it does not listen to the change from the split screen window size to the full screen window size and does not switch from the split screen window to the full screen window in time, resulting in the layout size of the window interface still being according to the previous split screen size and the interface content of the window interface being stretched. As shown in (a) of Figure 3 , the text of "bamboo charcoal soft bristle toothbrush" and the toothbrush are normally displayed in the split screen. When it comes to full screen, as shown in (b) of Figure 3 , there is an abnormal display situation where both the text and the picture are stretched and there are margins left. These abnormal situations are particularly obvious on some special-shaped display screens. For example, on the display screen of a car stereo terminal with a wider width, the situation where the window interface is stretched or incompletely displayed is more obvious. And if it is required that the manufacturers of third-party applications adapt all full screen and split screen sizes, the workload is large and the operation is difficult.

[0094] To address the above technical problem of the internal content in the window interface being stretched and deformed, the embodiment of the present application proposes a split screen display method.

[0095] The following outlines the split screen display method of the embodiment of the present application with reference to the accompanying drawings.

[0096] Reference Figure 4a , Figure 4a shows a schematic diagram of the split screen display when the mobile phone is held vertically in the embodiment of the present application. As Figure 4aAs shown in (i) in the figure, when the mobile phone is in full screen, a whole physical screen display area (i.e., logical display screen 10) is provided, and the display area displays window A of application A, wherein window A is laid out in full screen size. The full screen size (pixels) and physical coordinates are "size: width: 1800, height: 2200, coordinates: (0, 0, 1800, 2200)". When the mobile phone receives the split screen operation, as shown in Figure 4a As shown in (ii), the original full screen is divided into two preset fixed-size "logical display screen 20" and "logical display screen 30", and the logical display screen 10 corresponding to the full screen is hidden. At this time, it is equivalent to the mobile phone having two "display screens", and these two display screens are relatively independent. When performing a split-screen operation, the mobile phone splits the screen according to the physical coordinates corresponding to the full screen and the preset coordinate conversion relationship to obtain two logical display screens with independent coordinate systems, and assigns a corresponding conversion relationship to each logical display screen for use in identifying the coordinates of the touch point position. For the coordinates of the logical display screens in the two independent coordinate systems, please refer to the following. Figure 4a In the coordinate system 1 and the coordinate system 2 shown in (ii), the size (pixels) and coordinates of the logical display screen 20 are “width: 900, height: 2200, coordinates in the coordinate system 1 (coordinates of the starting point and the end point 1): (0, 0, 900, 2200)”, and window A is laid out according to the size of the logical display screen 20. The size (pixels) and coordinates of the logical display screen 30 are “width: 900, height: 2200, coordinates in the coordinate system 2 (coordinates of the starting point and the end point 2): (0, 0, 900, 2200)”, and window B of application B located in the logical display screen 30 is laid out according to the size of the logical display screen 30. In the process of layout of window interface of application, since the application is layout of window interface according to the full screen size of logical display screen, there is no concept of split screen or full screen for window or APP, and it is operated in full screen, that is, "full screen" display according to the size (pixel) of width: 900, height: 2200, coordinates: (0,0,900,2200), rather than half screen display relative to the full screen size (pixel) of physical screen: width: 1800, height: 2200. The mobile phone uses a default logical display screen or a logical display screen selected by the user as the target logical display screen, re-layouts the window interface corresponding to the application on the full screen according to the size of the target logical display screen (this size is the full screen for the application), and moves the re-layout window interface to the target logical display screen for display.

[0097] Above Figure 4a The description is provided with the mobile phone in portrait mode as an example. The split-screen display method in landscape mode is the same as that in portrait mode.

[0098] refer to Figure 4b ,Figure 4b It shows a schematic diagram of the split-screen display when the mobile phone in the embodiment of the present application is held horizontally. As Figure 4b shown, in the horizontally held state, after split-screen, two split-screens with an upper and lower layout are obtained, namely "logical display screen 20" and "logical display screen 30", and the logical display screen 10 corresponding to the full screen is hidden. Among them, the size (pixels) and coordinates of the logical display screen 20 are "width: 2200, height: 900, coordinates: (0, 0, 2200, 900)", and window A is laid out according to the size of the logical display screen 20. The size (pixels) and coordinates of the logical display screen 30 are "width: 2200, height: 900, coordinates: (0, 0, 2200, 900)", and window B of the application B located in the logical display screen 30 is laid out according to the size of the logical display screen 30, obtaining an interface of horizontal split-screen.

[0099] It should be noted that in the present application, in order to facilitate the manifestation of the relationship between the logical display screen and the window, the frame of the logical display screen is drawn in a form non-coincident with the window frame, and the frame of the full-screen logical display screen 10 is drawn in a form non-coincident with the frames of the logical display screens 20 and 30 corresponding to the split-screen. In actual layout, the window frame and the logical display screen frame may completely coincide or may not completely coincide, and no limitation is made here. In addition, there may be no gap or there may be a gap between the two logical display screens.

[0100] Compared with the prior art, the split-screen display method in the embodiment of the present application splits the display screen with the full-screen size into two logical display screens with fixed sizes. When changing from full screen to split screen, the application window and the corresponding window interface are laid out according to the size of the logical display screen therein, rather than a half-screen layout with the full-screen size, so that the situation of abnormal interface will not occur. For example, for the Figure 2 abnormal situation mentioned above, if the technical solution of the present application is adopted, when the application is laid out, it is laid out according to the full-screen size (pixels) of the logical display screen: width: 900, height: 2200. Since the size of the logical display screen is fixed, and the size of the logical display screen is preset, when the mobile phone is split-screen, it is split-screen according to the preset fixed size. When the application lays out the application window, it is laid out according to the full-screen size of the logical display screen, so that the situation of incomplete display of controls will not occur.

[0101] In addition, during the process of changing from split screen to full screen, the mobile phone re-lays out the window interfaces of the applications on the logical display screen according to the full-screen window size, and moves the re-laid window interfaces of the applications as a whole to the full screen for display, thereby avoiding the situation of stretching. For example, for Figure 3For the abnormal situation shown, the split-screen display method of the present application is adopted. In this method, for an application, the obtained logical display screen is an independent display screen. When actually laying out, it is laid out according to the full-screen size of the logical display screen, that is, the layout is carried out according to the size (pixels) of width: 900 and height: 2200. Furthermore, when switching from the logical display screen to the full screen corresponding to the physical screen, at this time, the application considers it as switching from an independent logical display screen to another independent full screen. When obtaining the full-screen size, it is laid out according to the full-screen size of the display area of the physical screen (logical display screen 10). Therefore, the stretching situation will not occur. If the application does not obtain the full-screen size of the physical screen, it will still stay on the interface of the logical display screen and there will be no stretching. Thus, it can be seen that through the split-screen display method of the present application, the above-mentioned abnormal interface situation can be avoided, especially for electronic devices with irregularly sized special-shaped display screens, such as the display screen of a car head unit with an overly wide width, or electronic devices with more obvious stretching or abnormal control display situations. Adopting the split-screen display method of the present application can significantly improve the usage experience of split-screen display.

[0102] In the above embodiment, the description is made in the way that vertical split-screen is adopted when holding the device vertically and horizontal split-screen is adopted when holding the device horizontally. In some embodiments, it can also be that horizontal split-screen is adopted when holding the device vertically and vertical split-screen is adopted when holding the device horizontally. It can also be that a full screen is divided into three split-screens or four split-screens, etc. This is not limited here. Refer to Figure 4c , Figure 4c shows another schematic diagram of the interface after the mobile phone is split-screen according to the embodiment of the present application. As Figure 4c shown in (i) therein, when holding the device vertically, it can be divided into a logical display screen 20 and a logical display screen 30 arranged vertically. As Figure 4c shown in (ii) therein, when holding the device horizontally, it can be divided into a logical display screen 20 and a logical display screen 30 arranged horizontally. As Figure 4c shown in (iii) therein, after the mobile phone receives the split-screen operation, the split of three split-screens is realized. For example, "logical display screen 10", "logical display screen 20" and "logical display screen 30" arranged from top to bottom. The present application does not limit the form and quantity of the split-screen.

[0103] In the above embodiments, when splitting the screen, two logical display screens with equal sizes (such as the first and second logical screens) are taken as examples for illustration. In some embodiments, the fixed sizes of multiple logical display screens may also be unequal. For example, for two split screens, the left one can be larger than the right one, or the right one can be larger than the left one, or the upper and lower split screens can have different sizes, etc. This application is not limited thereto. In the above embodiments, a mobile phone is used as the electronic device for illustration. In some embodiments of this application, the electronic device may also be a desktop computer, a tablet computer, a laptop computer, a super mobile personal computer, a personal digital assistant (PDA), a vehicle-mounted terminal, or other electronic devices.

[0104] The split-screen display method according to the embodiments of this application will be described below in conjunction with the specific structure of the electronic device.

[0105] Refer to Figure 5 , Figure 5 FIG. shows a schematic structural diagram of an electronic device according to an embodiment of this application. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) connector 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0106] It can be understood that the structure schematically shown in the embodiments of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or have different component arrangements. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0107] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors.

[0108] The processor 110 may generate operation control signals according to the instruction operation code and timing signals to complete the control of fetching and executing instructions.

[0109] A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory may save the instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can directly call it from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0110] In some embodiments, when the processor 110 receives a split-screen instruction, the display screen 194 may be split into at least two independent logical display screens according to a preset size, for example, with a width × height (pixels) of 900 × 2200. Then, the application window and window interface corresponding to the application originally displayed on the full screen are laid out according to the size of one of the logical display screens, and the adjusted window interface of the application is displayed on the logical display screen of the corresponding size. Since the logical display screen is equivalent to an independent display screen, when the application is laid out, it is a "full-screen" layout according to the size of the logical display screen, thereby effectively avoiding the abnormal interfaces described above. Figure 2 and Figure 3 described.

[0111] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0112] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple groups of I2C buses. The processor 110 may be respectively coupled to the touch sensor 180K, the charger, the flash, the camera 193, the display screen 194, etc. through different I2C bus interfaces. For example: The processor 110 may be coupled to the touch sensor 180K through the I2C interface, enabling the processor 110 to communicate with the touch sensor 180K through the I2C bus interface, obtain touch events, and confirm the specific operation of the touch according to the coordinate position of the touch point, thereby implementing the touch function of the electronic device 100.

[0113] The MIPI interface may be used to connect the processor 110 to peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate through the CSI interface to implement the shooting function of the electronic device 100.

[0114] In some embodiments, the processor 110 and the display screen 194 communicate through the DSI interface to implement the display function of the electronic device 100 from full screen to split screen, or from split screen to full screen.

[0115] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to the camera 193, the display screen 194, the wireless communication module 160, the audio module 170, the sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0116] It can be understood that the interface connection relationship between the modules illustrated in the embodiments of the present invention is only illustrative and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 can also adopt different interface connection methods or a combination of multiple interface connection methods in the above embodiments.

[0117] The electronic device 100 realizes the display function through the GPU, the display screen 194, and the application processor, etc. The GPU is a microprocessor for image processing, which is connected to the display screen 194 and the application processor. The GPU is used to execute mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change the display information.

[0118] In some embodiments, after receiving the split-screen operation, the processor 110 sends the split-screen operation to the GPU. The GPU divides the display screen 194 into two logical display screens according to the set size for display. After the user opens an application in one logical display screen, the GPU layouts the window and window interface of the application according to the size of the logical display screen so that the window and window interface of the application match the logical display screen. Or for the application window before split-screen, re-layout the application window and window interface according to the size of the logical display screen, and render the interface graphics so that the application window and window interface can be normally displayed both in full screen and split screen.

[0119] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can adopt a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include one or N display screens 194, where N is a positive integer greater than 1.

[0120] The above-mentioned FIG. 4 and Figure 5 The software system of the electronic device shown can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservices architecture, or a cloud architecture, etc. In the embodiments of the present invention, taking the Android system with a layered architecture as an example, the software system architecture of the electronic device 100 is exemplarily described.

[0121] As Figure 6 As shown, the layered architecture divides the software into several layers, and each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, namely the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.

[0122] The application layer may include a series of application packages.

[0123] As Figure 6 As shown, the application packages may include applications such as a camera, a gallery, a map, a WLAN, music, a short message, a calendar, a call, and a status bar.

[0124] The application framework layer provides application programming interfaces (APIs) and programming frameworks for the applications in the application layer. The application framework layer includes some predefined functions.

[0125] As Figure 6As shown in the figure, the application framework layer may include a display management framework, a touch management framework, a sensor management framework, etc. Among them, the display management framework may include a window manager and a screen manager, the touch management framework may include a touch injection module, and the sensor management module may include a sensor reporting module.

[0126] As Figure 6 shown in the figure, the window manager is used to manage window programs. The window manager can obtain the size of the display screen, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0127] In some embodiments, the window manager may include a window screen moving module, and the window screen moving module is used to move the window corresponding to the application from the first logical screen (for example, the logical display screen 10 in Figure 4a as shown) to the second logical screen (for example, the logical display screen 20 in Figure 4a as shown), and draw the window interface according to the size of the second logical screen.

[0128] The screen manager can also be understood as a "view system", including visible controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build application programs. The display interface can be composed of one or more views. For example, a display interface including a short message notification icon may include a view for displaying text and a view for displaying pictures.

[0129] In some embodiments, the screen manager may include a split management module and a touch split management module. Among them, the split management module is used to use the entire display screen as one screen for display when the application is full-screen displayed. When the application needs to be split-screen displayed, it is responsible for splitting the entire display screen into multiple logical display screens according to a preset size.

[0130] The touch injection module includes a touch split management module, and the touch split management module is used to inject the received user touch event into the two split logical display screens. That is, when touching on the split screen, the coordinate position of the touch on the split screen can be accurately obtained.

[0131] The sensor reporting module includes an information synchronization module, and the information synchronization module is used to obtain the rotation data of the electronic device received by the gyroscope sensor, such as the orientation data of whether the electronic device is in landscape or portrait orientation, and send the orientation data to the split management module, so that the split management module can select horizontal splitting or vertical splitting according to the orientation data, and adjust the window orientation of the application displayed on any one logical display screen to be displayed at a preset angle to meet the normal viewing of the user interface.

[0132] In some embodiments of the present application, a notification manager may also be included. The notification manager enables an application to display notification information in the status bar, which can be used to convey messages of the notification type, and can automatically disappear after a short stay without user interaction. For example, the notification manager is used to inform that the download is completed, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or a scroll bar text, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialogue window. For example, prompt text information in the status bar, emit a prompt tone, the electronic device vibrates, the indicator light flashes, etc.

[0133] The Android Runtime includes core libraries and a virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.

[0134] The core libraries include two parts: one part is the functional functions that the Java language needs to call, and the other part is the core libraries of Android.

[0135] The application layer and the application framework layer run in the virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

[0136] The system libraries may include multiple functional modules. For example, it includes a display composition module. The display module may include a surface manager, a 3D graphics processing library, etc. The display composition module can be used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications. The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, composition, and layer processing, etc.

[0137] In some embodiments, when the display composition module implements split-screen and full-screen displays, it can perform rendering, composition, and layer processing on the window interface.

[0138] As Figure 6 shown, the kernel layer is the layer between the hardware and the software. The kernel layer at least includes a display driver, a touch sensor driver, and an orientation sensor driver. In addition, it may also include a camera driver, an audio driver, etc.

[0139] The hardware layer includes a display screen (LCD), a touchpad (touch sensor), and a gyroscope. The display screen completes the communication between software and hardware through the display driver in the kernel layer, and then splits the display screen into multiple logical display screens through the split management module of the display management framework. The touchpad realizes communication with other layers through the touch sensor driver to implement the processing of touch events by the touch management framework. The gyroscope realizes communication with the sensor management framework through the orientation sensor driver to receive orientation data on multiple logical display screens.

[0140] The split-screen display method of the embodiments of the present application will be described in detail below with reference to specific embodiments.

[0141] In the following embodiments, it is described by taking the method applied to a mobile phone (as an example of an electronic device). The specific structure of the mobile phone can refer to the Figure 5 and Figure 6 hardware structure and software structure. The process from full screen to split screen and then from split screen to full screen display will be described below. The number of split screens is taken as an example of two logical display screens.

[0142] Refer to Figure 7 , Figure 7 which shows the flowchart of the split-screen display method of the embodiments of the present application. As Figure 7 shown, in order to reflect the processing process of the window interface of the application before and after split screen, the operation of opening the application is performed first before split screen, and the window interface of the application is displayed on the full screen. This flowchart may include S710 - S740.

[0143] S710, the mobile phone receives a split-screen operation.

[0144] The split-screen operation of the present application may be a specific split-screen action. For example, in the state where the split-screen application is opened, the finger slides from the left edge of the mobile phone screen to the right edge, or two fingers slide from top to bottom, or the knuckle continuously taps the screen twice, etc. The specific operation of split screen in the present application is not limited.

[0145] S720, in response to the split-screen operation, the mobile phone splits the display area into two logical display screens according to a preset size. Among them, the preset size may be a fixed size set at the factory. For example, the size of the logical display screen shown in (b) in the above Figure 4a is width × height (pixels): 900 × 2200.

[0146] Combined with Figure 4a shown in (a) above, the full-screen size of the display area is width × height (pixels): 1800 × 2200. As Figure 4aAs shown in (b) therein, the full screen is split into two equal-sized (in pixels) with width × height (in pixels) being: 900 × 2200. That is, logical display screen 20 and logical display screen 30. Among them, the coordinates of logical display screen 20 are: (0, 0, 900, 2200), and the coordinates of logical display screen 30 are: (0, 0, 900, 2200). From the perspective of the display area and coordinates, the two logical display screens are relatively independent, so that when arranging the application layout, the size of the logical display screen is used as the full-screen size for layout to avoid abnormal display.

[0147] For S730, the mobile phone re-adjusts the window interface of the application according to the size of the specified logical display screen. Among them, the specified logical display screen refers to one of at least two split logical display screens. The specified logical display screen can be the logical display screen above the physical screen (upper split screen, which can be regarded as the first logical display screen) or the logical display screen below the physical screen (lower split screen, which can be regarded as the second logical display screen) during horizontal split screen, or it can be the logical display screen on the left side of the physical screen (left split screen, which can be regarded as the first logical display screen) or the logical display screen on the right side (right split screen, which can be regarded as the second logical display screen) during vertical split screen.

[0148] As shown in Table 1, the mobile phone splits the parameters of holding the mobile phone horizontally and vertically according to the preset size and obtains the following data respectively. Table 1 is the full-screen parameters of holding the mobile phone horizontally and vertically before splitting.

[0149] Table 1 Full-screen parameters of holding the mobile phone horizontally and vertically before splitting

[0150]

[0151] Taking the example of splitting into two logical display screens, the following parameters of the logical display screen can be obtained after splitting. And the corresponding Application A and Application B in the logical display screen can obtain the layout parameters shown in Table 2, and layout their respective Windows A and B according to the layout parameters after splitting.

[0152] Table 2 Full-screen parameters of the logical display screen of holding the mobile phone horizontally and vertically after splitting

[0153]

[0154] As can be seen from Table 2, when holding the device in portrait orientation, for Application A, the window size obtained is the full-screen size of the logical display screen: width x height is: 900x2200. The window coordinates are the full-screen coordinates of the logical display screen (0,0,900,2200). Similarly, for Application B, the full-screen size of another logical display screen (a logical display screen other than the one occupied by Application A) is width x height: 900x2200, and the full-screen coordinates are (0,0,900,2200), and these parameters are used as the window layout size of Application B. For Application A and Application B, whether it is the full-screen size before split-screen or the full-screen size of the logical display screen after split-screen, the two sizes are relatively independent, and the application only needs to perform full-screen layout according to the full-screen size of the logical display screen where it is located. As Figure 4a shown, the window A of Application A is laid out according to width × height (pixels) of: 1800×2200 when in full screen. After split-screen, the window A of Application A is laid out according to the size of the specified logical display screen with width × height (pixels) of: 900×2200 (for Application A, this size is also the full screen) so that the re-laid out window interface conforms to the size of the specified logical display screen. Compared with the prior art, the logical display screen of the present application is an independent display screen relative to the full-screen display area. That is to say, when the application needs to be displayed on the full-screen display area of the physical screen, the application is laid out according to the full-screen size of the physical screen, and when the application needs to be displayed on the logical display screen after split-screen, the application is laid out according to the full-screen size of the logical display screen. For the application, whether it is before or after split-screen, it is full-screen display. Instead of in the prior art, after split-screen, the application still lays out the window interface in the split-screen according to the full-screen size of the physical screen.

[0155] S740, the mobile phone will display the adjusted window interface of the application on the specified logical display screen.

[0156] The specified logical display screen can be a default logical display screen of the mobile phone. As shown in Figure 4a (b) of, the mobile phone can be defaulted to be the logical display screen 20. Or it is defaulted to be the logical display screen 30. In some embodiments, the user can also select the specified screen to display the corresponding application by himself.

[0157] Referring to Figure 8a , Figure 8a shows a schematic diagram of the split-screen selection interface of the mobile phone according to the embodiment of the present application. As shown in Figure 8a , when the mobile phone executes S720, it can also pop up a split-screen selection option on the interface in the form of an information prompt. As shown in Figure 8aAs shown in (i) therein, the user is reminded by the pop-up box 810 that "Please select at least one screen for displaying Application A", and options "Logical Display Screen 20" and "Logical Display Screen 30" are listed. The user can check the specified logical display screen through the check box "□". After the user checks the logical display screen 20, as Figure 8a shown in (ii) therein, the mobile phone confirms the checked coordinate position, confirms the logical display screen 20, obtains the size of the logical display screen 20, arranges the window interface of Application A, and displays the arranged window interface of Application A on the specified logical display screen 20.

[0158] In some other embodiments, after receiving the split screen, the mobile phone can display the already opened applications or all applications in the form of a list to the user through a pop-up box. The user can drag an application from the list to any logical display screen to realize the display of the application on the specified logical display screen.

[0159] Refer to Figure 8b , Figure 8b which shows a schematic diagram of another split screen selection interface of the mobile phone. As shown in (i) therein, when the mobile phone executes S720, a list 820 pops up on the right side of the interface. The list can preferentially display the already opened applications, such as "Application A" and "Application B", and can also display "Application C" for selection. In addition, the user can also select other applications through the application thumbnail icon 821. The user can drag the application to the corresponding split screen by dragging. For example, the user can drag Application A to the upper split screen, then the mobile phone identifies the specified logical display screen according to the coordinate position and displays the Application A on the specified logical display screen, as Figure 8b shown in (ii) therein, the "window interface of Application A" is displayed on the upper split screen. For the already opened "Application B", it can be automatically assigned to the lower split screen for display. Figure 8b As compared with the prior art, the split screen display method of the present application can avoid the situation that when splitting the screen for display, the window interface of the split screen is still arranged according to the full screen size, and it is easy for the controls in the window interface to appear abnormally. And the split screen method of the present application does not require a third-party application to be adapted to all sizes. As long as it is adapted according to the full screen and the split screen is reasonably arranged according to the size of the logical display screen, the adaptation can be achieved. The workload of adaptation is reduced, which brings convenience to manufacturers.

[0160]

[0161] ​In addition, when the mobile phone switches from split screen to full screen, since the split screen is independent of the full screen size, when switching from split screen to full screen, only after the application obtains the full screen parameters will it layout the window interface. Before obtaining the full screen parameters, the logical display screen in split screen mode will still be used to display the window interface, thus avoiding the stretching and disordered layout of the window interface when switching from a split screen window to a full screen window while the application has not obtained the full screen window size and still layouts according to the split screen layout.

[0162] In some embodiments of the present application, the application can also be opened by the mobile phone after S720 is executed, and it is not limited to being opened before the split screen operation. Whether the application is opened before or after S720, the layout method of the application's window interface is the same as that of S730, which will not be described here again.

[0163] The following describes the implementation process of confirming the coordinate position of the touch point after the mobile phone is split screen in combination with specific embodiments. This process is also Figure 8a and Figure 8b the specific implementation of the confirmation of the logical display screen in

[0164] Referring to Figure 9a , Figure 9a shows the flowchart of the method for confirming the coordinate position after the mobile phone is split screen in an embodiment of the present application. This process is executed by the mobile phone. As Figure 9a shown, this confirmation process may include S910 - S940.

[0165] S910, the mobile phone receives a touch operation.

[0166] For example, this touch operation is the operation of the user sliding the interface of Application A on the logical display screen after split screen.

[0167] S920, the mobile phone obtains the position coordinates of the touch point relative to the full screen. The process of obtaining the coordinate position can refer to the existing technology and will not be described in detail here.

[0168] Referring to Figure 9b , Figure 9b shows the schematic diagram of the coordinate position of the user touching the display screen in an embodiment of the present application. As Figure 9b shown, taking the portrait screen as an example, the physical position coordinates of the full screen are (0, 0, 1800, 2200), and the position coordinates of the user's touch point relative to the full screen are (1600, 1100).

[0169] S930, the mobile phone determines the conversion relationship between the physical position coordinates of the full screen and the physical position coordinates of the logical display screen.

[0170] Among them, the conversion relationship can be preset. After split-screen, the conversion relationships of each screen are different. The mobile phone will assign a corresponding conversion relationship to each logical display screen according to the position of each logical display screen in the full-screen physical position coordinates.

[0171] As Figure 9b shown, when the mobile phone touches the screen, the mobile phone can recognize that the touch is on the right half-screen, that is, the logical display screen 30, and the coordinates of the logical display screen have been determined during split-screen, that is, as Figure 9b shown, the position coordinates of the logical display screen are (0, 0, 900, 2200). Based on the full-screen physical position coordinates and the position coordinates of the logical display screen, the conversion relationship between the two can be determined. That is, for the height, the two are equal. For the width, since the logical display screen is located on the right half-screen, therefore, the abscissa of the touch point relative to the full-screen minus the width of the left half-screen is the abscissa of the touch point on the logical display screen 30.

[0172] S940, based on the conversion relationship, determine the second position coordinates of the first position coordinates in the logical display screen.

[0173] Based on the above conversion relationship, that is, the ordinate is equal, and the abscissa is the abscissa of the full-screen minus the width of the left half-screen, the position coordinates of the touch point on the logical display screen can be obtained as (700, 1100). Determine the operation corresponding to the touch according to the position coordinates on the logical display screen, so that the mobile phone can accurately recognize the relative position of the touch point and execute the touch operation.

[0174] In some embodiments, when there is a gap between two logical display screens, refer to Figure 9c , Figure 9c which shows another schematic diagram of the coordinate position of the user touching the display screen in the embodiment of the present application. As Figure 9c shown, the interval between the two logical display screens is 5 pixels, the full-screen physical position coordinates are still (0, 0, 1800, 2200), and the coordinates of the two logical display screens are (0, 0, 898, 2200). Then, when determining the position of the touch point, the abscissa will be obtained by subtracting the position coordinates of the left half-screen from the abscissa of the relative full-screen 1600 and then subtracting the interval of 4 pixels, that is, the coordinates of the touch point are (698, 1100).

[0175] According to the coordinate confirmation method in the embodiment of the present application, the position coordinates of the touch point relative to the logical display screen can be accurately obtained, which is beneficial to the mobile phone to accurately recognize the touch operation of the user.

[0176] Next, the implementation process of the Figure 7 split-screen display method described in and Figure 9 will be described in combination with each module of the mobile phone.

[0177] Reference Figure 10a , Figure 10a shows the interaction flowchart of each module of the mobile phone in the embodiment of the present application executing the split-screen display method. As Figure 10a and in combination with Figure 6 shown, the mobile phone includes a split management module, a window screen moving module, a touch conversion management module, a touch split management module and an application.

[0178] As Figure 10a and in combination with Figure 4a shown, the interaction of each module includes: (1) The user inputs a split-screen operation through interface interaction, and the split management module receives the split operation. (2) The split management module splits the full screen into a logical display screen 20 and a logical display screen 30. Among them, since the split size is a preset fixed size when splitting, the split management module can accurately obtain the physical position coordinates of each logical display screen. (3) The split management module sends the physical position coordinates to the touch conversion management module. (4) The touch conversion management module calculates the touch conversion calculation relationship of each logical display screen. (5) The touch conversion management module notifies the touch split management module that the split is completed. (6) The touch split management module notifies the split management module that the touch conversion relationship is configured. (7) The split management module notifies the window screen moving module to move the application window interface to the logical display screen 30. Among them, the confirmation process of the logical display screen 30 can be specified by the user or the default of the mobile phone, which is described in S740 in the above Figure 7 . (8) The window screen moving module notifies the application to switch from full screen to split screen, transfers the full screen to the logical display screen 30, and informs the size of the logical display screen 30. In some embodiments, layout parameters such as the coordinates of the logical display screen 30 can also be informed. (9) The application re-layouts the window interface according to the size of the logical display screen 30. (10) The application notifies the window moving management module that the window interface has been re-layout, and notifies to switch the screen to the logical display screen 30. (11) The window moving management module obtains the re-layout window interface, moves the two logical display screens to the front of the screen, and displays the new window interface on the logical display screen 30, and hides the original full screen in the background of the screen.

[0179] Reference Figure 10b Figure 10b shows the interaction flowchart of each module of the mobile phone in the embodiment of the present application for confirming the position coordinates of the touch point. As Figure 10a and in combination with Figure 6 shown, the mobile phone includes a touch sensor, a touch processing module, a touch conversion management module, a touch split management module and an application.

[0180] As Figure 10b and in combination with Figure 9bAs shown in the figure, the interactions of each module include: (1) The touch sensor receives a touch operation and obtains the coordinates of the touch point relative to the full screen (1600, 1100). (2) The touch sensor reports the coordinates to the touch processing module. (3) The touch sensor reports the coordinates to the touch conversion management module. (4) The touch conversion management module determines that the touch is in the right half of the screen and determines the coordinates of the touch point on the logical display screen 30 (700, 1100) according to the conversion relationship. (5) The touch conversion management module splits the touch point relative coordinates to the touch split management module. (6) The touch split management module sends the touch point coordinates (700, 1100) to the application, so that the application can perform corresponding touch operations. For example, when opening the camera application, the camera application will be opened on the logical display screen 30.

[0181] It should be noted that the above-mentioned modules and working processes have been described in detail in the above embodiments, and specific references can be made to the above embodiments. Figure 7 and the split screen display method described in FIG. 9 will not be elaborated here.

[0182] In the above embodiments, the functions and quantities of each module are illustrative. In some embodiments of the present application, the electronic device may also include more or fewer modules than the above-mentioned quantities. One module may have multiple or fewer of the above-mentioned functions. This is not limited here.

[0183] In an embodiment of the present application, when the status bar on the mobile phone intersects with two split screens at the same time, the situation where the two display screens control the status bar at the same time will occur, resulting in the problem that the left and right sides of the status bar have different colors, which reduces the user experience.

[0184] Refer to Figure 11a , Figure 11a shows a schematic diagram of the interface of the status bar with different colors after split screen. As Figure 11a shown, the status bar 1110 is controlled by two display screens, the left split screen and the right split screen at the same time. When the background colors of the two display screens are different, it will cause the status bar 1110 to have two different colors, and the status bar will cover the application area display, reducing the user experience.

[0185] To solve Figure 11a the technical problems described above, in an embodiment of the present application, a status display area is also provided on the display area of the physical screen of the mobile phone. This status display area is an independent display area from the logical display screen. When the two logical display screens have different colors, since the status bar is controlled independently of the logical display screen of the mobile phone, there will be no situation where the left and right colors are different and the status bar will cover the application area display.

[0186] Refer to Figure 11b , Figure 11bThe schematic diagram of the interface with a status display area on the mobile phone according to the embodiment of the present application is shown. As Figure 11b shown, the status display area 1110 is independent of the logic display screen 20 and the logic display screen 30. Therefore, the background color on the logic display screen will not affect the status display area.

[0187] In an embodiment of the present application, the status display area can be divided from the display area of the physical screen when the mobile phone responds to the split-screen operation and is controlled independently of the logic display screen. It can also be that the status display area itself is independent of the split-screen display area, that is, the display area participating in the split screen and the status display area are two independent areas. This is not limited here.

[0188] In some embodiments, when the opened application is an application that requires the mobile phone to be rotated, for example, the camera application, during the rotation of the mobile phone, if the image interface obtained by the camera cannot match the actual holding direction of the mobile phone, it will cause the image interface displayed on the split-screen interface to be rotated by 90 degrees from the angle when the human eye is looking straight ahead, thereby bringing discomfort to the user.

[0189] Reference Figure 12a , Figure 12a shows the schematic diagram of the interface of the mobile phone after split-screen and opening the camera. As Figure 12a shown, the interface 1210 is the schematic diagram of the interface after opening the camera when held horizontally. When the mobile phone is in split-screen display, the camera direction uses the vertical screen of the window direction, resulting in the image captured by the camera being twisted by 90 degrees from the actual holding direction. The user experience is reduced.

[0190] To solve Figure 12a the technical problems described, when performing split-screen, the mobile phone needs to obtain the rotation data, and when opening the camera application, keep the image direction collected by the camera consistent with the window direction of the logic display screen. Specifically, it can be through the information synchronization module as Figure 6 shown, synchronize the rotation data to each logic display screen and the camera application, so that the camera application can adjust the angle of the captured image interface according to the current rotation angle.

[0191] Reference Figure 12b , Figure 12b shows the schematic diagram of the interface of the mobile phone after split-screen and opening the camera according to the embodiment of the present application. As Figure 12b shown, the image direction in the image interface 1220 is consistent with the angle when the human eye is looking straight ahead. The user experience is improved.

[0192] The present application also provides an electronic device, including:

[0193] A memory for storing instructions executed by one or more processors of the device, and

[0194] A processor for executing the processing method described in the above embodiments in combination with Figure 7 and the processing method explained in FIG. 9.

[0195] The present application also provides a computer-readable storage medium storing a computer program, which, when run by a processor, causes the processor to execute the processing method described in the above embodiments Figure 7 and the processing method explained in FIG. 9.

[0196] The present application also provides a computer program product containing instructions, which, when the computer program product runs on an electronic device, causes the processor to execute the processing method described in the above embodiments Figure 7 and the processing method explained in FIG. 9.

[0197] Now refer to Figure 13 , which shows a block diagram of a System on Chip (SoC) 1300 according to an embodiment of the present application. In Figure 13 , similar components have the same reference numerals. Additionally, the dashed boxes are optional features of a more advanced SoC. In Figure 13 , the SoC 1300 includes: an interconnect unit 1350 coupled to an application processor 1310; a system agent unit 1380; a bus controller unit 1390; an integrated memory controller unit 1340; one or a group of one or more coprocessors 1320, which may include integrated graphics logic, an image processor, an audio processor, and a video processor; a Static Random Access Memory (SRAM) unit 1330; a Direct Memory Access (DMA) unit 1360. In one embodiment, the coprocessor 1320 includes a dedicated processor, such as, for example, a network or communication processor, a compression engine, a GPGPU, a high-throughput MIC processor, or an embedded processor, etc.

[0198] The Static Random Access Memory (SRAM) unit 1330 may include one or more computer-readable media for storing data and / or instructions. Instructions may be stored in the computer-readable storage medium, specifically, temporary and permanent copies of the instructions. The instructions may include: when executed by at least one unit in the processor, causing the Soc 1300 to execute the shooting method according to the above embodiments, specifically, referring to the split-screen display method explained in the above embodiments Figure 7 and FIG. 9, which will not be elaborated here.

[0199] Embodiments of the mechanisms disclosed in this application can be implemented in hardware, software, firmware, or combinations of these implementation methods. Embodiments of this application can be implemented as a computer program or program code executed on a programmable system, which includes at least one processor, a storage system (including volatile and non-volatile memories and / or storage elements), at least one input device, and at least one output device.

[0200] The program code can be applied to input instructions to perform the various functions described in this application and generate output information. The output information can be applied to one or more output devices in a known manner. For the purposes of this application, a processing system includes any system having a processor such as, for example, a Digital Signal Processor (DSP), a microcontroller, an Application Specific Integrated Circuit (ASIC), or a microprocessor.

[0201] The program code can be implemented in a high-level procedural language or an object-oriented programming language in order to communicate with the processing system. When needed, the program code can also be implemented in assembly language or machine language. In fact, the mechanisms described in this application are not limited to the scope of any specific programming language. In either case, the language can be a compiled language or an interpreted language.

[0202] In some cases, the disclosed embodiments may be implemented in hardware, firmware, software, or any combination thereof. The disclosed embodiments may also be implemented as instructions carried or stored on one or more transitory or non-transitory machine-readable (e.g., computer-readable) storage media, which may be read and executed by one or more processors. For example, the instructions may be distributed via a network or via other computer-readable media. Thus, machine-readable media may include any mechanism for storing or transmitting information in a machine (e.g., computer) readable form, including but not limited to, floppy disks, optical disks, optical discs, compact disc read only memories (CD-ROMs), magneto-optical disks, read only memories (ROMs), random access memories (RAM), erasable programmable read only memories (EPROMs), electrically erasable programmable read only memories (EEPROMs), magnetic or optical cards, flash memory, or tangible machine-readable memories for transmitting information (e.g., carrier waves, infrared signals, digital signals, etc.) in electrical, optical, acoustic, or other forms via the Internet. Thus, machine-readable media include any type of machine-readable media suitable for storing or transmitting electronic instructions or information in a machine (e.g., computer) readable form.

[0203] In the drawings, some structural or method features may be shown in a particular arrangement and / or order. However, it should be understood that such a particular arrangement and / or ordering may not be required. Rather, in some embodiments, these features may be arranged in a different manner and / or order than shown in the accompanying drawings of the specification. Additionally, the inclusion of a structural or method feature in a particular figure does not imply that such a feature is required in all embodiments, and in some embodiments, these features may be omitted or may be combined with other features.

[0204] It should be noted that each unit / module mentioned in the device embodiments of the present application is a logical unit / module. Physically, a logical unit / module can be a physical unit / module, a part of a physical unit / module, or can be implemented as a combination of multiple physical units / module. The physical implementation manner of these logical units / modules themselves is not the most important. The combination of the functions implemented by these logical units / modules is the key to solving the technical problems proposed by the present application. In addition, in order to highlight the innovative part of the present application, the above-mentioned device embodiments of the present application do not introduce units / modules that are not closely related to solving the technical problems proposed by the present application, which does not mean that there are no other units / modules in the above-mentioned device embodiments.

[0205] It should be noted that in the examples and the description of this patent, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the term "comprising", "including" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article or device. Without further limitation, an element defined by the statement "comprising one" does not exclude the presence of additional identical elements in the process, method, article or device comprising the element.

[0206] Although the present application has been illustrated and described by referring to some preferred embodiments of the present application, those of ordinary skill in the art should understand that various changes can be made to it in form and detail without departing from the spirit and scope of the present application.

Claims

1. A split-screen display method, characterized in that, Applied to an electronic device, the electronic device includes a physical screen, a display area is correspondingly set on the physical screen, and a window interface of an application is displayed in the display area. Among them, the window interface includes a window frame of the application and surface content within the window frame. The electronic device is provided with a software system including an application framework layer, and the application framework layer includes a split management module and a window screen moving module. The method includes: The electronic device receives a split screen operation; In response to the split screen operation, the split management module of the electronic device splits the display area into at least two logical display screens according to a preset size. The at least two logical display screens all have a fixed size, and each logical display screen has an independent coordinate system. There is a corresponding conversion relationship between the physical position coordinates of the display area and the physical position coordinates of each logical display screen; The electronic device readjusts the window interface of the application according to the size of the first logical display screen among the at least two logical display screens, so that the window frame and the surface content match the first logical display screen; The electronic device displays the adjusted window interface of the application on the first logical display screen; Among them, the electronic device readjusts the window interface of the application according to the size of the first logical display screen among the at least two logical display screens, so that the window frame and the surface content match the first logical display screen. The electronic device displays the adjusted window interface of the application on the first logical display screen, including: The window screen moving module of the electronic device obtains the size of the first logical display screen from the split management module, and notifies the application to readjust the window interface corresponding to the size according to the size of the first logical display screen, so that the window frame and the surface content match the first logical display screen; The application readjusts the window interface according to the size of the first logical display screen, and notifies the window screen moving module to move the adjusted window interface; The window screen moving module receives the screen moving notification from the application, and moves the adjusted window interface to be displayed on the first logical display screen; In response to the split screen operation, the electronic device splits the display area into at least two logical display screens according to a preset size, including: The electronic device determines the current orientation as landscape or portrait; Based on the orientation, the display area is split into the logical display screens that conform to the orientation; The electronic device displays the adjusted window interface of the application on the first logical display screen, including: The electronic device displays the window interface corresponding to the orientation on the first logical display screen according to the orientation; And, the electronic device receives the first position coordinates of a touch point on the display area; The electronic device determines a second position coordinate of the first position coordinate within the logical display screen based on a conversion relationship between the physical position coordinates of the display area and the physical position coordinates of the logical display screen, so as to perform a touch operation corresponding to the second position coordinate of the touch point.

2. The method according to claim 1, wherein When there is an interval between at least two of the logical display screens, the electronic device further determines the second position coordinate of the first position coordinate within the logical display screen based on the interval.

3. The method according to claim 1 or 2, characterized in that, When the application is a camera application, the method further includes: The electronic device obtains a window direction corresponding to the camera application and makes the image direction captured by the camera consistent with the window direction on the logical display screen.

4. The method according to claim 1, wherein The electronic device includes a touch processing module and a touch conversion management module, wherein the touch processing module is configured to receive a first position coordinate of a touch point on the display area and send the first position coordinate to the touch conversion management module; the touch conversion management module is configured to determine a conversion relationship between the physical position coordinates of the display area and the physical position coordinates of the logical display screen based on the physical position coordinates of the display area and the number of split logical display screens, and determine a second position coordinate of the first position coordinate of the touch point occurring within the display area within the logical display screen based on the conversion relationship.

5. The method according to claim 1, characterized in that, It further includes: In response to the split screen operation, the electronic device demarcates a status display area on the display area, and the status display area is a display area independent of the logical display screen and is used to display status information of the electronic device.

6. The method according to claim 1, characterized in that, A status display area independent of the display area is further provided on the physical screen of the electronic device and is used to display status information of the electronic device.

7. An electronic device, characterized in that, It includes: A physical screen, on which a display area is correspondingly provided, and a window interface of an application is displayed in the display area, wherein the window interface includes a window frame of the application and surface content within the window frame, a memory for storing instructions executed by one or more processors of the device; at least one processor for executing the instructions and for executing, the processor is provided with a software system including an application framework layer, and the application framework layer includes a split management module and a window screen moving module: Receiving a split screen operation; In response to the split screen operation, the split management module of the processor splits the display area into at least two logical display screens according to a preset size, the at least two logical display screens all have a fixed size, and each of the logical display screens has an independent coordinate system, and there is a corresponding conversion relationship between the physical position coordinates of the display area and the physical position coordinates of each of the logical display screens; The processor readjusts the window interface of the application according to the size of the first logical display screen among the at least two logical display screens and displays the adjusted window interface of the application on the first logical display screen so that the window frame and the surface content match the first logical display screen; Among them, the processor re - adjusts the window interface of the application according to the size of the first logical display screen among the at least two logical display screens, and displays the adjusted window interface of the application on the first logical display screen to make the window frame and the surface content match the first logical display screen, including: The window screen - moving module of the processor obtains the size of the first logical display screen from the split management module, and notifies the application to re - adjust the window interface corresponding to the size according to the size of the first logical display screen; The application re - adjusts the window interface according to the size of the first logical display screen, and notifies the window screen - moving module to move the adjusted window interface; The window screen - moving module receives the screen - moving notification from the application, and moves the adjusted window interface to be displayed on the first logical display screen; The processor is used to determine the current landscape or portrait orientation, and split the display area into the logical display screens that conform to the orientation based on the orientation; The processor is used to display the window interface corresponding to the orientation on the first logical display screen according to the orientation; And, the processor is used to receive the first position coordinate of the touch point for the display area; The processor is used to determine the second position coordinate of the first position coordinate within the logical display screen based on the conversion relationship between the physical position coordinates of the display area and the physical position coordinates of the logical display screen, so as to perform a touch operation corresponding to the second position coordinate of the touch point.

8. The electronic device according to claim 7, characterized in that, When there is an interval between at least two of the logical display screens, The processor is further used to determine the second position coordinate of the first position coordinate within the logical display screen based on the interval.

9. The electronic device according to claim 7 or 8, characterized in that, When the application is a camera application, the processor is used to obtain the window direction corresponding to the camera application, and keep the image direction collected by the camera consistent with the window direction on the logical display screen.

10. The electronic device according to claim 7, wherein, The processor includes a touch processing module and a touch conversion management module, The touch processing module is used to receive the first position coordinate of the touch point for the display area, and send the first position coordinate to the touch conversion management module; The touch conversion management module is used to determine the conversion relationship between the physical position coordinates of the display area and the physical position coordinates of the logical display screen based on the physical position coordinates of the display area and the number of split logical display screens, and determine the second position coordinate of the first position coordinate of the touch point occurring within the display area within the logical display screen based on the conversion relationship.

11. The electronic device according to claim 7, wherein It further includes: In response to the split - screen operation, the electronic device draws a status display area on the display area. The status display area is a display area independent of the logical display screen and is used to display the status information of the electronic device.

12. The electronic device according to claim 7, wherein There is also a status display area independent of the display area on the physical screen of the electronic device, which is used to display the status information of the electronic device.

13. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, and when the computer program is run by an electronic device, the electronic device is caused to execute the method according to any one of claims 1-6.

14. A computer program product containing instructions, characterized in that, When the computer program product runs on an electronic device, the electronic device is caused to execute the method according to any one of claims 1-6.

Images