Screen display method and related electronic device
By adjusting the View box range in electronic devices according to the split screen conditions supported by the application, the problem of code complexity in split screen animation display is solved, and the user experience and maintenance convenience are improved.
Patent Information
- Application Number
- PCT/CN2023/136762
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-03-15
- Filing Date
- 2023-12-06
- Publication Date
- 2025-08-14
AI Technical Summary
During the split screen process, the prior art requires additional layers to display split screen animation, resulting in complex code and difficult to maintain.
By determining the split screen conditions supported by different applications in electronic devices, using regular or irregular hot zones to adjust the scope of the View box, avoiding additional layers and simplifying the code structure.
It realizes simplified code structure, improves the convenience of user experience and technical maintenance, and avoids layer complexity problems caused by split-screen operations.
Smart Images

Figure CN2023136762_14082025_PF_FP_ABST
Abstract
Description
Screen display method and related electronic equipment
[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on March 15, 2023, with application number 202310278303.9 and application name “A screen display method and related electronic equipment”, the entire contents of which are incorporated by reference into this application. Technical Field
[0002] The present application relates to the field of screen display, and in particular to a screen display method and related electronic equipment. Background Art
[0003] In recent years, electronic devices such as tablets and foldable phones have become increasingly popular due to their large screens and the ease of splitting the screen, allowing users to operate two applications on a single screen, thus improving the user experience. For example, a tablet can use the split-screen function to split a video application and office software into two separate screens, displaying both the video playback interface and the text editing interface on the tablet screen. This allows users to simultaneously watch videos and edit documents on their tablet, allowing them to enjoy both entertainment and leisure.
[0004] Summary of the Invention
[0005] An embodiment of the present application provides a screen display method and related electronic equipment, which solves the problem that during the split-screen process, additional layers need to be added to display split-screen animations, resulting in complex code and making it difficult for later technical personnel to perform technical maintenance.
[0006] In a first aspect, an embodiment of the present application provides a screen display method, which is applied to an electronic device with a display screen, the method comprising: displaying a first interface, displaying a floating window on the first interface, the floating window comprising a first control, the floating window corresponding to a first application, and the first interface corresponding to a second application; in response to a first operation on the first control, setting the floating window to a first mode, the first mode being a working mode in which the floating window can be moved on the display screen; if the first application and the second application are both applications that support top-bottom split screen and left-right split screen, determining one or more hot zones in the upper, lower, left, and right directions of a display area of the display screen; if the first application and the second application are not both applications that support top-bottom split screen and left-right split screen, determining one or more hot zones in the upper and lower directions of a display area of the display screen Determine one or more regularly shaped hot zones in the forward or left and right directions respectively; move the position of the floating window on the display screen in response to the second operation on the first control; when the first control is moved within any hot zone range, display the second interface, the second interface includes a first View box and a second View box, the first View box displays the dynamic content of the first application, the second View box displays the dynamic content of the second application, and the first View box and the second View box are on the same layer; in the process of displaying the second interface, respond to the third operation on the first control, display the third interface, the third interface includes a first split-screen interface and a second split-screen interface, the first split-screen interface corresponds to the first application, and the second split-screen interface corresponds to the second application.
[0007] In the above embodiment, the electronic device determines the setting method of two different hot zones on the display screen according to whether the first application and the second application support top-bottom split-screen and / or left-right split-screen. Then, when the electronic device detects that the first control is in any hot zone, it triggers the split-screen operation and then displays the split-screen animation content. Since the View frame that displays the split-screen animation content is on the same layer. Therefore, the traditional split-screen operation based on irregular hot zones is avoided, and it is necessary to add a View frame with a new coating to display the split-screen animation content, which in turn causes the code to be complicated and is not conducive to maintenance by later technical personnel.
[0008] In conjunction with the first aspect, in one possible implementation, the third interface also includes a split-screen switching control. After the third interface is displayed, the following further steps are performed: in response to a fourth operation on the split-screen switching control, if the third interface is a top-bottom split-screen interface, the third interface is switched to a left-right split-screen interface; if the third interface is a left-right split-screen interface, the third interface is switched to a top-bottom split-screen interface. In this way, the user can switch between left-right split screen and top-bottom split screen on the existing split-screen interface, avoiding the tedious operation of "exiting the current split screen, dragging the floating window, and entering the split screen" when the user needs to switch split screens, thereby improving the user experience.
[0009] In combination with the first aspect, in one possible implementation, before responding to the second operation on the second control, it also includes: obtaining a first application identifier and a second application identifier, the first application identifier being the identification information of the first application, and the second application identifier being the identification information of the second application; determining whether the first application identifier and the second application identifier are both identification information in a first whitelist; if so, the first application and the second application are both applications that support top-bottom split-screen and left-right split-screen; if not, the first application and the second application are not both applications that support top-bottom split-screen and left-right split-screen. In this way, determining whether the first application and the second application support split-screen by means of a whitelist is beneficial for the electronic device to determine the setting method of the hot zone according to the split-screen conditions supported by the first application and the second application.
[0010] In combination with the first aspect, in one possible implementation, the display area of the display screen includes N rectangular View frames, each View frame includes four edges: top, bottom, left, and right, and the position and range of each View frame in the display area are represented by four-dimensional coordinates (Xi, Yi, Zi, Ki); wherein Xi represents the distance between the left side of the i-th View frame and the first edge, Yi represents the distance between the right side of the i-th View frame and the first edge, Zi represents the distance between the upper edge of the i-th View frame and the second edge, and Ki represents the distance between the lower edge of the i-th View frame and the second edge; the first edge is the edge of the display screen parallel to the left and right sides, the second edge is the edge of the display screen parallel to the upper and lower edges, and N is an integer greater than 1.
[0011] In combination with the first aspect, in one possible implementation method, when the first application and the second application are both applications that support top-bottom split-screen and left-right split-screen, the second interface is displayed, specifically including: obtaining the first position information of the first control; calculating the first identifier based on the first position information; obtaining the four-dimensional coordinates of the corresponding N View frames according to the first identifier; adjusting the range of each View frame in the display screen based on the N four-dimensional coordinates to obtain the first View frame and the second View frame; displaying the dynamic content of the first application in the first View frame, and displaying the dynamic content of the second application in the second View frame.
[0012] In combination with the first aspect, in one possible implementation method, when the first application and the second application are not both applications that support top-bottom split-screen and left-right split-screen, the second interface is displayed, specifically including: obtaining the first position information of the first control; obtaining the range of the hot zone in the display screen according to the four-dimensional coordinates of the hot zone; when it is determined that the first control is in any hot zone based on the first position information, obtaining the identification information of the hot zone where the first control is located; obtaining the four-dimensional coordinates of the corresponding N View frames based on the identification information; adjusting the range of each View frame in the display screen based on the N four-dimensional coordinates to obtain the first View frame and the second View frame; displaying the motion content of the first application in the first View frame, and displaying the motion content of the second application in the second View frame.
[0013] In conjunction with the first aspect, in one possible implementation, the electronic device includes a split-screen animation management module, a animation frame adjustment module, and a animation adding module. If the first application and the second application are both applications that support top-bottom split-screen and left-right split-screen, displaying the second interface includes: the split-screen animation management module calculating a first identifier based on first position information of the first control;
[0014] The split-screen animation management module sends a third notification message to the animation frame adjustment module, and the third notification message includes the first identifier; the animation frame adjustment module obtains the four-dimensional coordinates of the corresponding N View frames according to the first identifier; the animation adjustment module adjusts the range of the corresponding N View frames in the display screen according to the four-dimensional coordinates of the N View frames to obtain the first View frame and the second View frame; the animation adjustment module sends a fourth notification message to the animation adding module, and the fourth notification message includes the first identifier, the first mapping relationship between the first View frame and the first application, and the second mapping relationship between the second View frame and the second application; the animation adding module obtains the animation content of the first application and the animation content of the second application according to the first identifier; the animation adding module displays the animation content of the first application on the first View frame according to the first mapping relationship; the animation adding module displays the animation content of the second application on the second View frame according to the second mapping relationship.
[0015] In combination with the first aspect, in one possible implementation method, the electronic device includes a split-screen motion effect management module, a motion effect frame adjustment module, and a motion effect adding module. If the first application and the second application are not both applications that support top-bottom split-screen and left-right split-screen, a second interface is displayed, including: the split-screen management module sends a third notification message to the motion effect frame adjustment module when it determines that the first control is within the hot zone based on the first position information of the first control, and the third notification message includes identification information of the hot zone where the first control is located; the motion effect frame adjustment module obtains the four-dimensional coordinates of the corresponding N View frames according to the identification information; the motion effect adjustment module adjusts the four-dimensional coordinates of the N View frames according to the four-dimensional coordinates of the N View frames. The range of N View frames corresponding to the display screen obtains the first View frame and the second View frame; the motion effect adjustment module sends a fourth notification message to the motion effect adding module, and the fourth notification message includes the identification information, the first mapping relationship between the first View frame and the first application, and the second mapping relationship between the second View frame and the second application; the motion effect adding module obtains the motion effect content of the first application and the motion effect content of the second application according to the identification information; the motion effect adding module displays the motion effect content of the first application on the first View frame according to the first mapping relationship; the motion effect adding module displays the motion effect content of the second application on the second View frame according to the second mapping relationship.
[0016] In combination with the first aspect, in one possible implementation, the electronic device also includes a floating window moving module and a hot zone setting module of the first application, and before displaying the second interface, it also includes: the floating window moving module responds to the first operation, and sends a first notification message to the hot zone setting module, the first notification message includes a first application identifier and a second application identifier, the first application identifier is the identification information of the first application, and the second application identifier is the identification information of the second application; the hot zone setting module determines whether the first application identifier and the second application identifier are both application identifiers in the first whitelist; if yes, the hot zone setting module sends the first hot zone information to the split-screen animation management module, and the first hot zone information is used to indicate that the first application and the second application are both applications that support top and bottom split-screen and left and right split-screen; if not, the hot zone setting module sends the second hot zone information to the split-screen animation management module, and the second hot zone information is used to indicate that the first application and the second application are not both applications that support top and bottom split-screen and left and right split-screen.
[0017] In combination with the first aspect, in one possible implementation method, after the hot zone setting module sends the first hot zone information to the split-screen animation management module or after the hot zone setting module sends the second hot zone information to the split-screen animation management module, it also includes: the floating window movement module responds to the second operation and sends a second notification message to the split-screen animation management module, and the second notification message is used to prompt the split-screen animation management module to obtain the first position information of the first control; the split-screen animation management module obtains the first position information of the first control in real time.
[0018] In combination with the first aspect, in one possible implementation method, after displaying the second interface, it also includes: the floating window moving module responds to the third operation and sends a fifth notification message to the animation adding module; the animation adding module sends a first indication message to the first application, and the first indication message includes a first identifier; the animation adding module sends a second indication message to the second application, and the second indication message includes the first identifier; the first application displays the first split-screen interface on the third interface based on the first identifier; the second application displays the second split-screen interface on the third interface based on the first identifier.
[0019] In combination with the first aspect, in one possible implementation method, after displaying the second interface, it also includes: the floating window moving module responds to the third operation and sends a fifth notification message to the motion effect adding module; the motion effect adding module sends a first indication message to the first application, and the first indication message includes the identification information of the hot zone where the first control is located; the motion effect adding module sends a second indication message to the second application, and the second indication message includes the identification information of the hot zone where the first control is located; the first application displays the first split-screen interface on the third interface based on the identification information of the hot zone where the first control is located; the second application displays the second split-screen interface on the third interface based on the identification information of the hot zone where the first control is located.
[0020] In a second aspect, an embodiment of the present application provides an electronic device, which includes: one or more processors, a display screen and a memory; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the electronic device to execute: displaying a first interface through the display screen, displaying a floating window on the first interface, the floating window including a first control, the floating window corresponding to a first application, and the first interface corresponding to a second application; in response to a first operation on the first control, setting the floating window to a first mode, the first mode is a working mode in which the floating window can be moved on the display screen; if the first application and the second application are both applications that support top-bottom split screen and left-right split screen, one or more hot zones are respectively determined in the top, bottom, left and right directions of the display area of the display screen; if the first application and the second application are The second application is not an application that supports top-down split screen and left-right split screen, and one or more regularly shaped hot zones are respectively determined in the upper and lower directions or left and right directions of the display area of the display screen; in response to the second operation on the first control, the position of the floating window is moved on the display screen; when the first control is moved to any hot zone range, the second interface is displayed through the display screen, and the second interface includes a first View box and a second View box, the first View box displays the dynamic content of the first application, and the second View box displays the dynamic content of the second application, and the first View box and the second View box are on the same layer; in the process of displaying the second interface, in response to the third operation on the first control, the third interface is displayed through the display screen, and the third interface includes a first split-screen interface and a second split-screen interface, the first split-screen interface corresponds to the first application, and the second split-screen interface corresponds to the second application.
[0021] In combination with the second aspect, in one possible implementation, the one or more processors call the computer instructions to cause the electronic device to execute: in response to the fourth operation on the split-screen switching control, if the third interface is a top-bottom split-screen interface, switch the third interface to a left-right split-screen interface; if the third interface is a left-right split-screen interface, switch the third interface to a top-bottom split-screen interface.
[0022] In combination with the second aspect, in one possible implementation, the one or more processors call the computer instructions to cause the electronic device to execute: obtaining a first application identifier and a second application identifier, the first application identifier being identification information of the first application, and the second application identifier being identification information of the second application; determining whether the first application identifier and the second application identifier are both identification information in the first whitelist; if yes, the first application and the second application are both applications that support top-down split-screen and left-right split-screen; if no, the first application and the second application are not both applications that support top-down split-screen and left-right split-screen.
[0023] In combination with the second aspect, in one possible implementation, the one or more processors call the computer instructions to enable the electronic device to execute: obtaining the first position information of the first control; calculating the first identifier based on the first position information; obtaining the four-dimensional coordinates of the corresponding N View frames according to the first identifier; adjusting the range of each View frame in the display screen based on the N four-dimensional coordinates to obtain the first View frame and the second View frame; displaying the dynamic content of the first application in the first View frame through the display screen, and displaying the dynamic content of the second application in the second View frame through the display screen.
[0024] In combination with the second aspect, in one possible implementation method, the one or more processors call the computer instructions to enable the electronic device to execute: obtaining the first position information of the first control; obtaining the range of the hot zone in the display screen according to the four-dimensional coordinates of the hot zone; when it is determined that the first control is in any hot zone based on the first position information, obtaining the identification information of the hot zone where the first control is located; obtaining the four-dimensional coordinates of the corresponding N View frames based on the identification information; adjusting the range of each View frame in the display screen based on the N four-dimensional coordinates to obtain the first View frame and the second View frame; displaying the dynamic content of the first application in the first View frame through the display screen, and displaying the dynamic content of the second application in the second View frame through the display screen.
[0025] In a third aspect, an embodiment of the present application provides an electronic device comprising: a touch screen, a camera, one or more processors and one or more memories; the one or more processors are coupled to the touch screen, the camera, and the one or more memories, and the one or more memories are used to store computer program code, and the computer program code includes computer instructions. When the one or more processors execute the computer instructions, the electronic device executes the method described in the first aspect or any possible implementation method of the first aspect.
[0026] In a fourth aspect, an embodiment of the present application provides a chip system, which is applied to an electronic device, and the chip system includes one or more processors, which are used to call computer instructions to enable the electronic device to execute the method described in the first aspect or any possible implementation method of the first aspect.
[0027] In a fifth aspect, an embodiment of the present application provides a computer program product comprising instructions, which, when run on an electronic device, enables the electronic device to execute the method described in the first aspect or any possible implementation of the first aspect.
[0028] In a sixth aspect, an embodiment of the present application provides a computer-readable storage medium comprising instructions, which, when executed on an electronic device, enables the electronic device to execute the method described in the first aspect or any possible implementation of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS
[0029] Figures 1A-1J are diagrams illustrating an application scenario provided by the present application;
[0030] FIG2A is an example diagram of hot zone distribution of an electronic device in landscape mode provided by an embodiment of the present application;
[0031] FIG2B is an example diagram of hot zone distribution of an electronic device in portrait mode provided by an embodiment of the present application;
[0032] FIG2C is an example diagram of the distribution of View frames of an electronic device in landscape mode provided by an embodiment of the present application;
[0033] FIG2D is a layout diagram of a View frame of a display area of an electronic device provided by an embodiment of the present application;
[0034] FIG3A is an example diagram of irregular hot zone division of an electronic device 100 provided by an embodiment of the present application;
[0035] 3B-3D are diagrams illustrating user interfaces of a group of electronic devices 100 provided by the present application;
[0036] FIG4 is a flow chart of a screen display method provided in an embodiment of the present application;
[0037] FIG5A is a layout diagram of a View frame of a display area of another electronic device provided by an embodiment of the present application;
[0038] FIG5B is an example diagram of an electronic device in landscape mode provided by an embodiment of the present application;
[0039] FIG5C is an example diagram of an electronic device in portrait mode provided by an embodiment of the present application;
[0040] FIG6 is a module interaction diagram of a screen display method provided in an embodiment of the present application;
[0041] FIG7 is a module interaction diagram of another screen display method provided in an embodiment of the present application;
[0042] FIG8 is a schematic diagram of the hardware structure of the electronic device 100 provided in an embodiment of the present application;
[0043] FIG9 is a software structure block diagram of the electronic device 100 according to an embodiment of the present application when performing a split-screen operation based on irregular hot zones;
[0044] FIG10 is a software structure block diagram of the electronic device 100 provided in an embodiment of the present application when performing split-screen operation in a regular hot zone manner. DETAILED DESCRIPTION
[0045] The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Mentioning "embodiment" in this article means that the specific features, structures or characteristics described in conjunction with the embodiment can be included in at least one embodiment of the present embodiment application. The appearance of this phrase in various positions in the specification does not necessarily mean the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It can be understood explicitly and implicitly by those skilled in the art that the embodiments described herein can be combined with other embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without making creative work are within the scope of protection of this application.
[0046] In the specification, claims, and accompanying drawings of this application, the terms "first," "second," "third," and the like are used to distinguish different objects and are not used to describe a particular order. Furthermore, the terms "including," "comprising," "having," and any variations thereof are intended to cover non-exclusive inclusions. For example, a list of steps or elements may be included, or alternatively, steps or elements not listed may be included, or other steps or elements may be included that are inherent to the process, method, product, or apparatus.
[0047] Only part relevant to the present application is shown in the accompanying drawings, not all of it. Before discussing exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processing or methods depicted as flow charts. Although flow charts describe various operations (or steps) as sequential processing, many operations therein can be implemented in parallel, concurrently or simultaneously. In addition, the order of various operations can be rearranged. When its operation is completed, the processing can be terminated, but can also have additional steps not included in the accompanying drawings. The processing can correspond to methods, functions, procedures, subroutines, subprograms, etc.
[0048] As used in this specification, the terms "component," "module," "system," "unit," and the like are used to refer to computer-related entities, hardware, firmware, a combination of hardware and software, software, or software in execution. For example, a unit can be, but is not limited to, a process running on a processor, a processor, an object, an executable file, an execution thread, a program, and / or distributed between two or more computers. In addition, these units can be executed from various computer-readable media having various data structures stored thereon. Units can communicate, for example, through local and / or remote processes based on signals having one or more data packets (e.g., data from a second unit interacting with another unit in a local system, a distributed system, and / or a network. For example, the Internet interacts with other systems via signals).
[0049] In recent years, electronic devices such as tablets and foldable phones have become increasingly popular due to their large screens and the ease of splitting the screen, allowing users to operate two applications on a single screen, thus improving the user experience. For example, a tablet can use the split-screen function to split a video application and office software into two separate screens, displaying both the video playback interface and the text editing interface on the tablet screen. This allows users to simultaneously watch videos and edit documents on their tablet, allowing them to enjoy both entertainment and leisure.
[0050] To better understand the above application scenarios, the application scenarios involved in the embodiments of the present application are exemplarily described below in conjunction with Figures 1A to 1J. In the embodiments of the present application, an electronic device 100 is used as an example for explanation. The electronic device 100 can be a smartphone, a foldable screen phone, a tablet computer, or other types of terminal devices, and the embodiments of the present application do not limit this.
[0051] FIG1A shows a user interface 10 of an electronic device 100. User interface 10 is an exemplary interface of a browser application. A floating window 101 is displayed in user interface 10. This floating window 101 corresponds to a floating window of a calculator application. In user interface 10, floating window 101 can be moved around by a user's operation.
[0052] Exemplarily, when the electronic device 100 detects a user's long press operation (first operation) on the drag bar 1011 on the floating window 101, in response to the operation, the electronic device 100 sets the floating window 101 to a "draggable" mode (first mode), that is, the user can drag the floating window 101 on the user interface 10 through the drag bar 1011.
[0053] As shown in FIG1B , when the floating window 101 is in the "draggable" mode, in response to the user's second operation on the drag bar 1011 (for example, dragging the floating window 101 to the right of the screen), the electronic device 100 moves the floating window 101 and its drag bar 1011 to the right of the screen in the direction of the user's gesture. The user then continues to drag the floating window 101 to the right. At time t1, the electronic device 100 detects that the drag bar 1011 has entered the area 102, and the electronic device 100 begins to split the screen left and right and displays the user interface 11 shown in FIG1C .
[0054] As shown in Figure 1C, the user interface 11 is an exemplary dynamic effect interface of the electronic device 100 during the left-right split screen process. Among them, the dynamic effect box 111 is the dynamic effect box of the browser application, and the split-screen dynamic effect of the browser can be displayed in the dynamic effect box. For example, the icon 1111 of the browser application. The dynamic effect box 112 is the dynamic effect box of the calculator application, and the split-screen dynamic effect of the calculator can be displayed in the dynamic effect box. For example, a gray background image, a floating window 1121 of the calculator application, an application icon 1122 of the calculator application, and a drag bar 1011 of the floating window. At this time, the user's finger is still long pressing the drag bar 1011. When the electronic device 100 detects the user's third operation on the drag bar 1011 (for example, raising the hand to release the drag bar 1011), in response to the third operation, the electronic device 100 displays the user interface 12 as shown in Figure 1D.
[0055] As shown in FIG1D , user interface 12 is an exemplary user interface of electronic device 100 after splitting the browser application and the calculator application into two parts. User interface 12 includes a browser application interface 121 (a second split-screen interface) and a calculator application interface 122 (a first split-screen interface). Users can perform different operations in the different split-screen interfaces. For example, users can browse news and search for information online in the second split-screen interface, and perform data calculations in the first split-screen interface.
[0056] 1A to 1D illustrate exemplary application scenarios of left-right split screen of electronic device 100. In some embodiments, the electronic device can also perform top-bottom split screen to obtain different split screen display effects.
[0057] For example, in the user interface 10 of Figure 1E, when the electronic device 100 detects a first operation of the user on the drag bar 1011 in the floating window 101 of the calculator application (for example, long pressing the drag bar 1011), in response to the first operation, the floating window 101 enters the "draggable" mode (first mode). At this time, when the electronic device 100 detects a second operation of the user on the drag bar 1011 (for example, dragging the drag bar 1011 upward), in response to the second operation, the floating window 101 moves upward in the direction of the user's gesture. When the electronic device 100 detects that the drag bar 1011 is within the area 104, the electronic device 100 displays the user interface 13 shown in Figure 1F.
[0058] As shown in Figure 1F, the user interface 13 is an exemplary dynamic effect interface of the electronic device 100 during the process of splitting the screen up and down. Among them, the dynamic effect box 131 is the dynamic effect box of the browser application, and the dynamic effect content of the browser can be displayed in this dynamic effect box. For example, the application icon 1311 of the browser. The dynamic effect box 132 is the dynamic effect box of the calculator application, and the dynamic effect content of the calculator application is displayed in this dynamic effect box. For example, a floating window 1321, a gray background image, a calculator application icon 1322, and a drag bar 1011. At this time, the user's finger is still long pressing the drag bar 1011. When the electronic device 100 detects the user's third operation on the drag bar 1011 (for example, raising the hand to release the drag bar 1011), in response to the third operation, the electronic device 100 displays the user interface 14 shown in Figure 1G.
[0059] As shown in FIG1G , user interface 14 is an exemplary user interface of electronic device 100 after the browser application and calculator application are split into two upper and lower screens. User interface 14 includes a browser application interface 142 (a second split-screen interface) and a calculator application interface 141 (a first split-screen interface). Users can perform different operations in the different split-screen interfaces. For example, they can browse news and surf the Internet in the second split-screen interface, and perform data calculations in the first split-screen interface.
[0060] In some embodiments, the upper and lower split-screen interface and the left and right split-screen interface can be switched. For example, the user interface 12 and the user interface 14 include a split-screen switching control 123 and a split-screen switching control 143, respectively. In the user interface 12, when the electronic device 100 detects an input operation (for example, a single click) for the split-screen switching control 123, in response to the input operation, the electronic device 100 can switch the user interface 12 to the user interface 14, that is, the left and right split-screen interface is switched to the upper and lower split-screen interface. In the user interface 14, when the electronic device 100 detects an input operation (for example, a single click) for the split-screen switching control 143, in response to the input operation, the electronic device 100 can switch the user interface 14 to the user interface 12, that is, the upper and lower split-screen interface is switched to the left and right split-screen interface.
[0061] The embodiments of Figures 1A to 1G above mainly describe application scenarios in which the electronic device 100 performs left-right or top-down splitting in landscape mode. In some application scenarios, the electronic device 100 can switch between landscape and portrait modes based on the user's holding position of the electronic device 100. In portrait mode, the electronic device 100 can also perform floating window splitting. The following description will only use the top-down splitting of the electronic device 100 in portrait mode as an example.
[0062] As shown in Figure 1H, user interface 15 is an exemplary user interface of the electronic device 100 in portrait mode. The user interface is the interface of a browser application, in which a floating window 151 of a calculator application and a drag bar 1511 corresponding to the floating window are displayed. When the electronic device 100 detects a first operation of the user on the drag bar 1511 (for example, long pressing the drag bar 1511), in response to the first operation, the floating window 151 enters "draggable" mode. At this time, if the electronic device 100 detects a second operation of the user (for example, dragging the drag bar 1511 upward), in response to the second operation, the electronic device 100 moves the floating window 151 upward following the direction of movement of the finger. When the electronic device 100 detects that the drag bar enters the area 152, the electronic device 100 displays the user interface 16 as shown in Figure 1I.
[0063] In Figure 1I, the user interface 16 is an exemplary dynamic effect interface of the electronic device 100 in the process of splitting the screen up and down in the vertical screen interface. Among them, the dynamic effect interface includes a first dynamic effect box 161 and a second dynamic effect box 162. The dynamic effect content of the calculator application is displayed in the first dynamic effect box 161. For example, a floating window 1611, a gray background image, and an application icon 1612 of the calculator. The dynamic effect content of the browser application is displayed in the second dynamic effect box 162. For example, the application icon 1612. If at this time, the electronic device 100 detects a third operation on the drag bar 1511 (for example, raising the hand to release the drag bar 1511), in response to the third operation, the electronic device 100 will display the user interface 17 shown in Figure 1J.
[0064] In FIG1J , user interface 17 is an exemplary interface of the upper and lower split screen of the electronic device 100 in the portrait mode. The user interface 17 includes a first split screen interface 172 (the interface of the calculator application) and a second split screen interface 171 (the interface of the browser application). In some application scenarios, the user interface 17 may also include a split screen switching control 173. When the electronic device 100 detects a user input operation (e.g., a single click) on the split screen switching control 173, in response to the input operation, the electronic device 100 switches the upper and lower split screen to the left and right split screen in the portrait mode.
[0065] In some embodiments, the location of the application split-screen interface may be related to the direction in which the floating window is dragged. For example, in the embodiments of Figures 1A-1D above, since the electronic device 100 moves the floating window 101 to the right in response to the user's second operation on the drag bar, in the user interface of Figure 1D, the electronic device displays the split-screen interface of the calculator application on the right and the split-screen interface of the browser application on the left. For another example, in the embodiments of Figures 1E-1J above, since the electronic device 100 moves the floating window 151 upward in response to the user's second operation on the drag bar. Therefore, in the user interface of Figure 1J, the electronic device displays the split-screen interface of the calculator application on the upper side and the split-screen interface of the browser application on the lower side.
[0066] It should be understood that the above-mentioned embodiments of Figures 1A to 1J are merely illustrative of the application scenarios of the split-screen application of the electronic device 100 according to the embodiments of the present application.
[0067] The following is an illustrative description of two principles for split-screen display by the electronic device 100. The electronic device generally determines whether to trigger a split-screen operation by detecting whether the drag bar of the floating window enters a hot zone. When the electronic device determines that the drag bar of the floating window is within the hot zone, the electronic device triggers the split-screen operation. When the electronic device determines that the drag bar of the floating window is not within the hot zone, the electronic device does not trigger the split-screen operation.
[0068] There are mainly three processes for electronic devices to perform split-screen operations: triggering split-screen operations, displaying split-screen animations, and displaying split-screen interfaces. Among them, triggering split-screen operations is mainly achieved by judging whether the drag bar of the floating window is within the hot zone range. The hot zone described here can be understood as an area of a specific range delineated on the screen display area that is not facing the user (invisible to the user). Hot zones can be divided into regular hot zones and irregular hot zones. In an embodiment of the present application, a regular hot zone can be understood as a hot zone with a rectangular shape, and an irregular hot zone can be understood as a hot zone with a non-rectangular shape (for example, a triangle, a circle, etc.). For regular hot zones and irregular hot zones, the principles of triggering split-screen operations and displaying split-screen animations will also be different. For ease of understanding, below, the embodiments of the present application will introduce the principles of the electronic device 100 performing split-screen operations based on regular hot zones and based on irregular hot zones, respectively.
[0069] First, the principle of the split-screen operation of the electronic device 100 based on regular hot zones is exemplarily introduced.
[0070] In Figure 2A, the display area of the electronic device 100 includes two rectangular hotspots, namely Hotspot 1 and Hotspot 2. For Hotspot 1 and Hotspot 2, the electronic device 100 first records the positions of these two areas on the screen. The method used is to record the range of each hotspot in the display area by recording the distance between each hotspot and the edge of the display area, thereby defining the hotspot.
[0071] Since the shape of each hot zone is a rectangle, it can be found that the four sides of each hot zone are actually parallel to the upper and lower edges / left and right edges of the screen edge. Assume that the hot zone is defined based on the left edge (S1) and the lower edge (S2) of the display area (display screen), and the distance between the left, right, top and bottom edges of each hot zone and S1 / S2 is defined by a four-dimensional coordinate. Then, the range of the hot zone can be represented by (X, Y, Z, K). Among them, X represents the distance between the left side of the hot zone and the left edge of the display area (S1 in Figure 2A), Y represents the distance between the right side of the hot zone and the left edge of the display area, Z represents the distance between the top edge of the hot zone and the bottom edge of the display area, and K represents the distance between the bottom edge of the hot zone and the bottom edge of the display area. By defining the four-dimensional coordinates of each hot zone, the range of any regular hot zone in the display area of the electronic device can be defined.
[0072] It should be noted that the embodiment of the present application only uses the left edge and the bottom edge of the display area as references to define the hot zone. In some embodiments, any two other non-parallel edges of the display area can also be selected as reference edges for defining the hot zone.
[0073] For example, assume that the length of the left edge of the display area is h1 and the length of the lower edge of the display area is h2. As shown in Figure 2A, the range of hot zone 1 in the display area is (0.024*h2, 0.15*h2, h1, 0), and the range of hot zone 2 in the display area is (0.85*h2, 0.96*h2, h1, 0). By defining regular hot zones in the above manner, even if the electronic device switches between horizontal and vertical screens, the hot zones can also be switched accordingly. Therefore, the hot zones will not be redefined due to the switching of horizontal / vertical screens.
[0074] For example, as shown in FIG2B , this is an interface diagram of the electronic device 100 in portrait mode. Since the electronic device 100 selects the left edge and the bottom edge of the display area as the basis to define the hot zone. Therefore, in FIG2B , the left edge of the display area corresponds to S2, and the bottom edge of the display area corresponds to S3. If the range of hot zone 1 in the display area is (0.024*h2, 0.15*h2, h1, 0), and the range of hot zone 2 in the display area is (0.85*h2, 0.96*h2, h1, 0), then the range of hot zone 1 and hot zone 2 in the display area can be as shown in FIG2B .
[0075] Please refer to Figure 2C, which is an example diagram of the layout of the View frame of the electronic device 100 in landscape mode. For split-screen operations using regular hot zones, electronic devices usually divide the screen area into multiple View frames of regular shapes (all rectangular). These View frames can be used to display the dynamic content applied during the split-screen process. For ease of description, only three View frames are shown in Figure 2C, and these three View frames are on one layer. Similar to the definition of the range of the above-mentioned hot zone in the display area, the range of each View frame in the display area of the electronic device is also determined by a four-dimensional coordinate. The relevant description of the definition of the View frame range can be found in the above description and will not be repeated here.
[0076] When the electronic device detects that the drag bar of the floating window is within the hot zone, it starts the split-screen operation. Then, according to the type of split-screen operation (for example, the application corresponding to the floating window is split on the top, the application corresponding to the floating window is split on the bottom, the application corresponding to the floating window is split on the left, and the application corresponding to the floating window is split on the right), the four-dimensional coordinates of the View frame in the display area can be changed accordingly, and the distances between the top, bottom, left and right sides of the View frame and the edge of the selected display area can be adjusted according to the four-dimensional coordinates, thereby changing the range of the View frame in the display area, and then obtaining a View frame that displays the application's animated content during the split-screen process.
[0077] Figure 2D shows the layout of the View frames of the display area of the electronic device during split-screen operation. It can be seen that compared to Figure 2C , the ranges of the first and second View frames have been expanded, while the range of the third View frame has been significantly compressed. In conjunction with the embodiments of Figures 1A-1D above, the animated content within the animated content frame 111 in Figure 1C above can be displayed in the first View frame, and the animated content within the animated content frame 112 in Figure 1C above can be displayed in the second View frame.
[0078] The following is an exemplary introduction to the principle of the electronic device 100 performing split-screen operation based on irregular hot zones.
[0079] FIG3A shows an example of irregular hot zone division of the electronic device 100. FIG3A includes four hot zones, namely hot zone 1, hot zone 2, hot zone 3, and hot zone 4. Since these four hot zones are all trapezoidal, they all include sides that are not parallel to the edge of the display area. Therefore, these four hot zones are all irregular hot zones. This makes it impossible for the electronic device to use the above-mentioned method of defining four-dimensional coordinates to characterize the range of the irregular hot zone in the display area (because the waist of the trapezoid is not parallel to the upper or lower edge of the display area, it cannot be represented by the distance from the lower or left edge). Therefore, for irregular hot zones, it is necessary to obtain the corresponding logic function H based on the layout of the irregular hot zones in the display area. Then, based on the output of the logic function H, it is determined whether to perform a split-screen operation, and if a split-screen operation is to be performed, which type of split-screen operation should be performed (for example, the application corresponding to the floating window is split on the top, the application corresponding to the floating window is split on the bottom, the application corresponding to the floating window is split on the left, and the application corresponding to the floating window is split on the right).
[0080] For example, when a user is dragging a floating window's drag bar, the electronic device can obtain the position coordinates (x, y) of the drag bar in the display area in real time, use (x, y) as input to H, and thereby obtain a first identifier W. Based on W, it is determined whether to perform a split-screen operation, and if so, which type of split-screen operation should be performed.
[0081] For example, in FIG3B , the position coordinates of the drag bar 3011 of the floating window are (x1, y1), the first identifier W is calculated according to W=H(x1, y1), and it is determined based on W that the upper split-screen operation of the application corresponding to the floating window should be executed.
[0082] For irregular hot spots, the entire display area is generally used as a View frame (the first View frame shown in Figure 3C). When a split-screen animation is to be displayed (for example, the user interface 13 in Figure 1F above), it is necessary to add another View frame on the basis of the original View frame, which also adds a layer. For example, Figure 3D shows the layout of the View frame in the process of splitting the corresponding application of the floating window. The second View frame is a newly added View frame based on the first View frame. In combination with the above-mentioned Figure 1F embodiment, the first View frame displays the animation content of the calculator application, and the second View frame displays the animation content of the browser application.
[0083] Regarding the above-mentioned split-screen operation based on rule-based hot zone, on the one hand, since the range of the hot zone in the display area can be defined by four-dimensional coordinates, the range of the hot zone can also be switched accordingly in landscape or portrait mode. This makes the code logic for split-screen operation in this way simple, the code is highly readable, and it is easy for technical personnel to perform technical maintenance later. On the other hand, when technical personnel later want to modify the range or position of the hot zone, they only need to change the four-dimensional coordinates of the hot zone, which greatly improves the work efficiency of the technical personnel.
[0084] However, this method can only define regular areas, and the amount of code is relatively redundant to a certain extent. In addition, generally speaking, this method generally only defines two hot zones (upper and lower hot zones or left and right hot zones), which makes it possible to only achieve upper and lower split screens or left and right split screens through hot zone methods. Taking the definition of left and right hot zones as an example, electronic devices can only perform left and right split screens through hot zone methods. If you want to perform upper and lower split screens, you can only perform left and right split screens first, and then switch to upper and lower split screens by switching (for example, single-clicking the split screen switching control 123 in Figure 1D above). In this way, the process of switching from left and right split screens to upper and lower split screens is relatively complicated for users, and there is no split screen animation in the process of switching from left and right split screens to upper and lower split screens, which also gives people a sense of abruptness from the user interface.
[0085] Regarding the above-mentioned split-screen operation based on irregular hot zones, on the one hand, since the first identifier is calculated based on the position of the floating window drag bar through a logical function to determine whether to perform a split-screen operation and what type of split-screen operation to perform, hot zones of any shape can be defined. On the other hand, when displaying split-screen animations, a View frame needs to be added to the top layer, which adds a layer and makes the underlying code more complicated.
[0086] Therefore, in order to solve the problems existing in the split-screen operation based on the above-mentioned regular hot zone method and irregular hot zone method, an embodiment of the present application provides a method for screen display, which method is: before performing the split-screen operation, the electronic device first determines whether the application corresponding to the floating window and the application corresponding to the current user interface are both applications that support top-down split-screen and left-right split-screen. If yes, the electronic device uses the irregular hot zone method (through the logic function method) to determine whether to perform the split-screen operation and, if a split-screen operation is to be performed, which type of split-screen operation is to be performed (for example, a left-right split-screen operation with the floating window corresponding to the application interface on the left or a left-right split-screen operation with the floating window corresponding to the application interface on the right or a top-down split-screen operation with the floating window corresponding to the application interface on the top or a top-down split-screen operation with the floating window corresponding to the application interface on the bottom or no split-screen operation is performed). If not, the electronic device uses the regular hot zone method (by determining whether the drag bar of the floating window is within the defined regular hot zone) to determine whether to perform the split-screen operation and, if a split-screen operation is to be performed, which type of split-screen operation is to be performed (for example, a left-right split-screen operation with the floating window corresponding to the application interface on the left or a left-right split-screen operation with the floating window corresponding to the application interface on the right).
[0087] In addition, the electronic device sets multiple View frames in the same layer of the screen area (the embodiment of the present application takes the setting of 3 View frames as an example for explanation). During the split-screen operation, by changing the size and position of the 3 View frames, a View frame that displays the dynamic content of the application is obtained. Then, the dynamic content of the corresponding application is displayed in the View frame. In this way, the problem that the electronic device must add additional View frames to generate the dynamic effects of the split-screen application during the split-screen operation, which makes the layer complicated and then makes the code complicated, is avoided.
[0088] The following describes the process of a screen display method provided by an embodiment of the present application in conjunction with the accompanying drawings. Please refer to Figure 4, which is a flow chart of a screen display method provided by an embodiment of the present application. The specific process is as follows:
[0089] S401: The electronic device displays a first interface, where the first interface is an interface corresponding to a second application. A floating window is displayed on the first interface, where the application corresponding to the floating window is a first application, and the first floating window includes a first control.
[0090] For example, the first interface may be the user interface 10 in the embodiment of FIG. 1A , the floating window may be the floating window 101 in the embodiment of FIG. 1A , and the first control may be the drag bar 1011 in the embodiment of FIG. 1A . The first application may be the calculator application in the embodiment of FIG. 1A (the application corresponding to the floating window), and the second application may be the browser application in the embodiment of FIG. 1A .
[0091] S402: In response to a first operation on the first control, the electronic device sets the floating window to a first mode.
[0092] For example, the first operation may be a long press operation on the drag bar 1011 in the embodiment of Figure 1A. The first mode is a working mode in which the floating window moves in the direction of the user dragging.
[0093] Optionally, after detecting a first user operation on the first control, the electronic device may obtain application identifiers of the first application and the second application, and determine whether the application identifier of the first application and the application identifier of the second application are in the first whitelist based on the application identifiers of the first application and the second application. The first whitelist includes application identifiers of multiple applications, and the applications corresponding to these multiple application identifiers are applications that support both top-bottom split-screen and left-right split-screen.
[0094] If the application identifier of the first application and the application identifier of the second application are present in the first whitelist, it indicates that both the first application and the second application support top-bottom split screen and left-right split screen. Then, the electronic device uses the irregular hot zone method to perform the split screen operation of the first application and the second application.
[0095] If the first application's application identifier or the second application's application identifier does not exist in the first whitelist, or both the first application's application identifier and the second application's application identifier do not exist, it indicates that the first application and / or the second application only supports one of the two split-screen modes: left-right split-screen and top-bottom split-screen. In this case, the electronic device uses a regular hotspot method to perform split-screen operation on the first and second applications.
[0096] S403: In response to a second operation on the first control, the electronic device obtains first position information of the first control.
[0097] Illustratively, the second operation may be an input operation of the user dragging the drag bar 1011 to the right in the embodiment of FIG. 1B .
[0098] After detecting the second operation on the first control, the electronic device can obtain first position information of the first control in real time. The first position information can be two-dimensional coordinate information of the first control in the display area of the electronic device.
[0099] In some embodiments, the coordinate information of the center point of the first control in the display area can be determined as the first position information, or the coordinate information of any point in the first control in the display area can be determined as the first position information. The embodiments of the present application do not limit this.
[0100] S404: If the first application and the second application both support top-bottom split screen and left-right split screen, the electronic device calculates a first identifier based on the first position information.
[0101] Specifically, in the above S402, if the identification information of the first application and the identification information of the second application are both in the first whitelist, then the first application and the second application are both applications that support top-bottom split-screen and left-right split-screen. If the first application and the second application are both applications that support top-bottom split-screen and left-right split-screen. Then, the electronic device uses the irregular hot zone method to determine whether to perform a split-screen operation of the first application and the second application, that is: the electronic device determines whether to perform a split-screen operation by using the first identifier output by the logic function, and on the premise of performing a split-screen operation, determines which type of split-screen operation (for example, the first application top split-screen operation, the first application bottom split-screen operation, the first application left split-screen operation, the first application right split-screen operation, etc.).
[0102] The electronic device may first obtain a logic function H corresponding to the set irregular hot zone. Then, the first coordinate information (x, y) is used as input to H to obtain a first identifier W, i.e., W = H(x, y), thereby calculating W in real time based on the first position information obtained in real time. The electronic device may also determine whether to perform a split-screen operation based on the first identifier, and if so, which type of split-screen operation should be performed.
[0103] S405: When the first identifier indicates a split-screen operation, the electronic device adjusts the range of the View frame in the display area according to the first identifier to obtain a first View frame and a second View frame, where the first View frame corresponds to a first application and the second View frame corresponds to a second application.
[0104] Specifically, the display area can be understood as the display screen of the electronic device. The first identifier calculated by the electronic device can be divided into the following five situations: the first application is split on the top (for example, the first identifier is Topsplit), the first application is split on the bottom (for example, the first identifier is Bottomsplit), the first application is split on the left (for example, the first identifier is Leftsplit), the first application is split on the right (for example, the first identifier is Rightsplit), and no split screen operation is performed (for example, the first identifier is Freeform).
[0105] Among them, "First App Upper Split Screen" and "First App Lower Split Screen" indicate that the first app is going to split the screen up and down. "First App Upper Split Screen" means that in the split-screen interface, the interface of the first app is above the interface of the second app; "First App Lower Split Screen" means that in the split-screen interface, the interface of the first app is below the interface of the second app. "First App Left Split Screen" and "First App Right Split Screen" indicate that the first app is going to split the screen left and right. "First App Left Split Screen" means that in the split-screen interface, the interface of the first app is to the left of the interface of the second app; "First App Right Split Screen" means that in the split-screen interface, the interface of the first app is to the right of the interface of the second app.
[0106] After the electronic device calculates the first identifier, if the first identifier indicates that the electronic device is to perform a split-screen operation (for example, the first identifier is Topsplit or Bottomsplit or Leftsplit or Rightsplit), the electronic device can determine the corresponding motion effect scheme based on the first identifier, thereby adjusting the range of the View frame in the display area accordingly. N View frames are pre-set in the display area of the electronic device, and these N View frames are on the same layer. For the sake of convenience, the embodiment of the present application is described as an example where N is 3.
[0107] For example, the display area of the electronic device 100 as shown in FIG2C above includes three View frames, namely the first View frame, the second View frame, and the third View frame. In these three View frames, each View frame has four edges: top, bottom, left, and right. By defining the distances between the four edges of top, bottom, left, and right and the edge of the screen, the position and size of each View frame can be determined. The position and size of a single View frame in the display area of the electronic device can be represented by using four-dimensional coordinates. For example, the four-dimensional coordinates can be (X, Y, Z, K). Among them, X can represent the distance between the left length of a single View frame and the left edge of the screen, Y can represent the distance between the right length of a single View frame and the left edge of the screen, Z can represent the distance between the upper length of a single View frame and the lower edge of the screen, and K can represent the distance between the lower length of a single View frame and the right edge of the screen.
[0108] The four-dimensional coordinates of different View frames corresponding to different first identifiers can be stored in advance in the electronic device, that is, different motion effect schemes corresponding to different first identifiers. For example, when the first identifier is Topsplit, the four-dimensional coordinates of the first View frame can be (X 11 , Y 11 , Z 11 , K 11 ), the four-dimensional coordinates of the second View frame can be (X 21 , Y 21 , Z 21 , K21 ), the four-dimensional coordinates of the third View frame can be (X 31 , Y 31 , Z 31 , K 31 ).
[0109] When the first identifier is Bottomsplit, the four-dimensional coordinates of the first View frame can be (X 12 , Y 12 , Z 12 , K 12 ), the four-dimensional coordinates of the second View frame can be (X 22 , Y 22 , Z 22 , K 22 ), the four-dimensional coordinates of the third View frame can be (X 32 , Y 32 , Z 32 , K 32 ).
[0110] When the first flag is Leftsplit, the four-dimensional coordinates of the first View frame can be (X 13 , Y 13 , Z 13 , K 13 ), the four-dimensional coordinates of the second View frame can be (X 23 , Y 23 , Z 23 , K 23 ), the four-dimensional coordinates of the third View frame can be (X 33 , Y 33 , Z 33 , K 33 ).
[0111] When the first flag is Rightsplit, the four-dimensional coordinates of the first View frame can be (X 14 , Y 14 , Z 14 , K 14 ), the four-dimensional coordinates of the second View frame can be (X 24 , Y 24 , Z 24 , K 24 ), the four-dimensional coordinates of the third View frame can be (X 34 , Y 34 , Z 34 , K 34 ). When the first identifier is Freeform, the four-dimensional coordinates of the View frame may not be stored.
[0112] After calculating the first identifier, the electronic device can select the four-dimensional coordinates of each View frame corresponding to the first identifier, and adjust the positions of the top, bottom, left, and right sides of each View frame according to the obtained four-dimensional coordinates of each View frame, thereby obtaining a first View frame for displaying the first application animation content and a second View frame for displaying the second application animation content.
[0113] Assuming the first identifier is Topsplit, the four-dimensional coordinates of the first View frame are (0.1*Left, 0.9*Left, Height, 0.5*Height), the four-dimensional coordinates of the second View frame are (0.1*Left, 0.9*Left, 0.4*Height, 0), and the four-dimensional coordinates of the third View frame are (0.9*Left, Left, Height, 0). If Left represents the length of the bottom edge of the display screen, and Height represents the length of the left edge of the display area, then an example image after the electronic device adjusts the three View frames based on these three four-dimensional coordinates can be shown as shown in Figure 5A.
[0114] In some embodiments, the definitions of the upper, lower, left, and right edges of the display screen are related to the display mode of the electronic device. The display mode of the electronic device can be divided into a horizontal display mode and a vertical display mode. As shown in Figure 5B, an example diagram of an electronic device in horizontal display mode is shown. Among them, L1, L2, L3, and L4 are the left edge, right edge, top edge, and bottom edge of the electronic device display screen, respectively. The length of L3 and L4 is Left, and the length of L1 and L2 is Height. As shown in Figure 5C, an example diagram of an electronic device in vertical mode, in which case L4, L3, L1, and L2 are the left edge, right edge, top edge, and bottom edge of the electronic device, respectively. The length of L1 and L2 is Left, and the length of L3 and L4 is Height.
[0115] S406: If the first application and / or the second application is an application that only supports top-bottom split screen or left-right split screen, the electronic device determines whether the first control is in a target hot zone based on the first position information.
[0116] Specifically, in the above S402, if the application identifier of the first application and the application identifier of the second application are not both in the first whitelist, then the first application and / or the second application are applications that only support top-bottom split-screen or left-right split-screen. If the first application and / or the second application are applications that support top-bottom split-screen or left-right split-screen. Then, the electronic device uses the method of regular hot zones to determine whether to perform a split-screen operation of the first application and the second application, that is: the electronic device determines whether to perform a split-screen operation by determining whether the first control is within the range of the hot zone, and on the premise of performing a split-screen operation, determines which type of split-screen operation (for example, top split-screen operation of the first application, bottom split-screen operation of the first application, left split-screen operation of the first application, right split-screen operation of the first application, etc.).
[0117] The electronic device can pre-store the position information (four-dimensional coordinates) of each hot zone in the display area. The four-dimensional coordinates of the hot zone have the same meaning as the four-dimensional coordinates of the View box mentioned above. The electronic device can determine the range of the preset hot zone in the display area of the electronic device by reading the four-dimensional coordinates of the hot zone. After obtaining the first position information, the electronic device can determine whether the first control is in the hot zone based on the first position information and the range of the hot zone in the display area, that is: when the two-dimensional coordinates of the first control are within the hot zone range, it is determined that the first control is in the hot zone, and the hot zone where the first control is located is the target hot zone; otherwise, the first control is not in the target hot zone. When the electronic device determines that the first control is in the hot zone, the electronic device triggers a split-screen operation.
[0118] S407: If the first control is in the target hot zone, the electronic device adjusts the range of the View box in the display area based on the hot zone identifier of the target hot zone to obtain a first View box and a second View box, where the first View box corresponds to the first application and the second View box corresponds to the second application.
[0119] Specifically, if the first control is within the target hot zone, the electronic device obtains the identification information of the target hot zone, and based on the obtained identification information, the electronic device can determine what type of split-screen operation should be performed. For example, there are only left and right hot zones in the display area. If the right hot zone is the target hot zone, the electronic device determines to perform a split-screen operation, and performs a right split-screen operation of the first application with the interface of the first application on the right. Then, the electronic device can select the four-dimensional coordinates of each corresponding View frame based on the identification information of the target hot zone. According to the four-dimensional coordinates of each View frame, the positions of the top, bottom, left, and right sides of each View frame in the display area are adjusted to obtain a first View frame displaying the motion effect content of the first application and a second View frame displaying the motion effect content of the second application.
[0120] S408: The electronic device displays a second interface, the second interface includes a first motion effect interface and a second motion effect interface, the first motion effect interface displays the motion effect content of the first application, the second motion effect interface displays the motion effect content of the second application, the first View frame includes the first motion effect interface, and the second View frame includes the second motion effect interface.
[0121] Specifically, after obtaining the first View frame and the second View frame, the electronic device displays the second interface. The second interface includes a first animation interface and a second animation interface. The first animation interface is used to display the animation content of the first application, and the second animation interface is used to display the animation content of the second application. The first View frame includes the first animation interface, and the second View frame includes the second animation interface.
[0122] For example, the first dynamic effect interface can be the content displayed in the dynamic effect box 112 in Figure 1C, or the shadow animation of the first application. The second dynamic effect interface can be the content displayed in the dynamic effect box 111 in Figure 1C, or a screenshot of the second application.
[0123] S409: In response to the third operation on the first control, the electronic device displays a third interface, and the third interface includes a first split-screen interface and a second split-screen interface. The first split-screen interface is the interface of the first application, and the second split-screen interface is the interface of the second application.
[0124] Exemplarily, the third operation may be the hand-raising operation on the drag bar 1011 in FIG. 1C .
[0125] The third interface includes a first split-screen interface and a second split-screen interface. The first split-screen interface is the interface of the first application, and the second split-screen interface is the interface of the second application.
[0126] Exemplarily, the third interface may be the user interface 12 in FIG. 1D , the first split-screen interface may be the interface 122 in FIG. 1D , and the second split-screen interface may be the interface 121 in FIG. 1D .
[0127] Optionally, before displaying the third interface, the electronic device may further display a transition animation of the first application in the first View frame, and display a second transition animation of the second application in the second View frame.
[0128] In the embodiment of Figure 4 above, after the electronic device detects the user's first operation on the floating window drag bar (for example, a long press operation), in response to the first operation, the electronic device will determine whether the application corresponding to the current user interface and the application corresponding to the floating window are both applications that support top-bottom split-screen and left-right split-screen. If yes, the electronic device uses an irregular hot zone method to perform split-screen operations. If not, the electronic device uses a regular hot zone method to perform split-screen operations. Regardless of whether the electronic device uses a regular hot zone method or an irregular hot zone method to perform split-screen operations, the electronic device displays the View frame that displays the dynamic content of the two split-screen applications by adjusting the range of multiple View frames on the same layer on the display area, and displays the dynamic content of the split-screen application on the corresponding View frame. In this way, when using the irregular hot zone method to perform split-screen operations, the addition of new layers due to the addition of new View frames will not cause complex underlying code logic problems, making it difficult for technical personnel to modify and maintain them later.
[0129] The embodiment in FIG4 above describes the process of a screen display method provided in an embodiment of the present application. Below, in conjunction with FIG6 , the interaction process of each module in the electronic device in the embodiment of FIG4 is described. The electronic device includes a first application, a second application, and a multi-window management module (HwMultiWindowSwitchManager). The first application and the second application are located in the application layer of the Android system architecture, and the multi-window management module is located in the application framework layer of the Android system architecture.
[0130] Among them, the first application includes a floating window moving module (Bar moving module), and the multi-window management module includes a hot zone setting module (AddHotArea), a split-screen animation management module (SetDragAnimationListener), an animation adding module (HwMultiWinPushAcceptView), and an animation frame adjustment module (HwMultiWinPushPendingDropView).
[0131] Please refer to FIG6 , which is a module interaction diagram of a screen display method provided by an embodiment of the present application. The interaction process of each module is as follows:
[0132] S601: The floating window moving module sends a first notification message to the hot zone setting module in response to a first operation on a first control in the floating window.
[0133] Exemplarily, the first operation may be a long press operation on the drag bar 1011 in the embodiment of FIG. 1A .
[0134] After detecting the first operation on the first control, the floating window moving module of the first application responds to the first operation, obtains the first application identifier and the second application identifier, and sends a first notification message to the hot zone setting module. The first notification message is used to instruct the hot zone setting module to determine the method of triggering the electronic device to perform a split-screen operation, that is, whether to trigger the electronic device to perform a split-screen operation based on a regular hot zone method or to trigger the electronic device to perform a split-screen operation based on an irregular hot zone method. The first notification message may include the first application identifier and the second application identifier, the first application identifier being the application identifier of the first application, and the second application identifier being the application identifier of the second application.
[0135] S602: The hot zone setting module obtains a first application identifier and a second application identifier based on the first notification message, where the first application identifier corresponds to the first application and the second application identifier corresponds to the second application.
[0136] S603: The hot zone setting module determines whether the first application identifier and the second application identifier are both application identifiers in the first whitelist.
[0137] Specifically, after obtaining the first application identifier and the second application identifier, the hot zone setting module obtains the first whitelist and determines whether the first application identifier and the second application identifier are both application identifiers in the first whitelist. For details about the first whitelist, refer to the description of the first whitelist in S402 above, and will not be repeated here in this embodiment of the present application.
[0138] In some embodiments, the hot zone setting module may call a related interface based on the getPackageName function to obtain the first whitelist.
[0139] S604: If the first application identifier and the second application identifier are both application identifiers in the first whitelist, the hot zone setting module sends a first hot zone message to the split-screen animation management module.
[0140] Specifically, if the first application identifier and the second application identifier are both application identifiers in the first whitelist, the hot zone setting module determines that the first application and the second application are both applications that support top-bottom split-screen and left-right split-screen.
[0141] Therefore, the hot zone setting module sends a first hot zone message to the split-screen animation management module. The first hot zone message is used to indicate that the first application and the second application are both applications that support top-bottom split-screen and left-right split-screen, that is, the split-screen animation module can trigger the split-screen operation of the first application and the second application based on irregular hot zones.
[0142] In one possible implementation, upon receiving the first hot zone message, the split-screen animation management module may activate a first monitor (onDragStarted / onDragExited) and a second monitor (onDragEntered). The first monitor is used to monitor the current position of the first control and calculate a first identifier based on the first position information; the second monitor is used to determine which split-screen animation to execute.
[0143] S605: The floating window moving module responds to the second operation on the first control and sends a second notification message to the split-screen animation management module.
[0144] Illustratively, the second operation may be an input operation of the user dragging the drag bar 1011 to the right in the embodiment of FIG. 1B .
[0145] Specifically, after responding to the second operation on the first control, the floating window moving module sends a second notification message to the split screen animation management module. The second notification message is used to instruct the split screen animation management module to call the first monitor to calculate the first identifier according to the position of the first control (first position information).
[0146] S606: The split-screen animation management module obtains the first position information of the first control in real time.
[0147] Specifically, after receiving the second notification message in real time, the split-screen animation management module can detect the first position information of the first control in the display area in real time through the first monitor.
[0148] S607: The split-screen animation management module obtains a first identifier according to the first position information.
[0149] Specifically, since the split-screen animation management module previously receives the first hot zone message sent by the hot zone setting module, the split-screen animation module determines whether to perform a split-screen operation and what type of split-screen operation to perform (first application left split screen, first application right split screen, first application top split screen, or first application bottom split screen) by means of irregular hot zones.
[0150] The split-screen animation management module may call a logic function H for calculating a first identifier through the first monitor. Then, the first monitor is called to output the first identifier based on the first position information and H. After calculating the first identifier, the first monitor sends the first identifier to the split-screen animation management module, so that the split-screen animation management module obtains the first identifier.
[0151] S608: When the first identifier indicates that the electronic device performs a split-screen operation, the split-screen motion effect management module sends a third notification message to the motion effect frame adjustment module.
[0152] Specifically, when the first identifier instructs the electronic device to perform a split-screen operation, the split-screen animation management module sends a third notification message to the animation frame adjustment module, and the third notification message is used to instruct the animation frame adjustment module to adjust the range of the View frame in the display area. The third notification message may include the first identifier.
[0153] S609: The animation frame adjustment module adjusts the range of the View frame in the display area according to the third notification message to obtain a first View frame and a second View frame, where the first View frame corresponds to the first application and the second View frame corresponds to the second application.
[0154] Specifically, the animation frame adjustment module obtains the four-dimensional coordinates of each View frame corresponding to the first identifier in the third notification message. Based on the obtained four-dimensional coordinates of each View frame, the module adjusts the position of the top, bottom, left, and right sides of each View frame within the display area, thereby obtaining a first View frame displaying the animation content of the first application and a second View frame displaying the animation content of the second application.
[0155] The animation frame adjustment module adjusts the range of the View frame in the display area according to the third notification message. For the relevant description of obtaining the first View frame and the second View frame, please refer to the relevant description of S405 in the embodiment of Figure 4 above, which will not be repeated here.
[0156] S610: The motion effect frame adjustment module sends a fourth notification message to the motion effect adding module.
[0157] Specifically, after the animation frame adjustment module adjusts the range of the View frame in the display area according to the third notification message to obtain the first View frame and the second View frame, the animation frame adjustment module can send a fourth notification message to the animation effect adding module. The fourth notification message is used to instruct the animation effect adding module to add and display animation content corresponding to the first application and the second application in the first View frame and the second View frame.
[0158] The fourth notification message may include the first identifier, and may also include a mapping relationship between the identifier information of the first View frame and the first application, and a mapping relationship between the identifier information of the second View frame and the second application.
[0159] S611: The animation adding module obtains first animation information and second animation information according to the fourth notification message, where the first animation information is related to the first application, and the second animation information is related to the second application.
[0160] Specifically, the animation adding module can determine the split-screen animation content of the first application and the second application based on the first identifier in the fourth notification message, the mapping relationship between the identification information of the first View frame and the first application, and the mapping relationship between the identification information of the second View frame and the second application, that is, what kind of content to display in the first View frame and the second View frame.
[0161] For example, in FIG1C above, the split-screen animation content of the browser application (second application) is the animation box 111 and the browser application icon 1111, and the split-screen animation content of the calculator application (first application) is the animation box 112 and the gray background within the box.
[0162] The animation adding module can call the relevant interface based on the first identifier to obtain the first animation information (for example, the gray background image of the animation box 112 in Figure 1C above) and the second animation information (for example, the icon 1111 of the browser application in Figure 1C above).
[0163] S612: The motion effect adding module displays the first motion effect content in the first View frame and displays the second motion effect content in the second View frame.
[0164] Specifically, the first motion effect content corresponds to the first motion effect information, and the second motion effect content corresponds to the second motion effect information.
[0165] After obtaining the first animation information and the second animation information, the animation adding module can display the corresponding elements in the first animation information (for example, the gray background image in the animation box 112 in Figure 1C above) and the elements in the second animation information (for example, the icon 1111 of the browser application in Figure 1C above) in the first View and the second View frames respectively according to the mapping relationship between the identification information of the first View frame and the first application and the mapping relationship between the identification information of the second View frame and the second application in the fourth notification message. The content displayed in the View frame is the content displayed in the first animation interface and the second animation interface in S408 of Figure 4 above.
[0166] S613: The floating window moving module responds to the third operation on the first control and sends a fifth notification message to the motion effect adding module.
[0167] Exemplarily, the third operation may be the hand-raising operation on the drag bar 1011 in FIG. 1C .
[0168] The fifth notification message is used to indicate that the electronic device is about to display the third interface and end the split-screen animation display.
[0169] S614: The animation adding module sends a first instruction message to the first application and sends a second instruction message to the second application.
[0170] Specifically, after receiving the fifth notification message, the animation adding module may send a first indication message to the first application and a second indication message to the second application. The first indication message and the second indication message may include the first identifier.
[0171] Exemplarily, the animation adding module may send the first indication message and the second indication message to the first application and the second application respectively through the Activity task management service module (HwInnerActivityTaskManagerService) located in the Android system application layer.
[0172] The first instruction message is used to instruct the Activity Task module (Activity Task) of the first application to close the floating window, so that the floating window no longer appears on the display screen of the electronic device. At the same time, the first instruction message is also used to instruct the Activity Task module (Activity Task) of the first application to display the split-screen interface (first split-screen interface) of the first application on the display screen.
[0173] The position of the split-screen interface of the first application can be determined based on the first identifier. For example, the first identifier represents the upper split-screen of the first application. Then, the first split-screen interface is above the second screen interface (for example, the first split-screen interface 141 shown in FIG. 1G above).
[0174] The second instruction message is used to instruct the Activity task module (Activity Task) of the second application to display the split-screen interface (second split-screen interface) of the second application on the display screen.
[0175] The position of the split-screen interface of the second application can be determined based on the first identifier. For example, if the first identifier represents the upper split-screen of the first application, then the second split-screen interface is below the first screen interface (for example, the second split-screen interface 142 shown in FIG. 1G above).
[0176] Optionally, before the motion effect adding module sends a first indication message to the first application and sends a second indication message to the second application, a transition motion effect content with a duration of t may be played in the first View frame and the second View frame based on the first identifier.
[0177] S615: The first application displays a first split-screen interface on the third interface, and the second application displays a second split-screen interface on the third interface.
[0178] Optionally, before the first application displays the first split-screen interface on the third interface, the first application closes the floating window through the Activity task module.
[0179] Please refer to Figure 7, which is a module interaction diagram of another screen display method provided by an embodiment of the present application. In the embodiment of Figure 4 above, the interaction process of each module is as follows:
[0180] S701: The floating window moving module sends a first notification message to the hot zone setting module in response to a first operation on a first control in the floating window.
[0181] S702: The hot zone setting module obtains a first application identifier and a second application identifier based on the first notification message, where the first application identifier corresponds to the first application and the second application identifier corresponds to the second application.
[0182] S703: The hot zone setting module determines whether the first application identifier and the second application identifier are both application identifiers in the first whitelist.
[0183] S704: If the first application identifier and the second application identifier are not both application identifiers in the first whitelist, the hot zone setting module sends a second hot zone message to the split-screen animation management module.
[0184] Specifically, if the first application identifier and the second application identifier are not both application identifiers in the first whitelist, the hot zone setting module determines that the first application and / or the second application only supports top-bottom split-screen or left-right split-screen applications.
[0185] Therefore, the hot zone setting module sends a second hot zone message to the split-screen animation management module. The second hot zone message is used to indicate that the first application and the second application are not both applications that support top-bottom split-screen and left-right split-screen, that is, to prompt the split-screen animation module to trigger the split-screen operation of the first application and the second application based on the regular hot zone method.
[0186] S705: The floating window moving module responds to the second operation on the first control and sends a second notification message to the split-screen animation management module.
[0187] S706: The split-screen animation management module obtains the first position information of the first control in real time.
[0188] Specifically, after receiving the second hot zone message, the split-screen animation management module can activate the first monitor (onDragStarted / onDragExited) and the second monitor (onDragEntered). The first monitor is used to monitor the current position of the first control and determine whether the first control is within the hot zone; the second monitor is used to determine which split-screen animation to execute.
[0189] S707: The split-screen animation management module determines whether the first control is within the target hot zone based on the first position information.
[0190] Specifically, after obtaining the first position information, the split-screen animation module determines whether the floating window's drag bar is within the hot zone based on the first position information (x, y) obtained by the first monitor and the four-dimensional coordinates of the hot zone, that is, whether (x, y) is within the range defined by the four-dimensional coordinates of the hot zone. If it is within the hot zone, the hot zone where the floating window's drag bar is located is the target hot zone, and the split-screen animation module also obtains the identification information of the target hot zone.
[0191] For the relevant description that the split-screen animation management module determines whether the first control is in the target hot zone based on the first position information, please refer to S406 of Figure 4 above, where the electronic device determines whether the first control is in the target hot zone based on the first position information.
[0192] S708: If the first control is in the target hot zone, the split-screen motion effect management module sends a third notification message to the motion effect frame adjustment module.
[0193] Specifically, the third notification message includes identification information of the target hot zone, which can be used to indicate the type of split-screen operation to be performed, for example, an upper split-screen operation, a lower split-screen operation, a left split-screen operation, a right split-screen operation, etc. of the first application.
[0194] S709: The animation frame adjustment module adjusts the range of the View frame in the display area of the electronic device based on the third notification message to obtain a first View frame and a second View frame, where the first View frame corresponds to a first application and the second View frame corresponds to a second application.
[0195] Specifically, the motion effect frame adjustment module obtains the four-dimensional coordinates of each View frame corresponding to the application identifier based on the identification information of the target hot zone in the third notification message, and adjusts the positions of the upper, lower, left, and right sides of each View frame in the display area based on the obtained four-dimensional coordinates of each View frame, thereby obtaining a first View frame displaying the motion effect content of the first application and a second View frame displaying the motion effect content of the second application.
[0196] S710: The motion effect frame adjustment module sends a fourth notification message to the motion effect adding module.
[0197] S711: The animation adding module obtains first animation information and second animation information according to the fourth notification message, where the first animation information is related to the first application, and the second animation information is related to the second application.
[0198] S712: The motion effect adding module displays the first motion effect content in the first View frame and displays the second motion effect content in the second View frame.
[0199] S713: The floating window moving module responds to the third operation on the first control and sends a fifth notification message to the motion effect adding module.
[0200] S714: The animation adding module sends a first indication message to the first application and sends a second indication message to the second application.
[0201] S715: The first application displays a first split-screen interface on the third interface, and the second application displays a second split-screen interface on the third interface.
[0202] The relevant descriptions of S701 to S703 and S710 to S715 may refer to the relevant descriptions of S601 to S603 and S610 to S615 mentioned above, and will not be repeated here.
[0203] The following describes the structure of the electronic device 100. Please refer to Figure 8, which is a schematic diagram of the hardware structure of the electronic device 100 provided in an embodiment of the present application.
[0204] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 125, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 148, a battery 149, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, a proximity sensor 180L, a bone conduction sensor 180M, etc.
[0205] It should be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than those shown in FIG8, or may combine or separate certain components, or arrange the components differently. The components shown in FIG8 may be implemented in hardware, software, or a combination of software and hardware.
[0206] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.
[0207] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.
[0208] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.
[0209] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.
[0210] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as Wi-Fi networks), Bluetooth (BT), BLE broadcast, global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc. applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.
[0211] Electronic device 100 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.
[0212] Display screen 194 is used to display images, videos, and the like. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, or a quantum dot light-emitting diode (QLED). In some embodiments, electronic device 100 may include one or N display screens 194, where N is a positive integer greater than one.
[0213] The electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.
[0214] The ISP processes data fed back by camera 193. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then passed to the ISP for processing and converted into a visible image. The ISP can also perform algorithmic optimization on image noise and brightness. It can also optimize parameters such as exposure and color temperature of the captured scene. In some embodiments, the ISP can be located within camera 193.
[0215] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.
[0216] The NPU is a neural network (NN) computing processor. Drawing on the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it rapidly processes input information and can continuously self-learn. The NPU can enable intelligent cognitive applications in electronic device 100, such as image recognition, face recognition, speech recognition, and text comprehension.
[0217] The electronic device 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.
[0218] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be provided in the processor 110, or some functional modules of the audio module 170 can be provided in the processor 110.
[0219] The speaker 170A, also called a "speaker", is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or listen to hands-free calls through the speaker 170A.
[0220] The receiver 170B, also called a "handset", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or a voice message, the user can place the receiver 170B close to the ear to hear the voice.
[0221] Microphone 170C, also known as "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to the microphone 170C to input the sound signal into the microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to realize sound signal collection, noise reduction, and identification of sound sources, and realize directional recording function, etc.
[0222] The pressure sensor 180A is used to sense the pressure signal and convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be disposed on the display screen 194 .
[0223] The touch sensor 180K is also called a "touch panel." The touch sensor 180K can be disposed on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen." The touch sensor 180K is used to detect touch operations applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operations to the application processor to determine the type of touch event. Visual output related to the touch operations can be provided via the display screen 194. In other embodiments, the touch sensor 180K can also be disposed on the surface of the electronic device 100, in a location different from that of the display screen 194.
[0224] Figure 9 is a software structure diagram of the electronic device 100 provided in an embodiment of the present application when performing split-screen operation based on irregular hot zones. The layered architecture divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, namely, the application layer, the application framework layer, the Android runtime (Android runtime) and the system library, and the kernel layer, from top to bottom.
[0225] The application layer may include a series of application packages. As shown in Figure 9, the application package may include the first application, the second application, and the task management service module in the embodiments of Figures 6 and 7 above. Among them, the first application and the second application both include an Activity task module, and the first application also includes a floating window moving module. Among them:
[0226] The floating window moving module is configured to, after responding to a first operation on the first control, send a first notification message to the hot zone setting module to instruct the hot zone setting module to determine a method for triggering the electronic device to perform a split-screen operation;
[0227] The floating window and moving module is further configured to, after responding to the second operation on the first control, send a second notification message to the split-screen motion effect management module in real time to instruct the split-screen motion effect management module to calculate the first identifier based on the position of the first control;
[0228] The floating window moving module is further configured to, in response to a third operation on the first control, send a fifth notification message to the motion effect adding module to notify the motion effect adding module that the electronic device is to display the third interface and end the split-screen motion effect display;
[0229] The Activity task module in the first application is used to close the floating window and display the first split-screen interface in the third interface after receiving the first indication message;
[0230] The Activity task module in the second application is used to display the second split-screen interface in the third interface after receiving the second indication message;
[0231] The task management service module is used to receive the first indication message and the second indication message sent by the motion effect adding module, and send the first indication message to the Activity task module in the first application, and send the second indication message to the Activity task module in the second application.
[0232] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions. As shown in Figure 9, the application framework layer can include the multi-window management module in the embodiments of Figures 6 and 7 above.
[0233] The window management module includes a hot zone setting module, a split-screen motion effect management module, a motion effect frame adjustment module, and a motion effect adding module.
[0234] The hot zone setting module is configured to, upon receiving the first notification message sent by the floating window movement module, determine whether the application identifiers of the first and second applications are in the first whitelist. If so, it sends a first hot zone message to the split-screen animation management module to instruct the split-screen animation module to trigger the split-screen operation of the first and second applications based on the irregular hot zone.
[0235] The split-screen animation management module is used to receive the second notification message, calculate the first identifier, and send the first identifier to the animation frame adjustment module.
[0236] The motion effect frame adjustment module is used to adjust the range of the View frame in the display area according to the first identifier to obtain a first View frame and a second View frame.
[0237] The motion effect frame adjustment module is further used to send a fourth notification message to the motion effect adding module to instruct the motion effect adding module to add and display motion effect content corresponding to the first application and the second application in the first View frame and the second View frame.
[0238] The motion effect adding module is used to add and display motion effect content corresponding to the first application and the second application in the first View frame and the second View frame after receiving the fourth notification message.
[0239] The animation adding module is further used to send a first indication message and a second indication message to the task management service module after receiving the fifth notification message.
[0240] Android Runtime includes core libraries and a virtual machine. Android runtime is responsible for scheduling and management of the Android system.
[0241] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.
[0242] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.
[0243] The system library can include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.
[0244] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.
[0245] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
[0246] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0247] A 2D graphics engine is a drawing engine for 2D drawings.
[0248] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.
[0249] FIG10 is a software structure block diagram of the electronic device 100 provided in an embodiment of the present application when performing split-screen operation in a regular hot zone manner.
[0250] Among them, the split-screen animation management module is used to receive the second notification message and determine whether the first control is in the target hot zone. If it is in the target hot zone, the identification information of the target hot zone is sent to the animation frame adjustment module.
[0251] The dynamic effect frame adjustment module is used to adjust the range of the View frame in the display area according to the identification information of the target information to obtain the first View frame and the second View frame.
[0252] In FIG10 , the functions of other applications and functional modules can be found in the embodiment of FIG7 and the corresponding descriptions in FIG9 , which will not be repeated here.
[0253] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware, or any combination thereof. When implemented using software, all or part of the embodiments may be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described herein are generated. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated therein. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a magnetic tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive).
[0254] The steps in the method of the embodiment of the present application can be adjusted in order, combined and deleted according to actual needs.
[0255] The modules in the device of the embodiment of the present application can be merged, divided and deleted according to actual needs.
[0256] Those skilled in the art will appreciate that all or part of the processes in the above-described method embodiments can be implemented by a computer program instructing the relevant hardware. The program can be stored in a computer-readable storage medium. When executed, the program can include the processes in the above-described method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.
[0257] In short, the above description is only an embodiment of the technical solution of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent replacements, improvements, etc. made based on the disclosure of the present invention should be included in the scope of protection of the present invention.
Claims
1. A screen display method, It is characterized in that Applied to an electronic device having a display screen, the method comprises: Displaying a first interface, displaying a floating window on the first interface, the floating window including a first control, the floating window corresponding to a first application, and the first interface corresponding to a second application; In response to a first operation on the first control, setting the floating window to a first mode, where the first mode is a working mode in which the floating window can be moved on the display screen; If both the first application and the second application are applications that support top-bottom split screen and left-right split screen, one or more hot zones are respectively determined in the top, bottom, left, and right directions of the display area of the display screen; If the first application and the second application are not both applications that support top-bottom split screen and left-right split screen, one or more hot areas with regular shapes are respectively determined in the upper and lower directions or the left and right directions of the display area of the display screen; In response to a second operation on the first control, moving the floating window in the display screen; When the first control is moved into any hot zone, a second interface is displayed, wherein the second interface includes a first View frame and a second View frame, wherein the first View frame displays the dynamic content of the first application, and the second View frame displays the dynamic content of the second application, and the first View frame and the second View frame are on the same layer; During the process of displaying the second interface, in response to a third operation on the first control, a third interface is displayed, the third interface including a first split-screen interface and a second split-screen interface, the first split-screen interface corresponds to the first application, and the second split-screen interface corresponds to the second application.
2. The method according to claim 1, It is characterized in that The third interface also includes a split-screen switching control, and after the third interface is displayed, the following further includes: In response to a fourth operation on the split-screen switching control, if the third interface is a top-bottom split-screen interface, switching the third interface to a left-right split-screen interface; If the third interface is a left-right split-screen interface, switch the third interface to an upper-lower split-screen interface.
3. The method according to claim 1 or 2, It is characterized in that Before responding to the second operation on the second control, the method further includes: Obtain a first application identifier and a second application identifier, wherein the first application identifier is identifier information of the first application, and the second application identifier is identifier information of the second application; Determine whether the first application identifier and the second application identifier are both identifier information in a first whitelist; If yes, both the first application and the second application are applications that support top-bottom split screen and left-right split screen; If not, the first application and the second application are not both applications that support top-bottom split-screen and left-right split-screen.
4. The method according to any one of claims 1 to 3, It is characterized in that The display area of the display screen includes N rectangular View frames, each View frame includes four sides: top, bottom, left, and right. The position and range of each View frame in the display area are represented by four-dimensional coordinates (Xi, Yi, Zi, Ki); Among them, the Xi represents the distance between the left side of the i-th View frame and the first edge, the Yi represents the distance between the right side of the i-th View frame and the first edge, the Zi represents the distance between the upper side of the i-th View frame and the second edge, and the Ki represents the distance between the lower side of the i-th View frame and the second edge; the first edge is the edge of the display screen parallel to the left side and the right side, the second edge is the edge of the display screen parallel to the upper side and the lower side, and N is an integer greater than 1.
5. The method according to claim 4, It is characterized in that In the case where both the first application and the second application are applications that support top-bottom split screen and left-right split screen, displaying the second interface specifically includes: Acquire first position information of the first control; Calculate a first identifier based on the first location information; Obtaining the four-dimensional coordinates of the corresponding N View frames according to the first identifier; Based on the N four-dimensional coordinates, the range of each View frame in the display screen is correspondingly adjusted to obtain a first View frame and a second View frame; The animated content of the first application is displayed in the first View frame, and the animated content of the second application is displayed in the second View frame.
6. The method according to claim 4, It is characterized in that In the case that both the first application and the second application are not applications that support top-bottom split screen and left-right split screen, displaying the second interface specifically includes: Acquire first position information of the first control; Acquire the range of the hot zone in the display screen according to the four-dimensional coordinates of the hot zone; When it is determined based on the first position information that the first control is in any hot zone, obtaining identification information of the hot zone where the first control is located; Acquire the four-dimensional coordinates of the corresponding N View frames based on the identification information; Based on the N four-dimensional coordinates, the range of each View frame in the display screen is correspondingly adjusted to obtain a first View frame and a second View frame; The animated content of the first application is displayed in the first View frame, and the animated content of the second application is displayed in the second View frame.
7. The method according to claim 1, It is characterized in that The electronic device includes a split-screen animation management module, an animation frame adjustment module, and an animation adding module. If the first application and the second application are both applications that support top-bottom split-screen and left-right split-screen, displaying the second interface includes: The split-screen animation management module calculates a first identifier according to the first position information of the first control; The split-screen animation management module sends a third notification message to the animation frame adjustment module, where the third notification message includes the first identifier; The animation frame adjustment module obtains the four-dimensional coordinates of the corresponding N View frames according to the first identifier; The motion effect adjustment module adjusts the ranges of the N View frames corresponding to the N View frames in the display screen according to the four-dimensional coordinates of the N View frames to obtain the first View frame and the second View frame; The motion effect adjustment module sends a fourth notification message to the motion effect adding module, where the fourth notification message includes the first identifier, a first mapping relationship between the first View frame and the first application, and a second mapping relationship between the second View frame and the second application; The motion effect adding module obtains the motion effect content of the first application and the motion effect content of the second application according to the first identifier; The animation adding module displays the animation content of the first application on the first View frame according to the first mapping relationship; The animation adding module displays the animation content of the second application on the second View frame according to the second mapping relationship.
8. The method according to claim 1, It is characterized in that The electronic device includes a split-screen animation management module, an animation frame adjustment module, and an animation adding module. If the first application and the second application are not both applications that support top-bottom split-screen and left-right split-screen, displaying the second interface includes: The split-screen management module sends a third notification message to the motion effect frame adjustment module when it is determined that the first control is within the hot zone based on the first position information of the first control, wherein the third notification message includes identification information of the hot zone where the first control is located; The animation frame adjustment module obtains the four-dimensional coordinates of the corresponding N View frames according to the identification information; The motion effect adjustment module adjusts the ranges of the N View frames corresponding to the N View frames in the display screen according to the four-dimensional coordinates of the N View frames to obtain the first View frame and the second View frame; The motion effect adjustment module sends a fourth notification message to the motion effect adding module, where the fourth notification message includes the identification information, a first mapping relationship between the first View frame and the first application, and a second mapping relationship between the second View frame and the second application; The motion effect adding module obtains the motion effect content of the first application and the motion effect content of the second application according to the identification information; The animation adding module displays the animation content of the first application on the first View frame according to the first mapping relationship; The animation adding module displays the animation content of the second application on the second View frame according to the second mapping relationship.
9. The method according to claim 7 or 8, It is characterized in that The electronic device further includes a floating window moving module and a hot zone setting module of the first application, and before displaying the second interface, further includes: The floating window moving module sends a first notification message to the hot zone setting module in response to the first operation, where the first notification message includes the first application identifier and the second application identifier, where the first application identifier is identifier information of the first application, and the second application identifier is identifier information of the second application; The hot zone setting module determines whether the first application identifier and the second application identifier are both application identifiers in a first whitelist; If yes, the hot zone setting module sends first hot zone information to the split-screen animation management module, where the first hot zone information is used to indicate that both the first application and the second application are applications that support top-bottom split-screen and left-right split-screen; If not, the hot zone setting module sends second hot zone information to the split-screen animation management module, and the second hot zone information is used to indicate that the first application and the second application are not both applications that support top-bottom split-screen and left-right split-screen.
10. The method according to claim 9, It is characterized in that After the hot zone setting module sends the first hot zone information to the split-screen animation management module or after the hot zone setting module sends the second hot zone information to the split-screen animation management module, the method further includes: In response to the second operation, the floating window moving module sends a second notification message to the split-screen animation management module, where the second notification message is used to prompt the split-screen animation management module to obtain the first position information of the first control; The split-screen animation management module obtains the first position information of the first control in real time.
11. The method according to claim 7, It is characterized in that The electronic device further includes a floating window moving module in the first hot zone, and after displaying the second interface, further includes: The floating window moving module responds to the third operation and sends a fifth notification message to the motion effect adding module; The animation adding module sends a first indication message to the first application, where the first indication message includes the first identifier; The animation adding module sends a second indication message to the second application, where the second indication message includes the first identifier; The first application displays a first split-screen interface on the third interface based on the first identifier; The second application displays a second split-screen interface on the third interface based on the first identifier.
12. The method according to claim 8, It is characterized in that The electronic device further includes a floating window moving module in the first hot zone, and after displaying the second interface, further includes: The floating window moving module responds to the third operation and sends a fifth notification message to the motion effect adding module; The animation adding module sends a first indication message to the first application, where the first indication message includes the identification information; The animation adding module sends a second indication message to the second application, where the second indication message includes the identification information; The first application displays a first split-screen interface on the third interface based on the identification information; The second application displays a second split-screen interface on the third interface based on the identification information.
13. An electronic device, It is characterized in that include: Memory, processor and touch screen; wherein: The touch screen is used to display content; The memory is used to store a computer program, wherein the computer program includes program instructions; The processor is used to call the program instructions so that the electronic device executes the method according to any one of claims 1-12.
14. A computer-readable storage medium, It is characterized in that The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method according to any one of claims 1 to 13 is implemented.