Split-screen display method and electronic equipment
By receiving the user triggering the split screen display operation in an electronic device and displaying the interface of multiple target applications based on the target split screen layout, the problem that applications that do not adapt to the split screen layout cannot be displayed on the split screen is solved, and split screen support for all applications is achieved, improving user experience and device compatibility.
Patent Information
- Application Number
- CN202311435903.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-10-30
- Publication Date
- 2025-05-02
AI Technical Summary
Existing electronic devices can only support applications that have been adapted to split-screen layout to run normally in split-screen mode. For non-adapted applications, they cannot support split-screen display, which reduces the user experience.
By receiving the user triggering the split-screen display operation, the electronic device split-screen display of multiple target applications on the display screen according to the target split-screen layout, including applications that are not adapted to the split-screen layout, and zoom the predefined application interface through the determined scaling ratio and then display it on the split-screen.
It realizes that all applications support split-screen display without the need for application developers to adapt in advance, improving the compatibility and user experience of electronic devices.
Smart Images

Figure CN119916992A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of terminal technology, and in particular to a split-screen display method and electronic device. Background Art
[0002] Currently, combined with Figure 1 As shown, traditional Internet Protocol TV (IPTV) / over the top (OTT) set-top boxes based on the public Internet generally support watching videos with a single application (such as Figure 1 or watch live events on multiple channels in a single application (such as Figure 1 If the user wants to open other applications, he must exit the current application first, and the interactive operation is troublesome. With the advancement of technology and the popularization of smart terminal devices, people are no longer satisfied with controlling only a single application at the same time, so the demand for controlling multiple applications at the same time is becoming increasingly obvious. Therefore, tablets / folding screen mobile phones have gradually introduced application split screens to meet the needs of users to watch and play, watch and chat, etc., such as watching videos while chatting on WeChat.
[0003] However, since the screens of tablets / foldable phones are smaller than large screens, the experience is not so ideal. Moreover, with the introduction of new scenarios such as video calls on high-end set-top boxes / smart screens, artificial intelligence (AI) fitness, and smart screen projection, the application split-screen feature can fully utilize the advantages of large screens and provide a better multi-application experience. For example, Figure 2 As shown, through the IPTV / OTT set-top box system, you can watch TV programs while browsing other applications (Application, APP) (such as Figure 2 The user can also watch TV programs while exercising, watch TV programs while receiving calls, watch TV programs while playing cast applications, etc., to enhance the visual experience and meet the user's needs of operating multiple applications at the same time.
[0004] At present, the implementation process of an electronic device displaying the interfaces of multiple applications at the same time may be: the electronic device displays the icons of multiple applications in response to the user triggering the operation of entering the split-screen mode. After the electronic device receives the user's selection operation for the icon of the application to be displayed in split screen, the interface of the application selected by the user can be displayed in split screen on the display screen of the electronic device. However, the electronic device can only support the normal operation of the application adapted to the split-screen layout in the split-screen mode, and cannot support the split-screen display for the application that has not been adapted. Summary of the invention
[0005] The present application provides a split-screen display method and electronic device, which solves the problem that the electronic device can only support the normal operation of applications adapted to the split-screen layout in the split-screen mode, and cannot support the split-screen display for applications that have not been adapted, thereby improving the user experience.
[0006] In a first aspect of the present application, a split-screen display method is provided. The method can be applied to an electronic device including a display screen. The method may include:
[0007] An electronic device may receive a first operation of a user triggering a split-screen display; in response to the first operation, the electronic device may display split-screen interfaces of multiple target applications on a display screen according to a target split-screen layout. The multiple target applications may include a first application that is not adapted to the target split-screen layout; and the split-screen interface of the first application is obtained by scaling a predefined interface of the first application according to a scaling ratio. The scaling ratio may be determined based on the ratio of the width of a split-screen display area for displaying the split-screen interface of the first application in the target split-screen layout to the width of the display screen and the ratio of the height of the split-screen display area to the height of the display screen.
[0008] The predefined interface of the first application may be an interface pre-designed according to the size of the display screen, or may be other pre-designed interfaces that are unrelated to the size of the display screen, and the embodiments of the present application do not limit this.
[0009] The split-screen display method provided in the embodiment of the present application, after receiving the user's operation to trigger the split-screen display, if the application participating in the split-screen display has not been adapted to the split-screen layout, the predefined interface of the application can be scaled by a determined scaling ratio and then split-screen display can be performed, so that the application that has not been adapted to the split-screen layout can participate in the split-screen display. In other words, the method provided in the embodiment of the present application supports the split-screen display of applications that have not been adapted to the current split-screen layout, so that all applications in the electronic device support split-screen display, and there is no need for the application developer to perform adaptation work for the application in advance, thereby reducing the application adaptation workload, improving the compatibility of the electronic device, and enhancing the user experience.
[0010] In conjunction with the first aspect, in a possible implementation, the target application may include an application selected by the user in the split-screen application list; or the target application may include an application selected by the user in the split-screen application list and an application whose interface is displayed on the display screen before receiving the first operation. A split-screen application list may be provided for the user to select an application to participate in the split-screen, which is highly flexible. It also supports including the application whose interface is displayed on the current display screen into the applications participating in the split-screen, which provides convenience for the user to use the split-screen function.
[0011] In combination with the first aspect, in another possible implementation, when the target application includes an application selected by the user in a split-screen application list, before the electronic device displays split-screen interfaces of multiple target applications on the display screen according to the target split-screen layout, the above method may also include: the electronic device displays the identifiers of multiple applications, such as displaying a split-screen application list including the identifiers of multiple applications; receiving a selection operation of the user for at least two application identifiers from the multiple application identifiers; accordingly, the target application may specifically include: the application corresponding to the identifier selected by the user.
[0012] In combination with the first aspect, in another possible implementation, when the target application includes an application selected by the user in a split-screen application list and an application whose interface is displayed on the display screen before receiving the first operation, before the electronic device receives the first operation of the user triggering the split-screen display, the above method may also include: the electronic device displays the interface of the second application, wherein the second application may be the above-mentioned first application or may not be the above-mentioned first application; or, the electronic device displays the interfaces of at least two second applications in split screen, and the at least two second applications may include the above-mentioned first application or may not include the above-mentioned first application; accordingly, before the electronic device displays the split-screen interfaces of multiple target applications in split screen on the display screen according to the target split-screen layout, the above method may also include: the electronic device displays the identifiers of multiple applications, such as displaying a split-screen application list including the identifiers of multiple applications, the multiple applications do not include the above-mentioned second application, or the split-screen application list does not include the identifier of the second application; the electronic device receives the user's selection operation for the identifier of at least one application among the multiple application identifiers; accordingly, the target application may specifically include: the application corresponding to the identifier selected by the user and the second application.
[0013] In combination with the first aspect, in another possible implementation, before the electronic device displays the identifications of multiple applications, the method may further include: the electronic device displays a template selection page, the template selection page includes multiple split-screen templates, the split-screen template only indicates the number of split-screens, does not indicate the specific split-screen ratio, and different split-screen modules correspond to different numbers of split-screens; the electronic device receives a user's selection operation of a target split-screen module, and the number of split-screens corresponding to the target split-screen module is the same as the number of target applications. By providing a template selection page for the user to select the number of split-screens they want, the flexibility of the solution is improved.
[0014] In combination with the first aspect, in another possible implementation, in response to a first operation, the electronic device displays split-screen interfaces of multiple target applications on the display screen according to the target split-screen layout, which may specifically include: in response to the first operation, the electronic device displays a split-screen layout list, and the split-screen layout list is used to display preview images of the split-screen layouts; the electronic device receives a second operation by the user on a preview image of a target split-screen layout in the split-screen layout list; in response to the second operation, the electronic device displays split-screen interfaces of multiple target applications on the display screen according to the target split-screen layout; wherein the split-screen layout list includes: at least one preview image of the first split-screen layout, and / or, at least one preview image of the second split-screen layout. Preview image of the bureau; different split-screen layouts have different layout modes; the first split-screen layout is a split-screen layout that satisfies the following conditions among the split-screen layouts supported by the electronic device: the number of split-screens corresponding to the split-screen layout is the same as the number of target applications, and there are applications in multiple target applications that are adapted to the split-screen layout; at least one second split-screen layout includes one or more of the following split-screen layouts: split-screen layouts other than the first split-screen layout among the split-screen layouts supported by the electronic device and corresponding to the same number of split-screens as the number of target applications; split-screen layouts corresponding to the same number of split-screens as the number of target applications in the historical split-screen layouts; split-screen layouts corresponding to the same number of split-screens as the number of target applications in the split-screen layouts saved by the electronic device. The electronic device can display preview images of one or more split-screen layouts in the split-screen layout list, such as the recommended split-screen layout, the historical split-screen layout, the split-screen layout saved by the user, and other split-screen layouts, for the user to choose, based on the adaptation of the target application selected by the user to the split-screen layout, thereby improving the user's experience.
[0015] In combination with the first aspect, in another possible implementation, for each of the at least one first split-screen layout and the at least one second split-screen layout: when there is an application in multiple target applications that is not compatible with the split-screen layout, the split-screen layout list also includes: a first identifier displayed corresponding to the preview image of the split-screen layout; wherein the first identifier is used to indicate that there is an application in multiple target applications that is not compatible with the split-screen layout. For the split-screen layout with unadapted applications, an unadapted identifier can also be presented to the user, so that the user can make a better distinction.
[0016] In combination with the first aspect, in another possible implementation, the split-screen layout list further includes: displaying a second identifier corresponding to the preview image of the first split-screen layout; wherein the second identifier is used to indicate that the first split-screen layout is a recommended split-screen layout. For split-screen layouts for which there are adapted applications, the corresponding recommended identifier is displayed, so that the user can more easily select a split-screen layout with a better display experience in the split-screen layout list, thereby enhancing the user's experience.
[0017] In combination with the first aspect, in another possible implementation, before the electronic device displays the split-screen layout list, the method may further include: the electronic device obtains adaptation information of each target application in multiple target applications, the adaptation information is used to indicate the split-screen layout adapted to the corresponding target application; the electronic device determines at least one first split-screen layout according to the adaptation information of each target application in the multiple target applications. By determining a split-screen layout with a better display experience effect and recommending it to the user based on information about whether the target application selected by the user has been adapted to the split-screen layout, the user's experience is enhanced.
[0018] In combination with the first aspect, in another possible implementation, the adaptation information is included in a configuration file corresponding to the target application; or, the adaptation information is included in a whitelist; the whitelist is used to record the split-screen layout adapted for the application contained in the electronic device, and the whitelist is stored in the electronic device or obtained from a server.
[0019] In combination with the first aspect, in another possible implementation, the split-screen layout includes multiple split-screen display areas; the adaptation information is an identifier corresponding to the adapted split-screen display area; or, the adaptation information is the size of the adapted split-screen display area.
[0020] In combination with the first aspect, in another possible implementation, after the electronic device displays the split screen interfaces of multiple target applications on the display screen according to the target split screen layout in response to the first operation, the method may further include: the electronic device receives a third operation of the user triggering the display of the split screen menu; in response to the third operation, the electronic device displays the split screen menu, the split screen menu includes a window adjustment control; the electronic device receives a fourth operation of the user on the window adjustment control; in response to the fourth operation, the electronic device redisplays the split screen layout list for the user to reselect the target split screen layout. In this way, the split screen layout can be flexibly adjusted according to the needs of the user, thereby enhancing the user's experience.
[0021] In combination with the first aspect, in another possible implementation, the electronic device includes an application layer and a system layer; the electronic device displays a split-screen interface of a first application on a display screen, including: the application layer of the electronic device transmits split-screen parameters to the system layer of the electronic device, the split-screen parameters including: the position and size of the split-screen display area for displaying the split-screen interface of the first application, and marking information, the marking information is used to indicate that the first application is not adapted to the split-screen layout; the system layer of the electronic device determines the scaling ratio according to the marking information, the size of the split-screen display area and the size of the display screen; the system layer of the electronic device scales the predefined interface of the first application according to the scaling ratio and the position of the split-screen display area and displays it on the display screen. In this way, the split-screen display of the unadapted application can be achieved.
[0022] In combination with the first aspect, in another possible implementation, the electronic device includes an application layer and a system layer; the electronic device displays a split-screen interface of a first application on a display screen, including: in response to an instruction of the application layer of the electronic device, the system layer of the electronic device creates a virtual screen, the size of the virtual screen is the same as the size of the split-screen display area for displaying the split-screen interface of the first application; the application layer of the electronic device determines the scaling ratio according to the size of the split-screen display area and the size of the display screen; the application layer of the electronic device synthesizes the predefined interface of the first application into the virtual screen according to the scaling ratio; the system layer of the electronic device displays the synthesized interface on the virtual screen on the display screen according to the position of the split-screen display area. In this way, the split-screen display of unadapted applications can be achieved.
[0023] In a second aspect, a device is provided, which has the function of implementing the electronic device behavior in the method of the first aspect. The function can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions, for example, an input unit or module, a display unit or module, and a processing unit or module.
[0024] According to a third aspect, an electronic device is provided, comprising: a processor; a memory; and a computer program, wherein the computer program is stored in the memory, and when the computer program is executed by the processor, the electronic device executes a method as described in any one of the above-mentioned first aspects.
[0025] In a fourth aspect, a computer-readable storage medium is provided, the computer-readable storage medium comprising a computer program, and when the computer program runs on an electronic device, the electronic device can execute any one of the methods described in the first aspect.
[0026] In a fifth aspect, a computer program product comprising instructions is provided, which, when executed on an electronic device, enables the electronic device to execute any one of the methods described in the first aspect.
[0027] In a sixth aspect, an embodiment of the present application provides a chip, the chip including a processor, the processor being used to call a computer program in a memory to execute a method as described in any one of the methods in the first aspect.
[0028] It can be understood that the beneficial effects that can be achieved by the device described in the second aspect, the electronic device described in the third aspect, the computer-readable storage medium described in the fourth aspect, the computer program product described in the fifth aspect, and the chip described in the sixth aspect provided above can refer to the beneficial effects in the first aspect and any possible implementation method thereof, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0029] Figure 1A schematic diagram of an interface display provided for related technologies;
[0030] Figure 2 Another interface display schematic diagram provided for related technologies;
[0031] Figure 3A A schematic diagram of a split-screen display interface provided for related technologies;
[0032] Figure 3B Another schematic diagram of a split-screen display interface provided by the related technology;
[0033] Figure 4A A flowchart of a split-screen display method provided for related technologies;
[0034] Figure 4B A schematic diagram of another interface for split-screen display provided by the related technology;
[0035] Figure 5A A schematic diagram of another interface for split-screen display provided by the related technology;
[0036] Figure 5B A schematic diagram of another interface for split-screen display provided by the related technology;
[0037] Figure 5C A schematic diagram of a module used in a split-screen display provided by the related technology;
[0038] Figure 6 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;
[0039] Figure 7 A schematic diagram of a flow chart of a split-screen display method provided in an embodiment of the present application;
[0040] Figure 8 A schematic diagram of a split-screen display interface provided in an embodiment of the present application;
[0041] Fig. 9 A schematic diagram of another interface for split-screen display provided in an embodiment of the present application;
[0042] Fig.10 A schematic diagram of another split-screen display interface provided in an embodiment of the present application;
[0043] Fig.11 A schematic diagram of a split-screen layout provided in an embodiment of the present application;
[0044] Fig.12 A schematic diagram of another split-screen display interface provided in an embodiment of the present application;
[0045] Fig.13A schematic diagram of another split-screen display interface provided in an embodiment of the present application;
[0046] Fig.14 A schematic diagram of a method for rendering a split-screen interface of an incompatible application at a system layer of an electronic device provided in an embodiment of the present application;
[0047] Fig.15 A schematic diagram of a method for rendering a split-screen interface of an incompatible application at an application layer of an electronic device provided in an embodiment of the present application;
[0048] Fig.16 A schematic diagram of a flow chart of another split-screen display method provided in an embodiment of the present application;
[0049] Fig.17 A schematic diagram of another split-screen display interface provided in an embodiment of the present application;
[0050] Fig.18 A schematic diagram of a flow chart of another split-screen display method provided in an embodiment of the present application;
[0051] Fig.19 A schematic diagram of another split-screen display interface provided in an embodiment of the present application;
[0052] Fig. 20 A schematic diagram of another split-screen display interface provided in an embodiment of the present application. DETAILED DESCRIPTION
[0053] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of the present application, unless otherwise specified, "plurality" means two or more.
[0054] With the advancement of technology and the popularization of smart terminal devices, the need to control multiple applications at the same time is becoming increasingly obvious. And with the launch of new scenarios of high-end set-top boxes / smart screens, the use of application split-screen features can give full play to the advantages of large screens and provide a better multi-application experience. The relevant technology provides three solutions for achieving split-screen display.
[0055] Solution 1 provides a technical solution for implementing split-screen display on a mobile phone. When a user wants to use the split-screen display function of a mobile phone, Figure 3A As shown in (a) of FIG. 1 , the user can perform a sliding operation from right to left on the DOCK area 301 of the mobile phone touch screen. In response to the sliding operation, as shown in FIG. Figure 3AAs shown in (b) of FIG. 1 , the mobile phone can display a “multi-window” control 302. The user can click on the “multi-window” control 302. After the mobile phone receives the click operation, Figure 3A As shown in (c) of FIG. 1 , the mobile phone can display application icons (eg, Figure 3A The browser application icon, gallery application icon, email application icon, WeChat application icon, etc. shown in (c) TM app icon, phone app icon, etc.), and split-screen display style layout.
[0056] The user can select the preferred target split-screen display style layout and the desired split-screen application in the above interface. In response to the user's selection operation of the application icon and the target split-screen display style layout, the mobile phone can split the selected application according to the target split-screen display style layout. For example, Figure 3A As shown in (c), the user selected WeChat TM and the phone's application icon, and selects the target split-screen display style layout 303, then in response, Figure 3A As shown in (d) in the figure, the mobile phone can TM The interface of the phone and the interface of the phone are displayed on the touch screen of the mobile phone in split screen according to the target split screen display style layout 303. For another example, Figure 3B As shown in (a), the user selects the email application icon, the browser application icon, and the WeChat application icon. TM , and selects the target split-screen display style layout 304, then in response, Figure 3B As shown in (b), the mobile phone can integrate the email interface, browser interface and WeChat interface. TM The interface is displayed in split screen on the mobile phone touch screen according to the target split screen display style layout 304.
[0057] Solution 2 provides a technical solution for implementing split-screen display on a smart TV terminal. Figure 4AAs shown, when the user wants to use the split-screen display function of the smart TV terminal, the split-screen function can be set in advance, one or more split-screen schemes, split-screen alternatives, and the maximum number of split-screens can be set. Among them, each split-screen scheme includes the number of split-screens and the split-screen parameters when the application is pulled up, such as setting the window position and size of the interface for displaying the corresponding application according to the order in which the application is pulled up. In this way, when the user opens a web page / TV program / web application, it is displayed in full screen on the smart TV terminal. If the user continues to open another web page / TV program / web application, the smart TV terminal determines whether the user has set a split-screen scheme. If so, the split-screen scheme set by the user is obtained, and the two web pages / TV programs / web applications opened successively are displayed in split screen according to the split-screen scheme set by the user, and the process ends. If not, the default split-screen scheme is calculated, and the two web pages / TV programs / web applications opened successively are displayed according to the default split-screen scheme, and the process ends.
[0058] The display effect of the second scheme can be as follows Figure 4B As shown. Figure 4B As shown in (a) of FIG. 1 , the smart TV terminal displays a startup item panel, which includes: a TV entity function, a web page entity function, and a web application (APP) entity function, wherein the web application entity function may be multiple, for example Figure 4B The microblog shown in (a) TM , maps, e-books, etc. When the user chooses to open a Web Page, the Web Page is displayed in full screen on the smart TV terminal. If the user continues to open another web page / TV program / web application, such as opening TV, Figure 4B As shown in (b) of FIG. 1 , the smart TV terminal displays the Web Page and TV in split screen based on the split screen scheme set by the user or the default split screen scheme. The user continues to open APP1. Figure 4B As shown in (c) of FIG. 1 , based on the split screen scheme set by the user or the default split screen scheme, the Web Page, TV and APP1 are displayed in split screen. If the user continues to open APP2, Figure 4B As shown in (d) in the figure, based on the split-screen scheme set by the user or the default split-screen scheme, the Web Page, TV, APP1 and APP2 are displayed in split-screen.
[0059] Solution 3 provides a technical solution for realizing split-screen display on a TV. In this solution, when a user wants to use the split-screen display function of a TV, he can operate the corresponding button to trigger the TV to switch from the non-split-screen display mode to the split-screen display mode. Figure 5AAs shown in (a) of FIG. 1 , the user can select the application that he wants to display in split screen and the split screen layout setting that he wants to use on the screen. The split screen layout setting reflects the display ratio and / or position of each application displayed in split screen. For example, the split screen layout setting can be an equal split mode (the display ratio of each application is the same), a large-large-small mode (the display ratio of one application is large, and the display ratio of the others is small), etc. In response to the user's selection operation, such as Figure 5A As shown in (b) of FIG. 1 , the TV sets the interface of the application selected by the user in split screen according to the split screen layout setting selected by the user. The user can also choose to save / collect the information currently displayed in split screen, such as the application displayed in split screen and the corresponding split screen layout setting, for subsequent viewing / use. For example, the user can pull out more operation menus by performing corresponding operations, such as Figure 5A As shown in (c) in FIG. 1 , the more operation menu may include multiple preset items, such as a switch style setting item, a favorite split screen setting item, etc. After the user operates the favorite split screen setting item, the corresponding TV can collect the information currently displayed on the split screen. Figure 5B As shown in FIG. 1 , the user can open the history record by performing corresponding operations to view the favorite split-screen displayed information. Figure 5C As shown, the above functions can be realized through the button confirmation module, mode switching module and split-screen display module of the TV.
[0060] It can be understood that the above three solutions all provide split-screen display solutions, that is, the electronic devices in the solutions provided support split-screen mode. Split-screen mode refers to a mode in which an electronic device can simultaneously display the interfaces of multiple (two or more) applications on its display screen. That is, in split-screen mode, a user can use two or more applications at the same time, and the interface of each application occupies a part of the electronic device display screen. Normally, in order to adapt to the split-screen mode, applications usually need to adapt the interface in advance. That is, the application developer needs to design the corresponding split-screen interface in advance so that the application can be displayed in split screen according to the split-screen interface designed in advance.
[0061] In the above three schemes, the applications that are allowed to participate in the split-screen display are only those that have designed the corresponding split-screen interface in advance. That is, in the technical scheme provided by the relevant technology, only the applications that have designed the corresponding split-screen interface in advance can be supported to run normally in the split-screen mode. For applications that have not designed the corresponding split-screen interface in advance, the split-screen display cannot be supported, which reduces the user experience. Among them, it can be understood that the above-mentioned design of the corresponding split-screen interface in advance refers to designing the split-screen interface in advance according to the number of display areas (hereinafter referred to as the number of split-screens) and the split-screen ratio of the display screen when the split-screen display is displayed. In this embodiment, the number of split-screens and the split-screen ratio corresponding to the split-screen display are called split-screen layouts. The number of split-screens and / or split-screen ratios corresponding to different split-screen layouts are different. With the development of technology, the split-screen layouts that electronic devices can support are also gradually increasing. If the scheme of the relevant technology is adopted, if you want the application to use multiple split-screen layouts for split-screen display, the application developer needs to design the corresponding split-screen interface in advance for each split-screen layout, which undoubtedly increases the development cost. If the split-screen interface corresponding to a split-screen layout is not designed in advance, the application cannot use the corresponding split-screen layout for split-screen display, which reduces the user experience.
[0062] In this embodiment, if a split screen interface of a split screen layout is designed in advance for an application, the application is said to have adapted to the split screen layout. If a split screen interface of a split screen layout is not designed in advance for an application, the application is said to have not adapted to the split screen layout.
[0063] In order to solve the above technical problems, the embodiment of the present application provides a split-screen display method, which can be applied to an electronic device including a display screen. For applications that are not adapted to a certain split-screen layout, the split-screen layout is also supported for split-screen display to improve the user experience.
[0064] It should be noted that in the embodiment of the present application, an application that is not adapted to a certain split-screen layout may be that it is only adapted to one or more split-screen layouts, but some split-screen layouts are not adapted, and an application that is not adapted to a certain split-screen layout may also be that it is not adapted to any split-screen layout supported by the electronic device, and this embodiment does not limit this. Among them, for an application that has not been adapted to any split-screen layout supported by the electronic device, it can also be considered that the application does not support split-screen display.
[0065] As an example, in this embodiment, the above-mentioned electronic device can specifically be a mobile phone, a tablet computer, a laptop computer, an ultra-mobile personal computer (UMPC), a handheld computer, a netbook, a personal digital assistant (PDA), a wearable electronic device (for example, a smart watch, a smart glasses, a smart helmet, a smart bracelet), a virtual reality device, a smart screen, a smart TV, an OTT set-top box system (including an OTT set-top box and a display screen), a television, and other devices that support split-screen display function, and the embodiments of the present application do not impose any restrictions on this.
[0066] The implementation of the embodiments of the present application will be described in detail below with reference to the accompanying drawings.
[0067] Take the mobile phone as an example. Figure 6 , is a schematic diagram of the structure of a mobile phone provided in an embodiment of the present application. Figure 6 As shown, the mobile phone may include a processor 610, an external memory interface 620, an internal memory 621, a universal serial bus (USB) interface 630, a charging management module 640, a power management module 641, a battery 642, an antenna 1, an antenna 2, a mobile communication module 650, a wireless communication module 660, an audio module 670, a speaker 670A, a receiver 670B, a microphone 670C, an earphone interface 670D, a sensor module 680, a button 690, a motor 691, an indicator 692, cameras 1 to N 693, a display screen 694, and subscriber identification module (SIM) card interfaces 1 to N 695, etc.
[0068] Among them, the sensor module 680 may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, and the like.
[0069] It is to be understood that the structure illustrated in this embodiment does not constitute a specific limitation on the mobile phone. In other embodiments, the mobile phone may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.
[0070] The processor 610 may include one or more processing units, for example: the processor 610 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units can be independent devices or integrated in one or more processors. The controller can be the nerve center and command center of the mobile phone. The controller can generate an operation control signal according to the instruction opcode and the timing signal to complete the control of fetching and executing instructions.
[0071] A memory may also be provided in the processor 610 for storing instructions and data. In some embodiments, the memory in the processor 610 is a cache memory. The memory may store instructions or data that the processor 610 has just used or circulated. If the processor 610 needs to use the instruction or data again, it may be directly called from the memory. Repeated access is avoided, the waiting time of the processor 610 is reduced, and the efficiency of the system is improved. In an embodiment of the present application, the processor 610 is used to execute the method of the present application to realize the function of split-screen display.
[0072] In some embodiments, the processor 610 may include one or more interfaces. The processor 610 may interact with other components of the electronic device through the one or more interfaces. It is understood that Figure 6 The interface connection relationship between the modules shown is only a schematic illustration and does not constitute a structural limitation on the electronic device.
[0073] The charging management module 640 is used to receive charging input from the charger. While the charging management module 640 is charging the battery 642, it can also power the mobile phone through the power management module 641. The power management module 641 is used to connect the battery 642, the charging management module 640 and the processor 610. The power management module 641 can also receive input from the battery 642 to power the mobile phone.
[0074] The wireless communication function of the mobile phone can be realized through antenna 1, antenna 2, mobile communication module 650, wireless communication module 660, modem processor and baseband processor.
[0075] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Mobile communication module 650 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied on mobile phones. Mobile communication module 650 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. Mobile communication module 650 can receive electromagnetic waves from antenna 1, and filter, amplify and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. Mobile communication module 650 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through antenna 1.
[0076] The wireless communication module 660 can provide wireless communication solutions including wireless local area networks (WLAN) (such as Wi-Fi networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), NFC, infrared technology (IR), etc., which are applied to mobile phones. The wireless communication module 660 can be one or more devices integrating at least one communication processing module. The wireless communication module 660 receives electromagnetic waves via antenna 2, modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 610. The wireless communication module 660 can also receive the signal to be sent from the processor 610, modulate the frequency, amplify it, and convert it into electromagnetic waves for radiation through antenna 2.
[0077] In some embodiments, the antenna 1 of the mobile phone is coupled to the mobile communication module 650, and the antenna 2 is coupled to the wireless communication module 660, so that the mobile phone can communicate with the network and other devices through wireless communication technology.
[0078] The mobile phone realizes the display function through a GPU, a display screen 694, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 694 and the application processor. The processor 610 may include one or more GPUs, which execute program instructions to generate or change display information.
[0079] The display screen 694 is used to display images, videos, etc. The display screen 694 includes a display panel. In some embodiments, the mobile phone may include 1 or N display screens 694, where N is a positive integer greater than 1. In the embodiment of the present application, the display screen 694 can be used to display the interface involved in the embodiment of the present application, such as a split-screen interface for displaying multiple target applications in split screen.
[0080] The mobile phone can realize the shooting function through the ISP, camera 693, video codec, GPU, display screen 694 and application processor, etc. In some embodiments, the mobile phone can include 1 or N cameras 693, where N is a positive integer greater than 1.
[0081] The external memory interface 620 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the mobile phone. The external memory card communicates with the processor 610 through the external memory interface 620 to implement a data storage function. For example, files such as music and videos can be stored in the external memory card.
[0082] The internal memory 621 can be used to store computer executable program codes, which include instructions. The processor 610 executes various functional applications and data processing of the mobile phone by running the instructions stored in the internal memory 621. The internal memory 621 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the mobile phone (such as audio data, a phone book, etc.), etc. In addition, the internal memory 621 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.
[0083] The mobile phone can realize audio functions such as playing alarm music, recording, etc. through the audio module 670, the speaker 670A, the receiver 670B, the microphone 670C, the earphone interface 670D, and the application processor.
[0084] The audio module 670 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signal. The audio module 670 can also be used to encode and decode audio signals. In some embodiments, the audio module 670 can be arranged in the processor 610, or some functional modules of the audio module 670 can be arranged in the processor 610.
[0085] Speaker 670A, also called "horn", is used to convert audio electrical signals into sound signals. The mobile phone can listen to alarm music or listen to hands-free calls through speaker 670A. Receiver 670B, also called "earpiece", is used to convert audio electrical signals into sound signals. When the mobile phone answers a call or voice message, the voice can be answered by placing receiver 670B close to the human ear. Microphone 670C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by placing the human mouth close to microphone 670C to input the sound signal into microphone 670C.
[0086] The pressure sensor is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor can be set on the display screen 694. When a touch operation is applied to the display screen 694, the mobile phone detects the intensity of the touch operation according to the pressure sensor. The mobile phone can also calculate the touch position according to the detection signal of the pressure sensor.
[0087] Gyroscope sensors can be used to determine the motion posture of the phone. Air pressure sensors are used to measure air pressure. Magnetic sensors include Hall sensors. The phone can use magnetic sensors to detect the opening and closing of the flip leather case. Accelerometers can detect the magnitude of the phone's acceleration in all directions (generally three axes). Distance sensors are used to measure distance. The phone can use proximity sensors to detect when the user holds the phone close to the ear to talk, so that the screen can be automatically turned off to save power. Proximity sensors can also be used for automatic unlocking and locking of the leather case mode and pocket mode. Ambient light sensors are used to sense the brightness of ambient light. Fingerprint sensors are used to collect fingerprints. The phone can use the collected fingerprint characteristics to achieve fingerprint unlocking, access application locks, fingerprint photography, fingerprint answering calls, etc. Temperature sensors are used to detect temperature. Bone conduction sensors can obtain vibration signals.
[0088] The touch sensor is also called a "touch panel". The touch sensor can be set on the display screen 694, and the touch sensor and the display screen 694 form a touch screen, also called a "touch screen". The touch sensor is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 694. In other embodiments, the touch sensor can also be set on the surface of the mobile phone, which is different from the position of the display screen 694.
[0089] The buttons 690 include a power button, a volume button, etc. The buttons 690 may be mechanical buttons or touch buttons.
[0090] Motor 691 can generate vibration prompts. Motor 691 can be used for alarm ringing prompts, incoming call vibration prompts, and touch vibration feedback. Different application scenarios (for example: time reminders, receiving messages, alarms, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.
[0091] Indicator 692 can be an indicator light, which can be used to indicate the charging status, power changes, and can also be used to indicate messages, missed calls, alarms, notifications, etc.
[0092] When the mobile phone includes a SIM card interface 695, the SIM card interface 695 is used to connect the SIM card. The SIM card can be connected to and separated from the mobile phone by inserting it into the SIM card interface 695 or pulling it out from the SIM card interface 695. The mobile phone can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The mobile phone interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the mobile phone uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the mobile phone and cannot be separated from the mobile phone.
[0093] It should be noted that the above embodiments are illustrated by taking the electronic device as a mobile phone as an example. In some other embodiments, the electronic device may also be other devices, such as a smart screen / OTT set-top box system / television, etc. When the electronic device is a device of other forms, it may include Figure 6 More or fewer components of the mobile phone shown. For example, in the case where the electronic device is a smart screen, the electronic device may not include a charging management module 640, a mobile communication module 650, a receiver 670B, a motor 691, and a SIM card interface 695, etc. The smart screen may also be equipped with a remote control. The remote control is used to control the smart screen. The remote control may include: a plurality of buttons, such as a power button, a volume button, and other multiple selection buttons. The buttons on the remote control may be mechanical buttons or touch buttons. The remote control can receive key inputs, generate key signal inputs related to user settings and function controls of the smart screen, and send corresponding control signals to the smart screen to control the smart screen. For example, the remote control can send control signals to the smart screen via infrared signals, etc. The remote control may also include a battery storage cavity for installing batteries to power the remote control.
[0094] The following takes the electronic device as a smart screen as an example, and combines specific examples to describe in detail the split-screen display method provided in the embodiment of the present application.
[0095] Among them, the software architecture of the smart screen may include an application layer and a system layer. Of course, when the electronic device is other types of devices, its software architecture may also include other layers, such as an application framework layer, a kernel layer, etc., which are not specifically limited in this embodiment. The layers communicate with each other through software interfaces. In some embodiments, the application layer may include various applications installed on the smart screen. Applications in the application layer can interact directly with the system layer. The system layer can provide corresponding services for the application layer to implement corresponding functions, such as providing display services. The following introduces the solution in conjunction with the software architecture.
[0096] Figure 7 A schematic diagram of a split-screen display method provided in an embodiment of the present application. Figure 7 As shown, the method may include:
[0097] S701. The smart screen receives an operation initiated by the user to trigger split-screen display.
[0098] Among them, the smart screen supports a split-screen display function. When the user wants to use the split-screen display function of the smart screen, the corresponding operation can be performed to trigger the smart screen to perform split-screen display. In this embodiment, the operation of triggering the split-screen display can be the first operation in the embodiment of the present application.
[0099] Exemplarily, the operation of triggering the split-screen display in this embodiment can be any form of operation. For example, the display screen of the smart screen has a touch function, or the display screen of the smart screen is specifically a touch screen, then the operation of triggering the split-screen display can be a user's touch operation on a specific control displayed on the display screen of the smart screen. For another example, the smart screen includes a specific button, and the specific button can be a touch button or a mechanical button, then the operation of triggering the split-screen display can be the user's operation on the specific button. For another example, the smart screen is equipped with a remote control, and the remote control includes a specific button, then the operation of triggering the split-screen display can be the user's operation on the specific button on the remote control. Alternatively, the operation of triggering the split-screen display can be the user's operation of displaying a specific control on the display screen of the smart screen through the remote control. Among them, the above-mentioned specific controls and specific buttons can be used to trigger the smart screen to display a split screen, or in other words, can be used to trigger the smart screen to enter the split-screen display function.
[0100] For example, if the display screen of the smart screen has a touch function, a specific control displayed on the display screen of the smart screen is touched to trigger the smart screen to display in split screen. Here, it is assumed that the specific control is called a static split screen control and it is included in the split screen menu. It can be considered that the static split screen control is provided to the user in the form of a secondary menu, and the split screen menu can be considered as a primary menu. Figure 8As shown, the user can trigger the smart screen to display a split-screen menu 801 by performing corresponding operations. The split-screen menu 801 includes one or more controls for split-screen display control, such as multiple controls including the above-mentioned static split-screen control 802. Afterwards, the user can touch the controls displayed on the display screen to trigger the smart screen to implement the corresponding function. For example, the user touches the static split-screen control 802. Correspondingly, the smart screen, such as the application layer of the smart screen, can receive the user's touch operation on the static split-screen control 802, that is, receive the user's operation to trigger the split-screen display.
[0101] After the smart screen receives the user's operation to trigger the split-screen display, in response, the smart screen, such as the system layer of the smart screen, can display the split-screen interfaces of multiple target applications on the display screen of the smart screen according to the target split-screen layout. In some embodiments, the target split-screen layout and the target application can be selected by the user, such as the smart screen can provide a corresponding list for the user to select the application to be split and the split-screen layout to be used. As an example, the process can be implemented through the following S702-S709.
[0102] S702. In response to the operation in S701, the smart screen displays a template selection page, which includes multiple split-screen templates.
[0103] S703. The smart screen receives the user's selection operation on the target split-screen module in multiple split-screen templates.
[0104] In the embodiment of the present application, the split screen template is used to indicate the number of split screens, but not the specific split screen ratio. In other words, the split screen template only indicates the number of split screen display areas into which the display screen is divided when performing the corresponding split screen display, but does not indicate the position and size of each split screen display area. Different split screen templates indicate different numbers of split screens.
[0105] With the gradual update of split-screen technology, split-screen display is not limited to dividing the display screen into two display areas, but can be divided into more display areas. In other words, more and more devices support more and more diverse numbers of split screens to provide users with a richer user experience. Therefore, in this embodiment, after receiving an operation from a user to trigger a split-screen display, a smart screen, such as an application layer of a smart screen, can first display a template selection page, which can include multiple split-screen templates supported by the smart screen for the user to choose from.
[0106] For example, continue to combine Figure 8 In the example shown, the number of split screens indicated by the split screen template supported by the smart screen is 2, 3, and 4 respectively. After the smart screen receives the user's touch operation on the static split screen control 802, as shown in FIG. Fig. 9As shown, the smart screen can display a template selection page 901. The template selection page 901 includes split-screen template 1, split-screen template 2, and split-screen template 3. The number of split screens indicated by split-screen template 1 is 2, which is used to indicate that when split-screen display is performed, the display screen will be divided into 2 display areas. The number of split screens indicated by split-screen template 2 is 3, which is used to indicate that when split-screen display is performed, the display screen will be divided into 3 display areas. The number of split screens indicated by split-screen template 3 is 4, which is used to indicate that when split-screen display is performed, the display screen will be divided into 4 display areas. It should be noted that Fig. 9 The split-screen templates illustrated in the example indicate the number of split screens, such as 2, 3, and 4, but do not indicate a specific split-screen ratio.
[0107] In some embodiments, the user can select a split-screen template corresponding to the number of split-screen applications in the displayed template selection page as the target split-screen template. For example, if the number of applications the user wants to split is 2, the user can select split-screen template 1 as the target split-screen template.
[0108] It should be noted that, similar to the operation in S701, the user's selection operation for the target split screen template can also be any form of operation. Fig. 9 The touch operation of the split screen template 1) in the embodiment, or the operation of the corresponding button on the remote control, or the operation of the corresponding control displayed on the display screen through the remote control, etc., will not be described in detail in this embodiment. Among them, S702 and S703 are optional steps.
[0109] S704. In response to the selection operation in S703, the smart screen displays the logos of multiple applications.
[0110] S705. The smart screen receives a user's selection operation on at least two target application identifiers from multiple application identifiers.
[0111] The above-mentioned multiple applications may be some or all of the applications included in the smart screen. The identification of the application may include one or more of the icon of the application and the name of the application.
[0112] In an embodiment of the present application, the above-mentioned multiple applications may include applications that have been adapted to one or some split-screen layouts supported by the smart screen. In other words, the above-mentioned multiple applications include applications that have not been adapted to some split-screen layouts supported by the smart screen. The above-mentioned multiple applications may also include applications that have not been adapted to all split-screen layouts supported by the smart screen. The above-mentioned multiple applications may also include: applications that have been adapted to all split-screen layouts supported by the smart screen.
[0113] In some embodiments, after the smart screen receives the user's selection operation on the target split-screen template, the smart screen, such as the application layer of the smart screen, can display the identification of multiple applications for the user to select the application that he wants to split the screen. Among them, the identification of multiple applications can be provided to the user through a split-screen application list (or a static template split-screen creation page). A floating window can be created on the current display interface to display the split-screen application list, or to display the identification of these multiple applications, or the content in the current display interface can be directly updated to display the split-screen application list, or to display the identification of these multiple applications. The embodiment of the present application does not specifically limit the specific display form of the identification of multiple applications.
[0114] For example, taking updating the content in the current display interface to display a split-screen application list including multiple application identifiers, where the application identifiers include application icons and names as an example. Continuing with the example in S703, after the smart screen receives the user's selection operation on split-screen template 1, as shown in FIG. Fig.10 As shown, the smart screen, such as the application layer of the smart screen, can display a split-screen application list 1001. The split-screen application list 1001 includes icons and names of multiple applications. For example, it includes: icons and names of music, WeChat TM 's icons and names, gallery icons and names, email icons and names, video icons and names, etc. Among them, these applications include: applications that have not been adapted to all split-screen layouts supported by the smart screen, applications that have been adapted to some split-screen layouts supported by the smart screen, and applications that have been adapted to all split-screen layouts supported by the smart screen. The user can select the application that he wants to split in the split-screen application list 1001, such as referring to the application selected by the user as the target application. For example, the above selection operation may include an operation of selecting the identifier of the target application and an operation on the "OK" control. The user can select the identifier of the application that he wants to split, and operate the "OK" control to select the application that he wants to split. Accordingly, the smart screen, such as the application layer of the smart screen, can receive the user's selection operation on the identifier of the application and the operation on the "OK" control.
[0115] It should be noted that, similar to the operation in S701, the user's selection operation of the target application can also be any form of operation. Fig.10The touch operation of the "identification of the application in the smart screen and the "OK" control), or the operation of the corresponding button on the remote control, or the operation of the corresponding control displayed on the display screen through the remote control, etc., will not be described in detail in this embodiment. In addition, the above example is illustrated by taking the split-screen application list as an example, including applications that have not been adapted to all split-screen layouts supported by the smart screen, applications that have been adapted to some split-screen layouts supported by the smart screen, and applications that have been adapted to all split-screen layouts supported by the smart screen. In some other embodiments, the split-screen application list may also include only applications that have not been adapted to all split-screen layouts supported by the smart screen, or only applications that have been adapted to some split-screen layouts supported by the smart screen. Of course, it may also include only applications that have been adapted to all split-screen layouts supported by the smart screen, or include applications that have not been adapted to all split-screen layouts supported by the smart screen and applications that have been adapted to all split-screen layouts supported by the smart screen, or include applications that have been adapted to some split-screen layouts supported by the smart screen and applications that have been adapted to all split-screen layouts supported by the smart screen, or include applications that have not been adapted to all split-screen layouts supported by the smart screen and applications that have been adapted to some split-screen layouts supported by the smart screen. The embodiments of this application are not specifically limited here.
[0116] The split-screen layout supported by the electronic device is pre-configured by the device manufacturer, and an electronic device may support one or more split-screen layouts. Fig.11 As shown, the smart screen supports 6 split-screen layouts, namely: split-screen layout 1, split-screen layout 2, split-screen layout 3, split-screen layout 4, split-screen layout 5 and split-screen layout 6. Among them, the number of split screens in split-screen layout 1 is 2, and the split-screen ratio is 1:1 in the width direction. The number of split screens in split-screen layout 2 is 2, and the split-screen ratio is 2:1 in the width direction. The number of split screens in split-screen layout 3 is 3, and the split-screen ratio is 1:2 in the width direction and 1:1 in the height direction. The number of split screens in split-screen layout 4 is 3, and the split-screen ratio is 2:1 in the width direction and 1:1 in the height direction. The number of split screens in split-screen layout 5 is 4, and the split-screen ratio is 1:1 in the width direction and 1:1 in the height direction. The number of split screens in split-screen layout 6 is 4, and the split-screen ratio is 2:1 in the width direction and 1:1:1 in the height direction.
[0117] As described in the previous embodiments, an application has been adapted to a certain split-screen layout, which means that the application developer has designed a corresponding split-screen interface for the application in advance according to the split-screen layout. In some embodiments of the present application, developers can design different split-screen interfaces for applications based on their needs, for electronic devices such as some or all of the split-screen layouts supported by smart screens. For example, in combination with Fig.11In the example shown, the developer of an application, such as a video, designs a corresponding split-screen interface for the video according to the needs for split-screen layout 2, such as split-screen interface A, and designs a corresponding split-screen interface for the video for split-screen layout 3, such as split-screen interface B. It can be understood that when designing the split-screen interface of the application, the corresponding split-screen interface can be designed according to the split-screen ratio of the split-screen layout, or according to the specific size of the split-screen display area included in the split-screen layout. For example, for split-screen layout 2, the split-screen ratio is 2:1 in the width direction, then two split-screen interfaces A can be designed for the video, such as split-screen interface A1 and split-screen interface A2, which are respectively adapted to the split-screen display area that occupies 2 / 3 of the width of the display screen in the width direction and is the same height as the display screen in the height direction, and the split-screen display area that occupies 1 / 3 of the width of the display screen in the width direction and is the same height as the display screen in the height direction. Similarly, for split-screen layout 3, the corresponding split-screen interface B can also be pre-designed according to its corresponding split-screen ratio (1:2 in the width direction and 1:1 in the height direction), such as including two split-screen interfaces, namely split-screen interface B1 and split-screen interface B2, which are respectively adapted to the split-screen display area that occupies 1 / 3 of the width of the display screen in the width direction and the same height as the display screen in the height direction and the split-screen display area that occupies 2 / 3 of the width of the display screen and 1 / 2 of the height of the display screen in the height direction. For other applications included in the smart screen, similar processing as video can also be performed.
[0118] It is understandable that in the above embodiments, different split-screen layouts may include split-screen display areas of the same size, that is, the split-screen display areas included in different split-screen layouts occupy the same proportion in the width direction and the height direction of the display screen. Fig.11 In the example shown, the size of the split-screen display area on the right side of split-screen layout 2 is the same as the size of the split-screen display area on the left side of split-screen layout 3. Therefore, application developers can design a split-screen interface for split-screen display areas of the same size in different split-screen layouts, such as designing a split-screen interface for the split-screen display area on the right side of split-screen layout 2 and the split-screen display area on the left side of split-screen layout 3, which can save development costs.
[0119] In this embodiment, a split-screen display area of a certain size can be referred to as a mode (or UI mode, or UI configuration), and split-screen display areas of different sizes correspond to different modes. Each split-screen layout can also be regarded as a combination of different modes (or different split-screen display areas). Fig.11As shown, the split-screen display area that occupies 1 / 2 of the width of the display screen in the width direction and is the same as the height of the display screen in the height direction is called mode ①, the split-screen display area that occupies 1 / 3 of the width of the display screen in the width direction and is the same as the height of the display screen in the height direction is called mode ②, the split-screen display area that occupies 2 / 3 of the width of the display screen in the width direction and is the same as the height of the display screen in the height direction is called mode ③, the split-screen display area that occupies 1 / 2 of the width of the display screen in the width direction and 1 / 2 of the height of the display screen in the height direction is called mode ④, the split-screen display area that occupies 2 / 3 of the width of the display screen in the width direction and 1 / 2 of the height of the display screen in the height direction is called mode ⑤, the split-screen display area that occupies 1 / 3 of the width of the display screen in the width direction and 1 / 2 of the height of the display screen in the height direction is called mode ⑥, and the split-screen display area that occupies 1 / 3 of the width of the display screen in the width direction and 1 / 3 of the height of the display screen in the height direction is called mode ⑦. Among them, split-screen layout 1 can be regarded as a combination of two modes ①, split-screen layout 2 can be regarded as a combination of one mode ② and one mode ③, and split-screen layout 3 can be regarded as a combination of one mode ② and two modes ⑤. Other split-screen layouts are similar and will not be repeated here.
[0120] Based on the above, in some other embodiments of the present application, for electronic devices, such as smart screen applications, developers can design split-screen interfaces corresponding to different modes according to needs. In this way, for split-screen layouts that include modes for which corresponding split-screen interfaces are designed, it can be considered that the application has adapted the split-screen layout. For example, the developer of an application, such as a video, designs a corresponding split-screen interface for the video according to needs for mode ②, such as split-screen interface C, and designs a corresponding split-screen interface for the video for mode ③, such as split-screen interface D, and also designs a corresponding split-screen interface for the video for mode ⑤, such as split-screen interface E. Therefore, it can be understood that the video is adapted to all split-screen layouts including mode ②, mode ③, and mode ⑤, that is, the video is adapted to split-screen layout 2, split-screen layout 3, split-screen layout 4, and split-screen layout 6. Similar processing to the video can also be performed for other applications included in the smart screen.
[0121] For example, combined with Fig.10 In the example shown, the app developers of App Store, Sports Health and Weather have designed all split-screen layouts / split-screen interfaces of all modes for these apps in advance, and the app developers of Browser, File Manager and Video have designed some split-screen layouts (such as split-screen layout 2, split-screen layout 3, split-screen layout 4 and split-screen layout 6) / split-screen interfaces of some modes (such as mode ②, mode ③ and mode ⑤) for these apps in advance, Music, WeChat TM , email and gallery application developers have not designed any split screen layout / split screen interface of any mode for these applications in advance. Therefore, the split screen application list 1001 includes applications such as music, WeChat, etc. TM, email and gallery have not been adapted to all split-screen layouts supported by the smart screen; browser, file manager and video have been adapted to split-screen layout 2, split-screen layout 3, split-screen layout 4 and split-screen layout 6; calculator, application store, sports health and weather have been adapted to all split-screen layouts supported by the smart screen. Users can select the target application they want to split in the split-screen application list 1001 according to their own needs. It should be noted that only examples are given here for the specific situations of the split-screen layouts supported by the applications included in the smart screen, and it does not constitute a limitation on this application.
[0122] S706. In response to the selection operation in S705, the smart screen obtains adaptation information of each target application among multiple target applications, and the adaptation information is used to indicate the split-screen layout adapted for the corresponding target application.
[0123] Among them, for electronic devices, such as applications included in smart screens, the adapted split-screen layout can be indicated by adaptation information. The adaptation information can be pre-configured. For example, if the developer has designed a corresponding split-screen interface for the application for a certain split-screen layout or mode, the corresponding information can be added to the adaptation information. Therefore, after an electronic device, such as a smart screen, receives a user's selection operation for multiple target applications, it can obtain the adaptation information of each target application in the multiple target applications so as to obtain the split-screen layout adapted for each target application. For example, continuing with the example of S705 above, take the target applications selected by the user as email and video as an example. Smart screens, such as the application layer of smart screens, can obtain the adaptation information of emails and the adaptation information of videos so as to obtain the split-screen layout adapted for emails and videos.
[0124] In some embodiments of the present application, the adaptation information may be included in a configuration file corresponding to the target application.
[0125] Among them, a split-screen layout may include multiple split-screen display areas. As an example, the adaptation information may be an identifier of the adapted split-screen display area, that is, the identifier of the adapted split-screen display area may be used to indicate the split-screen layout adapted for the application. Among them, as described in the aforementioned embodiment, a split-screen display area of a certain size may be referred to as a mode, so, in other words, the adaptation information may be an identifier of the adapted mode. That is, if the developer pre-designs a split-screen interface for the application for a certain mode (i.e., a split-screen display area of a certain size), the identifier of the mode may be used to indicate that the split-screen layout including the mode is the split-screen layout adapted for the application.
[0126] Continuing with the example in S705 above, the video developers designed corresponding split-screen interfaces for the video for mode ②, mode ③ and mode ⑤ respectively. Therefore, the adaptation information may include the identifier of mode ②, the identifier of mode ③ and the identifier of mode ⑤, which are used to indicate that the video is adapted to split-screen layout 2, split-screen layout 3, split-screen layout 4 and split-screen layout 6.
[0127] For example, the operating system of an electronic device, such as a smart screen, is Android TM Take the system as an example. The configuration file of the application can be a Manifest.xml file. The application developer can add configuration items in the Manifest.xml file, and the configuration items include the identifier of the mode adapted by the application, which is used to indicate the split-screen layout adapted by the application. For example, the configuration item can be specifically: android:resizsableUIMode="*". Among them, the "*" is used to set the identifier of the adapted split-screen display area, or the identifier of the adapted mode. If multiple modes have been adapted, the identifiers of different modes can be separated by ",", and if no mode has been adapted, the "*" can be set to empty, but this embodiment is not limited to this. For example, the above video is adapted to mode ②, mode ③ and mode ⑤, the identifier of mode ② is 2, the identifier of mode ③ is 3 and the identifier of mode ⑤ is 5, then the configuration item can be specifically: android:resizsableUIMode="2,3,5". For another example, an application is adapted to mode ①, and the identifier of mode ① is 1, then the configuration item can be specifically android:resizsableUIMode="1". For another example, if an application is not adapted to any mode, the configuration item may specifically be android:resizsableUIMode="".
[0128] Based on the above, after the application layer of a smart screen, such as a smart screen, receives the user's selection operation on the target application, the application layer of the smart screen, such as a smart screen, can read the configuration file of the target application to obtain the adaptation information of the target application from the configuration file. Take the target application as the above video as an example. The application layer of the smart screen can read the configuration file of the video, such as the content of the configuration file read as follows:
[0129]
[0130] Based on the configuration item android:resizsableUIMode="2,3,5" in the above configuration file, the application layer of the smart screen can determine that the video has been adapted to mode ②, mode ③, and mode ⑤. Afterwards, the application layer of the smart screen determines the split-screen layout adapted to the video based on the modes included in all split-screen layouts supported by the smart screen, that is, split-screen layout 2, split-screen layout 3, split-screen layout 4, and split-screen layout 6 are split-screen layouts adapted to the video.
[0131] Similarly, take the target application as the above-mentioned email as an example. The application layer of the smart screen can read the configuration file of the video. According to the example in S705, the email has not been adapted to any split-screen layout, or has not been adapted to any mode. Therefore, the configuration item in the configuration file read is specifically: android:resizsableUIMode="". The application layer of the smart screen can determine that the email has not been adapted to any split-screen layout.
[0132] As another example, the adaptation information may be the size of the adapted split-screen display area, that is, the size of the adapted split-screen display area may be used to indicate the split-screen layout adapted for the application. That is, if the developer pre-designs a split-screen interface for the application for a split-screen display area of a certain size, the size of the split-screen display area may be used to indicate that the split-screen layout including the split-screen display area of the size is the split-screen layout adapted for the application.
[0133] To simplify the description, a split-screen display area of a certain size can be called a mode. Continuing with the example in S705 above, the video developer designed corresponding split-screen interfaces for the video for mode ②, mode ③ and mode ⑤, respectively. Therefore, the adaptation information may include the size of mode ②, the size of mode ③ and the size of mode ⑤, which is used to indicate that the video is adapted to split-screen layout 2, split-screen layout 3, split-screen layout 4 and split-screen layout 6. Among them, the size of the mode, or the size of the split-screen display area, can be represented by the proportion of the split-screen display area in the width and height directions of the display screen. Continuing with the example of the application configuration file being the Manifest.xml file. Application developers can add configuration items in the Manifest.xml file, and the configuration items include the size of the mode adapted by the application, which is used to indicate the split-screen layout adapted by the application.
[0134] As an implementation method, the configuration items can be specifically:
[0135] android:resizeableWidthRatio="*" / / indicates the ratio of the split-screen display area in the width direction of the display screen. For example, 1 / 2 indicates that the split-screen display area occupies 1 / 2 of the width of the display screen in the width direction.
[0136] android:resizeableHeightRatio="*" / / Indicates the ratio of the split-screen display area to the height of the display. For example, 1 / 1 means that the height is the same as the display, or the height is fully occupied.
[0137] If multiple modes have been adapted, the sizes of different modes can be separated by ",", and the parameters in resizeableWidthRatio and resizeableHeightRatio correspond one to one, and the two parameters in the corresponding positions correspond to the size of a split-screen display area (or the size of a mode). If no mode has been adapted, the "*" is empty, but this embodiment is not limited to this.
[0138] For example, the above video is adapted to mode ②, mode ③ and mode ⑤, the size of mode ② is (1 / 3, 1 / 1), the size of mode ③ is (2 / 3, 1 / 1) and the size of mode ⑤ is (2 / 3, 1 / 2), then the configuration item can be android:resizeableWidthRatio="1 / 3, 2 / 3, 2 / 3", android:resizeableHeightRatio="1 / 1, 1 / 1, 1 / 2". For another example, an application is adapted to mode ①, the size of mode ① is (1 / 2, 1 / 1), then the configuration item can be android:resizeableWidthRatio="1 / 2", android:resizeableHeightRatio="1 / 1". For another example, an application is not adapted to any mode, then the configuration item can be android:resizeableWidthRatio="", android:resizeableHeightRatio="".
[0139] Based on the above, after the application layer of a smart screen, such as a smart screen, receives the user's selection operation on the target application, the application layer of the smart screen, such as a smart screen, can read the configuration file of the target application to obtain the adaptation information of the target application from the configuration file. Take the target application as the above video as an example. The application layer of the smart screen can read the configuration file of the video. Taking the configuration items read from the configuration file as android:resizeableWidthRatio="1 / 3, 2 / 3, 2 / 3", android:resizeableHeightRatio="1 / 1, 1 / 1, 1 / 2" as an example, the application layer of the smart screen can determine the sizes of the modes adapted to the video based on the configuration items as (1 / 3, 1 / 1), (2 / 3, 1 / 1) and (2 / 3, 1 / 2). Among them, since the size of mode ② is (1 / 3, 1 / 1), the size of mode ③ is (2 / 3, 1 / 1), and the size of mode ⑤ is (2 / 3, 1 / 2), the application layer of the smart screen can determine that the video has been adapted to mode ②, mode ③ and mode ⑤. Afterwards, the application layer of the smart screen can determine the split-screen layout adapted for the video based on the modes included in all split-screen layouts supported by the smart screen, namely split-screen layout 2, split-screen layout 3, split-screen layout 4 and split-screen layout 6.
[0140] Similarly, take the target application as the above-mentioned email as an example. The application layer of the smart screen can read the configuration file of the video. According to the example in S705, the email has not been adapted to any split-screen layout, or has not been adapted to any mode. Therefore, the configuration items in the configuration file read are specifically android:resizeableWidthRatio="", android:resizeableHeightRatio="". The application layer of the smart screen can determine that the email has not been adapted to any split-screen layout.
[0141] As another implementation method, the configuration items may specifically be:
[0142] android:resizeableUIMode="*" / / Indicates the proportion of the split-screen display area in the width and height directions of the display screen. For example, 2 / 1 means that the width of the display screen is divided into 2 equal parts and the height is divided into 1 equal part, where the split-screen display area occupies 1 equal part in width and 1 equal part in height of the display screen. In other words, the width of the split-screen display area occupies 1 / 2 of the width of the display screen and the height is fully occupied.
[0143] For example, if an application is adapted to mode ①, the size of mode ① is that the width occupies 1 / 2 of the width of the display screen and the height occupies the entire height, then the specific configuration item can be android:resizeableUIMode="2 / 1". Other split-screen layouts are similar and will not be repeated here.
[0144] Of course, other forms of adaptation information can also be used to indicate the split-screen layout adapted by the application, such as different split-screen layouts have different identifiers. If the developer designs different split-screen interfaces for the application based on different split-screen layouts, the adaptation information can also be the identifier of the split-screen layout. The specific implementation is similar to the aforementioned adaptation information as the identifier of the split-screen display area, and will not be described in detail here.
[0145] In other embodiments of the present application, the adaptation information may be included in a whitelist. The whitelist is used to record the split-screen layout adapted for the applications contained in electronic devices, such as smart screens. In other words, the whitelist contains the identification of the application (such as the name or package name of the application) and the identification or size of the adapted split-screen display area. The implementation method of the specific adaptation information is similar to the implementation method of the adaptation information contained in the configuration file mentioned above.
[0146] For example, the application identifier is used as the package name of the application, and the identifier of the mode corresponding to the split-screen display area is used to represent the split-screen layout adapted by the application, and the identifiers of mode ① to mode ⑦ are 1 to 7 respectively. The whitelist can be specifically shown in Table 1 below:
[0147] Table 1
[0148]
[0149] Based on Table 1, after receiving the selection operation in S705, the smart screen, such as the application layer of the smart screen, can obtain the whitelist to determine the split-screen layout adapted to the selected target application. For example, if the target application includes a video, then according to the identifier of the mode corresponding to the package name of the video in the whitelist shown in Table 1, it can be determined that the video has been adapted to mode ②, mode ③ and mode ⑤. Afterwards, the application layer of the smart screen determines that the video has been adapted to split-screen layout 2, split-screen layout 3, split-screen layout 4 and split-screen layout 6 based on the modes included in all split-screen layouts supported by the smart screen. For another example, if the target application includes a calculator, then according to the identifier of the mode corresponding to the package name of the calculator in the whitelist shown in Table 1, it can be determined that the calculator has been adapted to mode ①, mode ②, mode ③, mode ④, mode ⑤, mode ⑥ and mode ⑦. Afterwards, the application layer of the smart screen determines that the calculator has been adapted to all split-screen layouts based on the modes included in all split-screen layouts supported by the smart screen.
[0150] For another example, the identifier of the application is the package name of the application, and the size of the corresponding mode of the split-screen display area is used to represent the split-screen layout adapted by the application. The whitelist can be specifically shown in Table 2 below:
[0151] Table 2
[0152]
[0153] Similarly, based on Table 2, the smart screen, such as the application layer of the smart screen, can determine the split-screen layout adapted to the target application selected by the user based on the obtained whitelist. For example, if the target application includes a video, the size of the split-screen display area adapted for the video can be determined according to the whitelist shown in Table 2 as (1 / 3, 1 / 1), (2 / 3, 1 / 1) and (2 / 3, 1 / 2). Furthermore, based on the size of mode ② being (1 / 3, 1 / 1), the size of mode ③ being (2 / 3, 1 / 1), and the size of mode ⑤ being (2 / 3, 1 / 2), the application layer of the smart screen can determine that the video has been adapted to mode ②, mode ③ and mode ⑤, thereby determining that the video has been adapted to split-screen layout 2, split-screen layout 3, split-screen layout 4 and split-screen layout 6.
[0154] It should be noted that for applications that have not been adapted to any split-screen layout, or in other words, have not been adapted to any mode (such as email), as shown in Tables 1 and 2, the identifier / size of the mode corresponding to its identifier in the whitelist may be empty. In this way, the smart screen can determine that the application has not been adapted to any split-screen layout when it is determined that the identifier / size of the mode corresponding to the identifier of the application in the whitelist is empty. Alternatively, for applications that have not been adapted to any split-screen layout, or in other words, have not been adapted to any mode, its identifier may not be included in the whitelist. In this way, the smart screen can determine that the application has not been adapted to any split-screen layout when it is determined that the identifier of an application is not included in the whitelist.
[0155] Of course, Table 2 above only shows a method of describing the size of a pattern. Other methods may also be used to represent the size of a pattern. For details, please refer to the description of the corresponding content in the above embodiment, which will not be repeated here.
[0156] It should be noted that the whitelist shown in the table above is only an example. The whitelist can be embodied in any form as long as it can represent the correspondence between the application and the mode it is adapted to. The embodiment of the present application does not impose any specific restrictions on the form of the whitelist.
[0157] In the embodiment of the present application, the above whitelist can be stored in an electronic device (such as a storage device of the electronic device) or obtained from a server (such as an operation backend server). In other words, the smart screen, such as the application layer of the smart screen, can obtain the whitelist from its own storage device or from a server such as the cloud. The embodiment of the present application does not specifically limit the specific method of obtaining the whitelist.
[0158] S707. The smart screen displays a split-screen layout list based on the adaptation information of each target application among the multiple target applications obtained.
[0159] Among them, the split-screen layout list is used to display the preview image of the split-screen layout, that is, the split-screen layout list may contain one or more preview images of the split-screen layout. Among them, the preview image of the split-screen layout can be obtained according to the number of target applications selected by the user (or the number of split screens indicated by the split-screen template selected by the user) and the adaptation information of the selected target application. In other words, the smart screen, such as the application layer of the smart screen, can obtain the preview image of the split-screen layout according to the number of target applications selected by the user and the adaptation information of the selected target application that needs to be displayed in split screen, and display it in the form of a split-screen layout list. Among them, the preview image of the split-screen layout can reflect the number of split screens, as well as the position and size of each split-screen display area. Further optionally, the preview image of the split-screen layout can also reflect which target application interface each split-screen display area is used to display.
[0160] In some embodiments of the present application, the split-screen layout list may include at least one preview image of a first split-screen layout, and / or at least one preview image of a second split-screen layout.
[0161] Among them, the first split-screen layout is an electronic device, such as a split-screen layout supported by a smart screen, which satisfies the following conditions: the number of split-screens corresponding to the split-screen layout is the same as the number of target applications, and there are applications in multiple target applications that are adapted to the split-screen layout. The first split-screen layout can be understood as a split-screen layout recommended for users. In other words, a smart screen, such as the application layer of a smart screen, can determine at least one recommended split-screen layout from the split-screen layouts supported by the smart screen based on the adaptation information of each target application in multiple target applications and the number of target applications, and display a preview image of the at least one recommended split-screen layout to the user through a split-screen layout list.
[0162] For example, the target application includes two applications, namely application 1 and application 2. Fig.11 , an example is given to illustrate how to determine the first split-screen layout.
[0163] Table 3
[0164] Application 1 Application 2 Recommended split-screen layout Not adapted Adaptation mode ① Split screen layout 1 Adaptation mode ② Not adapted Split screen layout 2 Adaptation mode ① Adaptation mode ① Split screen layout 1 Adaptation mode ③ Adaptation mode ② Split screen layout 2 Adaptation mode ① Adaptation mode ② Split Screen Layout 1 and Split Screen Layout 2
[0165] Smart screens, such as the application layer of smart screens, can first determine the candidate split-screen layouts from the split-screen layouts supported by the smart screen according to the number of target applications. Among them, the number of split screens corresponding to the candidate split-screen layouts is the same as the number of target applications. For example, if the number of target applications is 2, the candidate split-screen layouts include split-screen layout 1 and split-screen layout 2. In addition, smart screens, such as the application of smart screens, can determine the split-screen layouts adapted for each target application based on the adaptation information of the target application obtained in S706. Afterwards, the smart screen, such as the application layer of the smart screen, determines at least one recommended split-screen layout from the candidate split-screen layouts, such as split-screen layout 1 and split-screen layout 2, based on the split-screen layout adapted for each target application in multiple target applications.
[0166] For example, based on Table 3, when the adaptation information of application 1 indicates that application 1 has not been adapted to any mode, and the adaptation information of application 2 indicates that application 2 has been adapted to a mode, such as mode ①, it can be determined that application 1 has not been adapted to any split-screen layout, and application 2 has been adapted to split-screen layout 1. Therefore, it can be determined that there is an application in application 1 and application 2, that is, application 2 is adapted to split-screen layout 1. In this way, a smart screen, such as the application layer of a smart screen, can determine that the recommended split-screen layout is split-screen layout 1. Similarly, when the adaptation information of application 1 indicates that application 1 has been adapted to mode ②, and the adaptation information of application 2 indicates that application 2 has not been adapted to any mode, it can be determined that application 1 has been adapted to split-screen layout 2, and application 2 has not been adapted to any split-screen layout. Therefore, it can be determined that there is an application in application 1 and application 2, that is, application 1 is adapted to split-screen layout 2, and the recommended split-screen layout can be determined to be split-screen layout 2. Similarly, when the adaptation information of application 1 indicates that application 1 has been adapted to mode ①, and the adaptation information of application 2 indicates that application 2 has been adapted to mode ①, it can be determined that application 1 has been adapted to split-screen layout 1, and application 2 has been adapted to split-screen layout 1, that is, it can be determined that there is an application in application 1 and application 2, that is, application 1 and application 2 are adapted to split-screen layout 1, and the recommended split-screen layout can be determined to be split-screen layout 1. For another example: when the adaptation information of application 1 indicates that application 1 has been adapted to mode ③, and the adaptation information of application 2 indicates that application 2 has been adapted to mode ②, it can be determined that application 1 has been adapted to split-screen layout 2, and application 2 has been adapted to split-screen layout 2, that is, it can be determined that there is an application in application 1 and application 2, that is, application 1 and application 2 are adapted to split-screen layout 2, and the recommended split-screen layout can be determined to be split-screen layout 2.
[0167] When the adaptation information of application 1 indicates that application 1 has been adapted to mode ①, and the adaptation information of application 2 indicates that application 2 has been adapted to mode ②, it can be determined that application 1 has been adapted to split-screen layout 1, and application 2 has been adapted to split-screen layout 2, that is, it can be determined that there are applications in application 1 and application 2 that are adapted to split-screen layout 1, and there are applications that are adapted to split-screen layout 2. At this time, the application layer of the smart screen can determine that the recommended split-screen layouts are split-screen layout 1 and split-screen layout 2. In other words, when there are multiple candidate split-screen layouts and all of them have applications that have been adapted to them, these multiple candidate split-screen layouts can be used as recommended split-screen layouts.
[0168] For example, in combination with the example in S706 above, the number of target applications is 2, specifically video and email, video has been adapted to split-screen layout 2, split-screen layout 3, split-screen layout 4 and split-screen layout 6, and email has not been adapted to any split-screen layout, then it can be determined that among the candidate split-screen layouts, no application is adapted to split-screen layout 1, and there is an application, namely, video, which is adapted to split-screen layout 2, then the first split-screen layout, namely, the recommended split-screen layout, can be determined to be split-screen layout 2. Fig.12As shown, the smart screen, such as the application layer of the smart screen, can display a split-screen layout list 1201, which includes a preview image 1202 of split-screen layout 2. Among them, it can be seen that the preview image 1202 of split-screen layout 2 reflects that the number of split screens is 2, and the size of the left split-screen display area is 2 / 3 of the width of the display screen in the width direction and the full display screen in the height direction, and the size of the right split-screen display area is 1 / 3 of the width of the display screen in the width direction and the full display screen in the height direction. The preview image 1202 of split-screen layout 2 also reflects that the left split-screen display area is used to display the interface of the video, and the right split-screen display area is used to display the interface of the email. In an embodiment of the present application, the second split-screen layout includes one or more of the following split-screen layouts: a split-screen layout other than the first split-screen layout among the split-screen layouts supported by the electronic device and having the same number of corresponding split-screens as the number of target applications (which may be referred to as a non-recommended split-screen layout); a split-screen layout in the historical split-screen layout having the same number of corresponding split-screens as the number of target applications; a split-screen layout in the split-screen layout saved by the electronic device having the same number of corresponding split-screens as the number of target applications.
[0169] Among them, in an electronic device, such as a split-screen layout supported by a smart screen, where the number of corresponding split-screens is the same as the number of target applications, the split-screen layouts other than the first split-screen layout are the split-screen layouts other than the recommended split-screen layouts in the above-mentioned candidate split-screen layouts, or in other words, the second split-screen layout is a split-screen layout supported by a smart screen, where the number of corresponding split-screen layouts is the same as the number of target applications, and there is no split-screen layout that is compatible with the split-screen layout. Exemplarily, based on Table 3, taking the example that the target applications include application 1 and application 2, the candidate split-screen layouts include split-screen layout 1 and split-screen layout 2, then corresponding to the first row of examples in Table 3, the second split-screen layout may include split-screen layout 2. Other examples are similar and will not be described in detail.
[0170] Continue to combine Fig.12 In the example shown, the smart screen, such as the application layer of the smart screen, can also determine that the second split-screen layout is split-screen layout 1, and the displayed split-screen layout list 1201 can also include a preview image 1203 of split-screen layout 1. Among them, similar to the preview image of split-screen layout 2, the preview image 1203 of split-screen layout 1 reflects the number of split screens, the position and size of the split-screen display area. The preview image 1203 of split-screen layout 1 also reflects which target application interface the split-screen display area is specifically used to display.
[0171] In addition, the second split-screen layout also includes a split-screen layout in which the number of corresponding split screens in the historical split-screen layout is the same as the number of target applications; in the case of a split-screen layout in which the number of corresponding split screens in the split-screen layout saved by the electronic device is the same as the number of target applications, the user can not only learn about the split-screen layout recommended by the smart screen through the split-screen layout list, but also learn about the split-screen layouts that have been used or saved historically, which can better meet the user's personalized needs.
[0172] It can be understood from the previous description that the first split-screen layout and the second split-screen layout are determined at least according to whether there is an application in a plurality of target applications that is adapted to the split-screen layout. Therefore, the split-screen layout list may only include a preview image of the first split-screen layout, such as for each candidate split-screen layout in the candidate split-screen layout, there is a target application adapted to it. The split-screen layout list may also only include a preview image of the second split-screen layout, such as for each candidate split-screen layout in the candidate split-screen layout, there is no target application adapted to it. The split-screen layout list may also include both a preview image of the first split-screen layout and a preview image of the second split-screen layout, such as for some candidate split-screen layouts in the candidate split-screen layout, there is a target application adapted to it, and for other candidate split-screen layouts, there is no target application adapted to it. That is, the split-screen layout list may include only preview images of recommended split-screen layouts, or only preview images of non-recommended split-screen layouts, or both preview images of recommended split-screen layouts and preview images of non-recommended split-screen layouts.
[0173] In some embodiments, the number of split-screen layouts allowed to be displayed to the user through the split-screen layout list can be predefined, such as the number allowed to be displayed is k. The smart screen can first determine the candidate split-screen layouts from the split-screen layouts supported by the smart screen according to the number of target applications. Among them, the number of split screens corresponding to the candidate split-screen layout is the same as the number of target applications. After obtaining the candidate split-screen layouts, the candidate split-screen layouts can be sorted, and the topk candidate split-screen layouts can be selected to be displayed to the user through the split-screen layout list.
[0174] Among them, the candidate split screen layouts can be sorted according to the number of target applications that are adapted to each candidate split screen layout in the candidate split screen layouts. That is to say, the smart screen, such as the application layer of the smart screen, can determine the number of target applications that are adapted to each candidate split screen layout in the candidate split screen layouts according to the adaptation information of each target application in multiple target applications, and thus sort the candidate split screen layouts based on this.
[0175] For example, there are 4 candidate split-screen layouts, namely candidate split-screen layouts a to d. Assume that based on the adaptation information of the target application, it is determined that there are 3 target applications adapted to candidate split-screen layout a, 2 target applications adapted to candidate split-screen layout b, 1 target application adapted to candidate split-screen layout c, and there is no target application adapted to candidate split-screen layout d. That is, it can be determined that among the multiple candidate split-screen layouts, the number of target applications adapted to candidate split-screen layout a is the largest, followed by candidate split-screen layout b, and candidate split-screen layout c is the third, and the number of target applications adapted to candidate split-screen layout d is the least. Taking k as 2 as an example, the preview image of candidate split-screen layout a and the preview image of candidate split-screen layout b can be displayed to the user through the split-screen layout list. It can be understood that since both candidate split-screen layout a and candidate split-screen layout b have target applications adapted to them, the split-screen layouts displayed to the user in this example are all recommended split-screen layouts. Of course, as described above, continuing with the example of k being 2, if in the sorting, the two top2 candidate split-screen layouts do not have a target application that is adapted to them, then the split-screen layouts displayed to the user are both not recommended split-screen layouts. If in the sorting, one of the top2 candidate split-screen layouts has a target application that is adapted to it, and the other does not have a target application that is adapted to it, then the split-screen layouts displayed to the user are one recommended split-screen layout and the other not recommended split-screen layout.
[0176] Optionally, the split-screen layouts displayed to the user through the split-screen layout list can be displayed in order. As an example, the preview images of the split-screen layouts can be displayed in order according to the number of target applications adapted to each candidate split-screen layout in the candidate split-screen layouts to be displayed to the user.
[0177] Continuing with the above example, taking k as 3 as an example, the order of displaying the preview images of the split-screen layouts in the split-screen layout list is: the preview image of candidate split-screen layout a, the preview image of candidate split-screen layout b, and the preview image of candidate split-screen layout c.
[0178] Furthermore, in order to facilitate the user to know that the first split-screen layout is a recommended split-screen layout, the split-screen layout list may also include a second identifier displayed corresponding to the preview image of the first split-screen layout. That is, the second identifier is used to indicate that the corresponding split-screen layout is the recommended split-screen layout. In addition, for the first split-screen layout and the second split-screen layout, when there are multiple target applications where the application is not compatible with the split-screen layout, the split-screen layout list may also include a first identifier displayed corresponding to the preview image of the split-screen layout. That is, the first identifier is used to indicate that there are multiple target applications where the application is not compatible with the split-screen layout.
[0179] Continue to combine Fig.12In the example shown, the first mark is a black border and the second mark is the word "preferred". As described in the above example, split screen layout 2 is the recommended split screen layout. Fig.12 As shown, the split-screen layout list 1201 also includes the word "preferred" 1204 displayed corresponding to the preview image 1202 of split-screen layout 2, which is used to indicate that split-screen layout 2 is the recommended split-screen layout. As for emails, since they have not been adapted to any split-screen layout of the smart screen, there are applications that are incompatible with split-screen layout 1 and recommended split-screen layout 2. Therefore, the split-screen layout list 1201 also includes upper and lower black borders 1205 displayed corresponding to the preview image 1203 of split-screen layout 1, and upper and lower black borders displayed corresponding to the preview image 1202 of split-screen layout 2, which are used to indicate that there are applications in split-screen layout 2 and split-screen layout 1 that are incompatible with the split-screen layouts. It should be noted that if there is no application in the recommended split-screen layout that is incompatible with it, only the second mark will be displayed corresponding to the preview image of the recommended split-screen layout, and the first mark will not exist. In addition, Fig.12 The specific display method of the first logo and the second logo is only used as an example of the display method of the two logos, and the embodiment of the present application does not specifically limit the specific display method of the first logo and the second logo.
[0180] S708. The smart screen receives the user's selection operation on the preview image of the target split-screen layout in the split-screen layout list.
[0181] S709. In response to the selection operation in S708, the smart screen displays the split-screen interfaces of multiple target applications on the display screen according to the target split-screen layout.
[0182] After the smart screen displays the split-screen layout list, the user can select the split-screen layout they want to use in the split-screen layout list, such as the target split-screen layout. For example, the user can select the preview image of the target split-screen layout in the split-screen layout list. Afterwards, the smart screen, such as the application layer of the smart screen, can receive the user's selection operation on the preview image of the target split-screen layout. In response to the selection operation, the smart screen can display the split-screen interfaces of multiple target applications selected by the user on the display screen according to the target split-screen layout.
[0183] In some embodiments, after receiving the user's operation on the preview image of the target split screen layout, the smart screen can not only display the target split screen layout according to the target split screen layout, but also save the target split screen layout selected by the user for subsequent use. In some other embodiments, only the target split screen layout selected by the user can be saved without executing S709.
[0184] It should be noted that the selection operation of the preview image of the target split-screen layout in this embodiment may be the second operation in the embodiment of the present application, which is similar to the operation in S701, and the user's selection operation of the preview image of the target split-screen layout may also be any form of operation.
[0185] For example, combined with Fig.12 In the example shown, the target split screen layout selected by the user is split screen layout 2, that is, the application layer of the smart screen receives the user's selection operation on the preview image 1202 of split screen layout 2. In response, Fig.13 As shown, the smart screen can display a split-screen interface of the video and a split-screen interface of the email on the display screen of the smart screen.
[0186] It can be understood that in this embodiment, among the multiple target applications, there may be applications that have been adapted to the target split-screen layout, such as the video in the above example, and there may also be applications that have not been adapted to the target split-screen layout, such as the email in the above example. For applications that have been adapted to the target split-screen layout, a smart screen, such as the application layer of a smart screen, can pull up the application through the system split-screen interface to display the split-screen interface of the application on the display screen of the smart screen. For applications that have not been adapted to the target split-screen layout, such as the so-called first application, the embodiments of the present application provide two ways to realize the display of the split-screen interface of the application on the display screen.
[0187] Method 1: The system layer of an electronic device, such as a smart screen, can render the split-screen interface of an incompatible application. Fig.14 As shown in the figure, when an unsuitable application, such as the first application, is pulled up in split screen, the application layer of the smart screen sets the position and size of the split screen display area of the first application, and a mark indicating that the split screen layout is not adapted to the system layer. The system layer determines that the first application is not adapted by the mark, and then renders the split screen interface of the first application in proportion to the corresponding split screen display area according to the full screen aspect ratio after layer synthesis.
[0188] Specifically: After the application layer of an electronic device, such as a smart screen, receives the user's selection operation on the target split-screen layout, the split-screen parameters can be transmitted to the system layer of the smart screen. Among them, the split-screen parameters may include: the position and size of the split-screen display area for displaying the split-screen interface of the first application, and marking information, and the marking information is used to indicate that the first application is not adapted to the split-screen layout. Afterwards, the system layer of the smart screen determines the scaling ratio based on the marking information, the size of the split-screen display area, and the size of the display screen. After determining the scaling ratio, the system layer of the smart screen can scale the interface of the predefined first application and display it on the display screen according to the scaling ratio and the position of the split-screen display area. In other words, for the unadapted first application, when the application layer of the smart screen pulls up the first application through the system split-screen interface, the marking information indicating that the first application is not adapted to the split-screen layout can be transmitted to the system layer, so that the system layer can determine the scaling ratio and implement the rendering of the split-screen interface of the first application based on the scaling ratio.
[0189] In some embodiments, an interface function may be added to indicate whether the application is adapted to the split-screen layout, that is, the marking information is implemented in the form of an interface function. TM Taking the system as an example, you can add the interface function setLaunchRatioAdaptionFlag(booluiNotAdapted) in ActivityOptions to indicate whether the application is adapted to the split-screen layout. For example, the value of bool uiNotAdapted can be a first value and a second value, such as true and false. The first value, such as true, is used to indicate that the application is not adapted to the split-screen layout. The second value, such as false, is used to indicate that the application is adapted to the split-screen layout.
[0190] For example, Android TM The split screen in the system includes split screen mode and free window mode.
[0191] If the first application is launched in split-screen mode, the split-screen parameters transmitted by the application layer to the system may specifically include, or in other words, the parameters included when calling the system split-screen interface include:
[0192] options.setLaunchWindowingMode, used to set the primary and secondary screen applications. If the value is 3, it means that the first application is set as the primary screen application. If the value is 4, it means that the first application is set as the secondary screen application.
[0193] options.setLaunchBounds, used to set the position and size of the split-screen display area for displaying the split-screen interface of the first application;
[0194] options.setLaunchRatioAdaptionFlag(true), used to indicate that the first application is not adapted to the split-screen layout;
[0195] StartActivity(intent,options.toBundle()) is used to launch the first application.
[0196] If the first application is launched in the free window mode, the split screen parameters transmitted by the application layer to the system may specifically include, or in other words, the parameters included when calling the system split screen interface include:
[0197] setLaunchWindowingMode, the value is 5, which is used to indicate that the split screen is in free window mode;
[0198] setLaunchBounds, used to set the position and size of the split-screen display area for displaying the split-screen interface of the first application;
[0199] options.setLaunchRatioAdaptionFlag(true), used to indicate that the first application is not adapted to the split-screen layout;
[0200] StartActivity(intent,options.toBundle()) is used to launch the first application.
[0201] In this way, after the system layer of the smart screen receives the corresponding split-screen parameters, it can determine to pull up the first application based on the split-screen parameters, and determine that the first application is not adapted to the split-screen layout. The position and size of the split-screen display area used to display the split-screen interface of the first application can also be determined based on the split-screen parameters. The system layer of the smart screen can determine the scaling ratio based on the proportion of the width of the split-screen display area in the width of the display screen and the proportion of the height of the split-screen display area in the height of the display screen. Afterwards, the system layer can scale the predefined interface of the first application in proportion to the determined scaling ratio as the split-screen interface of the first application, and render it on the display screen according to the position of the split-screen display area. The predefined interface of the first application can be an interface designed according to the size of the display screen.
[0202] As an example, the scaling ratio may be the product of the ratio of the width of the split-screen display area for displaying the split-screen interface of the first application to the width of the display screen and the ratio of the height of the split-screen display area to the height of the display screen. Fig.12In the example shown, taking the case where the user selects split-screen layout 2 as the target split-screen layout, since the email is not adapted to the split-screen layout 2, the scaling ratio needs to be determined based on the split-screen display area used to display the email split-screen interface, such as the ratio of the width of the split-screen display area on the right side of split-screen layout 2 to the width of the display screen and the ratio of the height of the split-screen display area to the height of the display screen. For example, the split-screen display area occupies 1 / 3 of the width of the display screen in the width direction, that is, the width of the split-screen display area accounts for 1 / 3 of the width of the display screen, and 1 / 1 of the height of the display screen in the height direction, that is, the height of the split-screen display area accounts for 1 / 3 of the height of the display screen, thereby determining the scaling ratio to be 1 / 3. Furthermore, the system layer of the smart screen can scale the predefined email interface according to the scaling ratio of 1 / 3 and then display it.
[0203] Method 2: The application layer of an electronic device, such as a smart screen, can render the split-screen interface of an incompatible application. Fig.15 As shown, the application layer of the smart screen can call the system interface to trigger the system layer to create a virtual screen and pull up an unmatched application, such as the first application, on the virtual screen. After that, the screen data on the virtual screen, that is, the interface of the first application, is called back to the application layer. When the screen is split, the application layer scales the interface of the first application on the virtual screen in proportion to the full screen aspect ratio through off-screen rendering, and then renders it as the split-screen interface of the first application into the corresponding split-screen display area.
[0204] Specifically, after the application layer of an electronic device, such as a smart screen, receives the user's selection operation on the target split-screen layout, the split-screen parameters can be transmitted to the system layer of the smart screen. Among them, the split-screen parameters may include: the position and size of the split-screen display area for displaying the split-screen interface of the first application, and marking information, and the marking information is used to indicate that the first application is not adapted to the split-screen layout. Afterwards, the system layer of the smart screen determines the scaling ratio based on the marking information, the size of the split-screen display area, and the size of the display screen. After determining the scaling ratio, the system layer of the smart screen can scale the interface of the predefined first application and display it on the display screen according to the scaling ratio and the position of the split-screen display area. In other words, for the unadapted first application, when the application layer of the smart screen pulls up the first application through the system split-screen interface, the marking information indicating that the first application is not adapted to the split-screen layout can be transmitted to the system layer, so that the system layer can determine the scaling ratio and implement the rendering of the split-screen interface of the first application based on the scaling ratio.
[0205] After the application layer of an electronic device, such as a smart screen, receives the user's selection operation for the target split-screen layout, the system layer of the electronic device can create a virtual screen in response to the instruction of the application layer of the smart screen. The size of the virtual screen is the same as the size of the split-screen display area used to display the split-screen interface of the first application. Afterwards, the application layer of the smart screen determines the scaling ratio based on the size of the split-screen display area and the size of the display screen. After determining the scaling ratio, the application layer of the smart screen synthesizes the predefined interface of the first application into the virtual screen according to the scaling ratio. Afterwards, the interface synthesized on the virtual screen can be displayed on the display screen according to the position of the split-screen display area.
[0206] As an example, the operating system of the smart screen is Android TM System as an example, Fig.16 As shown, the process of the application layer rendering the split-screen interface of the first application to the display screen in proportion is as follows: the application layer of the smart screen can instruct the system layer of the smart screen to create a virtual screen. For example, you can call createVirtualDisplay(VIRTUAL_DISPLAY_FLAG_OWN_CONTENT_ONLY) through MediaProject to create a virtual screen (VirtualDisplay). Among them, each virtual screen has a corresponding display id. After receiving the instruction, the system layer can create the corresponding virtual screen. In addition, the application layer can also create an intermediate texture, such as SurfaceTexture, and associate the virtual screen with the intermediate texture. That is, set SurfaceTexture to the created VirtualDisplay. Afterwards, the application layer can pull up the first application to the virtual screen, and based on the previous settings, the system layer can synthesize the layers of the first application to the virtual screen when rendering the interface of the first application. Afterwards, the application layer, such as the startActivity of the application layer, pulls up an empty application, and calls setLaunchBounds to set the position and size of the split-screen display area used to display the split-screen interface of the first application. Then, the application layer, such as the startActivity of the application layer, can render the image (i.e., screen data) on the virtual screen associated with SurfaceTexture into the above-mentioned split-screen display area by reducing the image in proportion to the full-screen aspect ratio through OpenGL, that is, calling back the screen data on the virtual screen associated with the intermediate texture to the application layer, and rendering it off-screen to the display screen.
[0207] In an embodiment of the present application, after the smart screen displays the split screen interfaces of multiple target applications on the display screen according to the target split screen layout, the user can adjust the split screen layout according to their own needs. Among them, the control for adjusting the layout of the split screen, such as the so-called window adjustment control, can be included in the split screen menu. Exemplarily, the smart screen, the application layer of the smart screen can receive an operation triggered by the user to display the split screen menu, such as the so-called third operation. In response to the third operation, such as Fig.17 As shown, the smart screen can display a split-screen menu 1701, which may include a window adjustment control 1702.
[0208] Further, after the split screen menu 1701 is displayed on the display screen, the user can adjust the layout of the split screen through the window adjustment control 1702 in the split screen menu 1701. Exemplarily, the smart screen, the application layer of the smart screen can receive the user's operation on the window adjustment control 1702. Such as the fourth operation. In response to the fourth operation, the smart screen can redisplay the split screen layout list, such as Fig.17 The user can reselect the split screen layout of the target application in the split screen layout list 1703. For example, in combination with Fig.12 In the example shown, the split-screen layout list 1703 includes a preview image of split-screen layout 1 and a preview image of split-screen layout 2. The user can select the new target split-screen layout as split-screen layout 1 in the redisplayed split-screen layout list 1703, that is, the application layer of the smart screen can receive the user's selection operation on the preview image of split-screen layout 1. In response, the smart screen can display the split-screen interface of the video and the split-screen interface of the email on the display screen of the smart screen according to split-screen layout 1, thereby adjusting the layout of the split screen. It should be noted that the third operation and the fourth operation in this embodiment are similar to the operations in S701, and these operations can also be operations of any form.
[0209] Fig.18 A schematic diagram of another split-screen display method provided in an embodiment of the present application. Fig.18 As shown, the method may include:
[0210] S1801. The smart screen displays the interface of at least one second application.
[0211] Among them, if the smart screen displays the interfaces of two or more second applications, it can be understood that the smart screen displays the interfaces of these two or more second applications in split screen, that is, it is currently in split screen mode. For example, take the example of a smart screen displaying the interfaces of two second applications, where the two second applications are video and email. The smart screen displays the interfaces of video and email, that is, the smart screen displays the interface of video and email in split screen. If the smart screen displays the interface of a second application, it can be understood that the smart screen is currently displaying the application in full screen and has not entered split screen mode.
[0212] S1802. The smart screen receives an operation from the user to trigger split-screen display.
[0213] In the embodiment of the present application, if the user wants to use other applications at the same time while using at least one second application, the operation of triggering split-screen display can be performed. Exemplarily, the operation of triggering split-screen display in this embodiment is similar to the operation in S701 and can be any form of operation.
[0214] For example, if the display screen of the smart screen has a touch function, a specific control displayed on the display screen of the smart screen is touched to trigger the smart screen to display in split screen. Among them, different from the specific control in S701, the specific control in S1802 is called a dynamic split screen control, and it is included in the split screen menu. It can be considered that the dynamic split screen control is provided to the user in the form of a secondary menu, and the split screen menu can be considered as a primary menu. Fig.19 As shown, the user can trigger the smart screen to display a split-screen menu 1901 by performing corresponding operations. The split-screen menu 1901 includes one or more controls for split-screen display control, such as the above-mentioned dynamic split-screen control 1902. After that, the user can touch the controls displayed on the display screen to trigger the smart screen to implement the corresponding function. For example, the user touches the dynamic split-screen control 1902. Correspondingly, the smart screen, such as the application layer of the smart screen, can receive the user's touch operation on the dynamic split-screen control 1902, that is, receive the user's operation to trigger the split-screen display.
[0215] After the smart screen receives the user's operation to trigger the split-screen display, in response, the smart screen, such as the system layer of the smart screen, can display the split-screen interfaces of multiple target applications on the display screen of the smart screen according to the target split-screen layout. In some embodiments, the target split-screen layout and the target application can be selected by the user, such as the smart screen can provide a corresponding list for the user to select the application to be split and the split-screen layout to be used. Figure 7 In the illustrated embodiment, the target application includes the second application. As an example, the process can be implemented through the following S1803-S1808.
[0216] S1803. In response to the operation in S1802, the smart screen displays the logos of multiple applications.
[0217] Among them, the page used to display the identifiers of multiple applications can be called a dynamically added application page.
[0218] S1804. The smart screen receives a user's selection operation on the identifier of the application to be split-screen from among multiple application identifiers.
[0219] The multiple applications described in S1803 do not include the second application. For example, in combination with the example in S1801, the multiple applications do not include video and email, and the user can select other applications except video and email from the displayed multiple application identifiers to participate in the split-screen display.
[0220] S1805. In response to the selection operation in S1804, the smart screen obtains the adaptation information of the target application, and the adaptation information is used to indicate the split-screen layout adapted to the corresponding target application.
[0221] The target application includes the above-mentioned application to be split and the second application selected by the user. Moreover, the target application may include an application that is not adapted to the split-screen layout, which may be the above-mentioned second application or the above-mentioned application to be split.
[0222] S1806. The smart screen displays a split-screen layout list based on the acquired adaptation information of the target application.
[0223] Exemplary, continue to combine Fig.19 The example shown takes the number of target applications as 3 as an example. Based on the adaptation information of the target application obtained, the split screen layout list displayed by the smart screen can be Fig.19 The split screen layout list 1903 is shown in FIG.
[0224] S1807. The smart screen receives the user's selection operation on the preview image of the target split-screen layout in the split-screen layout list.
[0225] S1808. In response to the selection operation in S1807, the smart screen displays the split-screen interfaces of multiple target applications on the display screen according to the target split-screen layout.
[0226] It should be noted that the specific implementation of S1801-S1808 in this embodiment is similar to the specific implementation of the corresponding steps in S701-S709. The specific implementation can refer to the description of the corresponding steps in S701-S709, and this embodiment will not be repeated in detail here.
[0227] The technical solution provided by the embodiment of the present application, after receiving the user's operation to trigger the split-screen display, if the application participating in the split-screen display has not been adapted to the split-screen layout, the predefined interface of the application can be scaled by a determined scaling ratio and then split-screen display can be performed, so that the application that has not been adapted to the split-screen layout can participate in the split-screen display. In other words, the method provided by the embodiment of the present application supports the split-screen display of applications that have not been adapted to the current split-screen layout, so that all applications in the electronic device support split-screen display, and there is no need for the application developer to perform adaptation work for the application in advance, thereby reducing the application adaptation workload, improving the compatibility of the electronic device, and enhancing the user experience.
[0228] In addition, the electronic device can display a split-screen layout list including multiple split-screen layouts for the user to select a suitable split-screen layout based on the information of whether the target application selected by the user has been adapted for the split-screen layout, thereby improving the user's experience. In addition, in the split-screen layout list, the corresponding recommendation mark is displayed for the split-screen layout of the adapted application, making it easier for the user to select a split-screen layout with a better split-screen display experience. For the split-screen layout of the unadapted application, the unadapted mark can also be presented to the user for easy identification by the user, further improving the user's experience.
[0229] in, Fig. 20 The following is a comparison chart of the effects before and after the application scheme is adopted. Take the call application as an example. If the split-screen display function is not used, the interface of the call application can be as follows: Fig. 20 If the call application does not support split-screen display, or has not been adapted to a split-screen layout, if it is forced to be split-screen, the display effect will be as follows Fig. 20 (b) or Fig. 20 As shown in (c) in the figure. It can be seen that some function buttons cannot be displayed normally. However, by adopting the solution of the present application, such an application can be displayed in split screen. For example, by adopting the technical solution provided by the present application, the interface can be scaled according to the scaling ratio and then displayed, and the display effect can be as follows: Fig. 20 As shown in (d) in .
[0230] Some other embodiments of the present application also provide a computer storage medium, which may include computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the various steps executed by the electronic device (such as a smart screen) in the above embodiments.
[0231] Some other embodiments of the present application also provide a computer program product. When the computer program product runs on a computer, the computer executes the various steps performed by the electronic device (such as a smart screen) in the above embodiments.
[0232] Some other embodiments of the present application also provide a device having the function of implementing the behavior of the electronic device (such as a smart screen) in the above-mentioned embodiments. The function can be implemented by hardware, or it can be implemented by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above-mentioned functions, for example, an input unit or module, a display unit or module, and a processing unit or module. As an example, the input unit or module can execute the above-mentioned S701, S703, S705 and S708; the display unit or module can execute the above-mentioned S702, S704, S707 and S709; the processing unit or module can execute the above-mentioned S706. As an example, the input unit or module can execute the above-mentioned S1802, S1804 and S1807; the display unit or module can execute the above-mentioned S1801, S1803, S1806 and S1808; the processing unit or module can execute the above-mentioned S1805.
[0233] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.
[0234] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0235] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.
[0236] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0237] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), disk or optical disk and other media that can store program code.
[0238] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
Claims
1. A split-screen display method, characterized in that: Applied to an electronic device including a display screen, the method comprises: The electronic device receives a first operation by a user triggering split-screen display; In response to the first operation, the electronic device displays split-screen interfaces of multiple target applications on the display screen according to the target split-screen layout, the multiple target applications including a first application, and the first application is an application that is not adapted to the target split-screen layout; Among them, the split-screen interface of the first application is obtained after scaling the predefined interface of the first application according to a scaling ratio, and the scaling ratio is determined according to the ratio of the width of the split-screen display area used to display the split-screen interface of the first application in the target split-screen layout to the width of the display screen and the ratio of the height of the split-screen display area to the height of the display screen.
2. The method according to claim 1, characterized in that In response to the first operation, the electronic device displays split-screen interfaces of multiple target applications on the display screen according to the target split-screen layout, including: In response to the first operation, the electronic device displays a split-screen layout list, where the split-screen layout list is used to display a preview image of the split-screen layout; The electronic device receives a second operation by a user on the preview image of the target split-screen layout in the split-screen layout list; In response to the second operation, the electronic device displays the split-screen interfaces of the multiple target applications on the display screen according to the target split-screen layout; The split-screen layout list includes: at least one preview image of a first split-screen layout, and / or at least one preview image of a second split-screen layout; different split-screen layouts have different layout modes; The first split-screen layout is a split-screen layout that satisfies the following conditions among the split-screen layouts supported by the electronic device: the number of split-screens corresponding to the split-screen layout is the same as the number of the target applications, and there is an application among the multiple target applications that is compatible with the split-screen layout; The at least one second split-screen layout includes one or more of the following split-screen layouts: Among the split-screen layouts supported by the electronic device and corresponding to the same number of split-screens as the number of the target applications, a split-screen layout other than the first split-screen layout; A split-screen layout in which the number of corresponding split-screens in the historical split-screen layout is the same as the number of the target application; A split-screen layout in which the number of corresponding split-screens in the split-screen layout saved by the electronic device is the same as the number of the target applications.
3. The method according to claim 2, characterized in that For each of the at least one first split-screen layout and the at least one second split-screen layout: In the case that there is an application among the multiple target applications that is not compatible with the split-screen layout, the split-screen layout list further includes: a first identifier displayed corresponding to the preview image of the split-screen layout; The first identifier is used to indicate that there is an application among the multiple target applications that is not compatible with the split-screen layout.
4. The method according to claim 2 or 3, characterized in that: The split-screen layout list further includes: displaying a second identifier corresponding to the preview image of the first split-screen layout; The second identifier is used to indicate that the first split-screen layout is a recommended split-screen layout.
5. The method according to any one of claims 2 to 4, characterized in that: Before the electronic device displays the split-screen layout list, the method further includes: The electronic device obtains adaptation information of each target application among the multiple target applications, where the adaptation information is used to indicate a split-screen layout adapted for the corresponding target application; The electronic device determines the at least one first split-screen layout according to the adaptation information of each target application in the multiple target applications.
6. The method according to claim 5, characterized in that The adaptation information is contained in a configuration file corresponding to the target application; or, The adaptation information is included in a whitelist; the whitelist is used to record the split-screen layout adapted by the application included in the electronic device, and the whitelist is stored in the electronic device or obtained from a server.
7. The method according to claim 5 or 6, characterized in that: The split-screen layout includes multiple split-screen display areas; The adaptation information is an identifier corresponding to the adapted split-screen display area; or, the adaptation information is a size of the adapted split-screen display area.
8. The method according to any one of claims 2 to 7, characterized in that: After the electronic device displays the split-screen interfaces of the plurality of target applications on the display screen in split-screen according to the target split-screen layout in response to the first operation, the method further includes: The electronic device receives a third operation of a user triggering display of a split-screen menu; In response to the third operation, the electronic device displays a split-screen menu, wherein the split-screen menu includes a window adjustment control; The electronic device receives a fourth operation of the user on the window adjustment control; In response to the fourth operation, the electronic device redisplays the split-screen layout list for the user to reselect a target split-screen layout.
9. The method according to any one of claims 1 to 8, characterized in that The electronic device comprises an application layer and a system layer; The electronic device displays the split-screen interface of the first application on the display screen, including: The application layer of the electronic device transmits split-screen parameters to the system layer of the electronic device, where the split-screen parameters include: a position and a size of a split-screen display area for displaying a split-screen interface of the first application, and marking information, where the marking information is used to indicate that the first application is not adapted to the split-screen layout; The system layer of the electronic device determines the scaling ratio according to the marking information, the size of the split-screen display area and the size of the display screen; The system layer of the electronic device scales the predefined interface of the first application and displays it on the display screen according to the scaling ratio and the position of the split-screen display area.
10. The method according to any one of claims 1 to 8, characterized in that The electronic device comprises an application layer and a system layer; The electronic device displays the split-screen interface of the first application on the display screen, including: In response to an instruction from the application layer of the electronic device, the system layer of the electronic device creates a virtual screen, where the size of the virtual screen is the same as the size of the split-screen display area for displaying the split-screen interface of the first application; The application layer of the electronic device determines the scaling ratio according to the size of the split-screen display area and the size of the display screen; The application layer of the electronic device synthesizes the predefined interface of the first application onto the virtual screen according to the scaling ratio; The system layer of the electronic device displays the interface synthesized on the virtual screen on the display screen according to the position of the split-screen display area.
11. An electronic device, characterized in that: The electronic device comprises: a processor; a memory; and a computer program, wherein the computer program is stored in the memory, and when the computer program is executed by the processor, the electronic device executes the method according to any one of claims 1 to 10.
12. A computer-readable storage medium, characterized in that: The computer-readable storage medium comprises a computer program, and when the computer program is executed on an electronic device, the electronic device is enabled to execute the method according to any one of claims 1 to 10.