Interface display method and related device

Abstract

The invention provides an interface display method and a related device. The method comprises the steps that the terminal equipment displays a first interface comprising a first control corresponding to a first application; a second interface is displayed in response to a first operation for the first control, the second interface displays a first window of the first application in a full-screen mode, and the first window comprises a plurality of sub-columns; if the terminal equipment is of the first type, a first window in the second interface comprises a first sub-column to a third sub-column; if the terminal equipment is of a second type, the first window in the second interface comprises a second sub-column and a third sub-column and does not comprise the first sub-column; in response to a second operation used for indicating to switch to the floating window state, a third interface is displayed, and the first window in the third interface only comprises the second sub-column. An interface displayed by the terminal equipment can comprise a plurality of sub-columns to display more contents, so that a user can operate and browse conveniently; the number of columns displayed by the application interface is adjusted based on the device type and the window form, various terminal devices are adapted, and the user experience is improved.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to an interface display method and related devices. Background Art

[0002] The interface displayed by the terminal device is usually provided with multiple controls to facilitate the user to return to the previous page or browse the next page.

[0003] Taking the example that the first-level page is the previous page of the second-level page, and the third-level page is the next-level page of the second-level page, when the terminal device displays the second-level page, the first-level page can be displayed by selecting the control or returning the control; when the terminal device displays the second-level page, the third-level page can be displayed by the next-level control.

[0004] However, during the use of the terminal device, multiple user operations may be required to display the content that the user wants to browse, which is cumbersome and has a poor human-computer interaction experience. Summary of the invention

[0005] The embodiment of the present application provides an interface display method and related devices, which are applied to the field of terminal technology. The terminal device can display an interface with multiple columns to display more content, facilitate user operation and browsing, and improve user experience; the number and layout of columns displayed in the application interface can also be adjusted based on the device type and window form to adapt to a variety of terminal devices.

[0006] In the first aspect, the embodiment of the present application proposes an interface display method. The method includes: the terminal device displays a first interface, the first interface includes a first control; the terminal device receives a first operation for the first control; in response to the first operation, the terminal device displays a second interface, the second interface displays a first window corresponding to the first application in full screen, the first window includes: multiple columns; the first application corresponds to the first control; when the type of the terminal device is the first type, the first window in the second interface includes: a first column, a second column and a third column; or, when the type of the terminal device is the second type, the first window in the second interface includes: a second column and a third column, excluding the first column; the terminal device receives a second operation for indicating that the first window is switched to a floating window state; in response to the second operation, the terminal device displays a third interface, and the first window in the third interface includes: a second column, excluding the first column and the third column.

[0007] The first interface may correspond to the main interface of the terminal device, and the first control may correspond to the icon of the first application; the first interface may also correspond to the interface for setting the display mode of the first application, and the first control may also correspond to the control for selecting a multi-column display. The first operation may be a click operation or an operation of opening the first application by voice. The specific type and method of the first operation are not limited in the embodiments of the present application. The second interface may correspond to the following Figure 5A , Figure 5B The interface shown.

[0008] The second operation may be a click operation or an operation of opening the first application by voice. The specific type and method of the second operation are not limited in the present embodiment. Figure 5A , Figure 5B An interface with a floating window. In the floating window state, when the window is small, a column is displayed to reduce the clutter of the screen caused by too much content in the window, reduce accidental touches, and improve the user experience.

[0009] In this way, the interface displayed by the terminal device can include multiple columns to display more content, which is convenient for users to operate and browse; the number of columns displayed in the application interface can be adjusted based on the device type and window form to adapt to a variety of terminal devices and improve user experience

[0010] Optionally, when the type of the terminal device is the first type, the first window in the second interface includes: a first column, a second column and a third column, including: when the terminal device displays the first window in landscape mode, the second interface displays all the contents of the third column; when the terminal device displays the first window in portrait mode, the second interface displays part of the contents of the third column.

[0011] In this way, the display of the interface is adjusted based on the status of the terminal device. When the screen is displayed in landscape mode and the horizontal length is longer, all contents are displayed and the third column is fully displayed, which is convenient for user browsing; when the screen is displayed in portrait mode and the horizontal length is narrower, part of the contents is displayed and the third column is not fully displayed.

[0012] Optionally, the method further includes: when the terminal device displays the first window in portrait mode, a mask is suspended at the third column in the second interface, so that the brightness of the third column is lower than that of the second column.

[0013] In this way, the user can be prompted that the third column is not fully displayed.

[0014] Optionally, the second type of device includes a folding screen, and the number of columns displayed on the second interface is also related to the state of the folding screen in the terminal device; the method also includes: the terminal device receives a third operation to switch the form of the terminal device; in response to the third operation, the terminal device switches from an expanded state to a folded state, and the terminal device displays a fourth interface, and the first window in the fourth interface includes the second column, but does not include the first column and the third column.

[0015] The third operation may be a folding operation for the folding screen. The fourth interface may correspond to Figure 5B In this way, when the application window is narrow, a column is displayed to reduce the situation where the column is not fully displayed, reduce the situation of accidental touches, and improve the user experience.

[0016] Optionally, the terminal device displays a fifth interface, the fifth interface includes a second control, and the fifth interface is the same as the first interface; the terminal device receives a fourth operation for the second control, and the second control corresponds to the second application; in response to the fourth operation, the terminal device displays a sixth interface, and the sixth interface displays a second window corresponding to the second application in full screen, and the second window includes: multiple columns; the second application corresponds to the second control.

[0017] The fifth interface may correspond to the main interface of the terminal device, and the second control may correspond to the icon of the second application. The fourth operation may be a click operation or an operation of opening the second application by voice. The specific type and method of the fourth operation are not limited in the embodiment of the present application.

[0018] In this way, multiple applications in the terminal device can all be displayed in multiple columns.

[0019] Optionally, the terminal device includes: a column frame, which is used to confirm the layout of columns displayed by the terminal device; in response to a first operation, the terminal device displays a second interface, including: a first application calling the column frame in the terminal device; the column frame obtains first window information corresponding to the first application, and the first window information includes: the length of the first window in the horizontal direction, and the status of the first window; the column frame sends first layout information to the first application based on the first window information, and the first layout information is used to describe the layout of the second interface corresponding to the first application.

[0020] The first application can implement the layout of each column in the interface by calling the column framework.

[0021] Optionally, a third control is displayed in the first column of the second interface; the terminal device performs a fourth operation on the third control; in response to the fourth operation, the terminal device displays a seventh interface, the seventh interface including: a first column, a second column and a third column; the content displayed in the second column of the seventh interface is different from the content displayed in the second column of the second interface, the content displayed in the third column of the seventh interface is different from the content displayed in the third column of the second interface, and the content displayed in the second column of the seventh interface is related to the third control.

[0022] The third control may correspond to the classification item in the first column below; when the classification item selected by the user changes, the content displayed in the second column and the third column changes accordingly. Fig.10 The interface shown.

[0023] In this way, the contents displayed in the first sub-column, the second sub-column and the third sub-column are related, which facilitates the user to adjust the browsing content.

[0024] Optionally, the ratio of the second length in the second interface to the third length in the second interface is a first value; the second interface further includes a fourth control;

[0025] The method also includes: receiving a first drag operation for a fourth control; in response to the first drag operation, the terminal device displays an eighth interface, and the ratio of the second length in the eighth interface to the third length in the eighth interface is a second value; when the starting position and the end position of the first drag operation are different, the second value is different from the first value; when the starting position and the end position of the first drag operation are the same, the second value is the same as the first value.

[0026] The fourth control may correspond to the first adjustment control described below. The eighth interface may correspond to Fig. 9 The interface shown.

[0027] The terminal device can adjust the ratio of the second column and the third column based on user operations to improve the interactive experience.

[0028] Optionally, in response to a first drag operation, the terminal device displays an eighth interface, including: after the terminal device receives the first drag operation, the application transmits first information to the column frame, the first information carries coordinates corresponding to the drag operation; the column frame sends third layout information to the application based on the coordinates of the first drag operation, the third layout information is used to describe the layout of the eighth interface; the layout of the eighth interface is related to the coordinates of the first drag operation; the terminal device displays the eighth interface based on the third layout information.

[0029] Based on the user operation, the column framework redetermines the layout of each column based on the user operation.

[0030] Optionally, the second interface also includes: a fifth control; the terminal device receives a sixth operation on the fifth control; in response to the sixth operation, the terminal device displays a ninth interface, and the ninth interface does not display the first column.

[0031] The fifth control may correspond to the first retracted control. The ninth interface may correspond to Fig. 7A The fifth operation may be a click operation or other types of operations, which are not limited in the present embodiment. The first column may be adjusted to be collapsed based on the user operation to improve the user experience.

[0032] Optionally, in response to the sixth operation, the terminal device displays a ninth interface, including: after the terminal device receives the sixth operation, the application transmits a second message to the column frame, the second message is used to instruct the first column to be folded; the column frame sends fourth layout information to the application based on the second message, the fourth layout information is used to indicate that the second column and the third column are both moved toward the first column by a first length, and the third length is increased by the first length; the application displays a ninth interface based on the fourth layout information; wherein the second length corresponding to the ninth interface is the same as the second length corresponding to the second interface; the difference between the third length corresponding to the ninth interface and the third length corresponding to the second interface is the first length corresponding to the second interface.

[0033] When the first column is collapsed based on a user operation, it is achieved by moving the second column and the third column.

[0034] Optionally, the ninth interface displays a sixth control; the method also includes: receiving a sixth operation for the sixth control; in response to the sixth operation, the terminal device displays a tenth interface, and the tenth interface displays a first column, a second column and a third column.

[0035] The sixth control may correspond to the first expansion control. The tenth interface may correspond to Fig. 7A The sixth operation may be a click operation or other types of operations, which are not limited in the present embodiment. The expansion of the first column may be adjusted based on the user operation to improve the user experience.

[0036] Optionally, in response to the seventh operation, the terminal device displays the tenth interface, including: after the terminal device receives the seventh operation, the application transmits a third message to the column framework, the third message is used to instruct the expansion of the first column; the column framework sends fifth layout information to the application based on the third message, the fifth layout information is used to instruct the second column and the third column to move away from the first column by a first length, and the third length is reduced by the first length; the application displays the tenth interface based on the fifth layout information; wherein the second length corresponding to the tenth interface is the same as the second length corresponding to the second interface; the difference between the third length corresponding to the second interface and the third length corresponding to the tenth interface is the first length corresponding to the second interface.

[0037] When the first column is collapsed based on a user operation, it is achieved by moving the second column and the third column.

[0038] Optionally, the second interface also includes: a seventh control; the method also includes: the terminal device receives an eighth operation for the seventh control; in response to the eighth operation, the terminal device displays the eleventh interface, the eleventh interface displays the third column, and does not display the first column and the second column.

[0039] The seventh control may correspond to a full screen display control. The eleventh interface may correspond to Figure 7B The eighth operation may be a click operation or other types of operations, which are not limited in the present embodiment. The third column may be adjusted to full screen display based on the user operation to improve the user experience.

[0040] Optionally, in response to the eighth operation, the terminal device displays the eleventh interface, including: after the terminal device receives the eighth operation, the application transmits a fourth message to the column frame, the fourth message is used to indicate the full-screen display of the third column; the column frame sends sixth layout information to the application based on the fourth message, the sixth layout information is used to indicate that the third column moves in the direction of the first column by the first length and the second length, and the third column increases the first length and the second length; the application displays the eleventh interface based on the sixth layout information.

[0041] Optionally, the third column in the eleventh interface also includes: an eighth control; the terminal device receives a ninth operation for the eighth control; in response to the ninth operation, the terminal device displays the twelfth interface, and the twelfth interface displays the first column, the second column and the third column.

[0042] The eighth control may correspond to the exit full screen display control. The twelfth interface may correspond to Figure 7B The ninth operation may be a click operation or other types of operations, which are not limited in the present embodiment. Based on the user operation, the third column may be adjusted to exit the full screen display, thereby improving the user experience.

[0043] Optionally, in response to the ninth operation, the terminal device displays the twelfth interface, including: after the terminal device receives the ninth operation, the application transmits a fifth message to the column framework, the fifth message is used to indicate cancellation of the full-screen display of the third column; the column framework sends seventh layout information to the application based on the fifth message, the seventh layout information is used to indicate that the third column moves away from the first column by the first length and the second length, and the third column reduces the first length and the second length; the application displays the twelfth interface based on the sixth layout information.

[0044] Optionally, the first type of device includes: a tablet; the second type of device includes: a mobile phone with a foldable screen.

[0045] In a second aspect, an embodiment of the present application provides a terminal device, which may also be referred to as a terminal, user equipment (UE), mobile station (MS), mobile terminal (MT), etc. The terminal device may be a mobile phone, a smart TV, a wearable device, a tablet computer (Pad), a computer with wireless transceiver function, a virtual reality (VR) terminal device, an augmented reality (AR) terminal device, a wireless terminal in industrial control, a wireless terminal in self-driving, a wireless terminal in remote medical surgery, a wireless terminal in smart grid, a wireless terminal in transportation safety, a wireless terminal in smart city, a wireless terminal in smart home, etc.

[0046] The terminal device comprises: a processor and a memory; the memory stores computer-executable instructions; the processor executes the computer-executable instructions stored in the memory, so that the terminal device executes the method of the first aspect.

[0047] In a third aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program. When the computer program is executed by a processor, the method of the first aspect is implemented.

[0048] In a fourth aspect, an embodiment of the present application provides a computer program product, which includes a computer program. When the computer program is executed, the computer executes the method of the first aspect.

[0049] In a fifth aspect, an embodiment of the present application provides a chip, the chip including a processor, the processor being used to call a computer program in a memory to execute the method of the first aspect.

[0050] It should be understood that the second to fifth aspects of the present application correspond to the technical solutions of the first aspect of the present application, and the beneficial effects achieved by each aspect and the corresponding feasible implementation methods are similar and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] Figure 1 A schematic diagram of the interface of a terminal device in a possible design;

[0052] Figure 2A schematic diagram of the structure of a software framework of a terminal device provided in an embodiment of the present application;

[0053] Figure 3 A schematic diagram of an interface of a terminal device provided in an embodiment of the present application;

[0054] Figure 4 A schematic diagram of a flow chart of interaction between modules provided in an embodiment of the present application;

[0055] Figure 5A A schematic diagram of an interface of a terminal device provided in an embodiment of the present application;

[0056] Figure 5B A schematic diagram of an interface of a terminal device provided in an embodiment of the present application;

[0057] Figure 5C A flowchart of an interface display method provided in an embodiment of the present application;

[0058] Figure 5D A flowchart of an interface display method provided in an embodiment of the present application;

[0059] Figure 6 A schematic diagram of an interface of a terminal device provided in an embodiment of the present application;

[0060] Fig. 7A A schematic diagram of an interface of a terminal device provided in an embodiment of the present application;

[0061] Figure 7B A schematic diagram of an interface of a terminal device provided in an embodiment of the present application;

[0062] Figure 8 A schematic diagram of an interface of a terminal device provided in an embodiment of the present application;

[0063] Fig. 9 A schematic diagram of an interface of a terminal device provided in an embodiment of the present application;

[0064] Fig.10 A schematic diagram of an interface of a terminal device provided in an embodiment of the present application;

[0065] Fig.11 A schematic diagram of the structure of a terminal device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0066] To facilitate understanding of the embodiments of the present application, some terms involved in the present application are first briefly explained.

[0067] 1. Other terms

[0068] In the embodiments of the present application, words such as "first" and "second" are used to distinguish the same or similar items with substantially the same functions and effects. For example, the first chip and the second chip are only used to distinguish different chips, and their order is not limited. Those skilled in the art can understand that words such as "first" and "second" do not limit the quantity and execution order, and words such as "first" and "second" do not necessarily limit them to be different.

[0069] It should be noted that in the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0070] In the embodiments of the present application, "at least one" refers to one or more, and "more than one" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, ab, a--c, bc, or abc, where a, b, c can be single or multiple.

[0071] 2. Terminal equipment

[0072] The terminal device of the embodiment of the present application may also be any form of electronic device. For example, the electronic device may include a handheld device, a vehicle-mounted device, etc. For example, some electronic devices are: mobile phones, tablet computers, PDAs, laptop computers, mobile internet devices (MIDs), wearable devices, virtual reality (VR) devices, augmented reality (AR) devices, wireless terminals in industrial control, wireless terminals in self driving, wireless terminals in remote medical surgery, wireless terminals in smart grids, wireless terminals in transportation safety, wireless terminals in smart cities, wireless terminals in smart homes, cellular phones, cordless phones, session initiation protocol (SIP) phones, wireless local loop (WLL) stations, personal digital assistants (PDAs), handheld devices with wireless communication capabilities, computing devices or other processing devices connected to wireless modems, vehicle-mounted devices, wearable devices, terminal devices in 5G networks or future evolved public land mobile communication networks (public land mobile The embodiments of the present application do not limit this.

[0073] As an example but not limitation, in the embodiments of the present application, the electronic device may also be a wearable device. Wearable devices may also be referred to as wearable smart devices, which are a general term for wearable devices that are intelligently designed and developed using wearable technology for daily wear, such as glasses, gloves, watches, clothing, and shoes. A wearable device is a portable device that is worn directly on the body or integrated into the user's clothes or accessories. Wearable devices are not only hardware devices, but also powerful functions achieved through software support, data interaction, and cloud interaction. Broadly speaking, wearable smart devices include full-featured, large-sized, and fully or partially independent of smartphones, such as smart watches or smart glasses, as well as devices that only focus on a certain type of application function and need to be used in conjunction with other devices such as smartphones, such as various types of smart bracelets and smart jewelry for vital sign monitoring.

[0074] In addition, in the embodiments of the present application, the electronic device can also be a terminal device in the Internet of Things (IoT) system. IoT is an important part of the future development of information technology. Its main technical feature is to connect objects to the network through communication technology, thereby realizing an intelligent network that interconnects people and machines and things.

[0075] The electronic devices in the embodiments of the present application may also be referred to as: terminal equipment, user equipment (UE), mobile station (MS), mobile terminal (MT), access terminal, user unit, user station, mobile station, mobile station, remote station, remote terminal, mobile device, user terminal, terminal, wireless communication equipment, user agent or user device, etc.

[0076] In an embodiment of the present application, the electronic device or each network device includes a hardware layer, an operating system layer running on the hardware layer, and an application layer running on the operating system layer. The hardware layer includes hardware such as a central processing unit (CPU), a memory management unit (MMU), and a memory (also called main memory). The operating system can be any one or more computer operating systems that implement business processing through processes, such as Linux operating system, Unix operating system, Android operating system, iOS operating system, or Windows operating system. The application layer includes applications such as browsers, address books, word processing software, and instant messaging software.

[0077] In a possible design, the interface displayed by the terminal device is usually provided with multiple controls to facilitate the user to return to the previous level or browse the next level. For example, taking the first-level page as the previous level page of the second-level page and the third-level page as the next level page of the second-level page as an example, when the terminal device displays the second-level page, the first-level page can be displayed by selecting the control or returning the control; when the terminal device displays the second-level page, the third-level page can be displayed by the next-level control.

[0078] However, during the use of the terminal device, it may be necessary to switch pages multiple times to display the content that the user wants to browse, which is cumbersome and the human-computer interaction experience is poor.

[0079] Taking the first-level page, second-level page, and third-level page corresponding to the group page, title page, and article page respectively as an example, on the title page displayed on the terminal device, the group page can be displayed by selecting the control; on the title page displayed on the terminal device, the article page corresponding to the corresponding title can be displayed through the next-level control.

[0080] For example, Figure 1 A schematic diagram of the interface of a terminal device in a possible design.

[0081] Taking the note application as an example, when the terminal device receives the user's operation of opening the note application, it can enter the following Figure 1 The title interface is shown in a. Figure 1 As shown in a in FIG. 1 , the title page includes a selection control 101 and multiple titles. The multiple titles include but are not limited to: article one, article two, article three, audio notes or other types of titles.

[0082] When the terminal device receives a click operation on the selection control 101, the terminal device enters Figure 1 The interface shown in b in FIG. The interface displays multiple groups. The groups include: all, favorites 102, locked, deleted or other types of classification items.

[0083] When the terminal device receives a click operation on the collection 102, the terminal device enters Figure 1 The interface shown in c in FIG. The interface includes multiple titles corresponding to the collection. The multiple titles corresponding to the collection include but are not limited to: article 1 103, article 2, article 3, article 4 or other types of titles.

[0084] When the terminal device receives a click operation on the article 103, the terminal device enters Figure 1 The interface shown in d in FIG. The interface includes: a return control 104 and specific content corresponding to the article 1. When the terminal device receives a click operation on the return control 104, the terminal device enters Figure 1 The interface shown in c.

[0085] In this way, the terminal device can switch pages through controls to display the content that the user wants to browse based on the user's operation. However, the user needs to operate multiple times, the operation is cumbersome, and the human-computer interaction experience is poor.

[0086] In view of this, an embodiment of the present application provides an interface display method, where an application can call a column framework to obtain layout information of the interface, and then fill different page views into the columns based on the layout information for display.

[0087] For ease of understanding, the software framework of the terminal device is described below. The software system of the terminal device can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture.

[0088] Taking the layered architecture of the Android system as an example, the software structure of the terminal device is exemplified. Figure 2A schematic diagram of the structure of a software framework of a terminal device provided in an embodiment of the present application. Figure 2 As shown,

[0089] The layered architecture divides the software system of the terminal device into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system can be divided into four layers, namely, the application layer (applications), the application framework layer (application framework), the Android runtime (Android runtime), the system library, and the kernel layer (kernel).

[0090] The application layer can include a series of application packages. The application layer runs applications by calling the application programming interface (API) provided by the application framework layer. Figure 2 As shown, the application package may include applications such as camera, calendar, map, phone, music, settings, notes, video, etc.

[0091] The application framework layer provides API and programming framework for the applications in the application layer. The application framework layer includes some predefined functions. Figure 2 As shown, the application framework layer may include a window manager, a column frame, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0092] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0093] The column framework is used to provide the application with layout information of the columns displayed on the interface, as well as animations when the columns are expanded and collapsed, etc. For example, the number, size, and position of the columns displayed on the interface.

[0094] The column framework includes: column layout management (e.g., frafment layout) and basic control module. Column layout management is used to determine the number of columns, the length of each column in the horizontal direction, whether the column is folded and invisible, etc. In some embodiments, the column layout management includes: a first column (e.g., slide layout), a second column (e.g., frafmentA0001) and a third column (e.g., frafment A0002). The basic control module is used to manage controls in each column, for example, controls for adjusting the expansion of the first column, controls for adjusting the folding of the first column, controls for adjusting the full-screen display of the third column, controls for adjusting the exit of the full-screen display of the third column, controls for adjusting the size of the second column and the third column, etc. When the terminal device receives a user operation on a control in each column, the layout of each column is adjusted based on the function corresponding to the corresponding control.

[0095] In some embodiments, when the column layout is adjusted, a corresponding animation is also provided to enhance the user experience. For example, when the first column is collapsed, an animation of the second column and the third column sliding toward the first column can be provided. When the first column is expanded, an animation of the second column and the third column sliding away from the first column can be provided. The embodiments of the present application do not limit the specific animations, the implementation of the animations, etc.

[0096] Content providers are used to store and retrieve data and make it accessible to applications. Data can include video, images, audio, calls made and received, browsing history and bookmarks, phone books, etc. The view system includes visual controls, such as controls that display text, controls that display images, etc.

[0097] The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view that displays text and a view that displays images.

[0098] The phone manager is used to provide communication functions for terminal devices, such as the management of call status (including answering, hanging up, etc.).

[0099] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, etc.

[0100] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, the terminal device vibrates, the indicator light flashes, etc.

[0101] The Android runtime includes the core library and the virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.

[0102] The core library consists of two parts: one is the function that the Java language needs to call, and the other is the Android core library. The application layer and the application framework layer run in the virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0103] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0104] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications. The media library supports playback and recording of multiple common audio and video formats, as well as static image files. The media library can support multiple audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc. The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing. The 2D graphics engine is a drawing engine for 2D drawing.

[0105] The kernel layer is a layer between hardware and software. The kernel layer is used to drive the hardware to make the hardware work. The kernel layer at least includes display driver, camera driver, audio driver, sensor driver, etc., which are not limited in the embodiments of the present application.

[0106] In some embodiments, the terminal device may further include a hardware abstract layer (HAL), which may include multiple library modules, such as a camera library module, a motor library module, etc. The Android system may load the corresponding library module for the device hardware, thereby achieving the purpose of the application framework layer accessing the device hardware. The device hardware may include a motor, a camera, etc. in the terminal device.

[0107] The following is an example of the workflow of the terminal device software and hardware, combined with the scenario of terminal device interface switching.

[0108] When the touch sensor in the terminal device receives a touch operation, the corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the touch operation into raw input events (including touch coordinates, touch force, timestamp of touch operation, etc.). The raw input events are stored in the kernel layer. The application framework layer obtains the raw input events from the kernel layer and identifies the control corresponding to the input event.

[0109] Taking the case where the touch operation is a touch and click operation, and the control corresponding to the click operation is the control of the note application icon, the note application calls the column framework to obtain the layout information of the interface, and calls the image rendering library in the system library through the view system of the application framework layer to draw and render the image, so as to display the corresponding interface of the note application on the screen (display).

[0110] For ease of understanding, the interfaces involved in the embodiments of the present application are described below.

[0111] For example, Figure 3 A schematic diagram of an interface of a terminal device provided in an embodiment of the present application.

[0112] The application interface of the terminal device can be Figure 3 The application interface includes: a first column 302 , a second column 303 and a third column 304 .

[0113] It can be understood that the contents displayed in the first column 302, the second column 303 and the third column 304 are related to the application and correspond to different views of the application respectively. The embodiment of the present application does not limit the specific content displayed in the columns.

[0114] Taking the note application as an example, the first column 302 includes: note categories and note folders. Note categories include: all 305, favorites, locked, deleted or other types of categories; note folders include: unclassified, learning, third level, fifth level or other types of folders. The second column 303 displays the titles of the notes corresponding to all 305. The titles of the notes corresponding to all 305 include: first title, second title, third title or other titles; the third column 304 displays the content corresponding to the first title in the second column.

[0115] In some embodiments, the application interface further includes: a first retracting control 306 and / or a full-screen display control 307. When the terminal device receives a click operation on the first retracting control 306, the application interface of the note application displays the second sub-column and the third sub-column, and does not display the first sub-column 302. When the terminal device receives a click operation on the full-screen display control 307, the application interface of the note application displays the third sub-column 304, and does not display the first sub-column 302 and the second sub-column 303.

[0116] In a possible implementation, the first retractable control 306 is located in the first sub-column 302, and the full-screen display component 307 is located in the third sub-column 303. In this way, it is convenient for users to operate, more in line with the user's operating habits, and improves the user experience. The embodiment of the present application does not limit the form, style, position, etc. of the first retractable control 306 and the full-screen display control 307.

[0117] In some embodiments, the application interface further includes a first adjustment control 308. The first adjustment control 308 is located between the second column 303 and the third column 304.

[0118] When the terminal device receives a drag operation for the first adjustment control 308, the ratio of the horizontal length of the second column 303 to the horizontal length of the third column 304 changes with the drag operation.

[0119] Combine the following Figure 4 5 illustrates the interaction between the modules involved in the application interface display process.

[0120] For example, Figure 4 A schematic diagram of a flow chart of interaction between modules provided in an embodiment of the present application. The terminal device includes: an application, a column frame, and a window manager.

[0121] like Figure 4 As shown, the interaction process includes:

[0122] S401: The terminal device receives a first user operation, and the application calls a column framework to obtain interface layout information.

[0123] Specifically, the application calls the column framework through the first interface to obtain the layout information of each column in the interface. The first interface is an interface for adding content, for example, add content (View view1, View view2, View view3) interface.

[0124] In some embodiments, the application transmits an application identifier to the column frame. The application identifier can be the name of the application, or the name of the application package, or any other identifier, which is not limited here. In this way, it is convenient for the column frame to determine the window size.

[0125] In the embodiment of the present application, the first user operation may be an operation for the user to open the application, or an operation for setting the column mode. The embodiment of the present application does not limit the type, method, etc. of the first user operation. The operation for setting the column mode may be an operation for the user to select the column mode from multiple display modes in the setting interface of the application. The multiple modes may include: standard mode and column mode. The interface corresponding to the standard mode may be as follows: Figure 1 shown.

[0126] The layout information includes, but is not limited to, the number of columns, the size information of each column, or the position information of each column. The size information includes, the length of the first column in the horizontal direction, the length of the second column in the horizontal direction, the length of the third column in the horizontal direction, etc. The position information includes, the position of the first column, the position of the second column, the position of the second column, etc. The embodiments of the present application do not limit the layout information.

[0127] For example, when the user Figure 5A When the note application icon 501 is clicked on the main interface shown in a in FIG. , the note application calls the column framework to obtain the layout information of the interface.

[0128] S402: After receiving a call from an application, the column framework obtains window information corresponding to the application from a window manager.

[0129] In a possible implementation, the column frame sends a message for acquiring window information to the window manager, the message including the application identifier, and the window manager sends the window information corresponding to the application identifier to the column frame.

[0130] In the embodiment of the present application, the window information includes but is not limited to: window size information, window status information, etc. The size information includes: the length of the window in the horizontal direction, the length of the window in the vertical direction. The window status information includes: whether the window is a floating window, or whether the window is not a floating window.

[0131] S403: The column framework determines the layout of the application interface based on the window information, and transmits the layout information to the application.

[0132] The layout information includes but is not limited to: the number of columns, the horizontal length of each column, the position of each column, etc.

[0133] In the embodiment of the present application, the number of columns is related to the type and window form of the terminal device.

[0134] When the terminal device is of the first type and the window is in full screen mode, the window includes: three columns; when the terminal device is of the second type and the window is in full screen mode, the window includes: two columns. The first type of devices includes: tablets, computers, etc. The second type of devices includes: folding screen mobile phones, etc. The embodiments of the present application do not limit the first type of devices, the second type of devices, etc. When the window is a floating window, the window includes one column.

[0135] The layout information includes any two or more of the following: the first length of the first column in the horizontal direction, the second length of the second column in the horizontal direction, the third length of the third column in the horizontal direction, the ratio of the second length to the third length, the number of columns, etc.

[0136] For example, the application is a note application, the first user operation is to open the note application, and the device is a tablet. Figure 5A As shown, the terminal device is Figure 5A In the main interface shown in a of FIG. 1 , when receiving an operation of the user opening the note application 501 of the terminal device, the terminal device can enter the Figure 5A The application interface shown in bd.

[0137] When the window corresponding to the note application is in full screen mode and displayed in landscape mode, the column frame transmits the first layout information to the application, and the terminal device enters Figure 5A The application interface shown in b in FIG. The application interface includes: a first column 302, a second column 303 and a third column 304. The second interface displays all the contents of the third column 304, and the third column 304 is fully displayed.

[0138] When the window corresponding to the note application is in full screen mode and displayed in portrait orientation, the terminal device enters the application interface shown in c in FIG. 5 , which includes: a first column 302, a second column 303, and a third column 304. The second interface displays part of the content of the third column 304, and the third column 304 is not fully displayed.

[0139] In some embodiments, when the third column is not fully displayed, a mask is suspended over the third column so that the brightness of the third column is lower than that of the second column.

[0140] When the window corresponding to the note application is a floating window, the column frame transmits the third layout information to the application, and the terminal device enters Figure 5AThe application interface shown in d in FIG. The application interface includes: a second column 303.

[0141] In this way, the terminal device can adjust the displayed content based on the window size. When the window is wide, three columns can be displayed to display more content and reduce the operation of users when switching pages. When the window is a small floating window, one column is displayed to reduce the situation where users cannot see clearly. In addition, the terminal device determines the number and position of columns displayed in the interface through the column framework, which is applicable to multiple applications and has high universality.

[0142] In some embodiments, the layout information also includes display effect information. The display effect information is used to indicate the display effect of each column. For example, when the window corresponding to the note application is in full screen mode and displayed in portrait mode, a mask is suspended on the third column, presenting a mask state with a lower brightness than the second column.

[0143] For example, the application is a note application, the first user operation is to open the note application, and the device is a foldable screen mobile phone. Figure 5B As shown, the terminal device is Figure 5B In the main interface shown in a of FIG. 1 , when receiving the operation of the user opening the note application 502 of the terminal device, the terminal device can enter the Figure 5B The application interface shown in bd.

[0144] When the foldable screen mobile phone is in the unfolded state, the column frame transmits the first layout information to the application, and the terminal device enters Figure 5B The application interface shown in b in FIG. 1 includes: a second column 303 and a third column 304. The first column 302 is not displayed.

[0145] When the foldable screen phone is in the folded state, the column frame transmits the third layout information to the application, and the terminal device enters Figure 5B The application interface shown in c in FIG. The application interface includes: a second column 303 .

[0146] When the window corresponding to the note application is a floating window, the column frame transmits the third layout information to the application, and the terminal device enters Figure 5B The application interface shown in d in FIG. The application interface includes: a second column 303.

[0147] In other embodiments, the terminal device may also determine the number of columns in the application interface based on the window size.

[0148] Specifically, when the window is not a floating window and the horizontal length of the window is greater than or equal to the first threshold, the application interface includes three columns. When the window is a floating window, the application interface includes one column.

[0149] In a possible implementation mode 1, when the window is not a floating window and the length in the horizontal direction is greater than or equal to the second threshold, the column framework sends the first layout information to the application. The first layout information includes any two or more of the following: a first length in the horizontal direction of the first column, a second length in the horizontal direction of the second column, a third length in the horizontal direction of the third column, and a ratio of the second length to the third length. The second threshold is greater than the first threshold.

[0150] In this way, the application can determine the length of each column in the vertical direction based on the first layout information, and then determine the layout of each column.

[0151] In possible implementation mode 2, when the window is not a floating window, the horizontal length of the window is less than the second threshold, and the horizontal length of the window is greater than or equal to the first threshold, the column framework sends second layout information to the application. The second layout information includes any two or more of the following: the first length, the second length, and the third length.

[0152] In this way, the application can confirm the layout of each column when the third column is not fully displayed based on the second layout information.

[0153] In possible implementation manner three, when the window is a floating window or the horizontal length of the window is less than the first threshold, the column framework sends third layout information to the application. The third layout information includes: the second length.

[0154] S404: The application draws and renders the application interface according to the layout information to display the application interface on the display screen.

[0155] In some embodiments, the application draws and renders the application interface according to the layout information, the image synthesis system (surfaceflinger) synthesizes the application interface after the application draws and renders, and the display driver drives the display screen to display the application interface synthesized by the image synthesis system. The embodiment of the present application does not limit the process from drawing and rendering to displaying the application interface.

[0156] In this way, the application can display multiple columns by calling the column framework, and adjust the columns displayed in the interface under different circumstances.

[0157] It is understandable that the above embodiments use window information and device information as examples to illustrate how the column frame determines the layout of each column in different situations. The column frame can also determine the layout of each column based on one or more of the following information, including but not limited to: window information, device information, information for whether to display in split screen, device placement direction, etc. The embodiments of the present application are not limited to this.

[0158] For example, Figure 5CThis is a flow chart of an interface display method provided in an embodiment of the present application. Taking the device as a tablet as an example, Figure 5C As shown, the interface display method includes:

[0159] S501: The terminal device receives an operation on a first expansion control.

[0160] S502: After receiving an operation on a first expansion control, a second sub-column and a third sub-column in the terminal device move a first length in a direction away from the first sub-column.

[0161] S503: When the terminal device is placed horizontally, the terminal device further adjusts the third length of the third column to adapt to the display screen of the terminal device.

[0162] S504: When the terminal device is placed vertically, the terminal device adds a mask to the third column.

[0163] In this way, the terminal device can control the expansion of the first column based on user operations to display more content.

[0164] For example, Figure 5D The following is a flow chart of an interface display method provided in an embodiment of the present application. Figure 5D As shown, the interface display method includes:

[0165] S505: The terminal device receives an operation for folding the first control.

[0166] S506: After receiving an operation for retracting the first control, the second sub-column and the third sub-column in the terminal device move a first length toward the first sub-column.

[0167] S507: When the terminal device is placed horizontally, the terminal device further adjusts the third length of the third column to adapt to the display screen of the terminal device.

[0168] S508: When the terminal device is placed vertically, the terminal device removes the mask of the third column.

[0169] In this way, the terminal device can control the first sub-column to collapse based on the user operation, so as to facilitate the user to browse the content displayed in the third sub-column.

[0170] Based on the above embodiment, the user can also control the first column to collapse, or the third column to display in full screen.

[0171] Combine the following Figure 6 The interaction between modules involved in the column folding process is described.

[0172] For example, Figure 6 This is a schematic diagram of an interface of a terminal device provided in an embodiment of the present application. Figure 6 As shown, the interaction process includes:

[0173] S601: The terminal device receives a second user operation, and the application transmits a first adjustment message to the column framework, where the first adjustment message is used to indicate the number of columns to be adjusted for display.

[0174] In the embodiment of the present application, the second user operation is an operation of adjusting the number of displayed columns. The second user operation can be an operation of clicking to collapse a control, or an operation of clicking to expand a control, or a voice operation for adjusting columns. The embodiment of the present application does not specifically limit the type of the second user operation.

[0175] S602: The column framework determines an adjustment method based on the window information and the first adjustment message.

[0176] When the first adjustment message is used to indicate that the first column is collapsed, the adjustment method is: the second column and the third column are moved toward the first column by the first length corresponding to the first column, and the third length of the third column is increased by the first length corresponding to the first column.

[0177] When the first adjustment message is used to indicate that the third column is displayed in full screen, the adjustment method is: the third column is moved toward the first column by the first length and the second length, and the third column increases by the first length and the second length.

[0178] When the first adjustment message is used to indicate the expansion of the first column, the adjustment method is: the second column and the third column move away from the first column by the first length corresponding to the first column, and the third length of the third column is reduced by the first length corresponding to the first column.

[0179] When the first adjustment message is used to instruct the third column to exit full-screen display, if the interface before full-screen display displays the first column, the second column and the third column, the adjustment method is: the third column moves the first length and the second length away from the first column, and the third column reduces the first length and the second length.

[0180] If the interface before full screen display has the second column and the third column, the first column is not displayed. The adjustment method is: the third column moves toward the second column by the second length, and the third column increases by the second length.

[0181] S603: The column framework transmits the adjusted layout information to the application.

[0182] In some embodiments, the size of the first column, the size of the second column, the size of the third column, the position of the first column, the position of the second column, the position of the third column, etc.

[0183] In other embodiments, the adjusted layout information includes: position change information of the first column, position change information of the second column, position change information of the third column, size change information of the second column, size change information of the third column, etc.

[0184] S604: The application draws and renders an application interface based on the adjusted layout information to display the corresponding application interface on the display screen.

[0185] For example, Fig. 7A As shown, when the terminal device is Fig. 7A When the interface shown in a receives the operation of the user clicking the first retract control 306, the application transmits the adjusted layout information to the column frame, the first adjustment message is used to instruct to retract the first column, and the column frame transmits the adjusted layout information to the application based on the first adjustment message. The adjusted layout information is used to instruct the second column and the third column to move a first length in the direction of the first column, and the third column increases a first length. The terminal device enters Fig. 7A The application interface shown in b in FIG. 1 includes a second column and a third column, and a first expansion control 701 is provided in the second column.

[0186] When the terminal device is Fig. 7A When the interface shown in b receives the operation of the user clicking the first expansion control 701, the application transmits the adjusted layout information to the column frame, the first adjustment message is used to instruct to expand the first column, and the column frame transmits the adjusted layout information to the application based on the first adjustment message. The adjusted layout information is used to instruct the second column and the third column to move away from the first column by a first length, and the third column is reduced by a first length. The terminal device enters Fig. 7A The application interface shown in a.

[0187] For example, Figure 7B As shown, when the terminal device is Figure 7B When the interface shown in a receives the operation of the user clicking the full screen display control 307, the application transmits the adjusted layout information to the column frame, the first adjustment message is used to instruct the full screen display of the third column, and the column frame transmits the adjusted layout information to the application based on the first adjustment message. The adjusted layout information is used to instruct the third column to move the first length and the second length in the direction of the first column, and the third column increases the first length and the second length. The terminal device enters Figure 7B The application interface shown in b in FIG. The application interface includes: a third column, excluding the first column and the second column. The third column is provided with an exit full screen control 702.

[0188] When the terminal device is Figure 7BWhen the interface shown in b receives the operation of the user clicking on the exit full screen control 702, the application transmits the adjusted layout information to the column frame, and the first adjustment message is used to indicate the exit of the full screen display of the third column. The column frame transmits the adjusted layout information to the application based on the first adjustment message. The adjusted layout information is used to indicate that the third column moves away from the first column by the first length and the second length, and the third column reduces the first length and the second length. The terminal device enters Figure 7B The application interface shown in a.

[0189] In this way, users can adjust the display of columns to improve user experience.

[0190] Based on the above embodiment, the column framework may also add corresponding animation effects when the columns are expanded or collapsed.

[0191] The column frame realizes the animation effect of expansion or collapse by calling the corresponding view or by moving the screenshot of the corresponding view in the horizontal direction.

[0192] Based on the above embodiment, the user may also adjust the ratio between the second column and the third column.

[0193] Combine the following Figure 8 The interaction between modules involved in the column folding process is described.

[0194] For example, Figure 8 This is a schematic diagram of an interface of a terminal device provided in an embodiment of the present application. Figure 8 As shown, the interaction process includes:

[0195] S801: The terminal device receives a third user operation, and the application transmits a second adjustment message to the column frame, where the second adjustment message is used to instruct to adjust the column size.

[0196] In the embodiment of the present application, the third user operation is an operation for adjusting the size of the column. The third user operation can be a drag operation on the first adjustment control, or a voice operation for indicating the size of the column. The embodiment of the present application does not specifically limit the type of the third user operation.

[0197] In some embodiments, the third user operation is a drag operation on the first adjustment control 308, and the second adjustment message includes: position coordinates corresponding to the drag operation.

[0198] S802: The column framework determines adjusted layout information based on the second adjustment message.

[0199] The column frame adjusts the layout of the columns based on the position coordinates of the drag operation. Exemplarily, the length of the second column in the horizontal direction is the sum of the change in the position coordinates of the drag operation in the horizontal direction and the second length. The third length of the third column satisfies: the third length = the length of the display screen in the horizontal direction - the first length - the second length.

[0200] Taking the first adjustment control 308 being located at an edge of the second column away from the first column as an example, when the interface includes the first column, the second length of the second column is the difference between the position coordinates of the drag operation in the horizontal direction and the first length. The third length is the difference between the length of the display screen in the horizontal direction and the position coordinates of the drag operation in the horizontal direction.

[0201] When the interface does not include the first column, the second length of the second column is the horizontal position coordinate of the drag operation. The third length is the difference between the horizontal length of the display screen and the horizontal position coordinate of the drag operation.

[0202] The embodiment of the present application does not limit the specific calculation method of the second length and the third length. S803: The column framework transmits the adjusted layout information to the application.

[0203] In some embodiments, the adjusted layout information includes: the size of the first column, the size of the second column, the size of the third column, the position of the first column, the position of the second column, the position of the third column, etc.

[0204] In other embodiments, the adjusted layout information includes: position change information of the first column, position change information of the second column, position change information of the third column, size change information of the second column, size change information of the third column, etc.

[0205] S804: The application draws and renders an application interface based on the adjusted layout information to display the corresponding application interface on the display screen.

[0206] For example, Fig. 9 As shown, when the terminal device is Fig. 9 When the interface shown in a receives the user's operation of dragging the first adjustment control 308, the application transmits a second adjustment message to the column frame, the second adjustment message includes the coordinates of the drag operation or the coordinates of the position change of the touch point corresponding to the drag operation, and the column frame transmits the adjusted layout information to the application based on the second adjustment message. The adjusted layout information is used to indicate the change in the ratio of the length of the second column to the third column. The terminal device enters Fig. 9 Compared with the application interface shown in b in Fig. 9 The application interface shown in a in FIG. 1 includes a first column, a second column and a third column. The ratio of the second length to the third length of the application interface is Fig. 9The ratio of the second length to the third length in the application interface shown in a is different.

[0207] The change in the ratio of the second length to the third length is related to the change in the position of the touch point corresponding to the drag operation.

[0208] In this way, the terminal device can adjust the size of the column based on the user operation, which is convenient for the user and improves the user experience.

[0209] The above embodiment is explained by taking the note application as an example. Other applications in the terminal device can also realize the display of three columns by calling the column frame. The specific calling process is similar to the note application and will not be described in detail here. Other applications can be calendars, emails, galleries, documents, file managers, etc. The embodiments of this application do not limit the specific applications.

[0210] Based on the above embodiment, a content in the second column can also be dragged and moved to the first column to modify the group corresponding to the content. Taking the note application as an example, when the user drags the first title under the first category item in the second column to the second category item in the first column, the terminal device adjusts the first title to the second category item.

[0211] For example, Fig.10 A schematic diagram of an interface of a terminal device provided in an embodiment of the present application.

[0212] When the terminal device is Fig.10 When the interface shown in a in FIG. 1 receives a drag operation for the title item "Article 2" 1001 in the second column 303, the terminal device adjusts the classification item corresponding to the title item "Article 2" 1001. When the position at the end of the drag operation corresponds to the classification item "Level 3" 1002 in the first column 302, the terminal device adjusts the classification item corresponding to the title item "Article 2" 1001 to the classification item "Level 3" 1002, and displays Fig.10 The interface shown in b.

[0213] When the terminal device is Fig.10 When the interface shown in b in FIG. 1 receives a click operation on the classification item "Level 3" 1002, the terminal device displays Fig.10 The interface shown in c in FIG. The interface includes: a first column 302, a second column 303, and a third column 304. The second column 303 displays the title item "Article 2" 1001, and the third column displays the specific content corresponding to the default title item in the second column 303. The default title item can be the first title item or other title items, which is not limited here.

[0214] The method of the embodiment of the present application has been described above, and the device for executing the above method provided by the embodiment of the present application is described below. Those skilled in the art can understand that the method and the device can be combined and referenced with each other, and the relevant device provided by the embodiment of the present application can execute the steps in the above method.

[0215] The method provided in the embodiment of the present application can be applied to an electronic device with a display function. The electronic device includes a terminal device, and the specific device form of the terminal device can refer to the above related description, which will not be repeated here.

[0216] An embodiment of the present application provides a terminal device, which includes: a processor and a memory; the memory stores computer-executable instructions; the processor executes the computer-executable instructions stored in the memory, so that the terminal device executes the above method.

[0217] For example, Fig.11 This is a schematic diagram of the structure of a terminal device provided in an embodiment of the present application. Fig.11 As shown, the terminal device includes: the terminal device may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0218] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the terminal device. In other embodiments of the present application, the terminal device may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0219] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0220] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

[0221] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0222] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0223] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present invention is only a schematic illustration and does not constitute a structural limitation on the terminal device. In other embodiments of the present application, the terminal device may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0224] The charging management module 140 is used to receive charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input through a wireless charging coil of a terminal device. While the charging management module 140 is charging the battery 142, it can also power the electronic device through the power management module 141.

[0225] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0226] The terminal device implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0227] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the terminal device may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0228] The terminal device can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0229] ISP is used to process the data fed back by camera 193. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to ISP for processing and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, ISP can be set in camera 193.

[0230] The camera 193 is used to capture static images or videos. In some embodiments, the terminal device may include 1 or N cameras 193, where N is a positive integer greater than 1. The types of the multiple cameras 193 may be different. For example, the camera 193 may include a camera for acquiring color images or a TOF camera, etc. In the embodiment of the present application, the camera may be understood as a camera. The camera includes: an AO camera, a TOF camera, etc. in the embodiment of the present application.

[0231] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the terminal device. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music and videos can be stored in the external memory card.

[0232] The internal memory 121 can be used to store computer executable program codes, and the executable program codes include instructions. The internal memory 121 can include a program storage area and a data storage area.

[0233] The terminal device can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor.

[0234] The button 190 includes a power button, a volume button, etc. The button 190 may be a mechanical button. It may also be a touch button. The terminal device may receive the button input and generate a key signal input related to the user settings and function control of the terminal device. The indicator 192 may be an indicator light, which may be used to indicate the charging status, power change, message, missed call, notification, etc.

[0235] In addition, on top of the above components, the device also runs an operating system, such as an iOS operating system, an Android operating system, or a Windows operating system, etc. Applications can be installed and run on the operating system.

[0236] The software system of the terminal device can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture, etc., which will not be elaborated here.

[0237] The embodiment of the present application provides a chip. The chip includes a processor, and the processor is used to call a computer program in a memory to execute the technical solution in the above embodiment. Its implementation principle and technical effect are similar to those of the above related embodiments, and will not be repeated here.

[0238] The embodiments of the present application also provide a computer-readable storage medium. The computer-readable storage medium stores a computer program. The above method is implemented when the computer program is executed by the processor. The method described in the above embodiment can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. If implemented in software, the function can be stored as one or more instructions or codes on a computer-readable medium or transmitted on a computer-readable medium. Computer-readable media can include computer storage media and communication media, and can also include any medium that can transfer a computer program from one place to another. The storage medium can be any target medium that can be accessed by a computer.

[0239] In one possible implementation, a computer-readable medium may include RAM, ROM, compact disc read-only memory (CD-ROM) or other optical disk storage, disk storage or other magnetic storage devices, or any other medium that is intended to carry or store the required program code in the form of instructions or data structures and can be accessed by a computer. Moreover, any connection is appropriately referred to as a computer-readable medium. For example, if a coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL) or wireless technology (such as infrared, radio and microwave) is used to transmit software from a website, server or other remote source, the coaxial cable, fiber optic cable, twisted pair, DSL or wireless technology such as infrared, radio and microwave are included in the definition of medium. Disks and optical disks as used herein include optical disks, laser disks, optical disks, digital versatile disks (DVD), floppy disks and Blu-ray disks, where disks usually reproduce data magnetically, while optical disks reproduce data optically using lasers. Combinations of the above should also be included in the scope of computer-readable media.

[0240] An embodiment of the present application provides a computer program product, which includes a computer program. When the computer program is executed, the computer executes the above method.

[0241] The embodiments of the present application are described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable device to generate a machine, so that the instructions executed by the processing unit of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0242] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0243] The above specific implementation methods further illustrate the purpose, technical solutions and beneficial effects of the present invention in detail. It should be understood that the above are only specific implementation methods of the present invention and are not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc. made on the basis of the technical solutions of the present invention should be included in the scope of protection of the present invention.

Claims

1. An interface display method, characterized in that: include: The terminal device displays a first interface, wherein the first interface includes a first control; The terminal device receives a first operation on the first control; In response to the first operation, the terminal device displays a second interface, the second interface displays a first window corresponding to the first application in full screen, the first window comprising: a plurality of columns; the first application corresponds to the first control; When the type of the terminal device is the first type, the first window in the second interface includes: a first column, a second column and a third column; or, when the type of the terminal device is the second type, the first window in the second interface includes: a second column and a third column, but does not include the first column; The terminal device receives a second operation for instructing the first window to switch to a floating window state; In response to the second operation, the terminal device displays a third interface, and the first window in the third interface includes: a second column, excluding the first column and the third column.

2. The method according to claim 1, characterized in that When the type of the terminal device is the first type, the first window in the second interface includes: a first column, a second column and a third column, including: When the terminal device displays the first window in landscape mode, the second interface displays all the contents of the third column; When the terminal device displays the first window in portrait mode, the second interface displays part of the content of the third column.

3. The method according to claim 2, characterized in that The method further comprises: When the terminal device displays the first window in portrait mode, a mask is suspended at the third column in the second interface, so that the brightness of the third column is lower than that of the second column.

4. The method according to any one of claims 1 to 3, characterized in that: The second type of device includes a folding screen, and the number of columns displayed on the second interface is also related to the state of the folding screen in the terminal device; The method further comprises: The terminal device receives a third operation for switching the form of the terminal device; In response to the third operation, the terminal device switches from the expanded state to the folded state, and the terminal device displays a fourth interface, in which the first window includes the second column but does not include the first column and the third column.

5. The method according to any one of claims 1 to 4, characterized in that: The terminal device displays a fifth interface, the fifth interface includes a second control, and the fifth interface is the same as the first interface; The terminal device receives a fourth operation on the second control, where the second control corresponds to a second application; In response to the fourth operation, the terminal device displays a sixth interface, the sixth interface displays a second window corresponding to the second application in full screen, the second window including: a plurality of columns; The second application corresponds to the second control.

6. The method according to any one of claims 1 to 5, characterized in that: The terminal device comprises: a column frame, the column frame being used to confirm the layout of the columns displayed by the terminal device; In response to the first operation, the terminal device displays a second interface, including: The first application calls the column frame in the terminal device; The column framework acquires first window information corresponding to the first application, where the first window information includes: a horizontal length of the first window and a state of the first window; The column framework sends first layout information to the first application based on the first window information, where the first layout information is used to describe the layout of the second interface corresponding to the first application.

7. The method according to claims 1-6, characterized in that: A third control is displayed in the first column of the second interface; A fifth operation of the terminal device on the third control; In response to the fifth operation, the terminal device displays a seventh interface, wherein the seventh interface includes: the first sub-column, the second sub-column and the third sub-column; The content displayed in the second column in the seventh interface is different from the content displayed in the second column in the second interface, the content displayed in the third column in the seventh interface is different from the content displayed in the third column in the second interface, and the content displayed in the second column in the seventh interface is related to the third control.

8. The method according to any one of claims 1 to 7, characterized in that: The ratio of the second length in the second interface to the third length in the second interface is a first value; the second interface further includes a fourth control; The method further comprises: receiving a first drag operation on the fourth control; In response to the first drag operation, the terminal device displays an eighth interface, and a ratio of the second length in the eighth interface to the third length in the eighth interface is a second value; When the starting position and the ending position of the first drag operation are different, the second value is different from the first value; when the starting position and the ending position of the first drag operation are the same, the second value is the same as the first value.

9. The method according to claim 8, characterized in that In response to the first drag operation, the terminal device displays an eighth interface, including: After the terminal device receives the first drag operation, the application transmits first information to the column frame, where the first information carries coordinates corresponding to the drag operation; The column framework sends third layout information to the application based on the coordinates of the first drag operation, wherein the third layout information is used to describe the layout of the eighth interface; the layout of the eighth interface is related to the coordinates of the first drag operation; The terminal device displays the eighth interface based on the third layout information.

10. The method according to any one of claims 1 to 9, characterized in that: The second interface also includes: a fifth control; The terminal device receives a sixth operation for the fifth control; In response to the sixth operation, the terminal device displays a ninth interface, and the ninth interface does not display the first column.

11. The method according to claim 10, characterized in that In response to the sixth operation, the terminal device displays a ninth interface, including: After the terminal device receives the sixth operation, the application transmits a second message to the column frame, where the second message is used to instruct to collapse the first column; The column framework sends fourth layout information to the application based on the second message, wherein the fourth layout information is used to indicate that the second column and the third column are both moved toward the first column by the first length, and the third length is increased by the first length; The application displays the ninth interface based on the fourth layout information; Among them, the second length corresponding to the ninth interface is the same as the second length corresponding to the second interface; the difference between the third length corresponding to the ninth interface and the third length corresponding to the second interface is the first length corresponding to the second interface.

12. The method according to claim 10 or 11, characterized in that: The ninth interface displays a sixth control; the method further includes: Receiving a seventh operation on a sixth control; In response to the seventh operation, the terminal device displays a tenth interface, and the tenth interface displays the first column, the second column, and the third column.

13. The method according to claim 12, characterized in that In response to the seventh operation, the terminal device displays a tenth interface, including: After the terminal device receives the seventh operation, the application transmits a third message to the column framework, where the third message is used to instruct to expand the first column; The column framework sends fifth layout information to the application based on the third message, wherein the fifth layout information is used to instruct the second column and the third column to move the first length away from the first column, and the third length is reduced by the first length; The application displays the tenth interface based on the fifth layout information; Among them, the second length corresponding to the tenth interface is the same as the second length corresponding to the second interface; the difference between the third length corresponding to the second interface and the third length corresponding to the tenth interface is the first length corresponding to the second interface.

14. The method according to any one of claims 1 to 13, characterized in that: The second interface further includes: a seventh control; the method further includes: The terminal device receives an eighth operation for the seventh control; In response to the eighth operation, the terminal device displays an eleventh interface, and the eleventh interface displays the third sub-column but does not display the first sub-column and the second sub-column.

15. The method according to claim 14, characterized in that In response to the eighth operation, the terminal device displays an eleventh interface, including: After the terminal device receives the eighth operation, the application transmits a fourth message to the column framework, where the fourth message is used to instruct to display the third column in full screen; The column framework sends sixth layout information to the application based on the fourth message, wherein the sixth layout information is used to instruct the third column to move the first length and the second length toward the first column, and the third column increases the first length and the second length; The application displays the eleventh interface based on the sixth layout information.

16. The method according to claim 14 or 15, characterized in that The third sub-column in the eleventh interface further includes: an eighth control; The terminal device receives a ninth operation for the eighth control; In response to the ninth operation, the terminal device displays a twelfth interface, and the twelfth interface displays the first column, the second column, and the third column.

17. The method according to claim 16, characterized in that In response to the ninth operation, the terminal device displays a twelfth interface, including: After the terminal device receives the ninth operation, the application transmits a fifth message to the column framework, where the fifth message is used to instruct to cancel the full-screen display of the third column; The column framework sends seventh layout information to the application based on the fifth message, wherein the seventh layout information is used to instruct the third column to move away from the first column by a first length and a second length, and the third column to reduce the first length and the second length; The application displays the twelfth interface based on the sixth layout information.

18. The method according to any one of claims 1 to 17, characterized in that: The first type of devices includes: tablets; The second type of device includes: a mobile phone with a foldable screen.

19. A terminal device, characterized in that: include: Processor and memory; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory, so that the terminal device performs the method according to any one of claims 1 to 18.

20. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 18 is implemented.

21. A computer program product, characterized in that The method comprises a computer program, which, when being executed, enables a computer to execute the method according to any one of claims 1 to 18.

Images