Sidebar display method, device, terminal and storage medium
By displaying the system sidebar in the edge area of the display screen, displaying the pending data for the first application, and displaying the processing interface in response to the trigger operation of the pending data, the sidebar in the prior art is difficult to assist users in rapid rapidity. Handling the problem of pending data improves the auxiliary effect.
Patent Information
- Application Number
- CN202110421089.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-04-19
- Publication Date
- 2025-02-14
- Estimated Expiration
- 2041-04-19
AI Technical Summary
In the prior art, when the user plays games or watches videos in full screen, it is difficult to effectively assist the user in quickly processing the data to be processed.
By displaying the system sidebar in the edge area of the display screen, the pending data recommended for the first application is displayed in the sidebar, and a second graphical user interface of the first application is displayed in response to a trigger operation on the pending data, the second graphical user interface of the first application is displayed in response to a triggering operation on the pending data. , used to process the data to be processed.
When the user faces the first graphical user interface, he can directly contact the pending data in the sidebar of the system to quickly display the second graphical user interface for processing, thereby improving the application of the system sidebar to the current display. The auxiliary effect of the program.
Smart Images

Figure CN115220828B_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present application relate to the field of computer technology, and in particular to a method, device, terminal and storage medium for displaying a sidebar. Background Art
[0002] The system sidebar is a control container provided by the operating system of the mobile terminal. The system sidebar can display application icons or navigation buttons that users often use.
[0003] In the related art, the icon of the social program can be placed in the system sidebar. When the user is playing a game or watching a video in full screen, the user can reply to the message in a floating window by clicking the icon of the social program in the system sidebar. Summary of the invention
[0004] The embodiment of the present application provides a method, device, terminal and storage medium for displaying a sidebar. The technical solution is as follows:
[0005] According to one aspect of the present application, a method for displaying a sidebar is provided, the method comprising:
[0006] displaying a first graphical user interface of a first application;
[0007] Displaying a system sidebar in an edge area of the display screen, wherein the system sidebar displays to-be-processed data recommended for the first application;
[0008] In response to a trigger operation on the data to be processed, a second graphical user interface of the first application is displayed, where the second graphical user interface is an interface for processing the data to be processed.
[0009] According to another aspect of the present application, a sidebar display device is provided, the device comprising:
[0010] A first interface display module, used to display a first graphical user interface of a first application;
[0011] A sidebar display module, used for displaying a system sidebar in an edge area of a display screen, wherein the system sidebar displays the to-be-processed data recommended for the first application program;
[0012] The second interface display module is used to display a second graphical user interface of the first application in response to a trigger operation on the data to be processed, where the second graphical user interface is an interface for processing the data to be processed.
[0013] According to another aspect of the present application, a terminal is provided, comprising a processor and a memory, wherein the memory stores at least one instruction, and the instruction is loaded and executed by the processor to implement a sidebar display method as provided in various aspects of the present application.
[0014] According to another aspect of the present application, a computer-readable storage medium is provided, wherein at least one instruction is stored in the storage medium, and the instruction is loaded and executed by a processor to implement a sidebar display method as provided in various aspects of the present application.
[0015] According to one aspect of the present application, a computer program product is provided, the computer program product comprising computer instructions, the computer instructions being stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the method provided in the above-mentioned display content aspect or various optional implementations of the display content aspect.
[0016] When displaying the first graphical user interface of the first application, the present application can display a system sidebar in the edge area of the display screen, and the system sidebar displays the to-be-processed data recommended for the first application. Subsequently, if a trigger operation is generated on the to-be-processed data, the present application can respond to the trigger operation and display the second graphical user interface of the first application, and the second graphical user interface is an interface for processing the to-be-processed data. Since the present application can simultaneously display the first graphical user interface and the to-be-processed data in the system sidebar, the user can directly trigger the to-be-processed data in the system sidebar when facing the first graphical user interface, so as to quickly display the second graphical user interface for processing the to-be-processed data, thereby improving the auxiliary effect of the system sidebar on the currently displayed application. BRIEF DESCRIPTION OF THE DRAWINGS
[0017] In order to more clearly introduce the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments of the present application will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0018] Figure 1 is a structural block diagram of a terminal provided by an exemplary embodiment of the present application;
[0019] Figure 2 is a schematic diagram of a system sidebar provided in an embodiment of the present application;
[0020] Figure 3is a flow chart of a sidebar display method provided by an exemplary embodiment of the present application;
[0021] Figure 4 is a flow chart of a method for displaying a sidebar provided by another exemplary embodiment of the present application;
[0022] Figure 5 is based on Figure 4 A schematic diagram of a display mode of a system sidebar provided in the illustrated embodiment;
[0023] Figure 6 It is a user interface for displaying a document editing program and a sidebar simultaneously provided by an embodiment of the present application;
[0024] Figure 7 is a flow chart of a method for displaying a sidebar provided by another exemplary embodiment of the present application;
[0025] Figure 8 is based on Figure 7 The illustrated embodiment provides a user interface for a shopping program;
[0026] Fig. 9 It is a user interface for displaying a social program and a system sidebar simultaneously, provided by an embodiment of the present application;
[0027] Fig.10 Another user interface provided by an embodiment of the present application for simultaneously displaying a social program and a system sidebar;
[0028] Fig.11 A user interface for displaying a shopping program and a system sidebar simultaneously provided by an embodiment of the present application;
[0029] Fig.12 It is a user interface for displaying a financial management program and a system sidebar simultaneously, provided by an embodiment of the present application;
[0030] Fig.13 A user interface for simultaneously displaying an in-application game and a sidebar provided by a financial management program provided in an embodiment of the present application;
[0031] Fig.14 It is a structural block diagram of a sidebar display device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0032] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.
[0033] When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Instead, they are only examples of devices and methods consistent with some aspects of the present application as detailed in the attached claims.
[0034] In the description of the present application, it should be understood that the terms "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or implying relative importance. In the description of the present application, it should be noted that, unless otherwise clearly specified and limited, the terms "connected" and "connected" should be understood in a broad sense. For example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be directly connected or indirectly connected through an intermediate medium. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood according to specific circumstances. In addition, in the description of the present application, unless otherwise specified, "multiple" means two or more. "And / or" describes the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the objects associated before and after are in an "or" relationship.
[0035] As used herein, the term "if" is optionally interpreted as "when ...", "upon ...", "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrase "if it is determined that ..." or "if (stated condition or event) is detected" or "in response to detecting (stated condition or event)", depending on the context.
[0036] It should be noted that the use of personally identifiable information should be subject to privacy policies and practices that are generally recognized to meet or exceed industry or government requirements for maintaining user privacy. Specifically, the nature of authorized use of personally identifiable information should be clearly stated to users during the management and processing of personally identifiable information to minimize the risk of unintentional or unauthorized access or use.
[0037] Exemplarily, the display method of the sidebar shown in the embodiment of the present application can be applied in a terminal having a display screen and a sidebar display function. The terminal may include a mobile phone, a tablet computer, a laptop computer, a desktop computer, an all-in-one computer, a server, a workstation, a television, a set-top box, smart glasses, a smart watch, a digital camera, an MP4 player terminal, an MP5 player terminal, a learning machine, a point-reading machine, an electronic paper book, an electronic dictionary, a vehicle-mounted terminal, a virtual reality (VR) player terminal or an augmented reality (AR) player terminal, etc.
[0038] See also Figure 1 , Figure 1 is a structural block diagram of a terminal provided by an exemplary embodiment of the present application, such as Figure 1 As shown, the terminal includes a processor 120 and a memory 140, wherein the memory 140 stores at least one instruction, and the instruction is loaded and executed by the processor 120 to implement the sidebar display method as described in the various method embodiments of the present application.
[0039] In the present application, the terminal 100 displays a first graphical user interface of a first application; displays a system sidebar in an edge area of the display screen, and the system sidebar displays data to be processed recommended for the first application; and displays a second graphical user interface of the first application in response to a trigger operation on the data to be processed, and the second graphical user interface is an interface for processing the data to be processed.
[0040] The processor 120 may include one or more processing cores. The processor 120 uses various interfaces and lines to connect various parts of the entire terminal 100, and executes various functions and processes data of the terminal 100 by running or executing instructions, programs, code sets or instruction sets stored in the memory 140, and calling data stored in the memory 140. Optionally, the processor 120 can be implemented in at least one hardware form of digital signal processing (DSP), field-programmable gate array (FPGA), and programmable logic array (PLA). The processor 120 can integrate one or a combination of a central processing unit (CPU), a graphics processing unit (GPU), and a modem. Among them, the CPU mainly processes the operating system, user interface, and application programs; the GPU is responsible for rendering and drawing the content to be displayed on the display screen; and the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 120, but may be implemented separately through a chip.
[0041] The memory 140 may include a random access memory (RAM) or a read-only memory (ROM). Optionally, the memory 140 includes a non-transitory computer-readable storage medium. The memory 140 may be used to store instructions, programs, codes, code sets, or instruction sets. The memory 140 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the following various method embodiments, etc.; the data storage area may store data involved in the following various method embodiments, etc.
[0042] See also Figure 2 , Figure 2 is a schematic diagram of a system sidebar provided in an embodiment of the present application. Figure 2 As a possible display mode, the system sidebar 210 includes an intelligent recommendation area 211. In the intelligent recommendation area 211, data to be processed is displayed.
[0043] Optionally, the system sidebar 210 may also include a smart recommendation area 211 and an application recommendation area 212. The application recommendation area 212 is used to display application internal objects. The application internal objects are controls or information originally displayed in a graphical user interface in the first application.
[0044] Optionally, the system sidebar 210 may also include an intelligent recommendation area 211 and an efficient tool area 213. The efficient tool area 213 is used to display service progress information, which is used to indicate the status of the service in progress, and the service progress information is dynamically updated.
[0045] Optionally, the system sidebar 210 may also include a smart recommendation area 211 and a voice assistant button 214. The voice assistant button 214 is used to invoke the voice assistant when triggered. The voice assistant can interact with the user interface voice, thereby achieving the effect of the user controlling the terminal by voice.
[0046] Based on the above possible implementation solutions, the system sidebar 210 can also simultaneously include an intelligent recommendation area 211, an application recommendation area 212, an efficient tool area 213 and a voice assistant button 214.
[0047] In summary of the possible display forms of the system sidebar 210, the system sidebar 210 can display the smart recommendation area 211 alone, or can display both the smart recommendation area 211 and other content. Among them, the other content can be at least one of the application recommendation area 212, the efficient tool area 213 and the voice assistant button 214.
[0048] Schematically, which one or which areas / buttons are specifically displayed can be determined according to the type of the first application. For example, the terminal predetermines the correspondence between the type of application and the sidebar layout. When displaying the interface of the first application, the terminal obtains the program identifier of the first application, thereby displaying the sidebar of the corresponding layout; the terminal can also learn the user's usage habits and adjust the content displayed in the sidebar according to the user's usage habits; further, the user can also manually edit the content displayed in each area of the sidebar according to his or her preferences. In some embodiments, the layout of each area of the sidebar can also be determined by the first graphical user interface. For example, different sidebar layouts are displayed for different interfaces of the same application to further improve the interaction efficiency between the user and the terminal.
[0049] Optionally, when the terminal predetermines the correspondence between the type of application and the sidebar layout, the correspondence can be stored locally or in a cloud server. It should be noted that the correspondence can be a correspondence between the identifier of the application, the type of application, and the sidebar layout. For example, see the content shown in Table 1.
[0050]
[0051] Table 1
[0052] As shown in Table 1, the terminal can pre-store a table of corresponding relationships. When the terminal obtains the identifier of the first application, that is, the installation package name in Table 1, the terminal can learn the type of the first application. In addition, the terminal can further obtain the sidebar layout corresponding to the first application. In the example shown in Table 1, the sidebar layouts corresponding to the same type of application are the same. For example, the sidebar layouts corresponding to two different social chat types, Happy Chat (happychat.apk) and Tuchat (Tuchat.apk), are the same, both of which are layout 1.
[0053] In the embodiment of the present application, the configuration parameters required for different layouts may be pre-stored in the terminal.
[0054] Optionally, when the first application is fixed, the content displayed in the sidebar layout may also change accordingly due to different users. For example, the terminal can record the frequently used content in the sidebar, and subsequently adjust the sidebar layout according to the frequency of use. For example, the display area of the area with higher frequency of use is increased, and the display area of the area with lower frequency of use is reduced. Alternatively, for the same display area, the controls with higher frequency of use are displayed in the front, and the controls with lower frequency of use are displayed in the back.
[0055] Optionally, the sidebar can also enter an edit mode. When the sidebar is in the edit mode, the user can manually adjust the display area of each area and / or the display order of each control in the sidebar according to their needs.
[0056] Please refer to Figure 3 , Figure 3 FIG. 1 is a flowchart of a method for displaying a sidebar provided by an exemplary embodiment of the present application. The method for displaying a sidebar can be applied in the terminal shown above. Figure 3 In , the sidebar display methods include:
[0057] Step 310: Display a first graphical user interface of a first application.
[0058] In an embodiment of the present application, the terminal is a terminal with a display screen, and a user interface (UI) can be displayed on the display screen. An application with a UI can be installed and run in the terminal. When the terminal runs a first application, the terminal will display a first graphical user interface of the first application.
[0059] Optionally, the first graphical user interface may be a main interface in the first application, or may be a sub-interface in the first application.
[0060] Optionally, the first graphical user interface may be an interface for displaying static content, or an interface for playing dynamic content.
[0061] Step 320: Display a system sidebar in an edge area of the display screen, wherein the system sidebar displays the to-be-processed data recommended for the first application.
[0062] In the embodiment of the present application, the system sidebar may be displayed under the instruction of the user's outgoing operation. In practice, when the user performs an outgoing operation, an outgoing instruction is triggered in the terminal, and the outgoing instruction instructs the terminal to display the system sidebar.
[0063] Optionally, the outgoing call instruction may be triggered by a human-computer interaction operation between the user and the terminal, wherein the human-computer interaction operation may include any one or more of a touch operation, a gesture or a voice.
[0064] Optionally, when the human-computer interaction operation is a touch operation, the touch operation includes but is not limited to clicking, long pressing, dragging, pressing a large area, pressing hard, touching a specified track, or touching a knuckle, etc. When the terminal determines that the received human-computer interaction operation matches the preset human-computer interaction operation, an outgoing instruction associated with the preset human-computer interaction operation is generated. The outgoing instruction is used to display the system sidebar.
[0065] The system sidebar is a virtual container provided by the operating system in the terminal, and the virtual container is used to place content, and the content includes operable controls and / or information. Optionally, the information may include at least one of text, images, video or audio.
[0066] Illustratively, the system sidebar may be displayed against the left edge of the display screen, or against the right edge of the display screen.
[0067] Step 330 , in response to a trigger operation on the data to be processed, display a second graphical user interface of the first application, where the second graphical user interface is an interface for processing the data to be processed.
[0068] In the embodiment of the present application, after displaying the sidebar, the operating system can respond to the trigger operation on the pending data to display the second graphical user interface of the first application. It should be noted that when the system is able to display the second graphical user interface when the pending data in the system sidebar is triggered, the efficiency of the user opening the second graphical user interface is improved, as described below.
[0069] In the related art, the process of switching from displaying a first graphical user interface of a first application to displaying a second graphical user interface of a terminal is as follows: first, the first graphical user interface is displayed on the display screen, and then the user actively searches for a page entry for opening the second graphical user interface in the first graphical user interface. After the user clicks on the page entry, the terminal switches to the second graphical user interface. Thereafter, the user inputs the data to be processed in the relevant information input interface of the second graphical user interface.
[0070] However, the present application enables the terminal to automatically push the data to be processed in the background. Without changing the first user graphical interface, the data to be processed is displayed in the system sidebar, and when the user triggers the data to be processed, the second graphical user interface can be directly opened, thereby improving the operation efficiency.
[0071] In summary, when displaying the first graphical user interface of the first application, this embodiment can display a system sidebar in the edge area of the display screen, and the system sidebar displays the to-be-processed data recommended for the first application. Subsequently, if a trigger operation is generated on the to-be-processed data, the present application can respond to the trigger operation and display the second graphical user interface of the first application, and the second graphical user interface is an interface for processing the to-be-processed data. Since the present application can simultaneously display the first graphical user interface and the to-be-processed data in the system sidebar, the user can directly trigger the to-be-processed data in the system sidebar when facing the first graphical user interface, so as to quickly display the second graphical user interface for processing the to-be-processed data, thereby improving the auxiliary effect of the system sidebar on the currently displayed application.
[0072] Based on the solution disclosed in the previous embodiment, the terminal can also have different implementation solutions according to different data to be processed. When the data to be processed includes files, please refer to the following embodiment.
[0073] See also Figure 4 , Figure 4 FIG. 1 is a flow chart of a method for displaying a sidebar provided by another exemplary embodiment of the present application. The method for displaying a sidebar can be applied in the terminal shown above. Figure 4 In the display method of the sidebar, the display method of the sidebar includes:
[0074] Step 401: display a first graphical user interface of a first application.
[0075] In the present application, the execution process of step 401 is the same as the execution process of step 310, which will not be repeated here.
[0076] Step 402: According to the file formats supported by the first application program, searching the operating system for files that conform to the file formats.
[0077] Optionally, the terminal is able to determine the file formats that the first application supports to open. In one possible manner, the operating system in the terminal is able to identify the installation package of the first application when the first application is installed. Subsequently, the operating system determines the file formats that the first application supports to open through a cloud database query, and saves the file formats locally. In another possible manner, the operating system in the terminal does not usually save the file formats that the first application supports to open in advance. When the operating system needs to determine the file formats that the first application supports to open, the operating system will determine the file formats that the first application supports to open through the cloud database.
[0078] It should be noted that both of the above methods are actually implementable solutions. The data of the first implementation method is stored locally, so that the terminal can implement the sidebar display solution provided by this application in an offline state. The data of the second implementation method is stored in the cloud, and the data is obtained from the cloud in real time when the operating system needs it, saving local storage space.
[0079] After the terminal determines that the first application supports opening the file format, the terminal can query the operating system for files that conform to the file format. It should be noted that the operating system in this application has full file access rights and matches files that conform to the specified file format among the accessible files.
[0080] It should be noted that, due to the limited display space of the system sidebar, after determining the files that meet the file format, the terminal can also sort the files by importance. The conditions for sorting the files by importance can include the last modification time or the number of accesses.
[0081] In one possible manner, if the condition for sorting the file importance is the last modification time, the terminal can preferentially display the files whose last modification time is closest to the current system time among the files conforming to the file format in the system sidebar.
[0082] In another possible manner, if the condition for sorting the importance of files is the number of accesses, the terminal can preferentially display the files with the most accesses in the system sidebar.
[0083] Step 403: Display a system sidebar in the edge area of the display screen, and the system sidebar displays files that conform to the file format.
[0084] In an embodiment of the present application, the terminal can display a system sidebar in an edge area of a display screen. It should be noted that the edge area can be an area pre-designed by a designer on a display screen close to the edge of the display screen. In one possible manner, when the display screen is a rectangular screen or a nearly rectangular screen, the terminal can use a long strip area close to one side of the display screen as an edge area.
[0085] For example, the terminal may use a strip area with a width of 500 pixels close to the edge area as the edge area. In another possible design, the terminal may use an area close to the edge of the display screen and occupying a specified percentage of the width of the display screen as the edge area. For example, the terminal uses a strip area close to the right edge of the display screen and occupying 30% of the total width as the edge area. Alternatively, the terminal uses a strip area close to the left edge of the display screen and occupying 30% of the total width as the edge area.
[0086] In an embodiment of the present application, the terminal can display a system sidebar in the edge area. The system sidebar can be called out and displayed under the instruction of the user. In another possible manner, the system sidebar can also be an area resident in the terminal display screen and does not change with the change of the first user interface.
[0087] See also Figure 5 , Figure 5 is based on Figure 4 The illustrated embodiment provides a schematic diagram of a display method of a system sidebar. In display state 510, the system sidebar 210 of the terminal is permanently displayed on the display screen. Regardless of whether the user interface displayed by the terminal is the desktop or the user interface of an ordinary application, the system sidebar 210 will be permanently displayed. Among them, in this display state, if the application enters a full-screen user interface, the terminal can display or hide the system sidebar 210. Optionally, whether the system sidebar is permanently resident can also be controlled by the user. Among them, when the system sidebar resident button is triggered, the terminal will control the system sidebar to be resident on the display screen. The shape of the resident button after being triggered can be seen in Figure 5 Button 511 in.
[0088] In the display state 520, the system sidebar 210 of the terminal can be displayed on the display screen when receiving a call-out operation from the user, and can then be closed when receiving a close operation from the user. Figure 5 Button 521 in.
[0089] Step 404, in response to a trigger operation on the file, displaying a second graphical user interface of the first application, the second graphical user interface being a file viewing interface or a file editing interface after the file is loaded.
[0090] In a possible implementation, the terminal can display the file through the second graphical user interface.
[0091] In this example, the file may be at least one of a document file, a spreadsheet file, a slide file, a picture file, a video file, an audio file, or an email file that can be viewed.
[0092] In another possible implementation, the terminal can display a file editing interface for editing a file through a second graphical user interface.
[0093] In this example, the file may be at least one of a document file, a spreadsheet file, a slide file, a picture file, a video file, an audio file, or an email file that can be edited.
[0094] In a specific implementation, the terminal can display the corresponding second graphical user interface in the following ways. Please refer to the following introduction.
[0095] In case 1, the first application is a document editing program, and the file is a document file.
[0096] See also Figure 6 , Figure 6 This is a user interface that displays a document editing program and a sidebar simultaneously, provided by an embodiment of the present application. Figure 6 In the example, the first application is a document editing program named Notebook. In the second graphical user interface 6A, the editing interface of the document file "Creating a Comfortable Space" is displayed. Document file 1, document file 2, and document file 3 are displayed in the system sidebar 210. Schematically, the system sidebar 210 can also display a voice assistant button 214, and display a first background 601, a second background 602, a third background 603, and a fourth background 604 in the application recommendation area. In addition, the terminal displays a first service progress information 605 and a second service progress information 606 in the efficient tool area. In Figure 6 In the example, the first service progress information 605 is used to indicate the current recording progress. The second service progress information 606 is used to indicate the current taxi-hailing progress.
[0097] Optionally, the system sidebar can also display the user's frequently used applications, for example, frequently used social programs 607 , frequently used games 608 , frequently used shopping programs 609 , first frequently used video software 610 , second frequently used video software 611 , and frequently used office software 612 .
[0098] Case 2: The first application is a spreadsheet editing program, and the file is a spreadsheet file.
[0099] Similar to Figure 6 The second graphical user interface displays a table file. The system sidebar displays multiple table files recommended by the operating system, not Figure 6 In addition to the above differences, the contents of the user interface when the first application is a table editing program can all refer to Figure 6 The user interface shown.
[0100] Case 3: The first application is a slide show editing program, and the file is a slide show file.
[0101] Similar to Figure 6 The second graphical user interface displays a slideshow file. The system sidebar displays multiple slideshow files recommended by the operating system, not Figure 6 In addition to the above differences, the contents of the user interface when the first application is a slide editing program can all refer to Figure 6 The user interface shown.
[0102] Case 4: The first application is a multimedia editing program, and the file is at least one of a video or an audio.
[0103] In this case, something like Figure 6 The second graphical user interface shows a user interface for editing videos or audios. The system sidebar shows multiple editable videos or audios recommended by the operating system, rather than Figure 6 In addition to the above differences, the contents of the user interface when the first application is a multimedia editing program can all refer to Figure 6 The user interface shown.
[0104] Case 5: The first application is a program that supports code scanning, and the file is a graphic code file.
[0105] In this example, the first application is a program that supports code scanning. The graphic code file here can be any file such as a barcode, a QR code or a graphic code.
[0106] To sum up, when the data to be processed displayed in the system sidebar is a file, this embodiment can determine the file in the operating system that conforms to the file format based on the file format supported by the first application, and display the file in the system sidebar. At the same time, when the file is triggered, the file viewing interface or file editing interface after the file is loaded is displayed in the second image user interface of the first application, thereby improving the efficiency of users viewing files, or improving the efficiency of users opening files to be edited.
[0107] Based on the solution disclosed in the previous embodiment, the terminal can also have different implementation solutions according to different data to be processed. When the data to be processed includes a character string, please refer to the following embodiment.
[0108] See also Figure 7 , Figure 7 FIG. 1 is a flow chart of a method for displaying a sidebar provided by another exemplary embodiment of the present application. The method for displaying a sidebar can be applied in the terminal shown above. Figure 7 In the display method of the sidebar, the display method of the sidebar includes:
[0109] Step 701: display a first graphical user interface of a first application.
[0110] In the present application, the execution process of step 701 is the same as the execution process of step 310, which will not be repeated here.
[0111] Step 702: According to the encoding format supported by the first application, search the clipboard for a character string that complies with the encoding format.
[0112] Optionally, the terminal can determine the encoding format supported by the first application. The supported encoding format includes an encoding format that can be parsed by the first application. In one possible manner, the encoding format can be an encoding format with a specified keyword. For example, the terminal can process an encoding format including a specified field herf / / . It should be noted that the specified field can be any possible string.
[0113] Illustratively, the clipboard shown in the present application can be a system clipboard provided by the operating system. The system clipboard provided by the operating system can contain text and other content. For example, the system clipboard can also include pictures, audio or video.
[0114] In this application, the corresponding string can be queried from the text part in the system clipboard.
[0115] Step 703: Display a system sidebar in the edge area of the display screen, and the system sidebar displays a character string that complies with the encoding format.
[0116] In the present application, a string that conforms to the encoding format can be directly displayed in the system sidebar. In one possible display mode, the string that conforms to the encoding format can be completely displayed in the system sidebar. In another possible display mode, the string that conforms to the encoding format can be partially displayed in the system sidebar, and the rest is hidden, so as to avoid taking up too much space in the system sidebar.
[0117] Step 704 , in response to a trigger operation on the character string, display a second graphical user interface of the first application, where the second graphical user interface is a user interface obtained by parsing the information carried in the character string.
[0118] In the present application, the character string in the system sidebar can be triggered by a trigger operation of the user. Among them, the trigger operation may include operation modes such as clicking, long pressing or heavy pressing. In response to the trigger operation on the character string, the terminal displays the second graphical user interface of the first application. It should be noted that the second graphical user interface is the user interface after the information carried in the character string is parsed. Among them, if the first application has the ability to parse the information carried in the character string, the first application will parse and process the information carried in the character string, and the user interface obtained after parsing and processing the information is the second graphical user interface.
[0119] It should be noted that the second graphical user interface includes multiple display modes. In one possible mode, the second graphical user interface and the first graphical user interface are displayed in split screen. In another possible mode, the second graphical user interface is displayed in full screen. In yet another possible mode, the second graphical user interface is displayed in a floating window.
[0120] In a specific implementation, the terminal can display the corresponding second graphical user interface in the following ways. Please refer to the following introduction.
[0121] Case 1: The first application is a shopping application, and the string includes a product link.
[0122] In this application, when the first application is a shopping application, the string may include a product link. It should be noted that after the product link is clicked, the system sidebar may no longer display the product link, but display other content related to the product. For example, see Figure 8 , Figure 8 is based on Figure 7 The embodiment shown provides a user interface for a shopping program. Figure 8 In the second graphical user interface 810, the details interface of the product is displayed. The main display content includes the introduction video and pictures of the product. Below the introduction video and pictures of the product, the price, name, preferential activities, sales volume and collection status of the product can be included. At the same time, the second graphical user interface 810 also displays a purchase button, an add to cart button, a store homepage button, a customer service button and a collection button.
[0123] In the system sidebar 210, the voice assistant button 214, coupon control 811, price trend chart 812 and price comparison button 813 are displayed, which are strongly related to the second graphical user interface currently displayed. On this basis, the terminal can also display sharing controls. For example, Figure 8 The eight sharing controls displayed are buttons for sharing to App 1, App 2, App 3, or App 4, as well as a copy link control, a price comparison control for multiple products, a pictorial sharing control, and a face-to-face sharing control.
[0124] Illustratively, the product link may be a link that can only be parsed by a shopping program. In actual application scenarios, the product link may also be referred to as a product password, which is not limited in the present application embodiment.
[0125] in addition, Figure 8 Also displayed is second service progress information 606, which is used to indicate the current taxi-hailing progress. And, Figure 8 It can also display the launch icons of recently used applications. When these launch icons are triggered, the terminal will launch the corresponding application.
[0126] Case 2: The first application is a contact book application, and the character string includes at least one of a contact number, an email address, or a social account.
[0127] In this example, when the first application is a contact book application, the operating system can process at least one of a contact number, an email address, or a social account as a string as shown in the present application. In response to the user clicking on the string in the system sidebar, the terminal automatically creates corresponding contact information in the second graphical user interface and fills the corresponding string into the corresponding position.
[0128] Case 3: The first application is a map application or a taxi-hailing application, and the string includes location information.
[0129] In this example, when the first application is a map application or a taxi application, the character string displayed in the system sidebar includes location information. In the actual execution process, the operating system can pre-establish a location vocabulary. Based on the location vocabulary, the operating system can have the function of identifying the location.
[0130] In the system sidebar provided in the present application, the system sidebar can also display an application internal object, which is information or a subroutine provided by the first application. In one possible manner, the application internal object can be information, which can be displayed in the form of a news push or in the form of a list.
[0131] In another possible way, the internal object of the application can also be a subprogram. In actual application, the subprogram can be a small program of the application program, such as a small program integrated in a social chat application, or a small program integrated in a payment application.
[0132] As for the internal objects of the application, the operating system can determine the internal objects of the application with different contents when the first application program is different, as described below.
[0133] Example 1: The start icon of the sub-program can be directly displayed in the system sidebar, and the start icon will start the sub-program of the first application after being triggered.
[0134] It should be noted that the development authority of the subprogram in the first application program may be open to other companies or groups by the owner of the first application program.
[0135] Example 2: A news list may be displayed in the system sidebar, and at least two pieces of news may be displayed in the news list. It should be noted that when the first application is a news or knowledge-based application that provides content, the system sidebar may display the news list provided by the application.
[0136] Optionally, the information list includes but is not limited to a hot search list or a hot news list.
[0137] Example three, when the first application Chen Xu is a shopping program, the product browsing history is displayed in the system sidebar so that the user can quickly recall the products he has viewed and make related operations.
[0138] Example 4: The terminal can display the contact information in the first application in the system sidebar.
[0139] In the present application, if the first application has a social function and can add contact friends and other information, the contact information in the first application can be displayed in the system sidebar.
[0140] Example 5: When the first application is a social program, the terminal can display a page entry of a blog in the social program in the system sidebar. When the page entry is triggered, the terminal will display the blog in the social program.
[0141] Example six: When the first application is a financial management program, at least one of asset information, bills, or payment codes in the financial management program may be displayed in the system sidebar.
[0142] To summarize the above six examples, the information of the internal objects of the application needs to be provided by the first application to the operating system. After the operating system obtains the information of the corresponding internal objects of the application through a preset data interface, it will generate corresponding content and display it in the system operation bar.
[0143] In another display mode of the present application, the system sidebar can also display service progress information, which is used to indicate the status of the service in progress, and the service progress information will be dynamically updated. In a possible mode, the update mode of the service progress information includes triggered update and periodic update.
[0144] When the updating mode of the service progress information is a triggered updating, when the user clicks the area where the service progress information is displayed, the terminal will update the service accuracy information.
[0145] When the updating mode of the service progress information is periodic updating, the terminal will update the service progress information according to the updating cycle.
[0146] In this application, regarding the display position of the service progress information in the system sidebar, there can be the following two display modes.
[0147] In a possible display method of the service progress information, the terminal obtains the display direction of the system sidebar; determines the bottom area of the system sidebar according to the display direction of the system sidebar; and displays the service progress information in the bottom area.
[0148] In another possible display method of the service progress information, the terminal obtains a touch point corresponding to an outgoing instruction; the service progress information is displayed based on the position of the touch point, and the outgoing instruction is used to call out the system sidebar.
[0149] Illustratively, a voice assistant button may also be displayed in the system sidebar, and the voice assistant button is used to invoke the voice assistant when triggered.
[0150] In summary, the sidebar display method of the embodiment of the present application can display the second graphical user interface of the first application when the data to be processed includes a string and the string is triggered. The second graphical user interface is a user interface after parsing the information carried in the string. In this scenario, the first application can quickly and intelligently open the second graphical user interface that the user is more likely to open, thereby improving the system sidebar's ability to improve efficiency for different applications.
[0151] Optionally, the system sidebar can also expand the application's ability to display content information by displaying subroutines or information within the system, making it easier for users to quickly obtain important information within the application.
[0152] Optionally, the system sidebar can also display a voice assistant, so that the user can quickly call out the voice assistant and control the terminal by voice.
[0153] Optionally, the system sidebar may also display service progress information, so that the system sidebar can display the status of services currently in progress, thereby improving the efficiency of users obtaining information about services in progress.
[0154] Illustratively, the display content of the system sidebar in the embodiment of the present application is introduced below through several implementation schemes.
[0155] See also Fig. 9 , Fig. 9 This is a user interface for displaying a social program and a system sidebar simultaneously, provided by an embodiment of the present application. Fig. 9 In the example, the social program displays a chat interface. The content displayed in the system sidebar includes a voice assistant button 214, a mini program icon, a first article 911 being read, and a second article 912 being read. It should be noted that both the first article 911 and the second article 912 are pages within the social program.
[0156] In the system sidebar, the terminal can also display the content on the system clipboard. In addition, the terminal can also display the ongoing taxi service and several applications that the user frequently opens in the system sidebar.
[0157] See also Fig.10 , Fig.10 Another user interface provided by the embodiment of the present application for simultaneously displaying a social program and a system sidebar. Fig.10 In the example, the social program displays a chat interface. The content displayed in the system sidebar includes a voice assistant button 214, a typing association emoticon package, a table file 1001, a document file 1002, a slide file 1003 and a blog content 1004 received by the social program.
[0158] In the system sidebar, the terminal can also display the content on the system clipboard. In addition, the terminal can also display the ongoing taxi service and several applications that the user frequently opens in the system sidebar.
[0159] See also Fig.11 , Fig.11 This is a user interface that displays a shopping program and a system sidebar simultaneously, provided by an embodiment of the present application. Fig.11 In the example, the shopping program displays the main page of the program. In the system sidebar, the terminal displays a first group purchase progress message 1101 and a second group purchase progress message 1102. Also, the coupon column displayed by the terminal includes 4 different coupons.
[0160] In the system sidebar, the terminal can also display the content on the system clipboard. In addition, the terminal can also display the ongoing taxi service and several applications that the user frequently opens in the system sidebar.
[0161] See also Fig.12 , Fig.12 It is a user interface provided by an embodiment of the present application that displays a financial management program and a system sidebar simultaneously. Fig.12 In the financial management program, the main page of the financial management program is displayed. In the system sidebar, the terminal displays asset information, bills, and common contacts. Among them, asset information and bills are both internal objects of the application, and common contacts can also be information provided by the financial management program.
[0162] In the system sidebar, the terminal can also display the content on the system clipboard. In addition, the terminal can also display the ongoing taxi service and several applications that the user frequently opens in the system sidebar.
[0163] See also Fig.13 , Fig.13 This is a user interface for displaying an in-application game and a sidebar simultaneously provided by a financial management program provided by an embodiment of the present application. Fig.13 In the system sidebar, payment QR codes, frequently used contacts, and mini-programs in the financial management program are displayed.
[0164] In the system sidebar, the terminal can also display the content on the system clipboard. In addition, the terminal can also display the ongoing taxi service and several applications that the user frequently opens in the system sidebar.
[0165] The following is an embodiment of the device of the present application, which can be used to execute the embodiment of the method of the present application. For details not disclosed in the embodiment of the device of the present application, please refer to the embodiment of the method of the present application.
[0166] Please refer to Fig.14 , Fig.14 This is a structural block diagram of a sidebar display device provided by an exemplary embodiment of the present application. The sidebar display device can be implemented as all or part of a terminal through software, hardware, or a combination of both. The device includes:
[0167] The first interface display module 1410 is used to display a first graphical user interface of a first application program;
[0168] A sidebar display module 1420, configured to display a system sidebar in an edge area of a display screen, wherein the system sidebar displays the to-be-processed data recommended for the first application program;
[0169] The second interface display module 1430 is used to display a second graphical user interface of the first application in response to a trigger operation on the data to be processed, where the second graphical user interface is an interface for processing the data to be processed.
[0170] In an optional embodiment, the data to be processed involved in the device includes files, and the second interface display module 1430 is used to display a second graphical user interface of the first application in response to a trigger operation on the file, and the second graphical user interface is a file viewing interface or a file editing interface after the file is loaded.
[0171] In an optional embodiment, the sidebar display module 1420 is used to query the operating system for files that conform to the file format supported by the first application for opening; and display the system sidebar in the edge area of the display screen, wherein the system sidebar displays files that conform to the file format.
[0172] In an optional embodiment, the first application is a document editing program, and the file is a document file; or, the first application is a table editing program, and the file is a table file; or, the first application is a slide editing program, and the file is a slide file; or, the first application is a multimedia editing program, and the file is at least one of video or audio; or, the first application is a program that supports code scanning, and the file is a graphic code file.
[0173] In an optional embodiment, the data to be processed involved in the device includes a character string; the second interface display module 1430 is used to display a second graphical user interface of the first application in response to a trigger operation on the character string, and the second graphical user interface is a user interface after parsing the information carried in the character string.
[0174] In an optional embodiment, the sidebar display module 1420 is used to query the clipboard for a character string that conforms to the encoding format supported by the first application; and display the system sidebar in the edge area of the display screen, and the system sidebar displays the character string that conforms to the encoding format.
[0175] In an optional embodiment, the first application is a shopping program, and the character string includes a product link; or, the first application is an address book program, and the character string includes at least one of a contact number, an email address, or a social account; or, the first application is a map program or a taxi program, and the character string includes location information.
[0176] In an optional embodiment, the device further includes an object display module, wherein the object display module is used to display application internal objects in a system sidebar, wherein the application internal objects are information or subroutines provided by the first application program.
[0177] In an optional embodiment, the object display module is used to display a launch icon in the system sidebar, the launch icon is used to launch a subroutine of the first application; or, to display an information list in the system sidebar, the information list is used to display at least two pieces of information; or, in response to the first application being a shopping program, to display a product browsing history in the system sidebar; or, to display contact information in the first application in the system sidebar; or, in response to the first application being an office program, to display at least one of a background template, an image, text, audio or video in the system sidebar; or, in response to the first application being a social program, to display a page entrance to a blog in the social program in the system sidebar; or, in response to the first application being a financial management program, to display at least one of asset information, a bill or a payment code in the system sidebar.
[0178] In an optional embodiment, the device further comprises a progress display module, which is used to display service progress information in the system sidebar, wherein the service progress information is used to indicate the status of the service in progress, and the service progress information is dynamically updated.
[0179] In an optional embodiment, the progress display module is used to obtain the display direction of the system sidebar; determine the bottom area of the system sidebar according to the display direction of the system sidebar; display the service progress information in the bottom area; or, obtain the touch point corresponding to the outgoing instruction; display the service progress information based on the position of the touch point, and the outgoing instruction is used to call out the system sidebar.
[0180] In an optional embodiment, the device also includes a voice assistant display module, which is used to display a voice assistant button in the system sidebar, and the voice assistant button is used to invoke the voice assistant when triggered.
[0181] In summary, the sidebar display device of the embodiment of the present application can display the second graphical user interface of the first application when the data to be processed includes a character string and the character string is triggered. The second graphical user interface is a user interface after parsing the information carried in the character string. In this scenario, the first application can quickly and intelligently open the second graphical user interface that the user is more likely to open, thereby improving the system sidebar's ability to improve efficiency for different applications.
[0182] Optionally, when the data to be processed displayed in the system sidebar in this embodiment is a file, the file that conforms to the file format in the operating system can be determined based on the file format supported by the first application, and the file can be displayed in the system sidebar. At the same time, when the file is triggered, the file viewing interface or file editing interface after the file is loaded is displayed in the second image user interface of the first application, thereby improving the efficiency of users viewing files, or improving the efficiency of users opening files to be edited.
[0183] An embodiment of the present application also provides a computer-readable medium, which stores at least one instruction, and the at least one instruction is loaded and executed by the processor to implement the sidebar display method described in the above embodiments.
[0184] It should be noted that: when the display device of the sidebar provided in the above embodiment executes the display method of the sidebar, only the division of the above functional modules is used as an example. In actual application, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the display device of the sidebar provided in the above embodiment and the embodiment of the display method of the sidebar belong to the same concept. The specific implementation process is detailed in the method embodiment and will not be repeated here.
[0185] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.
[0186] A person skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware or by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a disk or an optical disk, etc.
[0187] The above description is only an illustrative embodiment that can be implemented in the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application should be included in the scope of protection of the present application.
Claims
1. A method for displaying a sidebar, characterized in that: The method comprises: displaying a first graphical user interface of a first application; Displaying a system sidebar in an edge area of the display screen, the system sidebar comprising an intelligent recommendation area, an efficient tool area, an application recommendation area, and a voice assistant button, wherein the intelligent recommendation area displays to-be-processed data recommended for the first application, the efficient tool area displays service progress information, and the application recommendation area displays internal objects of the application; In response to a trigger operation on the data to be processed, displaying a second graphical user interface of the first application, wherein the second graphical user interface is an interface for processing the data to be processed; When the system sidebar is in editing mode, adjusting the display area of each area and / or the display order of each control in the sidebar based on a manual operation of the user; Among them, the internal application object is information or subroutine provided by the first application, the service progress information is used to indicate the status of the service in progress, and the service progress information is dynamically updated, and the voice assistant button is used to call up the voice assistant when triggered; the information of the internal application object is obtained from the first application by the operating system through a preset data interface; the system sidebar is displayed based on the sidebar layout corresponding to the type of the first application, and the sidebar layout is used to determine the distribution of areas and / or buttons displayed in the system sidebar; the layout of the system sidebar is adjusted based on the frequency of use of the areas and / or buttons included in the system sidebar.
2. The method according to claim 1, characterized in that The data to be processed includes files; The step of displaying a second graphical user interface of the first application in response to a trigger operation on the data to be processed comprises: In response to a trigger operation on the file, a second graphical user interface of the first application is displayed, where the second graphical user interface is a file viewing interface or a file editing interface after the file is loaded.
3. The method according to claim 2, characterized in that The displaying of the system sidebar in the edge area of the display screen includes: According to the file format supported by the first application program, searching the operating system for files that conform to the file format; The system sidebar is displayed in an edge area of the display screen, and the system sidebar displays files that conform to the file format.
4. The method according to claim 2, characterized in that: The first application is a document editing program, and the file is a document file; or, The first application is a table editing program, and the file is a table file; or, The first application is a slideshow editing program, and the file is a slideshow file; or, The first application is a multimedia editing program, and the file is at least one of a video or an audio; or, The first application is a program that supports code scanning, and the file is a graphic code file.
5. The method according to claim 1, characterized in that The data to be processed includes a character string; The step of displaying a second graphical user interface of the first application in response to a trigger operation on the data to be processed comprises: In response to a trigger operation on the character string, a second graphical user interface of the first application is displayed, where the second graphical user interface is a user interface obtained by parsing the information carried in the character string.
6. The method according to claim 5, characterized in that The displaying of the system sidebar in the edge area of the display screen includes: According to the encoding format supported by the first application, searching the clipboard for a character string that conforms to the encoding format; The system sidebar is displayed in an edge area of the display screen, and the system sidebar displays a character string that conforms to the encoding format.
7. The method according to claim 6, characterized in that The first application is a shopping application, and the character string includes a product link; or, The first application is a contact book application, and the character string includes at least one of a contact number, an email address, or a social account; or, The first application is a map application or a taxi-hailing application, and the character string includes location information.
8. The method according to claim 1, characterized in that The method further comprises: Displaying a startup icon in the system sidebar, wherein the startup icon is used to start a subroutine of the first application; or, Displaying an information list in the system sidebar, wherein the information list is used to display at least two pieces of information; or, In response to the first application being a shopping application, displaying a product browsing history in the system sidebar; or, Displaying contact information in the first application in the system sidebar; or, In response to the first application being an office program, displaying at least one of a background template, an image, text, audio, or video in the system sidebar; or, In response to the first application being a social program, displaying a page entry of a blog in the social program in the system sidebar; or, In response to the first application being a financial management program, at least one of asset information, bills, or payment codes is displayed in the system sidebar.
9. The method according to claim 1, characterized in that: The method further comprises: Obtaining a display direction of the system sidebar; determining a bottom area of the system sidebar according to the display direction of the system sidebar; and displaying the service progress information in the bottom area; or, Acquire a touch point corresponding to an outgoing instruction; and display the service progress information based on the position of the touch point, wherein the outgoing instruction is used to call out the system sidebar.
10. A device for displaying content, characterized in that: The device comprises: A first interface display module, used to display a first graphical user interface of a first application; A sidebar display module, configured to display a system sidebar in an edge area of a display screen, wherein the system sidebar includes an intelligent recommendation area, an efficient tool area, an application recommendation area, and a voice assistant button, wherein the intelligent recommendation area displays to-be-processed data recommended for the first application, the efficient tool area displays service progress information, and the application recommendation area displays internal objects of the application; A second interface display module, configured to display a second graphical user interface of the first application in response to a trigger operation on the data to be processed, wherein the second graphical user interface is an interface for processing the data to be processed; When the system sidebar is in editing mode, adjusting the display area of each area and / or the display order of each control in the sidebar based on a manual operation of the user; Among them, the internal application object is information or subroutine provided by the first application, the service progress information is used to indicate the status of the service in progress, and the service progress information is dynamically updated, and the voice assistant button is used to call up the voice assistant when triggered; the information of the internal application object is obtained from the first application by the operating system through a preset data interface; the system sidebar is displayed based on the sidebar layout corresponding to the type of the first application, and the sidebar layout is used to determine the distribution of areas and / or buttons displayed in the system sidebar; the layout of the system sidebar is adjusted based on the frequency of use of the areas and / or buttons included in the system sidebar.
11. A terminal, characterized in that: The terminal includes a processor, a memory connected to the processor, and program instructions stored in the memory. When the processor executes the program instructions, the sidebar display method according to any one of claims 1 to 9 is implemented.
12. A computer-readable storage medium, wherein program instructions are stored in the storage medium, characterized in that: When the program instructions are executed by a processor, the sidebar display method as described in any one of claims 1 to 9 is implemented.
13. A computer program product, characterized in that The computer program product includes computer instructions, which are loaded and executed by a processor to implement the sidebar display method according to any one of claims 1 to 9.
Citation Information
Patent Citations
A data processing method and a mobile terminal
CN109684526A