Display method, electronic device, and storage medium

Abstract

The application discloses a display method, an electronic device and a storage medium, relates to the technical field of terminals, and can shallow the entry of a function component, simplify an operation process, and improve user experience. The method comprises the following steps: displaying a first interface, wherein the first interface comprises a first interface element, and the first interface element is of a first category; in response to a first operation of a user in the first interface, an electronic device displays a first function component matched with the first category; displaying a second interface, wherein the second interface comprises a second interface element, and the second interface element is of the first category; and in response to a first operation of the user in the second interface, the electronic device displays a second function component matched with the first category. The first function component is used for implementing editing of the first interface element, the second function component is used for implementing editing of the second interface element, and the first function component and the second function component are different.

Description

Technical Field

[0001] This application relates to the field of terminal technology, and in particular to a display method, electronic device and storage medium. Background Technology

[0002] With the rapid development of computer technology and smart terminal devices, the user interface has become the core medium for user interaction with terminal devices. Users can zoom in or out on the content displayed on the user interface through zoom operations (such as pinching with two fingers or scrolling with the mouse wheel) to view details or the overall layout more clearly.

[0003] However, once the user has completed the zoom operation, further processing of the zoomed content is often cumbersome, leading to a reduced user experience. Summary of the Invention

[0004] This application provides a display method, an electronic device, and a storage medium that can simplify the entry points for functional components, streamline the operation process, and improve the user experience.

[0005] To achieve the above objectives, the embodiments of this application provide the following technical solutions:

[0006] Firstly, a display method is provided, which can be executed by an electronic device; or by a module applied in an electronic device, such as a chip, chip system, or circuit; or by a logic module or software capable of implementing all or part of the functions of the electronic device, without limitation. For ease of description, the following explanation uses execution by an electronic device as an example.

[0007] The method includes: displaying a first interface, the first interface including first interface elements, wherein the first interface elements are of a first category. In response to a first operation by a user on the first interface, an electronic device displays a first functional component matching the first category. Then, a second interface is displayed, the second interface including second interface elements, wherein the second interface elements are of the first category. In response to a first operation by a user on the second interface, the electronic device displays a second functional component matching the first category.

[0008] Interface elements (such as first interface elements or second interface elements) refer to the visual information that constitutes an interface (such as first interface or second interface). The first interface or second interface can be the interface of any application installed on the terminal device.

[0009] The first operation can be a zoom operation, a rotation operation, or a screenshot operation, etc. The category of interface elements (such as the first category) refers to the category to which the visual information that constitutes the interface belongs.

[0010] The first functional component is used to edit the first interface element, and the second functional component is used to edit the second interface element. The first and second functional components are different; that is, the functional components corresponding to the same category of interface elements can be different.

[0011] With the above technical solution, after the user operates on the interface (such as the first interface or the second interface) (such as pinching to zoom out with two fingers), the electronic device can display functional components (such as the first functional component and the second functional component) that match the category of the interface element (such as the first category) on the first interface. In this way, the user can directly edit the elements of the first interface through the functional components displayed on the first interface, without having to search for the corresponding functional components through multiple operations. This simplifies the entry point of the functional components, streamlines the operation process, and improves the user experience.

[0012] In an alternative implementation, when the first interface element includes a first image, the first functional component may include at least one of a cropping component, an elimination component, a marking component, or an image expansion component.

[0013] The components are as follows: a cropping component for cropping the first image; an elimination component for eliminating content from the first image; a marking component for marking the first image; and an image expansion component for expanding the first image.

[0014] With the above technical solution, users can directly edit the image (i.e., the first image) on the first interface through the cropping component, elimination component, marking component, or image expansion component displayed on the first interface, without having to search for the corresponding functional component through multiple operations. In this way, the entry points of the cropping component, elimination component, marking component, or image expansion component can be simplified, the operation process can be streamlined, and the user experience can be improved.

[0015] In one optional implementation, the first interface element may include a first image. Furthermore, if the similarity between the second image and the first image is greater than a threshold, and / or the interval between the capture time of the second image and the capture time of the first image is less than a threshold, the first functional component may further include a comparison component. The comparison component is used to compare the first image and the second image.

[0016] Through the above technical solutions, electronic devices can also simplify the entry point of the comparison component, so that users can directly compare the image (i.e., the first image) in the first interface with another image (such as the second image) through the comparison component displayed on the first interface, which can meet the diverse needs of users and further improve the user experience.

[0017] In one optional implementation, the first interface element may include a first image, and both the first image and the third image may contain the target region. Furthermore, if the similarity between the third image and the first image is greater than a threshold, and / or the interval between the capture time of the third image and the capture time of the first image is less than a threshold, the aforementioned first functional component may further include a replacement component.

[0018] The replacement component is used to replace the content in the target area of ​​the first image with the content in the target area of ​​the third image.

[0019] Through the above technical solutions, electronic devices can also simplify the entry point of the replacement component, so that users can directly replace the content of the image (i.e., the first image) in the first interface through the replacement component displayed on the first interface, which can further meet the diverse needs of users and further improve the user experience.

[0020] In one alternative implementation, the target area can be a face area.

[0021] The above technical solution limits the target area, which enhances the feasibility of the solution.

[0022] In one alternative implementation, the first interface element may include a first image. Furthermore, if the number of characters contained in the first image exceeds a threshold, the aforementioned functional component may further include a summary component.

[0023] The summary component is used to summarize the text in the first image.

[0024] Through the above technical solutions, electronic devices can also simplify the entry point of the summary component, allowing users to directly summarize the text on the first interface through the summary component displayed on the first interface, thereby further improving the user experience.

[0025] In an alternative implementation, where the first interface element includes a first document, the aforementioned functional components may include at least one of a tagging component or a summary component.

[0026] The markup component is used to add tags to the first document. The summary component is used to summarize the content of the first document.

[0027] With the above technical solution, when users intend to mark or summarize documents on the first interface, they can directly edit the documents on the first interface through the markup or summary components displayed on the first interface, without having to search for the markup or summary components. This simplifies the operation process and improves the user experience.

[0028] In an alternative implementation, the method may further include: displaying a third interface, and in response to a first operation by the user on the third interface, displaying at least one of a pen component or a recording component.

[0029] The drawing component is used for drawing in the third interface, and the recording component is used to record the content of the meeting.

[0030] Through the above technical solution, users can not only draw on the third-party interface using the drawing tool, but also record meeting content using the recording tool displayed on the third-party interface. This not only saves users time but also simplifies the operation process and improves the user experience.

[0031] In one alternative implementation, the first operation described above can be a scaling operation. The scaling operation can include zooming in or zooming out. In some embodiments, the functional components displayed in response to a zoom-in operation and the functional components displayed in response to a zoom-out operation may be different or the same. In other embodiments, the functional components displayed in response to a zoom-in operation and the functional components displayed in response to a zoom-out operation may be the same.

[0032] It is understood that the functional components displayed in response to the zoom-in operation and the functional components displayed in response to the zoom-out operation may be different, including: all the functional components displayed in response to the zoom-in operation and the functional components displayed in response to the zoom-out operation are different, or some of the functional components displayed in response to the zoom-in operation and the functional components displayed in response to the zoom-out operation are different.

[0033] The above technical solution can distinguish the functional components corresponding to zoom-in and zoom-out operations, so as to meet the different needs of users in different scenarios and further improve the user experience.

[0034] In one alternative implementation, the first functional component includes at least one component that is most frequently used among the components used to edit interface elements of the first category.

[0035] The above technical solutions can simplify the entry points for frequently used functional components, thereby further improving the user experience.

[0036] In an alternative implementation, before displaying the first functional component that matches the first category, the method may further include: determining the first category based on the application to which the first interface belongs or the identification result of interface identification of the first interface.

[0037] The above technical solution provides two specific implementation processes for determining the category of interface elements (i.e., the first category). In this way, electronic devices can quickly determine the category of interface elements based on this method, thereby improving the speed of displaying functional components that match the category of interface elements and further enhancing the user experience.

[0038] In an alternative implementation, the method may further include: displaying a fourth interface including the cover of the first book, and displaying book information of the second book in response to a second operation by the user on the fourth interface.

[0039] The second book is included in the first book, and the book information of the second book includes one or more of the following: a synopsis, title, author, or recommendation information.

[0040] Through the above technical solution, users can intuitively view the book information of multiple books from the interface through the second operation, which can help users quickly select their favorite books and enhance the user experience.

[0041] In an optional implementation, the method may further include: displaying a fifth interface including a product image of the first product, and, in response to a second operation by the user on the fifth interface, displaying product information of the second product.

[0042] The second product is included in the first product. The product information of the second product includes one or more of the following: product images, reviews, or information about the store where the second product is located.

[0043] Through the above technical solution, users can intuitively view product information for multiple products from the interface through the second operation, which can help users quickly select their favorite products and enhance the user experience.

[0044] In one alternative implementation, the second operation described above can be an amplification operation.

[0045] Secondly, a display method is provided, which can be executed by an electronic device; or by a module applied in an electronic device, such as a chip, chip system, or circuit; or by a logic module or software capable of implementing all or part of the functions of the electronic device, without limitation. For ease of description, the following explanation uses execution by an electronic device as an example.

[0046] The method includes displaying a sixth interface, wherein the sixth interface includes a document. The electronic device can respond to a first action by the user on the sixth interface by displaying functional components matching the document.

[0047] Functional components that match the document are used to edit the document.

[0048] With the above technical solution, after the user operates on the interface displaying the document (such as the sixth interface), the electronic device can display the functional component that matches the document on the interface. The user can directly edit the document in the interface through the functional component without having to search for the corresponding functional component through multiple operations. In this way, the entry point of the functional component can be simplified, the operation process can be streamlined, and the user experience can be improved.

[0049] In one alternative implementation, the functional components that match the document may include at least one of a tagging component, a summarizing component, or a translation component.

[0050] The markup component is used to mark up the document, the summary component is used to summarize the content in the document, and the translation component is used to translate the content in the document.

[0051] With the above technical solution, users can directly edit the documents displayed on the interface through the marking component, summary component, or translation component, without having to search for the corresponding functional component through multiple operations. In this way, the entry point of at least one of the marking component, summary component, or translation component can be simplified, the operation process can be streamlined, and the user experience can be improved.

[0052] Thirdly, a display device is provided, which is located in an electronic device and includes: a functional unit / module for performing any of the methods provided in the first aspect, wherein the actions performed by each functional unit are implemented by hardware or by executing corresponding software through hardware.

[0053] For example, the device includes a display module. The display module is used to display a first interface, which includes first interface elements of a first category, and in response to a first operation by a user on the first interface, displays a first functional component matching the first category. The display module is also used to display a second interface, which includes second interface elements of the first category, and in response to a first operation by a user on the second interface, displays a second functional component matching the first category. The first functional component is used to enable editing of the first interface elements, and the second functional component is used to enable editing of the second interface elements. The first and second functional components are different.

[0054] Fourthly, an electronic device is provided, comprising: a processor, a display, a memory, and a computer program stored in the memory; the memory, the display, and the processor are coupled; when the electronic device is in operation, the processor executes the computer program to implement any of the display methods provided in the first or second aspect.

[0055] Fifthly, a computer program product is provided, the computer program product including instructions, which, when executed on a computer, cause the computer to perform any of the display methods provided in the first or second aspect.

[0056] In a sixth aspect, a computer-readable storage medium is provided, including computer-executable instructions that, when executed on a computer, cause the computer to perform any of the display methods provided in the first or second aspect.

[0057] It should be noted that the technical effects of any of the implementation methods in aspects three through six can be found in the technical effects of the corresponding implementation methods in aspects one or two, and will not be repeated here. Attached Figure Description

[0058] Figure 1 This is a schematic diagram of an interface in related technologies;

[0059] Figure 2 This is a schematic diagram of an interface for cropping images in related technologies;

[0060] Figure 3 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application;

[0061] Figure 4 A schematic flowchart illustrating a display method provided in an embodiment of this application;

[0062] Figure 5 A schematic diagram of an interface for displaying a clipping component provided in an embodiment of this application;

[0063] Figure 6 A schematic diagram of an interface for a display function component provided in an embodiment of this application;

[0064] Figure 7 A schematic diagram of the interface of another display function component provided in an embodiment of this application;

[0065] Figure 8 A schematic diagram of the interface of another display function component provided in an embodiment of this application;

[0066] Figure 9 A schematic diagram of an interface for marking images provided in an embodiment of this application;

[0067] Figure 10 This is a schematic diagram of an interface for removing content from an image, provided as an embodiment of this application.

[0068] Figure 11 This is a schematic diagram of an interface for cropping an image, provided as an embodiment of this application.

[0069] Figure 12 This is a schematic diagram of an interface for replacing content in an image, provided as an embodiment of this application.

[0070] Figure 13 A schematic diagram of an interface for marking in a document, provided as an embodiment of this application;

[0071] Figure 14 This is a schematic diagram of an interface for summarizing the content of a document, provided as an embodiment of this application.

[0072] Figure 15 A schematic diagram of an interface for displaying functional components in a conferencing application, provided as an embodiment of this application;

[0073] Figure 16 A schematic diagram of an interface drawn in a second interface, provided as an embodiment of this application;

[0074] Figure 17 A schematic diagram of an interface for recording the content of a meeting, provided as an embodiment of this application;

[0075] Figure 18 This is a schematic diagram of an interface for summarizing search results, provided as an embodiment of this application.

[0076] Figure 19 This application provides a schematic diagram of an interface for displaying book information.

[0077] Figure 20 This application provides a schematic diagram of an interface for displaying product information.

[0078] Figure 21 This is a schematic diagram of the structure of another electronic device provided in an embodiment of this application. Detailed Implementation

[0079] In the description of this application, unless otherwise stated, " / " means "or," for example, A / B can mean A or B. The "and / or" in this document is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, and B alone. Furthermore, "at least one" means one or more, and "multiple" means two or more. The terms "first," "second," etc., do not limit the quantity or order of execution, and "first," "second," etc., do not necessarily imply differences.

[0080] It should be noted that, in the embodiments of this application, the terms "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design scheme described as "exemplary" or "for example" in this application should not be construed as being more preferred or advantageous than other embodiments or design schemes. Specifically, the use of terms such as "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.

[0081] It is understood that the term "embodiment" used throughout the specification means that a specific feature, structure, or characteristic related to an embodiment is included in at least one embodiment of this application. Therefore, throughout the specification, various embodiments do not necessarily refer to the same embodiment. Furthermore, these specific features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. It is understood that in the various embodiments of this application, the sequence number of each process does not imply the order of execution; the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0082] In this application, unless otherwise specified, the same or similar parts between the various embodiments can be referred to each other. In the various embodiments of this application, unless otherwise specified or logically conflicting, the terminology and / or descriptions between different embodiments are consistent and can be mutually referenced. Technical features in different embodiments can be combined to form new embodiments based on their inherent logical relationships. The following embodiments of this application do not constitute a limitation on the scope of protection of this application.

[0083] With the rapid development of computer technology and smart terminal devices, the user interface has become the core medium for user interaction with terminal devices. Users can zoom in or out on the content displayed on the user interface using zoom operations (such as pinching with two fingers or scrolling with the mouse wheel) to view the overall layout or details more clearly. For example, users can zoom in or out on the content displayed on the user interface. Figure 1 Image 101 shown in (a) Figure 1 Document 102 shown in (b) or Figure 1 The application interface 103 of the social media application shown in (c) is zoomed.

[0084] After zooming in, users can further edit the zoomed content, such as cropping, marking, and deleting. For example, using a mobile phone as the terminal device, if a user zooms in on image 101 and intends to crop the zoomed-in image 101 (hereinafter referred to as image A), the user can perform a click operation on image A. The mobile phone can respond to the user's click operation on image A by displaying... Figure 2 Image browsing interface 201 is shown in (a) of the image.

[0085] like Figure 2As shown in (a), the image browsing interface 201 may include an editing control 202. The user can click on the editing control 202. The mobile phone can respond to the user's operation on the editing control 202 by displaying... Figure 2 The image editing interface 203 is shown in (b) of the image. (See image editing interface 203 in the image Figure 2 As shown in (b), the image editing interface 203 may include a cropping control 204. The user can click on the cropping control 204. The mobile phone can respond to the user's operation on the cropping control 204 by displaying... Figure 2 The clipping interface 205 is shown in (c) in the figure.

[0086] After displaying the cropping interface 205, in one example, the user can manually adjust the size of image A in the cropping interface 205 to crop image A. In another example, the cropping interface 205 may include... Figure 2 The scaling control 206 is shown in (c). Users can click on the scaling control 206. The mobile phone can respond to the user's operation on the scaling control 206 and display... Figure 2 The cropping ratio selection interface 207 is shown in (d) in the figure.

[0087] The cropping ratio selection interface 207 can include various ratio controls, such as... Figure 2 The "Square" control 208-A and the "9:16" control 208-B, as shown in (d), represent cropping the image according to a corresponding ratio. For example, the "Square" control 208-A represents cropping the image at a width:length ratio of 1:1, and the "9:16" control 208-B represents cropping the image at a width:length ratio of 9:16. Taking the "Square" control 208-A as an example, the user can click on the "Square" control 208-A. The mobile phone can respond to the user's operation on the "Square" control 208-A, cropping image A at a width:length ratio of 1:1, resulting in... Figure 2 The cropping completion interface 209 is shown in (e) in the figure.

[0088] The cropping completion interface 209 may include image B and a completion control 210. Image B is the cropped image of image A. The user can confirm image B; once confirmed, i.e., the user confirms that no adjustments to image B are needed, the user can click the completion control 210. The mobile phone can respond to the user's operation on the completion control 210, store and display image B, such as... Figure 2 As shown in (f) in the figure.

[0089] As can be seen from the above description, if users need to perform further operations on the scaled content, they often face problems such as cumbersome operation processes and excessively deep layers of control entry points.

[0090] In view of this, embodiments of this application provide a display method applied to an electronic device. Specifically, the electronic device can display a first interface, which includes first interface elements, and the first interface elements are of a first category. The electronic device can, in response to a first operation by a user on the first interface, display a first functional component matching the first category. The electronic device can also display a second interface, which includes second interface elements, and the second interface elements are of the first category. The electronic device, in response to a first operation by a user on the second interface, displays a second functional component matching the first category.

[0091] Through the above technical solution, after the user performs an operation on the interface (such as the first interface or the second interface) (such as the first operation), the electronic device can display functional components (such as the first functional component and the second functional component) that match the category of the interface element (such as the first category) on the first interface. In this way, the user can directly edit the elements of the first interface through the functional components displayed on the first interface, without having to search for the corresponding functional components through multiple operations. This simplifies the entry point of the functional components, streamlines the operation process, and improves the user experience.

[0092] The technical solution provided in this application will now be described with reference to the accompanying drawings. Figure 3 A schematic diagram of the structure of electronic device 300 is shown.

[0093] like Figure 3 As shown, the electronic device 300 may include a processor 310, an external memory interface 320, an internal memory 321, a universal serial bus (USB) interface 330, a charging management module 340, a power management module 341, a battery 342, an antenna 1, an antenna 2, a mobile communication module 350, a wireless communication module 360, an audio module 370, a speaker 370A, a receiver 370B, a microphone 370C, a headphone jack 370D, a sensor module 380, buttons 390, a motor 391, an indicator 392, a camera 393, a display screen 394, and a subscriber identification module (SIM) card interface 395, etc.

[0094] It is understood that the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the electronic device 300. In other embodiments of this application, the electronic device 300 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0095] Processor 310 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. The different processing units may be independent devices or integrated into one or more processors.

[0096] The processor 310 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 310 is a cache memory. This memory can store instructions or data that the processor 310 has just used or that are used repeatedly. If the processor 310 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 310, and thus improves the efficiency of the system.

[0097] Internal memory 321 can be used to store computer executable program code, which includes instructions. Processor 310 executes various functional applications and data processing of the electronic device by running the instructions stored in internal memory 321. For example, in this embodiment, processor 310 can execute instructions stored in internal memory 321, which may include a program storage area and a data storage area.

[0098] Electronic device 300 can implement audio functions through audio module 370, speaker 370A, receiver 370B, microphone 370C, headphone jack 370D, and application processor, such as music playback and recording. In some embodiments, audio module 370 can be located in processor 310, or some functional modules of audio module 370 can be located in processor 310.

[0099] The sensor module 380 may include a pressure sensor 380A, a gyroscope sensor 380B, a barometric pressure sensor 380C, a magnetic sensor 380D, an accelerometer sensor 380E, a proximity sensor 380F, a fingerprint sensor 380H, a temperature sensor 380J, a touch sensor 380K, an ambient light sensor 380L, etc.

[0100] Pressure sensor 380A is used to sense pressure signals and convert them into electrical signals. Gyroscope sensor 380B is used to determine the motion posture of electronic device 300. Barometric pressure sensor 380C is used to measure air pressure. Magnetic sensor 380D includes a Hall effect sensor. Electronic device 300 can use magnetic sensor 380D to detect the opening and closing of the flip cover. Accelerometer sensor 380E can detect the magnitude of acceleration of electronic device 300 in various directions (generally three axes). Distance sensor 380F is used to measure distance. Fingerprint sensor 380H is used to collect fingerprints. Temperature sensor 380J is used to detect temperature. Ambient light sensor 380L is used to sense ambient light intensity.

[0101] Touch sensor 380K, also known as a "touch device". Touch sensor 380K can be disposed on display screen 394, and touch sensor 380K and display screen 394 together form a touch screen, also known as a "touchscreen". In other embodiments, touch sensor 380K can also be disposed on the surface of electronic device 300, in a different position than display screen 394.

[0102] Buttons 390 include a power button, volume buttons, etc. Buttons 390 can be mechanical buttons or touch-sensitive buttons. Electronic device 300 can receive button input and generate key signal inputs related to user settings and function control of electronic device 300.

[0103] The charging management module 340 receives charging input from a charger, which can be a wireless charger or a wired charger. While charging the battery 342, the charging management module 340 can also supply power to electronic devices via the power management module 341.

[0104] The power management module 341 connects the battery 342, the charging management module 340, and the processor 310. The power management module 341 receives input from the battery 342 and / or the charging management module 340, and supplies power to the processor 310, internal memory 321, external memory, display screen 394, camera 393, and wireless communication module 360, etc. In some embodiments, the power management module 341 and the charging management module 340 may also be housed in the same device.

[0105] Display screen 394 is used to display images, videos, documents, meeting interfaces, etc. Electronic device 300 implements display functions through display screen 394 and processor 310. GPU is a microprocessor for image processing, connected to display screen 394 and application processor. GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 310 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0106] In this embodiment, the processor 310 can control the display screen 394 to display a first interface, which includes first interface elements and belongs to a first category. In response to a user's first operation on the first interface, the processor 310 can control the display screen 394 to display a first functional component matching the first category. The processor 310 can also control the display screen 394 to display a second interface, which includes second interface elements and also belongs to the first category. In response to a user's first operation on the second interface, the processor 310 can control the display screen 394 to display a second functional component matching the first category.

[0107] The following describes the display method provided in the embodiments of this application, using an electronic device as an example of a terminal device.

[0108] The terminal equipment involved in this application may be user equipment (UE), terminal equipment (TE), mobile devices, tablets, computing devices, vehicle-mounted devices, wearable devices, robots, virtual reality (VR) terminals, augmented reality (AR) terminals, etc., in 5G networks or public land mobile networks (PLMNs) that evolve after 5G.

[0109] Terminal devices can be mobile or fixed.

[0110] The embodiments of this application do not limit the form of the terminal device. The apparatus for implementing the functions of the terminal device can be the terminal device itself, or it can be any apparatus capable of supporting the terminal device in implementing those functions, such as a chip system. This apparatus can be installed in the terminal device or used in conjunction with the terminal device. In the embodiments of this application, the chip system can be composed of chips, or it can include chips and other discrete components.

[0111] Figure 4 This is a flowchart illustrating a display method provided in an embodiment of this application. Figure 4 As shown, the method includes the following steps S401-S404.

[0112] S401, displaying the first interface.

[0113] The first interface includes interface elements (hereinafter referred to as first interface elements).

[0114] Interface elements refer to the visual information that constitutes an interface. For example, if an image (hereinafter referred to as the first image) is displayed in the first interface, the first interface elements may include the first image. If a document (hereinafter referred to as the first document) is displayed in the first interface, the first interface elements may include the first document.

[0115] The category of a UI element (such as the category of the first UI element) refers to the category to which the visual information constituting the UI (such as the first UI) belongs. The first UI element is the first category. For example, if the first UI element includes a first image, the first category is the image category. If the first UI element includes a first document, the first category is the document category.

[0116] The first interface can be the interface of any application installed on the terminal device. For example, if the first interface element includes a first image, the first interface can be the interface of a gallery application (also known as a photo album application) or the interface of a social application. If the first interface element includes a first document, the first interface can be the interface of a document application or the interface of a social application.

[0117] S402, in response to the user's first operation on the first interface, displays a first functional component that matches the first category.

[0118] In the embodiments of this application, the first operation may be a scaling operation, a rotation operation, or a screenshot operation, etc.

[0119] In this embodiment, the first operation is not specifically limited. Taking a zoom operation as an example, a zoom operation can include a shrink operation and a zoom-in operation. In one example, the zoom operation can be a touch operation, such as a user's two-finger pinch operation or two-finger zoom operation. In another example, the zoom operation can be a user-inputted voice command, such as a user-inputted voice command to "shrink" or "zoom in". In yet another example, the zoom operation can be an air gesture operation or a knuckle operation.

[0120] A functional component that matches the category of an interface element is used to edit the interface element; that is, a first functional component that matches the first category is used to edit the first interface element. Taking the first interface element as the first image as an example, the first functional component is used to edit the first image.

[0121] In this embodiment of the application, the position of the functional component (such as the first functional component) displayed on the terminal device is not specifically limited. Taking the first functional component as an example, the terminal device may display the first functional component in the lower right corner of the currently displayed interface (such as the first interface), or it may display the first functional component in the middle, upper left corner, or other positions of the currently displayed interface.

[0122] Specifically, taking a zoom operation as the first operation, and assuming the terminal device stores the correspondence between the categories of interface elements and their functional components, after the terminal device displays the first interface, the user can input a zoom operation on the first interface if they intend to zoom in or out. The terminal device can respond to the user's zoom operation on the first interface and determine the first category. Then, the terminal device can determine the first functional component that matches the first category from its stored correspondence. The terminal device can then display the first functional component.

[0123] In this embodiment of the application, the method for determining the first category of the terminal device is not specifically limited. The process of determining the first category of the terminal device will be described below using two methods.

[0124] Method A: The terminal device determines the first category based on the application to which the first interface belongs.

[0125] Specifically, the terminal device can determine the application to which the first interface belongs (hereinafter referred to as application 1). Then, the terminal device can determine the first category based on the function of application 1.

[0126] For example, suppose the application to which the first interface belongs is a gallery application, whose function is to store and display images. Accordingly, the terminal device can determine the first category as the image category. As another example, suppose the application to which the first interface belongs is a document application, whose function is to display documents. Accordingly, the terminal device can determine the first category as the document category.

[0127] Method B: The terminal device determines the first category based on the recognition result of the interface recognition of the first interface.

[0128] Specifically, the terminal device can perform interface recognition on the first interface to determine the attribute information of the first interface elements, and determine the first category based on the attribute information of the interface elements.

[0129] In this embodiment, the attribute information of interface elements is not specifically limited. In one example, the attribute information of interface elements may include the file extension of the interface element. The file extension is used to identify the category of the interface element. For example, the file extension of interface elements in the image category may be .jpg, .jpeg, .png, .gif, or .bmp, and the file extension of interface elements in the document category may be .txt, .pdf, .docx, .xlsx, or .pptx.

[0130] For example, taking the attribute information of interface elements as their file extensions, if the first interface element has the extension .jpg, .jpeg, .png, .gif, or .bmp, the terminal device can determine that the first category is an image category. If the first interface element has the extension .txt, .pdf, .docx, .xlsx, or .pptx, the terminal device can determine that the first category is a document category.

[0131] The following description uses a mobile phone as an example of a terminal device and refers to the accompanying drawings to illustrate S402.

[0132] In one embodiment, the first interface element is... Figure 5 Image 501 shown in (a) is an example of an image where the scaling operation is a magnification operation, and the high-frequency functional components matching the image include a cropping component. (Refer to...) Figure 5 As shown in (a), the user can perform a two-finger zoom operation on the first interface. The phone can respond to the user's two-finger zoom operation on the first interface, zoom in on image 501, and display it. Figure 5 The cutting component 502 shown in (b) is shown in the figure.

[0133] In yet another embodiment, the first interface element is... Figure 6 Image 601 shown in (a) is an example of a scaling operation where the scaling operation is a reduction operation. High-frequency functional components matching the image include cropping, elimination, and marking components. (Refer to...) Figure 6 As shown in (a), the user can perform a two-finger pinch operation on the first interface. The phone can respond to the user's two-finger pinch operation on the first interface by shrinking image 601 and displaying... Figure 6 The trimming component 602, the elimination component 603, and the marking component 604 are shown in (b) of the diagram.

[0134] In another embodiment, the first interface element is... Figure 7 Document 701, shown in (a) above, uses a zoom-out operation. High-frequency functional components matching this document include summary and markup components. (See also...) Figure 7 As shown in (a), the user can perform a two-finger pinch operation on the first interface. The phone can respond to the user's two-finger pinch operation on the first interface by shrinking document 701 and displaying... Figure 7 The summary component 702 and the marker component 703 are shown in (b) of the diagram.

[0135] S403, displaying the second interface.

[0136] The second interface includes interface elements (hereinafter referred to as second interface elements).

[0137] The category of the second interface element is the same as the category of the first interface element; that is, the second interface element belongs to the first category. For example, if both the first and second interface elements include images, the category of the second interface element is the same as the category of the first interface element—the image category.

[0138] For a detailed description of S403, please refer to the content of S401 above, which will not be repeated here.

[0139] S404, in response to the user's first operation in the second interface, displays a second functional component that matches the first category.

[0140] The second functional component is used to enable editing of the second interface elements.

[0141] It is understood that the functional components matching different categories of interface elements can be the same or different. Taking the example of different functional components matching different categories of interface elements, where the interface element is a first image or a first document. When the interface element is a first image, the category of the interface element is the image category, and the functional components matching the first image can include at least one of a cropping component, an elimination component, a marking component, or an image expansion component. As described above, the functional components are used to implement the editing of interface elements. Therefore, in this embodiment, the cropping component is used to crop the first image, the elimination component is used to eliminate content contained in the first image, the marking component is used to mark in the first image, and the image expansion component is used to expand the first image.

[0142] When the interface element is a first document, the category of the interface element is a document category, and the functional component matching the first document may include at least one of a marking component, a summarizing component, or a translation component. In this embodiment, the marking component is used to mark items in the first document, the summarizing component is used to summarize the content in the first document, and the translation component is used to translate the content in the first document.

[0143] It is understandable that functional components matching interface elements of the same category can be the same or different. In one example, let's take "image" as the first category (i.e., both the first and second interface elements are image categories), and the first interface element includes image A, while the second interface element includes image B. The aforementioned first functional component could include a cropping component and an elimination component. The aforementioned second functional component could include a marking component and an image expansion component. In another example, let's take "document" as the first category, and the first interface element includes Chinese documents, while the second interface element includes English documents. The aforementioned first functional component could include a summary component and a marking component, and the second functional component could include a summary component, a marking component, and a translation component.

[0144] The specific implementation of S404 can be found in the description of S402 above, and will not be repeated here.

[0145] Through the above technical solution, after the user performs an operation on the interface (such as the first interface or the second interface) (such as the first operation), the electronic device can display functional components (such as the first functional component and the second functional component) that match the category of the interface element (such as the first category) on the first interface. In this way, the user can directly edit the elements of the first interface through the functional components displayed on the first interface, without having to search for the corresponding functional components through multiple operations. This simplifies the entry point of the functional components, streamlines the operation process, and improves the user experience.

[0146] In one alternative implementation, the functional component matching the category of the interface element is at least one of the most frequently used components among the components that enable editing of interface elements of that category (hereinafter referred to as editable components). For example, the first or second functional component mentioned above may include at least one of the most frequently used components among the components that enable editing of interface elements of the first category. Therefore, the functional component matching the category of the interface element can also be referred to as a high-frequency functional component.

[0147] In this embodiment, the method by which the terminal device determines high-frequency functional components is not specifically limited. In one example, the terminal device may pre-store the correspondence between interface element categories and high-frequency functional components. Accordingly, the terminal device can determine the corresponding high-frequency functional component based on the category of the interface element from its stored correspondence. In another example, the terminal device may pre-store the correspondence between interface element categories and editable components. Accordingly, the terminal device can determine the corresponding editable component based on the category of the interface element from its stored correspondence. Then, the terminal device can determine the usage frequency of each component in the editable component based on the number of times the user uses each component within a preset time period, and determine the high-frequency functional components from the editable component based on the usage frequency of each component.

[0148] In this embodiment of the application, the preset time period is not specifically limited. For example, the preset time period can be the most recent hour, the most recent day, the most recent week, or the most recent month, etc.

[0149] In this embodiment of the application, the number of high-frequency functional components determined by the terminal device is not specifically limited. For example, the number of high-frequency functional components can be 1, 2, 3, or more.

[0150] The above technical solutions can simplify the entry points for frequently used functional components, thereby further improving the user experience.

[0151] To meet diverse user needs, when the interface elements include images, the terminal device can respond to the user's first operation on the interface by displaying at least one of several components, such as a comparison component, a replacement component, or a summary component. The following detailed description uses the interface element as the first interface element and the image included within the interface element as the first image.

[0152] When the first interface element includes a first image, the terminal device may respond to the user's first operation on the first interface by displaying at least one of a plurality of components such as a comparison component, a replacement component, or a summary component.

[0153] The comparison component compares the first image with any image stored in the terminal device other than the first image (hereinafter referred to as image A). The replacement component replaces the content in the target region of the first image with the content in any region of image A (hereinafter referred to as the target region). The summary component summarizes the content in the first image.

[0154] In this embodiment of the application, the target area is not specifically limited. For example, the target area can be a face area, the area where a building is located, or the area where the sky is located, etc.

[0155] For example, taking the replacement component and summary component as examples, and the terminal device as a mobile phone, continue to refer to... Figure 6 As shown in (a), the user can perform a two-finger pinch operation on the first interface, and the phone can respond to the user's two-finger pinch operation on the first interface by displaying the following: Figure 8 The components shown are trimming component 602, elimination component 603, marking component 604, replacement component 605, and summary component 606.

[0156] The above technical solution allows for the shallow display of more components (such as comparison components, replacement components, or summary components) on the first interface, thus meeting diverse user needs and effectively enhancing the user experience.

[0157] Comparison, replacement, and summary components are typically components that users need to interact with in specific scenarios. Therefore, terminal devices can display comparison, replacement, or summary components in different scenarios. The following will describe the process of displaying comparison, replacement, and summary components on the terminal device.

[0158] In an optional implementation, if the similarity between a certain image (hereinafter referred to as the second image) and the first image is greater than a threshold (hereinafter referred to as the similarity threshold), and / or the interval between the shooting time of the second image and the shooting time of the first image is less than a threshold (hereinafter referred to as the duration threshold), the terminal device may display a comparison component. That is, the first functional component mentioned above includes a comparison component.

[0159] At this point, the comparison component described above, which is used to compare the first image and image A, can be replaced by: the comparison component being used to compare the first image and the second image.

[0160] The embodiments of this application do not specifically limit the number of second images. For example, the number of second images may include one, two, or more.

[0161] The embodiments of this application do not specifically limit the similarity threshold. For example, the similarity threshold can be 80%, 90%, or 95%, etc.

[0162] This application does not impose a specific limitation on the duration threshold. For example, the duration threshold can be 1 second (s) or 0.1 seconds, etc.

[0163] Specifically, taking the example where the similarity between the second image and the first image is greater than a similarity threshold, and the interval between the shooting time of the second image and the shooting time of the first image is less than a duration threshold, the terminal device can determine the interval between the shooting time of each image stored in its own memory and the shooting time of the first image, and determine the similarity between each image stored in its own memory and the first image. Then, the terminal device can determine whether there exists an image (i.e., the second image) among its stored images where the interval between the shooting time and the shooting time of the first image is less than the duration threshold, and the similarity with the first image is greater than the similarity threshold. If there is an image where the interval between the shooting time and the shooting time of the first image is less than the duration threshold, and the similarity with the first image is greater than the similarity threshold, the terminal device can display a comparison component. If there is no image where the interval between the shooting time and the shooting time of the first image is less than the duration threshold, and the similarity with the first image is greater than the similarity threshold, the terminal device may not display a comparison component.

[0164] The process by which the aforementioned terminal device determines the similarity between each of its stored images and the first image can be found in relevant technologies and will not be elaborated here.

[0165] In an optional implementation, if both the first image and a certain image (hereinafter referred to as the third image) contain the target region, and furthermore, if the similarity between the third image and the first image is greater than a similarity threshold, and / or the interval between the shooting time of the third image and the shooting time of the first image is less than a duration threshold, the terminal device may display a replacement component. That is, the aforementioned first functional component includes a replacement component.

[0166] At this point, the replacement component described above, which is used to replace the content in the target area of ​​the first image with the content in the target area of ​​image A, can be replaced with: the replacement component is used to replace the content in the target area of ​​the first image with the content in the target area of ​​the third image.

[0167] The embodiments of this application do not specifically limit the number of third images. For example, the number of third images may include one, two, or more.

[0168] Specifically, taking a target region as a face region, the similarity between the second image and the first image is greater than a similarity threshold, and the interval between the shooting time of the second image and the shooting time of the first image is less than a duration threshold as an example. When the first interface element includes the first image, the terminal device can determine whether any of its stored images contain a face region, the interval between the shooting time of each of its stored images and the shooting time of the first image, and the similarity between each of its stored images and the first image.

[0169] Then, the terminal device can determine from its stored images whether there exists an image (i.e., the third image) that contains a face region, whose shooting time is less than a duration threshold compared to the shooting time of the first image, and whose similarity to the first image is greater than a similarity threshold. If an image containing a face region exists, whose shooting time is less than a duration threshold compared to the shooting time of the first image, and whose similarity to the first image is greater than a similarity threshold, the terminal device can display the replacement component. If no image containing a face region exists, whose shooting time is less than a duration threshold compared to the shooting time of the first image, and whose similarity to the first image is greater than a similarity threshold, the terminal device may not display the replacement component.

[0170] The process by which the aforementioned terminal device determines whether each of its stored images contains a face region can be found in relevant technologies, and will not be elaborated here.

[0171] In an alternative implementation, if the number of characters contained in the first image exceeds a threshold (hereinafter referred to as the quantity threshold), the terminal device may display a summary component. That is, the first functional component described above includes a summary component.

[0172] At this point, the above-mentioned summary component, which is used to summarize the content in the first image, can be replaced with: the above-mentioned summary component is used to summarize the text in the first image.

[0173] This application does not specify a particular threshold for the quantity. For example, the threshold could be 1000 or 500, etc.

[0174] Specifically, when the first interface element is a first image, the terminal device can determine whether the number of characters contained in the first image exceeds a certain threshold. If so, the terminal device can display a summary component. If not, the terminal device can choose not to display the summary component.

[0175] Through the above technical solutions, terminal devices can display comparison components, replacement components, or summary components in a shallow manner in different scenarios. This not only saves terminal resources but also meets different user needs in various scenarios, thereby enhancing the user experience.

[0176] In one optional implementation, after the terminal device displays functional components that match the categories of interface elements, it can also edit the interface elements in response to user operations on the functional components. For example, the terminal device can edit a first interface element in response to user operations on a first functional component. Similarly, the terminal device can edit a second interface element in response to user operations on a second functional component.

[0177] The following examples illustrate the process of editing the first interface element on a terminal device, using two scenarios: 1. The first interface element includes a first image, and 2. The first interface element includes a first document.

[0178] I. The first interface element includes the first image.

[0179] When the first interface element includes a first image, the aforementioned terminal device editing the first interface element in response to the user's operation on the functional component can be replaced by: the terminal device editing the first image in response to the user's operation on the functional component. The following describes the process of the terminal device editing the first image using the marking component, the removal component, the cropping component, and the replacement component as examples.

[0180] 1. Tag Component

[0181] After receiving a user's operation on the marking component, the terminal device can display the marking tool and, in response to the user's marking operation in the first image using the marking tool, mark the first image.

[0182] Marking tools can include different colors and different brushes.

[0183] Specifically, when a user intends to mark an area in the first image, they can interact with the marking components displayed on the first interface. The terminal device can respond to the user's interaction with the marking components by displaying different brushes and colors for the user to choose from. The user can select their preferred brush (hereinafter referred to as the target brush) and color (hereinafter referred to as the target color). Then, the user can move their finger across the first image. Based on the detected movement trajectory of the user's finger, the terminal device can use the target brush and target color to draw corresponding lines on the screen to mark the first image.

[0184] For example, continuing with the first image as Figure 6 Taking image 601 as an example, the user intends to use a drawing tool to mark the little boy holding a balloon in image 601. The user can... Figure 6 The terminal device can respond to the user's click operation on the marker component 604 shown in (b) by performing a click operation. Figure 9 The image shows a brush 901 and a color 902. The user can select a target brush from brush 901 and a target color from color 902. Then, the user's finger can move within the image 601, and the terminal device can use the target brush and target color to draw corresponding lines on the screen, resulting in... Figure 9 Image 903 is shown.

[0185] 2. Eliminate components

[0186] The terminal device can respond to the user's operation on the elimination component and eliminate the content selected by the user in the first image.

[0187] Specifically, when a user intends to remove content from the first image, they can operate on the removal component displayed on the first interface and select the content they wish to remove from the first image. After selection, the terminal device can remove the selected content from the first image.

[0188] For example, continuing with the first image as Figure 6 Taking image 601 as an example, the user intends to remove the little girl on the left side of image 601. The user can... Figure 6 Clicking the elimination component 603 shown in (b) selects the area where the little girl is located in image 601, as shown in the image. Figure 10 As shown in (a) above. After selection, the terminal device can remove the little girl in image 601, obtaining... Figure 10 Image 1001 is shown in (b) of the image.

[0189] 3. Trimming components

[0190] The terminal device can crop the first image in response to the user's operation on the cropping component.

[0191] Specifically, when a user intends to adjust the size of the first image, they can manipulate the cropping component displayed on the first interface. The terminal device can respond to the user's manipulation of the cropping component by displaying a cropping frame. The user can adjust the cropping frame. The terminal device can respond to the user's adjustment of the cropping frame by cropping the first image.

[0192] For example, continuing with the first image as Figure 6 Taking image 601 shown in (a) as an example, the user intends to adjust the size of image 601 to crop the blank area in image 601. The user can adjust... Figure 6 The user clicks on the cropping component 602 shown in (b). The terminal device can respond to the user's click on the cropping component 602 by displaying... Figure 11 The cropping frame 1101 is shown in (a) above. The user can adjust the cropping frame 1101, and the terminal device can respond to the user's adjustment operation on the cropping frame 1101 by cropping the image 601 to obtain... Figure 11 Image 1102 is shown in (b) of the image.

[0193] 4. Replace components

[0194] The terminal device can respond to the user's operation on the replacement component by replacing the content in the target area of ​​the first image with the content in the target area of ​​the third image.

[0195] Specifically, when a user intends to replace the content in the target area of ​​the first image with the content in the target area of ​​the third image, they can operate on the replacement component displayed on the first interface. The terminal device can respond to the user's operation on the replacement component by displaying the content in the target area of ​​the third image. Subsequently, the user can operate on the content in the target area of ​​the third image. The terminal device can respond to the user's operation on the content in the target area of ​​the third image by replacing the content in the target area of ​​the first image with the content in the target area of ​​the third image.

[0196] For example, taking a mobile phone as the terminal device and a face area as the target area, suppose the user takes a picture... Figure 12 In Figure (a), images 1201 and 1202 are shown. Image 1201 is displayed on the first interface. The user intends to replace the face image in face region B of image 1201 with the face image in face region A of image 1202. Thus, the phone responds to the user's first operation on the first interface by displaying... Figure 12After replacing component 1203 as shown in (b), the user can click on component 1203. The phone can respond to the user's click on component 1203 by displaying [the following text is missing from the original] on the first screen. Figure 12 The face region A is shown in (c). The user can tap on face region A, and the phone can respond to this tap by replacing the face image in face region A with the face image in face region B, resulting in... Figure 11 Image 1204 is shown in (d) of the image.

[0197] Through the above technical solution, users can edit the images on the first interface, thus helping them obtain their desired images, improving user satisfaction, and enhancing the user experience.

[0198] II. The first interface element includes the first document.

[0199] When the first interface element includes a first document, the aforementioned terminal device editing the first interface element in response to user operations on functional components can be replaced by: the terminal device editing the first document in response to user operations on functional components. The following description uses the annotation component and summary component as examples to illustrate the process of the terminal device editing the first document.

[0200] 1. Annotation Component

[0201] After receiving a user's operation on the annotation component, the terminal device can display the annotation tool and, in response to the user's annotation operation in the first document using the annotation tool, make annotations in the first document.

[0202] The specific marking process can be referred to the marking process in the first image described above, and will not be repeated here.

[0203] For example, continuing with the first document as Figure 7 Taking document 701 as an example, after the user selects the target brush and target color, the user's finger can move within document 701. The terminal device can then use the target brush and target color to draw corresponding lines on the screen, resulting in... Figure 13 The document shown is 1301.

[0204] 2. Summary of components

[0205] The terminal device can respond to the user's operation on the summary component and summarize the content in the first document.

[0206] Specifically, when a user intends to summarize the content of the first document, they can interact with the summary component displayed on the first interface. The terminal device can respond to the user's interaction with the summary component, summarize the content of the first document, obtain the summary content, and display the summary content.

[0207] In this embodiment, the method by which the terminal device displays the summary content is not limited. For example, the terminal device can display the summary content in a split-screen format, display the summary content in a floating window on the original interface, or display the summary content separately.

[0208] For example, taking the first document as... Figure 7 Taking document 701 as an example, and using a terminal device to display a summary of the document in a split-screen format, if a user intends to summarize the content of document 701, they can interact with the summary component 702 displayed on the first screen. The terminal device can respond to the user's interaction with the summary component 702, summarize the content of document 701, obtain the summary content, and display the summary content in a split-screen format, such as... Figure 14 As shown.

[0209] Through the above technical solution, users can edit the document on the first interface. This helps users mark the document or better understand its content, improving user satisfaction and enhancing the user experience.

[0210] In this embodiment, the terminal device can respond to a user's first operation on the currently displayed interface by displaying functional components that match the application to which the currently displayed interface belongs. The following description uses a conferencing application and a search application as examples to illustrate the process of the terminal device displaying functional components that match the application to which the currently displayed interface belongs. The search application is an application that uses internet technology to find information needed by the user.

[0211] 1. Meeting Applications

[0212] During remote meetings using a conferencing application, users need to record or mark the content of the meeting. In one alternative implementation, the terminal device can display the interface of the conferencing application (hereinafter referred to as the third interface) and, in response to a first operation by the user on the third interface, display at least one of a drawing component and a recording component.

[0213] The drawing component is used for drawing in the third interface, and the recording component is used to record the content of the meeting.

[0214] Specifically, taking the first operation as a zoom operation, the components displayed by the terminal device in response to the user's first operation on the third interface include the pen component and the recording component. After the terminal device displays the third interface, the user can perform a two-finger pinch operation on the third interface, and the terminal device can respond to the user's two-finger pinch operation on the third interface by displaying the pen component and the recording component.

[0215] For example, the meeting content displayed in the third interface is used as... Figure 15 The meeting content 1501 shown in (a) is an example of a zoom-in operation. (Refer to...) Figure 15 As shown in (a), the user can perform a two-finger zoom operation on the third interface, and the terminal device can respond to the user's two-finger zoom operation on the third interface by displaying... Figure 15 The pen component 1502 and the recording component 1503 are shown in (b) of the diagram.

[0216] After the terminal device displays the pen component in the above manner, it can receive user operations on the pen component. The terminal device responds to the user's drawing operations on the third interface and draws lines on the third interface.

[0217] For example, taking a third interface as an example Figure 15 Take the interface shown in (a) as an example. Users can... Figure 15 The pen component 1502 shown in (b) is clicked, and the user moves their finger on the third interface. The terminal device can detect the movement trajectory of the user's finger and draw corresponding lines on the screen to obtain... Figure 16 The interface shown.

[0218] After the terminal device displays the recording component in the above manner, the terminal device can also respond to the user's operation on the recording component and record the content of the meeting.

[0219] Specifically, when a user intends to record the content of a meeting, they can interact with the recording component displayed on the third-party interface. The terminal device can respond to the user's interaction with the recording component, recording and displaying the content of the meeting.

[0220] For example, taking a third interface as an example Figure 15 Take the interface shown in (a) as an example. Users can... Figure 15 The recording component 1503 shown in (b) is clicked. The terminal device can respond to the user's click on the recording component 1503 by dividing the third interface into sections as shown in (b). Figure 17 The two areas shown are used to display meeting materials and recorded meeting content.

[0221] Through the above technical solution, users can not only draw on the third-party interface using the drawing tool, but also record meeting content using the recording tool displayed on the third-party interface. This not only saves users time but also simplifies the operation process and improves the user experience.

[0222] 2. Search Applications

[0223] When users search using a search application, they need to summarize the search results. In one alternative implementation, the terminal device can display the search application's interface (hereinafter referred to as the search interface) and, in response to the user's first action on the search interface, display a summary component.

[0224] The search component is used to summarize the search results.

[0225] Specifically, taking the zoom operation as an example, after the terminal device displays the search interface, the user can perform a zoom operation within the search interface. The terminal device can respond to the user's zoom operation in the search interface by displaying a summary component.

[0226] After the terminal device displays the summary component in the above manner, the terminal device can also respond to the user's operation on the summary component and summarize the search results.

[0227] For example, taking the search interface as an example Figure 18 Take the interface shown in (a) as an example. Users can... Figure 18 The summary component 1801 shown in (a) is clicked. The terminal device can respond to the user's click on the summary component 1801 by displaying... Figure 18 Interface 1802 is shown in (b) of the diagram. (See diagram 1802.) Figure 18 As shown in (b), the interface may include a search interface and a summary of the search results from the terminal device.

[0228] Using the above technical solution, users can summarize their search results through a summary component displayed on the search interface while using the search application. This helps users quickly browse search results, saves time, and improves the user experience.

[0229] In one alternative implementation, when the first operation is a zoom operation, the zoom operation may include a shrink operation or a zoom-in operation. The functional components displayed by the terminal device in response to the zoom-in operation may be the same as or different from the functional components displayed by the terminal device in response to the shrink operation.

[0230] For example, taking the first category as the image category, the functional components displayed by the terminal device in response to zoom-in operations may include cropping components, elimination components, marking components, and image enlargement components. The functional components displayed by the terminal device in response to zoom-out operations may include image enlargement components.

[0231] For example, taking the first category as the document category, the functional components displayed by the terminal device in response to zoom-in operations may include a marker component. The functional components displayed by the terminal device in response to zoom-out operations may include a summary component.

[0232] For example, taking the second interface as a meeting application interface, the functional components displayed by the terminal device in response to zoom-in operations may include a recording component and a drawing component. The functional components displayed by the terminal device in response to zoom-out operations may include a recording component.

[0233] In the above description, the number of interface elements displayed in the terminal device's interface (such as the first interface or the second interface) is one, such as an image or a document. When multiple interface elements (hereinafter referred to as first objects) are displayed in the terminal device's interface (such as the third and fourth interfaces in this application), the terminal device can also respond to a second operation by the user in that interface, determine at least one interface element (hereinafter referred to as a second object) from the first objects, and display introductory information about the second object.

[0234] In the embodiments of this application, the second operation can be a zoom-in operation, or a double-click operation, etc.

[0235] The following describes the process of displaying the introductory information of the second object on the terminal device, taking the first object as an example, which includes (1) multiple books or (2) multiple products.

[0236] (1) Multiple books

[0237] In an alternative implementation, the terminal device may also display an interface (hereinafter referred to as the fourth interface) including the covers of multiple books (hereinafter referred to as the first book), and in response to a second operation by the user in the fourth interface, display the book information of the second book.

[0238] The second book is contained within the first book.

[0239] This application does not specifically limit the book information. For example, book information may include one or more of the following: book cover, synopsis, title, author, or recommendation information.

[0240] The number of the first books is greater than the number of the second books. This application does not specifically limit the number of the first and second books in its embodiments. For example, the first books can be 10, and correspondingly, the second books can be 2. Or, for another example, the first books can be 8, and correspondingly, the second books can be 2.

[0241] Specifically, taking the second operation as a zoom-in operation as an example, after the terminal device displays the fourth interface, if the user intends to look up the book information of each book, they can perform a zoom-in operation on the fourth interface. The terminal device can respond to the user's zoom-in operation on the fourth interface, determine the second book from the first book according to the first filtering conditions, and display the book information of the second book.

[0242] This application embodiment does not specifically limit the first filtering condition. For example, the first filtering condition could be to select the book with the most likes from the first books as the second book. Another example is that the first filtering condition could be to select the book with the most comments from the first books as the second book. Yet another example is that the first filtering condition could be to determine the second book from the first books according to the display order of the books on the fourth interface.

[0243] For example, with the number of second books being 2, the first filtering criterion is to select the book with the highest number of likes from the first books as the second book. The book information includes a synopsis, name, author, and recommendation information. The fourth interface is... Figure 19 Take the interface shown in (a) as an example. Figure 19 As shown in (a), the fourth interface contains the covers of 10 books, which are respectively Figure 19 The image (a) shows the covers of books A through J. Assume books A and B have the highest number of likes. The terminal device can respond to the user's zoom-in operation on the fourth interface by displaying the introduction, name, author, and recommendation information for book A, as well as the introduction, name, author, and recommendation information for book B, such as... Figure 19 As shown in (b) of the diagram.

[0244] After the terminal device displays the book information of the second book in the above manner, it can also respond to the user's zoom-out operation on the fourth interface to display the cover of the first book.

[0245] With the above technical solution, users can zoom in to intuitively view information about multiple books on the interface, thus helping them quickly select their favorite books and enhancing the user experience.

[0246] (2) Multiple products

[0247] In an alternative implementation, the terminal device may also display an interface (hereinafter referred to as the fifth interface) including product images of multiple products (hereinafter referred to as the first product), and in response to a second operation by the user in the fifth interface, display product information of the second product.

[0248] The second product is included in the first product.

[0249] This application does not specifically limit the product information. For example, product information may include one or more of the following: product images, price, reviews, or information about the store where the product is located.

[0250] Specifically, taking the second operation as a zoom-in operation as an example, after the terminal device displays the fifth interface, if the user intends to view product information for each product, they can perform a zoom-in operation on the fifth interface. The terminal device can respond to the user's zoom-in operation on the fifth interface, determine the second product from the first product according to the second filtering criteria, and display the product information of the second product.

[0251] This application does not specifically limit the second filtering condition in its embodiments. For example, the second filtering condition could be to select the product with the highest sales volume among the first products as the second product based on the sales volume of each product. Another example is that the second filtering condition could be to select the product with the most positive reviews among the first products as the second product based on the number of positive reviews among each product. Yet another example is that the second filtering condition could be to determine the second product from the first products based on the display order of each product on the fifth interface.

[0252] For example, with the quantity of the second product being 2, the second filtering condition is to select the product with the highest sales volume among the first products as the second product. Product information includes product images, price, reviews, and store information. The fifth interface is... Figure 20 Take the interface shown in (a) as an example. See also... Figure 20 As shown in (a), the fifth interface contains product images of 6 products, namely... Figure 20 Transforming toys 1-6 are shown in (a) of the diagram. Assume that transforming toys 1 and 2 have the highest sales volume. The terminal device can respond to the user's zoom-in operation on the fifth interface, displaying product images, prices, reviews, and store information for transforming toys 1, as well as product images, prices, reviews, and store information for transforming toys 2, such as... Figure 20 As shown in (b) of the diagram.

[0253] After displaying the product information of the second product in the above manner, the terminal device can also display the product image of the first product in response to the user's zoom-out operation on the fifth interface.

[0254] Through the above technical solution, users can zoom in to intuitively view product information for multiple products on the interface, thus helping them quickly select their favorite products and enhancing the user experience.

[0255] In one alternative implementation, when the interface elements include documents, i.e., when the interface element category is document, the functional components displayed by the terminal device for different interface elements can be the same. Specifically, the terminal device can display an interface that includes documents (hereinafter referred to as the sixth interface), and in response to the user's first operation in the sixth interface, display functional components that match the document.

[0256] Functional components that match the document are used to edit the document.

[0257] Functional components that match the document may include at least one of a tagging component, a summarizing component, or a translation component.

[0258] The specific implementation method can also be referred to the above. Figure 4 The contents of that document will not be repeated here.

[0259] With the above technical solution, users can directly edit the documents displayed on the interface through the marking component, summary component, or translation component, without having to search for the corresponding functional component through multiple operations. In this way, the entry point of at least one of the marking component, summary component, or translation component can be simplified, the operation process can be streamlined, and the user experience can be improved.

[0260] The above description primarily focuses on the display methods provided in the embodiments of this application from the perspective of electronic devices. Correspondingly, the embodiments of this application also provide a display device for implementing the various methods described above. This display device can be an electronic device as described in the method embodiments above, or a component that can be used in an electronic device. It is understood that, in order to achieve the above functions, the display device includes hardware structures and / or software modules corresponding to the execution of each function. Those skilled in the art should readily recognize that, based on the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein, this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed by hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0261] This application embodiment can divide the display device into functional modules according to the above method embodiment. For example, each function can be divided into its own functional module, or two or more functions can be integrated into one processing module. The integrated module can be implemented in hardware or as a software functional module. It should be understood that the module division in this application embodiment is illustrative and is only a logical functional division. In actual implementation, there may be other division methods.

[0262] Figure 21 A schematic diagram of an electronic device is shown, which may include a display module 2101.

[0263] The display module 2101 is used to display a first interface, which includes first interface elements, and the first interface elements are of a first category. In response to a first operation by the user on the first interface, it displays a first functional component matching the first category. The display module 2101 is also used to display a second interface, which includes second interface elements, and the second interface elements are of the first category. In response to a first operation by the user on the second interface, it displays a second functional component matching the first category.

[0264] The first functional component is used to edit the first interface elements, and the second functional component is used to edit the second interface elements. The first and second functional components are different.

[0265] Optionally, the electronic device may further include a processing module 2102. The processing module 2102 is used to determine the category of interface elements based on the application to which the first interface belongs or the recognition result of interface recognition of the first interface.

[0266] It should be understood that one or more of the above modules or units can be implemented by software, hardware, or a combination of both. When any of the above modules or units are implemented by software, the software exists as computer program instructions and is stored in memory. The processor can be used to execute the program instructions and implement the above method flow. The processor can be built into a system on a chip (SoC) or an application-specific integrated circuit (ASIC), or it can be a separate semiconductor chip. In addition to the core that executes software instructions for computation or processing, the processor may further include necessary hardware accelerators, such as field-programmable gate arrays (FPGAs), programmable logic devices (PLDs), or logic circuits that implement dedicated logic operations.

[0267] When the above modules or units are implemented in hardware, the hardware can be any one or any combination of a central processing unit (CPU), microprocessor, digital signal processing (DSP) chip, micro controller unit (MCU), artificial intelligence processor, ASIC, SoC, FPGA, PLD, application-specific digital circuit, hardware accelerator, or non-integrated discrete device, which can run the necessary software or perform the above method flow independently of software.

[0268] In one possible implementation, this application also provides a computer-readable storage medium storing a computer program or instructions that, when run on a display device, enable the display device to perform the methods described in any of the above method embodiments or any implementation thereof.

[0269] In one possible implementation, this application embodiment also provides a display method, which includes the method described in any of the above method embodiments or any implementation thereof.

[0270] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented using software programs, implementation can be, in whole or in part, in the form of a computer program product. This computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the flow or function according to the embodiments of this application is generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, computer instructions can be transmitted from one website, computer, server, or data center to another via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium accessible to a computer or a data storage device containing one or more servers, data centers, etc., that can be integrated with the medium. The available media can be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., digital versatile discs (DVDs), or semiconductor media (e.g., solid-state drives (SSDs)).

[0271] Although this application has been described herein in conjunction with various embodiments, those skilled in the art, by reviewing the accompanying drawings, the disclosure, and the appended claims, will understand and implement other variations of the disclosed embodiments in carrying out the claimed application. In the claims, the word "comprising" does not exclude other components or steps, and "a" or "an" does not exclude multiple instances. A single processor or other unit can implement several functions listed in the claims. While different dependent claims may recite certain measures, this does not mean that these measures cannot be combined to produce good results.

[0272] Although this application has been described in conjunction with specific features and embodiments, it is obvious that various modifications and combinations can be made thereto without departing from the spirit and scope of this application. Accordingly, this specification and drawings are merely exemplary illustrations of this application as defined by the appended claims, and are considered to cover any and all modifications, variations, combinations, or equivalents within the scope of this application. Clearly, those skilled in the art can make various alterations and modifications to this application without departing from the spirit and scope of this application. Thus, if such modifications and modifications of this application fall within the scope of the claims of this application and their equivalents, this application is also intended to include such modifications and modifications.

Claims

1. A display method, characterized in that, The method includes: Display a first interface, the first interface including first interface elements, the first interface elements being a first category; In response to a user’s first operation on the first interface, a first functional component matching the first category is displayed, the first functional component being used to enable editing of the elements of the first interface; Display a second interface, the second interface including second interface elements, the second interface elements being the first category; In response to the user's first operation on the second interface, a second functional component matching the first category is displayed; the second functional component is used to enable editing of elements on the second interface. The first functional component is different from the second functional component.

2. The method according to claim 1, characterized in that, The first interface element is a first image, and the first functional component includes at least one of the following components: A cropping component, the cropping component being used to crop the first image; An elimination component, the elimination component being used to eliminate content contained in the first image; A marking component, the marking component being used to mark in the first image; An image expansion component is used to expand the first image.

3. The method according to claim 1 or 2, characterized in that, The first interface element includes a first image; If the similarity between the second image and the first image is greater than a threshold, and / or the interval between the capture time of the second image and the capture time of the first image is less than a threshold, the first functional component includes a comparison component. The comparison component is used to compare the first image and the second image.

4. The method according to any one of claims 1-3, characterized in that, The first interface element includes a first image, and both the first image and the third image include a target area; If the similarity between the third image and the first image is greater than a threshold, and / or the interval between the shooting time of the third image and the shooting time of the first image is less than a threshold, the first functional component includes a replacement component. The replacement component is used to replace the content in the target area of ​​the first image with the content in the target area of ​​the third image.

5. The method according to claim 4, characterized in that, The target area is the face area.

6. The method according to any one of claims 1-5, characterized in that, The first interface element includes a first image; If the number of characters contained in the first image is greater than a threshold, the functional component includes a summary component, which is used to summarize the characters in the first image.

7. The method according to claim 1, characterized in that, The first interface element includes a first document, and the functional component includes at least one of the following components: A tagging component, the tagging component being used to tag in the first document; A summary component is used to summarize the content of the first document.

8. The method according to any one of claims 1-7, characterized in that, The method further includes: Display a third interface, which is the interface for the meeting application; In response to the user's first operation on the third interface, at least one of the following functional components is displayed: a pen component and a recording component; The drawing component is used to draw on the third interface, and the recording component is used to record the content of the meeting.

9. The method according to any one of claims 1-8, characterized in that, The first operation is a scaling operation; The scaling operation includes zooming in or zooming out, and the functional components displayed in response to the zooming in operation may be different or the same as those displayed in response to the zooming out operation.

10. The method according to any one of claims 1-9, characterized in that, The first functional component includes at least one component that is most frequently used among the components used to edit the interface elements of the first category.

11. The method according to any one of claims 1-10, characterized in that, Before displaying the first functional component that matches the first category, the method further includes: The first category is determined based on the application to which the first interface belongs or the recognition result of interface recognition of the first interface.

12. The method according to any one of claims 1-11, characterized in that, The method further includes: A fourth interface is displayed, which includes the cover of the first book; In response to the user's second operation on the fourth interface, the book information of the second book is displayed. The second book is included in the first book. The book information includes one or more of the following: a brief introduction, name, author, or recommendation information of the second book.

13. The method according to any one of claims 1-12, characterized in that, The method further includes: The fifth interface is displayed, which includes a product image of the first product; In response to a second operation by the user on the fifth interface, product information of a second product is displayed. The second product is included in the first product. The product information includes one or more of the following: product images and reviews of the second product, or information about the store where the second product is located.

14. An electronic device, characterized in that, The electronic device includes: a processor, a display, a memory, and a computer program stored in the memory; the memory, the display, and the processor are coupled; when the electronic device is running, the processor executes the computer program to implement the method as described in any one of claims 1-13.

15. A computer-readable storage medium, characterized in that, Includes program code that, when run on a computer or processor, causes the computer or processor to perform the method as described in any one of claims 1-13.

Images