Display method and apparatus

By recognizing the text and images selected by the user on the electronic device interface and pushing relevant services, the problem of cumbersome navigation address operations is solved, and the user experience is improved.

WO2025261026A1PCT designated stage Publication Date: 2025-12-26HONOR DEVICE CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2025/094997
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-06-20
Filing Date
2025-05-15
Publication Date
2025-12-26

AI Technical Summary

Technical Problem

In existing technologies, users need to perform multiple operations to navigate to an address sent by a friend on their electronic devices, resulting in a rather cumbersome user experience.

Method used

By recognizing the text and images selected by the user in the interface of electronic devices, and pushing services related to the text or images, the operation process is simplified.

Benefits of technology

It improves the user experience by simplifying the operation process, enabling electronic devices to quickly identify and push relevant services.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2025094997_26122025_PF_FP_ABST
    Figure CN2025094997_26122025_PF_FP_ABST
Patent Text Reader

Abstract

The embodiments of the present application relate to the technical field of terminals. Provided are a display method and an apparatus. The method comprises: in response to a first operation for selecting a first area on a first interface, displaying a second interface; in response to a second operation in respect of a button for a first service, sending a first picture to the first service; after the second interface is displayed, in response to a third operation in respect of a first button, displaying a third interface; and, in response to a fourth operation in respect of a button for a second service, sending text to the second service. In this way, an electronic device can not only send the text and a picture which serve as the first picture to any service related to the picture, but also recognize the text in the first area in response to the operation of a user in respect of the first button, thereby pushing the service related to the text and sending the text to any service.
Need to check novelty before this filing date? Find Prior Art

Description

Display method and apparatus

[0001] This application claims priority to Chinese Patent Application No. 202410804323.X, filed on June 20, 2024, entitled “Display Method and Apparatus”, the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of terminal technology, and in particular to display methods and apparatus. Background Technology

[0003] With the popularization and development of the internet, people's functional needs for electronic devices are becoming increasingly diversified. For example, to enhance users' ability to utilize multiple services, electronic devices can support the transfer of target content between various services. Target content can include text, images, videos, or files, etc.

[0004] Typically, when a user needs to navigate to an address sent by a friend, the user can perform a series of actions in sequence: copy the text information (or address information) related to the address in the chat application, open the navigation application from the background or desktop, click the search bar, paste the address information, click search, and click navigation.

[0005] However, the above operations are rather cumbersome and affect the user experience. Summary of the Invention

[0006] This application provides a display method and apparatus, applied in the field of terminal technology, enabling electronic devices to identify text and images in a selected area based on the user's operation, and push text-related services or image-related services to improve the user experience.

[0007] In a first aspect, embodiments of this application provide a display method, the method comprising: displaying a first interface, the first interface including display content; responding to a first operation of selecting a first area in the first interface, displaying a second interface, the first area including text and an image, the second interface including a first identifier for defining the text and image, display content, a first button, and a button for a first service, the first button being used to identify text in the first area, the first service being a service for pushing content based on the first area; after displaying the second interface, responding to a second operation on the button for the first service, sending a first image to the first service, the first image including text and an image; after displaying the second interface, responding to a third operation on the first button, displaying a third interface, the third interface including a second identifier for defining text, display content, the first button, and a button for a second service, the second service being a service for pushing text; responding to a fourth operation on the button for the second service, sending text to the second service. In this way, the electronic device can not only send text and images as a first image to any service related to the image, but also, in response to the user's operation on the first button, the electronic device can also identify the text in the first area, thereby realizing the pushing of text-related services and sending text to any service.

[0008] In one possible implementation, the second interface further includes a third button, and the method further includes: displaying a fourth interface in response to an operation on the third button, the fourth interface including a first image and a first identifier for framing the first image; displaying a fifth interface in response to a fifth operation of adjusting the size and / or position of the first identifier in the fourth interface, the fifth interface including a third identifier for indicating a second area within the first image and a fourth button; and saving the image corresponding to the second area to a preset application in response to an operation on the fourth button.

[0009] The third button can be button 608 in Figure 6D.

[0010] The fourth interface can be the interface shown in Figure 6I, the first image can be image 4 in Figure 6I, and the first identifier can be the selection identifier 701 in Figure 6I.

[0011] The fifth operation can be an operation targeting the selected identifier 701, and the fifth interface can be the interface shown in Figure 6J. The second area can be the area corresponding to image 5, the third identifier can be the selected identifier 701 in Figure 6J, and the fourth button can be the save button in Figure 6J. The preset application can be the gallery application.

[0012] In this way, users can flexibly edit the selected image using the third button on the second interface and save the edited image to a preset application.

[0013] In one possible implementation, after displaying the second interface, the method further includes: in response to a sixth operation on the first identifier, displaying a sixth interface, the sixth interface including: display content, a first image, and a first identifier for framing the first image, wherein the area occupied by the display content in the second interface is smaller than the area occupied by the display content in the sixth interface; in response to a seventh operation on adjusting the size and / or position of the first identifier in the sixth interface, displaying a seventh interface, the seventh interface including: display content, a fourth identifier for indicating a third area within the first image, and a button for a third service, wherein the third area is the area selected after adjustment by the seventh operation, and the third service is a service pushed based on content within the third area.

[0014] The sixth interface can be the interface shown in Figure 7G, which may include display content and does not display any service buttons. The seventh interface can be the interface shown in Figure 6E, where the button for the third service can be any button in the service list 610 of Figure 6E.

[0015] In this way, electronic devices can reserve a large area of ​​the sixth interface for displaying content, making it convenient for users to view and edit the content.

[0016] In one possible implementation, before the sixth operation, the content is displayed at an angle in the second interface, and after the sixth operation, the content is displayed without an angle in the sixth interface.

[0017] In this way, the electronic device displays the content in a non-tilted manner on the sixth interface, making it easier for users to view and edit the content.

[0018] In one possible implementation, the method further includes: in response to an eighth operation that adjusts the size and / or position of the first identifier in the second interface, displaying an eighth interface, the eighth interface including: display content, a fifth identifier for indicating a fourth region, and a button for a fourth service, the fourth region being the region selected after adjustment by the sixth operation, the display content being displayed at an angle in the second interface before the eighth operation, and the display content being displayed at an angle in the eighth interface after the eighth operation.

[0019] The eighth interface can be the interface shown in Figure 6E, and the button for the fourth service can be any button in the service list 610 in Figure 6E.

[0020] This allows users to edit the selected area on the second interface and display the service pushed after the area is adjusted on the eighth interface.

[0021] In one possible implementation, the method further includes: in response to a ninth operation on a first identifier, displaying a ninth interface, the ninth interface including: display content, a first image, a first identifier for framing the first image, and a button for a first service; in response to a ninth operation on the ninth interface adjusting the size and / or position of the first identifier, displaying a tenth interface, the tenth interface including: display content, a fifth identifier for indicating a fifth region, and a button for a fifth service, the fifth region being the region selected after adjustment by the ninth operation.

[0022] The ninth interface can be the interface shown in Figure 7D, and the tenth interface can be the interface shown in Figure 6E. In this way, while the user is adjusting the first identifier, the electronic device can continue to display the content and the first service on the ninth interface, so that the user can view the content on the interface at any time.

[0023] In one possible implementation, before the ninth operation, the displayed content is tilted in the second interface, and after the ninth operation, the displayed content is displayed without tilting in the ninth interface.

[0024] In this way, the electronic device displays the content in a non-tilted manner on the ninth interface, making it easier for users to view and edit the content.

[0025] In one possible implementation, the third interface further includes a third button. After displaying the third interface, the method further includes: in response to an operation on the third button, displaying an eleventh interface, which includes a second image generated based on text, a second identifier for framing the second image, and a fourth button; and in response to an operation on the fourth button, saving the second image to a preset application.

[0026] The third interface can be the interface shown in Figure 6E, and the third button can be button 608 in Figure 6E. The eleventh interface can be the interface shown in Figure 6J, the second picture can be picture 5 in Figure 6J, and the fourth button can be the save button in Figure 6J.

[0027] In one possible implementation, after displaying the first interface, the method further includes: in response to the operation of selecting the sixth area in the first interface, displaying the twelfth interface, wherein the sixth area includes an image, and the twelfth interface includes: a sixth identifier for framing the image, display content, a third button, and a sixth service, wherein the third button is used to crop the image, and the sixth service is a service for pushing content based on the sixth area.

[0028] The operation of selecting the sixth area in the first interface can be the operation of selecting an image in the first interface. The twelfth interface can be the interface shown in Figure 5C. The sixth identifier can be the selection identifier 5000 in Figure 5C. The third button can be the button 506 in Figure 5C. The sixth service can be any service in the service list 505.

[0029] In one possible implementation, the second identifier includes a seventh identifier for indicating the start position of the text and an eighth identifier for indicating the end position of the text. The seventh identifier is located in a first position, and the eighth identifier is located in a second position. After displaying the third interface, the method further includes displaying a thirteenth interface in response to an operation of moving the seventh identifier to the third position. The thirteenth interface includes text between the third position and the second position, the seventh identifier at the third position, the eighth identifier at the second position, display content, a first button, and a button for a fifth service. The fifth service is a service pushed based on the text between the third position and the second position. The fifth service may be the same as or different from the second service. The third position is located at any position in the display content other than the first area.

[0030] The seventh identifier can be identifier 405 in Figure 6E, the eighth identifier can be identifier 406 in Figure 6E, and the third position can be any position in Figure 6E other than the selected area 609. The twelfth interface can be the interface displayed after adjusting identifier 406, which is not shown for now.

[0031] This allows users to select text outside the boxed area 609 in Figure 6E using the seventh and / or eighth identifiers, thus improving the flexibility of text selection.

[0032] In one possible implementation, the first button is unselected before the second action and selected after the second action. This allows the user to determine whether the selected content is text or an image based on the state of the first button.

[0033] In one possible implementation, before displaying the first interface, the method further includes: displaying a fourteenth interface in response to an operation to open the settings interface of the first function from the settings app, the fourteenth interface including a fifth button and a sixth button; setting the operation to start the first function as a knuckle selection operation in response to an operation on the fifth button; displaying a fifteenth interface in response to an operation on the sixth button, the fifteenth interface being used to view other settings related to the knuckle selection operation, the fifteenth interface including a seventh button; and displaying the fourteenth interface in response to an operation on the seventh button.

[0034] The first function can be any door as described in the embodiments of this application, the fourteenth interface can be the interface shown in Figure 3A, the fifth button can be button 302 in Figure 3A, and the sixth button can be button 304 in Figure 3A.

[0035] The fifteenth interface can be the interface shown in Figure 3B, and the seventh button can be button 308 in Figure 3B.

[0036] In this way, the electronic device can add a fifth button to the settings interface of the first function, allowing users to set the operation of activating the first function as a knuckle selection action, simplifying the process of activating the first function. Furthermore, the electronic device can also view other settings related to the knuckle selection action based on the user's action on the sixth button.

[0037] In one possible implementation, the first service includes one or more of the following: a service for saving images, or a service for editing images.

[0038] Secondly, embodiments of this application provide a display device, which may be an electronic device, or a chip or chip system within an electronic device. The display device may include a display unit and a processing unit. When the display device is an electronic device, the display unit may be a display screen. The display unit is used to perform display steps to enable the electronic device to implement a display method described in the first aspect or any possible implementation of the first aspect. When the display device is an electronic device, the processing unit may be a processor. The display device may further include a storage unit, which may be a memory. The storage unit is used to store instructions, and the processing unit executes the instructions stored in the storage unit to enable the electronic device to implement a display method described in the first aspect or any possible implementation of the first aspect. When the display device is a chip or chip system within an electronic device, the processing unit may be a processor. The processing unit executes the instructions stored in the storage unit to enable the electronic device to implement a display method described in the first aspect or any possible implementation of the first aspect. The storage unit may be a storage unit within the chip (e.g., a register, cache, etc.), or a storage unit located outside the chip within the electronic device (e.g., a read-only memory, random access memory, etc.).

[0039] Specifically, the display unit is used to display a first interface, which includes display content; in response to a first operation of selecting a first area in the first interface, the display unit is also used to display a second interface, where the first area includes text and images, and the second interface includes a first identifier for defining the text and images, display content, a first button, and a button for a first service, where the first button is used to identify the text in the first area, and the first service is a content push service based on the first area; after displaying the second interface, in response to a second operation on the button for the first service, the processing unit is used to send a first image to the first service, where the first image includes text and images; after displaying the second interface, in response to a third operation on the first button, the display unit is also used to display a third interface, where the third interface includes a second identifier for defining the text, display content, a first button, and a button for a second service, where the second service is a text push service; in response to a fourth operation on the button for the second service, the processing unit is also used to send text to the second service.

[0040] Fourthly, embodiments of this application provide an electronic device, the electronic device comprising: one or more processors and a memory; the memory is coupled to the one or more processors, the memory being used to store computer program code, the computer program code including computer instructions, the one or more processors calling the computer instructions to cause the electronic device to perform the method described in the first aspect or any possible implementation of the first aspect, or to perform the method described in the second aspect or any possible implementation of the second aspect.

[0041] Fifthly, embodiments of this application provide a computer-readable storage medium comprising computer instructions that, when executed on an electronic device, cause the electronic device to perform the method described in the first aspect or any possible implementation thereof, or to perform the method described in the second aspect or any possible implementation thereof.

[0042] Sixthly, embodiments of this application provide a computer program product including a computer program. When the computer program product includes computer program code, when the computer program code is run on an electronic device, the electronic device performs the method described in the first aspect or any possible implementation of the first aspect, or performs the method described in the second aspect or any possible implementation of the second aspect.

[0043] In a seventh aspect, this application provides a chip system applied to an electronic device, the chip system including one or more processors, the one or more processors being configured to invoke computer instructions to cause the electronic device to perform the method described in the first aspect or any possible implementation thereof, or to perform the method described in the second aspect or any possible implementation thereof.

[0044] In one possible implementation, the chip system described above in this application further includes at least one memory storing instructions. The memory can be an internal storage unit of the chip system, such as a register or cache, or it can be a storage unit of the chip system itself (e.g., read-only memory, random access memory, etc.).

[0045] It should be understood that the third to seventh aspects of this application correspond to the technical solutions of the first to second aspects of this application, and the beneficial effects achieved by each aspect and the corresponding feasible implementation are similar, and will not be repeated here. Attached Figure Description

[0046] Figures 1A-1D are schematic diagrams of a scenario provided by the application embodiments;

[0047] Figure 2 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application;

[0048] Figures 3A-3F are schematic diagrams of an interface provided in an embodiment of this application;

[0049] Figures 4A-4I are schematic diagrams of an interface provided in an embodiment of this application;

[0050] Figures 5A-5C are schematic diagrams of an interface provided in an embodiment of this application;

[0051] Figures 6A-6J are schematic diagrams of an interface provided in an embodiment of this application;

[0052] Figures 7A-7L are schematic diagrams of an interface provided in an embodiment of this application;

[0053] Figures 8A-8C are schematic diagrams of an interface provided in an embodiment of this application;

[0054] Figure 9 is a flowchart illustrating an interface display method provided in an embodiment of this application;

[0055] Figure 10 is a schematic diagram of the hardware structure of another electronic device provided in an embodiment of this application. Detailed Implementation

[0056] To facilitate a clear description of the technical solutions in the embodiments of this application, some terms and technologies involved in the embodiments of this application will be briefly introduced below:

[0057] 1. Anywhere Door

[0058] The term "any door" can be understood as a function that enables the flexible transfer of target content between multiple services. It can also be called intelligent service push, etc. The embodiments of this application do not limit the name of the "any door".

[0059] The "Anywhere Door" feature allows users to drag target content such as text, images, videos, or files on the screen to either side edge of the screen by long-pressing, quickly accessing various quick services or applications, as described in Figures 1A-1D. For example, in response to a user dragging address information directly to the edge of the screen (while the user is still holding down the button), the electronic device displays a service list. In response to the user continuing to drag the address information to the navigation service in the service list (while the user releases the button), the electronic device can quickly initiate a navigation route, which can be a route from the user's current location to the location of the address information.

[0060] The services in the service list can be pushed to electronic devices based on user-selected content, or the services in the service list can be manually adjusted by the user. In essence, the "Anywhere Door" eliminates the inconvenience of frequent application switching, allowing users to flexibly control across applications and services.

[0061] 2. Select by knuckles

[0062] Knuckle selection is a gesture operation where users tap the screen with their knuckles and draw circles to select a portion of the interface. For example, users can use knuckle selection to take screenshots, access other interfaces, or trigger annotations.

[0063] 3. Electronic equipment

[0064] The electronic devices in this application embodiment may include handheld devices with display functions, in-vehicle devices, etc. For example, some electronic devices include: mobile phones, tablet computers, PDAs, laptops, mobile internet devices (MIDs), wearable devices, virtual reality (VR) devices, augmented reality (AR) devices, in-vehicle devices, terminal devices in 5G networks, or terminal devices in future evolved public land mobile networks (PLMNs), etc., and this application embodiment is not limited to these. Wearable devices may include one or more of the following: smartwatches, smart glasses, smart bracelets, smart jewelry, etc.

[0065] The electronic devices in the embodiments of this application may also be referred to as: terminal equipment, user equipment (UE), mobile station (MS), mobile terminal (MT), access terminal, user unit, user station, mobile station, mobile station, remote station, remote terminal, mobile device, user terminal, terminal, wireless communication equipment, user agent, or user device, etc.

[0066] 4. Other nouns

[0067] In the embodiments of this application, terms such as "first" and "second" are used to distinguish identical or similar items with substantially the same function and purpose. For example, "first chip" and "second chip" are used only to distinguish different chips and do not limit their order of execution. Those skilled in the art will understand that terms such as "first" and "second" do not limit the quantity or execution order, and that "first" and "second" do not necessarily imply that they are different.

[0068] It should be noted that, in the embodiments of this application, the terms "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design scheme described as "exemplary" or "for example" in this application should not be construed as being more preferred or advantageous than other embodiments or design schemes. Specifically, the use of terms such as "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.

[0069] In this application embodiment, "at least one" refers to one or more, and "more than one" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, ab, a--c, bc, or abc, where a, b, and c can be single or multiple.

[0070] The usage process of the "Anywhere Door" will be described below with reference to the embodiments corresponding to Figures 1A-1D. Figures 1A-1D are schematic diagrams of a scenario provided by the embodiments of the application. In this embodiment, a mobile phone is used as an example for illustration, and this illustration does not constitute a limitation on the embodiments of this application.

[0071] In response to a user opening a video application, the electronic device can display an interface as shown in Figure 1A, which can be referred to as a video playback interface. The display content in Figure 1A may include: the video, and buttons for controlling the video, etc.

[0072] A single frame of the video can display text, as well as images within the dashed box 101. The images within the dashed box 101 can include the portraits of expert A and expert B.

[0073] Buttons for manipulating the video may include multiple buttons in the dashed box 102, such as buttons for setting a like tag for the video, buttons for commenting on the video, buttons for saving the video, and buttons for sharing the video.

[0074] In response to the user's operation 1 on the target area in Figure 1A (while the user is still holding the device), the electronic device can display the interface shown in Figure 1B. After operation 1 is completed, the electronic device can display the interface shown in Figure 1C.

[0075] The target area can be any area in the video that contains text and images. For example, the target area could be an area containing: Expert A's personal information and Expert A's profile picture.

[0076] Operation 1 may include: knuckle selection operation, etc. When operation 1 is a knuckle selection operation, Figure 1B can display: a video playback interface and a selection trajectory 103. The selection trajectory 103 can be determined based on the knuckle selection operation. The selection trajectory 103 may or may not form a closed area.

[0077] Figure 1C can be called the image editing interface. Figure 1C shows: image 104, and the button in the dashed box 105.

[0078] Image 104 can be an image generated by an electronic device based on the display content in Figure 1A.

[0079] Image 104 can display a selection area 106, which can include the content within the target area. The selection area 106 can be a closed shape. Other areas in image 104 besides the selection area 106 are covered with a mask.

[0080] The buttons in the dashed box 105 can be displayed from left to right as follows: share button, button for setting the selection area to a free shape, button for setting the selection area to a rectangle, button for setting the selection area to an ellipse, and button for setting the selection area to a heart shape.

[0081] In response to the user dragging the content in the selected area 106 in Figure 1C to the right edge of the screen (without the user releasing the drag), the electronic device can display the interface shown in Figure 1D.

[0082] Figure 1D can display: image 107, selected area 106, and service list 108.

[0083] Image 107 can be an image generated by an electronic device after taking a screenshot, reducing its size, and rotating the content displayed in Figure 1C.

[0084] Any service in the service list 108 can be a service that pushes images based on the selected area 106. For example, the service list 108 may include buttons for one or more of the following services: a button for the collection space service, a button for sending to a friend, a button for sending to a colleague, a button for the note service 109, a button for the shopping service, and a button for the search service, etc.

[0085] It is understandable that if the electronic device can recognize the content within the selected area 106 as an image, then the services in the service list 108 are image-based services pushed by the electronic device. Optionally, when a user copies text in the interface and drags the text to the edge of the screen, the electronic device can also push text-related services in the service list; the specific process will not be elaborated here.

[0086] Furthermore, in response to the user continuing to drag the content in the selected area 106 to the position of the button 109, the electronic device can display the service window corresponding to the button 109 and send the content in the selected area 106 to the service window, which is not shown in the figure.

[0087] However, the methods described in Figures 1A-1D are rather cumbersome, affecting the user experience. Furthermore, when the selected area includes both images and text, the electronic device cannot recognize the text and / or images within the selected area, thus failing to push appropriate services based on the images and / or text within the selected area.

[0088] In view of this, this application provides a display method in which an electronic device can display text and images in a first area of ​​the interface. In response to a user's operation of circling the first area with their knuckle, the electronic device can recognize the text and images in the first area and push text-related services or image-related services, so that the pushed services are more in line with the user's needs and improve the user experience.

[0089] To better understand the embodiments of this application, the structure of the electronic device according to the embodiments of this application will be described below. For example, FIG2 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application.

[0090] The electronic device may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, an indicator 192, a camera 193, and a display screen 194, etc.

[0091] In this embodiment of the application, the sensor module 180 may include a touch sensor 180A, which can be used to receive user trigger operations on the electronic device.

[0092] The sensor module 180 may also include one or more of the following: proximity light sensor and ambient light sensor, pressure sensor, gyroscope sensor, barometric pressure sensor, magnetic sensor, accelerometer, distance sensor, fingerprint sensor, temperature sensor, or bone conduction sensor, etc. (not shown in Figure 2), but this application embodiment does not specifically limit the following.

[0093] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device. In other embodiments of this application, the electronic device may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0094] The processor 110 may include one or more processing units. The processor 110 can implement the steps of detecting the user's air gesture and controlling the device to execute corresponding instructions based on the user's air gesture in the power supply method provided in the embodiments of this application.

[0095] USB interface 130 is an interface that conforms to the USB standard specification, specifically it can be a Mini USB interface, Micro USB interface, USB Type C interface, etc.

[0096] The charging management module 140 is used to receive charging input from the charger. The power management module 141 is used to connect the charging management module 140 and the processor 110.

[0097] The wireless communication function of electronic devices can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.

[0098] Electronic devices utilize GPUs, displays (194), and application processors to achieve display functions. The GPU is a microprocessor for image processing, connecting the displays (194) and the application processor.

[0099] The display screen 194 is used to display images and videos, for example, the display screen 194 can display Figures 1A-1D and Figures 3A-7L described in the embodiments of this application.

[0100] Electronic devices can achieve shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.

[0101] Camera 193 is used to capture still images or videos. Camera 193 may include the AON camera described in the embodiments of this application, as well as a rear camera, etc.

[0102] The external memory interface 120 can be used to connect an external memory card. The internal memory 121 can be used to store computer executable program code, which includes instructions.

[0103] Electronic devices can implement audio functions such as music playback and recording through audio modules 170, speakers 170A, receivers 170B, microphones 170C, headphone jacks 170D, and application processors.

[0104] A touch sensor can be located on the display screen 194, and the touch sensor and the display screen 194 together form a touch screen, also known as a "touchscreen". The touch sensor can detect user knuckle selection or other trigger operations on the electronic device.

[0105] Button 190 includes the power button, volume buttons, etc.

[0106] The software systems of electronic devices can adopt layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture, etc., which will not be elaborated here.

[0107] The technical solution of this application and how the technical solution of this application solves the above-mentioned technical problems are described in detail below with specific embodiments. The following specific embodiments can be implemented independently or in combination with each other. The same or similar concepts or processes may not be described again in some embodiments.

[0108] In this embodiment, a video scenario is used as an example to illustrate the use of the "Anywhere Door". For instance, during video playback, in response to the user's activation of the "Anywhere Door", the electronic device can push services related to the text in the video and / or services related to the images in the video. It should be understood that this embodiment does not limit the use case of the "Anywhere Door".

[0109] In this embodiment, the electronic device can set the method for activating the "anywhere door" to knuckle selection (see the description in Figures 3A-3B). Furthermore, when the displayed content of the electronic device includes images and text, in response to the user's knuckle selection of images and text, the electronic device can push text-related services and / or image-related services (see the description in Figures 4A-7L).

[0110] 1. To activate the Anywhere Door, select it by knuckle gesture.

[0111] In response to a user's access to the Any Door settings interface via the Settings app - Smart Assistant button - Any Door button, or the Settings app - Search box - Any Door, the electronic device can display the interface shown in Figure 3A.

[0112] Figure 3A can be the interface for setting up any door. Figure 3A can display one or more of the following: animation 300, button 301, button 302, button 320, and option bar 303, etc.

[0113] Animation Effect 300 can be understood as the animation effect of the Any Door demonstration. The bottom of Animation Effect 300 can display the corresponding function explanation during the animation demonstration.

[0114] Button 301 can be used to activate or deactivate the "anywhere door". When button 301 is in the closed state, the electronic device can activate the "anywhere door" in response to a user's click on button 301; or, when button 301 is in the open state, the electronic device can deactivate the "anywhere door" in response to a user's click on button 301. When button 301 is in the closed state, button 302 may not be shown in Figure 3A.

[0115] Button 302 can be used to set the method of activating the Any Door to knuckle selection. The function of button 302 can be displayed around button 302, such as displaying the words "Knuckle selection opens the door"; the description of button 302 can also be displayed around button 302, such as displaying the words "Knuckle selection opens the Any Door automatically", etc.

[0116] Optionally, the method for activating the "Anywhere Door" is not limited to the knuckle selection described in Figure 3A. For example, the method for activating the "Anywhere Door" may also include: long-pressing text to activate the "Anywhere Door", long-pressing an image to activate the "Anywhere Door", long-pressing a screenshot thumbnail to activate the "Anywhere Door", activating the "Anywhere Door" through the screenshot editing interface, or activating the "Anywhere Door" by dragging elements in the smart screen recognition interface after entering the smart video screen with two fingers, etc., which are not limited in this embodiment.

[0117] Button 320 can be used to try out the Any Door.

[0118] The options bar 303 may include button 321 and button 304. Button 321 can be used to view the settings interface corresponding to the application content drag-and-drop function, and button 304 can be used to view the settings interface for knuckle selection.

[0119] Under normal circumstances, users can use the knuckle selection operation to take screenshots (as described in Figures 1A-1C) and save data globally. After the user sets the method for launching the "Anywhere Door" based on Figure 3A to the knuckle selection operation, the user may want to view other functions launched based on the knuckle selection operation. Therefore, the electronic device can set a button 304 in the option bar 303 of Figure 3A to allow users to quickly browse functions related to knuckle selection, thereby improving the user experience.

[0120] In response to a user's click on button 304, the electronic device displays the interface shown in Figure 3B. Optionally, the user can also access Figure 3B via other paths. For example, in response to a user's access to the screenshot / global favorites settings interface via the path Settings app - Accessibility button - Quick launch and gesture button, the electronic device can display the interface shown in Figure 3A.

[0121] Figure 3B shows the screenshot / global favorites settings interface, also known as the knuckle selection settings interface. Figure 3B can be used to set the activation method for screenshots / global favorites. Figure 3B can display: animation 305, button 306, and option bar 307, etc.

[0122] Animation 305 can be understood as an animation demonstration for screenshots / global favorites. The bottom of Animation 305 can display the corresponding function explanation during the animation demonstration.

[0123] Button 306 can be used to activate knuckle screenshot. For example, the specific implementation of knuckle screenshot can be displayed around button 306, that is, knuckle screenshot can realize functions such as capturing the whole screen, partial screenshot and scrolling screenshot.

[0124] Option bar 303 may include button 308. Button 308 allows you to view the settings interface for the "Anywhere Door - Knuckle Circle to Open".

[0125] Understandably, when the knuckle screenshot function is enabled based on button 306, the user may want to view other functions launched based on the knuckle. Therefore, the electronic device can set button 308 in the option bar 307 of Figure 3B to enable the user to quickly browse functions related to the knuckle selection operation and improve the user experience.

[0126] For example, in response to a user's click on button 308, the electronic device can display the interface shown in Figure 3A.

[0127] It should be noted that even if the user sets the screenshot activation method to knuckle selection via button 306 in Figure 3B, when button 302 in Figure 3A is in the active state, the user can still activate the "Anywhere Door" by using the knuckle selection operation. Alternatively, it can be understood that button 302 has a higher priority than button 306.

[0128] When button 302 in Figure 3A is in the off state and button 306 in Figure 3B is in the on state, the user can take a screenshot by selecting with their knuckle.

[0129] Optionally, the electronic device can open the "Anywhere Door" using button 301 in Figure 3A, or it can open the "Anywhere Door" from another interface. For example, after a system upgrade or upon first power-on, the electronic device can display the interface shown in Figure 3C, which can display button 309 for activating the "Anywhere Door," with a brief description of the "Anywhere Door's" function displayed around button 309. When button 309 is in the active state, the electronic device can activate the "Anywhere Door."

[0130] Optionally, the electronic device may also provide a trial function for any door. For example, in response to a user's click on button 320 in Figure 3A, the electronic device displays the interface shown in Figure 3D.

[0131] Figure 3D shows: prompt information 310, image 311, and text description 312 corresponding to image 311.

[0132] Prompt message 310 is used to prompt the user to select an image by tapping and drawing a circle with their knuckles (i.e., knuckle selection).

[0133] Image 311 can display the selection trajectory, which can be an irregular shape. The selection trajectory in image 311 can be used to prompt the user to perform the knuckle selection operation.

[0134] In response to the user's knuckle tapping and selecting image 311, the electronic device displays the interface shown in Figure 3E.

[0135] Figure 3E can display: prompt message 313, image 330, selected area 314, and service list 316.

[0136] Message 313 can be used to prompt users to click the global favorites icon.

[0137] Image 330 can be an image generated by editing, reducing, and rotating the image 311 and text description 312 in Figure 3D.

[0138] The selected area 314 can display image 311 or part of image 311, and the selected area 314 can be surrounded by a selection marker 315.

[0139] The service list 316 can push services based on the content in the selected area 314. For example, the service list 316 can display: the button 317 for the global favorite service and buttons for other services.

[0140] In response to the user's click on button 317, the electronic device can add the content in the selected area 314 to the global favorites service and display the interface shown in Figure 3F.

[0141] Figure 3F shows: Prompt message 318. Prompt message 318 can be used to notify the user that the operation was successful and that the electronic device has quickly added the picture to the global favorites.

[0142] In this way, users can try out the Anywhere Door through the interface shown in Figures 3D-3F, thereby improving their experience when using the Anywhere Door in the future.

[0143] 2. Select text and / or images using a knuckle selection tool.

[0144] It is understandable that, in response to a user's knuckle selecting text, the electronic device can push text-related services, as described in Method A; or, in response to a user's knuckle selecting an image, the electronic device can push image-related services, as described in Method B; or, in response to a user's knuckle selecting both text and an image, the electronic device can push image and / or text-related services, as described in Method C.

[0145] Method A: Select text using a knuckle gesture

[0146] The display content in Figure 1A may include: text and pictures, and operation 1 may be a knuckle selection operation.

[0147] In response to the user's operation 1 on the text in Figure 1A (when the user has not released the hand), the electronic device may display the interface shown in Figure 4A. After operation 1 ends, the electronic device may sequentially display the interfaces shown in Figure 4B and Figure 4C. The time interval between Figure 4B and Figure 4C may be a constant duration such as 20 ms.

[0148] It can be understood that after the electronic device responds to the user's operation 1 on the text in Figure 1A, it may identify the content around operation 1 to determine the selected content. When the circled area in Figure 4A does not contain words such as "will" and "shi", the electronic device may identify the content around operation 1 to determine that the user intends to select the text paragraph containing "will" and "shi", and then frame the text paragraph with the selection box 400 in Figure 4B. Further, the electronic device may identify the content in the selection box 400 and display the interface shown in Figure 4C when it determines that the content in the selection box 400 is text.

[0149] Optionally, after operation 1 ends, the electronic device may also skip the interface shown in Figure 4B and directly display the interface shown in Figure 4C, which is not limited in this embodiment of the present application.

[0150] Figure 4A may display: a video playback interface and a selection trajectory 401. The selection trajectory 401 may be determined based on operation 1, and the selection trajectory 401 may include text, such as the text being displayed as "June 6, 2024, XX City... Here I would like to introduce to everyone".

[0151] Figure 4B may display: a video playback interface and a selection box 400. The selection box 400 may be rectangular or may also be a rounded rectangle, etc., and the selection box 400 may be a solid line or may also be a dashed line, etc. The form of the selection box 400 is not limited in this embodiment of the present application.

[0152] It can be understood that after the electronic device displays Figure 4B, it may determine the distance between the selection box 400 and the screen edge. When the electronic device detects that the distance between the selection box 400 and the right screen edge is distance 1 and the distance between the selection box 400 and the left screen edge is distance 2, and when distance 1 is less than distance 2, the electronic device may display a service list 404 on the right side of Figure 4C.

[0153] Figure 4C may display: a picture 402, a framed area 403, and a service list 404.

[0154] Image 402 can be an image generated by an electronic device after taking a screenshot, reducing its size, and rotating the content displayed in Figure 1A.

[0155] The selection area 403 covers the image 402, and the selection area 403 can display: the text selected by the user based on operation 1, and the text in the selection area 403 is in the selected state.

[0156] The selected area 403 can display: label 405 and label 406. Label 405 can be used to indicate the start position of the text, and label 406 can be used to indicate the end position of the text.

[0157] For example, a user can select text in different areas by dragging indicator 405 and / or indicator 406. It is understood that a user can also select text in areas other than the selected area 403 by dragging indicator 405 and / or indicator 406.

[0158] Buttons 407 and 408 can be displayed around the selected area 403 (such as directly below the selected area 403). Button 407 can be selected, and button 408 can be unselected.

[0159] Understandably, if only text is displayed in the selected area 403, button 407 can be in the selected state by default.

[0160] Button 407 is used to select the text in the selection area 403 or to process the content in the selection area 403 into an image.

[0161] In one implementation, when button 407 is in an unselected state, in response to a user's click on button 407, the electronic device can recognize the text in the selected area 403 and highlight the text in the selected area 403. At this time, identifier 405 and identifier 406 can be displayed in the selected area 403.

[0162] When button 407 is selected, in response to the user's click operation on the button of any service in the service list 404, the electronic device can send the text in the selected area 403 to any service.

[0163] In another implementation, when button 407 is selected, in response to the user's click on button 407, the electronic device can process the content in the selected area 403 into an image and display the interface shown in Figure 4D.

[0164] Understandably, since the electronic device recognizes the content in the selected area 403 as text, the selection indicator may not be displayed around the selected area 403 in Figure 4C. The user can adjust the selected area using indicator 405 and / or indicator 406. Optionally, the selection indicator may also be displayed around the selected area 403 in Figure 4C, allowing the user to adjust the range of the selected area using the selection indicator.

[0165] The service list 404 can be based on the text push in the selected area 403 of Figure 4C. For example, the service list 404 may include: a button for saving services, a button 432 for sending to friends, a button for to-do services, a button for note services, a button for creating a new schedule service, and a button for searching services, etc.

[0166] Optionally, in response to a user's click on button 432 in service list 404, the electronic device can display the interface shown in Figure 4G. Window 433 can be displayed in Figure 4G, and window 433 can be a floating window corresponding to the "Send Friend" service. In response to a user's click on User 1 in window 433, the electronic device can display the interface shown in Figure 4H. Window 433 in Figure 4H can display chat messages, such as message 434, and the text in message 434 is the same as the text in the selected area 403.

[0167] Optionally, in response to a user's triggering action on the blank area in Figure 4C, the electronic device may continue to display the interface shown in Figure 4C.

[0168] Optionally, in response to a user clicking or dragging any service button, the electronic device can exit the portal and display the interface shown in Figure 1A; or, in response to a user clicking the button in the system navigation for returning to the previous step or swiping from one edge of the screen to the other, the electronic device can exit the portal and display the interface shown in Figure 1A. In response to a user clicking the button in the system navigation for returning to the desktop, the electronic device displays the desktop. The system navigation can be a three-button navigation system on the electronic device, which may include: a button for returning to the previous step, a button for returning to the desktop, and a button for entering the multitasking management interface, etc.

[0169] Optionally, the electronic device can also display a service list 404 on the left edge of the screen based on the user's dragging and dropping of text in the selected area 403 to the left edge of the screen, thereby changing the interface layout in Figure 4C.

[0170] In response to a user's click on button 407 in Figure 4C, the electronic device can display the interface shown in Figure 4D, which may display: image 402, selection area 403, and service list 409.

[0171] The selected area 403 may contain image 1, which may be an image generated based on the content within the selected area 403.

[0172] When image 1 is included in the selected area 403, the service list 409 can display services pushed based on image 1. For example, the service list 409 may display one or more of the following: a button 412 for saving the image, a button 432 for sending to a friend, or a button 435 for screenshot editing, etc. In response to the user's click on button 412, the electronic device can save image 1 to the gallery, allowing the user to quickly save images in the selected area. The gallery can be understood as an application used to store images, and can also be called a "photo album," etc., but this embodiment does not limit this.

[0173] Optionally, in response to a user's click on button 435 in service list 409, the electronic device can display the interface shown in Figure 4E to crop image 1.

[0174] Optionally, in response to a user's click on button 432 in service list 409, the electronic device can display the interface shown in Figure 4G. Window 433 may be displayed in Figure 4G. In response to a user's click on User 1 in window 433, the electronic device can display the interface shown in Figure 4I. Dialogue messages may be displayed in window 433 of Figure 4I, such as including image 3 or a thumbnail of image 3.

[0175] Understandably, electronic devices can determine the services to be pushed in the service list based on the content type within the selected area. For example, if the selected area contains an image, the electronic device can push services related to that image type; or, if the selected area contains text, the electronic device can push services related to that text.

[0176] Optionally, if the selected area contains text, the electronic device can also recognize the text and then push more accurate services. For example, when the electronic device detects that the text in the selected area is related to an address, it can push navigation-related services in the service list; or, when the electronic device detects that the text in the selected area is related to an item, it can push shopping-related services in the service list, etc. This application embodiment does not limit this.

[0177] A selection marker 4000 can be displayed around the selected area 403, which can be used to define the extent of the selected area 403. For example, in response to a user dragging the selection marker 4000, the electronic device can zoom in or out of the selected area 403. Alternatively, in response to a user dragging the selected area 403, the electronic device can also change the position of the selected area 403.

[0178] The selection indicator 4000, also known as a clipping box, can be displayed in bold and / or in color. Content within the selection indicator is highlighted; for example, the content within the selection indicator 4000 can be displayed in bold, and / or in color, and / or magnified.

[0179] The selected marker 4000 and the selected area 403 can be understood as a single unit. When the size of the selected marker 4000 changes, the size of the selected area 403 also changes; and / or, when the position of the selected marker 4000 changes, the position of the selected area 403 also changes accordingly. Users can adjust the content defined within the selected area 403 by adjusting the size and / or position of the selected marker 4000.

[0180] The area around the selected region 403 can display buttons 410 and 411. The function of button 410 is described in the same way as button 407, and the function of button 411 is described in the same way as button 408. Button 410 is currently unselected.

[0181] When button 410 is not selected, in response to the user's click operation on the button of any service in the service list 409, the electronic device can send image 1 to the window corresponding to any service.

[0182] Optionally, the electronic device can adjust the selected area. In response to a user's click on button 408 in Figure 4C or button 411 in Figure 4D, the electronic device can display the interface shown in Figure 4E.

[0183] Figure 4E shows the interface for adjusting the selected area. From left to right, the top of the interface in Figure 4E displays the following buttons: 430, 425, 426, 427, and 428. Button 430 exits the current interface, button 425 reverts to the previous editing operation, button 436 resumes the next editing operation, button 427 deletes the edited image, and button 428 saves the edited image.

[0184] The center of Figure 4E can display: Image 1 and option box 420.

[0185] The area around Image 1 can be marked with a selection marker 4000. Users can adjust the size of the selection marker 4000 to control the selected area. Adjusting the size of the selection marker 4000 can include dragging any edge or corner of the selection marker 4000 and moving it horizontally or vertically, or pinching or opening two fingers inside the selection marker 4000.

[0186] For example, users can crop image 1 by adjusting the selection indicator 4000.

[0187] Optionally, users can also re-crop a suitable image from image 2 by adjusting the selected indicator 4000. Image 2 can be an image generated based on the display content in Figure 1A, etc.

[0188] The option box 420 can display the following buttons from top to bottom: button 421 for setting the selection area to a free shape, button 422 for setting the selection area to a rectangle, button 423 for setting the selection area to an ellipse, and button 424 for setting the selection area to a heart shape.

[0189] At the bottom of Figure 4E, option box 429 can be displayed. From left to right, option box 429 can display: a button for sharing images, a button for adding doodles to images, a button for adding mosaics to images, a button for adjusting image details using the eraser, and a button for triggering scrolling screenshots, etc.

[0190] It is understood that the user can edit the image 1 in the selected area using any of the buttons in Figure 4E. In response to the user's click on button 428, the electronic device can store the edited image 1 in the gallery and display the interface shown in Figure 4F.

[0191] Figure 4F shows the video playback interface and prompt message 431. Prompt message 431 indicates that the edited image 1 has been saved to the gallery. For example, prompt message 431 can be displayed as "Saved to gallery".

[0192] Referring to the descriptions in Figures 4A-4G, the electronic device can convert between images and text based on button 407. For example, when button 407 is selected, the electronic device can push services based on the text in the selected area 403, sending the text to any service and enabling text transfer between services. When button 407 is not selected, the electronic device can push services based on image 1 corresponding to the selected area 403, sending image 1 to any service and enabling image transfer between services. This allows users to determine the content to be sent based on their needs, enabling the electronic device to provide more accurate services.

[0193] Method B: Selecting images using a knuckle gesture

[0194] In response to user action 1 on the image in Figure 1A (while the user is still holding the device), the electronic device can display the interface shown in Figure 5A. After action 1 is completed, the electronic device can sequentially display the interface shown in Figure 5B and then the interface shown in Figure 5C. The time interval between Figure 5B and Figure 5C can be 20ms.

[0195] Understandably, in response to the user's operation 1 on the image in Figure 1A, the electronic device can determine the selected area, for example, by defining the selected area using a selection box 500 in Figure 5B. Furthermore, the electronic device can identify the content within the selection box 500, and when it determines that the content within the selection box 500 is an image, it displays the interface shown in Figure 5C.

[0196] Optionally, after operation 1 is completed, the electronic device may also skip the interface shown in Figure 5B and directly display the interface shown in Figure 5C. This application embodiment does not limit this.

[0197] Figure 5A may show: the video playback interface, and the selection trajectory 501. The selection trajectory 501 may be determined based on operation 1, and may include: the portrait of expert A (or image 3).

[0198] Figure 5B shows the video playback interface and the selection box 500.

[0199] Understandably, after displaying Figure 5B, the electronic device can determine the distance between the selected box 500 and the edge of the screen. When the electronic device detects that the distance between the selected box 500 and the right edge of the screen is distance 3 and the distance between the selected box 500 and the left edge of the screen is distance 4, the electronic device can display the service list 505 on the right side of Figure 5C when the distance 3 is less than the distance 4.

[0200] Figure 5C can display: image 502, selected area 503, and service list 505.

[0201] Image 502 can be an image generated by an electronic device after taking a screenshot, reducing its size, and rotating the content displayed in Figure 1A.

[0202] The selected area 503 can display the image selected by the user based on operation 1. For example, the selected area 503 can include image 3.

[0203] The area around the selected region 503 will display the selected identifier 5000.

[0204] Button 506 can be displayed around the selected area 503 (such as directly below the selected area 503), and button 506 is in an unselected state. The meaning of button 506 can be found in the description of button 408 in Figure 4C, and will not be repeated here.

[0205] In response to a user's click on button 506, the electronic device can display an interface similar to that in Figure 4E to crop image 3.

[0206] Service list 505 is a service pushed based on image 3 in the selected area 503. The content in service list 505 can be the same as the content in service list 409 in Figure 4D, and will not be described again here.

[0207] Optionally, in response to a user clicking any service button in the service list 505, the electronic device can send image 3 to the service window, which is not shown in the figure.

[0208] Combining the interfaces shown in Figure 5C and Figure 4C, when the selected area contains only an image, the electronic device can display button 506 around the selected area; or, when the selected area contains text, the electronic device can display button 407 and button 408 around the selected area.

[0209] Method C: Select text and images using a knuckle-based selection tool.

[0210] Understandably, in response to a user selecting text and an image using their knuckle, when the electronic device detects that the area of ​​the text region is larger than the area of ​​the image region, the electronic device can define the text region and push text-related services (see Figures 6A, 4B, and 4C).

[0211] Alternatively, when the electronic device detects that the area of ​​the text region is smaller than the area of ​​the image region, the electronic device can define the image region and push image-related services, as described in Figures 6B, 5B, and 5C.

[0212] Alternatively, when an electronic device detects that the area of ​​the text region is the same as or nearly the same as the area of ​​the image region, it can simultaneously define both the text and image regions and prioritize pushing image-related services, as described in Figures 6C-6F. In other words, in a screenshot selection scenario, in response to the user dragging the screenshot to the edge of the screen, the electronic device can open any door and push image-related services. To maintain a consistent user experience, the electronic device can prioritize pushing image-related services when it detects that the area of ​​the text region is the same as the area of ​​the image region within the selected area.

[0213] In one implementation of method C, in response to user operation 1 on the text and image in Figure 1A (while the user is still holding their hand), the electronic device can display the interface shown in Figure 6A. After operation 1 is completed, the electronic device can sequentially display the interface shown in Figure 4B and the interface shown in Figure 4C.

[0214] Figure 6A shows the video playback interface and the selected trajectory 601. The content of the selected trajectory 601 can include text and images. The text can be displayed as "June 6, 2024, XX City... Introduced to everyone here", and the image can be a part of the portrait of expert A.

[0215] Understandably, in response to user operation 1 on the text and image in Figure 1A, the electronic device can determine the region A defined based on operation 1. When the area of ​​the text region in region A is larger than the area of ​​the image region, the electronic device can select the text by drawing a box and then sequentially display the interface shown in Figure 4B and the interface shown in Figure 4C. Region A can be understood as the area containing the text and image within the selection trajectory 601. Region A can be a rectangle or a rounded rectangle, and it may not be displayed on any interface.

[0216] In another implementation of method C, in response to user operation 1 on the text and image in Figure 1A (while the user is still holding their hand), the electronic device can display the interface shown in Figure 6B. After operation 1 is completed, the electronic device can sequentially display the interface shown in Figure 5B and the interface shown in Figure 5C.

[0217] Figure 6B shows the video playback interface and the selected trajectory 602. The content of the selected trajectory 602 can include text and images. The text can be displayed as words such as "famous," "based on," "created," and "company," and the image can be the portrait of expert A.

[0218] Understandably, in response to user operation 1 on the text and image in Figure 1A, the electronic device can determine the region B defined based on operation 1. When the area of ​​the text region in region B is smaller than the area of ​​the image region, the electronic device can define the image region by selecting the region and sequentially display the interface shown in Figure 5B and the interface shown in Figure 5C. Region B can be understood as the area containing the text and image within the selection trajectory 602. Region B can be a rectangle or a rounded rectangle, and it may not be displayed on either interface.

[0219] In another implementation of method C, in response to user operation 1 on the text and image in Figure 1A (while the user is still holding their hand), the electronic device can display the interface shown in Figure 1C. After operation 1 is completed, the electronic device can sequentially display the interface shown in Figure 6C and the interface shown in Figure 6D.

[0220] Understandably, in response to user operation 1 on the text and image in Figure 1A, the electronic device can determine the region C defined based on operation 1. When the area of ​​the text region in region C is equal to the area of ​​the image region, the electronic device defines the image and text by selecting the region. For example, the electronic device can display a selection box 603 in Figure 6C, which can include region C. Furthermore, the electronic device can display the interface shown in Figure 6D.

[0221] Region C can be understood as the area containing the text and images in the selected trajectory 103. Region C can be a rectangle or a rounded rectangle. Region C can be the area defined by the selection box 603 in Figure 6C.

[0222] Figure 6D can display: image 604, selected area 606, and service list 605.

[0223] Image 604 can be an image generated by an electronic device after taking a screenshot, reducing its size, and rotating the content displayed in Figure 1A.

[0224] The selected area 606 covers the image 604, and the selected area 606 can display the text and image selected by the user based on operation 1.

[0225] Optionally, the text within the selected area 606 can be highlighted, such as by displaying an underline or similar content below the text in the selected area 606, which is not shown in Figure 6D.

[0226] The selected area 606 can be surrounded by the selected marker 701.

[0227] Buttons 607 and 608 can be displayed around the selected area 606 (e.g., directly below the selected area 606). Button 607 and button 608 can both be in an unselected state. The meaning of button 607 can be found in the description of button 407 in Figure 4C, and the meaning of button 608 can be found in the description of button 408 in Figure 4C; they will not be repeated here.

[0228] Understandably, in response to user operation 1 on the text and image in Figure 1A, the electronic device can determine that the selected area contains both an image and text based on operation 1. Therefore, the electronic device can display button 607 and button 608 in Figure 6D, both in an unselected state. This allows the user to recognize the text using button 607 and edit the selected area using button 608.

[0229] Optionally, when button 607 is unselected, in response to a user's click on button 611 in the service list 605 of Figure 6D, the electronic device can display the interface shown in Figure 4G. In response to a user's click on User 1 in Figure 4G, the electronic device can display the interface shown in Figure 6F. A dialog message can be displayed in window 433 of Figure 6F, which may include image 4. Image 4 may include text and an image within the selected area 606.

[0230] Optionally, when button 607 is in an unselected state, in response to the user's click operation on button 611 in the service list 605 of Figure 6D, the electronic device can send the text in the selected area 606 to the service corresponding to button 611, and send the image in the selected area 606 to the service corresponding to button 611.

[0231] Service list 605 can push content based on images within the selected area 606 in Figure 6D. The content of service list 605 is the same as that of service list 505, and will not be repeated here. It can be understood that when the selected area contains both text and images, the electronic device can prioritize pushing image-related content to service list 605.

[0232] Optionally, if the selected area contains both text and images, the electronic device can simultaneously push services related to both text and images in the service list 605.

[0233] In response to a user's click on button 607 in Figure 6D, the electronic device can recognize the text in the selected area 606 and then display the interface shown in Figure 6E.

[0234] Figure 6E can display: image 604, selected area 609, and service list 610.

[0235] The selected area 609 covers the image 604. The selected area 609 can display the text in the selected area 606, label 405, and label 406. The functions of label 405 and label 406 are described in Figure 4C. For example, the electronic device can change the selected area based on a user's drag operation on label 405 and / or label 406.

[0236] Buttons 607 and 608 can be displayed around the selected area 609 (such as directly below the selected area 609). Button 607 can be selected, and button 608 can be unselected.

[0237] For example, when button 607 is selected, the electronic device can send the text in the selected area 609 to the service corresponding to the button based on the user's click operation on any button in the service list 610.

[0238] Service list 610 can be based on text pushes in the selected area 609 of Figure 6E. The content of service list 610 is the same as that of service list 404, and will not be described again here.

[0239] Optionally, a selection marker can also be displayed around the selected area 609. The electronic device can also modify the selected area based on the user's drag operation on the selected marker. For details, please refer to the descriptions in Method A-Method B, which will not be repeated here.

[0240] Optionally, in response to a user's click on button 608 in Figure 6E, the electronic device displays the interface shown in Figure 6J.

[0241] Optionally, in response to a user's click on button 608 in Figure 6D, the electronic device can display the interface shown in Figure 6I. Figure 6I may display: image 4 and selection indicator 701. Other content displayed in this interface may be similar to that in Figure 4E, and will not be described again here.

[0242] In response to a user's adjustment of the size and / or position of the selection marker 701 in Figure 6I, the electronic device can display the interface shown in Figure 6J. Figure 6J can display the adjusted image 5, and the selection marker 701 surrounding image 5. In response to a user's click on the save button in Figure 6J, the electronic device can save image 5 to the gallery application.

[0243] Optionally, referring to the descriptions in Figures 6C-6F, the electronic device can also highlight the text in the selected area, in which case buttons 607 and 608 are not displayed. For example, in response to user operation 1 on the text and image in Figure 1A (while the user has not released their hand), the electronic device can display the interface shown in Figure 1C. After operation 1 is completed, the electronic device can sequentially display the interface shown in Figure 6C and the interface shown in Figure 6G.

[0244] Compared to Figure 6D, buttons 607 and 608 may not be displayed in Figure 6G. The text within the selected area 606 is highlighted, which may include text highlighting and / or an underline below the text. The text within the selected area 606 is allowed to be triggered.

[0245] In response to a user's button press on any of the services in Figure 6G, the electronic device can send the content in the selected area 606 as an image to any of the services.

[0246] Alternatively, in response to a user's click on the text in the selected area 606 of Figure 6G, the electronic device can display the interface shown in Figure 6H.

[0247] Compared to Figure 6E, buttons 607 and 608 may not be displayed in Figure 6H. The text in the selected area 609 is highlighted. Optionally, labels 405 and 406 may also be displayed in the selected area 609 of Figure 6H, but are not shown in Figure 6H.

[0248] In response to a user's button press on any of the services in Figure 6H, the electronic device can send the text in the selected area 609 to any of the services.

[0249] In this way, electronic devices can provide multiple ways to select text in text and images, making it convenient for users to quickly select text and send it to the appropriate service.

[0250] 3. Adjust the selected area

[0251] It is understood that electronic devices can provide multiple ways to modify the selected area, as described in Methods 1-3 below.

[0252] Method 1: The electronic device displays the interface shown in Figure 6D. In response to a user's trigger action on the selection marker 701 around the dragged selection area 606 (while the user is still holding the selection), the electronic device can display the interface shown in Figure 7A. Furthermore, while the trigger action continues on the selection marker 701, in response to the user's action of moving the selection marker 701 to the right (while the user is still holding the selection), the electronic device can display the interface shown in Figure 7C. Further, after the user releases the selection marker, the electronic device can display the interface shown in Figure 6E.

[0253] As the user moves the selected marker 701 to the right, the electronic device can gradually switch from Figure 7A to Figure 7B. Figure 7C is displayed after the user finishes moving the selected marker 701.

[0254] Compared to Figure 6D, buttons 607 and 608 may not be displayed in Figure 7A. Figure 7A may display: image 604, service list 605, and selection area 606. The contents of selection area 606, image 604, and service list 605 can be found in the description of Figure 6D.

[0255] Figure 7B can display: image 604, selected area 702, and service list 605.

[0256] The selected area 702 can display text and a portion of an image, such as a portion of Expert A's portrait, like the right side of Expert A's portrait. The content within the selected area 702 is displayed without tilt, while the area outside the selected area 702 in image 604 is displayed tilted. The area of ​​the selected area 702 can be smaller than the area of ​​the selected area 606.

[0257] Compared to Figure 6E, buttons 607 and 608 may not be displayed in Figure 7C. Figure 7C may display: image 604, selection area 609, and service list 605. The area of ​​selection area 609 may be smaller than the area of ​​selection area 702.

[0258] Referring to the descriptions in Figures 7A-7C, it can be understood that while the user is operating on the selected indicator 701, the electronic device can continue to display the image 604 and the service list 605, with the content in the service list 605 remaining unchanged. When the user finishes adjusting the selected area, the electronic device can also re-identify the content in the selected indicator 701 and then push the relevant services as shown in Figure 6E.

[0259] Method 2: The electronic device displays the interface shown in Figure 6D. In response to a user's trigger action on the selection marker 701 around the dragged selection area 606 (while the user is still holding the selection), the electronic device can display the interface shown in Figure 7D. Furthermore, while the trigger action continues on the selection marker 701, in response to the user's action of moving the selection marker 701 to the right (while the user is still holding the selection), the electronic device can display the interface shown in Figure 7F. Furthermore, after the user releases the selection marker, the electronic device can display the interface shown in Figure 6E.

[0260] As the user moves the selected identifier 701 to the right, the electronic device can gradually switch from Figure 7D to Figure 7E. Figure 7F is displayed after the user finishes moving the selected identifier 701.

[0261] Compared to Figure 6D, buttons 607 and 608, as well as image 604, may not be displayed in Figure 7D.

[0262] Figure 7D shows: image 703, service list 605, and selected area 606. Image 703 can be a result of cropping and reducing the size of the content displayed in Figure 1A. The content in image 703 is displayed without tilting. The content contained in selected area 606 and service list 605 can be found in the description of Figure 6D. "Without tilting" means displayed vertically and upright without any tilting or italic effects.

[0263] Figure 7E shows: image 703, selected area 702, and service list 605. The contents of selected area 702 can be found in the description in Figure 7B.

[0264] Compared to Figure 6E, Figure 7F may omit button image 604, button 608, and button 608.

[0265] Figure 7F shows: image 703, selected area 609, and service list 605. The contents of selected area 609 can be found in the description of Figure 7C.

[0266] Referring to the descriptions in Figures 7D-7F, it can be understood that the electronic device can display the interface shown in Figure 7D when it detects any user action on the selected marker, ensuring that the content in image 703 is displayed without tilting, making it easier for the user to view and edit the content. Furthermore, while the user is operating on the selected marker 701, the electronic device can continue to display image 703 and the service list 605, with the content in service list 605 remaining unchanged. When the user finishes adjusting the selected area, the electronic device can also re-identify the content in the selected marker 701 and then push relevant services as shown in Figure 6E.

[0267] Method 3: The electronic device displays the interface shown in Figure 6D. In response to a user's trigger operation on the selection marker 701 surrounding the drag-and-drop selection area 606 (while the user is still holding the selection marker), the electronic device can display the interface shown in Figure 7D. Furthermore, while the trigger operation continues to act on the selection marker 701, in response to a user's drag operation to the right moving the selection marker 701 (while the user is still holding the selection marker), the electronic device can sequentially display the interfaces shown in Figure 7H and Figure 7I. Further, after the drag operation ends (when the user releases the selection marker), the electronic device can display the interface shown in Figure 6E.

[0268] Figure 7G can display: image 704, and the selected area 606.

[0269] Image 704 can be an image generated after cropping and shrinking the content displayed in Figure 1A. The content displayed in Image 704 is not tilted.

[0270] The area 606 can be surrounded by a selection indicator 701. The meaning of the area 606 and the selection indicator 701 can be found in the description of Figure 7A.

[0271] Understandably, during the adjustment of the selected area, the electronic device can hide the service list on the interface and only display image 704, allowing the user to edit the selected area of ​​image 704 within a larger area.

[0272] Optionally, the area of ​​image 704 can be smaller than the area of ​​the display screen, or the area of ​​image 704 can be equal to the area of ​​the display screen. Image 704 can be placed adjacent to any edge of the display screen. The area of ​​image 704 can be larger than the area of ​​image 703.

[0273] Figure 7H shows: image 704 and the selected area 702.

[0274] Figure 7G can display: image 704, and the selected area 609.

[0275] Based on the descriptions in Figures 7G-7I and 6E, it can be understood that the electronic device can display the interface shown in Figure 7G when it detects any user action on the selected identifier. This ensures that the content in image 703 is displayed without tilting, and image 703 is displayed to the maximum extent possible within the interface, facilitating user viewing and editing. Furthermore, while the user is operating on the selected identifier 701, the electronic device does not display the service list. After the user finishes operating on the selected identifier 701, the electronic device can re-identify the content in the selected identifier 701 and then display the service list, such as pushing relevant services in the service list 610 of Figure 6E.

[0276] It is understood that Figures 7A-7I can be used as illustrations of an electronic device adjusting an image within a selected area based on a selection marker. When the selected area contains only text, the electronic device can also adjust the text within the selected area using any of the methods in Method 3-Method 4.

[0277] For example, when the selected area contains only text, the electronic device can adjust the text in the selected area based on method 3, as described in Figures 7J-7L.

[0278] For example, the electronic device displays the interface shown in Figure 6E. In response to a user's trigger operation on identifier 406 (while the user has not released their finger), the electronic device can display the interface shown in Figure 7J. Furthermore, while the trigger operation continues to act on identifier 406, in response to a user's drag operation of moving identifier 406 downwards (while the user has not released their finger), the electronic device can display the interface shown in Figure 7K. Furthermore, after the drag operation ends (when the user releases their finger), the electronic device can display the interface shown in Figure 7L.

[0279] Figure 7J shows image 704 and a selected area 609. The selected area 609 can display identifiers 405 and 406. The meanings of identifiers 405 and 406 can be found in the description of Figure 6E.

[0280] Figure 7K can display: image 704 and a selected area 705, the area of ​​which can be larger than the area of ​​selected area 609. Selected area 705 can display: logo 405 and logo 406, logo 405 can be located at the beginning of the text in selected area 705, and logo 406 can be located at the end of the text in selected area 705.

[0281] Compared to Figure 6E, Figure 7L can display the selected area 705. The other content displayed in Figure 7L is similar to that in Figure 6E, and will not be described again here.

[0282] Optionally, a selection marker can also be displayed around the selected area 609 in Figure 6E, and the electronic device can adjust the selected area based on the user's operation on the selected marker. For example, in response to a user's trigger operation on the selected marker (while the user has not released their finger), the electronic device can display the interface shown in Figure 7J. Furthermore, while the trigger operation continues to act on the selected marker, in response to a user's drag operation to move the selected marker 701 downwards (while the user has not released their finger), the electronic device can display the interface shown in Figure 7K. Furthermore, after the drag operation ends (while the user releases their finger), the electronic device can display the interface shown in Figure 7L.

[0283] 4. Guidance scheme for entering the Anywhere Door

[0284] It is understandable that electronic devices can provide prompts based on Figures 8A-8C when they detect that a user has entered any door for the first time.

[0285] For example, in response to user action 1 on the text and image in Figure 1A (while the user is still holding the device), the electronic device can display the interface shown in Figure 1C. After action 1 is completed, the electronic device can display the interface shown in Figure 8A when it detects the first entry into the door; or, when the electronic device detects that the user has not entered the door for the first time, it can sequentially display the interface shown in Figure 6C and the interface shown in Figure 6D.

[0286] Optionally, in response to user operation 1 on the text and image in Figure 1A (while the user is still holding the device), the electronic device can display the interface shown in Figure 1C. After operation 1 is completed, the electronic device can display the interface shown in Figure 8C when it detects the first entry into the "anywhere door," but this is not limited in this embodiment.

[0287] It is understood that the electronic device may display Figure 8B and then Figure 8C sequentially after displaying Figure 8A. Alternatively, the electronic device may display Figure 8B in response to a user's click on the prompt information 801 in Figure 8A. The electronic device may display Figure 8C in response to a user's click on the prompt information 802 in Figure 8B; however, this embodiment does not limit the scope of the application.

[0288] Figure 8A shows: Prompt message 801, which can be used to prompt the user to adjust the screenshot range by dragging the edge.

[0289] Figure 8B shows: Prompt message 802, which can be used to prompt the user to select text by long-pressing.

[0290] Figure 8C may display: Prompt message 803, which can be used to prompt the user to share the content in the selected area by clicking the service icon.

[0291] Other content shown in Figures 8A, 8B, and 8C can be found in the description of Figure 6D, and will not be repeated here.

[0292] To more clearly illustrate the method provided in the embodiments of this application, Figure 9 is a flowchart illustrating an interface display method provided in an embodiment of this application. As shown in Figure 9, the interface display method may include the following steps:

[0293] S901, Display the first interface, which includes the displayed content.

[0294] The first interface can be the interface shown in Figure 1A.

[0295] S902, In response to the first operation of selecting the first area in the first interface, the second interface is displayed.

[0296] The first area includes text and images, and the second interface includes a first identifier for defining the text and images, display content, a first button, and a button for a first service. The first button is used to identify the text in the first area, and the first service is a service that pushes content based on the first area.

[0297] The first region can be the area in Figure 1A that contains text and images.

[0298] The first operation can be the knuckle selection operation.

[0299] The second interface can be the interface shown in Figure 6D, the first identifier can be the selection identifier 701 in Figure 6D, the first button can be the button 607 in Figure 6D, and the button for the first service can be the button 611 in Figure 6D.

[0300] S903. After displaying the second interface, in response to the second operation of the button for the first service, the first image is sent to the first service.

[0301] The second operation can be a click operation on button 611.

[0302] The first image includes text and a picture, and the first image can be picture 4 in Figure 6F.

[0303] Understandably, after the electronic device sends the first image to the first service, the electronic device can display image 4 in window 433 of Figure 6F.

[0304] S904. After displaying the second interface, in response to a third operation on the first button, display the third interface.

[0305] The third interface includes: a second identifier for defining text, display content, a first button, and a button for a second service, which is a text-based push service.

[0306] The third operation can be a click operation on button 607 in Figure 6D.

[0307] The third interface can be the interface shown in Figure 6E. The first button can also be button 607 in Figure 6E. The second identifier can be identifier 405 and identifier 406 in Figure 6E. The button for the second service can be the social service button in Figure 6E.

[0308] It is understandable that the first service and the second service can be the same or different.

[0309] S905, In response to the fourth operation of the button for the second service, text is sent to the second service.

[0310] The fourth operation can be a click operation on the social service button in Figure 6E.

[0311] It is understandable that after the electronic device sends the text to the second service, the electronic device can display the selected text in window 433 of Figure 6F, which is not shown in Figure 6E.

[0312] It should be noted that the interface provided in this application embodiment is only an example and does not constitute a limitation on the embodiments of this application.

[0313] It should be noted that the module names involved in the embodiments of this application can all be defined as other names, as long as they can achieve the function of each module, and no specific restrictions are placed on the module names.

[0314] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in the embodiments of this application are all information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and corresponding operation entry points are provided for users to choose to authorize or refuse.

[0315] The display method of the embodiments of this application has been described above. The apparatus for performing the above method provided in the embodiments of this application is described below. Those skilled in the art will understand that the methods and apparatus can be combined and referenced with each other, and the related apparatus provided in the embodiments of this application can perform the steps in the above list sorting method.

[0316] Figure 10 is a schematic diagram of the hardware structure of another electronic device provided in an embodiment of this application.

[0317] The electronic device includes a processor 1001, a communication line 1004, and at least one communication interface (in FIG10, communication interface 1003 is used as an example for illustration).

[0318] The processor 1001 may be a general-purpose CPU, a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits used to control the execution of the program of the present application.

[0319] The communication line 1004 may include circuitry for transmitting information between the aforementioned components.

[0320] Communication interface 1003 uses any transceiver-like device for communicating with other devices or communication networks, such as Ethernet, wireless local area networks (WLAN), etc.

[0321] Possibly, the electronic device may also include a memory 1002.

[0322] The memory 1002 may be a read-only memory (ROM) or other type of static storage device capable of storing static information and instructions, random access memory (RAM) or other type of dynamic storage device capable of storing information and instructions, or electrically erasable programmable read-only memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compressed optical discs, laser discs, optical discs, digital universal optical discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or any other medium capable of carrying or storing desired program code in the form of instructions or data structures and accessible by a computer, but not limited thereto. The memory may exist independently and be connected to the processor via communication line 1004. The memory may also be integrated with the processor.

[0323] The memory 1002 stores computer execution instructions for implementing the scheme of this application, and the processor 1001 controls the execution. The processor 1001 executes the computer execution instructions stored in the memory 1002 to implement the method provided in the embodiments of this application.

[0324] It is possible that the computer execution instructions in the embodiments of this application may also be referred to as application code, and the embodiments of this application do not specifically limit this.

[0325] In a specific implementation, as one embodiment, the processor 1001 may include one or more CPUs, such as CPU0 and CPU1 in FIG10.

[0326] In a specific implementation, as one embodiment, the electronic device may include multiple processors, such as processor 1001 and processor 1005 in FIG. 10. Each of these processors may be a single-core (single-CPU) processor or a multi-core (multi-CPU) processor. Here, a processor may refer to one or more devices, circuits, and / or processing cores for processing data (e.g., computer program instructions).

[0327] The display method provided in this application can be applied to electronic devices with communication functions. Electronic devices include terminal devices, and the specific device form of the terminal device can be referred to the above-described related descriptions, which will not be repeated here.

[0328] This application provides a terminal device, which includes a processor and a memory; the memory stores computer execution instructions; the processor executes the computer execution instructions stored in the memory, causing the terminal device to perform the above-described method.

[0329] This application provides a chip. The chip includes a processor, which is used to call a computer program in memory to execute the technical solutions in the above embodiments. Its implementation principle and technical effects are similar to those in the related embodiments described above, and will not be repeated here.

[0330] This application also provides a computer-readable storage medium. The computer-readable storage medium stores a computer program. When the computer program is executed by a processor, it implements the methods described above. The methods described in the above embodiments can be implemented wholly or partially by software, hardware, firmware, or any combination thereof. If implemented in software, the functionality can be stored as one or more instructions or code on or transmitted over the computer-readable medium. The computer-readable medium can include computer storage media and communication media, and can also include any medium that can transfer a computer program from one place to another. The storage medium can be any target medium accessible by a computer.

[0331] In one possible implementation, a computer-readable medium may include RAM, ROM, compact disc read-only memory (CD-ROM) or other optical disc storage, disk storage or other magnetic storage devices, or any other medium targeted to carry or to store the required program code in the form of instructions or data structures, and accessible by a computer. Furthermore, any connection is appropriately referred to as a computer-readable medium. For example, if software is transmitted from a website, server, or other remote source using coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave, then coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of medium. As used herein, disks and optical discs include optical discs, laser discs, optical discs, Digital Versatile Discs (DVDs), floppy disks, and Blu-ray discs, where disks typically reproduce data magnetically, while optical discs optically reproduce data using lasers. Combinations of the above should also be included within the scope of computer-readable media.

[0332] This application provides a computer program product, which includes a computer program that, when run, causes a computer to perform the above-described method.

[0333] This application describes embodiments with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processing unit of a general-purpose computer, special-purpose computer, embedded processor, or other programmable device to produce a machine, such that the instructions, which execute via the processing unit of the computer or other programmable data processing device, create means for implementing the functions specified in one or more flowchart illustrations and / or one or more block diagrams.

[0334] The above specific embodiments further illustrate the purpose, technical solution, and beneficial effects of the present invention. It should be understood that the above are merely specific embodiments of the present invention and are not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc., made on the basis of the technical solution of the present invention should be included within the scope of protection of the present invention.

Claims

1. A display method, characterized in that, include: Display a first interface, the first interface including displayed content; In response to a first operation that selects a first area in the first interface, a second interface is displayed. The first area includes text and an image. The second interface includes a first identifier for defining the text and the image, the display content, a first button, and a button for a first service. The first button is used to identify the text in the first area, and the first service is a service that pushes content based on the first area. After the second interface is displayed, in response to a second operation of the button for the first service, a first image is sent to the first service, the first image including the text and the image; After the second interface is displayed, in response to a third operation on the first button, a third interface is displayed, the third interface including: a second identifier for defining the text, the display content, the first button, and a button for a second service, the second service being a service pushed based on the text; In response to a fourth action on the button for the second service, the text is sent to the second service.

2. The method according to claim 1, characterized in that, The second interface also includes a third button, and the method further includes: In response to an operation on the third button, a fourth interface is displayed, the fourth interface including: the first image, and the first identifier used to frame the first image; In response to a fifth operation that adjusts the size and / or position of the first identifier in the fourth interface, a fifth interface is displayed, the fifth interface including: a third identifier for indicating a second region in the first image, and a fourth button; In response to the operation of the fourth button, the image corresponding to the second area is saved to a preset application.

3. The method according to claim 1 or 2, characterized in that, After displaying the second interface, the method further includes: In response to a sixth operation on the first identifier, a sixth interface is displayed, the sixth interface including: the display content, the first image, and the first identifier for framing the first image, wherein the area occupied by the display content in the second interface is smaller than the area occupied by the display content in the sixth interface; In response to a seventh operation that adjusts the size and / or position of the first identifier in the sixth interface, a seventh interface is displayed, which includes: the displayed content, a fourth identifier for indicating a third region in the first image, and a button for a third service. The third region is the region selected after adjustment by the seventh operation, and the third service is a service pushed based on the content in the third region.

4. The method according to claim 3, characterized in that, Before the sixth operation, the displayed content is displayed at an angle on the second interface; after the sixth operation, the displayed content is displayed without an angle on the sixth interface.

5. The method according to claim 1 or 2, characterized in that, The method further includes: In response to an eighth operation that adjusts the size and / or position of the first identifier in the second interface, an eighth interface is displayed, the eighth interface including: the displayed content, a fifth identifier for indicating a fourth region, and a button for a fourth service, the fourth region being the region selected after adjustment by the eighth operation. Before the eighth operation, the displayed content is displayed at an angle in the second interface, and after the eighth operation, the displayed content is displayed at an angle in the eighth interface.

6. The method according to claim 1 or 2, characterized in that, The method further includes: In response to a ninth operation targeting the first identifier, a ninth interface is displayed, the ninth interface including: the display content, the first image, the first identifier for framing the first image, and a button for the first service; In response to a ninth operation that adjusts the size and / or position of the first identifier in the ninth interface, a tenth interface is displayed, the tenth interface including: the displayed content, a fifth identifier for indicating a fifth region, and a button for a fifth service, the fifth region being the region selected after adjustment by the ninth operation.

7. The method according to claim 6, characterized in that, Before the ninth operation, the displayed content is displayed at an angle on the second interface; after the ninth operation, the displayed content is displayed without an angle on the ninth interface.

8. The method according to any one of claims 1-7, characterized in that, The third interface also includes a third button. After displaying the third interface, the method further includes: In response to an operation on the third button, an eleventh interface is displayed, which includes: a second image generated based on the text, a second identifier for framing the second image, and a fourth button; In response to an action on the fourth button, the second image is saved to a preset application.

9. The method according to any one of claims 1-8, characterized in that, After displaying the first interface, the method further includes: In response to the selection of the sixth area in the first interface, the twelfth interface is displayed. The sixth area includes the image. The twelfth interface includes a sixth identifier for framing the image, the display content, a third button, and a sixth service. The third button is used to crop the image, and the sixth service is a service that pushes content based on the sixth area.

10. The method according to any one of claims 1-9, characterized in that, The second identifier includes a seventh identifier for indicating the start position of the text and an eighth identifier for indicating the end position of the text, wherein the seventh identifier is in a first position and the eighth identifier is in a second position. After displaying the third interface, the method further includes: In response to the operation of moving the seventh identifier to the third position, a thirteenth interface is displayed. The thirteenth interface includes: text between the third position and the second position, the seventh identifier at the third position, the eighth identifier at the second position, the display content, the first button, and a button for the seventh service. The seventh service is a service pushed based on the text between the third position and the second position. The third position is located at any position in the display content other than the first area.

11. The method according to any one of claims 1-10, characterized in that, Before the second operation, the first button was unselected; after the second operation, the first button was selected.

12. The method according to any one of claims 1-11, characterized in that, Before displaying the first interface, the method further includes: In response to an operation to open the settings interface of the first function from the settings app, a fourteenth interface is displayed, which includes a fifth button and a sixth button; In response to the operation of the fifth button, the operation to activate the first function is set to a knuckle selection operation; In response to an operation on the sixth button, a fifteenth interface is displayed, which is used to view other settings related to the knuckle selection operation. The fifteenth interface includes a seventh button. In response to an action on the seventh button, the fourteenth interface is displayed.

13. The method according to any one of claims 1-12, characterized in that, The first service includes one or more of the following: a service for saving images, or a service for editing images.

14. An electronic device, characterized in that, The electronic device includes: one or more processors and memory; The memory is coupled to the one or more processors, the memory being used to store computer program code, the computer program code including computer instructions, the one or more processors invoking the computer instructions to cause the electronic device to perform the method as described in any one of claims 1 to 13.

15. A chip system, characterized in that, The chip system is applied to an electronic device, the chip system including one or more processors, the one or more processors being used to invoke computer instructions to cause the electronic device to perform the method as described in any one of claims 1 to 13.

16. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes computer instructions that, when executed on an electronic device, cause the electronic device to perform the method as described in any one of claims 1 to 13.

17. A computer program product, characterized in that, The computer program product includes computer program code that, when run on an electronic device, causes the electronic device to perform the method as described in any one of claims 1 to 13.

Citation Information

Patent Citations

  • Information display method, system and device and information acquisition method, system and device

    CN110866796A

  • Application recommendation method

    CN115016710A

  • Application program recommendation method and electronic equipment

    CN115033153A

  • Information search method and device, equipment and storage medium

    CN115033658A

  • Application recommendation method

    CN116126197A